-- Logs begin at Tue 2022-07-26 13:10:18 UTC, end at Tue 2022-07-26 15:51:27 UTC. -- Jul 26 13:51:57.400464 n-d-833090-9 systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 13:51:57.409652 n-d-833090-9 devstack@n-api.service[103938]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 13:51:57.412071 n-d-833090-9 devstack@n-api.service[103938]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 13:51:57 2022] *** Jul 26 13:51:57.412071 n-d-833090-9 devstack@n-api.service[103938]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 13:51:57.412071 n-d-833090-9 devstack@n-api.service[103938]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 13:51:57.412071 n-d-833090-9 devstack@n-api.service[103938]: nodename: n-d-833090-9 Jul 26 13:51:57.412071 n-d-833090-9 devstack@n-api.service[103938]: machine: x86_64 Jul 26 13:51:57.412071 n-d-833090-9 devstack@n-api.service[103938]: clock source: unix Jul 26 13:51:57.412071 n-d-833090-9 devstack@n-api.service[103938]: pcre jit disabled Jul 26 13:51:57.412531 n-d-833090-9 devstack@n-api.service[103938]: detected number of CPU cores: 4 Jul 26 13:51:57.412531 n-d-833090-9 devstack@n-api.service[103938]: current working directory: / Jul 26 13:51:57.412531 n-d-833090-9 devstack@n-api.service[103938]: detected binary path: /usr/bin/uwsgi-core Jul 26 13:51:57.412531 n-d-833090-9 devstack@n-api.service[103938]: your processes number limit is 47680 Jul 26 13:51:57.412531 n-d-833090-9 devstack@n-api.service[103938]: your memory page size is 4096 bytes Jul 26 13:51:57.412531 n-d-833090-9 devstack@n-api.service[103938]: detected max file descriptor number: 2048 Jul 26 13:51:57.412531 n-d-833090-9 devstack@n-api.service[103938]: lock engine: pthread robust mutexes Jul 26 13:51:57.412531 n-d-833090-9 devstack@n-api.service[103938]: thunder lock: enabled Jul 26 13:51:57.412531 n-d-833090-9 devstack@n-api.service[103938]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 13:51:57.412531 n-d-833090-9 devstack@n-api.service[103938]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 13:51:57.451872 n-d-833090-9 devstack@n-api.service[103938]: Python main interpreter initialized at 0x55e1d14149c0 Jul 26 13:51:57.451872 n-d-833090-9 devstack@n-api.service[103938]: python threads support enabled Jul 26 13:51:57.451872 n-d-833090-9 devstack@n-api.service[103938]: your server socket listen backlog is limited to 100 connections Jul 26 13:51:57.451872 n-d-833090-9 devstack@n-api.service[103938]: your mercy for graceful operations on workers is 90 seconds Jul 26 13:51:57.452214 n-d-833090-9 devstack@n-api.service[103938]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 13:51:57.452314 n-d-833090-9 devstack@n-api.service[103938]: *** Operational MODE: preforking *** Jul 26 13:51:57.452573 n-d-833090-9 devstack@n-api.service[103938]: *** uWSGI is running in multiple interpreter mode *** Jul 26 13:51:57.452573 n-d-833090-9 devstack@n-api.service[103938]: spawned uWSGI master process (pid: 103938) Jul 26 13:51:57.452760 n-d-833090-9 systemd[1]: Started Devstack devstack@n-api.service. Jul 26 13:51:57.453890 n-d-833090-9 devstack@n-api.service[103938]: spawned uWSGI worker 1 (pid: 103939, cores: 1) Jul 26 13:51:57.453890 n-d-833090-9 devstack@n-api.service[103938]: spawned uWSGI worker 2 (pid: 103940, cores: 1) Jul 26 13:51:57.453890 n-d-833090-9 devstack@n-api.service[103938]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 13:51:58.125969 n-d-833090-9 devstack@n-api.service[103940]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 13:51:58.151399 n-d-833090-9 devstack@n-api.service[103939]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 13:51:59.313817 n-d-833090-9 devstack@n-api.service[103940]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 13:51:59.313817 n-d-833090-9 devstack@n-api.service[103940]: from cryptography.utils import int_from_bytes Jul 26 13:51:59.314417 n-d-833090-9 devstack@n-api.service[103940]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 13:51:59.314417 n-d-833090-9 devstack@n-api.service[103940]: from cryptography.utils import int_from_bytes Jul 26 13:51:59.540937 n-d-833090-9 devstack@n-api.service[103939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 13:51:59.540937 n-d-833090-9 devstack@n-api.service[103939]: from cryptography.utils import int_from_bytes Jul 26 13:51:59.541555 n-d-833090-9 devstack@n-api.service[103939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 13:51:59.541555 n-d-833090-9 devstack@n-api.service[103939]: from cryptography.utils import int_from_bytes Jul 26 13:52:01.811524 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 13:52:01.812087 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 13:52:01.812239 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 13:52:01.812599 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 13:52:01.812854 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 13:52:01.813236 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.813559 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.813877 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.814193 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.814521 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.814830 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.815148 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.815463 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.815786 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.816066 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.816381 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.816701 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-9 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.817021 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.817327 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.817633 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.817945 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.818248 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.818569 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.818873 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.819375 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.819817 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.820162 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.820472 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.821433 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.821824 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.822127 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.822447 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.822752 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.823075 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.823382 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.823776 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-9 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.824115 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.824426 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.824737 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.825148 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.825458 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.825766 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.826086 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.826407 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.826712 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.827047 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.827365 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.827684 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.828026 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.828330 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.828637 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.828943 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.829260 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.829561 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.829862 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.830109 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.830412 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.830731 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.831050 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.831370 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.831620 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.831869 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.832221 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.832540 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.832845 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.833151 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.833456 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.833763 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.834067 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.834369 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.834670 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.834971 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.835288 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.835600 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.835916 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.836372 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.836945 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.837075 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.837324 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.837631 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.837966 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.838283 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.838589 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.838904 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.839226 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.839530 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.839833 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.840162 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.840481 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.840812 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.841112 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.841359 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.841657 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.841959 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.842275 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.842578 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.842996 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.843308 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.843608 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.843914 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.844245 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.844548 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.844851 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.845154 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.845457 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.845762 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.846066 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.846368 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.846685 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.847001 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.847304 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.847608 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.847911 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.848239 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.848558 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.848863 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.849172 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.849489 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.849792 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.850094 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.850408 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.850712 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.851017 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.851331 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.851630 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.851986 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.852297 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.852602 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.852904 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.853206 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.853507 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.853808 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.854110 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.854411 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.854712 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.855009 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.855321 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.855637 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.855941 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.856269 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.856571 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.856888 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.857221 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.857553 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.857894 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.858207 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.858539 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.858870 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.859191 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.859503 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.859815 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.860165 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.860475 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.860787 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.861096 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.861414 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.861730 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.862057 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.862372 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.862688 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.863006 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.863315 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.863632 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.863968 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.864302 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.864611 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.864954 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.865297 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.865607 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.865930 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.866249 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.866557 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.866865 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.867175 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.868059 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.868391 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.868703 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.869017 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.869327 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.869641 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.869954 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.870264 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.870573 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.870909 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.871222 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.871535 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.871844 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.872193 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.872505 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.872815 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.873122 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.873426 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.873729 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.874033 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.874341 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.874644 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.874962 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.875284 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.875586 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.875914 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.876243 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.876552 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.876860 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.877128 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 13:52:01.877535 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.877633 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 13:52:01.877727 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.877727 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.877892 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 13:52:01.878045 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.878233 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 13:52:01.878337 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.878486 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 13:52:01.878658 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.879129 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.879235 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.879449 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.879558 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.879764 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.880021 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.880115 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.880332 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.880436 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.880637 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.880737 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.880951 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.881041 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.881260 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.881359 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.881570 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.881674 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.881849 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.881938 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.882159 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.882330 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.882477 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-9 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.882568 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.882785 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.882874 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.883181 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.883775 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.884024 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.884188 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.884375 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.884514 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.884644 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.884736 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.884963 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.885054 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.885276 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.885374 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.885591 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.885779 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.885883 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.886085 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.886176 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.886387 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.886478 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.886688 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.886778 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.887018 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.887108 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.887325 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.887417 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.887629 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.887727 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.887931 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.888057 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.888258 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.888357 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.888563 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.888653 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.888863 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.888961 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.889184 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.889274 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-9 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.889499 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.889630 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.889805 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.889944 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.890110 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.890208 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.890413 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.890518 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.890756 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.890848 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.891064 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.891153 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.891406 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.891506 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.891724 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.891817 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.892055 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.892149 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.892376 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.892479 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.892690 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.892779 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.893004 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.893093 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.893315 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.893406 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.893609 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.893706 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.893914 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.894013 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.894216 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.894315 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.894529 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.894620 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.894827 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.894917 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.895127 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.895239 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.895381 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.895480 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.895661 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.895752 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.895994 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.896102 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.896314 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.896405 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.896631 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.896735 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.896878 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.896971 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.897125 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.897303 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.897438 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.897637 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.897751 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.897951 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.898050 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.898272 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.898364 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.898584 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.898712 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.899052 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.899188 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.899339 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.899417 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.899642 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.899776 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.899962 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.900098 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.900266 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.900359 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.900582 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.900674 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.900891 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.900980 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.901206 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.901306 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.901510 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.901609 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.901826 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.901918 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.902131 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.902229 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.902448 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.902538 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.902749 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.902847 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.903059 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.903162 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.903385 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.903475 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.903686 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.903787 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.904023 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.904135 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.904332 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.904423 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.904633 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.904734 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.904935 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.905105 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.905238 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.905340 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.905543 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.905634 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.905848 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.905940 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.906150 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.906240 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.906394 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.906482 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.906690 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.906782 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.906990 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.907092 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.907303 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.907401 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.907604 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.907704 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.907905 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.908011 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.908232 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.908335 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.908527 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.908620 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.908828 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.908918 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.909131 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.909231 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.909434 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.909531 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.909734 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.909871 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.910034 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.910170 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.910332 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.910431 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.910632 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.910730 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.910930 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.911030 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.911228 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.911323 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.911542 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.911633 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.911856 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.911980 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.912182 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.912283 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.912483 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.912573 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.912785 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.912877 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.913085 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.913185 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.913402 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.913491 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.913702 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.913800 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.914001 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.914100 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.914345 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.914518 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.914808 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.914947 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.915130 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.915330 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.915475 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.915747 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.915914 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.916140 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.916386 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.916526 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.916791 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.916951 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.917119 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.917282 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.917429 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.917553 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.917709 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.917847 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.918034 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.918343 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.918432 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.918651 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.918939 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.919040 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.919244 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.919515 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.919677 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.919838 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.920091 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.920205 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.920280 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.920435 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.920551 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.920732 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.920826 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.921045 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.921366 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.921529 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.921676 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.921872 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.922007 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.922243 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.922437 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.922587 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 13:52:01.922875 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.923003 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.923200 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.923489 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.923580 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.923826 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.923917 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.924180 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.924282 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.924510 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.924602 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.924824 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.924924 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.925135 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.925239 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.925446 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.925537 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.925758 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.925848 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.926063 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.926153 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.926373 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.926472 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.926678 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.926767 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.926987 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.927086 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.927293 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.927384 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.927603 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.927694 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.927912 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.928060 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.928245 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.928336 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.928552 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.928652 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.928859 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.928967 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.929176 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.929275 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.929481 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.929570 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.929795 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.929894 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.930655 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.930745 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.930982 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.931108 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.931294 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.931455 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.931601 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.931875 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.931986 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.932224 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.932397 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.932544 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.932641 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.932855 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.932954 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.933165 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.933266 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.933475 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.933576 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.933793 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.933887 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.934122 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.934232 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.934426 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.934516 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.934739 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.934831 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.935040 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.935264 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.935389 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.935481 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.935637 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.935730 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.935941 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.936062 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.936271 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.936369 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.936574 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.936663 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.936885 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.936976 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.937195 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.937282 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.937499 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.937586 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.937807 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.937896 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.938109 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.938207 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.938414 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.938504 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.938715 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.938804 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.939013 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.939100 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.939316 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.939413 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.939616 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.939713 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.939914 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.940098 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.940238 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.940336 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.940556 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.940645 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.940854 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.940949 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.941161 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.941259 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.941463 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.941552 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.941774 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.941860 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.942075 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.942175 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.942375 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.942464 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.942676 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.942771 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.942972 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.943068 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.943277 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.943364 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.943577 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.943673 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.943876 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.944020 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.944218 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.944309 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.944523 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.944612 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.944825 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.944914 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.945144 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.945239 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.945444 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.945533 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.946337 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.946449 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.946676 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.946762 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.947014 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.947103 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.947324 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.947415 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.947636 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.947725 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.947959 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.948064 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.948284 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.948374 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.948587 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.948680 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.948893 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.948990 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.949203 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.949292 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.949512 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.949602 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.949814 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.949915 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.950115 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.950211 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.950420 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.950515 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.950721 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.950818 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.951027 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.951115 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.951334 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.951423 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.951635 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.951725 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.951935 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.952044 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.952256 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.952353 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.952560 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.952651 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.952860 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.952947 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.953159 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.953256 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.953458 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.953548 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.953758 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.953847 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.954058 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.954147 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.954375 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.954477 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.954680 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.954769 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.954981 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.955079 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.955279 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.955368 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.955578 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.955666 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.955883 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.956027 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.956221 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.956310 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.956523 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.956612 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.956826 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.956923 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.957145 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.957234 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.957456 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.957544 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.957766 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.957862 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.958074 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.958160 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.958386 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.958475 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.958695 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.958785 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.958997 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.959091 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.959302 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.959388 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.959614 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.959708 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.959918 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.960072 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.960249 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.960338 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.960553 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.960642 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.960858 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.960954 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.961165 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.961302 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.961585 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.961721 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.961888 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.962233 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.962328 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.962573 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.962709 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.962903 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.963182 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.963272 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.963523 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.963664 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.963831 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.964004 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.964172 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.964317 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.964479 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.964644 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.964786 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.964954 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.965091 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.965261 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.965397 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.965569 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.965710 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.965874 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.966015 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.966183 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.966328 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.966485 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.966629 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.966916 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.967007 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.967225 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.967323 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.967532 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.967621 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.967829 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.967917 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.968160 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.968262 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.968468 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.968557 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.968781 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.968869 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.969090 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.969191 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.969392 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.969481 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.969704 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.969792 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.970012 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.970118 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.970316 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.970405 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.970621 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.970710 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.970922 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.971012 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.971223 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.971315 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.971527 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.971616 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.971836 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.971927 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.972165 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.972256 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.972471 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.972559 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.972771 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.972859 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.973078 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.973167 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.973379 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.973466 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.973676 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.973773 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.973975 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.974097 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.974282 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.974407 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.974600 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.974696 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.974906 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.975109 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.975224 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.975419 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.975541 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.975728 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.975841 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.976071 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.976163 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.976394 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.976484 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.976714 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.976812 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.977055 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.977201 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.977363 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.977603 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.977704 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.977787 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.977979 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.978078 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.978300 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.978388 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.978607 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.978695 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.978919 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.979018 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.979221 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.979350 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.979546 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.979643 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.979846 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.979964 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.980177 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.980267 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.980484 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.980574 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.980802 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.980900 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.981112 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.981240 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.981417 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.981505 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.981725 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.981824 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.982031 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.982127 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.982336 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.982425 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.982641 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.982730 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.982958 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.983046 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.983263 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.983358 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.983566 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.983661 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.983868 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.984028 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.984192 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.984292 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.984497 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.984587 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.984802 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.984889 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.985113 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.985368 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.985458 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.985697 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.985793 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.986010 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.986099 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.986310 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.986399 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.986628 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.986716 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.986936 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.987024 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.987258 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.987356 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.987578 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.987666 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.987881 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.987987 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.988224 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.988398 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.988528 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.988617 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.988831 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.988918 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.989130 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.989227 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.989434 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.989529 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.989737 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.989941 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.990039 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.990258 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.990347 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.990581 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.990672 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.990899 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.990994 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.991198 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.991291 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.991498 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.991587 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.991797 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.991895 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.992128 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.992217 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.992428 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.993080 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.993328 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.993425 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.993636 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.993743 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.993956 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.994045 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.994261 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.994350 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.994562 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.994650 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.994861 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.994961 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.995162 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.995251 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.995498 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.995587 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.995797 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.995885 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.996125 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.996217 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.996435 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.996532 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.996742 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.996839 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.997065 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.997154 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.997364 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.997451 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.997684 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.997780 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.997981 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.998070 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.998281 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.998370 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.998583 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.998679 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.998886 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.998980 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.999191 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.999289 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.999490 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.999588 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.999797 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:01.999887 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.000126 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.000217 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.000432 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.000533 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.000737 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.000826 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.001034 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.001122 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.001337 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.001473 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.001637 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.001726 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.001945 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.002037 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.002247 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.002345 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.002545 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.002640 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.002842 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.002931 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.003146 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.003236 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.003448 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.003536 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.003745 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.004117 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.004326 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.004424 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.004625 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.004714 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.004933 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.005036 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.005230 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.005477 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.005573 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.005805 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.005894 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.006106 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.006196 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.006409 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.006497 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.006706 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.006796 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.007015 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.007109 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.007317 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.007404 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.007615 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.007704 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.007913 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.008022 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.008829 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.009002 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.009139 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.009219 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.009478 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.009616 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.009780 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.009866 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.010099 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.010189 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.010412 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.010509 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.010711 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.010808 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.011015 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.011111 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.011313 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.011412 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.011611 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.011701 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.011910 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.012063 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.012236 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.012327 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.012534 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.012623 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.012831 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.012919 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.013128 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.013224 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.013427 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.013517 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.013723 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.014041 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.014132 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.014344 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.014434 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.014642 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.014745 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.014940 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.015037 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.015235 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.015331 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.015572 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.015663 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.015869 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.015979 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.016245 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.016346 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.016544 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.016632 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.016853 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.016943 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.017167 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.017255 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.017471 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.017560 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.017778 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.017867 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.018085 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.018180 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.018385 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.018609 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.018712 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.018930 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.019019 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.019266 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.019355 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.019568 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.019656 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.019865 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.020002 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.020202 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.020291 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.020509 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.020601 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.020814 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.020904 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.021128 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.021230 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.021445 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.021535 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.021754 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.021842 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.022050 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.022137 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.022352 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.022450 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.022657 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.022746 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.022959 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.023057 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.023262 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.023357 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.023564 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.023653 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.024421 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.024523 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.024803 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.024956 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.025112 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.025305 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.025418 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.025621 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.025710 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.025944 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.026034 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.026269 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.026365 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.026584 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.026674 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.026881 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.026975 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.027200 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.027297 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.027504 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.027591 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.027804 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.027900 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.028132 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.028236 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.028432 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.028522 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.028734 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.028822 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.029036 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.029174 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.029342 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.029462 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.029657 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.029771 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.029959 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.030079 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.030267 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.030379 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.030571 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.030685 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.030896 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.030987 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.031201 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.031289 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.031504 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.031600 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.031806 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.031896 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.032148 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.032290 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.032454 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.032598 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.032759 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.032903 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.033063 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.033208 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.033365 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.033508 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.033675 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.033807 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.033979 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.034110 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.034287 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.034427 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.034592 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.034725 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.034901 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.035022 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.035203 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.035320 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.035509 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.035635 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.035855 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.035987 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.036260 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.036432 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.036565 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.036660 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.036870 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.036968 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.037183 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.037281 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.037492 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.037641 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.037811 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.037944 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.038120 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.038248 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.038429 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.038564 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.038771 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.038885 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.039084 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.039201 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.039637 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.039872 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.039974 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.040239 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.040343 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.040561 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.040652 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.040879 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.040967 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.041185 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.041283 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.041494 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.041584 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.041794 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.041925 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.042095 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.042191 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.042414 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.042503 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.042721 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.042815 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.043032 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.043123 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.043340 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.043429 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.043651 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.043746 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.044001 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.044098 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.044296 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.044403 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.044605 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.044703 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.044949 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.045041 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.045249 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.045338 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.045554 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.045653 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.045853 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.045943 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.046153 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.046242 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.046466 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.046562 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.046763 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.046852 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.047066 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.047155 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.047371 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.047461 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.047674 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.047770 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.047994 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.048086 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.048295 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.048385 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.048610 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.048699 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.048917 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.049012 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.049220 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.049309 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.049527 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.049622 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.049839 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.049927 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.050151 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.050279 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.050451 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.050541 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.050755 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.050852 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.051061 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.051170 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.051362 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.051480 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.051661 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.051795 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.051975 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.052138 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.052315 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.052448 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.052614 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.052767 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.052928 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.053087 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.053252 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.053394 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.053574 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.053714 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.053879 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.054021 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.054206 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.054347 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.054529 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.054682 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.054841 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.055088 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.055252 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.055447 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.055577 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.055879 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.055988 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.056207 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.056298 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.056517 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.056615 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.056821 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.056921 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.057122 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.057212 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.057424 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.057555 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.057722 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.057810 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.058019 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.058107 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.058318 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.058409 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.058617 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.058708 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.058919 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.059015 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.059221 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.059311 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.059523 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.059614 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.059829 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.059918 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.060151 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.060243 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.060449 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.060540 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.060746 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.060843 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.061044 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.061133 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.061344 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.061433 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.061692 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.061799 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.061948 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.062038 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.062248 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.062337 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.062548 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.062646 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.062848 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.062945 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.063149 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.063239 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.063448 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.063545 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.063776 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.063866 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.064105 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.064196 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.064417 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.064508 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.064727 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.064817 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.065035 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.065123 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.065340 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.065436 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.065643 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.065732 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.065955 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.066044 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.066301 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.066397 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.066619 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.066747 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.066937 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.067137 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.067268 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.067461 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.067576 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.067772 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.067889 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.068101 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.068223 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.068411 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.068533 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.068721 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.068840 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.069034 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.069150 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.069342 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.069473 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.069649 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.069801 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.069956 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.070104 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.070263 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.070425 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.071124 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.071287 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.071498 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.071820 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.072016 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.072165 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.072295 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.072478 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.072568 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.072787 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.072878 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.073097 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.073187 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.073405 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.073495 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.073714 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.073804 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.074024 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.074123 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.074335 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.074426 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.074641 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.074736 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.074948 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.075049 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.075257 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.075584 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.075584 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.075822 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.075909 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.076026 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.076172 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.076270 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.076482 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.076572 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.076790 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.076881 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.077095 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.077185 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.077405 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.077505 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.077715 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.077805 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.078032 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.078128 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.078362 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.078451 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.078676 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.078767 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.078993 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.079111 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.079304 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.079409 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.079605 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.079745 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.079832 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 13:52:02.080140 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.080452 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.080780 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.081098 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.081417 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.081729 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.082041 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.082361 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.082660 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.082960 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.083264 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.083569 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.083868 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.084205 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.084512 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.084814 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.085130 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.085436 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.085968 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.086442 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.086769 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.087098 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.087420 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.087733 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.088059 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.088384 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.088688 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.088997 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.089310 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.089616 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.089918 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.090219 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.090527 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.090834 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.091135 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.091440 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.091740 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.092082 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.092385 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.092689 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.092991 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.093299 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.093602 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.093902 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.094204 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.094503 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.094810 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.095109 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.095413 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.095712 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.096037 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.096339 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.096642 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.097006 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.097308 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.097608 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.097907 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.098216 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.098520 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.098840 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.099146 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.099451 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.099790 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.100123 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.100655 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.100984 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.101299 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.101627 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.102554 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.103021 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.103335 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.103639 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.103987 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.104288 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.104596 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.104902 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.105209 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.105513 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.105820 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.106126 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.106430 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.106734 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.107037 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.107342 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.107645 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.107967 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.108280 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.108615 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.108934 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.109247 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.109561 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.109872 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.110177 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.110481 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.110786 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.111092 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.111404 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.111729 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.112063 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.112364 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.112779 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.113090 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.113405 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.113722 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.114029 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.114348 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.114667 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.114975 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.115294 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.115604 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.115929 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.116283 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.116607 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.116927 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.117246 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.118260 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.118699 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.118890 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.119213 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.119523 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.119827 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.120154 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.120465 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.120769 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.121072 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.121372 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.121674 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.121981 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.122282 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.122584 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.122885 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.123187 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.123488 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.123788 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.124116 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.124416 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.124716 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.125016 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.125317 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.125615 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.125953 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.126283 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.126596 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.126916 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.127224 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.127547 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.127850 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.128195 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.128514 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.129097 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.129407 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.129738 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.130043 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.130351 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.130657 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.130964 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.131274 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.131582 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.131913 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.132258 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.132562 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.132886 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.133281 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.133656 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.133968 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.134278 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.134604 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.134912 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.135221 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.135527 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.135834 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.136162 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.136476 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.136783 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.137090 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.137403 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.137716 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.138043 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.138367 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.138675 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.138992 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.139323 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.139676 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.140005 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.140353 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.140678 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.140990 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.141300 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.141603 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 13:52:02.141844 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 13:52:02.233462 n-d-833090-9 devstack@n-api.service[103940]: INFO dbcounter [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Registered counter for database nova_api Jul 26 13:52:02.256740 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 13:52:02.264376 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 13:52:02.295489 n-d-833090-9 devstack@n-api.service[103939]: INFO dbcounter [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Registered counter for database nova_api Jul 26 13:52:02.315547 n-d-833090-9 devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-537de776-b31d-4998-8c06-48029c8f280a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 13:52:02.322144 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.context [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) {{(pid=103940) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 13:52:02.322553 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 13:52:02.326118 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:52:02.327691 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:52:02.328507 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:52:02.330504 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:52:02.332480 n-d-833090-9 devstack@n-api.service[103940]: INFO dbcounter [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Registered counter for database nova_cell0 Jul 26 13:52:02.337078 n-d-833090-9 devstack@n-api.service[103940]: INFO dbcounter [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Registered counter for database nova_cell1 Jul 26 13:52:02.344277 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 13:52:02.346425 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 13:52:02.351462 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 13:52:02.354177 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 13:52:02.379543 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.context [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) {{(pid=103939) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 13:52:02.384151 n-d-833090-9 devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:52:02.385714 n-d-833090-9 devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:52:02.386498 n-d-833090-9 devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:52:02.388466 n-d-833090-9 devstack@n-api.service[103939]: DEBUG oslo_concurrency.lockutils [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:52:02.390422 n-d-833090-9 devstack@n-api.service[103939]: INFO dbcounter [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Registered counter for database nova_cell0 Jul 26 13:52:02.394321 n-d-833090-9 devstack@n-api.service[103939]: INFO dbcounter [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Registered counter for database nova_cell1 Jul 26 13:52:02.404974 n-d-833090-9 devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-537de776-b31d-4998-8c06-48029c8f280a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 13:52:02.405748 n-d-833090-9 devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-537de776-b31d-4998-8c06-48029c8f280a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 13:52:02.412519 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 13:52:02.413938 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 13:52:02.505198 n-d-833090-9 devstack@n-api.service[103940]: INFO dbcounter [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Registered counter for database nova_cell0 Jul 26 13:52:02.514464 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_db.sqlalchemy.engines [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 13:52:02.518816 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writer thread running {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 13:52:02.563250 n-d-833090-9 devstack@n-api.service[103939]: INFO dbcounter [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Registered counter for database nova_cell0 Jul 26 13:52:02.572518 n-d-833090-9 devstack@n-api.service[103939]: DEBUG oslo_db.sqlalchemy.engines [None req-537de776-b31d-4998-8c06-48029c8f280a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 13:52:02.576973 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writer thread running {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 13:52:02.862727 n-d-833090-9 devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 13:52:02.870694 n-d-833090-9 devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 13:52:02.894538 n-d-833090-9 devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-537de776-b31d-4998-8c06-48029c8f280a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 13:52:02.901929 n-d-833090-9 devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 13:52:03.215769 n-d-833090-9 devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 13:52:03.222049 n-d-833090-9 devstack@n-api.service[103940]: WARNING keystonemiddleware.auth_token [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 13:52:03.228402 n-d-833090-9 devstack@n-api.service[103940]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1d14149c0 pid: 103940 (default app) Jul 26 13:52:03.230690 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:52:03.231887 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001760 Jul 26 13:52:03.232598 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Tue Jul 26 13:52:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:52:03.244549 n-d-833090-9 devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-537de776-b31d-4998-8c06-48029c8f280a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 13:52:03.250609 n-d-833090-9 devstack@n-api.service[103939]: WARNING keystonemiddleware.auth_token [None req-537de776-b31d-4998-8c06-48029c8f280a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 13:52:03.255927 n-d-833090-9 devstack@n-api.service[103939]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e1d14149c0 pid: 103939 (default app) Jul 26 13:53:21.378186 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:21.379825 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002283 Jul 26 13:53:21.380817 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:21.397701 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:53:21.399529 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell0:SELECT=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:53:21.400623 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell1:SELECT=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:53:21.401680 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_cell0:SELECT=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:53:22.427315 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-5c5bfc5e-e552-4808-9f74-748c1221b8db admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:22.459537 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-5c5bfc5e-e552-4808-9f74-748c1221b8db admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.071136 Jul 26 13:53:22.460219 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 1/3] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jul 26 13:53:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:53:24.734273 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:24.735279 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-d8beefbb-28aa-4c62-a561-0b19d93b2996 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 26 13:53:24.735680 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 3/4] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:25.190483 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-9df3432b-96b7-4ba3-8ded-5c723b2d54e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:25.212224 n-d-833090-9 devstack@n-api.service[103939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 13:53:25.212224 n-d-833090-9 devstack@n-api.service[103939]: warnings.warn(msg) Jul 26 13:53:25.242796 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-9df3432b-96b7-4ba3-8ded-5c723b2d54e8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.500724 Jul 26 13:53:25.243539 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 2/5] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 26 13:53:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:53:25.258013 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=3 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:53:25.259129 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_cell0:SELECT=3 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:53:25.259890 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_cell1:SELECT=3 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:53:25.261053 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:53:25.466695 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-e414f5ff-75ce-447a-b23c-010a5b04ca28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:25.471154 n-d-833090-9 devstack@n-api.service[103940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 13:53:25.471154 n-d-833090-9 devstack@n-api.service[103940]: warnings.warn(msg) Jul 26 13:53:25.536367 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-e414f5ff-75ce-447a-b23c-010a5b04ca28 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283741 Jul 26 13:53:25.544100 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 4/6] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jul 26 13:53:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:53:27.849191 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-9df3432b-96b7-4ba3-8ded-5c723b2d54e8 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:27.850216 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-9df3432b-96b7-4ba3-8ded-5c723b2d54e8 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 26 13:53:27.850617 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 3/7] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:28.632941 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-21b3aec1-1734-44b9-aeac-d100298d854a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "disk": 5}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:28.652608 n-d-833090-9 devstack@n-api.service[103940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 13:53:28.652608 n-d-833090-9 devstack@n-api.service[103940]: warnings.warn(msg) Jul 26 13:53:28.705134 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-21b3aec1-1734-44b9-aeac-d100298d854a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.845834 Jul 26 13:53:28.706036 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 5/8] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 26 13:53:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:53:28.719000 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-d7854f57-49fa-4eaf-b115-c65a15ed5330 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:28.721906 n-d-833090-9 devstack@n-api.service[103939]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 13:53:28.721906 n-d-833090-9 devstack@n-api.service[103939]: warnings.warn(msg) Jul 26 13:53:28.760777 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-d7854f57-49fa-4eaf-b115-c65a15ed5330 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046195 Jul 26 13:53:28.761474 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 4/9] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jul 26 13:53:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:53:31.483738 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-21b3aec1-1734-44b9-aeac-d100298d854a admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:31.485691 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-21b3aec1-1734-44b9-aeac-d100298d854a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002312 Jul 26 13:53:31.513685 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:32.235191 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-30a46a59-28c3-46c2-96e2-3e30bb81f0a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "disk": 10, "id": "d2", "ram": 1024, "vcpus": 1}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:32.270888 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-30a46a59-28c3-46c2-96e2-3e30bb81f0a4 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.770923 Jul 26 13:53:32.282119 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 5/11] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 26 13:53:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:53:32.286048 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-ca6e856b-c55f-4d5d-9e18-870bd4691fd5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:32.338462 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-ca6e856b-c55f-4d5d-9e18-870bd4691fd5 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056448 Jul 26 13:53:32.341873 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 7/12] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jul 26 13:53:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:53:34.891230 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-30a46a59-28c3-46c2-96e2-3e30bb81f0a4 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:34.892290 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-30a46a59-28c3-46c2-96e2-3e30bb81f0a4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 26 13:53:34.892867 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 6/13] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:35.336110 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-bb7a2f69-63b5-486b-a92c-3265f07362ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "ram": 2048, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:35.357997 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-bb7a2f69-63b5-486b-a92c-3265f07362ec admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458769 Jul 26 13:53:35.358863 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 8/14] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 26 13:53:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:53:35.372500 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-5f320092-01ec-49c9-91ea-b2b0702c9586 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:35.405058 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-5f320092-01ec-49c9-91ea-b2b0702c9586 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037265 Jul 26 13:53:35.406278 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 7/15] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jul 26 13:53:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:53:37.820597 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-bb7a2f69-63b5-486b-a92c-3265f07362ec admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:37.822281 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-bb7a2f69-63b5-486b-a92c-3265f07362ec admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002213 Jul 26 13:53:37.822761 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 9/16] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:38.413984 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-331cdb49-de22-456e-b4be-e7c30e73c8a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:38.442589 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-331cdb49-de22-456e-b4be-e7c30e73c8a2 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.612576 Jul 26 13:53:38.443323 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 8/17] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 26 13:53:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:53:38.457246 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-db318da7-f233-4f3d-a93d-76ace21a5361 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:38.485265 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-db318da7-f233-4f3d-a93d-76ace21a5361 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032357 Jul 26 13:53:38.485851 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 10/18] 10.222.0.70 () {64 vars in 1335 bytes} [Tue Jul 26 13:53:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:53:40.942247 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-331cdb49-de22-456e-b4be-e7c30e73c8a2 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:40.943266 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-331cdb49-de22-456e-b4be-e7c30e73c8a2 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 26 13:53:40.943942 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 9/19] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:41.777555 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-c16a70fe-c396-408b-aefc-a3132d6ddce7 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:41.825896 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-c16a70fe-c396-408b-aefc-a3132d6ddce7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.873535 Jul 26 13:53:41.828279 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 11/20] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jul 26 13:53:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 13:53:44.401910 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-331cdb49-de22-456e-b4be-e7c30e73c8a2 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:44.402931 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-331cdb49-de22-456e-b4be-e7c30e73c8a2 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 26 13:53:44.404493 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 10/21] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:44.890958 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-152b5d05-7e21-4a98-8ff4-700597c824b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 1, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:44.915058 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-152b5d05-7e21-4a98-8ff4-700597c824b6 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.504861 Jul 26 13:53:44.915759 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 12/22] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 26 13:53:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:53:44.928062 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-3d33ed53-29f7-40a7-9037-a2e76df245f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:44.957163 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-3d33ed53-29f7-40a7-9037-a2e76df245f1 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033001 Jul 26 13:53:44.958109 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 11/23] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jul 26 13:53:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:53:47.306634 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-152b5d05-7e21-4a98-8ff4-700597c824b6 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:47.308441 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-152b5d05-7e21-4a98-8ff4-700597c824b6 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002201 Jul 26 13:53:47.308941 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:47.834099 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-070a2ea3-054d-457f-9f1b-8919955e63d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "vcpus": 1, "ram": 2048, "id": "2", "swap": 0}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:47.853542 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-070a2ea3-054d-457f-9f1b-8919955e63d9 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.538147 Jul 26 13:53:47.854069 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 12/25] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 26 13:53:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 13:53:47.866966 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-89e59723-ff3c-4264-844d-04ec0f338e13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:47.897681 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-89e59723-ff3c-4264-844d-04ec0f338e13 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034291 Jul 26 13:53:47.898349 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 14/26] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jul 26 13:53:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:53:50.916836 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-070a2ea3-054d-457f-9f1b-8919955e63d9 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:50.917878 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-070a2ea3-054d-457f-9f1b-8919955e63d9 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Jul 26 13:53:50.918806 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 13/27] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:51.479226 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-4689539c-8743-4290-9267-c6b42a88b963 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "rxtx_factor": 1.0}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:51.504136 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-4689539c-8743-4290-9267-c6b42a88b963 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.577432 Jul 26 13:53:51.504866 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 15/28] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 26 13:53:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 13:53:51.520564 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-41b6cc96-aade-4d0b-84c5-3285a617b9eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:51.529057 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:53:51.562376 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-41b6cc96-aade-4d0b-84c5-3285a617b9eb admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048268 Jul 26 13:53:51.562953 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 14/29] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jul 26 13:53:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:53:53.916391 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-4689539c-8743-4290-9267-c6b42a88b963 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:53.917702 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-4689539c-8743-4290-9267-c6b42a88b963 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Jul 26 13:53:53.918771 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 16/30] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 13:53:54.420176 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-a0c7361e-6b67-46d8-b603-5baade51df8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:54.440325 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-a0c7361e-6b67-46d8-b603-5baade51df8d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.513160 Jul 26 13:53:54.440977 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 15/31] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 26 13:53:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:53:54.455191 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-9bb55140-4469-440f-a708-1cff2ce67bd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:54.484921 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-9bb55140-4469-440f-a708-1cff2ce67bd4 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034121 Jul 26 13:53:54.485706 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 17/32] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jul 26 13:53:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:53:56.759405 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-a0c7361e-6b67-46d8-b603-5baade51df8d admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:53:56.760448 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-a0c7361e-6b67-46d8-b603-5baade51df8d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 26 13:53:56.761115 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 16/33] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:53:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:53:57.213160 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-bb4c5b42-91bb-4beb-95ed-6764031de176 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "disk": 160}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:57.236297 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-bb4c5b42-91bb-4beb-95ed-6764031de176 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.467946 Jul 26 13:53:57.236903 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 18/34] 10.222.0.70 () {64 vars in 1282 bytes} [Tue Jul 26 13:53:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:53:57.250025 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-01a87715-dd3b-4757-8bff-d2f8952f2b10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:53:57.284269 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-01a87715-dd3b-4757-8bff-d2f8952f2b10 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038752 Jul 26 13:53:57.284882 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 17/35] 10.222.0.70 () {64 vars in 1332 bytes} [Tue Jul 26 13:53:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:54:26.235032 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-bb4c5b42-91bb-4beb-95ed-6764031de176 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:26.236068 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-bb4c5b42-91bb-4beb-95ed-6764031de176 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 26 13:54:26.236470 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 19/36] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:54:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:54:26.247922 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:54:26.684947 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-0bc640f9-328c-40db-961d-ae3a21c5eb6e admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:26.703116 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-0bc640f9-328c-40db-961d-ae3a21c5eb6e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.460412 Jul 26 13:54:26.703661 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jul 26 13:54:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 13:54:27.814019 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-bb4c5b42-91bb-4beb-95ed-6764031de176 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:27.815020 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-bb4c5b42-91bb-4beb-95ed-6764031de176 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 26 13:54:27.815413 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 20/38] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 26 13:54:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:54:28.384152 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-cea69a61-3a7d-4258-88cc-e4ddd941d273 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:28.389619 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.wsgi [None req-cea69a61-3a7d-4258-88cc-e4ddd941d273 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-cea69a61-3a7d-4258-88cc-e4ddd941d273 admin admin] Request method failure captured: Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: Accept: application/json Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: Accept-Encoding: gzip, deflate Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: Connection: keep-alive Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: Content-Length: 0 Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: Host: 10.222.0.70 Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: Openstack-Api-Version: compute 2.90 Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: Openstack-System-Scope: None Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: User-Agent: python-novaclient Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Auth-Token: gAAAAABi3_ITiEeQMldXgYuGIgtaUjiKgjbjolP7ezqfWlcgHq_az33UbFlxpVy6Q84i5r_2eF0rkgT2TMS00FhTZv4m-hIld7horAMt0hy01aNe1i6GnXF5SihDJCX-YF4DdQvhmX3Ly9zG-X16zN8CXsw2HW8bcauKB7GCjQ33OxSXB8s-40Q Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Domain-Id: None Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Domain-Name: None Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Identity-Status: Confirmed Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Is-Admin-Project: True Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Domain-Id: default Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Domain-Name: Default Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Name: admin Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Role: member,reader,admin Jul 26 13:54:28.392854 n-d-833090-9 devstack@n-api.service[103939]: X-Roles: member,reader,admin Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53454f6887774c9880d9f47d614d0bbb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}] Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: X-Tenant: admin Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: X-Tenant-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: X-Tenant-Name: admin Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: X-User: admin Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: X-User-Domain-Id: default Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: X-User-Domain-Name: Default Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: X-User-Id: fb8424f799cb46b4a0bdbf1dc9713f44 Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: X-User-Name: admin Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: method: > Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: exception: Flavor 42 could not be found. Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: action_args: {'id': '42'} Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:54:28.394419 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:28.395373 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:28.396928 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-cea69a61-3a7d-4258-88cc-e4ddd941d273 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:54:28.398249 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-cea69a61-3a7d-4258-88cc-e4ddd941d273 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.401404 Jul 26 13:54:28.398249 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 19/39] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jul 26 13:54:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 13:54:28.404554 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-a98cf3fc-9c38-4f8f-9851-1fde3bd93d77 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:28.408687 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:54:28.430774 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-a98cf3fc-9c38-4f8f-9851-1fde3bd93d77 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029049 Jul 26 13:54:28.431353 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 21/40] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 26 13:54:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 13:54:28.442940 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-7ae9df6e-513f-4938-ba7e-9b0d733f8123 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:28.467087 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-7ae9df6e-513f-4938-ba7e-9b0d733f8123 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027632 Jul 26 13:54:28.467626 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 20/41] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 26 13:54:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 13:54:28.478559 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-3bfb14ce-910e-4f59-84dd-2f98e92193be admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:28.484732 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.wsgi [None req-3bfb14ce-910e-4f59-84dd-2f98e92193be admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-3bfb14ce-910e-4f59-84dd-2f98e92193be admin admin] Request method failure captured: Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: Accept: application/json Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: Accept-Encoding: gzip, deflate Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: Connection: keep-alive Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: Content-Length: 0 Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: Host: 10.222.0.70 Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: Openstack-Api-Version: compute 2.90 Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: Openstack-System-Scope: None Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: User-Agent: python-novaclient Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Auth-Token: gAAAAABi3_ITiEeQMldXgYuGIgtaUjiKgjbjolP7ezqfWlcgHq_az33UbFlxpVy6Q84i5r_2eF0rkgT2TMS00FhTZv4m-hIld7horAMt0hy01aNe1i6GnXF5SihDJCX-YF4DdQvhmX3Ly9zG-X16zN8CXsw2HW8bcauKB7GCjQ33OxSXB8s-40Q Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Domain-Id: None Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Domain-Name: None Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Identity-Status: Confirmed Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Is-Admin-Project: True Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Domain-Id: default Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Domain-Name: Default Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Name: admin Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Role: member,reader,admin Jul 26 13:54:28.487978 n-d-833090-9 devstack@n-api.service[103940]: X-Roles: member,reader,admin Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53454f6887774c9880d9f47d614d0bbb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}] Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: X-Tenant: admin Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: X-Tenant-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: X-Tenant-Name: admin Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: X-User: admin Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: X-User-Domain-Id: default Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: X-User-Domain-Name: Default Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: X-User-Id: fb8424f799cb46b4a0bdbf1dc9713f44 Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: X-User-Name: admin Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: method: > Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: exception: Flavor 42 could not be found. Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: action_args: {'id': '42'} Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:54:28.489521 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:28.490395 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:28.491703 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-3bfb14ce-910e-4f59-84dd-2f98e92193be admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:54:28.493057 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-3bfb14ce-910e-4f59-84dd-2f98e92193be admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015867 Jul 26 13:54:28.493057 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 22/42] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jul 26 13:54:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 13:54:29.487797 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-7ae9df6e-513f-4938-ba7e-9b0d733f8123 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:29.488835 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-7ae9df6e-513f-4938-ba7e-9b0d733f8123 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jul 26 13:54:29.489249 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 21/43] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 26 13:54:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:54:30.054724 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-10bb75fe-138e-4ccf-8fc6-2075ad703c7e admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:30.060655 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.wsgi [None req-10bb75fe-138e-4ccf-8fc6-2075ad703c7e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-10bb75fe-138e-4ccf-8fc6-2075ad703c7e admin admin] Request method failure captured: Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: Accept: application/json Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: Accept-Encoding: gzip, deflate Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: Connection: keep-alive Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: Content-Length: 0 Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: Host: 10.222.0.70 Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: Openstack-Api-Version: compute 2.90 Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: Openstack-System-Scope: None Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: User-Agent: python-novaclient Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Auth-Token: gAAAAABi3_IVdHklXwJHZ785sB7rML9J94VYLQ2lT5hAcIPaASmrIkm2GZwiCHsVE5jeUZWLW5phmy3tVtXi221pimSA5tdtvWEusCeHPduWk2z2zArkGmqGEAxyfYi-EuGRAQnl_JSeqCuugjBJOag-5GiMbh687-4RZeuYLH9PzS2bBhzYixI Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Domain-Id: None Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Domain-Name: None Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Identity-Status: Confirmed Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Is-Admin-Project: True Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Domain-Id: default Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Domain-Name: Default Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Name: admin Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Role: member,reader,admin Jul 26 13:54:30.062141 n-d-833090-9 devstack@n-api.service[103940]: X-Roles: member,reader,admin Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53454f6887774c9880d9f47d614d0bbb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}] Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: X-Tenant: admin Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: X-Tenant-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: X-Tenant-Name: admin Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: X-User: admin Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: X-User-Domain-Id: default Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: X-User-Domain-Name: Default Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: X-User-Id: fb8424f799cb46b4a0bdbf1dc9713f44 Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: X-User-Name: admin Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: method: > Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: exception: Flavor 84 could not be found. Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: action_args: {'id': '84'} Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:54:30.063725 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:30.064805 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:30.066172 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-10bb75fe-138e-4ccf-8fc6-2075ad703c7e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:54:30.067453 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-10bb75fe-138e-4ccf-8fc6-2075ad703c7e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.434715 Jul 26 13:54:30.067453 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jul 26 13:54:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 13:54:30.074692 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-fa4b35ca-3402-449a-b5e0-c542577f3e67 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:30.090243 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-fa4b35ca-3402-449a-b5e0-c542577f3e67 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020648 Jul 26 13:54:30.090812 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 22/45] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 26 13:54:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 13:54:30.101026 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-f40c2930-4d4e-4fea-b80d-3390c8229d8f admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:30.120257 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-f40c2930-4d4e-4fea-b80d-3390c8229d8f admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022729 Jul 26 13:54:30.120815 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 24/46] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 26 13:54:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 13:54:30.130416 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-b0d8512f-963f-4d64-87f6-081735909896 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:30.136819 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.wsgi [None req-b0d8512f-963f-4d64-87f6-081735909896 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-b0d8512f-963f-4d64-87f6-081735909896 admin admin] Request method failure captured: Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: Accept: application/json Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: Accept-Encoding: gzip, deflate Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: Connection: keep-alive Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: Content-Length: 0 Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: Host: 10.222.0.70 Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: Openstack-Api-Version: compute 2.90 Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: Openstack-System-Scope: None Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: User-Agent: python-novaclient Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Auth-Token: gAAAAABi3_IVdHklXwJHZ785sB7rML9J94VYLQ2lT5hAcIPaASmrIkm2GZwiCHsVE5jeUZWLW5phmy3tVtXi221pimSA5tdtvWEusCeHPduWk2z2zArkGmqGEAxyfYi-EuGRAQnl_JSeqCuugjBJOag-5GiMbh687-4RZeuYLH9PzS2bBhzYixI Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Domain-Id: None Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Domain-Name: None Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Identity-Status: Confirmed Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Is-Admin-Project: True Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Domain-Id: default Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Domain-Name: Default Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Name: admin Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Role: member,reader,admin Jul 26 13:54:30.138449 n-d-833090-9 devstack@n-api.service[103939]: X-Roles: member,reader,admin Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53454f6887774c9880d9f47d614d0bbb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}] Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: X-Tenant: admin Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: X-Tenant-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: X-Tenant-Name: admin Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: X-User: admin Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: X-User-Domain-Id: default Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: X-User-Domain-Name: Default Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: X-User-Id: fb8424f799cb46b4a0bdbf1dc9713f44 Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: X-User-Name: admin Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: method: > Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: exception: Flavor 84 could not be found. Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: action_args: {'id': '84'} Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:54:30.140089 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:30.140967 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:30.142190 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-b0d8512f-963f-4d64-87f6-081735909896 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:54:30.143456 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-b0d8512f-963f-4d64-87f6-081735909896 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013038 Jul 26 13:54:30.143456 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 23/47] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jul 26 13:54:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 13:54:31.172476 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-f40c2930-4d4e-4fea-b80d-3390c8229d8f admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:31.173576 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-f40c2930-4d4e-4fea-b80d-3390c8229d8f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jul 26 13:54:31.174050 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 25/48] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 26 13:54:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:54:31.723365 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-422579f3-a430-42c5-b4a8-9cc806537266 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:31.729929 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.wsgi [None req-422579f3-a430-42c5-b4a8-9cc806537266 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-422579f3-a430-42c5-b4a8-9cc806537266 admin admin] Request method failure captured: Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: Accept: application/json Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: Accept-Encoding: gzip, deflate Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: Connection: keep-alive Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: Content-Length: 0 Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: Host: 10.222.0.70 Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: Openstack-Api-Version: compute 2.90 Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: Openstack-System-Scope: None Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: User-Agent: python-novaclient Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Auth-Token: gAAAAABi3_IXCNMLn9bX5LKHS16ohcUDXIknmeBDOcxDP5wvwxFVm3GseRHEBfkiCmcXU0q47TJmKg-0GUp6NIx-gex61xYBAGE8y86OK7a7kx_1IcZtpvK09EHY7Dvxgco_Vv8TAP1swpA3e9O_Nt1My_9LWRyELzrmbGDK6-7r2-yjncRjfrw Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Domain-Id: None Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Domain-Name: None Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Identity-Status: Confirmed Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Is-Admin-Project: True Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Domain-Id: default Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Domain-Name: Default Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Project-Name: admin Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Role: member,reader,admin Jul 26 13:54:31.731404 n-d-833090-9 devstack@n-api.service[103939]: X-Roles: member,reader,admin Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53454f6887774c9880d9f47d614d0bbb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}] Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: X-Tenant: admin Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: X-Tenant-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: X-Tenant-Name: admin Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: X-User: admin Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: X-User-Domain-Id: default Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: X-User-Domain-Name: Default Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: X-User-Id: fb8424f799cb46b4a0bdbf1dc9713f44 Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: X-User-Name: admin Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: method: > Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: exception: Flavor 451 could not be found. Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: action_args: {'id': '451'} Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:54:31.732841 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:31.734285 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: ERROR nova.api.openstack.wsgi Jul 26 13:54:31.735610 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-422579f3-a430-42c5-b4a8-9cc806537266 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:54:31.737048 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-422579f3-a430-42c5-b4a8-9cc806537266 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.413158 Jul 26 13:54:31.737048 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 24/49] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 26 13:54:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 13:54:31.742395 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-a67aebe6-7fdd-4d57-ae83-c6f1a3e7b297 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:31.757161 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-a67aebe6-7fdd-4d57-ae83-c6f1a3e7b297 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018391 Jul 26 13:54:31.757709 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 26/50] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 26 13:54:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 13:54:31.767341 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:31.782822 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018966 Jul 26 13:54:31.783358 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 25/51] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Jul 26 13:54:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 13:54:31.793726 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-b54d53a3-7d31-4873-bc6e-191e360b8e1e admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:31.799103 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.wsgi [None req-b54d53a3-7d31-4873-bc6e-191e360b8e1e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-b54d53a3-7d31-4873-bc6e-191e360b8e1e admin admin] Request method failure captured: Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: Accept: application/json Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: Accept-Encoding: gzip, deflate Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: Connection: keep-alive Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: Content-Length: 0 Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: Host: 10.222.0.70 Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: Openstack-Api-Version: compute 2.90 Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: Openstack-System-Scope: None Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: User-Agent: python-novaclient Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Auth-Token: gAAAAABi3_IXCNMLn9bX5LKHS16ohcUDXIknmeBDOcxDP5wvwxFVm3GseRHEBfkiCmcXU0q47TJmKg-0GUp6NIx-gex61xYBAGE8y86OK7a7kx_1IcZtpvK09EHY7Dvxgco_Vv8TAP1swpA3e9O_Nt1My_9LWRyELzrmbGDK6-7r2-yjncRjfrw Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Domain-Id: None Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Domain-Name: None Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Identity-Status: Confirmed Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Is-Admin-Project: True Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Domain-Id: default Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Domain-Name: Default Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Project-Name: admin Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Role: member,reader,admin Jul 26 13:54:31.800610 n-d-833090-9 devstack@n-api.service[103940]: X-Roles: member,reader,admin Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53454f6887774c9880d9f47d614d0bbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53454f6887774c9880d9f47d614d0bbb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53454f6887774c9880d9f47d614d0bbb"}]}] Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: X-Tenant: admin Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: X-Tenant-Id: 53454f6887774c9880d9f47d614d0bbb Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: X-Tenant-Name: admin Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: X-User: admin Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: X-User-Domain-Id: default Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: X-User-Domain-Name: Default Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: X-User-Id: fb8424f799cb46b4a0bdbf1dc9713f44 Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: X-User-Name: admin Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: method: > Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: exception: Flavor 451 could not be found. Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: action_args: {'id': '451'} Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:54:31.802835 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:31.804225 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: ERROR nova.api.openstack.wsgi Jul 26 13:54:31.805730 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-b54d53a3-7d31-4873-bc6e-191e360b8e1e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:54:31.807637 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-b54d53a3-7d31-4873-bc6e-191e360b8e1e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012960 Jul 26 13:54:31.807637 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 27/52] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 26 13:54:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 13:54:32.825167 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:32.826236 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 26 13:54:32.826594 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 26 13:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:54:33.447335 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-4b56cf60-85aa-44d8-a395-8c04881b9c5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:54:33.465611 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-4b56cf60-85aa-44d8-a395-8c04881b9c5f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.483464 Jul 26 13:54:33.466161 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 28/54] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jul 26 13:54:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:54:34.471399 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:34.472533 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 26 13:54:34.472926 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 26 13:54:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:54:35.031338 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-7fbb6e7c-6f72-420e-b0db-dba728a4c58c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:54:35.049858 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-7fbb6e7c-6f72-420e-b0db-dba728a4c58c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.430296 Jul 26 13:54:35.050405 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 29/56] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jul 26 13:54:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:54:36.048654 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:36.049651 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 26 13:54:36.050042 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 26 13:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:54:36.577991 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-2af4dfb6-8e65-4814-9710-0dc346e6c275 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:54:36.596086 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-2af4dfb6-8e65-4814-9710-0dc346e6c275 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406307 Jul 26 13:54:36.596615 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 30/58] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jul 26 13:54:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:54:37.599359 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:37.600402 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 26 13:54:37.600794 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 29/59] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 26 13:54:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:54:38.140251 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-c25ec1d5-781c-4522-83f5-2697f136afb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:54:38.158592 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-c25ec1d5-781c-4522-83f5-2697f136afb1 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.419760 Jul 26 13:54:38.159135 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 31/60] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Jul 26 13:54:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 13:54:39.223871 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:39.225699 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002487 Jul 26 13:54:39.226344 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 30/61] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 26 13:54:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:54:39.805708 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-3cb7da40-d4fd-4df3-9687-3156f5d85dbc admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:54:39.828355 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-3cb7da40-d4fd-4df3-9687-3156f5d85dbc admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.431236 Jul 26 13:54:39.828832 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 32/62] 10.222.0.70 () {60 vars in 1202 bytes} [Tue Jul 26 13:54:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 13:55:33.935191 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:55:33.936279 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-ee828460-12d9-4a38-8d23-a57413d0de4a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 26 13:55:33.936688 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 31/63] 10.222.0.70 () {54 vars in 930 bytes} [Tue Jul 26 13:55:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:55:33.948778 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:55:34.355183 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-e738a069-ae9b-4395-b628-ec5716fb7b5e admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:55:34.375920 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-e738a069-ae9b-4395-b628-ec5716fb7b5e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.432413 Jul 26 13:55:34.376465 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 33/64] 10.222.0.70 () {60 vars in 1291 bytes} [Tue Jul 26 13:55:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 13:55:34.398310 n-d-833090-9 devstack@n-api.service[103939]: DEBUG dbcounter [-] [103939] Writing DB stats nova_api:SELECT=14 {{(pid=103939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:55:34.402350 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-f9f006af-1c9d-4faf-9578-b3ce0deb1f9d admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:55:34.410111 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-f9f006af-1c9d-4faf-9578-b3ce0deb1f9d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013355 Jul 26 13:55:34.410648 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 32/65] 10.222.0.70 () {60 vars in 1282 bytes} [Tue Jul 26 13:55:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:55:34.422479 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-67838ef6-a846-4baf-af0e-f9893e582425 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:55:34.430761 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-67838ef6-a846-4baf-af0e-f9893e582425 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011845 Jul 26 13:55:34.431281 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 34/66] 10.222.0.70 () {60 vars in 1285 bytes} [Tue Jul 26 13:55:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:55:34.443546 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-8d6c5fdb-848b-4b10-bdde-8a9461f57957 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:55:34.451449 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-8d6c5fdb-848b-4b10-bdde-8a9461f57957 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012176 Jul 26 13:55:34.452003 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 33/67] 10.222.0.70 () {60 vars in 1285 bytes} [Tue Jul 26 13:55:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:55:34.463891 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-b67389c2-6948-4828-a44c-1bf4630b540b admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:55:34.471429 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-b67389c2-6948-4828-a44c-1bf4630b540b admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011154 Jul 26 13:55:34.471930 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 35/68] 10.222.0.70 () {60 vars in 1282 bytes} [Tue Jul 26 13:55:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:01:12.242063 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-8d6c5fdb-848b-4b10-bdde-8a9461f57957 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:01:12.243074 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-8d6c5fdb-848b-4b10-bdde-8a9461f57957 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 26 14:01:12.243470 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 34/69] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 26 14:01:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:01:12.386398 n-d-833090-9 devstack@n-api.service[103940]: DEBUG dbcounter [-] [103940] Writing DB stats nova_api:SELECT=6 {{(pid=103940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:01:12.544521 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-88921101-2c67-4569-9e35-1ca1f15636e3 admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:01:12.546906 n-d-833090-9 devstack@n-api.service[103940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:01:12.546906 n-d-833090-9 devstack@n-api.service[103940]: warnings.warn(msg) Jul 26 14:01:12.548183 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-88921101-2c67-4569-9e35-1ca1f15636e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:01:12.548627 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-88921101-2c67-4569-9e35-1ca1f15636e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:01:12.549408 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-88921101-2c67-4569-9e35-1ca1f15636e3 admin admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:01:12.549838 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-88921101-2c67-4569-9e35-1ca1f15636e3 admin admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:01:12.592414 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-88921101-2c67-4569-9e35-1ca1f15636e3 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.207325 Jul 26 14:01:12.592991 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 36/70] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 26 14:01:12 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:01:13.462551 n-d-833090-9 devstack@n-api.service[103939]: DEBUG nova.api.openstack.wsgi [None req-8d6c5fdb-848b-4b10-bdde-8a9461f57957 admin admin] Calling method '>' {{(pid=103939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:01:13.463569 n-d-833090-9 devstack@n-api.service[103939]: INFO nova.api.openstack.requestlog [None req-8d6c5fdb-848b-4b10-bdde-8a9461f57957 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 26 14:01:13.464000 n-d-833090-9 devstack@n-api.service[103939]: [pid: 103939|app: 0|req: 35/71] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Jul 26 14:01:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:01:13.661088 n-d-833090-9 devstack@n-api.service[103940]: DEBUG nova.api.openstack.wsgi [None req-d299436e-0256-475e-8a63-7ef87661d59f admin admin] Calling method '>' {{(pid=103940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:01:13.663898 n-d-833090-9 devstack@n-api.service[103940]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:01:13.663898 n-d-833090-9 devstack@n-api.service[103940]: warnings.warn(msg) Jul 26 14:01:13.665094 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-d299436e-0256-475e-8a63-7ef87661d59f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:01:13.665538 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-d299436e-0256-475e-8a63-7ef87661d59f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:01:13.666323 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-d299436e-0256-475e-8a63-7ef87661d59f admin admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:01:13.666766 n-d-833090-9 devstack@n-api.service[103940]: DEBUG oslo_concurrency.lockutils [None req-d299436e-0256-475e-8a63-7ef87661d59f admin admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:01:13.690023 n-d-833090-9 devstack@n-api.service[103940]: INFO nova.api.openstack.requestlog [None req-d299436e-0256-475e-8a63-7ef87661d59f admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.082662 Jul 26 14:01:13.690594 n-d-833090-9 devstack@n-api.service[103940]: [pid: 103940|app: 0|req: 37/72] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 26 14:01:13 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:02:00.665433 n-d-833090-9 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 14:02:00.666380 n-d-833090-9 devstack@n-api.service[103938]: Tue Jul 26 14:02:00 2022 - graceful shutdown triggered... Jul 26 14:02:00.666907 n-d-833090-9 devstack@n-api.service[103940]: Gracefully killing worker 2 (pid: 103940)... Jul 26 14:02:00.667287 n-d-833090-9 devstack@n-api.service[103939]: Gracefully killing worker 1 (pid: 103939)... Jul 26 14:02:01.667528 n-d-833090-9 devstack@n-api.service[103938]: worker 1 buried after 1 seconds Jul 26 14:02:01.667528 n-d-833090-9 devstack@n-api.service[103938]: worker 2 buried after 1 seconds Jul 26 14:02:01.667528 n-d-833090-9 devstack@n-api.service[103938]: goodbye to uWSGI. Jul 26 14:02:01.670575 n-d-833090-9 systemd[1]: devstack@n-api.service: Succeeded. Jul 26 14:02:01.671132 n-d-833090-9 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 14:02:01.673998 n-d-833090-9 systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 14:02:01.691418 n-d-833090-9 devstack@n-api.service[119468]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 14:02:01 2022] *** Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: nodename: n-d-833090-9 Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: machine: x86_64 Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: clock source: unix Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: pcre jit disabled Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: detected number of CPU cores: 4 Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: current working directory: / Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: detected binary path: /usr/bin/uwsgi-core Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: your processes number limit is 47680 Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: your memory page size is 4096 bytes Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: detected max file descriptor number: 2048 Jul 26 14:02:01.710089 n-d-833090-9 devstack@n-api.service[119468]: lock engine: pthread robust mutexes Jul 26 14:02:01.711354 n-d-833090-9 devstack@n-api.service[119468]: thunder lock: enabled Jul 26 14:02:01.711354 n-d-833090-9 devstack@n-api.service[119468]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 14:02:01.711354 n-d-833090-9 devstack@n-api.service[119468]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 14:02:01.751663 n-d-833090-9 devstack@n-api.service[119468]: Python main interpreter initialized at 0x563d95f739c0 Jul 26 14:02:01.751663 n-d-833090-9 devstack@n-api.service[119468]: python threads support enabled Jul 26 14:02:01.751663 n-d-833090-9 devstack@n-api.service[119468]: your server socket listen backlog is limited to 100 connections Jul 26 14:02:01.751663 n-d-833090-9 devstack@n-api.service[119468]: your mercy for graceful operations on workers is 90 seconds Jul 26 14:02:01.752169 n-d-833090-9 devstack@n-api.service[119468]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 14:02:01.752257 n-d-833090-9 devstack@n-api.service[119468]: *** Operational MODE: preforking *** Jul 26 14:02:01.752488 n-d-833090-9 devstack@n-api.service[119468]: *** uWSGI is running in multiple interpreter mode *** Jul 26 14:02:01.752488 n-d-833090-9 devstack@n-api.service[119468]: spawned uWSGI master process (pid: 119468) Jul 26 14:02:01.752708 n-d-833090-9 systemd[1]: Started Devstack devstack@n-api.service. Jul 26 14:02:01.753310 n-d-833090-9 devstack@n-api.service[119468]: spawned uWSGI worker 1 (pid: 119478, cores: 1) Jul 26 14:02:01.753667 n-d-833090-9 devstack@n-api.service[119468]: spawned uWSGI worker 2 (pid: 119479, cores: 1) Jul 26 14:02:01.754013 n-d-833090-9 devstack@n-api.service[119468]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 14:02:02.445474 n-d-833090-9 devstack@n-api.service[119478]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 14:02:02.450791 n-d-833090-9 devstack@n-api.service[119479]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 14:02:03.661429 n-d-833090-9 devstack@n-api.service[119479]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:02:03.661429 n-d-833090-9 devstack@n-api.service[119479]: from cryptography.utils import int_from_bytes Jul 26 14:02:03.662225 n-d-833090-9 devstack@n-api.service[119479]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:02:03.662225 n-d-833090-9 devstack@n-api.service[119479]: from cryptography.utils import int_from_bytes Jul 26 14:02:03.671287 n-d-833090-9 devstack@n-api.service[119478]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:02:03.671287 n-d-833090-9 devstack@n-api.service[119478]: from cryptography.utils import int_from_bytes Jul 26 14:02:03.671857 n-d-833090-9 devstack@n-api.service[119478]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:02:03.671857 n-d-833090-9 devstack@n-api.service[119478]: from cryptography.utils import int_from_bytes Jul 26 14:02:06.165517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:02:06.166122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:02:06.166432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:02:06.166707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:02:06.166969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:02:06.167373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.167715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.168801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.168801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.169026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.169284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.169623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.170150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.170288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.170562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.170870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.171208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-9 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.171546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.171864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.172229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.172560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.172875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.173207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.173523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.174043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.175382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.175382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.175382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.175796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.176041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.176396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.176729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.177056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.177386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.177714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.178129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-9 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.178450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.178768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.179088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.179523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.179849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.180200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.180534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.180866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.181197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.181539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.181892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.182207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.182529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.183024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.183510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.184023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.184590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.184737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.184977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.185219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.185534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.185865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.186195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.186527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.186786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.187081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.187409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.187736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.188080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.188400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.188716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.189032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.189346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.189658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.189972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.190287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.190613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.190936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.191264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.191580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.191942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.192398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.192657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.192974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.193325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.193656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.193974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.194298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.194629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.194945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.195258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.195572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.195902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.196349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.196658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:02:06.197097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.197097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.197284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:02:06.197379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.197475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:02:06.197576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.197798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:02:06.197895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.198055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:02:06.198158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.198412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.198513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.198726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.198851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.199033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.199135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.199348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.199529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.199719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.200187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.200286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.200590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.200692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.200917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.201026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.201232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.201338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.201549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.201647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.201817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.201934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.202139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.202304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.202471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-9 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.202574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.202799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.202939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.203108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.203212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.203417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.203521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.203732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.203839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.204105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.204212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.204387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.204496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.204696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.204800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.205012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.205210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.205390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.205548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.205699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.205850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.205990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.206150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.206340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.206500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.206679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.206836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.206985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.207175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.207996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.208229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.208396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.208622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.208784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.209007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.209168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.209369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.209528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.209710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.209883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.210036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.210177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-9 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.210328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.210480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.210632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.210805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.210967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.211198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.211356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.211501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.211729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.211881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.212894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.213018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.213105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.213214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.213342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.213430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.213565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.213656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.213897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.214112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.214325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.214679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.214833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.215304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.215487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.215647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.215855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.216056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.216229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.216387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.216594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.216757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.216923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.217068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.217251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.217386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.217579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.217731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.217913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.218048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.218256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.218405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.218579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.218717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.218857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.218989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.219150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.219291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.219486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.219629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.219845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.220017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.220207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.220344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.220488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.220630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.220769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.220910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.221157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.221300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.221490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.221633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.221809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.221945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.222162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.222312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.222481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.222622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.222801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.222937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.223782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.224231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.224379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.224598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.224731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.224990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.225284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.225284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.225557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.225697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.225839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.225977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.226124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.226256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.226394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.226525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.226656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.226797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.226946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.227121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.227265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.227443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.227578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.227763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.227922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.228120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.228326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.228473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.228649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.228800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.228983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.229125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.229317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.229460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.229638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.229787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.229962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.230103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.230281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.230431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.230618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.230761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.230989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.231136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.231257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.231398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.231538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.231682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.231840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.232154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.232298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.232441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.232587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.232726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.232868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.233000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.233129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.233266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.233411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.233583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.233754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.233897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.234073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.234216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.234392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.234537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.234746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.234894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.235041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.235272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.235517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.235724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.235972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.236142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.236293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.236427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.236583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.236744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.236877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.237007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.237145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.237277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.237431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.237656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.237802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.237944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.238082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.238223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.238364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.238504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.238645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.239359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.239592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.239814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.239998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.240173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.240307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.240450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.240583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.240721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.240854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.240982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.241121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.241406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.241543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.241734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.241869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.242053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.242189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.242414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.242558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.242728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.242877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.243045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.243188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.243410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.243542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.243745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.243893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.244083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.244231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.244391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.244526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.244700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.244842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.245011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.245156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.245408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.245564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.245826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.245963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.246096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.246236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.246376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.246507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.246646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.246783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.246953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.247104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.247235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.247375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.247507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.247660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.247887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.248104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.248261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.248389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:02:06.248521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.248659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.248802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.248947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.249090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.249223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.249361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.249526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.249673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.249880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.250025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.250224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.250358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.250551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.250695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.250874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.251008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.251201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.251338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.251538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.251673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.251859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.252031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.252208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.252354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.252525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.252674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.252853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.252986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.253174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.253318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.253510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.253651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.253824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.253965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.254145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.254287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.255052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.255200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.255395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.255630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.255751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.255974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.256142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.256325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.256494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.256661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.256837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.256987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.257162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.257305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.257494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.257659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.257795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.258025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.258174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.258306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.258445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.258623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.258766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.258943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.259178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.259326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.259467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.259600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.259740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.259893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.260067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.260279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.260445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.260578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.260774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.260919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.261215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.261403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.261792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.261936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.262155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.262298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.262513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.262645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.262839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.262982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.263165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.263309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.263515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.263657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.263839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.264135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.264271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.264408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.264539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.264679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.264811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.264950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.265127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.265265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.265428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.265678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.265813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.265960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.266092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.266340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.266473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.266613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.266748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.266914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.267058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.267239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.267375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.267556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.267704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.267874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.268043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.268256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.268389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.268519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.268659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.268834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.268974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.269163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.269297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.269482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.269623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.269806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.269967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.270160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.270295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.270768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.271066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.271209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.271469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.271602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.271787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.272025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.272178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.272355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.272498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.272694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.272829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.273020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.273162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.273340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.273476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.273665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.273806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.273982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.274117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.274300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.274436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.274616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.274758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.274975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.275108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.275238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.275368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.275546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.275695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.275923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.276086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.276219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.276366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.276598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.276745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.276885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.277023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.277154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.277290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.277422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.277561 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.277741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.277884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.278074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.278208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.278475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.278622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.278754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.278884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.279014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.279143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.279376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.279610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.279815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.279988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.280124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.280255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.280438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.280583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.280761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.280905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.281077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.281213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.281394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.281537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.281708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.281843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.282026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.282162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.282343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.282479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.282678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.282814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.282997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.283142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.283314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.283459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.283628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.283774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.283941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.284108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.284276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.284421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.284594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.284744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.284891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.285032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.285204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.285347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.285516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.286280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.286414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.286545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.286790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.286926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.287107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.287251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.287422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.287556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.287735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.287856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.288084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.288208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.288400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.288626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.288744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.288855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.289016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.289149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.289345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.289555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.289683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.289803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.289960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.290107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.290272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.290408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.290585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.290734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.290938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.291082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.291251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.291394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.291598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.291745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.291929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.292129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.292260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.292388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.292593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.292742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.292906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.293039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.293227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.293369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.293543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.293671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.293855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.293977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.294167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.294299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.294483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.294613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.294901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.295023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.295235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.295365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.295509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.295640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.295825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.296047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.296180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.296410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.296559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.296692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.296836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.297082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.297225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.297365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.297506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.297646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.297777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.297908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.298045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.298189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.298320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.298465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.298613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.298830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.298972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.299112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.299252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.299391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.299547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.299757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.299900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.300123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.300275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.300462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.300588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.300709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.300836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.300957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.301077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.301234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.301935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.302082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.302362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.302507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.302679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.302802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.303055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.303204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.303400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.303545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.303721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.303865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.304064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.304213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.304380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.304517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.304698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.304835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.305010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.305153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.305320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.305456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.305637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.305789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.305957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.306100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.306272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.306424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.306659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.306804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.306943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.307105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.307359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.307494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.307625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.307764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.307912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.308170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.308307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.308445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.308577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.308715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.308867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.309103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.309239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.309370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.309500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.309639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.309797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.310012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.310145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.310276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.310414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.310546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.310685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.310826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.310957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.311141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.311284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.311468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.311618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.311788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.311924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.312139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.312273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.312462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.312612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.312786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.312921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.313110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.313246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.313439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.313575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.313756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.313897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.314075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.314217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.314387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.314523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.314699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.314842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.315014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.315156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.315363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.315505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.315636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.315922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.316076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.316272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.316417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.316592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.316865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.317075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.317215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.317470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.317640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.317765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.317977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.318114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.318324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.318470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.318660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.318810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.318979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.319128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.319340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.319489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.319630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.319763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.319908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.320109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.320250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.320381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.320521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.320652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.320839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.320984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.321156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.321297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.321470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.321604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.321784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.321928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.322080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.322210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.322479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.322629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.322779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.322911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.323042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.323180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.323312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.323451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.323608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.323751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.323919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.324156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.324297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.324442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.324582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.324715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.324846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.324984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.325287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.325438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.325608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.325745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.325919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.326056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.326230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.326373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.326548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.326683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.326877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.327069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.327233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.327387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.327530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.327666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.327823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.327988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.328168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.328304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.328509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.328722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.328874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.329027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.329193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.329441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.329588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.329744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.329893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.330032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.330179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.330329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.330480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.330625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.330769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.330923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.331088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.331243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.331396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.331540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.331683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.331841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.332010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.332162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.332306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.332487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.332665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.332829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.333004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.333150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.333293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.333436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.333687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.333859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.334025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.334171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.334322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.334472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.334634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.334787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.334938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.335092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.335235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.335378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.335529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.335681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.335831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.336008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.336179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.336332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.336489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.336633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.336775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.336919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.337186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.337339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.337495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.337646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.337908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.338066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.338236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.338403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.338576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.338722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.338864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.339015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.339158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.339321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.339485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.339720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.339870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.340038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.340196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.340196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.340488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.340632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.340775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.340925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.341069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.341236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.341381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.341532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.341686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.341837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.341990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.342142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.342286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.342437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.342581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.342730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.342883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.343026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.343178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.343329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.343472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.343617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.343843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.344077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.344228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.344372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.344515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.344515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.344796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.344796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.345076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.345237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.345380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.345532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.345677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.345828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.345971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.346113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.346257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.346413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.346564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.346564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.346836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.346985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.347164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.347409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.347566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.347711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.347854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.348651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.348817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.348972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.349116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.349116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.349412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.349556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.349731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.349982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.350139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.350290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.350441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.350593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.350746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.350892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.351035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.351185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.351336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.351486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.351644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.351797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.351941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.352123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.352266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.352420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.352578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.352722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.352865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.353010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.353154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.353306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.353465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.353623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.353784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.353936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.354095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.354239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.354393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.354545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.354697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.354849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.355007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.355160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.355311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.355463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.355607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.355777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.355931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.356121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.356290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.356506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.356697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.356891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.357074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.357272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.357461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.357774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.357774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.358461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.358637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.358637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.358925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.359069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.359213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.359386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.359636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.359805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.360080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.360336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.360336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.360712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.360883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.361029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.361176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.361361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.361544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.361813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.362019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.362394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.362617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.362839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.363055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.363364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.363592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.364569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.364826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.365132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.365430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.365582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.365915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.366070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.366215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.366373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.366528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.366811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.366964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.367149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.367371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.367539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.367800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.368038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.368202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.368417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.368577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.368867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.369017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.369170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.369569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.369734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.370067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.370301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.370513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.370666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.370847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.371168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.371333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.371602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.371765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.372134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.372297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.372454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.372645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.372818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.372987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.373149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.373321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.373482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.374013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.374175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.374321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.374472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.374624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.374778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.374930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.375088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.375231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.375374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.375524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.375683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.375683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.376021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.376192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.376344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.376496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.376649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.376793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.376936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.377090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.377233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.377388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.377532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.377532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.377803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.378074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.378227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.378381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.378533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.378685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.378845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.379120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.379279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.379999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.380165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.380419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.380573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.380724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.380877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.381029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.381180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.381325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.381470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.381639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.381793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.381938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.382080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.382230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.382383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.382535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.382694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.382845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.382989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.383142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.383293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.383445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.383606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.383759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.383901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.383901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.384212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.384368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.384522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.384672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.384824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.384967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.385116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.385268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.385418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.385581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.385733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.385883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.386026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.386189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.386337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.386747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.386896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.387135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.387298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.387502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.387653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.387864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.388056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.388314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.388474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.388627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.388770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.388912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.389055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.389351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.389479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.389588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.389707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.389803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.389890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.390131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.390426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.390536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.390765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.390872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.391099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.391216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.391411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.391516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.391728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.391842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.392070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.392191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.392386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.392504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.392703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.392816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.393013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.393119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.393327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.393437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.393640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.393738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.393955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.394065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.394266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.394369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.394580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.394685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.394890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.394987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.395792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.396606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.396606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.396792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.396899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.397019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.397178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.397316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.397421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.397531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.397683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.397778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.397875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.397965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.398147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.398273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.398471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.398598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.398787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.398912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.399102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.399243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.399468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.399601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.399725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.399840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.400059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.400217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.400458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.400599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.400717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.400831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.400997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.401138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.401322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.401455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.401640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.401772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.401960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.402181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.402311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.402440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.402696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.402848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.403044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.403183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.403372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.403503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.403706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.404051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.404206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.404387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.404537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.404710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.404857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.405031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.405142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.405353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.405451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.405681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.405779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.406006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.406274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.406373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.406620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.406726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.406942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.407053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.407324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.407441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.407599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.407758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.407916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.408045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.408260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.408366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.408578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.408676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.408912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.409028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.409233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.409329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.409552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.443242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.443242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.444597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.444597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.444597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.444597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.444597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.446515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.446624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.446720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.446811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.446927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.447070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.447206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.447326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.447427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.447519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.447639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.447772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.447889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.448013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.448112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.448232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.448353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.448530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.448653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.448784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.448889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.449924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.450152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.450296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.450426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.450549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.450675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.450804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.450932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.451054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.451181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.451339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.451339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.451627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.451627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.452083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.452329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.452569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.452569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.453066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.453302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.453302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.453911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.454112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.454341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.454547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.454765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.455592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.455722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.455853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.456607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.456752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.456859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.456954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.457073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.457249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.457388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.457466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.458181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.458256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.458315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.458383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.458444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.458566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.458670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.458748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.458830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.458902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.459010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.459123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.459219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.459382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.459541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.459665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.459743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.459814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.459883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.460008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.460008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.460315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.460671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.460752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.460892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.460967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.461083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.461157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.461397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.461397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.461613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.461718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.461718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.461912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.462970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.463136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.463227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.463338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.463416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.463486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.463586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.463681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.463762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.463855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.463993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.464877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.465891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.466938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.467224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.467308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.467418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.467497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.467568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.467638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.467710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.467789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.467863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.467934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.468997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.469882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.470958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.471847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119479) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:02:06.472162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.472640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.473898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.474982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.475706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.475706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.475706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.475706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.475706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.475706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.475706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.475706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.476409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.476409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.476409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.476409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.476409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.476409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.476409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.476883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.476883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.477098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.477419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.477739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.478081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.478416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.478734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.479070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.479399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.479726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.480083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.480408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.480751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.481073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.481444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.481770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.482093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.482421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.482744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.483066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.483389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.483717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.484068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.484408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.484747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.485070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.485407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.485748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.486108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.486433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.486792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.487128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.487453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.487774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.488258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:02:06.488511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:02:06.518513 n-d-833090-9 devstack@n-api.service[119479]: INFO dbcounter [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Registered counter for database nova_api Jul 26 14:02:06.541143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_db.sqlalchemy.engines [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:02:06.550659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writer thread running {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:02:06.553023 n-d-833090-9 devstack@n-api.service[119478]: INFO dbcounter [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Registered counter for database nova_api Jul 26 14:02:06.574703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_db.sqlalchemy.engines [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:02:06.582061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writer thread running {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:02:06.608735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.context [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) {{(pid=119479) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 14:02:06.612941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:06.614960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:06.615790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:06.617867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:06.619943 n-d-833090-9 devstack@n-api.service[119479]: INFO dbcounter [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Registered counter for database nova_cell0 Jul 26 14:02:06.625334 n-d-833090-9 devstack@n-api.service[119479]: INFO dbcounter [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Registered counter for database nova_cell1 Jul 26 14:02:06.632776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_db.sqlalchemy.engines [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:02:06.634130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_db.sqlalchemy.engines [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:02:06.641314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writer thread running {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:02:06.642632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writer thread running {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:02:06.642941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.context [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) {{(pid=119478) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 14:02:06.649108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:06.650730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:06.651640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:06.654023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:06.656231 n-d-833090-9 devstack@n-api.service[119478]: INFO dbcounter [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Registered counter for database nova_cell0 Jul 26 14:02:06.662029 n-d-833090-9 devstack@n-api.service[119478]: INFO dbcounter [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Registered counter for database nova_cell1 Jul 26 14:02:06.671178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_db.sqlalchemy.engines [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:02:06.674966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_db.sqlalchemy.engines [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:02:06.686720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writer thread running {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:02:06.687118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writer thread running {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:02:06.803818 n-d-833090-9 devstack@n-api.service[119479]: INFO dbcounter [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Registered counter for database nova_cell0 Jul 26 14:02:06.811441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_db.sqlalchemy.engines [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119479) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:02:06.816360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writer thread running {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:02:06.857277 n-d-833090-9 devstack@n-api.service[119478]: INFO dbcounter [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Registered counter for database nova_cell0 Jul 26 14:02:06.866341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_db.sqlalchemy.engines [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:02:06.872581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writer thread running {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:02:07.150308 n-d-833090-9 devstack@n-api.service[119479]: WARNING keystonemiddleware.auth_token [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:02:07.158518 n-d-833090-9 devstack@n-api.service[119479]: WARNING keystonemiddleware.auth_token [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:02:07.263413 n-d-833090-9 devstack@n-api.service[119478]: WARNING keystonemiddleware.auth_token [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:02:07.274971 n-d-833090-9 devstack@n-api.service[119478]: WARNING keystonemiddleware.auth_token [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:02:07.555072 n-d-833090-9 devstack@n-api.service[119479]: WARNING keystonemiddleware.auth_token [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:02:07.563429 n-d-833090-9 devstack@n-api.service[119479]: WARNING keystonemiddleware.auth_token [None req-f9753f3e-2026-4ba5-819b-a881d1f13d09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:02:07.571302 n-d-833090-9 devstack@n-api.service[119479]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d95f739c0 pid: 119479 (default app) Jul 26 14:02:07.671786 n-d-833090-9 devstack@n-api.service[119478]: WARNING keystonemiddleware.auth_token [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:02:07.678168 n-d-833090-9 devstack@n-api.service[119478]: WARNING keystonemiddleware.auth_token [None req-044a3c63-17ea-4205-a785-67d1923a2d9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:02:07.683564 n-d-833090-9 devstack@n-api.service[119478]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d95f739c0 pid: 119478 (default app) Jul 26 14:02:54.535140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:02:54.537617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:02:54.538934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:02:54.539812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:02:56.051269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-28f7a173-adea-44bf-b536-0328b1c6c885 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-363022954", "id": 1139025405, "os-flavor-access:is_public": "True"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:56.072571 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:56.072571 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:56.108935 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-28f7a173-adea-44bf-b536-0328b1c6c885 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 1.579785 Jul 26 14:02:56.110084 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1/1] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:54 2022] POST /compute/v2.1/flavors => generated 429 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:56.125906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:02:56.127327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:02:56.128100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:02:56.129069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:02:56.363104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a9260ef1-8ec1-46e5-840e-8eb68c43806c tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:56.365140 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:56.365140 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:02:56.410649 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a9260ef1-8ec1-46e5-840e-8eb68c43806c tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1139025405" status: 202 len: 0 microversion: 2.1 time: 0.290534 Jul 26 14:02:56.414597 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1/2] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:02:56 2022] DELETE /compute/v2.1/flavors/1139025405 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:02:56.421339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f4916e58-adb8-415e-8e27-56bd7d8a608d tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:56.461232 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f4916e58-adb8-415e-8e27-56bd7d8a608d tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044760 Jul 26 14:02:56.461929 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:02:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:02:56.480656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-faa670fd-2cf6-4e3a-b3da-aa1284bb35d0 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1725262903", "id": 1138768128, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:56.503480 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:56.503480 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:02:56.533988 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-faa670fd-2cf6-4e3a-b3da-aa1284bb35d0 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.057015 Jul 26 14:02:56.535214 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3/4] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:56 2022] POST /compute/v2.1/flavors => generated 417 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:02:56.547327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-abf9ebd5-57fc-4bd6-940d-160b6ad9b922 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:56.573800 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-abf9ebd5-57fc-4bd6-940d-160b6ad9b922 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.030272 Jul 26 14:02:56.574694 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 4/5] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:02:56 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:02:56.592986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e01b966a-5f1e-410b-8fb1-f5558c9100e6 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:56.615361 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e01b966a-5f1e-410b-8fb1-f5558c9100e6 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1138768128" status: 202 len: 0 microversion: 2.1 time: 0.025387 Jul 26 14:02:56.615880 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 5/6] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:02:56 2022] DELETE /compute/v2.1/flavors/1138768128 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:02:56.625164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4f21b494-1978-4120-9559-687b89c8fbf1 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:56.648918 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4f21b494-1978-4120-9559-687b89c8fbf1 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028080 Jul 26 14:02:56.649742 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 6/7] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:02:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:02:56.672048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a0bad5dd-a0dc-4812-8a35-9ddfc7e90d6e tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-489007509", "id": 176181743, "os-flavor-access:is_public": "True"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:56.690213 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a0bad5dd-a0dc-4812-8a35-9ddfc7e90d6e tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.025226 Jul 26 14:02:56.691300 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 7/8] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:56 2022] POST /compute/v2.1/flavors => generated 425 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:56.703826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ba0e2b4b-ed3f-4a79-9a32-3b72d426d127 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:56.722923 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ba0e2b4b-ed3f-4a79-9a32-3b72d426d127 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/176181743" status: 202 len: 0 microversion: 2.1 time: 0.022476 Jul 26 14:02:56.723739 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 8/9] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:02:56 2022] DELETE /compute/v2.1/flavors/176181743 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:02:56.733037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a05a5402-b2f0-4117-ba12-8833c02fc84f tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:56.753928 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a05a5402-b2f0-4117-ba12-8833c02fc84f tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025424 Jul 26 14:02:56.754880 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 9/10] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:02:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:02:56.774960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c14c7195-0601-4417-a06e-856a9c43ab6d tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1260376157", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:56.797655 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c14c7195-0601-4417-a06e-856a9c43ab6d tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.027287 Jul 26 14:02:56.798791 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 10/11] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:56 2022] POST /compute/v2.1/flavors => generated 507 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:02:56.810386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e09dc797-f7df-4975-899d-859166031523 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:56.832215 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e09dc797-f7df-4975-899d-859166031523 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/86ce7f6d-ce3f-4260-b12e-414dd6a9e08f" status: 202 len: 0 microversion: 2.1 time: 0.025394 Jul 26 14:02:56.832964 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 11/12] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:02:56 2022] DELETE /compute/v2.1/flavors/86ce7f6d-ce3f-4260-b12e-414dd6a9e08f => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:02:56.893752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ce01c980-d316-4ec8-85b3-0b9f204ee1f6 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Calling method '.version_select at 0x7f8796b958b0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:56.897211 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:56.897211 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:56.898632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce01c980-d316-4ec8-85b3-0b9f204ee1f6 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:56.899092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce01c980-d316-4ec8-85b3-0b9f204ee1f6 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:56.899915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce01c980-d316-4ec8-85b3-0b9f204ee1f6 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:56.900380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce01c980-d316-4ec8-85b3-0b9f204ee1f6 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:56.948351 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ce01c980-d316-4ec8-85b3-0b9f204ee1f6 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.620477 Jul 26 14:02:56.948965 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2/13] 10.222.0.70 () {58 vars in 1128 bytes} [Tue Jul 26 14:02:56 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:56.953538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-056fca2f-c9fc-46f2-9d03-ed6b28de31e3 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:56.991296 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-056fca2f-c9fc-46f2-9d03-ed6b28de31e3 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040947 Jul 26 14:02:56.993034 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3/14] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:02:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:02:57.416248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cfa94b88-73d3-407d-bfc5-d09b6b3f23f5 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Calling method '.version_select at 0x7f8796a1fc10>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:57.418891 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:57.418891 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:57.420458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cfa94b88-73d3-407d-bfc5-d09b6b3f23f5 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '3eb94c389969442a862dd55c80ca1660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14550b44edf45729f2b68d915cc9ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cfa94b88-73d3-407d-bfc5-d09b6b3f23f5 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Request method failure captured: Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QNdBoWfGwnBsHW8dfjjCKIyJiY-D50vC8pFhkqv02qN6XLgCdcovGiw6k-sl7raGGi6FyVoiT_M3S7Iu6XBiCEB9026g5io2FKB7uFlzgZzLyeTa1OUXVZaKDPWNPwyprUFc5sq6fPw_OJWdnfZCT0JWJhjBMkGwor8X0tv-3XHEc Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:02:57.428416 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d14550b44edf45729f2b68d915cc9ea5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}] Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 3eb94c389969442a862dd55c80ca1660 Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: action_args: {} Jul 26 14:02:57.429918 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:02:57.430727 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 26 14:02:57.431890 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:57.433075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cfa94b88-73d3-407d-bfc5-d09b6b3f23f5 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:57.433075 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cfa94b88-73d3-407d-bfc5-d09b6b3f23f5 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.435241 Jul 26 14:02:57.435821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 4/15] 10.222.0.70 () {58 vars in 1128 bytes} [Tue Jul 26 14:02:56 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 442 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:02:57.440773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7bf175c1-9a75-416a-bc9e-12e6a80e0ab3 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-299808302", "id": "b59ad6d1-c338-41e9-9341-fd6e0860f6f6", "os-flavor-access:is_public": "True"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:57.444997 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:57.444997 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:57.466506 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7bf175c1-9a75-416a-bc9e-12e6a80e0ab3 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.028939 Jul 26 14:02:57.478167 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 5/16] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:57 2022] POST /compute/v2.1/flavors => generated 506 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:57.688506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-187c1822-1327-41be-877a-4971e01d39a6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '.version_select at 0x7f87969f4040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:57.690411 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:57.690411 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:02:57.698572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-187c1822-1327-41be-877a-4971e01d39a6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) {{(pid=119478) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 26 14:02:57.699570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-187c1822-1327-41be-877a-4971e01d39a6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:57.700180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-187c1822-1327-41be-877a-4971e01d39a6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:57.726757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-187c1822-1327-41be-877a-4971e01d39a6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:57.727478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-187c1822-1327-41be-877a-4971e01d39a6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:57.742962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-187c1822-1327-41be-877a-4971e01d39a6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:57.744186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-187c1822-1327-41be-877a-4971e01d39a6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:57.751527 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-187c1822-1327-41be-877a-4971e01d39a6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.914124 Jul 26 14:02:57.752484 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 12/17] 10.222.0.70 () {58 vars in 1167 bytes} [Tue Jul 26 14:02:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:02:57.836782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d234904e-70c5-4412-83a5-b9aedd69f726 tempest-FlavorsV255TestJSON-1180149233 tempest-FlavorsV255TestJSON-1180149233-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1491156893", "id": 2017964969, "os-flavor-access:is_public": "True"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:57.865136 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d234904e-70c5-4412-83a5-b9aedd69f726 tempest-FlavorsV255TestJSON-1180149233 tempest-FlavorsV255TestJSON-1180149233-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.385007 Jul 26 14:02:57.866899 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 6/18] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:02:57 2022] POST /compute/v2.1/flavors => generated 449 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:02:57.871701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29dc10a2-9363-46b8-a2b9-5be7f0ddb659 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Calling method '.version_select at 0x7f8796971940>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:57.872556 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:57.872556 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:57.873656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-29dc10a2-9363-46b8-a2b9-5be7f0ddb659 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '3eb94c389969442a862dd55c80ca1660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14550b44edf45729f2b68d915cc9ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29dc10a2-9363-46b8-a2b9-5be7f0ddb659 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Request method failure captured: Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hosts/n-d-833090-9/reboot HTTP/1.1 Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QNdBoWfGwnBsHW8dfjjCKIyJiY-D50vC8pFhkqv02qN6XLgCdcovGiw6k-sl7raGGi6FyVoiT_M3S7Iu6XBiCEB9026g5io2FKB7uFlzgZzLyeTa1OUXVZaKDPWNPwyprUFc5sq6fPw_OJWdnfZCT0JWJhjBMkGwor8X0tv-3XHEc Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:02:57.875217 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d14550b44edf45729f2b68d915cc9ea5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}] Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 3eb94c389969442a862dd55c80ca1660 Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'n-d-833090-9'} Jul 26 14:02:57.876713 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:02:57.877583 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 26 14:02:57.878720 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:57.882476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29dc10a2-9363-46b8-a2b9-5be7f0ddb659 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:57.883657 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-29dc10a2-9363-46b8-a2b9-5be7f0ddb659 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-833090-9/reboot" status: 403 len: 111 microversion: 2.1 time: 0.015506 Jul 26 14:02:57.884512 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 7/19] 10.222.0.70 () {58 vars in 1188 bytes} [Tue Jul 26 14:02:57 2022] GET /compute/v2.1/os-hosts/n-d-833090-9/reboot => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:02:57.889286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8d10d981-4129-4af4-b457-d01c79724431 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:57.890063 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:57.890063 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:57.919335 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8d10d981-4129-4af4-b457-d01c79724431 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/b59ad6d1-c338-41e9-9341-fd6e0860f6f6" status: 202 len: 0 microversion: 2.1 time: 0.033684 Jul 26 14:02:57.920481 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 8/20] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:02:57 2022] DELETE /compute/v2.1/flavors/b59ad6d1-c338-41e9-9341-fd6e0860f6f6 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:02:57.948756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5e1c65b0-c92d-4cc2-a8ae-6d5085120e82 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:57.950431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e1c65b0-c92d-4cc2-a8ae-6d5085120e82 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:57.950881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e1c65b0-c92d-4cc2-a8ae-6d5085120e82 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:57.951672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e1c65b0-c92d-4cc2-a8ae-6d5085120e82 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:57.952341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e1c65b0-c92d-4cc2-a8ae-6d5085120e82 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:57.994054 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5e1c65b0-c92d-4cc2-a8ae-6d5085120e82 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.240262 Jul 26 14:02:57.994679 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 13/21] 10.222.0.70 () {58 vars in 1164 bytes} [Tue Jul 26 14:02:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:02:58.074789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-34cc9151-189d-4617-af71-f42a7fc47f9d tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.077480 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.077480 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:58.079638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34cc9151-189d-4617-af71-f42a7fc47f9d tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:58.080145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34cc9151-189d-4617-af71-f42a7fc47f9d tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:58.080967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34cc9151-189d-4617-af71-f42a7fc47f9d tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:58.081402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34cc9151-189d-4617-af71-f42a7fc47f9d tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:58.111199 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-34cc9151-189d-4617-af71-f42a7fc47f9d tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.189652 Jul 26 14:02:58.111782 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 9/22] 10.222.0.70 () {58 vars in 1176 bytes} [Tue Jul 26 14:02:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:58.118187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b981496c-7a55-4d1f-b44d-3c5c5caff5c5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1194475643", "name": "tempest-test_aggregate-1424898293"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:58.138114 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.138114 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:58.139423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-b981496c-7a55-4d1f-b44d-3c5c5caff5c5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Generated uuid 87ba207b-3c07-4ed9-92a1-e911368a7c72 for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:02:58.227821 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b981496c-7a55-4d1f-b44d-3c5c5caff5c5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.114118 Jul 26 14:02:58.229405 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 10/23] 10.222.0.70 () {60 vars in 1165 bytes} [Tue Jul 26 14:02:58 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:58.242860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b84b62f9-9ad1-48bf-bdaf-5a265cd53346 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Calling method '.version_select at 0x7f879697bf70>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.245446 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.245446 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:02:58.247373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84b62f9-9ad1-48bf-bdaf-5a265cd53346 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:58.248055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84b62f9-9ad1-48bf-bdaf-5a265cd53346 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:58.269318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84b62f9-9ad1-48bf-bdaf-5a265cd53346 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:58.269837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84b62f9-9ad1-48bf-bdaf-5a265cd53346 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:58.282462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84b62f9-9ad1-48bf-bdaf-5a265cd53346 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:58.283886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84b62f9-9ad1-48bf-bdaf-5a265cd53346 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:58.291674 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b84b62f9-9ad1-48bf-bdaf-5a265cd53346 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.295860 Jul 26 14:02:58.292600 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 14/24] 10.222.0.70 () {60 vars in 1208 bytes} [Tue Jul 26 14:02:57 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:02:58.297244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a7421e55-8308-41e4-be92-c2a98bf7c5c8 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Calling method '.version_select at 0x7f8796982820>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.298032 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.298032 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:02:58.340340 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-a7421e55-8308-41e4-be92-c2a98bf7c5c8 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a7421e55-8308-41e4-be92-c2a98bf7c5c8 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Request method failure captured: Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QQJygs67oJPJOqBhWbNLubDEI2h80UE9YExWoyTkNz8LQuOq618QnzXnFl8JAQj4kwE90W9BIaz_66lr3r0fsCcuXycGPFSWJZ_N-9havrJLLS8ErkQHoypaMKSve2qtydzXlndtQgFMav8_0kCofl0x0xwqH-gUWTz21lcUfd1iQ Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:02:58.347660 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d04f1ac4a4fdd81aeff2e4f449e66", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}] Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f7c91a5dc357460f9aaa5f7c0bad80c8 Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'nonexistent_hostname'} Jul 26 14:02:58.348972 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:02:58.350566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 26 14:02:58.351728 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.353605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a7421e55-8308-41e4-be92-c2a98bf7c5c8 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:58.354778 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a7421e55-8308-41e4-be92-c2a98bf7c5c8 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.059945 Jul 26 14:02:58.354778 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 15/25] 10.222.0.70 () {58 vars in 1212 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:02:58.359519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32529d64-8173-4e94-aa04-ad5536f7306d tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.367507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-02825aab-7f77-4b48-9c20-16f6966bb23e tempest-FlavorsV255TestJSON-540029209 tempest-FlavorsV255TestJSON-540029209-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.384728 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32529d64-8173-4e94-aa04-ad5536f7306d tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.028999 Jul 26 14:02:58.385613 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 16/26] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:02:58.385720 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-02825aab-7f77-4b48-9c20-16f6966bb23e tempest-FlavorsV255TestJSON-540029209 tempest-FlavorsV255TestJSON-540029209-project] 10.222.0.70 "GET /compute/v2.1/flavors/2017964969" status: 200 len: 449 microversion: 2.55 time: 0.155033 Jul 26 14:02:58.386730 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 11/27] 10.222.0.70 () {60 vars in 1199 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/flavors/2017964969 => generated 449 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:02:58.391495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5764574-a971-43f1-86d2-25870ab440e4 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.392283 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.392283 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:58.397527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-330ae5fc-1693-448f-84d1-f3562133b0a3 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.398961 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.398961 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:02:58.401519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-330ae5fc-1693-448f-84d1-f3562133b0a3 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:58.406472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-330ae5fc-1693-448f-84d1-f3562133b0a3 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:58.407115 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5764574-a971-43f1-86d2-25870ab440e4 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.018910 Jul 26 14:02:58.408346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-330ae5fc-1693-448f-84d1-f3562133b0a3 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:58.409058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-330ae5fc-1693-448f-84d1-f3562133b0a3 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:58.414502 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 12/28] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:58.419654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e9595695-8bf2-4a8f-acdf-5517a7c4e73c tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Calling method '.version_select at 0x7f879699e0d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.421196 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.421196 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:58.423289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e9595695-8bf2-4a8f-acdf-5517a7c4e73c tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '3eb94c389969442a862dd55c80ca1660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14550b44edf45729f2b68d915cc9ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e9595695-8bf2-4a8f-acdf-5517a7c4e73c tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Request method failure captured: Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hosts/n-d-833090-9 HTTP/1.1 Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QNdBoWfGwnBsHW8dfjjCKIyJiY-D50vC8pFhkqv02qN6XLgCdcovGiw6k-sl7raGGi6FyVoiT_M3S7Iu6XBiCEB9026g5io2FKB7uFlzgZzLyeTa1OUXVZaKDPWNPwyprUFc5sq6fPw_OJWdnfZCT0JWJhjBMkGwor8X0tv-3XHEc Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:02:58.425018 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d14550b44edf45729f2b68d915cc9ea5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}] Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 3eb94c389969442a862dd55c80ca1660 Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'n-d-833090-9'} Jul 26 14:02:58.426141 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:02:58.426789 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 26 14:02:58.428293 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.429147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e9595695-8bf2-4a8f-acdf-5517a7c4e73c tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:58.429751 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e9595695-8bf2-4a8f-acdf-5517a7c4e73c tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-833090-9" status: 403 len: 109 microversion: 2.1 time: 0.013911 Jul 26 14:02:58.431135 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 13/29] 10.222.0.70 () {58 vars in 1167 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/os-hosts/n-d-833090-9 => generated 109 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:02:58.436745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6643a527-e9fa-483c-ad03-e35c22ac6886 tempest-FlavorsV255TestJSON-1180149233 tempest-FlavorsV255TestJSON-1180149233-project-admin] Action: 'update', calling method: .version_select at 0x7f8796f3e4c0>, body: {"flavor": {"description": "new"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:58.442545 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-330ae5fc-1693-448f-84d1-f3562133b0a3 tempest-AZAdminV2TestJSON-1054495090 tempest-AZAdminV2TestJSON-1054495090-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.055852 Jul 26 14:02:58.443941 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 17/30] 10.222.0.70 () {58 vars in 1185 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:58.449031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9288320a-7379-4bce-bb22-df169f6374da tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1076548662", "id": 1329662216, "os-flavor-access:is_public": "True"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:58.449222 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.449222 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:58.452550 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.452550 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:02:58.471521 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9288320a-7379-4bce-bb22-df169f6374da tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.026493 Jul 26 14:02:58.479641 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 18/31] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:58 2022] POST /compute/v2.1/flavors => generated 414 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:58.479641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-834947a3-3940-4791-be2d-bbef2f39fd43 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-9"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:58.482178 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.482178 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:02:58.493442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-834947a3-3940-4791-be2d-bbef2f39fd43 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:58.494284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-834947a3-3940-4791-be2d-bbef2f39fd43 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:58.504173 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6643a527-e9fa-483c-ad03-e35c22ac6886 tempest-FlavorsV255TestJSON-1180149233 tempest-FlavorsV255TestJSON-1180149233-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/2017964969" status: 200 len: 450 microversion: 2.55 time: 0.072159 Jul 26 14:02:58.505438 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 14/32] 10.222.0.70 () {62 vars in 1219 bytes} [Tue Jul 26 14:02:58 2022] PUT /compute/v2.1/flavors/2017964969 => generated 450 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:02:58.510605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a37a013-174b-4f07-9be1-2948d3623257 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Calling method '.version_select at 0x7f8796c29f70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.532067 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-9a37a013-174b-4f07-9be1-2948d3623257 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a37a013-174b-4f07-9be1-2948d3623257 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Request method failure captured: Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QQJygs67oJPJOqBhWbNLubDEI2h80UE9YExWoyTkNz8LQuOq618QnzXnFl8JAQj4kwE90W9BIaz_66lr3r0fsCcuXycGPFSWJZ_N-9havrJLLS8ErkQHoypaMKSve2qtydzXlndtQgFMav8_0kCofl0x0xwqH-gUWTz21lcUfd1iQ Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:02:58.541776 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d04f1ac4a4fdd81aeff2e4f449e66", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}] Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f7c91a5dc357460f9aaa5f7c0bad80c8 Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'nonexistent_hostname'} Jul 26 14:02:58.542952 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:58.543588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:58.544711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.546330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a37a013-174b-4f07-9be1-2948d3623257 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:58.546330 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9a37a013-174b-4f07-9be1-2948d3623257 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.036963 Jul 26 14:02:58.549339 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 15/33] 10.222.0.70 () {58 vars in 1191 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:02:58.554695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0408c5ac-d26f-42f0-ae97-7b2f7f1e0bce tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.568705 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0408c5ac-d26f-42f0-ae97-7b2f7f1e0bce tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1329662216" status: 200 len: 414 microversion: 2.1 time: 0.018000 Jul 26 14:02:58.570362 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 16/34] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/flavors/1329662216 => generated 414 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:58.576359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f949347d-a892-43d1-b7a8-22cc48fd9e0b tempest-FlavorsV255TestJSON-540029209 tempest-FlavorsV255TestJSON-540029209-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.614142 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f949347d-a892-43d1-b7a8-22cc48fd9e0b tempest-FlavorsV255TestJSON-540029209 tempest-FlavorsV255TestJSON-540029209-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.042003 Jul 26 14:02:58.614953 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 17/35] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:02:58.636606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92a8f3b8-d129-449b-a6e5-8c2450529a91 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Calling method '.version_select at 0x7f8796119c10>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.637419 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:58.637419 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:58.638805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-92a8f3b8-d129-449b-a6e5-8c2450529a91 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '3eb94c389969442a862dd55c80ca1660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14550b44edf45729f2b68d915cc9ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92a8f3b8-d129-449b-a6e5-8c2450529a91 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Request method failure captured: Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hosts/n-d-833090-9/shutdown HTTP/1.1 Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QNdBoWfGwnBsHW8dfjjCKIyJiY-D50vC8pFhkqv02qN6XLgCdcovGiw6k-sl7raGGi6FyVoiT_M3S7Iu6XBiCEB9026g5io2FKB7uFlzgZzLyeTa1OUXVZaKDPWNPwyprUFc5sq6fPw_OJWdnfZCT0JWJhjBMkGwor8X0tv-3XHEc Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:02:58.640889 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d14550b44edf45729f2b68d915cc9ea5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}] Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 3eb94c389969442a862dd55c80ca1660 Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'n-d-833090-9'} Jul 26 14:02:58.642249 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:02:58.643075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 26 14:02:58.644661 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:58.646783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92a8f3b8-d129-449b-a6e5-8c2450529a91 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:58.646783 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-92a8f3b8-d129-449b-a6e5-8c2450529a91 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-833090-9/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.012715 Jul 26 14:02:58.646783 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 18/36] 10.222.0.70 () {58 vars in 1194 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/os-hosts/n-d-833090-9/shutdown => generated 113 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:02:58.938862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2dfa161d-b345-42ba-a6d8-a4757ccc5594 tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.964927 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2dfa161d-b345-42ba-a6d8-a4757ccc5594 tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.320239 Jul 26 14:02:58.965515 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 19/37] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:02:58.970497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-10f4bcd8-79e9-43f2-9be4-562efd153a01 tempest-FlavorsV255TestJSON-540029209 tempest-FlavorsV255TestJSON-540029209-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:58.994093 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-10f4bcd8-79e9-43f2-9be4-562efd153a01 tempest-FlavorsV255TestJSON-540029209 tempest-FlavorsV255TestJSON-540029209-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 3411 microversion: 2.55 time: 0.027300 Jul 26 14:02:58.994672 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 20/38] 10.222.0.70 () {60 vars in 1166 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/flavors => generated 3411 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:02:58.999312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c6ff2952-aef6-425e-9d24-e99d9fe529be tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Calling method '.version_select at 0x7f8796119f70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.011400 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c6ff2952-aef6-425e-9d24-e99d9fe529be tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c6ff2952-aef6-425e-9d24-e99d9fe529be tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Request method failure captured: Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QQJygs67oJPJOqBhWbNLubDEI2h80UE9YExWoyTkNz8LQuOq618QnzXnFl8JAQj4kwE90W9BIaz_66lr3r0fsCcuXycGPFSWJZ_N-9havrJLLS8ErkQHoypaMKSve2qtydzXlndtQgFMav8_0kCofl0x0xwqH-gUWTz21lcUfd1iQ Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:02:59.016008 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d04f1ac4a4fdd81aeff2e4f449e66", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}] Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f7c91a5dc357460f9aaa5f7c0bad80c8 Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'nonexistent_hostname'} Jul 26 14:02:59.017296 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:02:59.018104 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 26 14:02:59.019285 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.020501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.022630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c6ff2952-aef6-425e-9d24-e99d9fe529be tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:59.023503 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c6ff2952-aef6-425e-9d24-e99d9fe529be tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.027749 Jul 26 14:02:59.024401 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 21/39] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Jul 26 14:02:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:02:59.029583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bdad309a-74a8-48c9-9ef0-da4940dd9dec tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.031011 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:59.031011 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:59.050971 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bdad309a-74a8-48c9-9ef0-da4940dd9dec tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1329662216" status: 202 len: 0 microversion: 2.1 time: 0.025423 Jul 26 14:02:59.053016 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 22/40] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:02:59 2022] DELETE /compute/v2.1/flavors/1329662216 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:02:59.058609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a4ec6d2-b3c4-4577-92e6-a940f5eed064 tempest-FlavorsV255TestJSON-1180149233 tempest-FlavorsV255TestJSON-1180149233-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.078186 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a4ec6d2-b3c4-4577-92e6-a940f5eed064 tempest-FlavorsV255TestJSON-1180149233 tempest-FlavorsV255TestJSON-1180149233-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/2017964969" status: 202 len: 0 microversion: 2.55 time: 0.023613 Jul 26 14:02:59.079025 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 23/41] 10.222.0.70 () {60 vars in 1202 bytes} [Tue Jul 26 14:02:59 2022] DELETE /compute/v2.1/flavors/2017964969 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:02:59.087522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-957ff039-850e-4635-a693-e9687bb7b719 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Calling method '.version_select at 0x7f8796119b80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.088353 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:59.088353 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:59.089592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-957ff039-850e-4635-a693-e9687bb7b719 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '3eb94c389969442a862dd55c80ca1660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14550b44edf45729f2b68d915cc9ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-957ff039-850e-4635-a693-e9687bb7b719 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Request method failure captured: Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hosts/n-d-833090-9/startup HTTP/1.1 Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QNdBoWfGwnBsHW8dfjjCKIyJiY-D50vC8pFhkqv02qN6XLgCdcovGiw6k-sl7raGGi6FyVoiT_M3S7Iu6XBiCEB9026g5io2FKB7uFlzgZzLyeTa1OUXVZaKDPWNPwyprUFc5sq6fPw_OJWdnfZCT0JWJhjBMkGwor8X0tv-3XHEc Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:02:59.091183 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d14550b44edf45729f2b68d915cc9ea5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}] Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 3eb94c389969442a862dd55c80ca1660 Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'n-d-833090-9'} Jul 26 14:02:59.092314 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:02:59.092988 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 26 14:02:59.093910 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.094925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-957ff039-850e-4635-a693-e9687bb7b719 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:59.094925 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-957ff039-850e-4635-a693-e9687bb7b719 tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-833090-9/startup" status: 403 len: 110 microversion: 2.1 time: 0.008998 Jul 26 14:02:59.094925 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 24/42] 10.222.0.70 () {58 vars in 1191 bytes} [Tue Jul 26 14:02:59 2022] GET /compute/v2.1/os-hosts/n-d-833090-9/startup => generated 110 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:02:59.102044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-367d7629-20c9-4792-9f23-107668144538 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.135941 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-367d7629-20c9-4792-9f23-107668144538 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040719 Jul 26 14:02:59.147995 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 25/43] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:02:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:02:59.147995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae8aa1f5-2338-47a8-b6a6-6a95a7bfa6ea tempest-FlavorsV255TestJSON-1180149233 tempest-FlavorsV255TestJSON-1180149233-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.217455 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ae8aa1f5-2338-47a8-b6a6-6a95a7bfa6ea tempest-FlavorsV255TestJSON-1180149233 tempest-FlavorsV255TestJSON-1180149233-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.077735 Jul 26 14:02:59.227995 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 26/44] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:02:59 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:02:59.228248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8adcae04-def8-4c39-a80b-d3cab3e4dc83 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Calling method '.version_select at 0x7f87961195e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.245051 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-8adcae04-def8-4c39-a80b-d3cab3e4dc83 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8adcae04-def8-4c39-a80b-d3cab3e4dc83 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Request method failure captured: Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QQJygs67oJPJOqBhWbNLubDEI2h80UE9YExWoyTkNz8LQuOq618QnzXnFl8JAQj4kwE90W9BIaz_66lr3r0fsCcuXycGPFSWJZ_N-9havrJLLS8ErkQHoypaMKSve2qtydzXlndtQgFMav8_0kCofl0x0xwqH-gUWTz21lcUfd1iQ Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:02:59.249544 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d04f1ac4a4fdd81aeff2e4f449e66", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}] Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f7c91a5dc357460f9aaa5f7c0bad80c8 Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'nonexistent_hostname'} Jul 26 14:02:59.251605 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:02:59.252876 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 26 14:02:59.254926 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.260485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8adcae04-def8-4c39-a80b-d3cab3e4dc83 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:59.263880 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8adcae04-def8-4c39-a80b-d3cab3e4dc83 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.043181 Jul 26 14:02:59.265892 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 27/45] 10.222.0.70 () {58 vars in 1215 bytes} [Tue Jul 26 14:02:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:02:59.277471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-371bd753-7249-45ce-bf6e-dc79a3795190 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-414740249", "id": 432489940, "os-flavor-access:is_public": "False"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:59.282189 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:59.282189 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:59.314931 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-834947a3-3940-4791-be2d-bbef2f39fd43 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.840997 Jul 26 14:02:59.315932 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 19/46] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:02:58 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:59.324606 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-371bd753-7249-45ce-bf6e-dc79a3795190 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.047816 Jul 26 14:02:59.327795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a263ad55-d560-4c60-8049-3a5c34e36595 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Action: 'update', calling method: .version_select at 0x7f879604af70>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:59.333475 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 28/47] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:59 2022] POST /compute/v2.1/flavors => generated 426 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a263ad55-d560-4c60-8049-3a5c34e36595 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Request method failure captured: Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: request: PUT /compute/v2.1/os-hosts/n-d-833090-9 HTTP/1.1 Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 51 Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QQJygs67oJPJOqBhWbNLubDEI2h80UE9YExWoyTkNz8LQuOq618QnzXnFl8JAQj4kwE90W9BIaz_66lr3r0fsCcuXycGPFSWJZ_N-9havrJLLS8ErkQHoypaMKSve2qtydzXlndtQgFMav8_0kCofl0x0xwqH-gUWTz21lcUfd1iQ Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:02:59.339891 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d04f1ac4a4fdd81aeff2e4f449e66", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}] Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f7c91a5dc357460f9aaa5f7c0bad80c8 Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: {"status": "enable", "maintenance_mode": "invalid"} Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:02:59.341336 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'n-d-833090-9', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'disable', Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'Enable', Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'Disable', Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance: Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.342150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.343676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.344870 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.344870 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:02:59.344870 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:02:59.344870 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 14:02:59.344870 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.345364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a263ad55-d560-4c60-8049-3a5c34e36595 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:59.346257 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a263ad55-d560-4c60-8049-3a5c34e36595 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-833090-9" status: 400 len: 199 microversion: 2.1 time: 0.029097 Jul 26 14:02:59.347006 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 20/48] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:02:59 2022] PUT /compute/v2.1/os-hosts/n-d-833090-9 => generated 199 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:02:59.357634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-46ec7f6c-0365-42ff-8b13-ed1ef056c9b1 tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "432489940"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:59.382246 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-46ec7f6c-0365-42ff-8b13-ed1ef056c9b1 tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] HTTP exception thrown: Flavor 432489940 could not be found. Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-46ec7f6c-0365-42ff-8b13-ed1ef056c9b1 tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] Request method failure captured: Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 106 Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QMrik5Zx1wj0zx6rydn_WC7x0d5OKGOcxI46DxYl7yPiq3fNlvK0T1NWV5gAUTHBni51WNbtr83Q3_03AJM8bT1fXlj8jz-hqhQRQdFlgBSXe6MULDvL66PwCY4PlGQMiadvtgJkPNfsKrIIndaZD0vu05vD_c97C21-pTho4Pv78 Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 51f167a6baa44fedb949662c77218baa Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FlavorsAdminTestJSON-1871170589 Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:02:59.385678 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/51f167a6baa44fedb949662c77218baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/51f167a6baa44fedb949662c77218baa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_51f167a6baa44fedb949662c77218baa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/51f167a6baa44fedb949662c77218baa"}]}] Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FlavorsAdminTestJSON-1871170589 Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 51f167a6baa44fedb949662c77218baa Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1871170589 Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FlavorsAdminTestJSON-1871170589-project Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: a3e32f0400274870b23918f8b0c92ed7 Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FlavorsAdminTestJSON-1871170589-project Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "test", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "432489940"}} Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:02:59.387053 n-d-833090-9 devstack@n-api.service[119478]: exception: Flavor 432489940 could not be found. Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '432489940'}}} Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 432489940 could not be found. Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.387914 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 432489940 could not be found. Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.389470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.390731 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.390731 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:02:59.390731 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:02:59.390731 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 432489940 could not be found. Jul 26 14:02:59.390731 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.391855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-46ec7f6c-0365-42ff-8b13-ed1ef056c9b1 tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] Returning 400 to user: Flavor 432489940 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:59.392884 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-46ec7f6c-0365-42ff-8b13-ed1ef056c9b1 tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.039648 Jul 26 14:02:59.393911 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 21/49] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:59 2022] POST /compute/v2.1/servers => generated 80 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:02:59.400403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81a55a12-21e2-41f0-ad63-002f732b0456 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Action: 'update', calling method: .version_select at 0x7f879604a820>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81a55a12-21e2-41f0-ad63-002f732b0456 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Request method failure captured: Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: request: PUT /compute/v2.1/os-hosts/n-d-833090-9 HTTP/1.1 Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 51 Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QQJygs67oJPJOqBhWbNLubDEI2h80UE9YExWoyTkNz8LQuOq618QnzXnFl8JAQj4kwE90W9BIaz_66lr3r0fsCcuXycGPFSWJZ_N-9havrJLLS8ErkQHoypaMKSve2qtydzXlndtQgFMav8_0kCofl0x0xwqH-gUWTz21lcUfd1iQ Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:02:59.404471 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d04f1ac4a4fdd81aeff2e4f449e66", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}] Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f7c91a5dc357460f9aaa5f7c0bad80c8 Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: {"status": "invalid", "maintenance_mode": "enable"} Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:02:59.405818 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'n-d-833090-9', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'disable', Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'Enable', Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'Disable', Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance: Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.406564 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.407987 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.409150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.409150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:02:59.409150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:02:59.409150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 26 14:02:59.409150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.411196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81a55a12-21e2-41f0-ad63-002f732b0456 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:59.413404 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-81a55a12-21e2-41f0-ad63-002f732b0456 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-833090-9" status: 400 len: 189 microversion: 2.1 time: 0.017998 Jul 26 14:02:59.414127 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 22/50] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:02:59 2022] PUT /compute/v2.1/os-hosts/n-d-833090-9 => generated 189 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:02:59.432253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-61660111-a146-4e7c-b96f-c256555ea8ea tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.446162 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:59.446162 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:02:59.473432 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-61660111-a146-4e7c-b96f-c256555ea8ea tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/432489940" status: 202 len: 0 microversion: 2.1 time: 0.054471 Jul 26 14:02:59.473432 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 23/51] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:02:59 2022] DELETE /compute/v2.1/flavors/432489940 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:02:59.481582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c333212-46fa-4f76-84f2-23912b3aef9a tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Action: 'update', calling method: .version_select at 0x7f8794fd80d0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:59.484045 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:59.484045 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:02:59.485979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c333212-46fa-4f76-84f2-23912b3aef9a tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '3eb94c389969442a862dd55c80ca1660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd14550b44edf45729f2b68d915cc9ea5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c333212-46fa-4f76-84f2-23912b3aef9a tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Request method failure captured: Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: request: PUT /compute/v2.1/os-hosts/n-d-833090-9 HTTP/1.1 Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 50 Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QNdBoWfGwnBsHW8dfjjCKIyJiY-D50vC8pFhkqv02qN6XLgCdcovGiw6k-sl7raGGi6FyVoiT_M3S7Iu6XBiCEB9026g5io2FKB7uFlzgZzLyeTa1OUXVZaKDPWNPwyprUFc5sq6fPw_OJWdnfZCT0JWJhjBMkGwor8X0tv-3XHEc Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:02:59.488239 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d14550b44edf45729f2b68d915cc9ea5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d14550b44edf45729f2b68d915cc9ea5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d14550b44edf45729f2b68d915cc9ea5"}]}] Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: d14550b44edf45729f2b68d915cc9ea5 Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2133348673 Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 3eb94c389969442a862dd55c80ca1660 Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2133348673-project Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: {"status": "enable", "maintenance_mode": "enable"} Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 26 14:02:59.489346 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'n-d-833090-9', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:02:59.490091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 26 14:02:59.491196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.493090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c333212-46fa-4f76-84f2-23912b3aef9a tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:59.493090 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2c333212-46fa-4f76-84f2-23912b3aef9a tempest-HostsAdminNegativeTestJSON-2133348673 tempest-HostsAdminNegativeTestJSON-2133348673-project] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-833090-9" status: 403 len: 111 microversion: 2.1 time: 0.015626 Jul 26 14:02:59.493090 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 24/52] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:02:59 2022] PUT /compute/v2.1/os-hosts/n-d-833090-9 => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:02:59.722335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-46942808", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "availability_zone": "tempest-test_az-1194475643"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:59.747520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:59.747845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:59.749080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:02:59.749523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:02:59.772575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c2937ed6-e063-412d-ae0f-76876a866058 tempest-InstanceUsageAuditLogTestJSON-1340067367 tempest-InstanceUsageAuditLogTestJSON-1340067367-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.773084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=5 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:02:59.773420 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:59.773420 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:59.797482 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c2937ed6-e063-412d-ae0f-76876a866058 tempest-InstanceUsageAuditLogTestJSON-1340067367 tempest-InstanceUsageAuditLogTestJSON-1340067367-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26 14:02:59" status: 200 len: 318 microversion: 2.1 time: 0.462457 Jul 26 14:02:59.799987 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 29/53] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 14:02:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26%2014%3A02%3A59 => generated 318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:59.813942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9b324a63-0146-44a5-ae94-a7518ed1f844 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.843176 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9b324a63-0146-44a5-ae94-a7518ed1f844 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033027 Jul 26 14:02:59.843764 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 30/54] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:02:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:02:59.848573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c372f53-c7d2-43c1-b435-7b32964689d2 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Action: 'update', calling method: .version_select at 0x7f8794fb50d0>, body: {"status": null, "maintenance_mode": null} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c372f53-c7d2-43c1-b435-7b32964689d2 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Request method failure captured: Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/os-hosts/n-d-833090-9 HTTP/1.1 Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 42 Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QQJygs67oJPJOqBhWbNLubDEI2h80UE9YExWoyTkNz8LQuOq618QnzXnFl8JAQj4kwE90W9BIaz_66lr3r0fsCcuXycGPFSWJZ_N-9havrJLLS8ErkQHoypaMKSve2qtydzXlndtQgFMav8_0kCofl0x0xwqH-gUWTz21lcUfd1iQ Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:02:59.853493 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d04f1ac4a4fdd81aeff2e4f449e66", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}] Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f7c91a5dc357460f9aaa5f7c0bad80c8 Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: {"status": null, "maintenance_mode": null} Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 26 14:02:59.854687 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'n-d-833090-9', 'body': {'status': None, 'maintenance_mode': None}} Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'disable', Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'Enable', Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'Disable', Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance: Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi None Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.856421 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.857836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.858807 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:02:59.858807 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:02:59.858807 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 26 14:02:59.858807 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.858807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c372f53-c7d2-43c1-b435-7b32964689d2 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:59.858807 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8c372f53-c7d2-43c1-b435-7b32964689d2 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-833090-9" status: 400 len: 127 microversion: 2.1 time: 0.009949 Jul 26 14:02:59.858807 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 31/55] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:02:59 2022] PUT /compute/v2.1/os-hosts/n-d-833090-9 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:02:59.864072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9d2f1d0b-b7e4-4e55-861f-35ca28552029 tempest-InstanceUsageAuditLogTestJSON-1340067367 tempest-InstanceUsageAuditLogTestJSON-1340067367-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.865173 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:59.865173 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:59.878456 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9d2f1d0b-b7e4-4e55-861f-35ca28552029 tempest-InstanceUsageAuditLogTestJSON-1340067367 tempest-InstanceUsageAuditLogTestJSON-1340067367-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.021961 Jul 26 14:02:59.879007 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 32/56] 10.222.0.70 () {58 vars in 1185 bytes} [Tue Jul 26 14:02:59 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:59.884819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c0e5343c-8093-4fae-9309-0ceb65b22bc1 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-641771774", "id": 213364469, "os-flavor-access:is_public": "False"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:59.887931 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:59.887931 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:59.906973 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c0e5343c-8093-4fae-9309-0ceb65b22bc1 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.026290 Jul 26 14:02:59.907893 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 33/57] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:59.916165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-be6325c3-5696-4330-a7ea-94e197f53255 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Action: 'update', calling method: .version_select at 0x7f8794fb6ca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:59.918766 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:02:59.918766 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:02:59.919674 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.hosts [None req-be6325c3-5696-4330-a7ea-94e197f53255 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Enabling host nonexistent_hostname. Jul 26 14:02:59.927920 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-be6325c3-5696-4330-a7ea-94e197f53255 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-be6325c3-5696-4330-a7ea-94e197f53255 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Request method failure captured: Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 50 Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QQJygs67oJPJOqBhWbNLubDEI2h80UE9YExWoyTkNz8LQuOq618QnzXnFl8JAQj4kwE90W9BIaz_66lr3r0fsCcuXycGPFSWJZ_N-9havrJLLS8ErkQHoypaMKSve2qtydzXlndtQgFMav8_0kCofl0x0xwqH-gUWTz21lcUfd1iQ Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:02:59.929755 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d04f1ac4a4fdd81aeff2e4f449e66", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d04f1ac4a4fdd81aeff2e4f449e66"}]}] Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c84d04f1ac4a4fdd81aeff2e4f449e66 Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-121383311 Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f7c91a5dc357460f9aaa5f7c0bad80c8 Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HostsAdminNegativeTestJSON-121383311-project-admin Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: {"status": "enable", "maintenance_mode": "enable"} Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.930830 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 14:02:59.931540 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:02:59.937500 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:02:59.938537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-be6325c3-5696-4330-a7ea-94e197f53255 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:02:59.939343 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-be6325c3-5696-4330-a7ea-94e197f53255 tempest-HostsAdminNegativeTestJSON-121383311 tempest-HostsAdminNegativeTestJSON-121383311-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.021806 Jul 26 14:02:59.939343 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 34/58] 10.222.0.70 () {60 vars in 1211 bytes} [Tue Jul 26 14:02:59 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:02:59.939343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-60b1ef84-2b15-464b-8288-e84a2a5c01db tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-564586021", "id": 1517699681, "os-flavor-access:is_public": "True"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:02:59.957701 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-60b1ef84-2b15-464b-8288-e84a2a5c01db tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.024551 Jul 26 14:02:59.959210 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 35/59] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:59 2022] POST /compute/v2.1/flavors => generated 413 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:02:59.973225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae82c04c-58ef-4534-bced-8ce4fe4fd23d tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:02:59.991386 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ae82c04c-58ef-4534-bced-8ce4fe4fd23d tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.024175 Jul 26 14:02:59.991980 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 36/60] 10.222.0.70 () {58 vars in 1169 bytes} [Tue Jul 26 14:02:59 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:00.004515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d76ab7d4-69e7-4ad4-b768-c8ddb23a8acf tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.010884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:00.016384 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d76ab7d4-69e7-4ad4-b768-c8ddb23a8acf tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.015487 Jul 26 14:03:00.017048 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 37/61] 10.222.0.70 () {58 vars in 1177 bytes} [Tue Jul 26 14:02:59 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:00.030010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c7b27a5c-0b5d-4fe5-bab5-7c1396dc43ed tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.041756 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c7b27a5c-0b5d-4fe5-bab5-7c1396dc43ed tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.015336 Jul 26 14:03:00.042329 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 38/62] 10.222.0.70 () {58 vars in 1171 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:00.056004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-22db2fcd-8e09-45a3-a47c-4f7472e84b44 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.073166 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-22db2fcd-8e09-45a3-a47c-4f7472e84b44 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.022135 Jul 26 14:03:00.073868 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 39/63] 10.222.0.70 () {58 vars in 1169 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:00.088013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-561bd261-f680-47f1-90b4-8c5ba1f9732f tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.114132 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-561bd261-f680-47f1-90b4-8c5ba1f9732f tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.031394 Jul 26 14:03:00.120010 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 40/64] 10.222.0.70 () {58 vars in 1169 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:00.134312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0559cf02-40b8-4759-9e9b-ca7f63472291 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.159313 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0559cf02-40b8-4759-9e9b-ca7f63472291 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.028935 Jul 26 14:03:00.160004 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 41/65] 10.222.0.70 () {58 vars in 1175 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:00.181231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0db7078-3496-43e5-a2b2-5120f45fa6f3 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.209508 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0db7078-3496-43e5-a2b2-5120f45fa6f3 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.032947 Jul 26 14:03:00.210512 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 42/66] 10.222.0.70 () {58 vars in 1173 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:00.229886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7f6ccea9-2e3a-4c65-8438-e12de3c7650f tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.251714 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7f6ccea9-2e3a-4c65-8438-e12de3c7650f tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.025676 Jul 26 14:03:00.252364 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 43/67] 10.222.0.70 () {58 vars in 1169 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:00.271790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ea895bb9-ab15-4f61-bf35-ed9c447ec9e1 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.272759 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:00.272759 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:00.292152 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ea895bb9-ab15-4f61-bf35-ed9c447ec9e1 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1517699681" status: 202 len: 0 microversion: 2.1 time: 0.024983 Jul 26 14:03:00.296353 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 44/68] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:03:00 2022] DELETE /compute/v2.1/flavors/1517699681 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:03:00.307408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43207424-bb43-4824-bf0d-9e90181bbbd7 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.340115 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43207424-bb43-4824-bf0d-9e90181bbbd7 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041826 Jul 26 14:03:00.340851 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 45/69] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:00.362341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23fdfc2e-96e9-4bf7-859c-497d5e4f7baf tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.382079 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23fdfc2e-96e9-4bf7-859c-497d5e4f7baf tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/213364469" status: 202 len: 0 microversion: 2.1 time: 0.023598 Jul 26 14:03:00.382815 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 46/70] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:03:00 2022] DELETE /compute/v2.1/flavors/213364469 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:03:00.391622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b0337cf5-9913-4e6b-9d46-3870810149d3 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.419353 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b0337cf5-9913-4e6b-9d46-3870810149d3 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032180 Jul 26 14:03:00.420044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 47/71] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:00.443940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b504beb0-1879-49c5-b7b7-a4d3d01e2204 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1609045927", "id": 651104683, "os-flavor-access:is_public": "False"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:00.469644 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b504beb0-1879-49c5-b7b7-a4d3d01e2204 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.032279 Jul 26 14:03:00.470588 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 48/72] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:03:00 2022] POST /compute/v2.1/flavors => generated 412 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:00.484183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-59829f23-df9c-48ee-bcd0-75108e998978 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.515042 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-59829f23-df9c-48ee-bcd0-75108e998978 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035310 Jul 26 14:03:00.515637 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 49/73] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:00.535547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6727877f-6c75-4217-83a7-72158511bdc4 tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.564132 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6727877f-6c75-4217-83a7-72158511bdc4 tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032282 Jul 26 14:03:00.580373 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 50/74] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:00.589178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e281a999-b8cc-48c3-b0e5-6c5cd6832d6a tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.619305 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e281a999-b8cc-48c3-b0e5-6c5cd6832d6a tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/651104683" status: 202 len: 0 microversion: 2.1 time: 0.036090 Jul 26 14:03:00.620271 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 51/75] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:03:00 2022] DELETE /compute/v2.1/flavors/651104683 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:03:00.633146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90e157c2-3e97-49ea-9d47-a8f5e73b025f tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.669676 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90e157c2-3e97-49ea-9d47-a8f5e73b025f tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044855 Jul 26 14:03:00.670524 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 52/76] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:00.691235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a483b159-2073-446f-9e90-7099ee816345 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-774358528", "id": 1218166017, "os-flavor-access:is_public": "True"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:00.711659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:03:00.718041 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a483b159-2073-446f-9e90-7099ee816345 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.030864 Jul 26 14:03:00.726286 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 53/77] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:03:00 2022] POST /compute/v2.1/flavors => generated 413 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:00.731788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cde2c54-23ed-4ba5-a995-5fe572b12e5a tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.758593 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5cde2c54-23ed-4ba5-a995-5fe572b12e5a tempest-FlavorsAdminTestJSON-1871170589 tempest-FlavorsAdminTestJSON-1871170589-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.030877 Jul 26 14:03:00.772012 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 54/78] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:00.778943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3c6c1ea-899d-4c4a-9649-b4608c4c11f9 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.805848 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3c6c1ea-899d-4c4a-9649-b4608c4c11f9 tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1218166017" status: 202 len: 0 microversion: 2.1 time: 0.030982 Jul 26 14:03:00.810969 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 55/79] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:03:00 2022] DELETE /compute/v2.1/flavors/1218166017 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:03:00.819779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9e562823-8979-4d7d-9c96-2f8a7390f86d tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:00.846563 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9e562823-8979-4d7d-9c96-2f8a7390f86d tempest-FlavorsAdminTestJSON-165428152 tempest-FlavorsAdminTestJSON-165428152-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033642 Jul 26 14:03:00.857005 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 56/80] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:01.195459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:03:01.196513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:03:01.197579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:03:01.199010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:03:01.201818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:03:01.222635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:01.223381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:01.225138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:01.225908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:01.270255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Getting quotas for project 9bdf50c8bd1141ee99a02883f0accc53. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:03:01.280574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Getting quotas for user 8950f62d5ff94fa2b3a54d9a1ced5924 and project 9bdf50c8bd1141ee99a02883f0accc53. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:03:01.303407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:03:01.307892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:03:01.378142 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-be379266-3685-48c8-9ec3-af4e6b4e29ae tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.885785 Jul 26 14:03:01.379493 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 25/81] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:02:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:03:01.393104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ae33c88-a4f4-4ead-99ea-98e3a6e532d1 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:01.394382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1ae33c88-a4f4-4ead-99ea-98e3a6e532d1 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:02.642692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ae33c88-a4f4-4ead-99ea-98e3a6e532d1 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:02.663343 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ae33c88-a4f4-4ead-99ea-98e3a6e532d1 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1241 microversion: 2.1 time: 1.276367 Jul 26 14:03:02.664668 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 57/82] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:01 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1241 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:03.690704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c4a864f0-b2cd-42cb-ad85-df89d29485f5 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:03.691282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c4a864f0-b2cd-42cb-ad85-df89d29485f5 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:03.722381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c4a864f0-b2cd-42cb-ad85-df89d29485f5 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:03.723183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c4a864f0-b2cd-42cb-ad85-df89d29485f5 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:03.724288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c4a864f0-b2cd-42cb-ad85-df89d29485f5 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:03.724905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c4a864f0-b2cd-42cb-ad85-df89d29485f5 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:04.018125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c4a864f0-b2cd-42cb-ad85-df89d29485f5 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:04.046924 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c4a864f0-b2cd-42cb-ad85-df89d29485f5 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1297 microversion: 2.1 time: 0.361319 Jul 26 14:03:04.048457 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 26/83] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:03 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1297 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:05.076251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f145e2eb-53cd-418f-90f3-eebd753ff676 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:05.077264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f145e2eb-53cd-418f-90f3-eebd753ff676 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:05.085680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f145e2eb-53cd-418f-90f3-eebd753ff676 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:05.086638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f145e2eb-53cd-418f-90f3-eebd753ff676 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:05.087683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f145e2eb-53cd-418f-90f3-eebd753ff676 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:05.088371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f145e2eb-53cd-418f-90f3-eebd753ff676 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:05.438974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f145e2eb-53cd-418f-90f3-eebd753ff676 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:05.455368 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f145e2eb-53cd-418f-90f3-eebd753ff676 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.383963 Jul 26 14:03:05.459091 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 58/84] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:05 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:06.484047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71dedb75-36ff-4f79-aedd-07eb9747c144 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:06.484788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-71dedb75-36ff-4f79-aedd-07eb9747c144 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:06.499922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71dedb75-36ff-4f79-aedd-07eb9747c144 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:06.501376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71dedb75-36ff-4f79-aedd-07eb9747c144 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:06.503677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71dedb75-36ff-4f79-aedd-07eb9747c144 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:06.504803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71dedb75-36ff-4f79-aedd-07eb9747c144 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:06.924637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-71dedb75-36ff-4f79-aedd-07eb9747c144 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:06.946163 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-71dedb75-36ff-4f79-aedd-07eb9747c144 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.466917 Jul 26 14:03:06.947090 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 27/85] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:06 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:07.970636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cacde045-3c24-480f-b6cc-b32701604235 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:07.972348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cacde045-3c24-480f-b6cc-b32701604235 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:07.993245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cacde045-3c24-480f-b6cc-b32701604235 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:07.999932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cacde045-3c24-480f-b6cc-b32701604235 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:08.001235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cacde045-3c24-480f-b6cc-b32701604235 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:08.001703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cacde045-3c24-480f-b6cc-b32701604235 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:08.107781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:08.862882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cacde045-3c24-480f-b6cc-b32701604235 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:08.888843 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cacde045-3c24-480f-b6cc-b32701604235 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.921481 Jul 26 14:03:08.892513 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 59/86] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:07 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:09.924874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ba0171b-26f6-43dd-85b1-7ec50d825a64 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:09.925651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5ba0171b-26f6-43dd-85b1-7ec50d825a64 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:09.939072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ba0171b-26f6-43dd-85b1-7ec50d825a64 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:09.939927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ba0171b-26f6-43dd-85b1-7ec50d825a64 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:09.941235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ba0171b-26f6-43dd-85b1-7ec50d825a64 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:09.941905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ba0171b-26f6-43dd-85b1-7ec50d825a64 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:09.999724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d6af4050-3b7b-4b7f-bd46-858ade4e6053 tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Calling method '.version_select at 0x7f8794e2ac10>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:10.000707 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:10.000707 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:10.007016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6af4050-3b7b-4b7f-bd46-858ade4e6053 tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:10.007570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6af4050-3b7b-4b7f-bd46-858ade4e6053 tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:10.065661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6af4050-3b7b-4b7f-bd46-858ade4e6053 tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:10.066352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6af4050-3b7b-4b7f-bd46-858ade4e6053 tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:10.136585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6af4050-3b7b-4b7f-bd46-858ade4e6053 tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:10.137061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6af4050-3b7b-4b7f-bd46-858ade4e6053 tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:10.167979 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d6af4050-3b7b-4b7f-bd46-858ade4e6053 tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.914955 Jul 26 14:03:10.167979 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 28/87] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:03:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:03:10.190772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1f56bd17-6937-4d51-86e7-9751cfe6f32f tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Calling method '.version_select at 0x7f8794db11f0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:10.190772 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:10.190772 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:10.190772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f56bd17-6937-4d51-86e7-9751cfe6f32f tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:10.190772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f56bd17-6937-4d51-86e7-9751cfe6f32f tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:10.243812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f56bd17-6937-4d51-86e7-9751cfe6f32f tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:10.244766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f56bd17-6937-4d51-86e7-9751cfe6f32f tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:10.265526 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1f56bd17-6937-4d51-86e7-9751cfe6f32f tempest-HypervisorAdminV228Test-242979794 tempest-HypervisorAdminV228Test-242979794-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.092981 Jul 26 14:03:10.280177 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 29/88] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 26 14:03:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:03:10.659635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5ba0171b-26f6-43dd-85b1-7ec50d825a64 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:10.672392 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ba0171b-26f6-43dd-85b1-7ec50d825a64 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.750845 Jul 26 14:03:10.674672 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 60/89] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:09 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:11.198084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a80e30db-1810-4cd4-b7d5-f906a7a76db0 req-f28410b3-428e-41f3-ba90-4e6390a288d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d040e902-a81c-4f87-9864-d3a258e79bcb", "tag": "d89b8621-043d-4883-9979-ffb052174bf9"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:11.242847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a80e30db-1810-4cd4-b7d5-f906a7a76db0 req-f28410b3-428e-41f3-ba90-4e6390a288d0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:11.244613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a80e30db-1810-4cd4-b7d5-f906a7a76db0 req-f28410b3-428e-41f3-ba90-4e6390a288d0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:11.335622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:11.339699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:11.346142 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a80e30db-1810-4cd4-b7d5-f906a7a76db0 req-f28410b3-428e-41f3-ba90-4e6390a288d0 service nova] Creating event network-changed:d89b8621-043d-4883-9979-ffb052174bf9 for instance d040e902-a81c-4f87-9864-d3a258e79bcb on n-h1-833090-9 Jul 26 14:03:11.350937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a80e30db-1810-4cd4-b7d5-f906a7a76db0 req-f28410b3-428e-41f3-ba90-4e6390a288d0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:03:11.354700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a73b7468-8dc1-4a64-ba7e-de7135ef7206 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:11.355974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a73b7468-8dc1-4a64-ba7e-de7135ef7206 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:11.358944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a73b7468-8dc1-4a64-ba7e-de7135ef7206 None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:11.365969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a73b7468-8dc1-4a64-ba7e-de7135ef7206 None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:11.386471 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.compute.rpcapi [None req-a73b7468-8dc1-4a64-ba7e-de7135ef7206 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 14:03:11.387716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a73b7468-8dc1-4a64-ba7e-de7135ef7206 None None] Releasing lock "compute-rpcapi-router" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:03:11.429845 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a73b7468-8dc1-4a64-ba7e-de7135ef7206 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.114042 Jul 26 14:03:11.430975 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 30/90] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:12.038055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-116643789", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:12.040424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d3794faf-a205-4bd5-a43d-72d340882ef7 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-919794591", "id": 1614541754, "os-flavor-access:is_public": "False"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:12.044520 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:12.044520 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:12.119165 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d3794faf-a205-4bd5-a43d-72d340882ef7 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.636429 Jul 26 14:03:12.123809 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 31/91] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:03:11 2022] POST /compute/v2.1/flavors => generated 430 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:12.214838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:03:12.343601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-893609263", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:12.458830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:03:12.654639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=10 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:13.345703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:03:13.346368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:03:13.346619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:03:13.347245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:03:13.347674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:03:13.375368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:13.375822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:13.392854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:13.393335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:13.451844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Getting quotas for project 4d886dd6f815451886f280083ad22868. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:03:13.470676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Getting quotas for user 20efe46c2a984870a7fcc18ba702be15 and project 4d886dd6f815451886f280083ad22868. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:03:13.517748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:03:13.518378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:03:13.518868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:03:13.519368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:03:13.519747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:03:13.520221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:03:13.526813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:03:13.545278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:13.545741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:13.549647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:13.550125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:13.598578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for project d2c43d5f86804cc181b575525a402873. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:03:13.621505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for user 753d20ca575a4270b73b1c686bf657dd and project d2c43d5f86804cc181b575525a402873. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:03:13.658611 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c83714d7-9c01-432e-800b-0074e08abbd4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.230071 Jul 26 14:03:13.660116 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 61/92] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:03:13.664764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:03:13.669185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:03:13.679480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bfa5c333-8725-415a-8495-53177ea234d3 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:13.685345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bfa5c333-8725-415a-8495-53177ea234d3 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:13.709257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bfa5c333-8725-415a-8495-53177ea234d3 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:13.710099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bfa5c333-8725-415a-8495-53177ea234d3 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:13.711110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bfa5c333-8725-415a-8495-53177ea234d3 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:13.713803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bfa5c333-8725-415a-8495-53177ea234d3 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:13.824934 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-afcade18-f025-4c4b-994a-a793d45b09ce tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.699855 Jul 26 14:03:13.829884 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 32/93] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:03:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:03:13.841190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb50d901-a13e-4185-b418-f97e98c83622 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "03e863dc87f84ba6a47846767e9782d6"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:13.843875 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:13.843875 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:14.054106 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bb50d901-a13e-4185-b418-f97e98c83622 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1614541754/action" status: 200 len: 97 microversion: 2.1 time: 0.223011 Jul 26 14:03:14.064105 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 33/94] 10.222.0.70 () {60 vars in 1200 bytes} [Tue Jul 26 14:03:13 2022] POST /compute/v2.1/flavors/1614541754/action => generated 97 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:03:14.078303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f43dd10f-a556-41a7-ada2-25a85efb842f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:14.084897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f43dd10f-a556-41a7-ada2-25a85efb842f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:14.395014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bfa5c333-8725-415a-8495-53177ea234d3 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:14.416663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f43dd10f-a556-41a7-ada2-25a85efb842f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:14.432438 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bfa5c333-8725-415a-8495-53177ea234d3 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.765612 Jul 26 14:03:14.436039 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 62/95] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:13 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:14.452031 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f43dd10f-a556-41a7-ada2-25a85efb842f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1218 microversion: 2.1 time: 0.380995 Jul 26 14:03:14.465874 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 34/96] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:14 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1218 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:14.466587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-de51363e-1bcc-4823-b2b4-01046d351ab2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:14.467384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-de51363e-1bcc-4823-b2b4-01046d351ab2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:14.611396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-de51363e-1bcc-4823-b2b4-01046d351ab2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:14.633669 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-de51363e-1bcc-4823-b2b4-01046d351ab2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1212 microversion: 2.1 time: 0.195996 Jul 26 14:03:14.634715 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 63/97] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:14 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1212 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:14.935695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c8db2e96-12b9-4ea0-b85a-72e2c4dd11f9 tempest-FlavorsAccessTestJSON-233353484 tempest-FlavorsAccessTestJSON-233353484-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:15.067696 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c8db2e96-12b9-4ea0-b85a-72e2c4dd11f9 tempest-FlavorsAccessTestJSON-233353484 tempest-FlavorsAccessTestJSON-233353484-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.596159 Jul 26 14:03:15.083402 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 35/98] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:14 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:15.091112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dfa2367e-3354-430c-abdb-171e93b9269a tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "03e863dc87f84ba6a47846767e9782d6"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:15.096485 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:15.096485 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:15.463303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-864ae767-528d-4cc7-8166-1aeceddfa718 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:15.463931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-864ae767-528d-4cc7-8166-1aeceddfa718 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:15.480961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-864ae767-528d-4cc7-8166-1aeceddfa718 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:15.481798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-864ae767-528d-4cc7-8166-1aeceddfa718 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:15.482929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-864ae767-528d-4cc7-8166-1aeceddfa718 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:15.483388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-864ae767-528d-4cc7-8166-1aeceddfa718 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:16.024519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=13,nova_api:INSERT=5 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:16.032033 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dfa2367e-3354-430c-abdb-171e93b9269a tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1614541754/action" status: 200 len: 21 microversion: 2.1 time: 0.946809 Jul 26 14:03:16.041800 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 64/99] 10.222.0.70 () {60 vars in 1200 bytes} [Tue Jul 26 14:03:15 2022] POST /compute/v2.1/flavors/1614541754/action => generated 21 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:03:16.051917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ec340201-fd31-43e9-9d3c-718d70ea84fb tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:16.053765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ec340201-fd31-43e9-9d3c-718d70ea84fb tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:16.065484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec340201-fd31-43e9-9d3c-718d70ea84fb tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:16.066771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec340201-fd31-43e9-9d3c-718d70ea84fb tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:16.068757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec340201-fd31-43e9-9d3c-718d70ea84fb tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:16.069757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec340201-fd31-43e9-9d3c-718d70ea84fb tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:16.172295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-864ae767-528d-4cc7-8166-1aeceddfa718 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:16.189533 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-864ae767-528d-4cc7-8166-1aeceddfa718 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.728734 Jul 26 14:03:16.192362 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 36/100] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:15 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:16.208012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d000aff6-400a-4cfe-96f8-88961d2a99b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:16.211181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d000aff6-400a-4cfe-96f8-88961d2a99b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:16.239025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d000aff6-400a-4cfe-96f8-88961d2a99b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:16.242478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d000aff6-400a-4cfe-96f8-88961d2a99b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:16.244488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d000aff6-400a-4cfe-96f8-88961d2a99b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:16.245109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d000aff6-400a-4cfe-96f8-88961d2a99b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:16.288677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ec340201-fd31-43e9-9d3c-718d70ea84fb tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:16.341889 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ec340201-fd31-43e9-9d3c-718d70ea84fb tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1222 microversion: 2.1 time: 0.290499 Jul 26 14:03:16.347681 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 65/101] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:16 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:16.388640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23bf045e-0add-429d-978f-35aab5bd7d0b tempest-FlavorsAccessTestJSON-233353484 tempest-FlavorsAccessTestJSON-233353484-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:16.483920 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23bf045e-0add-429d-978f-35aab5bd7d0b tempest-FlavorsAccessTestJSON-233353484 tempest-FlavorsAccessTestJSON-233353484-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.134932 Jul 26 14:03:16.490497 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 66/102] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:16.513206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7752ca49-43ac-47b9-b820-eb3a584fc315 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:16.515329 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:16.515329 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:16.570518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d000aff6-400a-4cfe-96f8-88961d2a99b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:16.572067 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7752ca49-43ac-47b9-b820-eb3a584fc315 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1614541754" status: 202 len: 0 microversion: 2.1 time: 0.061062 Jul 26 14:03:16.576491 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 67/103] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:03:16 2022] DELETE /compute/v2.1/flavors/1614541754 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:03:16.586439 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d000aff6-400a-4cfe-96f8-88961d2a99b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1272 microversion: 2.1 time: 0.390636 Jul 26 14:03:16.588631 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 37/104] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:16 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1272 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:16.590808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4692dc74-3d3a-41e9-a0e9-a13085dec994 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:16.671145 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4692dc74-3d3a-41e9-a0e9-a13085dec994 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082197 Jul 26 14:03:16.671833 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 68/105] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:16.703895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a595c0c9-ec19-4af1-bf95-7bf3a59e93d0 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1087477065", "id": 593544528, "os-flavor-access:is_public": "False"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:16.707629 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:16.707629 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:16.757038 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a595c0c9-ec19-4af1-bf95-7bf3a59e93d0 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.054864 Jul 26 14:03:16.759160 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 38/106] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:03:16 2022] POST /compute/v2.1/flavors => generated 428 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:16.775049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0b71ffe9-7f9f-496d-a7b1-164e637e502e tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:16.776313 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:16.776313 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:16.798210 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0b71ffe9-7f9f-496d-a7b1-164e637e502e tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/593544528/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.028050 Jul 26 14:03:16.815162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-676586ad-7e93-469e-9814-ad54879ca699 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:16.817248 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:16.817248 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:16.820654 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 69/107] 10.222.0.70 () {58 vars in 1206 bytes} [Tue Jul 26 14:03:16 2022] GET /compute/v2.1/flavors/593544528/os-flavor-access => generated 21 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:03:16.855667 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-676586ad-7e93-469e-9814-ad54879ca699 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/593544528" status: 202 len: 0 microversion: 2.1 time: 0.047223 Jul 26 14:03:16.870869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2bb25165-e05f-4863-b27c-11bcd8561575 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:16.875177 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 39/108] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:03:16 2022] DELETE /compute/v2.1/flavors/593544528 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:03:16.904080 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2bb25165-e05f-4863-b27c-11bcd8561575 tempest-FlavorsAccessTestJSON-80624510 tempest-FlavorsAccessTestJSON-80624510-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037032 Jul 26 14:03:16.928384 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 70/109] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:17.212555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e82afab-d880-471b-a8c5-5116c9ea4589 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:17.213195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e82afab-d880-471b-a8c5-5116c9ea4589 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:17.242426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e82afab-d880-471b-a8c5-5116c9ea4589 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:17.244988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e82afab-d880-471b-a8c5-5116c9ea4589 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:17.251046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e82afab-d880-471b-a8c5-5116c9ea4589 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:17.254335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e82afab-d880-471b-a8c5-5116c9ea4589 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:17.380576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-37287fca-789f-4d36-a7cd-f94fc3fa6b14 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:17.381349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-37287fca-789f-4d36-a7cd-f94fc3fa6b14 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:17.422867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37287fca-789f-4d36-a7cd-f94fc3fa6b14 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:17.425347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37287fca-789f-4d36-a7cd-f94fc3fa6b14 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:17.431129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37287fca-789f-4d36-a7cd-f94fc3fa6b14 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:17.433770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37287fca-789f-4d36-a7cd-f94fc3fa6b14 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:18.109511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-37287fca-789f-4d36-a7cd-f94fc3fa6b14 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:18.123871 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-37287fca-789f-4d36-a7cd-f94fc3fa6b14 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1278 microversion: 2.1 time: 0.747882 Jul 26 14:03:18.124723 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 71/110] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:17 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1278 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:18.133930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-45a04db2-86ff-4e62-b409-1010071800e6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:18.137652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-45a04db2-86ff-4e62-b409-1010071800e6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:18.158880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-45a04db2-86ff-4e62-b409-1010071800e6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:18.159730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-45a04db2-86ff-4e62-b409-1010071800e6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:18.161012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-45a04db2-86ff-4e62-b409-1010071800e6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:18.161769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-45a04db2-86ff-4e62-b409-1010071800e6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:18.366038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-45a04db2-86ff-4e62-b409-1010071800e6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:18.416696 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-45a04db2-86ff-4e62-b409-1010071800e6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1270 microversion: 2.1 time: 0.251558 Jul 26 14:03:18.423634 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 72/111] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:18 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1270 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:18.543504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2e82afab-d880-471b-a8c5-5116c9ea4589 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:18.562453 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e82afab-d880-471b-a8c5-5116c9ea4589 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 1.353508 Jul 26 14:03:18.576011 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 40/112] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:17 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:19.153552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-713aa85e-6c72-4404-a976-93c8d9b4f33e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:19.154743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-713aa85e-6c72-4404-a976-93c8d9b4f33e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:19.170822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-713aa85e-6c72-4404-a976-93c8d9b4f33e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:19.174149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-713aa85e-6c72-4404-a976-93c8d9b4f33e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:19.177901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-713aa85e-6c72-4404-a976-93c8d9b4f33e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:19.178791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-713aa85e-6c72-4404-a976-93c8d9b4f33e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:19.457108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6ecb37df-dcd5-4277-b31a-57a290e47681 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:19.458022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6ecb37df-dcd5-4277-b31a-57a290e47681 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:19.471536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ecb37df-dcd5-4277-b31a-57a290e47681 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:19.475448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ecb37df-dcd5-4277-b31a-57a290e47681 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:19.476558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ecb37df-dcd5-4277-b31a-57a290e47681 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:19.481118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ecb37df-dcd5-4277-b31a-57a290e47681 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:19.532053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-713aa85e-6c72-4404-a976-93c8d9b4f33e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:19.569004 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-713aa85e-6c72-4404-a976-93c8d9b4f33e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1276 microversion: 2.1 time: 0.422612 Jul 26 14:03:19.588464 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 73/113] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:19 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1276 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:19.604693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-20dd0d58-383d-4977-9ed5-9408746538f6 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:19.609515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-20dd0d58-383d-4977-9ed5-9408746538f6 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:19.636358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20dd0d58-383d-4977-9ed5-9408746538f6 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:19.636849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20dd0d58-383d-4977-9ed5-9408746538f6 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:19.637680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20dd0d58-383d-4977-9ed5-9408746538f6 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:19.642906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20dd0d58-383d-4977-9ed5-9408746538f6 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:20.006251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6ecb37df-dcd5-4277-b31a-57a290e47681 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:20.030861 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6ecb37df-dcd5-4277-b31a-57a290e47681 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1270 microversion: 2.1 time: 0.575163 Jul 26 14:03:20.031623 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 41/114] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:19 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1270 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:20.604306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-20dd0d58-383d-4977-9ed5-9408746538f6 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:20.611353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-45f767f7-7276-4647-ac64-9b7ab82f9070 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:20.612374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-45f767f7-7276-4647-ac64-9b7ab82f9070 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:20.614009 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-20dd0d58-383d-4977-9ed5-9408746538f6 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 1.024174 Jul 26 14:03:20.616232 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 74/115] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:19 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:20.627133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45f767f7-7276-4647-ac64-9b7ab82f9070 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:20.632871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45f767f7-7276-4647-ac64-9b7ab82f9070 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:20.635056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45f767f7-7276-4647-ac64-9b7ab82f9070 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:20.638441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45f767f7-7276-4647-ac64-9b7ab82f9070 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:21.056748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-997ebf1b-3b90-4e1c-849b-6dde62a93e25 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:21.057463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-997ebf1b-3b90-4e1c-849b-6dde62a93e25 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:21.082242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-997ebf1b-3b90-4e1c-849b-6dde62a93e25 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:21.087274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-997ebf1b-3b90-4e1c-849b-6dde62a93e25 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:21.088454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-997ebf1b-3b90-4e1c-849b-6dde62a93e25 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:21.089047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-997ebf1b-3b90-4e1c-849b-6dde62a93e25 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:21.416025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-45f767f7-7276-4647-ac64-9b7ab82f9070 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:21.453854 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-45f767f7-7276-4647-ac64-9b7ab82f9070 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 0.849018 Jul 26 14:03:21.460750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-997ebf1b-3b90-4e1c-849b-6dde62a93e25 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:21.471989 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 42/116] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:20 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:21.497685 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-997ebf1b-3b90-4e1c-849b-6dde62a93e25 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1270 microversion: 2.1 time: 0.445454 Jul 26 14:03:21.518336 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 75/117] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:21 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1270 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:21.645427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6420e266-4920-47b9-b993-78ccf097f63b tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:21.648176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6420e266-4920-47b9-b993-78ccf097f63b tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:21.665428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6420e266-4920-47b9-b993-78ccf097f63b tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:21.666344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6420e266-4920-47b9-b993-78ccf097f63b tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:21.669085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6420e266-4920-47b9-b993-78ccf097f63b tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:21.671478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6420e266-4920-47b9-b993-78ccf097f63b tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:22.134162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6420e266-4920-47b9-b993-78ccf097f63b tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:22.150281 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6420e266-4920-47b9-b993-78ccf097f63b tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.512195 Jul 26 14:03:22.150868 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 76/118] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:21 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:22.489247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-30eae712-9843-4f8c-891a-272727ff66a2 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:22.490729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-30eae712-9843-4f8c-891a-272727ff66a2 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:22.504860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30eae712-9843-4f8c-891a-272727ff66a2 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:22.508752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30eae712-9843-4f8c-891a-272727ff66a2 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:22.523975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30eae712-9843-4f8c-891a-272727ff66a2 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:22.524776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30eae712-9843-4f8c-891a-272727ff66a2 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:22.596975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1227b267-2f34-4e25-8ee4-5f6587efb06d tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Calling method '.version_select at 0x7f8794d93040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:22.598512 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:22.598512 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:22.601796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1227b267-2f34-4e25-8ee4-5f6587efb06d tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '6e4aa29757b749a3868906d94b0e5bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c70abfd694c4e2e9ecb472ab254d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1227b267-2f34-4e25-8ee4-5f6587efb06d tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Request method failure captured: Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_Qmj3svK1-rBZ7FXEkb6AQmtlcGLO0zEk-34nLaX818MQSjWEzxvNFVunHfmK2V7s5sdjvFEKp7t4xhb8SuHliXdoPMklezWv-Z-zCwmbge_fepvtDhNpqtefB79UnpeWBsPDLed-BwBAtrSsGvJOXCR5nPsa32loX-beYfvkfOhaU Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3c70abfd694c4e2e9ecb472ab254d083 Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:03:22.604967 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c70abfd694c4e2e9ecb472ab254d083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3c70abfd694c4e2e9ecb472ab254d083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3c70abfd694c4e2e9ecb472ab254d083", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c70abfd694c4e2e9ecb472ab254d083"}]}] Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3c70abfd694c4e2e9ecb472ab254d083 Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-HypervisorAdminNegativeTestJSON-678637196-project Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6e4aa29757b749a3868906d94b0e5bcb Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-678637196-project Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: action_args: {} Jul 26 14:03:22.606200 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:22.606927 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 26 14:03:22.608030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:22.612576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1227b267-2f34-4e25-8ee4-5f6587efb06d tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:22.613990 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1227b267-2f34-4e25-8ee4-5f6587efb06d tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 1.148184 Jul 26 14:03:22.617572 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 43/119] 10.222.0.70 () {58 vars in 1167 bytes} [Tue Jul 26 14:03:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 1154 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:22.625655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2aacae3e-8bdd-453a-8cee-d7908b687cda tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:22.626281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2aacae3e-8bdd-453a-8cee-d7908b687cda tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:22.656847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2aacae3e-8bdd-453a-8cee-d7908b687cda tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:22.657650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2aacae3e-8bdd-453a-8cee-d7908b687cda tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:22.658877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2aacae3e-8bdd-453a-8cee-d7908b687cda tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:22.665027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2aacae3e-8bdd-453a-8cee-d7908b687cda tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:23.424730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:23.578077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:23.725739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2aacae3e-8bdd-453a-8cee-d7908b687cda tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:23.749244 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2aacae3e-8bdd-453a-8cee-d7908b687cda tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 1.125884 Jul 26 14:03:23.751965 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 44/120] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:22 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:23.794679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a4c44e3f-2921-4a79-9f12-0408f627e78f tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Calling method '.version_select at 0x7f8794d939d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:23.795399 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:23.795399 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:23.805228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a4c44e3f-2921-4a79-9f12-0408f627e78f tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '6e4aa29757b749a3868906d94b0e5bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c70abfd694c4e2e9ecb472ab254d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a4c44e3f-2921-4a79-9f12-0408f627e78f tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Request method failure captured: Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_Qmj3svK1-rBZ7FXEkb6AQmtlcGLO0zEk-34nLaX818MQSjWEzxvNFVunHfmK2V7s5sdjvFEKp7t4xhb8SuHliXdoPMklezWv-Z-zCwmbge_fepvtDhNpqtefB79UnpeWBsPDLed-BwBAtrSsGvJOXCR5nPsa32loX-beYfvkfOhaU Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3c70abfd694c4e2e9ecb472ab254d083 Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:03:23.807911 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c70abfd694c4e2e9ecb472ab254d083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3c70abfd694c4e2e9ecb472ab254d083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3c70abfd694c4e2e9ecb472ab254d083", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c70abfd694c4e2e9ecb472ab254d083"}]}] Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3c70abfd694c4e2e9ecb472ab254d083 Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-HypervisorAdminNegativeTestJSON-678637196-project Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6e4aa29757b749a3868906d94b0e5bcb Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-678637196-project Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: action_args: {} Jul 26 14:03:23.809338 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:23.810043 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 26 14:03:23.811054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:23.817050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a4c44e3f-2921-4a79-9f12-0408f627e78f tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:23.824743 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a4c44e3f-2921-4a79-9f12-0408f627e78f tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.065727 Jul 26 14:03:23.830535 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 45/121] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:23 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 77 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:23.851369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a0d7277b-0549-4aac-a1d7-724edbe0c958 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:23.854404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a0d7277b-0549-4aac-a1d7-724edbe0c958 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:23.874486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a0d7277b-0549-4aac-a1d7-724edbe0c958 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:23.877712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a0d7277b-0549-4aac-a1d7-724edbe0c958 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:23.891350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a0d7277b-0549-4aac-a1d7-724edbe0c958 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:23.894215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a0d7277b-0549-4aac-a1d7-724edbe0c958 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:24.002275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-30eae712-9843-4f8c-891a-272727ff66a2 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:24.026242 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-30eae712-9843-4f8c-891a-272727ff66a2 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 1.530499 Jul 26 14:03:24.030563 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 77/122] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:22 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:24.051257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a27d3abc-6e8a-40d7-8207-fc103ee388f7 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Calling method '.version_select at 0x7f8794df9d30>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:24.056459 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:24.056459 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:24.062057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a27d3abc-6e8a-40d7-8207-fc103ee388f7 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '6e4aa29757b749a3868906d94b0e5bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c70abfd694c4e2e9ecb472ab254d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a27d3abc-6e8a-40d7-8207-fc103ee388f7 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Request method failure captured: Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Qmj3svK1-rBZ7FXEkb6AQmtlcGLO0zEk-34nLaX818MQSjWEzxvNFVunHfmK2V7s5sdjvFEKp7t4xhb8SuHliXdoPMklezWv-Z-zCwmbge_fepvtDhNpqtefB79UnpeWBsPDLed-BwBAtrSsGvJOXCR5nPsa32loX-beYfvkfOhaU Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 3c70abfd694c4e2e9ecb472ab254d083 Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:03:24.070719 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c70abfd694c4e2e9ecb472ab254d083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3c70abfd694c4e2e9ecb472ab254d083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3c70abfd694c4e2e9ecb472ab254d083", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c70abfd694c4e2e9ecb472ab254d083"}]}] Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 3c70abfd694c4e2e9ecb472ab254d083 Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HypervisorAdminNegativeTestJSON-678637196-project Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6e4aa29757b749a3868906d94b0e5bcb Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-678637196-project Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: action_args: {} Jul 26 14:03:24.072951 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:24.073711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 26 14:03:24.074949 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:24.077552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a27d3abc-6e8a-40d7-8207-fc103ee388f7 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:24.080094 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a27d3abc-6e8a-40d7-8207-fc103ee388f7 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.048013 Jul 26 14:03:24.082708 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 78/123] 10.222.0.70 () {58 vars in 1179 bytes} [Tue Jul 26 14:03:24 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:24.379849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a0d7277b-0549-4aac-a1d7-724edbe0c958 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:24.392324 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a0d7277b-0549-4aac-a1d7-724edbe0c958 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.560687 Jul 26 14:03:24.399746 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 46/124] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:23 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:24.632749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:24.777407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:24.784583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1d8e18a1-9e07-48e1-9edf-3039c905a28d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:24.785852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1d8e18a1-9e07-48e1-9edf-3039c905a28d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:24.820527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d8e18a1-9e07-48e1-9edf-3039c905a28d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:24.828222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d8e18a1-9e07-48e1-9edf-3039c905a28d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:24.836135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d8e18a1-9e07-48e1-9edf-3039c905a28d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:24.838419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d8e18a1-9e07-48e1-9edf-3039c905a28d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:24.978726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-46f0bac6-ac6c-40a7-a44d-1262c5eca3a0 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Calling method '.version_select at 0x7f8794df9ca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:24.980255 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:24.980255 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:25.017230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-46f0bac6-ac6c-40a7-a44d-1262c5eca3a0 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) {{(pid=119479) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 26 14:03:25.020925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46f0bac6-ac6c-40a7-a44d-1262c5eca3a0 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:25.023335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46f0bac6-ac6c-40a7-a44d-1262c5eca3a0 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:25.037795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=79 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:25.105146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46f0bac6-ac6c-40a7-a44d-1262c5eca3a0 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:25.110782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46f0bac6-ac6c-40a7-a44d-1262c5eca3a0 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:25.180187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46f0bac6-ac6c-40a7-a44d-1262c5eca3a0 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:25.180891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46f0bac6-ac6c-40a7-a44d-1262c5eca3a0 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:25.196529 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-46f0bac6-ac6c-40a7-a44d-1262c5eca3a0 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.104010 Jul 26 14:03:25.204379 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 79/125] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:25.214249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d00b3357-ac28-41f2-b542-e2f6faf3e1e1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:25.225711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d00b3357-ac28-41f2-b542-e2f6faf3e1e1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:25.247909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d00b3357-ac28-41f2-b542-e2f6faf3e1e1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:25.248741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d00b3357-ac28-41f2-b542-e2f6faf3e1e1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:25.252601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d00b3357-ac28-41f2-b542-e2f6faf3e1e1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:25.253338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d00b3357-ac28-41f2-b542-e2f6faf3e1e1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:25.357470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d8e18a1-9e07-48e1-9edf-3039c905a28d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:25.369146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:25.377133 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1d8e18a1-9e07-48e1-9edf-3039c905a28d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 0.600310 Jul 26 14:03:25.378668 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 47/126] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:24 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:25.385914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3328a12d-2c08-49a0-87d2-482ac575d923 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Calling method '.version_select at 0x7f8794d42ee0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:25.387145 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:25.387145 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:25.388862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3328a12d-2c08-49a0-87d2-482ac575d923 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '6e4aa29757b749a3868906d94b0e5bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c70abfd694c4e2e9ecb472ab254d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3328a12d-2c08-49a0-87d2-482ac575d923 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Request method failure captured: Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_Qmj3svK1-rBZ7FXEkb6AQmtlcGLO0zEk-34nLaX818MQSjWEzxvNFVunHfmK2V7s5sdjvFEKp7t4xhb8SuHliXdoPMklezWv-Z-zCwmbge_fepvtDhNpqtefB79UnpeWBsPDLed-BwBAtrSsGvJOXCR5nPsa32loX-beYfvkfOhaU Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3c70abfd694c4e2e9ecb472ab254d083 Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:03:25.394485 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c70abfd694c4e2e9ecb472ab254d083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3c70abfd694c4e2e9ecb472ab254d083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3c70abfd694c4e2e9ecb472ab254d083", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c70abfd694c4e2e9ecb472ab254d083"}]}] Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3c70abfd694c4e2e9ecb472ab254d083 Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-HypervisorAdminNegativeTestJSON-678637196-project Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6e4aa29757b749a3868906d94b0e5bcb Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-678637196-project Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '1'} Jul 26 14:03:25.398041 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:25.399470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 26 14:03:25.400751 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.402390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3328a12d-2c08-49a0-87d2-482ac575d923 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:25.405006 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3328a12d-2c08-49a0-87d2-482ac575d923 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.024871 Jul 26 14:03:25.413879 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 48/127] 10.222.0.70 () {58 vars in 1173 bytes} [Tue Jul 26 14:03:25 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:25.713035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-40c77336-3867-4157-ae1d-18c241edcda2 req-0d780124-2f8a-4d4f-9f05-9f2c1f1aa449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd85b7d5-71df-48ab-b23a-adf63fcadd94", "tag": "abde11f3-2227-40c0-b73b-c1ddf26f7086"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:25.732092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-40c77336-3867-4157-ae1d-18c241edcda2 req-0d780124-2f8a-4d4f-9f05-9f2c1f1aa449 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:25.740502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-40c77336-3867-4157-ae1d-18c241edcda2 req-0d780124-2f8a-4d4f-9f05-9f2c1f1aa449 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:25.760176 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-40c77336-3867-4157-ae1d-18c241edcda2 req-0d780124-2f8a-4d4f-9f05-9f2c1f1aa449 service nova] Creating event network-changed:abde11f3-2227-40c0-b73b-c1ddf26f7086 for instance cd85b7d5-71df-48ab-b23a-adf63fcadd94 on n-h2-833090-9 Jul 26 14:03:25.766994 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-40c77336-3867-4157-ae1d-18c241edcda2 req-0d780124-2f8a-4d4f-9f05-9f2c1f1aa449 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350716 Jul 26 14:03:25.768830 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 49/128] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:25.776849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7b6642d-65cc-4b08-95aa-37ad6019c206 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Calling method '.version_select at 0x7f8794dc1310>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:25.777964 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:25.777964 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:25.779062 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-f7b6642d-65cc-4b08-95aa-37ad6019c206 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] HTTP exception thrown: Hypervisor with ID 'eb9b3ff6-0743-42f8-b627-8163da025079' could not be found. Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7b6642d-65cc-4b08-95aa-37ad6019c206 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Request method failure captured: Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-hypervisors/eb9b3ff6-0743-42f8-b627-8163da025079/uptime HTTP/1.1 Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QphSu4vLwM1mFc0FgOuY1LlUNESr2XpN4LLu3J1I0UxMagBn0H9U4KBYZpEpzQCgzVXoNF0b1VG9SfdSwdM3KkU9hcUjV0UB-bFdbRllhDGIEnOfs4tZ-ithk4SmCaTl-LltDct_vygZ3spDjfTWwY0qdsRJ4yGQWdMixZdk0uqX8 Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4ec6624f993d4dc5a117c54dea611d12 Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-801166897 Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:03:25.795102 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec6624f993d4dc5a117c54dea611d12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ec6624f993d4dc5a117c54dea611d12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ec6624f993d4dc5a117c54dea611d12", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec6624f993d4dc5a117c54dea611d12"}]}] Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-801166897 Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4ec6624f993d4dc5a117c54dea611d12 Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-801166897 Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ae4ce7a9d1664c9583ba906a53ad9f26 Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: exception: Hypervisor with ID 'eb9b3ff6-0743-42f8-b627-8163da025079' could not be found. Jul 26 14:03:25.797068 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'eb9b3ff6-0743-42f8-b627-8163da025079'} Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'eb9b3ff6-0743-42f8-b627-8163da025079' Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 26 14:03:25.797772 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'eb9b3ff6-0743-42f8-b627-8163da025079' could not be found. Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:25.798940 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.800216 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:25.800216 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:25.800216 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:25.800216 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:25.800216 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:25.800216 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'eb9b3ff6-0743-42f8-b627-8163da025079' could not be found. Jul 26 14:03:25.800216 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:25.803768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7b6642d-65cc-4b08-95aa-37ad6019c206 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Returning 404 to user: Hypervisor with ID 'eb9b3ff6-0743-42f8-b627-8163da025079' could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:25.805640 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7b6642d-65cc-4b08-95aa-37ad6019c206 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/eb9b3ff6-0743-42f8-b627-8163da025079/uptime" status: 404 len: 123 microversion: 2.1 time: 0.035228 Jul 26 14:03:25.806742 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 50/129] 10.222.0.70 () {58 vars in 1278 bytes} [Tue Jul 26 14:03:25 2022] GET /compute/v2.1/os-hypervisors/eb9b3ff6-0743-42f8-b627-8163da025079/uptime => generated 123 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:25.825205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8bb73e1f-35c9-44ab-8077-d98d0b1bb2f9 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:25.826340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8bb73e1f-35c9-44ab-8077-d98d0b1bb2f9 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:25.838836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bb73e1f-35c9-44ab-8077-d98d0b1bb2f9 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:25.844461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bb73e1f-35c9-44ab-8077-d98d0b1bb2f9 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:25.845700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bb73e1f-35c9-44ab-8077-d98d0b1bb2f9 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:25.846339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bb73e1f-35c9-44ab-8077-d98d0b1bb2f9 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:25.846552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d00b3357-ac28-41f2-b542-e2f6faf3e1e1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:25.905456 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d00b3357-ac28-41f2-b542-e2f6faf3e1e1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 0.697837 Jul 26 14:03:25.910088 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 80/130] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:25 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:25.930439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db811d34-7e39-4ec2-a93a-ec94679a5f11 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Calling method '.version_select at 0x7f8794dbee50>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:25.938633 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:25.938633 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:25.947315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db811d34-7e39-4ec2-a93a-ec94679a5f11 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:25.949898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db811d34-7e39-4ec2-a93a-ec94679a5f11 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:26.029278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db811d34-7e39-4ec2-a93a-ec94679a5f11 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:26.029757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db811d34-7e39-4ec2-a93a-ec94679a5f11 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:26.096270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db811d34-7e39-4ec2-a93a-ec94679a5f11 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:26.097053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db811d34-7e39-4ec2-a93a-ec94679a5f11 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:26.141741 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db811d34-7e39-4ec2-a93a-ec94679a5f11 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.225745 Jul 26 14:03:26.146757 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 81/131] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:26.169570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74202e39-739f-4982-ab5e-944770674426 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Calling method '.version_select at 0x7f8794dbe160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:26.171529 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:26.171529 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:26.174099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-74202e39-739f-4982-ab5e-944770674426 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '6e4aa29757b749a3868906d94b0e5bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c70abfd694c4e2e9ecb472ab254d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74202e39-739f-4982-ab5e-944770674426 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Request method failure captured: Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Qmj3svK1-rBZ7FXEkb6AQmtlcGLO0zEk-34nLaX818MQSjWEzxvNFVunHfmK2V7s5sdjvFEKp7t4xhb8SuHliXdoPMklezWv-Z-zCwmbge_fepvtDhNpqtefB79UnpeWBsPDLed-BwBAtrSsGvJOXCR5nPsa32loX-beYfvkfOhaU Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 3c70abfd694c4e2e9ecb472ab254d083 Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:03:26.183656 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c70abfd694c4e2e9ecb472ab254d083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3c70abfd694c4e2e9ecb472ab254d083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3c70abfd694c4e2e9ecb472ab254d083", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c70abfd694c4e2e9ecb472ab254d083"}]}] Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 3c70abfd694c4e2e9ecb472ab254d083 Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-678637196 Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HypervisorAdminNegativeTestJSON-678637196-project Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6e4aa29757b749a3868906d94b0e5bcb Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-678637196-project Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '1'} Jul 26 14:03:26.186454 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:26.188022 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 26 14:03:26.190228 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.199458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74202e39-739f-4982-ab5e-944770674426 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:26.201772 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-74202e39-739f-4982-ab5e-944770674426 tempest-HypervisorAdminNegativeTestJSON-678637196 tempest-HypervisorAdminNegativeTestJSON-678637196-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.048140 Jul 26 14:03:26.206952 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 82/132] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:26 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:26.227769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9b9f542-4277-4435-9de1-6d3003413da8 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Calling method '.version_select at 0x7f8794dab040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:26.237463 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-b9b9f542-4277-4435-9de1-6d3003413da8 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] HTTP exception thrown: Hypervisor with ID 'e0591df1-4edb-49af-ace4-f6a5bbaf9578' could not be found. Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9b9f542-4277-4435-9de1-6d3003413da8 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Request method failure captured: Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hypervisors/e0591df1-4edb-49af-ace4-f6a5bbaf9578 HTTP/1.1 Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QphSu4vLwM1mFc0FgOuY1LlUNESr2XpN4LLu3J1I0UxMagBn0H9U4KBYZpEpzQCgzVXoNF0b1VG9SfdSwdM3KkU9hcUjV0UB-bFdbRllhDGIEnOfs4tZ-ithk4SmCaTl-LltDct_vygZ3spDjfTWwY0qdsRJ4yGQWdMixZdk0uqX8 Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4ec6624f993d4dc5a117c54dea611d12 Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-801166897 Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:03:26.248748 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec6624f993d4dc5a117c54dea611d12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ec6624f993d4dc5a117c54dea611d12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ec6624f993d4dc5a117c54dea611d12", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec6624f993d4dc5a117c54dea611d12"}]}] Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-801166897 Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4ec6624f993d4dc5a117c54dea611d12 Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-801166897 Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ae4ce7a9d1664c9583ba906a53ad9f26 Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: exception: Hypervisor with ID 'e0591df1-4edb-49af-ace4-f6a5bbaf9578' could not be found. Jul 26 14:03:26.251327 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e0591df1-4edb-49af-ace4-f6a5bbaf9578'} Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e0591df1-4edb-49af-ace4-f6a5bbaf9578' Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 26 14:03:26.252755 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:03:26.255324 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e0591df1-4edb-49af-ace4-f6a5bbaf9578' could not be found. Jul 26 14:03:26.258204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.258204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:26.258204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.258204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:26.258204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:26.258204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:26.258204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:26.258204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:26.258204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e0591df1-4edb-49af-ace4-f6a5bbaf9578' could not be found. Jul 26 14:03:26.258204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:26.260810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9b9f542-4277-4435-9de1-6d3003413da8 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] Returning 404 to user: Hypervisor with ID 'e0591df1-4edb-49af-ace4-f6a5bbaf9578' could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:26.266702 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b9b9f542-4277-4435-9de1-6d3003413da8 tempest-HypervisorAdminNegativeTestJSON-801166897 tempest-HypervisorAdminNegativeTestJSON-801166897-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/e0591df1-4edb-49af-ace4-f6a5bbaf9578" status: 404 len: 123 microversion: 2.1 time: 0.046318 Jul 26 14:03:26.268880 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 83/133] 10.222.0.70 () {58 vars in 1257 bytes} [Tue Jul 26 14:03:26 2022] GET /compute/v2.1/os-hypervisors/e0591df1-4edb-49af-ace4-f6a5bbaf9578 => generated 123 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:03:26.365215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8bb73e1f-35c9-44ab-8077-d98d0b1bb2f9 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:26.394166 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8bb73e1f-35c9-44ab-8077-d98d0b1bb2f9 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.584540 Jul 26 14:03:26.395760 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 51/134] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:25 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:26.435377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3a6fe2e1-0ebc-47c7-990a-1c70ea9b6ad6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:26.440739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3a6fe2e1-0ebc-47c7-990a-1c70ea9b6ad6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:26.465716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a6fe2e1-0ebc-47c7-990a-1c70ea9b6ad6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:26.468259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a6fe2e1-0ebc-47c7-990a-1c70ea9b6ad6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:26.473002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a6fe2e1-0ebc-47c7-990a-1c70ea9b6ad6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:26.480615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a6fe2e1-0ebc-47c7-990a-1c70ea9b6ad6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:26.733210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee18328f-3f4c-4e01-b6e7-990695afa8f9 tempest-FlavorMetadataValidation-1645986360 tempest-FlavorMetadataValidation-1645986360-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-995345768", "id": 1417663267, "os-flavor-access:is_public": "True"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:26.739198 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:26.739198 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:26.795457 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ee18328f-3f4c-4e01-b6e7-990695afa8f9 tempest-FlavorMetadataValidation-1645986360 tempest-FlavorMetadataValidation-1645986360-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.301225 Jul 26 14:03:26.797674 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 52/135] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:03:26 2022] POST /compute/v2.1/flavors => generated 470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:03:26.827875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6255a8d1-4d67-4ee0-a8ba-230d6c0a165f tempest-FlavorMetadataValidation-1645986360 tempest-FlavorMetadataValidation-1645986360-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:26.839434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3a6fe2e1-0ebc-47c7-990a-1c70ea9b6ad6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:26.850779 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:26.850779 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:26.852982 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3a6fe2e1-0ebc-47c7-990a-1c70ea9b6ad6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 0.443027 Jul 26 14:03:26.854517 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 84/136] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:26 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:26.947237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e17ffc77-69be-4e9d-a3fc-bbe978995499 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:26.948105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e17ffc77-69be-4e9d-a3fc-bbe978995499 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:26.960428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e17ffc77-69be-4e9d-a3fc-bbe978995499 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:26.963023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e17ffc77-69be-4e9d-a3fc-bbe978995499 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:26.966223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e17ffc77-69be-4e9d-a3fc-bbe978995499 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:26.966995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e17ffc77-69be-4e9d-a3fc-bbe978995499 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:27.249567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=11,nova_api:DELETE=3,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:27.281263 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6255a8d1-4d67-4ee0-a8ba-230d6c0a165f tempest-FlavorMetadataValidation-1645986360 tempest-FlavorMetadataValidation-1645986360-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1417663267/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.466475 Jul 26 14:03:27.296947 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 53/137] 10.222.0.70 () {62 vars in 1265 bytes} [Tue Jul 26 14:03:26 2022] POST /compute/v2.1/flavors/1417663267/os-extra_specs => generated 62 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:27.321078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7b02c0a9-8000-4dcd-bc81-237de833f351 tempest-FlavorMetadataValidation-1645986360 tempest-FlavorMetadataValidation-1645986360-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:27.324624 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:27.324624 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:27.357182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e17ffc77-69be-4e9d-a3fc-bbe978995499 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:27.370783 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e17ffc77-69be-4e9d-a3fc-bbe978995499 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 0.428838 Jul 26 14:03:27.372130 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 85/138] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:26 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:27.419453 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7b02c0a9-8000-4dcd-bc81-237de833f351 tempest-FlavorMetadataValidation-1645986360 tempest-FlavorMetadataValidation-1645986360-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1417663267" status: 202 len: 0 microversion: 2.86 time: 0.118531 Jul 26 14:03:27.426874 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 54/139] 10.222.0.70 () {60 vars in 1202 bytes} [Tue Jul 26 14:03:27 2022] DELETE /compute/v2.1/flavors/1417663267 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:03:27.433668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a2dcfb47-e596-429e-80ae-5d12272e53ad tempest-FlavorMetadataValidation-1645986360 tempest-FlavorMetadataValidation-1645986360-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:27.447703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b787ac4d-238b-4dc2-8f9c-161ad9a512b8 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:27.452824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b787ac4d-238b-4dc2-8f9c-161ad9a512b8 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:27.467456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b787ac4d-238b-4dc2-8f9c-161ad9a512b8 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:27.472113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b787ac4d-238b-4dc2-8f9c-161ad9a512b8 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:27.473150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b787ac4d-238b-4dc2-8f9c-161ad9a512b8 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:27.473686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b787ac4d-238b-4dc2-8f9c-161ad9a512b8 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:27.481912 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a2dcfb47-e596-429e-80ae-5d12272e53ad tempest-FlavorMetadataValidation-1645986360 tempest-FlavorMetadataValidation-1645986360-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.052222 Jul 26 14:03:27.487636 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 86/140] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:03:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:03:27.889617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7e624af0-4fd7-499c-85dd-d7629a669817 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:27.890614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e624af0-4fd7-499c-85dd-d7629a669817 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:27.911340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e624af0-4fd7-499c-85dd-d7629a669817 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:27.916016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e624af0-4fd7-499c-85dd-d7629a669817 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:27.918710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e624af0-4fd7-499c-85dd-d7629a669817 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:27.919185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e624af0-4fd7-499c-85dd-d7629a669817 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:27.996347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b787ac4d-238b-4dc2-8f9c-161ad9a512b8 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:28.044863 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b787ac4d-238b-4dc2-8f9c-161ad9a512b8 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.595867 Jul 26 14:03:28.051163 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 55/141] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:27 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:28.437827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-13e00c3a-e026-40e1-b33f-0f32368163d1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:28.438949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-13e00c3a-e026-40e1-b33f-0f32368163d1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:28.464657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13e00c3a-e026-40e1-b33f-0f32368163d1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:28.471337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13e00c3a-e026-40e1-b33f-0f32368163d1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:28.473424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13e00c3a-e026-40e1-b33f-0f32368163d1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:28.476506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13e00c3a-e026-40e1-b33f-0f32368163d1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:29.339314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7e624af0-4fd7-499c-85dd-d7629a669817 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:29.360978 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7e624af0-4fd7-499c-85dd-d7629a669817 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 1.472666 Jul 26 14:03:29.362808 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 87/142] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:27 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:29.373401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d2b382f-1a07-4e5a-a80b-f287fb1afc60 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:29.374560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2d2b382f-1a07-4e5a-a80b-f287fb1afc60 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:29.389253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d2b382f-1a07-4e5a-a80b-f287fb1afc60 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:29.390687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d2b382f-1a07-4e5a-a80b-f287fb1afc60 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:29.391828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d2b382f-1a07-4e5a-a80b-f287fb1afc60 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:29.392713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d2b382f-1a07-4e5a-a80b-f287fb1afc60 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:29.696954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-13e00c3a-e026-40e1-b33f-0f32368163d1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:29.749780 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-13e00c3a-e026-40e1-b33f-0f32368163d1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 1.320017 Jul 26 14:03:29.782797 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 56/143] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:28 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:29.801033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f7f7cc9a-431f-47c8-bd5c-c36b9d5fadf1 req-cadc044b-f10b-4b28-b3ef-581a9201de92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4414ffa1-1053-4d24-864e-d1a943883be3", "tag": "a8df3bca-8031-4c87-b071-df70fe2e1de9"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:29.832502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f7f7cc9a-431f-47c8-bd5c-c36b9d5fadf1 req-cadc044b-f10b-4b28-b3ef-581a9201de92 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:29.837313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f7f7cc9a-431f-47c8-bd5c-c36b9d5fadf1 req-cadc044b-f10b-4b28-b3ef-581a9201de92 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:29.899328 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f7f7cc9a-431f-47c8-bd5c-c36b9d5fadf1 req-cadc044b-f10b-4b28-b3ef-581a9201de92 service nova] Creating event network-changed:a8df3bca-8031-4c87-b071-df70fe2e1de9 for instance 4414ffa1-1053-4d24-864e-d1a943883be3 on n-h2-833090-9 Jul 26 14:03:29.914253 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f7f7cc9a-431f-47c8-bd5c-c36b9d5fadf1 req-cadc044b-f10b-4b28-b3ef-581a9201de92 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128550 Jul 26 14:03:29.914883 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 57/144] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:29.982444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2d2b382f-1a07-4e5a-a80b-f287fb1afc60 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:29.996709 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d2b382f-1a07-4e5a-a80b-f287fb1afc60 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.630072 Jul 26 14:03:30.016090 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 88/145] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:29 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:30.086160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4b5d9d5d-341b-49e4-90e2-080f7d8399e5 req-c8b5f3dd-83fa-40da-b36f-b9f3ca0de341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d040e902-a81c-4f87-9864-d3a258e79bcb", "name": "network-vif-plugged", "status": "completed", "tag": "d89b8621-043d-4883-9979-ffb052174bf9"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:30.112376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4b5d9d5d-341b-49e4-90e2-080f7d8399e5 req-c8b5f3dd-83fa-40da-b36f-b9f3ca0de341 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:30.112827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4b5d9d5d-341b-49e4-90e2-080f7d8399e5 req-c8b5f3dd-83fa-40da-b36f-b9f3ca0de341 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:30.125858 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4b5d9d5d-341b-49e4-90e2-080f7d8399e5 req-c8b5f3dd-83fa-40da-b36f-b9f3ca0de341 service nova] Creating event network-vif-plugged:d89b8621-043d-4883-9979-ffb052174bf9 for instance d040e902-a81c-4f87-9864-d3a258e79bcb on n-h1-833090-9 Jul 26 14:03:30.134077 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4b5d9d5d-341b-49e4-90e2-080f7d8399e5 req-c8b5f3dd-83fa-40da-b36f-b9f3ca0de341 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157612 Jul 26 14:03:30.138540 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 58/146] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:30.387204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e5819949-7ad9-458c-aa31-fb93349dd9b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:30.387832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e5819949-7ad9-458c-aa31-fb93349dd9b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:30.399427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5819949-7ad9-458c-aa31-fb93349dd9b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:30.400192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5819949-7ad9-458c-aa31-fb93349dd9b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:30.401153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5819949-7ad9-458c-aa31-fb93349dd9b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:30.401795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5819949-7ad9-458c-aa31-fb93349dd9b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:30.792319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d8707d8b-1eb6-463a-a26a-b28c741dcf6e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:30.794528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d8707d8b-1eb6-463a-a26a-b28c741dcf6e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:30.807895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8707d8b-1eb6-463a-a26a-b28c741dcf6e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:30.810857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8707d8b-1eb6-463a-a26a-b28c741dcf6e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:30.811683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8707d8b-1eb6-463a-a26a-b28c741dcf6e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:30.815382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8707d8b-1eb6-463a-a26a-b28c741dcf6e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:31.069587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e5819949-7ad9-458c-aa31-fb93349dd9b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:31.080144 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e5819949-7ad9-458c-aa31-fb93349dd9b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 0.694956 Jul 26 14:03:31.081107 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 89/147] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:30 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:31.099935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af841a7e-1743-49e3-82f8-d345da03d3ce tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:31.101108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af841a7e-1743-49e3-82f8-d345da03d3ce tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:31.112705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af841a7e-1743-49e3-82f8-d345da03d3ce tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:31.116234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af841a7e-1743-49e3-82f8-d345da03d3ce tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:31.117202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af841a7e-1743-49e3-82f8-d345da03d3ce tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:31.117697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af841a7e-1743-49e3-82f8-d345da03d3ce tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:31.469136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d8707d8b-1eb6-463a-a26a-b28c741dcf6e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:31.484761 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d8707d8b-1eb6-463a-a26a-b28c741dcf6e tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 0.697828 Jul 26 14:03:31.485721 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 59/148] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:30 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:31.686299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af841a7e-1743-49e3-82f8-d345da03d3ce tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:31.696188 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af841a7e-1743-49e3-82f8-d345da03d3ce tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.608802 Jul 26 14:03:31.697245 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 90/149] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:31 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:32.103434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6c4e9f7f-9ded-40b1-bb5d-022d43908d8b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:32.105153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6c4e9f7f-9ded-40b1-bb5d-022d43908d8b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:32.113905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c4e9f7f-9ded-40b1-bb5d-022d43908d8b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:32.114754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c4e9f7f-9ded-40b1-bb5d-022d43908d8b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:32.116459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c4e9f7f-9ded-40b1-bb5d-022d43908d8b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:32.117746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c4e9f7f-9ded-40b1-bb5d-022d43908d8b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:32.508790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8e69c816-892d-4058-baeb-271659fe0ca0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:32.509493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6c4e9f7f-9ded-40b1-bb5d-022d43908d8b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:32.510123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8e69c816-892d-4058-baeb-271659fe0ca0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:32.520830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e69c816-892d-4058-baeb-271659fe0ca0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:32.521025 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6c4e9f7f-9ded-40b1-bb5d-022d43908d8b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 0.422759 Jul 26 14:03:32.521667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e69c816-892d-4058-baeb-271659fe0ca0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:32.534969 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 60/150] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:32 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:32.542325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e69c816-892d-4058-baeb-271659fe0ca0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:32.544258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e69c816-892d-4058-baeb-271659fe0ca0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:32.747478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-accead8e-c16f-4e6e-89cf-8943843482da tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:32.750064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-accead8e-c16f-4e6e-89cf-8943843482da tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:32.759924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-accead8e-c16f-4e6e-89cf-8943843482da tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:32.764406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-accead8e-c16f-4e6e-89cf-8943843482da tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:32.766925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-accead8e-c16f-4e6e-89cf-8943843482da tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:32.767941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-accead8e-c16f-4e6e-89cf-8943843482da tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:33.194328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8e69c816-892d-4058-baeb-271659fe0ca0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:33.205854 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8e69c816-892d-4058-baeb-271659fe0ca0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 0.701895 Jul 26 14:03:33.206655 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 91/151] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:32 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:33.262027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-accead8e-c16f-4e6e-89cf-8943843482da tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:33.275006 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-accead8e-c16f-4e6e-89cf-8943843482da tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1337 microversion: 2.1 time: 0.554972 Jul 26 14:03:33.283816 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 61/152] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:32 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1337 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:33.543923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58706c43-7360-4129-a1d8-8d45c0fde882 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:33.544752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-58706c43-7360-4129-a1d8-8d45c0fde882 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:33.558286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58706c43-7360-4129-a1d8-8d45c0fde882 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:33.562130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58706c43-7360-4129-a1d8-8d45c0fde882 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:33.563578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58706c43-7360-4129-a1d8-8d45c0fde882 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:33.567238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58706c43-7360-4129-a1d8-8d45c0fde882 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:34.105594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-58706c43-7360-4129-a1d8-8d45c0fde882 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:34.113728 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-58706c43-7360-4129-a1d8-8d45c0fde882 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 0.574442 Jul 26 14:03:34.115660 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 92/153] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:33 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:34.230591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5d21faa4-a1e8-4f12-b111-2e742da64252 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:34.231601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d21faa4-a1e8-4f12-b111-2e742da64252 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:34.240717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d21faa4-a1e8-4f12-b111-2e742da64252 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:34.241446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d21faa4-a1e8-4f12-b111-2e742da64252 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:34.242890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d21faa4-a1e8-4f12-b111-2e742da64252 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:34.243353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d21faa4-a1e8-4f12-b111-2e742da64252 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:34.313366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0cbf226d-ca9c-44a2-8ac7-b0ec6f2faa28 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:34.313873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0cbf226d-ca9c-44a2-8ac7-b0ec6f2faa28 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:34.325993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cbf226d-ca9c-44a2-8ac7-b0ec6f2faa28 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:34.326452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cbf226d-ca9c-44a2-8ac7-b0ec6f2faa28 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:34.327254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cbf226d-ca9c-44a2-8ac7-b0ec6f2faa28 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:34.328487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cbf226d-ca9c-44a2-8ac7-b0ec6f2faa28 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.019181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5d21faa4-a1e8-4f12-b111-2e742da64252 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:35.029663 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5d21faa4-a1e8-4f12-b111-2e742da64252 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 0.803042 Jul 26 14:03:35.030615 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 62/154] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:34 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:35.041276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0cbf226d-ca9c-44a2-8ac7-b0ec6f2faa28 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:35.058065 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0cbf226d-ca9c-44a2-8ac7-b0ec6f2faa28 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1486 microversion: 2.1 time: 0.751925 Jul 26 14:03:35.059042 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 93/155] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:34 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1486 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:35.101125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c47cc216-ef62-40b5-a523-5f0aff3b69c5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:35.101866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c47cc216-ef62-40b5-a523-5f0aff3b69c5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:35.118471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c47cc216-ef62-40b5-a523-5f0aff3b69c5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.119224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c47cc216-ef62-40b5-a523-5f0aff3b69c5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.120677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c47cc216-ef62-40b5-a523-5f0aff3b69c5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.121337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c47cc216-ef62-40b5-a523-5f0aff3b69c5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.339679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3074c9f2-ff3b-4f3d-8044-7cf1b74e2c44 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Action: 'create', calling method: .version_select at 0x7f8794dc1940>, body: {"keypair": {"name": "tempest-keypair-1105176260", "type": "ssh", "user_id": "1bd22282a7754bf5b08d19cb41d36725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1yIeWU3QCFmtZB48G6bs/WfloBKKy3LDrbHLtWn5Iyn7POKBD9UV452dPHi6VbXUwWa2ZarQ+Cz9lQUY/ihTtmJ+Spcw7HXpNzYDuTkRoJjviVSdmexlEv0BrnLmEc0A=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:35.393036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3074c9f2-ff3b-4f3d-8044-7cf1b74e2c44 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Getting quotas for project 91d5d344b0d04766accadbdc293e6a90. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:03:35.399865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3074c9f2-ff3b-4f3d-8044-7cf1b74e2c44 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Getting quotas for user 81ad7e12f0d54470a38747a71b25bdad and project 91d5d344b0d04766accadbdc293e6a90. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:03:35.453222 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3074c9f2-ff3b-4f3d-8044-7cf1b74e2c44 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.421210 Jul 26 14:03:35.454136 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 63/156] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Jul 26 14:03:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 423 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 14:03:35.460914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-03108c8c-9598-405e-8639-ef3bb04a936a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:35.461756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-03108c8c-9598-405e-8639-ef3bb04a936a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:35.469426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03108c8c-9598-405e-8639-ef3bb04a936a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.470069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03108c8c-9598-405e-8639-ef3bb04a936a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.470926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03108c8c-9598-405e-8639-ef3bb04a936a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.471531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03108c8c-9598-405e-8639-ef3bb04a936a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.664295 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c47cc216-ef62-40b5-a523-5f0aff3b69c5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1637 microversion: 2.1 time: 0.576565 Jul 26 14:03:35.665940 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 94/157] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:35 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1637 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:35.685904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-03108c8c-9598-405e-8639-ef3bb04a936a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:35.695517 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-03108c8c-9598-405e-8639-ef3bb04a936a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 0.239820 Jul 26 14:03:35.696041 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 64/158] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:35 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:35.759547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b367dc1-2d67-44ae-af62-357093f2f219 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Calling method '.version_select at 0x7f8794df9ca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:35.761414 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:35.761414 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:35.762689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b367dc1-2d67-44ae-af62-357093f2f219 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.763327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b367dc1-2d67-44ae-af62-357093f2f219 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.789668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b367dc1-2d67-44ae-af62-357093f2f219 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.790554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b367dc1-2d67-44ae-af62-357093f2f219 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.802318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b367dc1-2d67-44ae-af62-357093f2f219 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.803580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b367dc1-2d67-44ae-af62-357093f2f219 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.811411 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b367dc1-2d67-44ae-af62-357093f2f219 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.143989 Jul 26 14:03:35.813756 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 95/159] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:35.819989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-94e1cf33-6786-4a93-9956-b261cb3ed8e6 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Action: 'create', calling method: .version_select at 0x7f8794e17280>, body: {"keypair": {"name": "tempest-keypair-2046291657", "type": "ssh", "user_id": "1bd22282a7754bf5b08d19cb41d36725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTqj36qkQHIIlgJc0wNvRXOodQ7c7i8nchhQ9CPSG7N7U1ohWslQ7hVgd6jZx4I4FSr8JSFd3fBzTGy82ekdJcnM5xY7on5/mnFEiv+bI9LIobQMtnU1aWwvQnYWFTfxA=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:35.832430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6bf2a147-8a1d-4cad-9f9b-27e25be4583c tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:35.842932 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6bf2a147-8a1d-4cad-9f9b-27e25be4583c tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.145619 Jul 26 14:03:35.843703 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 65/160] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:03:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:35.848675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-83bc3b74-1967-4949-bef5-e4b576f8cb30 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:35.849341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-83bc3b74-1967-4949-bef5-e4b576f8cb30 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:35.854501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-94e1cf33-6786-4a93-9956-b261cb3ed8e6 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Getting quotas for project 91d5d344b0d04766accadbdc293e6a90. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:03:35.856555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83bc3b74-1967-4949-bef5-e4b576f8cb30 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.857085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83bc3b74-1967-4949-bef5-e4b576f8cb30 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.858011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83bc3b74-1967-4949-bef5-e4b576f8cb30 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.858707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83bc3b74-1967-4949-bef5-e4b576f8cb30 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.861045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-94e1cf33-6786-4a93-9956-b261cb3ed8e6 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Getting quotas for user 81ad7e12f0d54470a38747a71b25bdad and project 91d5d344b0d04766accadbdc293e6a90. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:03:35.893201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-83bc3b74-1967-4949-bef5-e4b576f8cb30 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:03:35.895037 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-94e1cf33-6786-4a93-9956-b261cb3ed8e6 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.079826 Jul 26 14:03:35.895898 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 96/161] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Jul 26 14:03:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 14:03:35.906657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-38cea403-9480-4fe8-b893-eae892d37b20 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Calling method '.version_select at 0x7f8794d60e50>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:35.908109 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:35.908109 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:35.909461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38cea403-9480-4fe8-b893-eae892d37b20 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.910242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38cea403-9480-4fe8-b893-eae892d37b20 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.931211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38cea403-9480-4fe8-b893-eae892d37b20 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.931680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38cea403-9480-4fe8-b893-eae892d37b20 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.945982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38cea403-9480-4fe8-b893-eae892d37b20 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:35.946356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38cea403-9480-4fe8-b893-eae892d37b20 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:35.953579 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-38cea403-9480-4fe8-b893-eae892d37b20 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.055581 Jul 26 14:03:35.954205 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 97/162] 10.222.0.70 () {58 vars in 1167 bytes} [Tue Jul 26 14:03:35 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:36.033166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d426ab4a-a2e5-4144-8ddf-d667000019da tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-577603854", "id": 1378323926, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:36.038007 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:36.038007 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:36.069130 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d426ab4a-a2e5-4144-8ddf-d667000019da tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.112963 Jul 26 14:03:36.070280 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 98/163] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:03:35 2022] POST /compute/v2.1/flavors => generated 424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:36.071829 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-83bc3b74-1967-4949-bef5-e4b576f8cb30 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 204 len: 0 microversion: 2.1 time: 0.226610 Jul 26 14:03:36.073352 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 66/164] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:03:35 2022] DELETE /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:03:36.075871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4158203e-1e62-4a7b-a18f-73ec2d19d7e9 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Calling method '.version_select at 0x7f8794dab820>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.081881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55c79276-70f8-42a7-9a85-adebd9616383 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Calling method '.version_select at 0x7f8794d934c0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.083089 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:36.083089 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:36.085029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c79276-70f8-42a7-9a85-adebd9616383 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.085925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c79276-70f8-42a7-9a85-adebd9616383 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.090702 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4158203e-1e62-4a7b-a18f-73ec2d19d7e9 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-1105176260?user_id=1bd22282a7754bf5b08d19cb41d36725" status: 200 len: 512 microversion: 2.10 time: 0.019273 Jul 26 14:03:36.091290 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 99/165] 10.222.0.70 () {60 vars in 1340 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1105176260?user_id=1bd22282a7754bf5b08d19cb41d36725 => generated 512 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:03:36.097140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba4ca5ec-16da-4cea-b4cc-f2186588f9e4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.098207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba4ca5ec-16da-4cea-b4cc-f2186588f9e4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:36.105581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba4ca5ec-16da-4cea-b4cc-f2186588f9e4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.106041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba4ca5ec-16da-4cea-b4cc-f2186588f9e4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.106838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba4ca5ec-16da-4cea-b4cc-f2186588f9e4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.107285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba4ca5ec-16da-4cea-b4cc-f2186588f9e4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.114325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c79276-70f8-42a7-9a85-adebd9616383 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.114775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c79276-70f8-42a7-9a85-adebd9616383 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.135506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c79276-70f8-42a7-9a85-adebd9616383 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.136643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c79276-70f8-42a7-9a85-adebd9616383 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.146590 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-55c79276-70f8-42a7-9a85-adebd9616383 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.071565 Jul 26 14:03:36.147448 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 67/166] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:36.158974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-61da8d0b-c2f6-4efc-a43c-fe3ab3a288fb tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.159648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-61da8d0b-c2f6-4efc-a43c-fe3ab3a288fb tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:36.167893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61da8d0b-c2f6-4efc-a43c-fe3ab3a288fb tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.168407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61da8d0b-c2f6-4efc-a43c-fe3ab3a288fb tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.169223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61da8d0b-c2f6-4efc-a43c-fe3ab3a288fb tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.169673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61da8d0b-c2f6-4efc-a43c-fe3ab3a288fb tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.316849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba4ca5ec-16da-4cea-b4cc-f2186588f9e4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:36.326911 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba4ca5ec-16da-4cea-b4cc-f2186588f9e4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 0.234235 Jul 26 14:03:36.327877 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 100/167] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:36.337192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3411f6b5-5922-4eee-86a5-f6834fbb4a55 tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.345741 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3411f6b5-5922-4eee-86a5-f6834fbb4a55 tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016347 Jul 26 14:03:36.346580 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 101/168] 10.222.0.70 () {58 vars in 1182 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:03:36.356862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ad2ed6b0-44f1-4d39-81e0-00d78bef5632 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Action: 'create', calling method: .version_select at 0x7f8794d99280>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1316698002", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5DZftrW7mgcNQVlfdiXPp+6UvN08U7T7elbfEr2gblrvylsGtS1pFVlqtE+UFtgv2AI9Jly23fNtFsl4+lxROtZleWfsvEMDD1fxB91qcuFL7N1T9IY1brAyL6TmCIWQ=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:36.365778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:36.377143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ad2ed6b0-44f1-4d39-81e0-00d78bef5632 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Getting quotas for project 91d5d344b0d04766accadbdc293e6a90. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:03:36.382869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ad2ed6b0-44f1-4d39-81e0-00d78bef5632 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Getting quotas for user 81ad7e12f0d54470a38747a71b25bdad and project 91d5d344b0d04766accadbdc293e6a90. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:03:36.387997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-61da8d0b-c2f6-4efc-a43c-fe3ab3a288fb tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:36.397474 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-61da8d0b-c2f6-4efc-a43c-fe3ab3a288fb tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1492 microversion: 2.1 time: 0.247904 Jul 26 14:03:36.398999 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 68/169] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1492 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:36.418215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-540de436-8386-42b5-be49-d5945a986014 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Calling method '.version_select at 0x7f8794c293a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.419289 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:36.419289 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:36.420256 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ad2ed6b0-44f1-4d39-81e0-00d78bef5632 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.066924 Jul 26 14:03:36.420535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-540de436-8386-42b5-be49-d5945a986014 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.420978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-540de436-8386-42b5-be49-d5945a986014 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.431351 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 102/170] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Jul 26 14:03:36 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 14:03:36.436753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-debadb05-bc4b-48b4-8d30-ff9f78d49e8d tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1249364269", "id": 2006998507, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:36.440048 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:36.440048 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:36.440483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-540de436-8386-42b5-be49-d5945a986014 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.440483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-540de436-8386-42b5-be49-d5945a986014 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.448842 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-540de436-8386-42b5-be49-d5945a986014 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.034930 Jul 26 14:03:36.461461 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 69/171] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:36.461461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1993086-9614-4122-8ae2-9b6621a94cb3 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Calling method '.version_select at 0x7f8794c29310>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.461461 n-d-833090-9 devstack@n-api.service[119478]: WARNING oslo_db.sqlalchemy.utils [None req-b1993086-9614-4122-8ae2-9b6621a94cb3 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 14:03:36.462120 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-debadb05-bc4b-48b4-8d30-ff9f78d49e8d tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.026911 Jul 26 14:03:36.462120 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 103/172] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:03:36 2022] POST /compute/v2.1/flavors => generated 425 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:36.467568 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b1993086-9614-4122-8ae2-9b6621a94cb3 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] 10.222.0.70 "GET /compute/v2.1/os-keypairs?user_id=1bd22282a7754bf5b08d19cb41d36725" status: 200 len: 726 microversion: 2.10 time: 0.016525 Jul 26 14:03:36.468829 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 70/173] 10.222.0.70 () {60 vars in 1259 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/os-keypairs?user_id=1bd22282a7754bf5b08d19cb41d36725 => generated 726 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:03:36.480684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-415b04cf-4e0b-4fa5-832e-df75be3bda15 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Calling method '.version_select at 0x7f8794cf2820>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.481461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-86a522b8-6cb0-4e31-9c20-cca6d63ee552 tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.481673 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:36.481673 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:36.482787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-415b04cf-4e0b-4fa5-832e-df75be3bda15 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.483257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-415b04cf-4e0b-4fa5-832e-df75be3bda15 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.492970 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-86a522b8-6cb0-4e31-9c20-cca6d63ee552 tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022710 Jul 26 14:03:36.494104 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 104/174] 10.222.0.70 () {58 vars in 1182 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:03:36.499085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-103f6900-2442-4637-aaec-94a4a178bda8 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Calling method '.version_select at 0x7f8794d608b0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.503753 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-415b04cf-4e0b-4fa5-832e-df75be3bda15 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.029553 Jul 26 14:03:36.504388 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 71/175] 10.222.0.70 () {58 vars in 1179 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:36.512539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1281dc22-64aa-4001-bbff-4ccbe316738d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Action: 'create', calling method: .version_select at 0x7f8794cf2430>, body: {"keypair": {"name": "tempest-keypair-1514025668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLF+fOw5GT8+/4q+75KtPBzzjXOPKYSuPk42XPIM9qMUOY3eI0ep75j7tbAzzRuCSI4zFh4bGNck+dD/0RbbU5K8q06fCeNZ7cRYJEwxPTujG99zIsjD9atRXaPGPev/0Q=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:36.529921 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-103f6900-2442-4637-aaec-94a4a178bda8 tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1316698002" status: 204 len: 0 microversion: 2.10 time: 0.034442 Jul 26 14:03:36.530596 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 105/176] 10.222.0.70 () {60 vars in 1325 bytes} [Tue Jul 26 14:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1316698002 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:03:36.535130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-1281dc22-64aa-4001-bbff-4ccbe316738d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Getting quotas for project 2853b779839a488cb28341b8a9744c60. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:03:36.535338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-91c12f0c-411c-43be-876c-91f393901043 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Calling method '.version_select at 0x7f8794dabd30>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.536454 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:36.536454 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:36.539001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91c12f0c-411c-43be-876c-91f393901043 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.539699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91c12f0c-411c-43be-876c-91f393901043 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.540790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-1281dc22-64aa-4001-bbff-4ccbe316738d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Getting quotas for user b41f5df8d0844f078e147aa5f454d5d3 and project 2853b779839a488cb28341b8a9744c60. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:03:36.557625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91c12f0c-411c-43be-876c-91f393901043 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.558221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91c12f0c-411c-43be-876c-91f393901043 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.570338 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1281dc22-64aa-4001-bbff-4ccbe316738d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062883 Jul 26 14:03:36.571327 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 72/177] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:03:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:36.576296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5739017a-d70b-40d5-afd8-14b8746ec29c tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Calling method '.version_select at 0x7f8794c89430>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.582261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91c12f0c-411c-43be-876c-91f393901043 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.582945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91c12f0c-411c-43be-876c-91f393901043 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.586128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:36.597349 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-91c12f0c-411c-43be-876c-91f393901043 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.065361 Jul 26 14:03:36.598153 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 106/178] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:36.609881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-89b7e801-e390-414a-b103-bce409e8caa7 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Calling method '.version_select at 0x7f8794e17160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.610735 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:36.610735 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:36.611979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89b7e801-e390-414a-b103-bce409e8caa7 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.612474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89b7e801-e390-414a-b103-bce409e8caa7 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.630020 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5739017a-d70b-40d5-afd8-14b8746ec29c tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2046291657?user_id=1bd22282a7754bf5b08d19cb41d36725" status: 204 len: 0 microversion: 2.10 time: 0.057444 Jul 26 14:03:36.630637 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 73/179] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2046291657?user_id=1bd22282a7754bf5b08d19cb41d36725 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:03:36.640616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d8d750fd-437e-437e-a27e-884f8615b7ce tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] Calling method '.version_select at 0x7f8794c068b0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.663780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89b7e801-e390-414a-b103-bce409e8caa7 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.665095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89b7e801-e390-414a-b103-bce409e8caa7 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.669645 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d8d750fd-437e-437e-a27e-884f8615b7ce tempest-KeyPairsV210TestJSON-360672390 tempest-KeyPairsV210TestJSON-360672390-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105176260?user_id=1bd22282a7754bf5b08d19cb41d36725" status: 204 len: 0 microversion: 2.10 time: 0.033509 Jul 26 14:03:36.670914 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 74/180] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105176260?user_id=1bd22282a7754bf5b08d19cb41d36725 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:03:36.683519 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-89b7e801-e390-414a-b103-bce409e8caa7 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.077833 Jul 26 14:03:36.684793 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 107/181] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:36.699987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-313fd18b-8edd-4571-ac60-63316a27761d tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Calling method '.version_select at 0x7f8794c06550>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.701162 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:36.701162 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:36.702918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-313fd18b-8edd-4571-ac60-63316a27761d tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.703530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-313fd18b-8edd-4571-ac60-63316a27761d tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.723252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-313fd18b-8edd-4571-ac60-63316a27761d tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.726693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-313fd18b-8edd-4571-ac60-63316a27761d tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.727896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5bf27efd-2385-4388-9b20-d6da94a81b66 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.730941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5bf27efd-2385-4388-9b20-d6da94a81b66 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:36.740789 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-313fd18b-8edd-4571-ac60-63316a27761d tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.045342 Jul 26 14:03:36.741957 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 75/182] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:36.758692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bf27efd-2385-4388-9b20-d6da94a81b66 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.759334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6122d39-07a2-4eb7-97e2-e3072eacc339 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Calling method '.version_select at 0x7f8794c299d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:36.762288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bf27efd-2385-4388-9b20-d6da94a81b66 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.764936 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:36.764936 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:36.766739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6122d39-07a2-4eb7-97e2-e3072eacc339 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.767210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6122d39-07a2-4eb7-97e2-e3072eacc339 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.770531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bf27efd-2385-4388-9b20-d6da94a81b66 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.772868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bf27efd-2385-4388-9b20-d6da94a81b66 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.793198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6122d39-07a2-4eb7-97e2-e3072eacc339 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.793843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6122d39-07a2-4eb7-97e2-e3072eacc339 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:36.820120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6122d39-07a2-4eb7-97e2-e3072eacc339 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:36.821225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6122d39-07a2-4eb7-97e2-e3072eacc339 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:37.003735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5bf27efd-2385-4388-9b20-d6da94a81b66 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:37.016096 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5bf27efd-2385-4388-9b20-d6da94a81b66 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 0.298580 Jul 26 14:03:37.018922 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 108/183] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:37.223117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6c178cd4-79a6-4190-8a07-d3470508d9ec req-b21ac7e0-3fcf-4f86-bbbb-2bdc87ec1fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd85b7d5-71df-48ab-b23a-adf63fcadd94", "name": "network-vif-plugged", "status": "completed", "tag": "abde11f3-2227-40c0-b73b-c1ddf26f7086"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:37.230525 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6122d39-07a2-4eb7-97e2-e3072eacc339 tempest-HypervisorAdminTestJSON-2071101859 tempest-HypervisorAdminTestJSON-2071101859-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.476828 Jul 26 14:03:37.231323 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 76/184] 10.222.0.70 () {58 vars in 1173 bytes} [Tue Jul 26 14:03:36 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:37.265646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6c178cd4-79a6-4190-8a07-d3470508d9ec req-b21ac7e0-3fcf-4f86-bbbb-2bdc87ec1fb4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:37.266740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6c178cd4-79a6-4190-8a07-d3470508d9ec req-b21ac7e0-3fcf-4f86-bbbb-2bdc87ec1fb4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:37.298318 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6c178cd4-79a6-4190-8a07-d3470508d9ec req-b21ac7e0-3fcf-4f86-bbbb-2bdc87ec1fb4 service nova] Creating event network-vif-plugged:abde11f3-2227-40c0-b73b-c1ddf26f7086 for instance cd85b7d5-71df-48ab-b23a-adf63fcadd94 on n-h2-833090-9 Jul 26 14:03:37.299215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6c178cd4-79a6-4190-8a07-d3470508d9ec req-b21ac7e0-3fcf-4f86-bbbb-2bdc87ec1fb4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=119479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:03:37.300743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37df8b0a-e76a-427e-88de-407b80b4fbdc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:37.301339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37df8b0a-e76a-427e-88de-407b80b4fbdc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:37.302494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37df8b0a-e76a-427e-88de-407b80b4fbdc None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:37.303656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37df8b0a-e76a-427e-88de-407b80b4fbdc None None] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:37.326761 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.compute.rpcapi [None req-37df8b0a-e76a-427e-88de-407b80b4fbdc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 14:03:37.341393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37df8b0a-e76a-427e-88de-407b80b4fbdc None None] Releasing lock "compute-rpcapi-router" {{(pid=119479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:03:37.361549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-95fdad79-69b5-422c-9830-0e78edfaa824 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:37.364465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-95fdad79-69b5-422c-9830-0e78edfaa824 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:37.392939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95fdad79-69b5-422c-9830-0e78edfaa824 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:37.394386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95fdad79-69b5-422c-9830-0e78edfaa824 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:37.395393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95fdad79-69b5-422c-9830-0e78edfaa824 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:37.399079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95fdad79-69b5-422c-9830-0e78edfaa824 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:37.406176 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-37df8b0a-e76a-427e-88de-407b80b4fbdc None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194452 Jul 26 14:03:37.407036 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 109/185] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:37.411855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:37.421710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-59614121-7293-4aed-812f-afe05150258d tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:37.422681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-59614121-7293-4aed-812f-afe05150258d tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:37.444301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59614121-7293-4aed-812f-afe05150258d tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:37.451187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59614121-7293-4aed-812f-afe05150258d tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:37.461386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59614121-7293-4aed-812f-afe05150258d tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:37.462393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59614121-7293-4aed-812f-afe05150258d tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:38.067882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-95fdad79-69b5-422c-9830-0e78edfaa824 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:38.077592 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-95fdad79-69b5-422c-9830-0e78edfaa824 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 0.731342 Jul 26 14:03:38.078850 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 77/186] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:37 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:38.087091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-59614121-7293-4aed-812f-afe05150258d tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:38.100095 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-59614121-7293-4aed-812f-afe05150258d tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1492 microversion: 2.1 time: 0.679817 Jul 26 14:03:38.103401 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 110/187] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:37 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1492 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:38.104975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7b758338-6fa1-4f7d-972a-1afe4b29f40f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:38.105870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7b758338-6fa1-4f7d-972a-1afe4b29f40f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:38.112989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b758338-6fa1-4f7d-972a-1afe4b29f40f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:38.114229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b758338-6fa1-4f7d-972a-1afe4b29f40f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:38.115813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b758338-6fa1-4f7d-972a-1afe4b29f40f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:38.116630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b758338-6fa1-4f7d-972a-1afe4b29f40f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:38.542995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7b758338-6fa1-4f7d-972a-1afe4b29f40f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:38.559709 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7b758338-6fa1-4f7d-972a-1afe4b29f40f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 0.479207 Jul 26 14:03:38.560512 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 78/188] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:38 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:39.076570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6bbfcadb-a61f-49ec-9ae4-22f4a482ff24 req-8703a847-7d0d-4b3f-8d3f-335d6e92582b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d040e902-a81c-4f87-9864-d3a258e79bcb", "name": "network-vif-deleted", "tag": "d89b8621-043d-4883-9979-ffb052174bf9"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:39.102054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c08c8a21-a0f7-464c-8fac-4359e2fb719a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:39.103262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c08c8a21-a0f7-464c-8fac-4359e2fb719a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:39.117580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6bbfcadb-a61f-49ec-9ae4-22f4a482ff24 req-8703a847-7d0d-4b3f-8d3f-335d6e92582b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:39.118948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6bbfcadb-a61f-49ec-9ae4-22f4a482ff24 req-8703a847-7d0d-4b3f-8d3f-335d6e92582b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:39.129699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c08c8a21-a0f7-464c-8fac-4359e2fb719a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:39.130256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c08c8a21-a0f7-464c-8fac-4359e2fb719a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:39.136690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c08c8a21-a0f7-464c-8fac-4359e2fb719a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:39.138132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c08c8a21-a0f7-464c-8fac-4359e2fb719a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:39.163471 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6bbfcadb-a61f-49ec-9ae4-22f4a482ff24 req-8703a847-7d0d-4b3f-8d3f-335d6e92582b service nova] Creating event network-vif-deleted:d89b8621-043d-4883-9979-ffb052174bf9 for instance d040e902-a81c-4f87-9864-d3a258e79bcb on n-h1-833090-9 Jul 26 14:03:39.175181 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6bbfcadb-a61f-49ec-9ae4-22f4a482ff24 req-8703a847-7d0d-4b3f-8d3f-335d6e92582b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099791 Jul 26 14:03:39.176447 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 111/189] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:39.197389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85743d65-a374-4443-8987-a1b4944f7986 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:39.200980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85743d65-a374-4443-8987-a1b4944f7986 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:39.225652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85743d65-a374-4443-8987-a1b4944f7986 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:39.226432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85743d65-a374-4443-8987-a1b4944f7986 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:39.230021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85743d65-a374-4443-8987-a1b4944f7986 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:39.232768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85743d65-a374-4443-8987-a1b4944f7986 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:39.541327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-85743d65-a374-4443-8987-a1b4944f7986 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8950f62d5ff94fa2b3a54d9a1ced5924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdf50c8bd1141ee99a02883f0accc53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:39.557864 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85743d65-a374-4443-8987-a1b4944f7986 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 200 len: 1322 microversion: 2.1 time: 0.374389 Jul 26 14:03:39.560757 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 112/190] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:39 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:39.593357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5e4adc9-94c2-4987-882f-594a51916a9e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:39.594489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a5e4adc9-94c2-4987-882f-594a51916a9e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:39.603032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5e4adc9-94c2-4987-882f-594a51916a9e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:39.603557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5e4adc9-94c2-4987-882f-594a51916a9e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:39.604348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5e4adc9-94c2-4987-882f-594a51916a9e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:39.604813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5e4adc9-94c2-4987-882f-594a51916a9e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:39.844501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c08c8a21-a0f7-464c-8fac-4359e2fb719a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:39.916880 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c08c8a21-a0f7-464c-8fac-4359e2fb719a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1318 microversion: 2.1 time: 0.819032 Jul 26 14:03:39.917928 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 79/191] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:39 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:03:40.026873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a5e4adc9-94c2-4987-882f-594a51916a9e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:40.041298 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a5e4adc9-94c2-4987-882f-594a51916a9e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 0.452921 Jul 26 14:03:40.044782 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 113/192] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:39 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:40.444603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1344377741", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "2006998507", "adminPass": "***", "networks": [{"uuid": "ef14aa4d-5b69-4691-8a08-b7e7f20ad659"}], "security_groups": [{"name": "tempest-securitygroup--2104653547"}], "key_name": "tempest-keypair-1514025668", "user_data": "}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:40.595372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cfb3efe5-422d-42e4-a3a3-e9fcce5beb98 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:40.596267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cfb3efe5-422d-42e4-a3a3-e9fcce5beb98 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:40.606609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfb3efe5-422d-42e4-a3a3-e9fcce5beb98 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:40.607116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfb3efe5-422d-42e4-a3a3-e9fcce5beb98 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:40.614883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfb3efe5-422d-42e4-a3a3-e9fcce5beb98 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:40.619723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfb3efe5-422d-42e4-a3a3-e9fcce5beb98 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:40.656556 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-cfb3efe5-422d-42e4-a3a3-e9fcce5beb98 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] HTTP exception thrown: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cfb3efe5-422d-42e4-a3a3-e9fcce5beb98 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Request method failure captured: Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb HTTP/1.1 Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QOO9wniyVvxDGdlFpoO-nucNF0BZbHezsqESLrIop6vYCwj7qRcW1kwsFRVf_YbQRYPk6my6QdBFEgb5FHcsh3YeAD0W6XtJTFRhqEpxRpm99oTggI1XAlFozfhueNu75hR8uUgSLxm9R7Vqym-xbJJ-zxpgCGRa7653kJPxAP4Vo Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 9bdf50c8bd1141ee99a02883f0accc53 Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminTestJSON-1655233440 Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:03:40.659757 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdf50c8bd1141ee99a02883f0accc53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdf50c8bd1141ee99a02883f0accc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdf50c8bd1141ee99a02883f0accc53", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdf50c8bd1141ee99a02883f0accc53"}]}] Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminTestJSON-1655233440 Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 9bdf50c8bd1141ee99a02883f0accc53 Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1655233440 Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminTestJSON-1655233440-project Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8950f62d5ff94fa2b3a54d9a1ced5924 Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminTestJSON-1655233440-project Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:40.661059 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd040e902-a81c-4f87-9864-d3a258e79bcb'} Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:40.661714 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:40.663455 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:40.667312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cfb3efe5-422d-42e4-a3a3-e9fcce5beb98 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Returning 404 to user: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:40.668608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cfb3efe5-422d-42e4-a3a3-e9fcce5beb98 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 404 len: 111 microversion: 2.1 time: 0.077866 Jul 26 14:03:40.673508 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 114/193] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:40 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:03:40.681335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-888d66b9-24b7-483c-874e-6f131317618d tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-9"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:40.685604 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:40.685604 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:40.700909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-888d66b9-24b7-483c-874e-6f131317618d tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:40.701732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-888d66b9-24b7-483c-874e-6f131317618d tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:40.726866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] validate_networks() for [('ef14aa4d-5b69-4691-8a08-b7e7f20ad659', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:03:41.446591 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-888d66b9-24b7-483c-874e-6f131317618d tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.771361 Jul 26 14:03:41.447581 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 115/194] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:41.454249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-8dfe0f9b-b68f-4a7b-a730-58fb00be6711 req-83e4b883-10e9-4f4b-b1e5-eb5d7ecfb110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4414ffa1-1053-4d24-864e-d1a943883be3", "name": "network-vif-plugged", "status": "completed", "tag": "a8df3bca-8031-4c87-b071-df70fe2e1de9"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:41.469325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8dfe0f9b-b68f-4a7b-a730-58fb00be6711 req-83e4b883-10e9-4f4b-b1e5-eb5d7ecfb110 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:41.469825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8dfe0f9b-b68f-4a7b-a730-58fb00be6711 req-83e4b883-10e9-4f4b-b1e5-eb5d7ecfb110 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:41.486608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8dfe0f9b-b68f-4a7b-a730-58fb00be6711 req-83e4b883-10e9-4f4b-b1e5-eb5d7ecfb110 service nova] Creating event network-vif-plugged:a8df3bca-8031-4c87-b071-df70fe2e1de9 for instance 4414ffa1-1053-4d24-864e-d1a943883be3 on n-h2-833090-9 Jul 26 14:03:41.496518 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-8dfe0f9b-b68f-4a7b-a730-58fb00be6711 req-83e4b883-10e9-4f4b-b1e5-eb5d7ecfb110 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044517 Jul 26 14:03:41.497821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 116/195] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:41.507808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ac02f0e5-ea9c-40c8-a7e1-303a66ab579a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:41.509116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ac02f0e5-ea9c-40c8-a7e1-303a66ab579a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:41.520056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac02f0e5-ea9c-40c8-a7e1-303a66ab579a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:41.521081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac02f0e5-ea9c-40c8-a7e1-303a66ab579a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:41.523404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac02f0e5-ea9c-40c8-a7e1-303a66ab579a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:41.524272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac02f0e5-ea9c-40c8-a7e1-303a66ab579a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:42.155718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ac02f0e5-ea9c-40c8-a7e1-303a66ab579a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:42.174914 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ac02f0e5-ea9c-40c8-a7e1-303a66ab579a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1467 microversion: 2.1 time: 0.674118 Jul 26 14:03:42.176153 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 117/196] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:41 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1467 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:42.192394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1119ce10-bb42-4773-8789-956a8afd7d4c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:42.193031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1119ce10-bb42-4773-8789-956a8afd7d4c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:42.212201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1119ce10-bb42-4773-8789-956a8afd7d4c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:42.212948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1119ce10-bb42-4773-8789-956a8afd7d4c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:42.213933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1119ce10-bb42-4773-8789-956a8afd7d4c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:42.214529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1119ce10-bb42-4773-8789-956a8afd7d4c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:42.408025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:03:42.408728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:03:42.408939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:03:42.409770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:03:42.410355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:03:42.414653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SAVEPOINT=1,nova_api:INSERT=3,nova_api:RELEASE=1,nova_api:SELECT=89,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:42.465918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:42.465918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:42.465918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:42.466913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:42.468484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1119ce10-bb42-4773-8789-956a8afd7d4c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:42.480786 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1119ce10-bb42-4773-8789-956a8afd7d4c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1312 microversion: 2.1 time: 0.302798 Jul 26 14:03:42.481127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Getting quotas for project 2853b779839a488cb28341b8a9744c60. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:03:42.482141 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 118/197] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:42 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1312 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:42.487829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e3f9fe7d-2538-44c1-b91c-2a75b4f211a9 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:42.488800 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:42.488800 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:42.489762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Getting quotas for user b41f5df8d0844f078e147aa5f454d5d3 and project 2853b779839a488cb28341b8a9744c60. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:03:42.524637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:03:42.525379 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e3f9fe7d-2538-44c1-b91c-2a75b4f211a9 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.041654 Jul 26 14:03:42.539103 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 119/198] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:42 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:42.539321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:03:42.587774 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0dbac5f2-f543-4d26-a909-0704b5ebe3fd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.152411 Jul 26 14:03:42.588807 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 80/199] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:03:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:03:42.594000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4c7cf52f-ef19-4228-a84a-4ebc16bd0d69 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-695066845"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:42.597610 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:42.597610 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:42.598988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.aggregate [None req-4c7cf52f-ef19-4228-a84a-4ebc16bd0d69 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Generated uuid 9c265c5d-6aa7-406b-8315-f3952d30a4f5 for aggregate {{(pid=119478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:42.639280 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4c7cf52f-ef19-4228-a84a-4ebc16bd0d69 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.048914 Jul 26 14:03:42.640687 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 81/200] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:42 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:42.647338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-11823752-71f2-4e9c-9107-ee7b231c89f8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:42.648591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-11823752-71f2-4e9c-9107-ee7b231c89f8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:42.728890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-11823752-71f2-4e9c-9107-ee7b231c89f8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:42.737312 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-11823752-71f2-4e9c-9107-ee7b231c89f8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1265 microversion: 2.1 time: 0.095096 Jul 26 14:03:42.753395 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 82/201] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:42 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:42.759619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e528bd53-8e6c-452f-9e61-2553004fd728 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-9"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:42.763107 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:42.763107 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:42.786218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e528bd53-8e6c-452f-9e61-2553004fd728 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:42.797155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e528bd53-8e6c-452f-9e61-2553004fd728 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:43.050622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2142682278", "block_migration": true, "disk_over_commit": false}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:43.063239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:43.077675 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e528bd53-8e6c-452f-9e61-2553004fd728 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.322834 Jul 26 14:03:43.078882 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 83/202] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:42 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:43.080811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:43.082546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:43.083937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:43.084842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:43.090703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-560fffe7-db17-4ba9-83dc-423050642849 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:43.091451 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:43.091451 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:43.111764 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-560fffe7-db17-4ba9-83dc-423050642849 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.023962 Jul 26 14:03:43.112950 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 84/203] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Jul 26 14:03:43 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:43.148283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f6c6a60b-6620-4130-b238-89090ccde5d7 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-9"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:43.157363 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:43.157363 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:43.182714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6c6a60b-6620-4130-b238-89090ccde5d7 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:43.183407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6c6a60b-6620-4130-b238-89090ccde5d7 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:43.415734 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f6c6a60b-6620-4130-b238-89090ccde5d7 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.286536 Jul 26 14:03:43.416819 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 85/204] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:43 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:43.653557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lazy-loading 'flavor' on Instance uuid cd85b7d5-71df-48ab-b23a-adf63fcadd94 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:03:43.767543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Going to try to live migrate instance to tempest-host-2142682278 {{(pid=119479) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 14:03:43.790697 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] HTTP exception thrown: Compute host tempest-host-2142682278 could not be found. Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Request method failure captured: Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94/action HTTP/1.1 Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 107 Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Qeg9SexXn7kINnVOgDkemP5cdCMNB6NyxLfNOY3oVEn5hY7N71KiINwwKus2gl726k6ppoqIi1PBvbgp4FcYThRmLZ1Zx8lFMB7B4GMYm-BA9U9snPlB_Yq29_qflwNfPEy65H7djXigh5zZorvbMUbOF3RWgHSWKXen30c3i7Lo0 Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2ad377767b364cbca24180aa0d4c929b Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-LiveMigrationNegativeTest-1998763502 Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:03:43.804412 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2ad377767b364cbca24180aa0d4c929b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2ad377767b364cbca24180aa0d4c929b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2ad377767b364cbca24180aa0d4c929b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2ad377767b364cbca24180aa0d4c929b"}]}] Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-LiveMigrationNegativeTest-1998763502 Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2ad377767b364cbca24180aa0d4c929b Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1998763502 Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-LiveMigrationNegativeTest-1998763502-project-admin Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8416ab1cb5e04d1892930cbb6ef80b43 Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-LiveMigrationNegativeTest-1998763502-project-admin Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: {"os-migrateLive": {"host": "tempest-host-2142682278", "block_migration": true, "disk_over_commit": false}} Jul 26 14:03:43.806043 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: exception: Compute host tempest-host-2142682278 could not be found. Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'cd85b7d5-71df-48ab-b23a-adf63fcadd94', 'body': {'os-migrateLive': {'host': 'tempest-host-2142682278', 'block_migration': True, 'disk_over_commit': False}}} Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:03:43.806928 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2142682278 could not be found. Jul 26 14:03:43.808501 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2142682278 could not be found. Jul 26 14:03:43.809868 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:43.811266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:43.811266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:43.811266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:43.811266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:43.811266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:43.811266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:43.811266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:43.811266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2142682278 could not be found. Jul 26 14:03:43.811266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:43.816068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Returning 400 to user: Compute host tempest-host-2142682278 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:43.817639 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0f7dc53e-e740-4e4e-8867-cbaa2fa61516 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94/action" status: 400 len: 100 microversion: 2.1 time: 1.290016 Jul 26 14:03:43.819165 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 120/205] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jul 26 14:03:42 2022] POST /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94/action => generated 100 bytes in 1292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:03:43.821402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f77bb48b-eb54-465e-a766-48d8be25d39f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Calling method '.version_select at 0x7f8794c060d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:43.826057 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:43.826057 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:43.831644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bdf10b59-e21e-4d9f-b66b-5113d967af4d tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:43.832837 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:43.832837 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:43.835033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f77bb48b-eb54-465e-a766-48d8be25d39f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:43.835813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f77bb48b-eb54-465e-a766-48d8be25d39f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:43.889354 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bdf10b59-e21e-4d9f-b66b-5113d967af4d tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.068084 Jul 26 14:03:43.890596 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 121/206] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:43 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:43.894610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f77bb48b-eb54-465e-a766-48d8be25d39f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:43.895801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f77bb48b-eb54-465e-a766-48d8be25d39f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:43.912806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e49d69a4-8d98-4e7e-83b1-0f3624956ada tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:43.914793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e49d69a4-8d98-4e7e-83b1-0f3624956ada tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:43.925159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f77bb48b-eb54-465e-a766-48d8be25d39f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:43.925815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f77bb48b-eb54-465e-a766-48d8be25d39f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:43.926890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e49d69a4-8d98-4e7e-83b1-0f3624956ada tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:43.927967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e49d69a4-8d98-4e7e-83b1-0f3624956ada tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:43.929715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e49d69a4-8d98-4e7e-83b1-0f3624956ada tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:43.930841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e49d69a4-8d98-4e7e-83b1-0f3624956ada tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:43.947639 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f77bb48b-eb54-465e-a766-48d8be25d39f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.513336 Jul 26 14:03:43.948057 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 86/207] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:43.963439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eba49324-79b6-4522-abaa-3402ca484fc8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:43.966345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eba49324-79b6-4522-abaa-3402ca484fc8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:43.977989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eba49324-79b6-4522-abaa-3402ca484fc8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:43.978688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eba49324-79b6-4522-abaa-3402ca484fc8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:43.979633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eba49324-79b6-4522-abaa-3402ca484fc8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:43.980106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eba49324-79b6-4522-abaa-3402ca484fc8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.126339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-eba49324-79b6-4522-abaa-3402ca484fc8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:44.144300 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eba49324-79b6-4522-abaa-3402ca484fc8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1317 microversion: 2.1 time: 0.184161 Jul 26 14:03:44.144300 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 87/208] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:43 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:44.154898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-82fbf9e7-c446-44b5-b9b0-a784d4bbee33 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:44.154898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-82fbf9e7-c446-44b5-b9b0-a784d4bbee33 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:44.159179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82fbf9e7-c446-44b5-b9b0-a784d4bbee33 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.160031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82fbf9e7-c446-44b5-b9b0-a784d4bbee33 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.161086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82fbf9e7-c446-44b5-b9b0-a784d4bbee33 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.161546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82fbf9e7-c446-44b5-b9b0-a784d4bbee33 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.225497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e49d69a4-8d98-4e7e-83b1-0f3624956ada tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:44.241372 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e49d69a4-8d98-4e7e-83b1-0f3624956ada tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1462 microversion: 2.1 time: 0.346842 Jul 26 14:03:44.242844 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 122/209] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:43 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1462 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:44.254189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f5b4784-b0af-4aae-a02b-2caf5c2b2800 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-924289221"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:44.258265 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:44.258265 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:44.259430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-3f5b4784-b0af-4aae-a02b-2caf5c2b2800 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Generated uuid 584c7aa6-88b7-4dbd-a3ef-29926bc6bd66 for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:44.285943 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f5b4784-b0af-4aae-a02b-2caf5c2b2800 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.040494 Jul 26 14:03:44.288244 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 123/210] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:44 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:44.293414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-59238a0e-9cf5-4066-ba39-a53847990269 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Calling method '.version_select at 0x7f8794d99040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:44.294718 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:44.294718 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:44.296472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59238a0e-9cf5-4066-ba39-a53847990269 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.297185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59238a0e-9cf5-4066-ba39-a53847990269 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.324951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59238a0e-9cf5-4066-ba39-a53847990269 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.327562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59238a0e-9cf5-4066-ba39-a53847990269 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.410625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-82fbf9e7-c446-44b5-b9b0-a784d4bbee33 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:44.417916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59238a0e-9cf5-4066-ba39-a53847990269 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.418389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59238a0e-9cf5-4066-ba39-a53847990269 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.440613 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-82fbf9e7-c446-44b5-b9b0-a784d4bbee33 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1467 microversion: 2.1 time: 0.302227 Jul 26 14:03:44.440613 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 88/211] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:44 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1467 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:44.444659 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-59238a0e-9cf5-4066-ba39-a53847990269 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h1-833090-9/servers" status: 200 len: 196 microversion: 2.1 time: 0.154900 Jul 26 14:03:44.445249 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 124/212] 10.222.0.70 () {58 vars in 1212 bytes} [Tue Jul 26 14:03:44 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-9/servers => generated 196 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:44.449861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-60dbfd13-17f7-424e-ab65-61370d922d4a tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-9"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:44.452633 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:44.452633 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:44.476297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60dbfd13-17f7-424e-ab65-61370d922d4a tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.477115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60dbfd13-17f7-424e-ab65-61370d922d4a tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.734053 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-60dbfd13-17f7-424e-ab65-61370d922d4a tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.287550 Jul 26 14:03:44.736759 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 125/213] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:44 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:44.825669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-91839295-c4d1-4c36-b277-56f22f76993a tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Calling method '.version_select at 0x7f8794b04b80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:44.904826 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-91839295-c4d1-4c36-b277-56f22f76993a tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/19bfdb86657a477a842b0602788398c3" status: 200 len: 371 microversion: 2.1 time: 0.166530 Jul 26 14:03:44.912687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c31c88ed-79d7-4c89-8462-2c88dd212895 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:44.913019 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 126/214] 10.222.0.70 () {58 vars in 1242 bytes} [Tue Jul 26 14:03:44 2022] GET /compute/v2.1/os-quota-sets/19bfdb86657a477a842b0602788398c3 => generated 371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:44.913904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c31c88ed-79d7-4c89-8462-2c88dd212895 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:44.918652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e90f7476-0baf-4086-b854-d328edbb6a4f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Calling method '.version_select at 0x7f8794aac1f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:44.919106 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:44.919106 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:44.920310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e90f7476-0baf-4086-b854-d328edbb6a4f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.920763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e90f7476-0baf-4086-b854-d328edbb6a4f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.923854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c31c88ed-79d7-4c89-8462-2c88dd212895 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.924765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c31c88ed-79d7-4c89-8462-2c88dd212895 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.927150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c31c88ed-79d7-4c89-8462-2c88dd212895 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.928394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c31c88ed-79d7-4c89-8462-2c88dd212895 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.936768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e90f7476-0baf-4086-b854-d328edbb6a4f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.937231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e90f7476-0baf-4086-b854-d328edbb6a4f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.966881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e90f7476-0baf-4086-b854-d328edbb6a4f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:44.967351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e90f7476-0baf-4086-b854-d328edbb6a4f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:44.975914 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e90f7476-0baf-4086-b854-d328edbb6a4f tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061581 Jul 26 14:03:44.981700 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 127/215] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:03:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:44.988313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-153885134", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:45.057299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:03:45.409064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:03:45.409539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:03:45.410010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:03:45.410388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:03:45.411041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:03:45.422553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:45.423348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:45.424500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:45.425423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:45.449748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Getting quotas for project 4d886dd6f815451886f280083ad22868. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:03:45.456123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:45.458432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Getting quotas for user 20efe46c2a984870a7fcc18ba702be15 and project 4d886dd6f815451886f280083ad22868. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:03:45.480483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:03:45.483995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:03:45.557375 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-00931e7f-3cfe-43ea-800e-0a89c86f4b87 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578938 Jul 26 14:03:45.558440 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 128/216] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:03:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:03:45.564279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-98a34747-383a-48cc-bafb-d661b8347357 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:45.565396 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:45.565396 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:45.576346 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-98a34747-383a-48cc-bafb-d661b8347357 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.016137 Jul 26 14:03:45.577866 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 129/217] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:03:45 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:45.583209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1c81ec41-240f-405b-9984-862f82b41ce1 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Action: 'update', calling method: .version_select at 0x7f8794b045e0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:45.628267 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c31c88ed-79d7-4c89-8462-2c88dd212895 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1613 microversion: 2.1 time: 1.174962 Jul 26 14:03:45.640187 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 89/218] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:44 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1613 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:45.640187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1abf1a52-93ec-4ff5-abb9-102447345e61 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Calling method '.version_select at 0x7f8794c06f70>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:45.640187 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:45.640187 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:45.640187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1abf1a52-93ec-4ff5-abb9-102447345e61 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:45.641810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1abf1a52-93ec-4ff5-abb9-102447345e61 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:45.669735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1abf1a52-93ec-4ff5-abb9-102447345e61 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:45.670301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1abf1a52-93ec-4ff5-abb9-102447345e61 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:45.677456 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1abf1a52-93ec-4ff5-abb9-102447345e61 tempest-HypervisorAdminUnderV252Test-524537496 tempest-HypervisorAdminUnderV252Test-524537496-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h1-833090-9/search" status: 200 len: 104 microversion: 2.1 time: 0.047248 Jul 26 14:03:45.679541 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 90/219] 10.222.0.70 () {58 vars in 1209 bytes} [Tue Jul 26 14:03:45 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-9/search => generated 104 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:45.685612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4005590c-3567-434c-b794-5865d40b1a6d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:45.686557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4005590c-3567-434c-b794-5865d40b1a6d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:45.696355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4005590c-3567-434c-b794-5865d40b1a6d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:45.696945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4005590c-3567-434c-b794-5865d40b1a6d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:45.697837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4005590c-3567-434c-b794-5865d40b1a6d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:45.698380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4005590c-3567-434c-b794-5865d40b1a6d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:45.703527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c81ec41-240f-405b-9984-862f82b41ce1 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:45.704298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c81ec41-240f-405b-9984-862f82b41ce1 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:45.706317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c81ec41-240f-405b-9984-862f82b41ce1 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:45.707553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c81ec41-240f-405b-9984-862f82b41ce1 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:45.794322 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1c81ec41-240f-405b-9984-862f82b41ce1 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/19bfdb86657a477a842b0602788398c3" status: 200 len: 328 microversion: 2.1 time: 0.214869 Jul 26 14:03:45.801769 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 130/220] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:03:45 2022] PUT /compute/v2.1/os-quota-sets/19bfdb86657a477a842b0602788398c3 => generated 328 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:45.807871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a93be514-fa34-4f0a-9840-9b3e54364c00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:45.808534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a93be514-fa34-4f0a-9840-9b3e54364c00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:46.036100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a93be514-fa34-4f0a-9840-9b3e54364c00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:46.061657 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a93be514-fa34-4f0a-9840-9b3e54364c00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1218 microversion: 2.1 time: 0.257923 Jul 26 14:03:46.081831 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 131/221] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:45 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1218 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:46.103251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3e5ea35b-cd7d-46bd-9e9b-422f384a0ba9 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-9"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:46.109075 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:46.109075 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:46.124278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e5ea35b-cd7d-46bd-9e9b-422f384a0ba9 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:46.125030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e5ea35b-cd7d-46bd-9e9b-422f384a0ba9 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:46.167516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4005590c-3567-434c-b794-5865d40b1a6d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:46.214739 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4005590c-3567-434c-b794-5865d40b1a6d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1391 microversion: 2.1 time: 0.533494 Jul 26 14:03:46.237931 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 91/222] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:45 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1391 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:46.260956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b64f239c-045e-49ec-af8e-131fb143ce32 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:46.261956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b64f239c-045e-49ec-af8e-131fb143ce32 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:46.276237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b64f239c-045e-49ec-af8e-131fb143ce32 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:46.277232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b64f239c-045e-49ec-af8e-131fb143ce32 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:46.279634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b64f239c-045e-49ec-af8e-131fb143ce32 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:46.280281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b64f239c-045e-49ec-af8e-131fb143ce32 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:46.384371 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3e5ea35b-cd7d-46bd-9e9b-422f384a0ba9 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.300202 Jul 26 14:03:46.388049 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 132/223] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:46 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:46.401739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b59e13f3-65e1-46c9-aa92-69bfb0e1ff3a tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:46.436507 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b59e13f3-65e1-46c9-aa92-69bfb0e1ff3a tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-quota-sets/19bfdb86657a477a842b0602788398c3" status: 202 len: 0 microversion: 2.1 time: 0.044343 Jul 26 14:03:46.437240 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 133/224] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:03:46 2022] DELETE /compute/v2.1/os-quota-sets/19bfdb86657a477a842b0602788398c3 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:03:46.441687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0333e9e4-7254-4a0b-a873-ccbb1e247219 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:46.442448 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:46.442448 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:46.466075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b64f239c-045e-49ec-af8e-131fb143ce32 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1fc3b9ab00b44314a7949a031f3327e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859c66e51f1744549f7147e367a179dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:46.467263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b64f239c-045e-49ec-af8e-131fb143ce32 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] flavor_id is None. Assuming migration. {{(pid=119478) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 14:03:46.468657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b64f239c-045e-49ec-af8e-131fb143ce32 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119478) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 14:03:46.500923 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0333e9e4-7254-4a0b-a873-ccbb1e247219 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.062259 Jul 26 14:03:46.501924 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 134/225] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:46 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:46.527564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-076a55e6-7ac3-4b6c-882d-b19927adfa3d tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Calling method '.version_select at 0x7f8794b04c10>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:47.063273 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-076a55e6-7ac3-4b6c-882d-b19927adfa3d tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/19bfdb86657a477a842b0602788398c3" status: 200 len: 371 microversion: 2.1 time: 0.559889 Jul 26 14:03:47.065230 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 135/226] 10.222.0.70 () {58 vars in 1242 bytes} [Tue Jul 26 14:03:46 2022] GET /compute/v2.1/os-quota-sets/19bfdb86657a477a842b0602788398c3 => generated 371 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:47.085940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5e8370de-6269-448c-ab9c-f8f537f11c71 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-904349350"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:47.090366 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:47.090366 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:47.092404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-5e8370de-6269-448c-ab9c-f8f537f11c71 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Generated uuid ff0b3df3-f22f-4a9f-a85b-c49e0007b9ab for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:47.140892 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5e8370de-6269-448c-ab9c-f8f537f11c71 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.061204 Jul 26 14:03:47.155081 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 136/227] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:47 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:47.169153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f93a5163-4fed-4625-a79a-f1076315d0a1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:47.172318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f93a5163-4fed-4625-a79a-f1076315d0a1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:47.192118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f93a5163-4fed-4625-a79a-f1076315d0a1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:47.194377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f93a5163-4fed-4625-a79a-f1076315d0a1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:47.196948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f93a5163-4fed-4625-a79a-f1076315d0a1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:47.198373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f93a5163-4fed-4625-a79a-f1076315d0a1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:47.338860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f93a5163-4fed-4625-a79a-f1076315d0a1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:47.342207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:47.358162 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f93a5163-4fed-4625-a79a-f1076315d0a1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1214 microversion: 2.1 time: 0.200499 Jul 26 14:03:47.359566 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 137/228] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:47 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:47.367493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8a240e58-f1df-49e4-85b9-b1ac735e2c2f tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-9"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:47.371790 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:47.371790 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:47.385523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8a240e58-f1df-49e4-85b9-b1ac735e2c2f tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:47.386292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8a240e58-f1df-49e4-85b9-b1ac735e2c2f tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:47.422701 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b64f239c-045e-49ec-af8e-131fb143ce32 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3/action" status: 202 len: 0 microversion: 2.1 time: 1.182796 Jul 26 14:03:47.425601 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 92/229] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:03:46 2022] POST /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3/action => generated 0 bytes in 1187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:03:47.434670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b3297198-5b08-49db-8980-cf1442e9fc45 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:47.435643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b3297198-5b08-49db-8980-cf1442e9fc45 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:47.446464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3297198-5b08-49db-8980-cf1442e9fc45 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:47.448377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3297198-5b08-49db-8980-cf1442e9fc45 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:47.449957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3297198-5b08-49db-8980-cf1442e9fc45 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:47.450980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3297198-5b08-49db-8980-cf1442e9fc45 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:47.670013 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8a240e58-f1df-49e4-85b9-b1ac735e2c2f tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.308189 Jul 26 14:03:47.681691 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 138/230] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:47 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:47.699921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7cab0a80-cf35-4bff-86dd-ffbeae66a11c tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Calling method '.version_select at 0x7f8794acb790>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:47.708036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b3297198-5b08-49db-8980-cf1442e9fc45 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:47.720663 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b3297198-5b08-49db-8980-cf1442e9fc45 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1391 microversion: 2.1 time: 0.292357 Jul 26 14:03:47.721840 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 93/231] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:47 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1391 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:47.727963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b657ead6-a8d1-4c34-9bc4-f0366de6c8e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:47.728838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b657ead6-a8d1-4c34-9bc4-f0366de6c8e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:47.739125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b657ead6-a8d1-4c34-9bc4-f0366de6c8e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:47.740169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b657ead6-a8d1-4c34-9bc4-f0366de6c8e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:47.742496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b657ead6-a8d1-4c34-9bc4-f0366de6c8e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:47.743116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b657ead6-a8d1-4c34-9bc4-f0366de6c8e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:48.437339 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7cab0a80-cf35-4bff-86dd-ffbeae66a11c tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/cf5b8095d6284c42ab2afca4cb5cf005/defaults" status: 200 len: 371 microversion: 2.1 time: 0.746364 Jul 26 14:03:48.439261 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 139/232] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:03:47 2022] GET /compute/v2.1/os-quota-sets/cf5b8095d6284c42ab2afca4cb5cf005/defaults => generated 371 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:48.446647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b657ead6-a8d1-4c34-9bc4-f0366de6c8e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:48.451137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b349ab9e-3501-47d3-b270-f157d13f6944 req-47c6e8fa-bc44-4cb8-ae75-37f2b1f00a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae", "tag": "04498d04-b08b-4461-aadb-a16fe8c57ea4"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:48.470485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b349ab9e-3501-47d3-b270-f157d13f6944 req-47c6e8fa-bc44-4cb8-ae75-37f2b1f00a9c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:48.471535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b349ab9e-3501-47d3-b270-f157d13f6944 req-47c6e8fa-bc44-4cb8-ae75-37f2b1f00a9c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:48.472361 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b657ead6-a8d1-4c34-9bc4-f0366de6c8e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1471 microversion: 2.1 time: 0.747191 Jul 26 14:03:48.480376 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 94/233] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:47 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1471 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:48.491595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1155d800-c8e8-4ca8-b936-1844f8bc3232 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-9"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:48.495245 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b349ab9e-3501-47d3-b270-f157d13f6944 req-47c6e8fa-bc44-4cb8-ae75-37f2b1f00a9c service nova] Creating event network-changed:04498d04-b08b-4461-aadb-a16fe8c57ea4 for instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae on n-h1-833090-9 Jul 26 14:03:48.503593 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b349ab9e-3501-47d3-b270-f157d13f6944 req-47c6e8fa-bc44-4cb8-ae75-37f2b1f00a9c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062127 Jul 26 14:03:48.505153 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 140/234] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:48.509374 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:48.509374 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:48.515218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cc730348-2e7c-4b0c-a07f-1a22d60e9a32 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:48.516769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cc730348-2e7c-4b0c-a07f-1a22d60e9a32 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:48.529794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc730348-2e7c-4b0c-a07f-1a22d60e9a32 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:48.531175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc730348-2e7c-4b0c-a07f-1a22d60e9a32 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:48.532616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc730348-2e7c-4b0c-a07f-1a22d60e9a32 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:48.533452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc730348-2e7c-4b0c-a07f-1a22d60e9a32 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:48.549569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1155d800-c8e8-4ca8-b936-1844f8bc3232 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:48.556626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1155d800-c8e8-4ca8-b936-1844f8bc3232 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:48.719256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cc730348-2e7c-4b0c-a07f-1a22d60e9a32 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:48.759152 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cc730348-2e7c-4b0c-a07f-1a22d60e9a32 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1276 microversion: 2.1 time: 0.228039 Jul 26 14:03:48.761483 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 141/235] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:48 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1276 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:48.790078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0f12bc02-7a38-4b05-bae5-ff73a38fbc19 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:48.791201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0f12bc02-7a38-4b05-bae5-ff73a38fbc19 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:48.810178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f12bc02-7a38-4b05-bae5-ff73a38fbc19 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:48.810969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f12bc02-7a38-4b05-bae5-ff73a38fbc19 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:48.812359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f12bc02-7a38-4b05-bae5-ff73a38fbc19 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:48.813134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f12bc02-7a38-4b05-bae5-ff73a38fbc19 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:48.885643 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1155d800-c8e8-4ca8-b936-1844f8bc3232 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.402457 Jul 26 14:03:48.892913 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 95/236] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:48 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:48.907308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d63f086-4dc0-4ace-883d-466da1748ad6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:48.914314 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:48.914314 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:48.994207 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d63f086-4dc0-4ace-883d-466da1748ad6 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.095815 Jul 26 14:03:48.994797 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 96/237] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:48 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:49.015903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de18e837-44f0-4438-82a9-e8aa655e69d3 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-478290733"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:49.018917 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:49.018917 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:49.019927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.aggregate [None req-de18e837-44f0-4438-82a9-e8aa655e69d3 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Generated uuid ff40f226-e9bd-4c16-ba8a-24c30ed9f1a5 for aggregate {{(pid=119478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:49.075339 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-de18e837-44f0-4438-82a9-e8aa655e69d3 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.070493 Jul 26 14:03:49.080922 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 97/238] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:49.098408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1ac9a612-4951-4136-a5dc-b7b55d4b8553 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-86692564"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:49.102703 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:49.102703 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:49.104419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.aggregate [None req-1ac9a612-4951-4136-a5dc-b7b55d4b8553 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Generated uuid d6706700-cca9-4d07-bb94-211ad3c333d5 for aggregate {{(pid=119478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:49.152064 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1ac9a612-4951-4136-a5dc-b7b55d4b8553 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.068679 Jul 26 14:03:49.152992 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 98/239] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:49 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:49.177237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cead60f1-6814-45ff-affa-d3fd4d43bbb2 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Action: 'update', calling method: .version_select at 0x7f87949edaf0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:49.315838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0f12bc02-7a38-4b05-bae5-ff73a38fbc19 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:49.325918 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0f12bc02-7a38-4b05-bae5-ff73a38fbc19 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1391 microversion: 2.1 time: 0.562939 Jul 26 14:03:49.339977 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 142/240] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:48 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1391 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:49.339977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2c48bc71-f919-4082-b4c0-f58dbee2baec tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:49.339977 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:49.339977 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:49.397476 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2c48bc71-f919-4082-b4c0-f58dbee2baec tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.068257 Jul 26 14:03:49.401979 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 143/241] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:49 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:49.417069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bc0984d6-588c-429b-92fd-bce12aa54354 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-9"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:49.420022 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:49.420022 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:49.436768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc0984d6-588c-429b-92fd-bce12aa54354 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:49.437519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc0984d6-588c-429b-92fd-bce12aa54354 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:49.463487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cead60f1-6814-45ff-affa-d3fd4d43bbb2 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:49.464974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cead60f1-6814-45ff-affa-d3fd4d43bbb2 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:49.466438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cead60f1-6814-45ff-affa-d3fd4d43bbb2 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:49.467107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cead60f1-6814-45ff-affa-d3fd4d43bbb2 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:49.611178 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cead60f1-6814-45ff-affa-d3fd4d43bbb2 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/6dbf52e767ea4ff088b587507039e131" status: 200 len: 328 microversion: 2.1 time: 0.448952 Jul 26 14:03:49.612923 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 99/242] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:03:49 2022] PUT /compute/v2.1/os-quota-sets/6dbf52e767ea4ff088b587507039e131 => generated 328 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:49.628686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e9c955a-5b85-42ae-bcd5-cf0f2e86e5ec tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:49.632455 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:49.632455 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:49.646184 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-2e9c955a-5b85-42ae-bcd5-cf0f2e86e5ec tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e9c955a-5b85-42ae-bcd5-cf0f2e86e5ec tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Request method failure captured: Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QQWni9OsmoFgI8sWLg6jcB_0_BAnUCAx4lrPJI7G-9F7a7-53LTMfGYBjj1xPHyuXSji84AjkY6pPYByA7vwPoBu_cp6nMPZXqbigjqx3LeP69EP9JIUEXwdaMoD0ZpGAGGRP_51My4Zp9Kyk-DKOTuND7aO6pJuG3xwtuQViluQ8 Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: c2ffe4aa1952406b87d9c09910b50ee8 Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:03:49.652863 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2ffe4aa1952406b87d9c09910b50ee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c2ffe4aa1952406b87d9c09910b50ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c2ffe4aa1952406b87d9c09910b50ee8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2ffe4aa1952406b87d9c09910b50ee8"}]}] Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: c2ffe4aa1952406b87d9c09910b50ee8 Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AggregatesAdminTestJSON-1854026711-project-admin Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 48715b6c4e97452ab5560acab2855324 Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AggregatesAdminTestJSON-1854026711-project-admin Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: exception: Aggregate 5 could not be found. Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '5'} Jul 26 14:03:49.655224 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:49.656585 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 26 14:03:49.658599 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:49.661775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e9c955a-5b85-42ae-bcd5-cf0f2e86e5ec tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:49.661775 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e9c955a-5b85-42ae-bcd5-cf0f2e86e5ec tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.041434 Jul 26 14:03:49.661775 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 100/243] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Jul 26 14:03:49 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:03:49.703449 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bc0984d6-588c-429b-92fd-bce12aa54354 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 240 microversion: 2.1 time: 0.299944 Jul 26 14:03:49.704379 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 144/244] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:49 2022] POST /compute/v2.1/os-aggregates/6/action => generated 240 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:49.708880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74ff935f-2aa5-495c-83f8-40fe9336b477 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Calling method '.version_select at 0x7f8794b04700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:49.716597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bc7ab29a-787f-486b-a961-3ebae746bfa0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:49.720062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bc7ab29a-787f-486b-a961-3ebae746bfa0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:49.734082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc7ab29a-787f-486b-a961-3ebae746bfa0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:49.734546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc7ab29a-787f-486b-a961-3ebae746bfa0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:49.735444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc7ab29a-787f-486b-a961-3ebae746bfa0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:49.735773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc7ab29a-787f-486b-a961-3ebae746bfa0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:49.908854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74ff935f-2aa5-495c-83f8-40fe9336b477 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:49.910661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74ff935f-2aa5-495c-83f8-40fe9336b477 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:49.911643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74ff935f-2aa5-495c-83f8-40fe9336b477 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:49.915396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74ff935f-2aa5-495c-83f8-40fe9336b477 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:49.998005 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-74ff935f-2aa5-495c-83f8-40fe9336b477 tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/6dbf52e767ea4ff088b587507039e131/detail" status: 200 len: 916 microversion: 2.1 time: 0.288996 Jul 26 14:03:49.999044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 145/245] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:03:49 2022] GET /compute/v2.1/os-quota-sets/6dbf52e767ea4ff088b587507039e131/detail => generated 916 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:50.005530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3ea4b468-4cb7-4f77-9492-03420e6a5bbb tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:50.007344 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:50.007344 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:50.025974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bc7ab29a-787f-486b-a961-3ebae746bfa0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:50.030571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:50.041808 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bc7ab29a-787f-486b-a961-3ebae746bfa0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1471 microversion: 2.1 time: 0.380227 Jul 26 14:03:50.056978 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-3ea4b468-4cb7-4f77-9492-03420e6a5bbb tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 26 14:03:50.061884 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 101/246] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:49 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1471 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3ea4b468-4cb7-4f77-9492-03420e6a5bbb tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Request method failure captured: Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QQWni9OsmoFgI8sWLg6jcB_0_BAnUCAx4lrPJI7G-9F7a7-53LTMfGYBjj1xPHyuXSji84AjkY6pPYByA7vwPoBu_cp6nMPZXqbigjqx3LeP69EP9JIUEXwdaMoD0ZpGAGGRP_51My4Zp9Kyk-DKOTuND7aO6pJuG3xwtuQViluQ8 Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c2ffe4aa1952406b87d9c09910b50ee8 Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:03:50.066647 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2ffe4aa1952406b87d9c09910b50ee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c2ffe4aa1952406b87d9c09910b50ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c2ffe4aa1952406b87d9c09910b50ee8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2ffe4aa1952406b87d9c09910b50ee8"}]}] Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c2ffe4aa1952406b87d9c09910b50ee8 Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminTestJSON-1854026711-project-admin Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 48715b6c4e97452ab5560acab2855324 Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminTestJSON-1854026711-project-admin Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: exception: Aggregate 5 could not be found. Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '5'} Jul 26 14:03:50.068126 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:03:50.070057 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:50.071252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:50.072745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:50.072745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:50.072745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:50.072745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 26 14:03:50.072745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.075602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93ab4384-ca39-4372-a9eb-809dd024a08b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-9"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:50.077792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3ea4b468-4cb7-4f77-9492-03420e6a5bbb tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:50.078922 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3ea4b468-4cb7-4f77-9492-03420e6a5bbb tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.077854 Jul 26 14:03:50.096690 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:50.096690 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:50.098118 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 146/247] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:50 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:03:50.105747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:50.119010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dfe48ce4-eac5-437f-a6ec-c0b67abd5a47 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:50.121549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dfe48ce4-eac5-437f-a6ec-c0b67abd5a47 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:50.126049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93ab4384-ca39-4372-a9eb-809dd024a08b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:50.127015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93ab4384-ca39-4372-a9eb-809dd024a08b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:50.131865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfe48ce4-eac5-437f-a6ec-c0b67abd5a47 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:50.132642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfe48ce4-eac5-437f-a6ec-c0b67abd5a47 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:50.133813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfe48ce4-eac5-437f-a6ec-c0b67abd5a47 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:50.134761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfe48ce4-eac5-437f-a6ec-c0b67abd5a47 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:50.205656 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-93ab4384-ca39-4372-a9eb-809dd024a08b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h1-833090-9. Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93ab4384-ca39-4372-a9eb-809dd024a08b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Request method failure captured: Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 39 Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QRygsY8jPSoQFdKmEshr4tyg_vWVHcDfJPbbbcc9vUw5h5cmB1WOp3FzFN-a_lk3UzzMiUdb90-_21oirmiQCS4EQiKmPZGGNlMoo3KyDGz_GSUcFH3Kpl_fwD5QptJlzn3QCRSU9vPXc8jVvvg3JX7dzquk3Sl0zwMRXVeiCj2_E Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:03:50.238254 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c762053428a54306b2b3cbf464bb91d0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}] Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 57fbea839c454b298f8b03aa82227836 Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: {"add_host": {"host": "n-h1-833090-9"}} Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:03:50.239711 n-d-833090-9 devstack@n-api.service[119478]: exception: Aggregate 6 already has host n-h1-833090-9. Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h1-833090-9'}}} Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result.read() Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:03:50.241195 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-833090-9-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi session.flush() Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:03:50.242445 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:03:50.244215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:03:50.245699 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result.read() Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-833090-9-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 26, 14, 3, 50, 187558), 'updated_at': None, 'host': 'n-h1-833090-9', 'aggregate_id': 6}] Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:50.247070 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h1-833090-9. Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.249165 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h1-833090-9. Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:50.250884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:50.257328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h1-833090-9. Jul 26 14:03:50.257328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:50.257328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93ab4384-ca39-4372-a9eb-809dd024a08b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Returning 409 to user: Aggregate 6 already has host n-h1-833090-9. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:50.257328 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-93ab4384-ca39-4372-a9eb-809dd024a08b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.186921 Jul 26 14:03:50.257328 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 102/248] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:50 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 192 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 26 14:03:50.261526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-188e10f2-d5fd-488b-b2da-7ba24d5919a3 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-166945528", "name": "tempest-test_aggregate-1318401782"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:50.308429 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:50.308429 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:50.311009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.aggregate [None req-188e10f2-d5fd-488b-b2da-7ba24d5919a3 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Generated uuid cb6c9201-5b7b-4fd2-8b13-c0d78dda7068 for aggregate {{(pid=119478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:50.378971 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-188e10f2-d5fd-488b-b2da-7ba24d5919a3 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.121827 Jul 26 14:03:50.380248 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 103/249] 10.222.0.70 () {60 vars in 1165 bytes} [Tue Jul 26 14:03:50 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:50.394685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-140df956-2c7d-48c7-abd6-d4fe2473ecf4 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-9"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:50.406753 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:50.406753 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:50.423336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-140df956-2c7d-48c7-abd6-d4fe2473ecf4 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:50.423900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-140df956-2c7d-48c7-abd6-d4fe2473ecf4 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:50.594466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dfe48ce4-eac5-437f-a6ec-c0b67abd5a47 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:50.614620 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dfe48ce4-eac5-437f-a6ec-c0b67abd5a47 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1318 microversion: 2.1 time: 0.504441 Jul 26 14:03:50.616565 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 147/250] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:50 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:50.629697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-797d6727-7d45-4384-a1fa-947719da5da5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:50.635238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-797d6727-7d45-4384-a1fa-947719da5da5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:50.643674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-797d6727-7d45-4384-a1fa-947719da5da5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:50.644550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-797d6727-7d45-4384-a1fa-947719da5da5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:50.645981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-797d6727-7d45-4384-a1fa-947719da5da5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:50.647904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-797d6727-7d45-4384-a1fa-947719da5da5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:50.662964 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-140df956-2c7d-48c7-abd6-d4fe2473ecf4 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 225 microversion: 2.1 time: 0.278365 Jul 26 14:03:50.664706 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 104/251] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:50 2022] POST /compute/v2.1/os-aggregates/6/action => generated 225 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:50.676132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4c57b00c-372b-459f-bafd-d1cdbe4c2549 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:50.677346 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:50.677346 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:50.718324 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4c57b00c-372b-459f-bafd-d1cdbe4c2549 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.051796 Jul 26 14:03:50.721927 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 105/252] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:50 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:50.729303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4dd4aae2-c0c4-4359-86a4-7535e5c28dfa tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Action: 'update', calling method: .version_select at 0x7f8794f288b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:50.992920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-797d6727-7d45-4384-a1fa-947719da5da5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:51.001223 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-797d6727-7d45-4384-a1fa-947719da5da5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1391 microversion: 2.1 time: 0.383050 Jul 26 14:03:51.015629 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 148/253] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:50 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1391 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:51.021121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-40c39ded-8ba0-4018-88fd-b3169701a67f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:51.022660 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:51.022660 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:51.058820 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-40c39ded-8ba0-4018-88fd-b3169701a67f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.040429 Jul 26 14:03:51.060896 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 149/254] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:51 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:51.074408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d47c34b-213b-4597-a5dc-f2b42c5106fd tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:51.075512 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:51.075512 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:51.082642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:51.094833 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-0d47c34b-213b-4597-a5dc-f2b42c5106fd tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d47c34b-213b-4597-a5dc-f2b42c5106fd tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Request method failure captured: Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QQWni9OsmoFgI8sWLg6jcB_0_BAnUCAx4lrPJI7G-9F7a7-53LTMfGYBjj1xPHyuXSji84AjkY6pPYByA7vwPoBu_cp6nMPZXqbigjqx3LeP69EP9JIUEXwdaMoD0ZpGAGGRP_51My4Zp9Kyk-DKOTuND7aO6pJuG3xwtuQViluQ8 Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c2ffe4aa1952406b87d9c09910b50ee8 Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:03:51.096437 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2ffe4aa1952406b87d9c09910b50ee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c2ffe4aa1952406b87d9c09910b50ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c2ffe4aa1952406b87d9c09910b50ee8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2ffe4aa1952406b87d9c09910b50ee8"}]}] Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c2ffe4aa1952406b87d9c09910b50ee8 Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminTestJSON-1854026711-project-admin Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 48715b6c4e97452ab5560acab2855324 Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminTestJSON-1854026711-project-admin Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: exception: Aggregate 7 could not be found. Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '7'} Jul 26 14:03:51.097761 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:51.098499 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 26 14:03:51.099503 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.102029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d47c34b-213b-4597-a5dc-f2b42c5106fd tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:51.102029 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0d47c34b-213b-4597-a5dc-f2b42c5106fd tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.036098 Jul 26 14:03:51.104928 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 150/255] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Jul 26 14:03:51 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:03:51.112959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9e46337b-25f0-4f05-8f4c-f5717156cc30 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1894078210"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:51.120596 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:51.120596 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:51.122396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-9e46337b-25f0-4f05-8f4c-f5717156cc30 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Generated uuid 83530a9a-6d77-403d-b77e-045ab0e3bbaa for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:51.163912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dd4aae2-c0c4-4359-86a4-7535e5c28dfa tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:51.164462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dd4aae2-c0c4-4359-86a4-7535e5c28dfa tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:51.165608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dd4aae2-c0c4-4359-86a4-7535e5c28dfa tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:51.166096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dd4aae2-c0c4-4359-86a4-7535e5c28dfa tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:51.179382 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9e46337b-25f0-4f05-8f4c-f5717156cc30 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071860 Jul 26 14:03:51.181453 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 151/256] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:51.187531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-098accd4-553a-40d3-8656-43c82b5a3d8a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:51.189339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-098accd4-553a-40d3-8656-43c82b5a3d8a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:51.203589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-098accd4-553a-40d3-8656-43c82b5a3d8a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:51.205270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-098accd4-553a-40d3-8656-43c82b5a3d8a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:51.207924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-098accd4-553a-40d3-8656-43c82b5a3d8a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:51.208729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-098accd4-553a-40d3-8656-43c82b5a3d8a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:51.286348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dd4aae2-c0c4-4359-86a4-7535e5c28dfa tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:51.286348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dd4aae2-c0c4-4359-86a4-7535e5c28dfa tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:51.287129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dd4aae2-c0c4-4359-86a4-7535e5c28dfa tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:51.287640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dd4aae2-c0c4-4359-86a4-7535e5c28dfa tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:51.404517 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4dd4aae2-c0c4-4359-86a4-7535e5c28dfa tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/6dbf52e767ea4ff088b587507039e131?user_id=fdc7698e6471488b927076da96fef2db" status: 200 len: 328 microversion: 2.1 time: 0.681185 Jul 26 14:03:51.405479 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 106/257] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:03:50 2022] PUT /compute/v2.1/os-quota-sets/6dbf52e767ea4ff088b587507039e131?user_id=fdc7698e6471488b927076da96fef2db => generated 328 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:51.411176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f12542e6-be5d-4c50-959d-c55c6d01d2ae tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-963604230"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:51.415679 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:51.415679 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:51.416822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.aggregate [None req-f12542e6-be5d-4c50-959d-c55c6d01d2ae tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Generated uuid 25e87b4e-e925-4c82-9f0b-f0cd66aac47a for aggregate {{(pid=119478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:51.453405 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f12542e6-be5d-4c50-959d-c55c6d01d2ae tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.046831 Jul 26 14:03:51.462824 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 107/258] 10.222.0.70 () {62 vars in 1205 bytes} [Tue Jul 26 14:03:51 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:03:51.468583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32461a45-3df1-4cd2-b06b-13b909f1ac4e tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:51.470339 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:51.470339 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:51.483047 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-32461a45-3df1-4cd2-b06b-13b909f1ac4e tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32461a45-3df1-4cd2-b06b-13b909f1ac4e tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Request method failure captured: Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QQWni9OsmoFgI8sWLg6jcB_0_BAnUCAx4lrPJI7G-9F7a7-53LTMfGYBjj1xPHyuXSji84AjkY6pPYByA7vwPoBu_cp6nMPZXqbigjqx3LeP69EP9JIUEXwdaMoD0ZpGAGGRP_51My4Zp9Kyk-DKOTuND7aO6pJuG3xwtuQViluQ8 Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: c2ffe4aa1952406b87d9c09910b50ee8 Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:03:51.484928 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2ffe4aa1952406b87d9c09910b50ee8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c2ffe4aa1952406b87d9c09910b50ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c2ffe4aa1952406b87d9c09910b50ee8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2ffe4aa1952406b87d9c09910b50ee8"}]}] Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: c2ffe4aa1952406b87d9c09910b50ee8 Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1854026711 Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AggregatesAdminTestJSON-1854026711-project-admin Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 48715b6c4e97452ab5560acab2855324 Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AggregatesAdminTestJSON-1854026711-project-admin Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: exception: Aggregate 7 could not be found. Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '7'} Jul 26 14:03:51.487255 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:03:51.488665 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:51.490623 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:51.499776 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:51.499776 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:51.499776 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:51.499776 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 26 14:03:51.499776 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.499776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32461a45-3df1-4cd2-b06b-13b909f1ac4e tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:51.499776 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32461a45-3df1-4cd2-b06b-13b909f1ac4e tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.022337 Jul 26 14:03:51.499776 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 108/259] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:51 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:03:51.602232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-098accd4-553a-40d3-8656-43c82b5a3d8a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:51.613419 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-098accd4-553a-40d3-8656-43c82b5a3d8a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1471 microversion: 2.1 time: 0.430009 Jul 26 14:03:51.615876 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 152/260] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:51 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1471 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:51.633803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6c797c05-6fbb-491a-93f6-df1b5905b24a tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Calling method '.version_select at 0x7f8794acd280>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:51.803779 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6c797c05-6fbb-491a-93f6-df1b5905b24a tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/6dbf52e767ea4ff088b587507039e131?user_id=fdc7698e6471488b927076da96fef2db" status: 200 len: 370 microversion: 2.1 time: 0.185504 Jul 26 14:03:51.804995 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 153/261] 10.222.0.70 () {58 vars in 1323 bytes} [Tue Jul 26 14:03:51 2022] GET /compute/v2.1/os-quota-sets/6dbf52e767ea4ff088b587507039e131?user_id=fdc7698e6471488b927076da96fef2db => generated 370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:51.810512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4be8deee-fb75-49de-8d63-b6d783e5d3cb tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-65267753"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:51.896337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-670b9e82-ff66-4017-a698-9c569c5d7f5f tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-9"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:51.900815 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:51.900815 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:51.902210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-670b9e82-ff66-4017-a698-9c569c5d7f5f tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '11f8088659654d1099c42f9a403d8c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a4fb049e54452fafa512f0af50c056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-670b9e82-ff66-4017-a698-9c569c5d7f5f tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Request method failure captured: Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 39 Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QObf2Y0jKJlpxgeGybQQH-ThA6toXJ--jNhMLTMTy4i9Kh7Kqn5SUXLa2BpcAPAklJjk4QbUgphsepCZ56PbChUzsCzXicY3YULIPQGbn7In759mSUn30_lhBXiQHdGPY4OAd0cGqcazQt4I7MFneJb5psVM_z2CsCAcaYvAFFZiA Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:03:51.907604 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33a4fb049e54452fafa512f0af50c056", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}] Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 11f8088659654d1099c42f9a403d8c8a Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: {"add_host": {"host": "n-h1-833090-9"}} Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:03:51.908914 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h1-833090-9'}}} Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:51.909660 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 26 14:03:51.910700 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:51.915235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-670b9e82-ff66-4017-a698-9c569c5d7f5f tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:51.919746 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-670b9e82-ff66-4017-a698-9c569c5d7f5f tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.429854 Jul 26 14:03:51.924526 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 109/262] 10.222.0.70 () {60 vars in 1191 bytes} [Tue Jul 26 14:03:51 2022] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 437 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:51.938174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0fbd65d6-cfd2-4969-9603-5d1783ba11ea tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-271677035"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:51.949525 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:51.949525 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:51.950818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.aggregate [None req-0fbd65d6-cfd2-4969-9603-5d1783ba11ea tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Generated uuid f80de206-df22-4175-bcec-00a3a9e8e4e2 for aggregate {{(pid=119478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:51.977876 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:51.977876 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:51.992980 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0fbd65d6-cfd2-4969-9603-5d1783ba11ea tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066582 Jul 26 14:03:52.000642 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 110/263] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:52.008625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d323dac0-9fe2-4ea5-891f-c076ce925cab tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:52.013159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d323dac0-9fe2-4ea5-891f-c076ce925cab tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:52.027435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d323dac0-9fe2-4ea5-891f-c076ce925cab tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:52.027886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d323dac0-9fe2-4ea5-891f-c076ce925cab tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:52.034524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d323dac0-9fe2-4ea5-891f-c076ce925cab tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:52.037948 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4be8deee-fb75-49de-8d63-b6d783e5d3cb tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 297 microversion: 2.41 time: 0.230860 Jul 26 14:03:52.039370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d323dac0-9fe2-4ea5-891f-c076ce925cab tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:52.041592 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 154/264] 10.222.0.70 () {62 vars in 1210 bytes} [Tue Jul 26 14:03:51 2022] PUT /compute/v2.1/os-aggregates/9 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:03:52.047623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-3b6883d3-db2e-40ae-be25-64dec16cdb6b req-e1e2b316-3b59-4a4a-9c5f-fecad39f29f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec88f45-f830-436b-8322-fddddf7c492a", "tag": "7da372b7-918b-4213-8ae7-b55c28349eb7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:52.060403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3b6883d3-db2e-40ae-be25-64dec16cdb6b req-e1e2b316-3b59-4a4a-9c5f-fecad39f29f0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:52.060972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3b6883d3-db2e-40ae-be25-64dec16cdb6b req-e1e2b316-3b59-4a4a-9c5f-fecad39f29f0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:52.081657 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-3b6883d3-db2e-40ae-be25-64dec16cdb6b req-e1e2b316-3b59-4a4a-9c5f-fecad39f29f0 service nova] Creating event network-changed:7da372b7-918b-4213-8ae7-b55c28349eb7 for instance 4ec88f45-f830-436b-8322-fddddf7c492a on n-h2-833090-9 Jul 26 14:03:52.100761 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-3b6883d3-db2e-40ae-be25-64dec16cdb6b req-e1e2b316-3b59-4a4a-9c5f-fecad39f29f0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057476 Jul 26 14:03:52.105003 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 155/265] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:52.112690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8f7fdac0-2b43-451c-807c-16fe870e9746 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:52.113821 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:52.113821 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:52.149404 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8f7fdac0-2b43-451c-807c-16fe870e9746 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.041911 Jul 26 14:03:52.153555 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 156/266] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:52 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:52.159785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-352af637-3c8f-4bd2-8e61-e55ed2d927db tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:52.161794 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:52.161794 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:52.174136 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-352af637-3c8f-4bd2-8e61-e55ed2d927db tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.019408 Jul 26 14:03:52.175034 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 157/267] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:52 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:52.188352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-01aab4b8-4167-422e-afdd-e531f8e33dbd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:52.203553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-01aab4b8-4167-422e-afdd-e531f8e33dbd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:52.216966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01aab4b8-4167-422e-afdd-e531f8e33dbd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:52.216966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01aab4b8-4167-422e-afdd-e531f8e33dbd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:52.224482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01aab4b8-4167-422e-afdd-e531f8e33dbd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:52.225352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01aab4b8-4167-422e-afdd-e531f8e33dbd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:52.759122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d323dac0-9fe2-4ea5-891f-c076ce925cab tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:52.767269 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d323dac0-9fe2-4ea5-891f-c076ce925cab tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1318 microversion: 2.1 time: 0.764946 Jul 26 14:03:52.767842 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 111/268] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:52 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1318 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:52.772960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3b2769e5-e20d-42eb-93cd-48e0485b05af tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:52.774020 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:52.774020 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:52.780838 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3b2769e5-e20d-42eb-93cd-48e0485b05af tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 297 microversion: 2.41 time: 0.011757 Jul 26 14:03:52.781931 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 112/269] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Jul 26 14:03:52 2022] GET /compute/v2.1/os-aggregates/9 => generated 297 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:03:52.786705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-42d7f399-302d-4e2c-a5ec-aceebcfcd0be tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2051935653"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:52.790514 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:52.790514 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:52.791431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.aggregate [None req-42d7f399-302d-4e2c-a5ec-aceebcfcd0be tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Generated uuid 353e68f4-a8b5-4378-b733-020cab19733d for aggregate {{(pid=119478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:52.815698 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-42d7f399-302d-4e2c-a5ec-aceebcfcd0be tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.032268 Jul 26 14:03:52.816989 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 113/270] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:52.822355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-878a6e23-d92c-4bdd-a7b3-8c6fb7e9d8d3 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:52.826032 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:52.826032 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:52.846708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-01aab4b8-4167-422e-afdd-e531f8e33dbd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:52.856753 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-01aab4b8-4167-422e-afdd-e531f8e33dbd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1391 microversion: 2.1 time: 0.680042 Jul 26 14:03:52.857310 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 158/271] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:52 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1391 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:52.864917 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-878a6e23-d92c-4bdd-a7b3-8c6fb7e9d8d3 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.045920 Jul 26 14:03:52.866625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6af5519a-f1ef-4550-9a4d-4e8b93fbe82b tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Calling method '.version_select at 0x7f8794d99af0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:52.868238 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 114/272] 10.222.0.70 () {60 vars in 1194 bytes} [Tue Jul 26 14:03:52 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:52.874550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-876ad117-4f6e-42d3-a811-c96d57d812e5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:52.875459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-876ad117-4f6e-42d3-a811-c96d57d812e5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:52.887989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-876ad117-4f6e-42d3-a811-c96d57d812e5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:52.888844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-876ad117-4f6e-42d3-a811-c96d57d812e5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:52.890608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-876ad117-4f6e-42d3-a811-c96d57d812e5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:52.891345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-876ad117-4f6e-42d3-a811-c96d57d812e5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:53.179996 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6af5519a-f1ef-4550-9a4d-4e8b93fbe82b tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/cf5b8095d6284c42ab2afca4cb5cf005/defaults" status: 200 len: 371 microversion: 2.1 time: 0.318383 Jul 26 14:03:53.188547 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 159/273] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:03:52 2022] GET /compute/v2.1/os-quota-sets/cf5b8095d6284c42ab2afca4cb5cf005/defaults => generated 371 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:53.194466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4a76529-b94d-4f7b-8d86-b57830662661 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-9"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:53.197629 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:53.197629 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:53.198650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-876ad117-4f6e-42d3-a811-c96d57d812e5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:53.208761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4a76529-b94d-4f7b-8d86-b57830662661 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:53.210448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4a76529-b94d-4f7b-8d86-b57830662661 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:53.217160 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-876ad117-4f6e-42d3-a811-c96d57d812e5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.347310 Jul 26 14:03:53.236324 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 115/274] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:52 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:53.262602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81c4e80f-5a76-48a8-ace2-98831cd887fc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-954442834"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:53.267175 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:53.267175 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:53.279536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81c4e80f-5a76-48a8-ace2-98831cd887fc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:53.280120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81c4e80f-5a76-48a8-ace2-98831cd887fc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:53.288957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81c4e80f-5a76-48a8-ace2-98831cd887fc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:53.289767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81c4e80f-5a76-48a8-ace2-98831cd887fc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:53.306157 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-81c4e80f-5a76-48a8-ace2-98831cd887fc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-954442834 could not be found. Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81c4e80f-5a76-48a8-ace2-98831cd887fc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Request method failure captured: Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 57 Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QRygsY8jPSoQFdKmEshr4tyg_vWVHcDfJPbbbcc9vUw5h5cmB1WOp3FzFN-a_lk3UzzMiUdb90-_21oirmiQCS4EQiKmPZGGNlMoo3KyDGz_GSUcFH3Kpl_fwD5QptJlzn3QCRSU9vPXc8jVvvg3JX7dzquk3Sl0zwMRXVeiCj2_E Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:03:53.310213 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c762053428a54306b2b3cbf464bb91d0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}] Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 57fbea839c454b298f8b03aa82227836 Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: {"add_host": {"host": "tempest-nonexist_host-954442834"}} Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:03:53.311910 n-d-833090-9 devstack@n-api.service[119478]: exception: Compute host tempest-nonexist_host-954442834 could not be found. Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-954442834'}}} Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-954442834' is not mapped to any cell Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:53.313408 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 26 14:03:53.314923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-954442834 could not be found. Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-954442834 could not be found. Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:53.318115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.322819 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:53.322819 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:53.322819 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:53.322819 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:53.322819 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:53.322819 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-954442834 could not be found. Jul 26 14:03:53.322819 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.322819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81c4e80f-5a76-48a8-ace2-98831cd887fc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-954442834 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:53.322819 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-81c4e80f-5a76-48a8-ace2-98831cd887fc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.057599 Jul 26 14:03:53.322819 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 116/275] 10.222.0.70 () {60 vars in 1194 bytes} [Tue Jul 26 14:03:53 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:53.324751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-df112cee-ff24-47b1-8b2c-0d76694d72e3 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:53.325732 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:53.325732 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:53.334183 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-df112cee-ff24-47b1-8b2c-0d76694d72e3 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.013906 Jul 26 14:03:53.335139 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 117/276] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:53 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:53.349786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a63a8b7a-5da0-42ce-9245-a2a6639a4d3e tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Action: 'update', calling method: .version_select at 0x7f87947b2160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:53.433352 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4a76529-b94d-4f7b-8d86-b57830662661 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 312 microversion: 2.41 time: 0.243397 Jul 26 14:03:53.441099 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 160/277] 10.222.0.70 () {62 vars in 1232 bytes} [Tue Jul 26 14:03:53 2022] POST /compute/v2.1/os-aggregates/9/action => generated 312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:03:53.447980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-429502c3-21b8-4888-94b9-f9d646ad4a35 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:53.449919 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:53.449919 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:53.493674 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-429502c3-21b8-4888-94b9-f9d646ad4a35 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.050444 Jul 26 14:03:53.493827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a63a8b7a-5da0-42ce-9245-a2a6639a4d3e tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:53.494322 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 161/278] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:53.494454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a63a8b7a-5da0-42ce-9245-a2a6639a4d3e tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:53.495755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a63a8b7a-5da0-42ce-9245-a2a6639a4d3e tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:53.496520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a63a8b7a-5da0-42ce-9245-a2a6639a4d3e tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:53.503316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e3e0a7d5-deea-4eb5-94d1-ad9dd4ccf833 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:53.504364 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:53.504364 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:53.556449 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e3e0a7d5-deea-4eb5-94d1-ad9dd4ccf833 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.060363 Jul 26 14:03:53.562815 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 162/279] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:53 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:53.569123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e96383b0-2f9b-40e3-bd05-d68707f00be8 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-9"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:53.572481 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:53.572481 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:53.588755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e96383b0-2f9b-40e3-bd05-d68707f00be8 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:53.590002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e96383b0-2f9b-40e3-bd05-d68707f00be8 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:53.659892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=13,nova_api:DELETE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:53.840509 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e96383b0-2f9b-40e3-bd05-d68707f00be8 tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 297 microversion: 2.41 time: 0.275737 Jul 26 14:03:53.849002 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 163/280] 10.222.0.70 () {62 vars in 1232 bytes} [Tue Jul 26 14:03:53 2022] POST /compute/v2.1/os-aggregates/9/action => generated 297 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:03:53.854921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-899c4bff-6058-48e2-b1f9-a988287314e9 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-899c4bff-6058-48e2-b1f9-a988287314e9 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Request method failure captured: Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 283 Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QRygsY8jPSoQFdKmEshr4tyg_vWVHcDfJPbbbcc9vUw5h5cmB1WOp3FzFN-a_lk3UzzMiUdb90-_21oirmiQCS4EQiKmPZGGNlMoo3KyDGz_GSUcFH3Kpl_fwD5QptJlzn3QCRSU9vPXc8jVvvg3JX7dzquk3Sl0zwMRXVeiCj2_E Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:03:53.859535 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c762053428a54306b2b3cbf464bb91d0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}] Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 57fbea839c454b298f8b03aa82227836 Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:03:53.863351 n-d-833090-9 devstack@n-api.service[119479]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:03:53.864367 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:03:53.865524 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:03:53.866670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:03:53.870829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:03:53.870829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:53.870829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-899c4bff-6058-48e2-b1f9-a988287314e9 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:53.870829 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-899c4bff-6058-48e2-b1f9-a988287314e9 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.013882 Jul 26 14:03:53.871995 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 164/281] 10.222.0.70 () {60 vars in 1165 bytes} [Tue Jul 26 14:03:53 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:03:53.878274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b8a2790b-b172-4829-8191-f6b60306feb2 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-809776239", "availability_zone": "tempest-test_az-2049432868"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:53.883134 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:53.883134 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:53.885125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-b8a2790b-b172-4829-8191-f6b60306feb2 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Generated uuid dba64be7-9a7a-4f88-8c8f-a950ba84e581 for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:53.895608 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a63a8b7a-5da0-42ce-9245-a2a6639a4d3e tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/cf5b8095d6284c42ab2afca4cb5cf005" status: 200 len: 329 microversion: 2.1 time: 0.557144 Jul 26 14:03:53.909102 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 118/282] 10.222.0.70 () {60 vars in 1263 bytes} [Tue Jul 26 14:03:53 2022] PUT /compute/v2.1/os-quota-sets/cf5b8095d6284c42ab2afca4cb5cf005 => generated 329 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:53.917761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5b46f5b7-0755-463d-8f58-7baf457e6d21 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:53.918905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b46f5b7-0755-463d-8f58-7baf457e6d21 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:53.932519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b46f5b7-0755-463d-8f58-7baf457e6d21 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:53.933331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b46f5b7-0755-463d-8f58-7baf457e6d21 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:53.934308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b46f5b7-0755-463d-8f58-7baf457e6d21 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:53.935005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b46f5b7-0755-463d-8f58-7baf457e6d21 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:53.936710 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b8a2790b-b172-4829-8191-f6b60306feb2 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.072558 Jul 26 14:03:53.949902 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 165/283] 10.222.0.70 () {60 vars in 1165 bytes} [Tue Jul 26 14:03:53 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:53.961082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0833505f-a218-4ec4-9890-77addaa563bd tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:53.963121 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:53.963121 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:54.013619 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0833505f-a218-4ec4-9890-77addaa563bd tempest-AggregatesAdminTestV241-1976468749 tempest-AggregatesAdminTestV241-1976468749-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.41 time: 0.060169 Jul 26 14:03:54.015252 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 166/284] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 26 14:03:53 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:54.029065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-488f987d-6697-4f39-9a1c-9f895b34facc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-488f987d-6697-4f39-9a1c-9f895b34facc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Request method failure captured: Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 27 Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QRygsY8jPSoQFdKmEshr4tyg_vWVHcDfJPbbbcc9vUw5h5cmB1WOp3FzFN-a_lk3UzzMiUdb90-_21oirmiQCS4EQiKmPZGGNlMoo3KyDGz_GSUcFH3Kpl_fwD5QptJlzn3QCRSU9vPXc8jVvvg3JX7dzquk3Sl0zwMRXVeiCj2_E Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:03:54.034470 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c762053428a54306b2b3cbf464bb91d0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}] Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 57fbea839c454b298f8b03aa82227836 Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: {"aggregate": {"name": ""}} Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:54.045030 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi '' Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:54.046685 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:03:54.049430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:54.051789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-488f987d-6697-4f39-9a1c-9f895b34facc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:54.051789 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-488f987d-6697-4f39-9a1c-9f895b34facc tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019245 Jul 26 14:03:54.051789 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 167/285] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:54 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:03:54.056594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5597c6bb-0c1d-4cc6-b62b-bdfb9e8a5b39 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:54.060017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5597c6bb-0c1d-4cc6-b62b-bdfb9e8a5b39 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:54.065078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5597c6bb-0c1d-4cc6-b62b-bdfb9e8a5b39 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:54.065950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5597c6bb-0c1d-4cc6-b62b-bdfb9e8a5b39 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:54.067514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5597c6bb-0c1d-4cc6-b62b-bdfb9e8a5b39 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:54.068576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5597c6bb-0c1d-4cc6-b62b-bdfb9e8a5b39 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:54.313487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5b46f5b7-0755-463d-8f58-7baf457e6d21 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:54.340008 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5b46f5b7-0755-463d-8f58-7baf457e6d21 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1318 microversion: 2.1 time: 0.428756 Jul 26 14:03:54.341067 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 119/286] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:53 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:54.351026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-94438329-46ae-41a5-9e66-a6c37156665d tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Action: 'update', calling method: .version_select at 0x7f87947a6280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:54.407794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5597c6bb-0c1d-4cc6-b62b-bdfb9e8a5b39 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:54.416186 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5597c6bb-0c1d-4cc6-b62b-bdfb9e8a5b39 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1391 microversion: 2.1 time: 0.377569 Jul 26 14:03:54.418370 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 168/287] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:54 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1391 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:54.423270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d1e8fa0b-b1af-4e9c-98b0-7a90e1868ccb tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-809776239_new", "availability_zone": "tempest-test_az-2049432868_new"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:54.426360 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:54.426360 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:54.514023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1e8fa0b-b1af-4e9c-98b0-7a90e1868ccb tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:54.514485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1e8fa0b-b1af-4e9c-98b0-7a90e1868ccb tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:54.596065 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d1e8fa0b-b1af-4e9c-98b0-7a90e1868ccb tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 336 microversion: 2.1 time: 0.176424 Jul 26 14:03:54.597230 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 169/288] 10.222.0.70 () {60 vars in 1173 bytes} [Tue Jul 26 14:03:54 2022] PUT /compute/v2.1/os-aggregates/12 => generated 336 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:54.607374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-77864367-814c-482d-96fb-a2f1ceb869d1 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2024403546"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:54.614082 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:54.614082 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:54.621060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-77864367-814c-482d-96fb-a2f1ceb869d1 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '11f8088659654d1099c42f9a403d8c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a4fb049e54452fafa512f0af50c056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-77864367-814c-482d-96fb-a2f1ceb869d1 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Request method failure captured: Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 60 Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QObf2Y0jKJlpxgeGybQQH-ThA6toXJ--jNhMLTMTy4i9Kh7Kqn5SUXLa2BpcAPAklJjk4QbUgphsepCZ56PbChUzsCzXicY3YULIPQGbn7In759mSUn30_lhBXiQHdGPY4OAd0cGqcazQt4I7MFneJb5psVM_z2CsCAcaYvAFFZiA Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:03:54.623842 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33a4fb049e54452fafa512f0af50c056", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}] Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 11f8088659654d1099c42f9a403d8c8a Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: {"aggregate": {"name": "tempest-test_aggregate-2024403546"}} Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:54.625652 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2024403546'}}} Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:54.627155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:54.629511 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 26 14:03:54.632225 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:54.634270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-77864367-814c-482d-96fb-a2f1ceb869d1 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:54.639433 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-77864367-814c-482d-96fb-a2f1ceb869d1 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.038283 Jul 26 14:03:54.641417 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 170/289] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:54 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:54.654887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a18f6a14-58f0-4e49-a7d8-6a94e92c55a2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:54.658187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a18f6a14-58f0-4e49-a7d8-6a94e92c55a2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:54.674972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a18f6a14-58f0-4e49-a7d8-6a94e92c55a2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:54.677495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a18f6a14-58f0-4e49-a7d8-6a94e92c55a2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:54.680902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a18f6a14-58f0-4e49-a7d8-6a94e92c55a2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:54.681512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a18f6a14-58f0-4e49-a7d8-6a94e92c55a2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:54.796107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94438329-46ae-41a5-9e66-a6c37156665d tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:54.796626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94438329-46ae-41a5-9e66-a6c37156665d tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:54.797649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94438329-46ae-41a5-9e66-a6c37156665d tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:54.798276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94438329-46ae-41a5-9e66-a6c37156665d tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:54.946382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a18f6a14-58f0-4e49-a7d8-6a94e92c55a2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:54.956711 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a18f6a14-58f0-4e49-a7d8-6a94e92c55a2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.312598 Jul 26 14:03:54.973934 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 171/290] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:54 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:54.982326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9cedd77-f06c-4730-8c5a-5927e531ecd5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:54.984084 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:54.984084 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:54.994724 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a9cedd77-f06c-4730-8c5a-5927e531ecd5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.016928 Jul 26 14:03:54.995550 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 172/291] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:03:54 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:55.001855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5cd8a3e-e2b6-4eba-a353-99597948721a tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1377911596"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:55.005389 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:55.005389 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:55.008132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-d5cd8a3e-e2b6-4eba-a353-99597948721a tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Generated uuid 0b1bf582-069e-45cd-8353-cebc65050605 for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:55.034875 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5cd8a3e-e2b6-4eba-a353-99597948721a tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.037709 Jul 26 14:03:55.036846 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 173/292] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:55.042983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8738b068-382a-46b2-b287-4c5345a56944 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:55.044334 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:55.044334 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:55.080955 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8738b068-382a-46b2-b287-4c5345a56944 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.040941 Jul 26 14:03:55.083414 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 174/293] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:55 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:55.098185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a4f0392-49b0-47a3-9ea4-fb4b966e3e27 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1377911596"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:55.110028 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:55.110028 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:55.111819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-0a4f0392-49b0-47a3-9ea4-fb4b966e3e27 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Generated uuid 0dcab461-bbd7-493b-b29e-7ec5235d7f4f for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:55.130346 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-0a4f0392-49b0-47a3-9ea4-fb4b966e3e27 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1377911596 already exists. Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a4f0392-49b0-47a3-9ea4-fb4b966e3e27 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Request method failure captured: Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 60 Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QRygsY8jPSoQFdKmEshr4tyg_vWVHcDfJPbbbcc9vUw5h5cmB1WOp3FzFN-a_lk3UzzMiUdb90-_21oirmiQCS4EQiKmPZGGNlMoo3KyDGz_GSUcFH3Kpl_fwD5QptJlzn3QCRSU9vPXc8jVvvg3JX7dzquk3Sl0zwMRXVeiCj2_E Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:03:55.136293 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c762053428a54306b2b3cbf464bb91d0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}] Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 57fbea839c454b298f8b03aa82227836 Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: {"aggregate": {"name": "tempest-test_aggregate-1377911596"}} Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:55.137568 n-d-833090-9 devstack@n-api.service[119479]: exception: Aggregate tempest-test_aggregate-1377911596 already exists. Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1377911596'}}} Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 26 14:03:55.138403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1377911596 already exists. Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:55.140658 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1377911596 already exists. Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1377911596 already exists. Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a4f0392-49b0-47a3-9ea4-fb4b966e3e27 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1377911596 already exists. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:55.142811 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0a4f0392-49b0-47a3-9ea4-fb4b966e3e27 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.054182 Jul 26 14:03:55.143763 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 175/294] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:55 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:03:55.159576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-097f2263-9c3b-4392-8bb2-efda0602455a tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-380042852"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:55.168179 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:55.168179 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:55.171927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-097f2263-9c3b-4392-8bb2-efda0602455a tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Generated uuid 6aef401e-181d-4298-b2d5-edf7b4a569d1 for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:55.200457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:UPDATE=3,nova_api:DELETE=11 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:55.223318 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-097f2263-9c3b-4392-8bb2-efda0602455a tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072241 Jul 26 14:03:55.225365 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 176/295] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:55.239066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ec58180-7b63-40d1-be79-b6d669f1d2da tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:55.249224 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:55.249224 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:55.285914 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ec58180-7b63-40d1-be79-b6d669f1d2da tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055972 Jul 26 14:03:55.288443 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 177/296] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:55 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:55.307527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b933b2ea-4460-4a6d-a60d-1487add739a5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:55.309242 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:55.309242 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:55.323410 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b933b2ea-4460-4a6d-a60d-1487add739a5 tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.033359 Jul 26 14:03:55.334816 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 178/297] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:03:55 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:55.334816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-99124a96-601f-482f-980c-34d3367ca61b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-357359642"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:55.339006 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:55.339006 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:55.340973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-99124a96-601f-482f-980c-34d3367ca61b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Generated uuid 7502bbed-1cf2-411c-89d2-669c6aa17430 for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:55.342173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:55.391622 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-99124a96-601f-482f-980c-34d3367ca61b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065136 Jul 26 14:03:55.402062 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 179/298] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:55.405258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4af37bb5-bb28-4e8d-bec3-d7a719adf58f tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:55.406123 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:55.406123 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:55.434142 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-94438329-46ae-41a5-9e66-a6c37156665d tempest-QuotasAdminTestJSON-739657316 tempest-QuotasAdminTestJSON-739657316-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/cf5b8095d6284c42ab2afca4cb5cf005" status: 200 len: 329 microversion: 2.1 time: 1.089919 Jul 26 14:03:55.437266 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 120/299] 10.222.0.70 () {60 vars in 1263 bytes} [Tue Jul 26 14:03:54 2022] PUT /compute/v2.1/os-quota-sets/cf5b8095d6284c42ab2afca4cb5cf005 => generated 329 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:55.449096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f5b3761f-eace-426a-84d3-4a1b93b10bec tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:55.450882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f5b3761f-eace-426a-84d3-4a1b93b10bec tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:55.465017 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4af37bb5-bb28-4e8d-bec3-d7a719adf58f tempest-AggregatesAdminTestJSON-1854026711 tempest-AggregatesAdminTestJSON-1854026711-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.070055 Jul 26 14:03:55.465482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f5b3761f-eace-426a-84d3-4a1b93b10bec tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:55.465638 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 180/300] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:55 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:55.467086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f5b3761f-eace-426a-84d3-4a1b93b10bec tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:55.469397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f5b3761f-eace-426a-84d3-4a1b93b10bec tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:55.470314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f5b3761f-eace-426a-84d3-4a1b93b10bec tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:55.479469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-481a801f-8266-470a-a92f-cab4b8303f7b tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:55.483323 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:55.483323 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:55.484920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-481a801f-8266-470a-a92f-cab4b8303f7b tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '11f8088659654d1099c42f9a403d8c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a4fb049e54452fafa512f0af50c056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-481a801f-8266-470a-a92f-cab4b8303f7b tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Request method failure captured: Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QObf2Y0jKJlpxgeGybQQH-ThA6toXJ--jNhMLTMTy4i9Kh7Kqn5SUXLa2BpcAPAklJjk4QbUgphsepCZ56PbChUzsCzXicY3YULIPQGbn7In759mSUn30_lhBXiQHdGPY4OAd0cGqcazQt4I7MFneJb5psVM_z2CsCAcaYvAFFZiA Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:03:55.489313 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33a4fb049e54452fafa512f0af50c056", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}] Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 11f8088659654d1099c42f9a403d8c8a Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 26 14:03:55.491844 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '15'} Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:55.492732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 26 14:03:55.494005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:55.496082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-481a801f-8266-470a-a92f-cab4b8303f7b tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:55.499479 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-481a801f-8266-470a-a92f-cab4b8303f7b tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.032550 Jul 26 14:03:55.504515 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 181/301] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:55 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:55.518071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a24aa706-94ad-438e-b2b8-0c8f0cfc0b22 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:55.519302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a24aa706-94ad-438e-b2b8-0c8f0cfc0b22 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:55.533417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a24aa706-94ad-438e-b2b8-0c8f0cfc0b22 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:55.535280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a24aa706-94ad-438e-b2b8-0c8f0cfc0b22 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:55.539322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a24aa706-94ad-438e-b2b8-0c8f0cfc0b22 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:55.540806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a24aa706-94ad-438e-b2b8-0c8f0cfc0b22 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:56.013419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a24aa706-94ad-438e-b2b8-0c8f0cfc0b22 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:56.045409 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a24aa706-94ad-438e-b2b8-0c8f0cfc0b22 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1391 microversion: 2.1 time: 0.538120 Jul 26 14:03:56.046438 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 182/302] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:55 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1391 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:56.078540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cea802a2-1d09-4de8-9e61-b4b9b2731427 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:56.079256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cea802a2-1d09-4de8-9e61-b4b9b2731427 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:56.090724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cea802a2-1d09-4de8-9e61-b4b9b2731427 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:56.091282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cea802a2-1d09-4de8-9e61-b4b9b2731427 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:56.092375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cea802a2-1d09-4de8-9e61-b4b9b2731427 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:56.093008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cea802a2-1d09-4de8-9e61-b4b9b2731427 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:56.127715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f5b3761f-eace-426a-84d3-4a1b93b10bec tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:56.143695 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-cea802a2-1d09-4de8-9e61-b4b9b2731427 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] HTTP exception thrown: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cea802a2-1d09-4de8-9e61-b4b9b2731427 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Request method failure captured: Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb HTTP/1.1 Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QOO9wniyVvxDGdlFpoO-nucNF0BZbHezsqESLrIop6vYCwj7qRcW1kwsFRVf_YbQRYPk6my6QdBFEgb5FHcsh3YeAD0W6XtJTFRhqEpxRpm99oTggI1XAlFozfhueNu75hR8uUgSLxm9R7Vqym-xbJJ-zxpgCGRa7653kJPxAP4Vo Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 9bdf50c8bd1141ee99a02883f0accc53 Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminTestJSON-1655233440 Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:03:56.145454 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdf50c8bd1141ee99a02883f0accc53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdf50c8bd1141ee99a02883f0accc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdf50c8bd1141ee99a02883f0accc53", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdf50c8bd1141ee99a02883f0accc53"}]}] Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminTestJSON-1655233440 Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 9bdf50c8bd1141ee99a02883f0accc53 Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1655233440 Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminTestJSON-1655233440-project Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8950f62d5ff94fa2b3a54d9a1ced5924 Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminTestJSON-1655233440-project Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:56.147507 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd040e902-a81c-4f87-9864-d3a258e79bcb'} Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:56.148301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:56.149766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.152198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cea802a2-1d09-4de8-9e61-b4b9b2731427 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Returning 404 to user: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:56.152346 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f5b3761f-eace-426a-84d3-4a1b93b10bec tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1318 microversion: 2.1 time: 0.710336 Jul 26 14:03:56.156386 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 121/303] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:55 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:56.167095 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cea802a2-1d09-4de8-9e61-b4b9b2731427 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 404 len: 111 microversion: 2.1 time: 0.103506 Jul 26 14:03:56.167359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6e2970d2-5c57-43cd-8bd7-ffa98bd9ac4b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:56.169423 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:56.169423 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:56.171175 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 183/304] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:03:56 2022] DELETE /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:56.184069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f6465aa5-d98a-4f2a-be24-26dcffd170e2 req-17bce90c-8547-4dfa-ba9c-9c7604db3301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae", "name": "network-vif-plugged", "status": "completed", "tag": "04498d04-b08b-4461-aadb-a16fe8c57ea4"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:56.204504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f6465aa5-d98a-4f2a-be24-26dcffd170e2 req-17bce90c-8547-4dfa-ba9c-9c7604db3301 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:56.206122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f6465aa5-d98a-4f2a-be24-26dcffd170e2 req-17bce90c-8547-4dfa-ba9c-9c7604db3301 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:56.221375 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6e2970d2-5c57-43cd-8bd7-ffa98bd9ac4b tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.060856 Jul 26 14:03:56.227335 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 122/305] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:56 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:56.233644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b3b22450-8088-4e92-974a-944f9b125ebf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:56.235982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b3b22450-8088-4e92-974a-944f9b125ebf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:56.237443 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f6465aa5-d98a-4f2a-be24-26dcffd170e2 req-17bce90c-8547-4dfa-ba9c-9c7604db3301 service nova] Creating event network-vif-plugged:04498d04-b08b-4461-aadb-a16fe8c57ea4 for instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae on n-h1-833090-9 Jul 26 14:03:56.246751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:INSERT=23,nova_api:SELECT=61,nova_api:UPDATE=14,nova_api:DELETE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:56.248216 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f6465aa5-d98a-4f2a-be24-26dcffd170e2 req-17bce90c-8547-4dfa-ba9c-9c7604db3301 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068554 Jul 26 14:03:56.249741 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 184/306] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:56.255122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3b22450-8088-4e92-974a-944f9b125ebf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:56.257574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3b22450-8088-4e92-974a-944f9b125ebf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:56.259183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3b22450-8088-4e92-974a-944f9b125ebf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:56.260262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3b22450-8088-4e92-974a-944f9b125ebf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:56.292971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2204bb73-9bd5-49c1-a8b5-86d6d5f73a88 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:56.294240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2204bb73-9bd5-49c1-a8b5-86d6d5f73a88 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] [instance: d040e902-a81c-4f87-9864-d3a258e79bcb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:56.314192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2204bb73-9bd5-49c1-a8b5-86d6d5f73a88 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:56.317935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2204bb73-9bd5-49c1-a8b5-86d6d5f73a88 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:56.323784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2204bb73-9bd5-49c1-a8b5-86d6d5f73a88 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:56.327709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2204bb73-9bd5-49c1-a8b5-86d6d5f73a88 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:56.370915 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-2204bb73-9bd5-49c1-a8b5-86d6d5f73a88 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] HTTP exception thrown: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2204bb73-9bd5-49c1-a8b5-86d6d5f73a88 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Request method failure captured: Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb HTTP/1.1 Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QOO9wniyVvxDGdlFpoO-nucNF0BZbHezsqESLrIop6vYCwj7qRcW1kwsFRVf_YbQRYPk6my6QdBFEgb5FHcsh3YeAD0W6XtJTFRhqEpxRpm99oTggI1XAlFozfhueNu75hR8uUgSLxm9R7Vqym-xbJJ-zxpgCGRa7653kJPxAP4Vo Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 9bdf50c8bd1141ee99a02883f0accc53 Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminTestJSON-1655233440 Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:03:56.373351 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdf50c8bd1141ee99a02883f0accc53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdf50c8bd1141ee99a02883f0accc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdf50c8bd1141ee99a02883f0accc53", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdf50c8bd1141ee99a02883f0accc53"}]}] Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminTestJSON-1655233440 Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 9bdf50c8bd1141ee99a02883f0accc53 Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1655233440 Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminTestJSON-1655233440-project Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8950f62d5ff94fa2b3a54d9a1ced5924 Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminTestJSON-1655233440-project Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:56.375434 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd040e902-a81c-4f87-9864-d3a258e79bcb'} Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:56.381476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. Jul 26 14:03:56.383356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.387367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2204bb73-9bd5-49c1-a8b5-86d6d5f73a88 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] Returning 404 to user: Instance d040e902-a81c-4f87-9864-d3a258e79bcb could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:56.387367 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2204bb73-9bd5-49c1-a8b5-86d6d5f73a88 tempest-AggregatesAdminTestJSON-1655233440 tempest-AggregatesAdminTestJSON-1655233440-project] 10.222.0.70 "GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb" status: 404 len: 111 microversion: 2.1 time: 0.123791 Jul 26 14:03:56.387367 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 185/307] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:56 2022] GET /compute/v2.1/servers/d040e902-a81c-4f87-9864-d3a258e79bcb => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:56.397295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-189f2c0f-808f-4c12-ad9b-984dc6d9dc5f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:56.398695 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:56.398695 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:56.418634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-189f2c0f-808f-4c12-ad9b-984dc6d9dc5f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-189f2c0f-808f-4c12-ad9b-984dc6d9dc5f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Request method failure captured: Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QRygsY8jPSoQFdKmEshr4tyg_vWVHcDfJPbbbcc9vUw5h5cmB1WOp3FzFN-a_lk3UzzMiUdb90-_21oirmiQCS4EQiKmPZGGNlMoo3KyDGz_GSUcFH3Kpl_fwD5QptJlzn3QCRSU9vPXc8jVvvg3JX7dzquk3Sl0zwMRXVeiCj2_E Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:03:56.422972 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c762053428a54306b2b3cbf464bb91d0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}] Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 57fbea839c454b298f8b03aa82227836 Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: exception: Aggregate -1 could not be found. Jul 26 14:03:56.424518 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '-1'} Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 14:03:56.425181 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.426284 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.427622 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.427622 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.427622 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:56.427622 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:56.427622 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 26 14:03:56.427622 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.430669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-189f2c0f-808f-4c12-ad9b-984dc6d9dc5f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:56.433008 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-189f2c0f-808f-4c12-ad9b-984dc6d9dc5f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.055369 Jul 26 14:03:56.436304 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 186/308] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:56 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:03:56.457284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bfc2c26d-963d-42ca-9c55-9a73cbd8b31a tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-79645739"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:56.463682 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:56.463682 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:56.465088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-bfc2c26d-963d-42ca-9c55-9a73cbd8b31a tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Generated uuid 65385334-2ac5-4566-9391-a62999cd94d0 for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:56.512178 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bfc2c26d-963d-42ca-9c55-9a73cbd8b31a tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.069213 Jul 26 14:03:56.514329 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 187/309] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:56.537556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9a57444-abd6-444b-bfe0-cff3e64acd45 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:56.538847 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:56.538847 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:56.539696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d9a57444-abd6-444b-bfe0-cff3e64acd45 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '11f8088659654d1099c42f9a403d8c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a4fb049e54452fafa512f0af50c056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9a57444-abd6-444b-bfe0-cff3e64acd45 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Request method failure captured: Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QObf2Y0jKJlpxgeGybQQH-ThA6toXJ--jNhMLTMTy4i9Kh7Kqn5SUXLa2BpcAPAklJjk4QbUgphsepCZ56PbChUzsCzXicY3YULIPQGbn7In759mSUn30_lhBXiQHdGPY4OAd0cGqcazQt4I7MFneJb5psVM_z2CsCAcaYvAFFZiA Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:03:56.541474 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33a4fb049e54452fafa512f0af50c056", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}] Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 11f8088659654d1099c42f9a403d8c8a Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 26 14:03:56.543734 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '16'} Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:56.545662 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.549806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9a57444-abd6-444b-bfe0-cff3e64acd45 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:56.574223 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d9a57444-abd6-444b-bfe0-cff3e64acd45 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] 10.222.0.70 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.013625 Jul 26 14:03:56.574223 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 188/310] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:56 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:56.574223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7618a7c2-e13b-4aa6-a1ee-d363ebe0e300 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:56.574223 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:56.574223 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:56.627631 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7618a7c2-e13b-4aa6-a1ee-d363ebe0e300 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.079232 Jul 26 14:03:56.637844 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 189/311] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:56 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:56.650821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4819b93-1057-4622-97af-63b36883de9f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:56.651716 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:56.651716 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:56.661187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b3b22450-8088-4e92-974a-944f9b125ebf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:56.678237 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b3b22450-8088-4e92-974a-944f9b125ebf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.452633 Jul 26 14:03:56.681184 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 123/312] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:56 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:56.691919 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e4819b93-1057-4622-97af-63b36883de9f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4819b93-1057-4622-97af-63b36883de9f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Request method failure captured: Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QRygsY8jPSoQFdKmEshr4tyg_vWVHcDfJPbbbcc9vUw5h5cmB1WOp3FzFN-a_lk3UzzMiUdb90-_21oirmiQCS4EQiKmPZGGNlMoo3KyDGz_GSUcFH3Kpl_fwD5QptJlzn3QCRSU9vPXc8jVvvg3JX7dzquk3Sl0zwMRXVeiCj2_E Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:03:56.694998 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c762053428a54306b2b3cbf464bb91d0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}] Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 57fbea839c454b298f8b03aa82227836 Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: exception: Aggregate -1 could not be found. Jul 26 14:03:56.698122 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '-1'} Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.699297 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 26 14:03:56.702513 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.704968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4819b93-1057-4622-97af-63b36883de9f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:56.704968 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4819b93-1057-4622-97af-63b36883de9f tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.058935 Jul 26 14:03:56.704968 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 190/313] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:03:56 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:03:56.718655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9915a602-2525-426a-ba58-2a19e92f968b tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:56.718655 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:56.718655 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:56.719562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9915a602-2525-426a-ba58-2a19e92f968b tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '11f8088659654d1099c42f9a403d8c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a4fb049e54452fafa512f0af50c056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9915a602-2525-426a-ba58-2a19e92f968b tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Request method failure captured: Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QObf2Y0jKJlpxgeGybQQH-ThA6toXJ--jNhMLTMTy4i9Kh7Kqn5SUXLa2BpcAPAklJjk4QbUgphsepCZ56PbChUzsCzXicY3YULIPQGbn7In759mSUn30_lhBXiQHdGPY4OAd0cGqcazQt4I7MFneJb5psVM_z2CsCAcaYvAFFZiA Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:03:56.721733 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33a4fb049e54452fafa512f0af50c056", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}] Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 11f8088659654d1099c42f9a403d8c8a Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 26 14:03:56.723028 n-d-833090-9 devstack@n-api.service[119478]: action_args: {} Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:56.723713 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:03:56.728391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9915a602-2525-426a-ba58-2a19e92f968b tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:56.735326 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9915a602-2525-426a-ba58-2a19e92f968b tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.016498 Jul 26 14:03:56.745139 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 124/314] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:03:56 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:56.753704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4308a484-7771-4e20-b3ff-ff5121fe97f3 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-875968772"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:56.758386 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:56.758386 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:56.759631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-4308a484-7771-4e20-b3ff-ff5121fe97f3 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Generated uuid 9699f721-22ef-4571-a16a-319cbbb5f46b for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:56.826602 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4308a484-7771-4e20-b3ff-ff5121fe97f3 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.078140 Jul 26 14:03:56.828189 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 191/315] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:56.852760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e4d69eb8-29cf-4e0e-9000-0030afcba315 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-9"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:56.864473 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:56.864473 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:56.891409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4d69eb8-29cf-4e0e-9000-0030afcba315 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:56.895475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4d69eb8-29cf-4e0e-9000-0030afcba315 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:57.094725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c8f77ef4-d567-43f1-9cd4-df0002a90c00 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:57.098879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c8f77ef4-d567-43f1-9cd4-df0002a90c00 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:57.127311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c8f77ef4-d567-43f1-9cd4-df0002a90c00 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:57.130459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c8f77ef4-d567-43f1-9cd4-df0002a90c00 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:57.135212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c8f77ef4-d567-43f1-9cd4-df0002a90c00 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:57.136194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c8f77ef4-d567-43f1-9cd4-df0002a90c00 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:57.274213 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e4d69eb8-29cf-4e0e-9000-0030afcba315 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.432255 Jul 26 14:03:57.275185 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 125/316] 10.222.0.70 () {60 vars in 1194 bytes} [Tue Jul 26 14:03:56 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:03:57.282407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a979ddda-a110-408f-b2ee-6632331323e7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:57.283666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a979ddda-a110-408f-b2ee-6632331323e7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:57.310383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a979ddda-a110-408f-b2ee-6632331323e7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:57.315080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a979ddda-a110-408f-b2ee-6632331323e7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:57.317042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a979ddda-a110-408f-b2ee-6632331323e7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:57.319584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a979ddda-a110-408f-b2ee-6632331323e7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:57.789382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c8f77ef4-d567-43f1-9cd4-df0002a90c00 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:57.806448 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c8f77ef4-d567-43f1-9cd4-df0002a90c00 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1391 microversion: 2.1 time: 0.725479 Jul 26 14:03:57.810614 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 192/317] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:57 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1391 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:57.829602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db36926f-8924-437d-82af-f15888dbc531 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-9"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:57.842751 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:57.842751 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:57.844839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-db36926f-8924-437d-82af-f15888dbc531 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '11f8088659654d1099c42f9a403d8c8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33a4fb049e54452fafa512f0af50c056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db36926f-8924-437d-82af-f15888dbc531 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Request method failure captured: Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 42 Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QObf2Y0jKJlpxgeGybQQH-ThA6toXJ--jNhMLTMTy4i9Kh7Kqn5SUXLa2BpcAPAklJjk4QbUgphsepCZ56PbChUzsCzXicY3YULIPQGbn7In759mSUn30_lhBXiQHdGPY4OAd0cGqcazQt4I7MFneJb5psVM_z2CsCAcaYvAFFZiA Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:03:57.847007 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33a4fb049e54452fafa512f0af50c056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33a4fb049e54452fafa512f0af50c056", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33a4fb049e54452fafa512f0af50c056"}]}] Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 33a4fb049e54452fafa512f0af50c056 Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-898766034 Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 11f8088659654d1099c42f9a403d8c8a Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-898766034-project Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: {"remove_host": {"host": "n-h1-833090-9"}} Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:57.848395 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-833090-9'}}} Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:57.849330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 26 14:03:57.850563 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:57.859807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db36926f-8924-437d-82af-f15888dbc531 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:57.861205 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db36926f-8924-437d-82af-f15888dbc531 tempest-AggregatesAdminNegativeTestJSON-898766034 tempest-AggregatesAdminNegativeTestJSON-898766034-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.049099 Jul 26 14:03:57.861992 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 193/318] 10.222.0.70 () {60 vars in 1194 bytes} [Tue Jul 26 14:03:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:03:57.883881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-be90087f-d16b-4dfc-8e27-f7a7de6d02c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:57.885038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-be90087f-d16b-4dfc-8e27-f7a7de6d02c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:57.896700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a979ddda-a110-408f-b2ee-6632331323e7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:57.897957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be90087f-d16b-4dfc-8e27-f7a7de6d02c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:57.898885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be90087f-d16b-4dfc-8e27-f7a7de6d02c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:57.899942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be90087f-d16b-4dfc-8e27-f7a7de6d02c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:57.901163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be90087f-d16b-4dfc-8e27-f7a7de6d02c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:57.910681 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a979ddda-a110-408f-b2ee-6632331323e7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1318 microversion: 2.1 time: 0.634232 Jul 26 14:03:57.949069 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 126/319] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:57 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1318 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:57.957106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-535d4fb5-493c-4d18-bd1a-154bfcf56cc1 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-9"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:57.989502 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:57.989502 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:58.034810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-535d4fb5-493c-4d18-bd1a-154bfcf56cc1 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:58.035357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-535d4fb5-493c-4d18-bd1a-154bfcf56cc1 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:58.227727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-be90087f-d16b-4dfc-8e27-f7a7de6d02c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:58.263777 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-be90087f-d16b-4dfc-8e27-f7a7de6d02c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.394056 Jul 26 14:03:58.269704 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 194/320] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:57 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:58.395742 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-535d4fb5-493c-4d18-bd1a-154bfcf56cc1 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.443203 Jul 26 14:03:58.398665 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 127/321] 10.222.0.70 () {60 vars in 1194 bytes} [Tue Jul 26 14:03:57 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:58.414650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-67aa512f-180b-4e44-8975-52bc70c76636 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:58.421246 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:58.421246 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:58.509750 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-67aa512f-180b-4e44-8975-52bc70c76636 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.102774 Jul 26 14:03:58.512104 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 195/322] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:58 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:58.523888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fe95d531-f1ac-4814-a470-e5f1b3dfcae9 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2067724190"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:58.526754 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:58.526754 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:58.527796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.aggregate [None req-fe95d531-f1ac-4814-a470-e5f1b3dfcae9 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Generated uuid 4382eb48-f20a-4465-86f1-9283e60c74cb for aggregate {{(pid=119478) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:03:58.589485 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fe95d531-f1ac-4814-a470-e5f1b3dfcae9 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.070818 Jul 26 14:03:58.594902 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 128/323] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:03:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:03:58.609728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4232e868-8757-4fb2-b7c3-c4d11c3f97a7 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:03:58.619121 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:58.619121 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:03:58.654077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4232e868-8757-4fb2-b7c3-c4d11c3f97a7 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:58.656364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4232e868-8757-4fb2-b7c3-c4d11c3f97a7 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:58.683062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4232e868-8757-4fb2-b7c3-c4d11c3f97a7 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:58.684042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4232e868-8757-4fb2-b7c3-c4d11c3f97a7 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:58.713257 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.compute.aggregates [None req-4232e868-8757-4fb2-b7c3-c4d11c3f97a7 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 26 14:03:58.714239 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-4232e868-8757-4fb2-b7c3-c4d11c3f97a7 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4232e868-8757-4fb2-b7c3-c4d11c3f97a7 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Request method failure captured: Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 42 Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QRygsY8jPSoQFdKmEshr4tyg_vWVHcDfJPbbbcc9vUw5h5cmB1WOp3FzFN-a_lk3UzzMiUdb90-_21oirmiQCS4EQiKmPZGGNlMoo3KyDGz_GSUcFH3Kpl_fwD5QptJlzn3QCRSU9vPXc8jVvvg3JX7dzquk3Sl0zwMRXVeiCj2_E Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:03:58.716949 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c762053428a54306b2b3cbf464bb91d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c762053428a54306b2b3cbf464bb91d0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c762053428a54306b2b3cbf464bb91d0"}]}] Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c762053428a54306b2b3cbf464bb91d0 Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264 Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 57fbea839c454b298f8b03aa82227836 Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: {"remove_host": {"host": "nonexist_host"}} Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:03:58.718394 n-d-833090-9 devstack@n-api.service[119479]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 26 14:03:58.719227 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 26 14:03:58.720899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:58.723058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:03:58.725834 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:03:58.725834 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:03:58.725834 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:03:58.725834 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:03:58.725834 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 26 14:03:58.725834 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:03:58.734606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4232e868-8757-4fb2-b7c3-c4d11c3f97a7 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:03:58.738663 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4232e868-8757-4fb2-b7c3-c4d11c3f97a7 tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.134389 Jul 26 14:03:58.744042 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 196/324] 10.222.0.70 () {60 vars in 1194 bytes} [Tue Jul 26 14:03:58 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:03:58.758170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0920259-010a-4db7-9542-0f484a2b296c tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:58.762916 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:03:58.762916 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:03:58.810863 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c0920259-010a-4db7-9542-0f484a2b296c tempest-AggregatesAdminNegativeTestJSON-1365543264 tempest-AggregatesAdminNegativeTestJSON-1365543264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.057501 Jul 26 14:03:58.812526 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 129/325] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:03:58 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:03:58.840895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c3e4628f-4afa-4c8b-8ce0-8cc313abb1a4 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:58.841542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c3e4628f-4afa-4c8b-8ce0-8cc313abb1a4 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:58.866296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3e4628f-4afa-4c8b-8ce0-8cc313abb1a4 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:58.866908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3e4628f-4afa-4c8b-8ce0-8cc313abb1a4 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:58.867933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3e4628f-4afa-4c8b-8ce0-8cc313abb1a4 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:58.868412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3e4628f-4afa-4c8b-8ce0-8cc313abb1a4 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:58.914523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:03:58.955983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1e50d122-28f8-4498-a20a-f57323481e00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:58.956629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1e50d122-28f8-4498-a20a-f57323481e00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:58.967940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e50d122-28f8-4498-a20a-f57323481e00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:58.968573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e50d122-28f8-4498-a20a-f57323481e00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:58.972746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e50d122-28f8-4498-a20a-f57323481e00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:58.973205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e50d122-28f8-4498-a20a-f57323481e00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:59.431542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c3e4628f-4afa-4c8b-8ce0-8cc313abb1a4 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:59.465002 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c3e4628f-4afa-4c8b-8ce0-8cc313abb1a4 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1590 microversion: 2.1 time: 0.629364 Jul 26 14:03:59.474404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1e50d122-28f8-4498-a20a-f57323481e00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:03:59.502126 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1e50d122-28f8-4498-a20a-f57323481e00 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1318 microversion: 2.1 time: 0.550131 Jul 26 14:03:59.502688 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 197/326] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:58 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1590 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:59.521136 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 130/327] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:58 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:03:59.527781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ca0d643-9be8-4f2e-8401-8a0f2468857d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:59.528748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1ca0d643-9be8-4f2e-8401-8a0f2468857d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:59.542719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ca0d643-9be8-4f2e-8401-8a0f2468857d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:59.543275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ca0d643-9be8-4f2e-8401-8a0f2468857d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:59.543851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c1f2498c-87f5-48ac-8ef9-b9390ee6ab79 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:03:59.544693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ca0d643-9be8-4f2e-8401-8a0f2468857d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:59.545246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ca0d643-9be8-4f2e-8401-8a0f2468857d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:59.545923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c1f2498c-87f5-48ac-8ef9-b9390ee6ab79 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:03:59.580709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1f2498c-87f5-48ac-8ef9-b9390ee6ab79 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:59.580709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1f2498c-87f5-48ac-8ef9-b9390ee6ab79 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:59.580709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1f2498c-87f5-48ac-8ef9-b9390ee6ab79 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:03:59.590973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1f2498c-87f5-48ac-8ef9-b9390ee6ab79 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:03:59.840674 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c1f2498c-87f5-48ac-8ef9-b9390ee6ab79 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.316119 Jul 26 14:03:59.842040 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 131/328] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:03:59 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae/os-interface => generated 285 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:00.536198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce92917e-bdfa-4e00-bb8c-04ac0f2cb68a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:00.536836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce92917e-bdfa-4e00-bb8c-04ac0f2cb68a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:00.560311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce92917e-bdfa-4e00-bb8c-04ac0f2cb68a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:00.561069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce92917e-bdfa-4e00-bb8c-04ac0f2cb68a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:00.562044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce92917e-bdfa-4e00-bb8c-04ac0f2cb68a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:00.562642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce92917e-bdfa-4e00-bb8c-04ac0f2cb68a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:01.012186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ca0d643-9be8-4f2e-8401-8a0f2468857d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:01.033282 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ca0d643-9be8-4f2e-8401-8a0f2468857d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 1.527469 Jul 26 14:04:01.036264 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 198/329] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:03:59 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:01.448558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-65c0e6af-33d0-47e3-9a15-a9c9ab7c3408 req-0799cc7b-cb4d-4551-b4d1-b2e9ebadde90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec88f45-f830-436b-8322-fddddf7c492a", "name": "network-vif-plugged", "status": "completed", "tag": "7da372b7-918b-4213-8ae7-b55c28349eb7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:01.478025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-65c0e6af-33d0-47e3-9a15-a9c9ab7c3408 req-0799cc7b-cb4d-4551-b4d1-b2e9ebadde90 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:01.479002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-65c0e6af-33d0-47e3-9a15-a9c9ab7c3408 req-0799cc7b-cb4d-4551-b4d1-b2e9ebadde90 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:01.519325 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-65c0e6af-33d0-47e3-9a15-a9c9ab7c3408 req-0799cc7b-cb4d-4551-b4d1-b2e9ebadde90 service nova] Creating event network-vif-plugged:7da372b7-918b-4213-8ae7-b55c28349eb7 for instance 4ec88f45-f830-436b-8322-fddddf7c492a on n-h2-833090-9 Jul 26 14:04:01.537735 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-65c0e6af-33d0-47e3-9a15-a9c9ab7c3408 req-0799cc7b-cb4d-4551-b4d1-b2e9ebadde90 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096640 Jul 26 14:04:01.538715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ce92917e-bdfa-4e00-bb8c-04ac0f2cb68a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:01.544159 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 199/330] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:01.563813 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce92917e-bdfa-4e00-bb8c-04ac0f2cb68a tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1318 microversion: 2.1 time: 1.031173 Jul 26 14:04:01.568209 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 132/331] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:00 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1318 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:02.057322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=34 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:02.067580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e229f3a8-3ce7-473f-93f8-f1a244c8ec78 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:02.068815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e229f3a8-3ce7-473f-93f8-f1a244c8ec78 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:02.077393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e229f3a8-3ce7-473f-93f8-f1a244c8ec78 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:02.081076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e229f3a8-3ce7-473f-93f8-f1a244c8ec78 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:02.085827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e229f3a8-3ce7-473f-93f8-f1a244c8ec78 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:02.088239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e229f3a8-3ce7-473f-93f8-f1a244c8ec78 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:02.599822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2ab070c3-88cd-4b04-b1d0-d1a06cd75d95 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:02.604438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2ab070c3-88cd-4b04-b1d0-d1a06cd75d95 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:02.629301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ab070c3-88cd-4b04-b1d0-d1a06cd75d95 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:02.630202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ab070c3-88cd-4b04-b1d0-d1a06cd75d95 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:02.641038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ab070c3-88cd-4b04-b1d0-d1a06cd75d95 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:02.644672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ab070c3-88cd-4b04-b1d0-d1a06cd75d95 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:02.720828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e229f3a8-3ce7-473f-93f8-f1a244c8ec78 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:02.734449 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e229f3a8-3ce7-473f-93f8-f1a244c8ec78 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.678442 Jul 26 14:04:02.735044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 200/332] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:02 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:03.198126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2ab070c3-88cd-4b04-b1d0-d1a06cd75d95 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:03.216917 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2ab070c3-88cd-4b04-b1d0-d1a06cd75d95 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1318 microversion: 2.1 time: 0.632891 Jul 26 14:04:03.220138 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 133/333] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:02 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:03.780055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-528ae952-f1ba-41a0-bbf3-e819dd147d18 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:03.781166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-528ae952-f1ba-41a0-bbf3-e819dd147d18 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:03.798021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-42e7922e-ae26-4722-9ec7-bae70822bde0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:03.798795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-42e7922e-ae26-4722-9ec7-bae70822bde0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:03.806113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-528ae952-f1ba-41a0-bbf3-e819dd147d18 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:03.806937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-528ae952-f1ba-41a0-bbf3-e819dd147d18 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:03.821678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42e7922e-ae26-4722-9ec7-bae70822bde0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:03.822931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-528ae952-f1ba-41a0-bbf3-e819dd147d18 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:03.823396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-528ae952-f1ba-41a0-bbf3-e819dd147d18 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:03.828074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42e7922e-ae26-4722-9ec7-bae70822bde0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:03.829201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42e7922e-ae26-4722-9ec7-bae70822bde0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:03.829774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42e7922e-ae26-4722-9ec7-bae70822bde0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:04.299763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-528ae952-f1ba-41a0-bbf3-e819dd147d18 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:04.337924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-42e7922e-ae26-4722-9ec7-bae70822bde0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:04.344074 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-528ae952-f1ba-41a0-bbf3-e819dd147d18 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.570627 Jul 26 14:04:04.352638 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-42e7922e-ae26-4722-9ec7-bae70822bde0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 200 len: 1590 microversion: 2.1 time: 0.561430 Jul 26 14:04:04.362659 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 134/334] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:03 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 1590 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:04.363578 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 201/335] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:03 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:04.376133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-adcad665-9c97-495e-b28e-d130f3efe695 req-40c65d8b-27dd-445b-b4a8-890816440544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae", "tag": "04498d04-b08b-4461-aadb-a16fe8c57ea4"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:04.402268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-adcad665-9c97-495e-b28e-d130f3efe695 req-40c65d8b-27dd-445b-b4a8-890816440544 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:04.403111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-adcad665-9c97-495e-b28e-d130f3efe695 req-40c65d8b-27dd-445b-b4a8-890816440544 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:04.432711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-710d6444-5445-4f8e-829e-4df946bb2110 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:04.434563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-710d6444-5445-4f8e-829e-4df946bb2110 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:04.447324 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-adcad665-9c97-495e-b28e-d130f3efe695 req-40c65d8b-27dd-445b-b4a8-890816440544 service nova] Creating event network-changed:04498d04-b08b-4461-aadb-a16fe8c57ea4 for instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae on n-h1-833090-9 Jul 26 14:04:04.448483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-710d6444-5445-4f8e-829e-4df946bb2110 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:04.449176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-710d6444-5445-4f8e-829e-4df946bb2110 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:04.450251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-710d6444-5445-4f8e-829e-4df946bb2110 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:04.450955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-710d6444-5445-4f8e-829e-4df946bb2110 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:04.462766 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-adcad665-9c97-495e-b28e-d130f3efe695 req-40c65d8b-27dd-445b-b4a8-890816440544 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096426 Jul 26 14:04:04.465928 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 135/336] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:04.803801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-710d6444-5445-4f8e-829e-4df946bb2110 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:04.817274 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-710d6444-5445-4f8e-829e-4df946bb2110 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1467 microversion: 2.1 time: 0.448205 Jul 26 14:04:04.820551 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 202/337] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:04 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1467 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:04.874057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e3d8b1e5-46de-4dfc-a209-575b31996764 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:04.877773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e3d8b1e5-46de-4dfc-a209-575b31996764 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:04.903746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=15 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:04.910434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3d8b1e5-46de-4dfc-a209-575b31996764 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:04.911147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3d8b1e5-46de-4dfc-a209-575b31996764 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:04.914609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3d8b1e5-46de-4dfc-a209-575b31996764 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:04.915996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3d8b1e5-46de-4dfc-a209-575b31996764 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:05.141267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-e3d8b1e5-46de-4dfc-a209-575b31996764 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lazy-loading 'flavor' on Instance uuid 4ec88f45-f830-436b-8322-fddddf7c492a {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:04:05.320545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:05.472256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:05.538665 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e3d8b1e5-46de-4dfc-a209-575b31996764 tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a/action" status: 202 len: 0 microversion: 2.1 time: 0.673165 Jul 26 14:04:05.542485 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 136/338] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:04:04 2022] POST /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:04:05.563338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-046a8383-bb23-4b51-b71d-a13f974b6602 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:05.578932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-046a8383-bb23-4b51-b71d-a13f974b6602 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:05.603032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-046a8383-bb23-4b51-b71d-a13f974b6602 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:05.610887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-046a8383-bb23-4b51-b71d-a13f974b6602 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:05.611758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-046a8383-bb23-4b51-b71d-a13f974b6602 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:05.612363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-046a8383-bb23-4b51-b71d-a13f974b6602 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:06.143525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-046a8383-bb23-4b51-b71d-a13f974b6602 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:06.159525 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-046a8383-bb23-4b51-b71d-a13f974b6602 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.608086 Jul 26 14:04:06.161571 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 137/339] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:05 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:06.171012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-80455830-6a97-45c3-9856-8f6314ee7128 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:06.173268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-80455830-6a97-45c3-9856-8f6314ee7128 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:06.198317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80455830-6a97-45c3-9856-8f6314ee7128 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:06.204806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80455830-6a97-45c3-9856-8f6314ee7128 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:06.207551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80455830-6a97-45c3-9856-8f6314ee7128 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:06.210793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80455830-6a97-45c3-9856-8f6314ee7128 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:06.402397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2be5d820-885d-4ec4-9ab5-a4e443a07ca3 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Action: 'update', calling method: .version_select at 0x7f87949adf70>, body: {"quota_set": {"ram": "5120"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:06.790127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80455830-6a97-45c3-9856-8f6314ee7128 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:06.810877 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-80455830-6a97-45c3-9856-8f6314ee7128 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1475 microversion: 2.1 time: 0.646250 Jul 26 14:04:06.820998 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 138/340] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:06 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1475 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:07.264951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be5d820-885d-4ec4-9ab5-a4e443a07ca3 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:07.267851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be5d820-885d-4ec4-9ab5-a4e443a07ca3 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:07.277088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be5d820-885d-4ec4-9ab5-a4e443a07ca3 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:07.282096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be5d820-885d-4ec4-9ab5-a4e443a07ca3 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:07.311497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=11 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:07.545531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0761e1ff-ab69-46bb-b5cf-1a47abcc2f00 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-722301528", "ram": 512, "vcpus": 1, "disk": 10, "id": 1783845031, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:07.554458 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:07.554458 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:04:07.558118 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2be5d820-885d-4ec4-9ab5-a4e443a07ca3 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/32497cdd855543f69c1cfbfe2e13a3a0" status: 200 len: 148 microversion: 2.57 time: 2.309044 Jul 26 14:04:07.570295 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 203/341] 10.222.0.70 () {62 vars in 1303 bytes} [Tue Jul 26 14:04:05 2022] PUT /compute/v2.1/os-quota-sets/32497cdd855543f69c1cfbfe2e13a3a0 => generated 148 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:04:07.589464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7d839fb0-22da-46ec-8b8c-ca302c0ca640 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:07.591234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7d839fb0-22da-46ec-8b8c-ca302c0ca640 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:07.608499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d839fb0-22da-46ec-8b8c-ca302c0ca640 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:07.611279 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0761e1ff-ab69-46bb-b5cf-1a47abcc2f00 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.788495 Jul 26 14:04:07.615203 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 139/342] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:04:06 2022] POST /compute/v2.1/flavors => generated 415 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:07.622492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d839fb0-22da-46ec-8b8c-ca302c0ca640 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:07.625107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d839fb0-22da-46ec-8b8c-ca302c0ca640 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:07.625688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d839fb0-22da-46ec-8b8c-ca302c0ca640 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:07.628876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b935f528-ae31-4dfb-8f98-19181515cd71 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Calling method '.version_select at 0x7f8794b6caf0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:07.900711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7d839fb0-22da-46ec-8b8c-ca302c0ca640 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:07.912324 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7d839fb0-22da-46ec-8b8c-ca302c0ca640 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.339722 Jul 26 14:04:07.913963 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 204/343] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:07 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:07.922639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c11add07-d73a-47f3-9b6c-7b64ff35fef1 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:07.926339 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:07.926339 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:07.964288 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c11add07-d73a-47f3-9b6c-7b64ff35fef1 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1783845031/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047854 Jul 26 14:04:07.966170 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 205/344] 10.222.0.70 () {60 vars in 1224 bytes} [Tue Jul 26 14:04:07 2022] POST /compute/v2.1/flavors/1783845031/os-extra_specs => generated 66 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:07.975645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d1d363f0-e0b9-466d-a62e-5ec1f443e83d tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:07.976861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d1d363f0-e0b9-466d-a62e-5ec1f443e83d tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:07.985077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=81,nova_api:DELETE=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:07.988163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1d363f0-e0b9-466d-a62e-5ec1f443e83d tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:07.988896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1d363f0-e0b9-466d-a62e-5ec1f443e83d tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:07.990030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1d363f0-e0b9-466d-a62e-5ec1f443e83d tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:07.991226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1d363f0-e0b9-466d-a62e-5ec1f443e83d tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:08.215650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d1d363f0-e0b9-466d-a62e-5ec1f443e83d tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:08.231074 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d1d363f0-e0b9-466d-a62e-5ec1f443e83d tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1458 microversion: 2.1 time: 0.262326 Jul 26 14:04:08.252568 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 206/345] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:07 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1458 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:08.439392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b935f528-ae31-4dfb-8f98-19181515cd71 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:08.440213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b935f528-ae31-4dfb-8f98-19181515cd71 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:08.441635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b935f528-ae31-4dfb-8f98-19181515cd71 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:08.447545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b935f528-ae31-4dfb-8f98-19181515cd71 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:08.523116 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b935f528-ae31-4dfb-8f98-19181515cd71 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/32497cdd855543f69c1cfbfe2e13a3a0/detail" status: 200 len: 463 microversion: 2.57 time: 0.904097 Jul 26 14:04:08.536659 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 140/346] 10.222.0.70 () {60 vars in 1304 bytes} [Tue Jul 26 14:04:07 2022] GET /compute/v2.1/os-quota-sets/32497cdd855543f69c1cfbfe2e13a3a0/detail => generated 463 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:04:08.561275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6c75d391-9f48-47ff-b224-8cb1c286c06f tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:08.564916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6c75d391-9f48-47ff-b224-8cb1c286c06f tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:08.628489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c75d391-9f48-47ff-b224-8cb1c286c06f tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:08.634376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c75d391-9f48-47ff-b224-8cb1c286c06f tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:08.642737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c75d391-9f48-47ff-b224-8cb1c286c06f tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:08.661567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c75d391-9f48-47ff-b224-8cb1c286c06f tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:09.152000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b674dc37-228c-4b04-8b7b-092fb614cbc9 tempest-FlavorsExtraSpecsTestJSON-1702118415 tempest-FlavorsExtraSpecsTestJSON-1702118415-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:09.169877 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b674dc37-228c-4b04-8b7b-092fb614cbc9 tempest-FlavorsExtraSpecsTestJSON-1702118415 tempest-FlavorsExtraSpecsTestJSON-1702118415-project] 10.222.0.70 "GET /compute/v2.1/flavors/1783845031/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.913105 Jul 26 14:04:09.175370 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 207/347] 10.222.0.70 () {58 vars in 1203 bytes} [Tue Jul 26 14:04:08 2022] GET /compute/v2.1/flavors/1783845031/os-extra_specs => generated 66 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:09.190763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57b037aa-af28-4da6-bccf-d7dc42ec9ed6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:09.194730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-57b037aa-af28-4da6-bccf-d7dc42ec9ed6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:09.210162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57b037aa-af28-4da6-bccf-d7dc42ec9ed6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:09.216160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57b037aa-af28-4da6-bccf-d7dc42ec9ed6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:09.217461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57b037aa-af28-4da6-bccf-d7dc42ec9ed6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:09.218371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57b037aa-af28-4da6-bccf-d7dc42ec9ed6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:09.857501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-57b037aa-af28-4da6-bccf-d7dc42ec9ed6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:09.876982 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57b037aa-af28-4da6-bccf-d7dc42ec9ed6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.699894 Jul 26 14:04:09.894598 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 208/348] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:09 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:09.910412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ca35e82-fc98-4c02-a943-5f581f3e8fb1 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:09.916093 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:09.916093 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:09.982162 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ca35e82-fc98-4c02-a943-5f581f3e8fb1 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1783845031/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.084136 Jul 26 14:04:09.988581 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 209/349] 10.222.0.70 () {60 vars in 1224 bytes} [Tue Jul 26 14:04:09 2022] POST /compute/v2.1/flavors/1783845031/os-extra_specs => generated 66 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:10.083034 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6c75d391-9f48-47ff-b224-8cb1c286c06f tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1609 microversion: 2.1 time: 1.545162 Jul 26 14:04:10.083813 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 141/350] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:08 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1609 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:10.110081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d4ce1bcb-a900-4d8c-b5d5-ec56c3035476 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Action: 'update', calling method: .version_select at 0x7f8794732af0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:10.539521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d965ee3b-cd28-44ad-b13e-122e79d13f4a tempest-AZAdminNegativeTestJSON-2075496322 tempest-AZAdminNegativeTestJSON-2075496322-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:10.541141 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:10.541141 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:10.543280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d965ee3b-cd28-44ad-b13e-122e79d13f4a tempest-AZAdminNegativeTestJSON-2075496322 tempest-AZAdminNegativeTestJSON-2075496322-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'bc9ed135d1fb450ab15a0433990bc769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b813265a84a4a438b103f22d5c032fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d965ee3b-cd28-44ad-b13e-122e79d13f4a tempest-AZAdminNegativeTestJSON-2075496322 tempest-AZAdminNegativeTestJSON-2075496322-project] Request method failure captured: Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RWTqCafNiw9Nhm6E-nP4AqyMJEmvNdqMRhY9e_DVU4nSDVwnR0N_r0IwPqL0uKLxFblXZ9TJeV39ba1s-LiVvnwjCvWNo-o1eHoY1qL9RoKxnbONCWqrh7u6jaJPdCYLadCQ0zrfacWyDelVPo5rCZRykbHW4zY2ho9BHzRhpXwXY Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8b813265a84a4a438b103f22d5c032fc Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AZAdminNegativeTestJSON-2075496322 Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:10.551671 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b813265a84a4a438b103f22d5c032fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b813265a84a4a438b103f22d5c032fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b813265a84a4a438b103f22d5c032fc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b813265a84a4a438b103f22d5c032fc"}]}] Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AZAdminNegativeTestJSON-2075496322 Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8b813265a84a4a438b103f22d5c032fc Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-2075496322 Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AZAdminNegativeTestJSON-2075496322-project Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: bc9ed135d1fb450ab15a0433990bc769 Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AZAdminNegativeTestJSON-2075496322-project Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 26 14:04:10.553225 n-d-833090-9 devstack@n-api.service[119479]: action_args: {} Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:04:10.554216 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 26 14:04:10.556096 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:10.559895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d965ee3b-cd28-44ad-b13e-122e79d13f4a tempest-AZAdminNegativeTestJSON-2075496322 tempest-AZAdminNegativeTestJSON-2075496322-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:10.566082 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d965ee3b-cd28-44ad-b13e-122e79d13f4a tempest-AZAdminNegativeTestJSON-2075496322 tempest-AZAdminNegativeTestJSON-2075496322-project] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.579907 Jul 26 14:04:10.576804 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 210/351] 10.222.0.70 () {58 vars in 1185 bytes} [Tue Jul 26 14:04:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 592 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:10.611936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e362e963-3f09-42f9-a1ab-958a8fc92b4e tempest-FlavorsExtraSpecsTestJSON-1702118415 tempest-FlavorsExtraSpecsTestJSON-1702118415-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:10.639477 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e362e963-3f09-42f9-a1ab-958a8fc92b4e tempest-FlavorsExtraSpecsTestJSON-1702118415 tempest-FlavorsExtraSpecsTestJSON-1702118415-project] 10.222.0.70 "GET /compute/v2.1/flavors/1783845031/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.046728 Jul 26 14:04:10.641034 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 211/352] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:04:10 2022] GET /compute/v2.1/flavors/1783845031/os-extra_specs/hw:numa_nodes => generated 22 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:10.652729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2c918b1b-b8ba-4f70-b77d-d160bff170df tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:10.663222 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:10.663222 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:10.665656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c918b1b-b8ba-4f70-b77d-d160bff170df tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:10.666346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c918b1b-b8ba-4f70-b77d-d160bff170df tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:10.667607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c918b1b-b8ba-4f70-b77d-d160bff170df tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:10.668277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c918b1b-b8ba-4f70-b77d-d160bff170df tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:10.791277 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2c918b1b-b8ba-4f70-b77d-d160bff170df tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.147969 Jul 26 14:04:10.792751 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 212/353] 10.222.0.70 () {58 vars in 1176 bytes} [Tue Jul 26 14:04:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:10.806836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c16232e3-a944-4608-8390-a914d7e8b992 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:10.814369 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:10.814369 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:10.855044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4ce1bcb-a900-4d8c-b5d5-ec56c3035476 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:10.856596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4ce1bcb-a900-4d8c-b5d5-ec56c3035476 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:10.860978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4ce1bcb-a900-4d8c-b5d5-ec56c3035476 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:10.873918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4ce1bcb-a900-4d8c-b5d5-ec56c3035476 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:10.906073 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c16232e3-a944-4608-8390-a914d7e8b992 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1783845031/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.109394 Jul 26 14:04:10.907610 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 213/354] 10.222.0.70 () {60 vars in 1224 bytes} [Tue Jul 26 14:04:10 2022] POST /compute/v2.1/flavors/1783845031/os-extra_specs => generated 66 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:10.927057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-9", "block_migration": true, "disk_over_commit": false}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:10.930282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:10.937645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:10.939098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:10.940734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:10.941550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:10.993007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Lazy-loading 'flavor' on Instance uuid 4ec88f45-f830-436b-8322-fddddf7c492a {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:04:11.005923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4ce1bcb-a900-4d8c-b5d5-ec56c3035476 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:11.006841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4ce1bcb-a900-4d8c-b5d5-ec56c3035476 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:11.008178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4ce1bcb-a900-4d8c-b5d5-ec56c3035476 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:11.008885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4ce1bcb-a900-4d8c-b5d5-ec56c3035476 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:11.031333 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 4ec88f45-f830-436b-8322-fddddf7c492a while it is in vm_state suspended Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Request method failure captured: Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a/action HTTP/1.1 Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 97 Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Qeg9SexXn7kINnVOgDkemP5cdCMNB6NyxLfNOY3oVEn5hY7N71KiINwwKus2gl726k6ppoqIi1PBvbgp4FcYThRmLZ1Zx8lFMB7B4GMYm-BA9U9snPlB_Yq29_qflwNfPEy65H7djXigh5zZorvbMUbOF3RWgHSWKXen30c3i7Lo0 Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2ad377767b364cbca24180aa0d4c929b Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-LiveMigrationNegativeTest-1998763502 Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:04:11.038702 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2ad377767b364cbca24180aa0d4c929b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2ad377767b364cbca24180aa0d4c929b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2ad377767b364cbca24180aa0d4c929b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2ad377767b364cbca24180aa0d4c929b"}]}] Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-LiveMigrationNegativeTest-1998763502 Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2ad377767b364cbca24180aa0d4c929b Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1998763502 Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-LiveMigrationNegativeTest-1998763502-project-admin Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8416ab1cb5e04d1892930cbb6ef80b43 Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-LiveMigrationNegativeTest-1998763502-project-admin Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: {"os-migrateLive": {"host": "n-h1-833090-9", "block_migration": true, "disk_over_commit": false}} Jul 26 14:04:11.041984 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: exception: Cannot 'os-migrateLive' instance 4ec88f45-f830-436b-8322-fddddf7c492a while it is in vm_state suspended Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4ec88f45-f830-436b-8322-fddddf7c492a', 'body': {'os-migrateLive': {'host': 'n-h1-833090-9', 'block_migration': True, 'disk_over_commit': False}}} Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 26 14:04:11.043351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4ec88f45-f830-436b-8322-fddddf7c492a in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:11.045401 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 4ec88f45-f830-436b-8322-fddddf7c492a while it is in vm_state suspended Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 4ec88f45-f830-436b-8322-fddddf7c492a while it is in vm_state suspended Jul 26 14:04:11.047562 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:11.056125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 4ec88f45-f830-436b-8322-fddddf7c492a while it is in vm_state suspended {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:11.072590 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4ddd3fd4-f5d4-4f7e-b64d-7a86b08409fb tempest-LiveMigrationNegativeTest-1998763502 tempest-LiveMigrationNegativeTest-1998763502-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a/action" status: 409 len: 155 microversion: 2.1 time: 0.150189 Jul 26 14:04:11.074402 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 214/355] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:04:10 2022] POST /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a/action => generated 155 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:04:11.105807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9f4446d2-a478-4408-9bc3-1c881e14fdc5 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:11.141593 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9f4446d2-a478-4408-9bc3-1c881e14fdc5 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1783845031/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064701 Jul 26 14:04:11.155538 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 215/356] 10.222.0.70 () {58 vars in 1203 bytes} [Tue Jul 26 14:04:11 2022] GET /compute/v2.1/flavors/1783845031/os-extra_specs => generated 66 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:11.170095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a04bf0ce-7cd1-4488-a88b-b8de08c1a355 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:11.172467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a04bf0ce-7cd1-4488-a88b-b8de08c1a355 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:11.188863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a04bf0ce-7cd1-4488-a88b-b8de08c1a355 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:11.189537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a04bf0ce-7cd1-4488-a88b-b8de08c1a355 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:11.190570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a04bf0ce-7cd1-4488-a88b-b8de08c1a355 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:11.191199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a04bf0ce-7cd1-4488-a88b-b8de08c1a355 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:11.273010 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d4ce1bcb-a900-4d8c-b5d5-ec56c3035476 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/32497cdd855543f69c1cfbfe2e13a3a0?user_id=7fdf8a41d6a44d24a9acb727e1131d4c" status: 200 len: 148 microversion: 2.57 time: 1.168251 Jul 26 14:04:11.276006 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 142/357] 10.222.0.70 () {62 vars in 1384 bytes} [Tue Jul 26 14:04:10 2022] PUT /compute/v2.1/os-quota-sets/32497cdd855543f69c1cfbfe2e13a3a0?user_id=7fdf8a41d6a44d24a9acb727e1131d4c => generated 148 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:04:11.282433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b7850351-63d7-4673-98a7-819676a91aa0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:11.283167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b7850351-63d7-4673-98a7-819676a91aa0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:11.310852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7850351-63d7-4673-98a7-819676a91aa0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:11.311525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7850351-63d7-4673-98a7-819676a91aa0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:11.312868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7850351-63d7-4673-98a7-819676a91aa0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:11.319854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7850351-63d7-4673-98a7-819676a91aa0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:11.379424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b7850351-63d7-4673-98a7-819676a91aa0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:04:11.590585 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b7850351-63d7-4673-98a7-819676a91aa0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 204 len: 0 microversion: 2.1 time: 0.312485 Jul 26 14:04:11.596443 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 143/358] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:04:11 2022] DELETE /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:04:11.611180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2d243931-e8f7-4a60-a769-a7480e53a137 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:11.618016 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:11.618016 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:04:11.687898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a04bf0ce-7cd1-4488-a88b-b8de08c1a355 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:11.690937 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2d243931-e8f7-4a60-a769-a7480e53a137 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1783845031/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.091313 Jul 26 14:04:11.692639 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 144/359] 10.222.0.70 () {60 vars in 1265 bytes} [Tue Jul 26 14:04:11 2022] PUT /compute/v2.1/flavors/1783845031/os-extra_specs/hw:numa_nodes => generated 22 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:11.698674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bd68fe6b-55da-4d8d-8890-748f010000e9 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] Calling method '.version_select at 0x7f879474b940>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:11.706987 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a04bf0ce-7cd1-4488-a88b-b8de08c1a355 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.547991 Jul 26 14:04:11.731482 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 216/360] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:11 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:11.738886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f3bc88e-0f28-4974-a789-611f2fc640b5 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:11.739539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4f3bc88e-0f28-4974-a789-611f2fc640b5 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:11.767372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f3bc88e-0f28-4974-a789-611f2fc640b5 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:11.768725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f3bc88e-0f28-4974-a789-611f2fc640b5 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:11.770841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f3bc88e-0f28-4974-a789-611f2fc640b5 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:11.771763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f3bc88e-0f28-4974-a789-611f2fc640b5 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:12.206893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:12.233861 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bd68fe6b-55da-4d8d-8890-748f010000e9 tempest-QuotasAdminTestV257-503350107 tempest-QuotasAdminTestV257-503350107-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/32497cdd855543f69c1cfbfe2e13a3a0?user_id=7fdf8a41d6a44d24a9acb727e1131d4c" status: 200 len: 190 microversion: 2.57 time: 0.539638 Jul 26 14:04:12.242629 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 145/361] 10.222.0.70 () {60 vars in 1364 bytes} [Tue Jul 26 14:04:11 2022] GET /compute/v2.1/os-quota-sets/32497cdd855543f69c1cfbfe2e13a3a0?user_id=7fdf8a41d6a44d24a9acb727e1131d4c => generated 190 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:04:12.249740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e91ff559-7178-418a-af11-3da8bcd084f8 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:12.271991 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e91ff559-7178-418a-af11-3da8bcd084f8 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1783845031/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026748 Jul 26 14:04:12.273342 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 146/362] 10.222.0.70 () {58 vars in 1203 bytes} [Tue Jul 26 14:04:12 2022] GET /compute/v2.1/flavors/1783845031/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:12.362448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4f3bc88e-0f28-4974-a789-611f2fc640b5 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:12.376595 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4f3bc88e-0f28-4974-a789-611f2fc640b5 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1464 microversion: 2.1 time: 0.644418 Jul 26 14:04:12.379825 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 217/363] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:11 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1464 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:12.401999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b698ce11-4541-4191-8eaa-8485c6b3d798 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:12.403816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-887513870", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:12.409053 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:12.409053 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:12.465297 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b698ce11-4541-4191-8eaa-8485c6b3d798 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1783845031/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.082047 Jul 26 14:04:12.471327 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 218/364] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:04:12 2022] DELETE /compute/v2.1/flavors/1783845031/os-extra_specs/hw:numa_nodes => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:04:12.477523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50810108-dea6-430a-9f2e-38419c078f54 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:12.513008 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-50810108-dea6-430a-9f2e-38419c078f54 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1783845031/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.039874 Jul 26 14:04:12.519135 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 219/365] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:04:12 2022] DELETE /compute/v2.1/flavors/1783845031/os-extra_specs/hw:cpu_policy => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:04:12.524894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-378622bf-a275-4812-bd73-af8b93389cb2 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:12.536006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:04:12.542882 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-378622bf-a275-4812-bd73-af8b93389cb2 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1783845031/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022595 Jul 26 14:04:12.553207 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 220/366] 10.222.0.70 () {58 vars in 1203 bytes} [Tue Jul 26 14:04:12 2022] GET /compute/v2.1/flavors/1783845031/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:12.563604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-672397bc-42bb-4e7f-8895-5a2693da92a4 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:12.565404 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:12.565404 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:12.605826 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-672397bc-42bb-4e7f-8895-5a2693da92a4 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1783845031" status: 202 len: 0 microversion: 2.1 time: 0.049680 Jul 26 14:04:12.606519 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 221/367] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:04:12 2022] DELETE /compute/v2.1/flavors/1783845031 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:04:12.623110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-93aa4765-f4d7-4b58-bf46-5baeaa6a8091 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:12.714380 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-93aa4765-f4d7-4b58-bf46-5baeaa6a8091 tempest-FlavorsExtraSpecsTestJSON-1255146792 tempest-FlavorsExtraSpecsTestJSON-1255146792-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.101963 Jul 26 14:04:12.732089 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 222/368] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:04:12 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:12.743304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-97af2f7b-9008-4f0f-9967-ed795d034986 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:12.744499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-97af2f7b-9008-4f0f-9967-ed795d034986 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:12.754753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97af2f7b-9008-4f0f-9967-ed795d034986 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:12.755697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97af2f7b-9008-4f0f-9967-ed795d034986 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:12.757652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97af2f7b-9008-4f0f-9967-ed795d034986 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:12.758350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97af2f7b-9008-4f0f-9967-ed795d034986 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:13.230744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-97af2f7b-9008-4f0f-9967-ed795d034986 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:13.248079 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-97af2f7b-9008-4f0f-9967-ed795d034986 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.514175 Jul 26 14:04:13.254019 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 223/369] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:12 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:13.329197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:04:13.329912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:04:13.331078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:04:13.331702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:04:13.332672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:04:13.373487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:13.375094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:13.376790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:13.380653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:13.402986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9b760238-d9b7-4c85-8983-2cffa2661404 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:13.403657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9b760238-d9b7-4c85-8983-2cffa2661404 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:13.426466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b760238-d9b7-4c85-8983-2cffa2661404 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:13.431520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b760238-d9b7-4c85-8983-2cffa2661404 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:13.433267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b760238-d9b7-4c85-8983-2cffa2661404 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:13.437337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b760238-d9b7-4c85-8983-2cffa2661404 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:13.478494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Getting quotas for project b98f74644a4e4143a94639544a446934. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:04:13.498861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Getting quotas for user 4fd3638503c149d0a41f9ab0a4d57423 and project b98f74644a4e4143a94639544a446934. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:04:13.551132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:04:13.563926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:04:13.687185 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f88b912e-4936-4935-a011-358cb0e3a330 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411545 Jul 26 14:04:13.695512 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 147/370] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:04:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:04:13.704019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4babb9a1-1194-4dfa-92c7-7f8d8b3c0605 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:13.705583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4babb9a1-1194-4dfa-92c7-7f8d8b3c0605 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:13.898426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4babb9a1-1194-4dfa-92c7-7f8d8b3c0605 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:13.907416 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4babb9a1-1194-4dfa-92c7-7f8d8b3c0605 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1219 microversion: 2.1 time: 0.210034 Jul 26 14:04:13.916258 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 148/371] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:13 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1219 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:13.999598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9b760238-d9b7-4c85-8983-2cffa2661404 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:14.025248 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9b760238-d9b7-4c85-8983-2cffa2661404 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1464 microversion: 2.1 time: 0.625765 Jul 26 14:04:14.025868 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 224/372] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:13 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1464 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:14.288820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ed0ca473-4986-4756-ae68-77f252a93685 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:14.289752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ed0ca473-4986-4756-ae68-77f252a93685 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:14.304476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed0ca473-4986-4756-ae68-77f252a93685 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:14.307542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed0ca473-4986-4756-ae68-77f252a93685 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:14.310344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed0ca473-4986-4756-ae68-77f252a93685 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:14.312007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed0ca473-4986-4756-ae68-77f252a93685 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:14.945952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4657b00f-1ec0-4b98-84e0-61799db8cd1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:14.946873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4657b00f-1ec0-4b98-84e0-61799db8cd1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:14.960052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4657b00f-1ec0-4b98-84e0-61799db8cd1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:14.963070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4657b00f-1ec0-4b98-84e0-61799db8cd1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:14.968997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4657b00f-1ec0-4b98-84e0-61799db8cd1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:14.969678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4657b00f-1ec0-4b98-84e0-61799db8cd1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:15.002355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ed0ca473-4986-4756-ae68-77f252a93685 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:15.027063 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ed0ca473-4986-4756-ae68-77f252a93685 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.742661 Jul 26 14:04:15.028661 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 149/373] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:14 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:15.052166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4211fb68-aac2-403b-8a1d-aae85e6ebcb1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:15.056861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4211fb68-aac2-403b-8a1d-aae85e6ebcb1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:15.083085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4211fb68-aac2-403b-8a1d-aae85e6ebcb1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:15.083568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4211fb68-aac2-403b-8a1d-aae85e6ebcb1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:15.084775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4211fb68-aac2-403b-8a1d-aae85e6ebcb1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:15.090821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4211fb68-aac2-403b-8a1d-aae85e6ebcb1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:15.126209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4657b00f-1ec0-4b98-84e0-61799db8cd1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:15.138517 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4657b00f-1ec0-4b98-84e0-61799db8cd1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1215 microversion: 2.1 time: 0.198946 Jul 26 14:04:15.139423 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 225/374] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:14 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1215 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:15.430112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4211fb68-aac2-403b-8a1d-aae85e6ebcb1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:15.481928 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4211fb68-aac2-403b-8a1d-aae85e6ebcb1 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1464 microversion: 2.1 time: 0.437171 Jul 26 14:04:15.487813 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 150/375] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:15 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1464 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:15.785353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-be7b817b-64ee-4b87-a268-4fddbf69d1cc req-45f45c9f-f1b8-4e0f-bbe6-c81ba1b2c4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec88f45-f830-436b-8322-fddddf7c492a", "name": "network-vif-deleted", "tag": "7da372b7-918b-4213-8ae7-b55c28349eb7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:15.838512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-be7b817b-64ee-4b87-a268-4fddbf69d1cc req-45f45c9f-f1b8-4e0f-bbe6-c81ba1b2c4f3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:15.839262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-be7b817b-64ee-4b87-a268-4fddbf69d1cc req-45f45c9f-f1b8-4e0f-bbe6-c81ba1b2c4f3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:15.930352 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-be7b817b-64ee-4b87-a268-4fddbf69d1cc req-45f45c9f-f1b8-4e0f-bbe6-c81ba1b2c4f3 service nova] Creating event network-vif-deleted:7da372b7-918b-4213-8ae7-b55c28349eb7 for instance 4ec88f45-f830-436b-8322-fddddf7c492a on n-h2-833090-9 Jul 26 14:04:15.966198 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-be7b817b-64ee-4b87-a268-4fddbf69d1cc req-45f45c9f-f1b8-4e0f-bbe6-c81ba1b2c4f3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189702 Jul 26 14:04:16.001759 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 226/376] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:16.056029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-08a74575-87e1-4164-aa65-167d59a74c73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:16.056736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-08a74575-87e1-4164-aa65-167d59a74c73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:16.084225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08a74575-87e1-4164-aa65-167d59a74c73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:16.085506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08a74575-87e1-4164-aa65-167d59a74c73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:16.086693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08a74575-87e1-4164-aa65-167d59a74c73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:16.087452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08a74575-87e1-4164-aa65-167d59a74c73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:16.194725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4bc2f003-41db-4c7e-93a1-3d1bcf3c3f7d tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:16.201353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4bc2f003-41db-4c7e-93a1-3d1bcf3c3f7d tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:16.214289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bc2f003-41db-4c7e-93a1-3d1bcf3c3f7d tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:16.215840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bc2f003-41db-4c7e-93a1-3d1bcf3c3f7d tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:16.217216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bc2f003-41db-4c7e-93a1-3d1bcf3c3f7d tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:16.218728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bc2f003-41db-4c7e-93a1-3d1bcf3c3f7d tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:16.396422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4bc2f003-41db-4c7e-93a1-3d1bcf3c3f7d tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:16.417044 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4bc2f003-41db-4c7e-93a1-3d1bcf3c3f7d tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1277 microversion: 2.1 time: 0.246262 Jul 26 14:04:16.420566 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 227/377] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:16 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1277 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:16.524216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:16.525905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:16.551912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:16.555221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:16.556972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:16.557757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:16.656856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:16.694629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:16.695555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:16.696282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lazy-loading 'fault' on Instance uuid 4ec88f45-f830-436b-8322-fddddf7c492a {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:04:16.702248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-08a74575-87e1-4164-aa65-167d59a74c73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:16.753998 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-08a74575-87e1-4164-aa65-167d59a74c73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.704253 Jul 26 14:04:16.788450 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 151/378] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:16 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:16.854100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:16.876146 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1b5b292e-5180-497d-9dfd-20b020bee289 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 200 len: 1308 microversion: 2.1 time: 0.359157 Jul 26 14:04:16.898068 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 228/379] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:16 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:17.457331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a5394149-742d-4d3b-a0c1-b174c00c4657 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:17.458116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a5394149-742d-4d3b-a0c1-b174c00c4657 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:17.478618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5394149-742d-4d3b-a0c1-b174c00c4657 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:17.480883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5394149-742d-4d3b-a0c1-b174c00c4657 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:17.486729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5394149-742d-4d3b-a0c1-b174c00c4657 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:17.487636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5394149-742d-4d3b-a0c1-b174c00c4657 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:17.707704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a5394149-742d-4d3b-a0c1-b174c00c4657 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:17.718342 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a5394149-742d-4d3b-a0c1-b174c00c4657 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1277 microversion: 2.1 time: 0.267370 Jul 26 14:04:17.718996 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 152/380] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:17 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:17.817810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ad2b900-8902-477a-99af-867b89f62719 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:17.821568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ad2b900-8902-477a-99af-867b89f62719 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:17.829663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:17.832765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ad2b900-8902-477a-99af-867b89f62719 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:17.836463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ad2b900-8902-477a-99af-867b89f62719 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:17.838050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ad2b900-8902-477a-99af-867b89f62719 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:17.838741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ad2b900-8902-477a-99af-867b89f62719 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:17.911936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8c24e977-38e1-4db4-bb12-77f496940000 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:17.914068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8c24e977-38e1-4db4-bb12-77f496940000 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: 4ec88f45-f830-436b-8322-fddddf7c492a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:17.927655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c24e977-38e1-4db4-bb12-77f496940000 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:17.934791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c24e977-38e1-4db4-bb12-77f496940000 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:17.935903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c24e977-38e1-4db4-bb12-77f496940000 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:17.937913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c24e977-38e1-4db4-bb12-77f496940000 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:17.987643 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8c24e977-38e1-4db4-bb12-77f496940000 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] HTTP exception thrown: Instance 4ec88f45-f830-436b-8322-fddddf7c492a could not be found. Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8c24e977-38e1-4db4-bb12-77f496940000 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Request method failure captured: Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a HTTP/1.1 Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_Qbxw9xhT9jYn3ggwqztQZU5G4pN_E1x3REYoDIV6kw2y_DTyzNLAqfZZDsXbumw6At-lpPkI91kx_v9x9K_YGbKWzho8-YTubc0OMG8_2-b6vhEWfu7RXC5lmqPgWkckg68-_Ge9KAq-G-sIp60GEHpnvbMgZ39Vy32eiwh8gboJo Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4d886dd6f815451886f280083ad22868 Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-LiveMigrationNegativeTest-898493123 Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:04:17.990121 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d886dd6f815451886f280083ad22868"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d886dd6f815451886f280083ad22868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d886dd6f815451886f280083ad22868", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d886dd6f815451886f280083ad22868"}]}] Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-LiveMigrationNegativeTest-898493123 Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4d886dd6f815451886f280083ad22868 Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-898493123 Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-LiveMigrationNegativeTest-898493123-project Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 20efe46c2a984870a7fcc18ba702be15 Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-LiveMigrationNegativeTest-898493123-project Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 4ec88f45-f830-436b-8322-fddddf7c492a could not be found. Jul 26 14:04:17.993135 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4ec88f45-f830-436b-8322-fddddf7c492a'} Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec88f45-f830-436b-8322-fddddf7c492a could not be found. Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:17.994339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec88f45-f830-436b-8322-fddddf7c492a could not be found. Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec88f45-f830-436b-8322-fddddf7c492a could not be found. Jul 26 14:04:17.996188 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:17.998715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8c24e977-38e1-4db4-bb12-77f496940000 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Returning 404 to user: Instance 4ec88f45-f830-436b-8322-fddddf7c492a could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:17.999650 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8c24e977-38e1-4db4-bb12-77f496940000 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a" status: 404 len: 111 microversion: 2.1 time: 0.098161 Jul 26 14:04:18.004672 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 153/381] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:17 2022] GET /compute/v2.1/servers/4ec88f45-f830-436b-8322-fddddf7c492a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:04:18.012484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-26ca86cd-88a9-49dc-8049-05f09924f0d4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:18.013463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-26ca86cd-88a9-49dc-8049-05f09924f0d4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:18.023914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26ca86cd-88a9-49dc-8049-05f09924f0d4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:18.026225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26ca86cd-88a9-49dc-8049-05f09924f0d4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:18.027464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26ca86cd-88a9-49dc-8049-05f09924f0d4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:18.029948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26ca86cd-88a9-49dc-8049-05f09924f0d4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:18.074404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-26ca86cd-88a9-49dc-8049-05f09924f0d4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:04:18.234011 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-26ca86cd-88a9-49dc-8049-05f09924f0d4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 204 len: 0 microversion: 2.1 time: 0.227698 Jul 26 14:04:18.234610 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 154/382] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:04:18 2022] DELETE /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:04:18.253361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6e721924-13c7-4448-904b-2fa9a8729e63 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:18.258738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6e721924-13c7-4448-904b-2fa9a8729e63 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:18.264033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7ad2b900-8902-477a-99af-867b89f62719 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:18.275714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e721924-13c7-4448-904b-2fa9a8729e63 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:18.278330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e721924-13c7-4448-904b-2fa9a8729e63 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:18.278531 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ad2b900-8902-477a-99af-867b89f62719 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.478124 Jul 26 14:04:18.280545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e721924-13c7-4448-904b-2fa9a8729e63 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:18.281324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e721924-13c7-4448-904b-2fa9a8729e63 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:18.283928 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 229/383] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:17 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:18.700767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6e721924-13c7-4448-904b-2fa9a8729e63 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:18.714849 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6e721924-13c7-4448-904b-2fa9a8729e63 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1473 microversion: 2.1 time: 0.471256 Jul 26 14:04:18.715442 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 155/384] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:18 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1473 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:18.762782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2134311b-fe55-45de-8968-61297aed2485 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:18.775062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2134311b-fe55-45de-8968-61297aed2485 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:18.816358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2134311b-fe55-45de-8968-61297aed2485 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:18.822889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2134311b-fe55-45de-8968-61297aed2485 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:18.824234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2134311b-fe55-45de-8968-61297aed2485 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:18.824963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2134311b-fe55-45de-8968-61297aed2485 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:19.061152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2134311b-fe55-45de-8968-61297aed2485 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:19.074827 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2134311b-fe55-45de-8968-61297aed2485 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1277 microversion: 2.1 time: 0.335201 Jul 26 14:04:19.076570 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 230/385] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:18 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1277 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:19.310683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-915358ff-5508-4c9c-ba20-dfe739f0f024 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:19.311634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-915358ff-5508-4c9c-ba20-dfe739f0f024 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:19.342827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-915358ff-5508-4c9c-ba20-dfe739f0f024 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:19.346789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-915358ff-5508-4c9c-ba20-dfe739f0f024 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:19.348573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-915358ff-5508-4c9c-ba20-dfe739f0f024 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:19.349482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-915358ff-5508-4c9c-ba20-dfe739f0f024 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:19.434998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:19.683015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-915358ff-5508-4c9c-ba20-dfe739f0f024 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:19.737720 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-915358ff-5508-4c9c-ba20-dfe739f0f024 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 0.421805 Jul 26 14:04:19.739501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2efe7978-c544-4aec-af5d-4d1b027d296f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:19.740395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2efe7978-c544-4aec-af5d-4d1b027d296f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:19.745459 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 156/386] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:19 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:19.767328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2efe7978-c544-4aec-af5d-4d1b027d296f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:19.768229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2efe7978-c544-4aec-af5d-4d1b027d296f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:19.769275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2efe7978-c544-4aec-af5d-4d1b027d296f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:19.774119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2efe7978-c544-4aec-af5d-4d1b027d296f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:20.059652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2efe7978-c544-4aec-af5d-4d1b027d296f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:20.070608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2efe7978-c544-4aec-af5d-4d1b027d296f tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1473 microversion: 2.1 time: 0.335663 Jul 26 14:04:20.087383 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 231/387] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:19 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1473 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:20.113454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dc6918e5-edc6-4580-84ac-d2ca69ed5307 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:20.114503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dc6918e5-edc6-4580-84ac-d2ca69ed5307 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:20.136730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc6918e5-edc6-4580-84ac-d2ca69ed5307 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:20.138773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc6918e5-edc6-4580-84ac-d2ca69ed5307 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:20.141227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc6918e5-edc6-4580-84ac-d2ca69ed5307 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:20.144650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc6918e5-edc6-4580-84ac-d2ca69ed5307 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:20.490697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dc6918e5-edc6-4580-84ac-d2ca69ed5307 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:20.504398 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dc6918e5-edc6-4580-84ac-d2ca69ed5307 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1319 microversion: 2.1 time: 0.394920 Jul 26 14:04:20.505227 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 157/388] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:20 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:20.769852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6b1a7bb5-28c8-4f04-837f-cb6469a29ba8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:20.770750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6b1a7bb5-28c8-4f04-837f-cb6469a29ba8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:20.788171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:20.793194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b1a7bb5-28c8-4f04-837f-cb6469a29ba8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:20.793707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b1a7bb5-28c8-4f04-837f-cb6469a29ba8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:20.794459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b1a7bb5-28c8-4f04-837f-cb6469a29ba8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:20.794911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b1a7bb5-28c8-4f04-837f-cb6469a29ba8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:21.093990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b020c8d-501d-4b2a-80f2-f4b876824ba4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:21.094956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b020c8d-501d-4b2a-80f2-f4b876824ba4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:21.109467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b020c8d-501d-4b2a-80f2-f4b876824ba4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:21.109934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b020c8d-501d-4b2a-80f2-f4b876824ba4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:21.124241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b020c8d-501d-4b2a-80f2-f4b876824ba4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:21.124912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b020c8d-501d-4b2a-80f2-f4b876824ba4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:21.899624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6b1a7bb5-28c8-4f04-837f-cb6469a29ba8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:21.914011 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6b1a7bb5-28c8-4f04-837f-cb6469a29ba8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 1.148817 Jul 26 14:04:21.915751 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 232/389] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:20 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:21.929181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-fb565fd5-950f-4b9c-960d-8c3ca900c47b req-f18acd9e-aeac-4fd0-bc7e-53d35fd2084e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981f15eb-5be0-4e4d-a32d-b0c2767da842", "tag": "9f8ea724-e72e-4f98-ad81-d7fd01389960"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:21.972250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fb565fd5-950f-4b9c-960d-8c3ca900c47b req-f18acd9e-aeac-4fd0-bc7e-53d35fd2084e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:21.974545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fb565fd5-950f-4b9c-960d-8c3ca900c47b req-f18acd9e-aeac-4fd0-bc7e-53d35fd2084e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:22.002964 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-fb565fd5-950f-4b9c-960d-8c3ca900c47b req-f18acd9e-aeac-4fd0-bc7e-53d35fd2084e service nova] Creating event network-changed:9f8ea724-e72e-4f98-ad81-d7fd01389960 for instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 on n-h1-833090-9 Jul 26 14:04:22.016837 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-fb565fd5-950f-4b9c-960d-8c3ca900c47b req-f18acd9e-aeac-4fd0-bc7e-53d35fd2084e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099593 Jul 26 14:04:22.017645 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 233/390] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:22.035104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-01f99ad1-b03b-4085-9570-79e82c32db50 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:22.036394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-01f99ad1-b03b-4085-9570-79e82c32db50 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:22.050965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01f99ad1-b03b-4085-9570-79e82c32db50 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:22.051427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01f99ad1-b03b-4085-9570-79e82c32db50 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:22.057039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01f99ad1-b03b-4085-9570-79e82c32db50 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:22.057563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01f99ad1-b03b-4085-9570-79e82c32db50 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:22.391110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b020c8d-501d-4b2a-80f2-f4b876824ba4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:22.412688 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b020c8d-501d-4b2a-80f2-f4b876824ba4 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1473 microversion: 2.1 time: 1.322109 Jul 26 14:04:22.424051 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 158/391] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:21 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1473 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:22.880052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae04306d-b95b-424b-89d0-29ad09f9d15b tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-753879881", "ram": 512, "vcpus": 1, "disk": 10, "id": 714998815, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:22.884327 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:22.884327 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:04:22.924435 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ae04306d-b95b-424b-89d0-29ad09f9d15b tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.506675 Jul 26 14:04:22.936913 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 159/392] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:04:22 2022] POST /compute/v2.1/flavors => generated 412 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:22.950299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9f0a53eb-4133-4e64-ab8d-9d81487ad913 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:22.952338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9f0a53eb-4133-4e64-ab8d-9d81487ad913 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:22.966325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f0a53eb-4133-4e64-ab8d-9d81487ad913 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:22.968205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f0a53eb-4133-4e64-ab8d-9d81487ad913 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:22.971153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f0a53eb-4133-4e64-ab8d-9d81487ad913 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:22.971768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f0a53eb-4133-4e64-ab8d-9d81487ad913 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:23.005309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-01f99ad1-b03b-4085-9570-79e82c32db50 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:23.020967 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-01f99ad1-b03b-4085-9570-79e82c32db50 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1319 microversion: 2.1 time: 0.999905 Jul 26 14:04:23.023816 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 234/393] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:22 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1319 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:23.417144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=9 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:23.602522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-159563c9-496a-48cb-a118-76f28f6706d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:23.660938 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-159563c9-496a-48cb-a118-76f28f6706d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] HTTP exception thrown: Flavor 714998815 has no extra specs with key hw:cpu_thread_policy. Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-159563c9-496a-48cb-a118-76f28f6706d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Request method failure captured: Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/flavors/714998815/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RiLT2IP3iP6MDZK4zhhv__fLTBzOSsC7OzG8UDju_dnmRxRhE1o4dRVZUoexhZzjuZjv5RXnsBn0rWOhBfYno2G4bv6nhszgMY7XFzyxwVkpFFu5t4TEihYc9jr3R6M1zhjQ4K5HQuWtZAofAj8n7WCB6qIvCmTLWiW9BVNpaEIbM Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ce046cb463b04c95b9a087ad2c660640 Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:23.664575 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ce046cb463b04c95b9a087ad2c660640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ce046cb463b04c95b9a087ad2c660640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ce046cb463b04c95b9a087ad2c660640", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ce046cb463b04c95b9a087ad2c660640"}]}] Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ce046cb463b04c95b9a087ad2c660640 Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 3ca6e291a501445cb124f78e3aeb8fac Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:23.667177 n-d-833090-9 devstack@n-api.service[119479]: exception: Flavor 714998815 has no extra specs with key hw:cpu_thread_policy. Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'flavor_id': '714998815', 'id': 'hw:cpu_thread_policy'} Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 714998815 has no extra specs with key hw:cpu_thread_policy. Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:23.669848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:23.672507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:23.672507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:23.672507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:23.672507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:23.672507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:23.672507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 714998815 has no extra specs with key hw:cpu_thread_policy. Jul 26 14:04:23.672507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:23.673371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-159563c9-496a-48cb-a118-76f28f6706d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Returning 404 to user: Flavor 714998815 has no extra specs with key hw:cpu_thread_policy. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:23.678371 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-159563c9-496a-48cb-a118-76f28f6706d3 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] 10.222.0.70 "GET /compute/v2.1/flavors/714998815/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.651646 Jul 26 14:04:23.680892 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 235/394] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:04:23 2022] GET /compute/v2.1/flavors/714998815/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 656 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:23.706410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6562c486-f52b-4557-a4a3-0008c4589aa3 req-9bef2064-66a2-4116-b37d-eceec85278b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd85b7d5-71df-48ab-b23a-adf63fcadd94", "name": "network-vif-deleted", "tag": "abde11f3-2227-40c0-b73b-c1ddf26f7086"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:23.749257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6562c486-f52b-4557-a4a3-0008c4589aa3 req-9bef2064-66a2-4116-b37d-eceec85278b3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:23.753289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6562c486-f52b-4557-a4a3-0008c4589aa3 req-9bef2064-66a2-4116-b37d-eceec85278b3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:23.786190 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6562c486-f52b-4557-a4a3-0008c4589aa3 req-9bef2064-66a2-4116-b37d-eceec85278b3 service nova] Creating event network-vif-deleted:abde11f3-2227-40c0-b73b-c1ddf26f7086 for instance cd85b7d5-71df-48ab-b23a-adf63fcadd94 on n-h2-833090-9 Jul 26 14:04:23.806342 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6562c486-f52b-4557-a4a3-0008c4589aa3 req-9bef2064-66a2-4116-b37d-eceec85278b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114991 Jul 26 14:04:23.807920 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 236/395] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:23.822159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:23.824035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:23.859536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:23.862669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:23.869730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:23.870781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:23.910719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=26 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:23.946024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:23.946812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:23.950094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lazy-loading 'fault' on Instance uuid cd85b7d5-71df-48ab-b23a-adf63fcadd94 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:04:23.953713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9f0a53eb-4133-4e64-ab8d-9d81487ad913 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:23.972559 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9f0a53eb-4133-4e64-ab8d-9d81487ad913 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 1.034130 Jul 26 14:04:23.975132 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 160/396] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:22 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:24.011019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f0ab5dd0-f5d7-4d27-9ee1-98820895729f tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:24.021542 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:24.021542 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:04:24.028458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f0ab5dd0-f5d7-4d27-9ee1-98820895729f tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '3ca6e291a501445cb124f78e3aeb8fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce046cb463b04c95b9a087ad2c660640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f0ab5dd0-f5d7-4d27-9ee1-98820895729f tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Request method failure captured: Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/flavors/714998815/os-extra_specs HTTP/1.1 Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 66 Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RiLT2IP3iP6MDZK4zhhv__fLTBzOSsC7OzG8UDju_dnmRxRhE1o4dRVZUoexhZzjuZjv5RXnsBn0rWOhBfYno2G4bv6nhszgMY7XFzyxwVkpFFu5t4TEihYc9jr3R6M1zhjQ4K5HQuWtZAofAj8n7WCB6qIvCmTLWiW9BVNpaEIbM Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ce046cb463b04c95b9a087ad2c660640 Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:04:24.033111 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ce046cb463b04c95b9a087ad2c660640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ce046cb463b04c95b9a087ad2c660640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ce046cb463b04c95b9a087ad2c660640", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ce046cb463b04c95b9a087ad2c660640"}]}] Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ce046cb463b04c95b9a087ad2c660640 Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 3ca6e291a501445cb124f78e3aeb8fac Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 26 14:04:24.034396 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'flavor_id': '714998815', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:04:24.035218 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 26 14:04:24.036318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:24.037588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f0ab5dd0-f5d7-4d27-9ee1-98820895729f tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:24.041069 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f0ab5dd0-f5d7-4d27-9ee1-98820895729f tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] 10.222.0.70 "POST /compute/v2.1/flavors/714998815/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.058589 Jul 26 14:04:24.050000 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 161/397] 10.222.0.70 () {60 vars in 1221 bytes} [Tue Jul 26 14:04:23 2022] POST /compute/v2.1/flavors/714998815/os-extra_specs => generated 124 bytes in 73 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:24.184052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20efe46c2a984870a7fcc18ba702be15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d886dd6f815451886f280083ad22868', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:24.217303 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0ab1c423-daf3-4ea9-a587-02636bf105b7 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 200 len: 1308 microversion: 2.1 time: 0.405470 Jul 26 14:04:24.224536 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 237/398] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:23 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:24.247918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ef3a7b7-3e57-459d-b7f0-ae5a5278edf3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:24.255756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ef3a7b7-3e57-459d-b7f0-ae5a5278edf3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:24.266404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:DELETE=5 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:24.291990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ef3a7b7-3e57-459d-b7f0-ae5a5278edf3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:24.292791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ef3a7b7-3e57-459d-b7f0-ae5a5278edf3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:24.294208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ef3a7b7-3e57-459d-b7f0-ae5a5278edf3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:24.294931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ef3a7b7-3e57-459d-b7f0-ae5a5278edf3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:24.473669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1890227490", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:24.602785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:04:25.064170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:04:25.064821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:04:25.066248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:04:25.067050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:04:25.067747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:04:25.080246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7ef3a7b7-3e57-459d-b7f0-ae5a5278edf3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:25.097809 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ef3a7b7-3e57-459d-b7f0-ae5a5278edf3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1319 microversion: 2.1 time: 0.868819 Jul 26 14:04:25.098793 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 238/399] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:24 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1319 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:25.123258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:25.125297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:25.126485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:25.129580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:25.137151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bc66bfc3-6536-4acc-9aa7-0378ffd8d455 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:25.147989 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:25.147989 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:25.212418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Getting quotas for project e9e2b96bde2a4879855a7dfcc1ebb8f2. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:04:25.251887 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bc66bfc3-6536-4acc-9aa7-0378ffd8d455 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/714998815/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.144460 Jul 26 14:04:25.255094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Getting quotas for user 285d6eb93c904aa7ab0328aace826df9 and project e9e2b96bde2a4879855a7dfcc1ebb8f2. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:04:25.262397 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 239/400] 10.222.0.70 () {60 vars in 1221 bytes} [Tue Jul 26 14:04:25 2022] POST /compute/v2.1/flavors/714998815/os-extra_specs => generated 66 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:25.321776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:04:25.341243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:04:25.489714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0546b30f-7883-44f6-8911-8c2abd7bac8a tempest-FlavorsV261TestJSON-1490685786 tempest-FlavorsV261TestJSON-1490685786-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-444647145", "id": 683446500, "os-flavor-access:is_public": "True"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:25.501989 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6313adc-1763-4d23-9597-8f3c50a0c0a1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.450320 Jul 26 14:04:25.513185 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 162/401] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:04:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:04:25.517559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c39c789f-a2ac-4ea6-86b1-51ce3aedc6c4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:25.518190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c39c789f-a2ac-4ea6-86b1-51ce3aedc6c4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:25.522724 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:25.522724 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:25.538963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c39c789f-a2ac-4ea6-86b1-51ce3aedc6c4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:25.539695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c39c789f-a2ac-4ea6-86b1-51ce3aedc6c4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:25.546867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c39c789f-a2ac-4ea6-86b1-51ce3aedc6c4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:25.549924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c39c789f-a2ac-4ea6-86b1-51ce3aedc6c4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:25.597834 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0546b30f-7883-44f6-8911-8c2abd7bac8a tempest-FlavorsV261TestJSON-1490685786 tempest-FlavorsV261TestJSON-1490685786-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.333609 Jul 26 14:04:25.620988 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 240/402] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:04:25 2022] POST /compute/v2.1/flavors => generated 464 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:04:25.627248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c5856d1a-860a-48d2-91a7-df914de543c0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:25.627874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c5856d1a-860a-48d2-91a7-df914de543c0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] [instance: cd85b7d5-71df-48ab-b23a-adf63fcadd94] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:25.652303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5856d1a-860a-48d2-91a7-df914de543c0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:25.653783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5856d1a-860a-48d2-91a7-df914de543c0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:25.657657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5856d1a-860a-48d2-91a7-df914de543c0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:25.662352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5856d1a-860a-48d2-91a7-df914de543c0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:25.701038 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c5856d1a-860a-48d2-91a7-df914de543c0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] HTTP exception thrown: Instance cd85b7d5-71df-48ab-b23a-adf63fcadd94 could not be found. Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c5856d1a-860a-48d2-91a7-df914de543c0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Request method failure captured: Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 HTTP/1.1 Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Qbxw9xhT9jYn3ggwqztQZU5G4pN_E1x3REYoDIV6kw2y_DTyzNLAqfZZDsXbumw6At-lpPkI91kx_v9x9K_YGbKWzho8-YTubc0OMG8_2-b6vhEWfu7RXC5lmqPgWkckg68-_Ge9KAq-G-sIp60GEHpnvbMgZ39Vy32eiwh8gboJo Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4d886dd6f815451886f280083ad22868 Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-LiveMigrationNegativeTest-898493123 Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:25.703406 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d886dd6f815451886f280083ad22868"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d886dd6f815451886f280083ad22868"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d886dd6f815451886f280083ad22868", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d886dd6f815451886f280083ad22868"}]}] Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-LiveMigrationNegativeTest-898493123 Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4d886dd6f815451886f280083ad22868 Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-898493123 Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-LiveMigrationNegativeTest-898493123-project Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 20efe46c2a984870a7fcc18ba702be15 Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-LiveMigrationNegativeTest-898493123-project Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance cd85b7d5-71df-48ab-b23a-adf63fcadd94 could not be found. Jul 26 14:04:25.705010 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'cd85b7d5-71df-48ab-b23a-adf63fcadd94'} Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd85b7d5-71df-48ab-b23a-adf63fcadd94 could not be found. Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:25.706146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd85b7d5-71df-48ab-b23a-adf63fcadd94 could not be found. Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd85b7d5-71df-48ab-b23a-adf63fcadd94 could not be found. Jul 26 14:04:25.707490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:25.711287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c5856d1a-860a-48d2-91a7-df914de543c0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] Returning 404 to user: Instance cd85b7d5-71df-48ab-b23a-adf63fcadd94 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:25.713097 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c5856d1a-860a-48d2-91a7-df914de543c0 tempest-LiveMigrationNegativeTest-898493123 tempest-LiveMigrationNegativeTest-898493123-project] 10.222.0.70 "GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94" status: 404 len: 111 microversion: 2.1 time: 0.090109 Jul 26 14:04:25.727541 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 241/403] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:25 2022] GET /compute/v2.1/servers/cd85b7d5-71df-48ab-b23a-adf63fcadd94 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:25.751489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c02df990-bfe6-483f-8dea-554fb719d75b tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:25.757481 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:25.757481 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:25.760856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c02df990-bfe6-483f-8dea-554fb719d75b tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '3ca6e291a501445cb124f78e3aeb8fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce046cb463b04c95b9a087ad2c660640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c02df990-bfe6-483f-8dea-554fb719d75b tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Request method failure captured: Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RiLT2IP3iP6MDZK4zhhv__fLTBzOSsC7OzG8UDju_dnmRxRhE1o4dRVZUoexhZzjuZjv5RXnsBn0rWOhBfYno2G4bv6nhszgMY7XFzyxwVkpFFu5t4TEihYc9jr3R6M1zhjQ4K5HQuWtZAofAj8n7WCB6qIvCmTLWiW9BVNpaEIbM Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ce046cb463b04c95b9a087ad2c660640 Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:25.762968 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ce046cb463b04c95b9a087ad2c660640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ce046cb463b04c95b9a087ad2c660640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ce046cb463b04c95b9a087ad2c660640", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ce046cb463b04c95b9a087ad2c660640"}]}] Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ce046cb463b04c95b9a087ad2c660640 Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 3ca6e291a501445cb124f78e3aeb8fac Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:25.764932 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'flavor_id': '714998815', 'id': 'hw:numa_nodes'} Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:04:25.766312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 26 14:04:25.768010 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:25.780583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c02df990-bfe6-483f-8dea-554fb719d75b tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:25.783048 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c02df990-bfe6-483f-8dea-554fb719d75b tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] 10.222.0.70 "DELETE /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.044480 Jul 26 14:04:25.784163 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 242/404] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:04:25 2022] DELETE /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes => generated 124 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:25.797233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2e64fedc-1cec-42f3-9bc4-25018384cff5 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:25.798585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2e64fedc-1cec-42f3-9bc4-25018384cff5 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:26.335519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2e64fedc-1cec-42f3-9bc4-25018384cff5 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:26.350430 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2e64fedc-1cec-42f3-9bc4-25018384cff5 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1223 microversion: 2.1 time: 0.564101 Jul 26 14:04:26.351618 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 243/405] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:25 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1223 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:26.559356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c39c789f-a2ac-4ea6-86b1-51ce3aedc6c4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:26.574273 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c39c789f-a2ac-4ea6-86b1-51ce3aedc6c4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1476 microversion: 2.1 time: 1.066170 Jul 26 14:04:26.577716 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 163/406] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:25 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1476 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:26.586770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c8418164-d5a5-43cf-8509-e740d9b8bd3e tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:26.590036 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:26.590036 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:04:26.656233 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c8418164-d5a5-43cf-8509-e740d9b8bd3e tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/714998815/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.076945 Jul 26 14:04:26.660889 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 164/407] 10.222.0.70 () {60 vars in 1221 bytes} [Tue Jul 26 14:04:26 2022] POST /compute/v2.1/flavors/714998815/os-extra_specs => generated 66 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:04:26.669526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22faacf4-cc9f-4529-97f3-2c7a599e22d7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:26.673582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22faacf4-cc9f-4529-97f3-2c7a599e22d7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:26.689314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22faacf4-cc9f-4529-97f3-2c7a599e22d7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:26.689788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22faacf4-cc9f-4529-97f3-2c7a599e22d7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:26.690612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22faacf4-cc9f-4529-97f3-2c7a599e22d7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:26.691059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22faacf4-cc9f-4529-97f3-2c7a599e22d7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:26.751669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b24e663f-1927-4361-9c64-64dad6b7587b tempest-FlavorsV261TestJSON-1095897805 tempest-FlavorsV261TestJSON-1095897805-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:26.762867 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b24e663f-1927-4361-9c64-64dad6b7587b tempest-FlavorsV261TestJSON-1095897805 tempest-FlavorsV261TestJSON-1095897805-project] 10.222.0.70 "GET /compute/v2.1/flavors/683446500" status: 200 len: 464 microversion: 2.61 time: 0.409821 Jul 26 14:04:26.774712 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 244/408] 10.222.0.70 () {60 vars in 1196 bytes} [Tue Jul 26 14:04:26 2022] GET /compute/v2.1/flavors/683446500 => generated 464 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:04:26.789966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-de56e0c7-3c36-474d-aa88-78790b4acd3c tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:26.793410 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:26.793410 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:26.794747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-de56e0c7-3c36-474d-aa88-78790b4acd3c tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '3ca6e291a501445cb124f78e3aeb8fac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce046cb463b04c95b9a087ad2c660640', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-de56e0c7-3c36-474d-aa88-78790b4acd3c tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Request method failure captured: Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 22 Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RiLT2IP3iP6MDZK4zhhv__fLTBzOSsC7OzG8UDju_dnmRxRhE1o4dRVZUoexhZzjuZjv5RXnsBn0rWOhBfYno2G4bv6nhszgMY7XFzyxwVkpFFu5t4TEihYc9jr3R6M1zhjQ4K5HQuWtZAofAj8n7WCB6qIvCmTLWiW9BVNpaEIbM Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ce046cb463b04c95b9a087ad2c660640 Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:26.796934 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ce046cb463b04c95b9a087ad2c660640"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ce046cb463b04c95b9a087ad2c660640"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ce046cb463b04c95b9a087ad2c660640", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ce046cb463b04c95b9a087ad2c660640"}]}] Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ce046cb463b04c95b9a087ad2c660640 Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 3ca6e291a501445cb124f78e3aeb8fac Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: {"hw:numa_nodes": "1"} Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:26.798189 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'flavor_id': '714998815', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:04:26.799233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 26 14:04:26.800309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:26.806485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-de56e0c7-3c36-474d-aa88-78790b4acd3c tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:26.807656 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-de56e0c7-3c36-474d-aa88-78790b4acd3c tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662 tempest-FlavorsExtraSpecsNegativeTestJSON-1267660662-project] 10.222.0.70 "PUT /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022477 Jul 26 14:04:26.816396 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 245/409] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:04:26 2022] PUT /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes => generated 124 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:26.823304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43c929f3-f793-4d25-bbed-dbe36ee92eea tempest-FlavorsV261TestJSON-1490685786 tempest-FlavorsV261TestJSON-1490685786-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:26.828305 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:26.828305 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:26.875471 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43c929f3-f793-4d25-bbed-dbe36ee92eea tempest-FlavorsV261TestJSON-1490685786 tempest-FlavorsV261TestJSON-1490685786-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/683446500" status: 200 len: 465 microversion: 2.61 time: 0.057386 Jul 26 14:04:26.877014 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 246/410] 10.222.0.70 () {62 vars in 1216 bytes} [Tue Jul 26 14:04:26 2022] PUT /compute/v2.1/flavors/683446500 => generated 465 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:04:26.889735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abfa4e80-dff1-4882-b130-35763c1c4ef2 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:26.892243 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:26.892243 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:26.910733 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-abfa4e80-dff1-4882-b130-35763c1c4ef2 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] HTTP exception thrown: Flavor 714998815 has no extra specs with key hw:cpu_thread_policy. Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abfa4e80-dff1-4882-b130-35763c1c4ef2 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Request method failure captured: Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/flavors/714998815/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RlCiJvOckWzxAeJtLQQITVxi7vwdRi4kde7e_xXztPf5BlFSF880e5aJ1RFmK7Qjw7NZwY3Vb_rGhztQrGlc0Y2sU21WkxMnVD4-fwJKd2L3dLmaUsuF1AC3qPECsL3uuHNCXIz1Wi0hpQwbfGtP9SqhLX6z-gSyw-o8XO2HK9Ty0 Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 7413f5933fbd434ab6839326e41b9e2c Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:04:26.913509 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7413f5933fbd434ab6839326e41b9e2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7413f5933fbd434ab6839326e41b9e2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7413f5933fbd434ab6839326e41b9e2c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7413f5933fbd434ab6839326e41b9e2c"}]}] Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 7413f5933fbd434ab6839326e41b9e2c Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e1d508026ddd4119aba3742b16f8460e Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:26.915216 n-d-833090-9 devstack@n-api.service[119479]: exception: Flavor 714998815 has no extra specs with key hw:cpu_thread_policy. Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'flavor_id': '714998815', 'id': 'hw:cpu_thread_policy'} Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 714998815 has no extra specs with key hw:cpu_thread_policy. Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:26.916085 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:26.917604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:26.917604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:26.917604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:26.917604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:26.917604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:26.917604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 714998815 has no extra specs with key hw:cpu_thread_policy. Jul 26 14:04:26.917604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:26.917604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abfa4e80-dff1-4882-b130-35763c1c4ef2 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Returning 404 to user: Flavor 714998815 has no extra specs with key hw:cpu_thread_policy. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:26.919403 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-abfa4e80-dff1-4882-b130-35763c1c4ef2 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/714998815/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.041120 Jul 26 14:04:26.924637 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 247/411] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:04:26 2022] DELETE /compute/v2.1/flavors/714998815/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:26.932676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1b25fcfc-4855-4ba2-9320-12bad106eb4f tempest-FlavorsV261TestJSON-1095897805 tempest-FlavorsV261TestJSON-1095897805-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:27.000727 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1b25fcfc-4855-4ba2-9320-12bad106eb4f tempest-FlavorsV261TestJSON-1095897805 tempest-FlavorsV261TestJSON-1095897805-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 7644 microversion: 2.61 time: 0.073887 Jul 26 14:04:27.005055 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 248/412] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:04:26 2022] GET /compute/v2.1/flavors/detail => generated 7644 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:04:27.020391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3683d5de-814e-4f2f-a179-a18e1abbd7a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:27.037867 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-3683d5de-814e-4f2f-a179-a18e1abbd7a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3683d5de-814e-4f2f-a179-a18e1abbd7a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Request method failure captured: Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 27 Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RlCiJvOckWzxAeJtLQQITVxi7vwdRi4kde7e_xXztPf5BlFSF880e5aJ1RFmK7Qjw7NZwY3Vb_rGhztQrGlc0Y2sU21WkxMnVD4-fwJKd2L3dLmaUsuF1AC3qPECsL3uuHNCXIz1Wi0hpQwbfGtP9SqhLX6z-gSyw-o8XO2HK9Ty0 Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 7413f5933fbd434ab6839326e41b9e2c Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:04:27.041900 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7413f5933fbd434ab6839326e41b9e2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7413f5933fbd434ab6839326e41b9e2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7413f5933fbd434ab6839326e41b9e2c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7413f5933fbd434ab6839326e41b9e2c"}]}] Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 7413f5933fbd434ab6839326e41b9e2c Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e1d508026ddd4119aba3742b16f8460e Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: {"hw:cpu_policy": "shared"} Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:27.043868 n-d-833090-9 devstack@n-api.service[119479]: exception: Request body and URI mismatch Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'flavor_id': '714998815', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:27.044785 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:27.045866 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:27.045866 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:27.045866 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 26 14:04:27.045866 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:27.045866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3683d5de-814e-4f2f-a179-a18e1abbd7a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:27.046864 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3683d5de-814e-4f2f-a179-a18e1abbd7a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.037750 Jul 26 14:04:27.055005 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 249/413] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:04:27 2022] PUT /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes => generated 73 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:04:27.087532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73068016-e7e2-4b98-8869-04fe358d2466 tempest-FlavorsV261TestJSON-1095897805 tempest-FlavorsV261TestJSON-1095897805-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:27.193115 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-73068016-e7e2-4b98-8869-04fe358d2466 tempest-FlavorsV261TestJSON-1095897805 tempest-FlavorsV261TestJSON-1095897805-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 3931 microversion: 2.61 time: 0.135320 Jul 26 14:04:27.195777 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 250/414] 10.222.0.70 () {60 vars in 1166 bytes} [Tue Jul 26 14:04:27 2022] GET /compute/v2.1/flavors => generated 3931 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:04:27.215907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-46f423fb-0955-44d5-bb01-19bed58ffe0e tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-46f423fb-0955-44d5-bb01-19bed58ffe0e tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Request method failure captured: Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 49 Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RlCiJvOckWzxAeJtLQQITVxi7vwdRi4kde7e_xXztPf5BlFSF880e5aJ1RFmK7Qjw7NZwY3Vb_rGhztQrGlc0Y2sU21WkxMnVD4-fwJKd2L3dLmaUsuF1AC3qPECsL3uuHNCXIz1Wi0hpQwbfGtP9SqhLX6z-gSyw-o8XO2HK9Ty0 Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 7413f5933fbd434ab6839326e41b9e2c Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:04:27.229553 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7413f5933fbd434ab6839326e41b9e2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7413f5933fbd434ab6839326e41b9e2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7413f5933fbd434ab6839326e41b9e2c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7413f5933fbd434ab6839326e41b9e2c"}]}] Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 7413f5933fbd434ab6839326e41b9e2c Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e1d508026ddd4119aba3742b16f8460e Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 26 14:04:27.231864 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'flavor_id': '714998815', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance: Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 26 14:04:27.233193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:27.237551 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:27.245911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:27.245911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:27.245911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:04:27.245911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:04:27.245911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 26 14:04:27.245911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:27.247605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-46f423fb-0955-44d5-bb01-19bed58ffe0e tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:27.249281 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-46f423fb-0955-44d5-bb01-19bed58ffe0e tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.049878 Jul 26 14:04:27.258173 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 251/415] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:04:27 2022] PUT /compute/v2.1/flavors/714998815/os-extra_specs/hw:numa_nodes => generated 117 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:04:27.276393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a6987fc-76ac-416a-af28-86472118490c tempest-FlavorsV261TestJSON-1490685786 tempest-FlavorsV261TestJSON-1490685786-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:27.284236 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:27.284236 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:27.310198 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9a6987fc-76ac-416a-af28-86472118490c tempest-FlavorsV261TestJSON-1490685786 tempest-FlavorsV261TestJSON-1490685786-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/683446500" status: 202 len: 0 microversion: 2.61 time: 0.047568 Jul 26 14:04:27.312070 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 252/416] 10.222.0.70 () {60 vars in 1199 bytes} [Tue Jul 26 14:04:27 2022] DELETE /compute/v2.1/flavors/683446500 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:04:27.320359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08890e18-99b3-406c-9f46-267be5bf13cb tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:27.362372 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08890e18-99b3-406c-9f46-267be5bf13cb tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/714998815" status: 202 len: 0 microversion: 2.1 time: 0.046676 Jul 26 14:04:27.368386 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 253/417] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:04:27 2022] DELETE /compute/v2.1/flavors/714998815 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:04:27.387653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cdf41c25-ea2b-4a5f-bac6-60dbeba28630 tempest-FlavorsV261TestJSON-1490685786 tempest-FlavorsV261TestJSON-1490685786-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:27.442171 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cdf41c25-ea2b-4a5f-bac6-60dbeba28630 tempest-FlavorsV261TestJSON-1490685786 tempest-FlavorsV261TestJSON-1490685786-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.071262 Jul 26 14:04:27.443795 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 254/418] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:04:27 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:04:27.452874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36552e96-5c73-4cee-ab74-8985ca02a786 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:27.516373 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-36552e96-5c73-4cee-ab74-8985ca02a786 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097 tempest-FlavorsExtraSpecsNegativeTestJSON-1942223097-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.069882 Jul 26 14:04:27.516968 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 255/419] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:04:27 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:27.536350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4403b2e8-c288-49fc-82b2-bd16fd20a060 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:27.538815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4403b2e8-c288-49fc-82b2-bd16fd20a060 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:27.543146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22faacf4-cc9f-4529-97f3-2c7a599e22d7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:27.551747 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22faacf4-cc9f-4529-97f3-2c7a599e22d7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1319 microversion: 2.1 time: 0.889371 Jul 26 14:04:27.558656 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 165/420] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:26 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1319 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:27.568702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4403b2e8-c288-49fc-82b2-bd16fd20a060 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:27.569463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4403b2e8-c288-49fc-82b2-bd16fd20a060 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:27.580711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4403b2e8-c288-49fc-82b2-bd16fd20a060 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:27.582157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4403b2e8-c288-49fc-82b2-bd16fd20a060 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:27.610288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d46f7f13-d7a8-4297-ac08-d4a80d276bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:27.612381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d46f7f13-d7a8-4297-ac08-d4a80d276bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:27.638139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d46f7f13-d7a8-4297-ac08-d4a80d276bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:27.638953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d46f7f13-d7a8-4297-ac08-d4a80d276bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:27.641678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d46f7f13-d7a8-4297-ac08-d4a80d276bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:27.642474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d46f7f13-d7a8-4297-ac08-d4a80d276bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:27.797862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4403b2e8-c288-49fc-82b2-bd16fd20a060 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:27.810679 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4403b2e8-c288-49fc-82b2-bd16fd20a060 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1275 microversion: 2.1 time: 0.287971 Jul 26 14:04:27.829772 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 256/421] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:27 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1275 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:27.835810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-0970f4a0-a137-45ae-8398-7aef2aca8dd4 req-8e5eb70e-cf91-43ed-ae86-9ffce49b4087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981f15eb-5be0-4e4d-a32d-b0c2767da842", "name": "network-vif-plugged", "status": "completed", "tag": "9f8ea724-e72e-4f98-ad81-d7fd01389960"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:27.865728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0970f4a0-a137-45ae-8398-7aef2aca8dd4 req-8e5eb70e-cf91-43ed-ae86-9ffce49b4087 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:27.867262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0970f4a0-a137-45ae-8398-7aef2aca8dd4 req-8e5eb70e-cf91-43ed-ae86-9ffce49b4087 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:27.891045 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-0970f4a0-a137-45ae-8398-7aef2aca8dd4 req-8e5eb70e-cf91-43ed-ae86-9ffce49b4087 service nova] Creating event network-vif-plugged:9f8ea724-e72e-4f98-ad81-d7fd01389960 for instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 on n-h1-833090-9 Jul 26 14:04:27.909599 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-0970f4a0-a137-45ae-8398-7aef2aca8dd4 req-8e5eb70e-cf91-43ed-ae86-9ffce49b4087 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074106 Jul 26 14:04:27.919821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 257/422] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:27.926063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-258e7ed4-0685-4a2d-8c2b-6b5d66076de1 req-0d21530e-f0fb-4871-bffe-1f6860fd565f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4414ffa1-1053-4d24-864e-d1a943883be3", "name": "network-vif-unplugged", "status": "completed", "tag": "a8df3bca-8031-4c87-b071-df70fe2e1de9"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:27.977418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-258e7ed4-0685-4a2d-8c2b-6b5d66076de1 req-0d21530e-f0fb-4871-bffe-1f6860fd565f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:27.979150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-258e7ed4-0685-4a2d-8c2b-6b5d66076de1 req-0d21530e-f0fb-4871-bffe-1f6860fd565f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:28.019413 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-258e7ed4-0685-4a2d-8c2b-6b5d66076de1 req-0d21530e-f0fb-4871-bffe-1f6860fd565f service nova] Creating event network-vif-unplugged:a8df3bca-8031-4c87-b071-df70fe2e1de9 for instance 4414ffa1-1053-4d24-864e-d1a943883be3 on n-h1-833090-9 Jul 26 14:04:28.049496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-258e7ed4-0685-4a2d-8c2b-6b5d66076de1 req-0d21530e-f0fb-4871-bffe-1f6860fd565f service nova] Instance 4414ffa1-1053-4d24-864e-d1a943883be3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:04:28.079171 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-258e7ed4-0685-4a2d-8c2b-6b5d66076de1 req-0d21530e-f0fb-4871-bffe-1f6860fd565f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156571 Jul 26 14:04:28.093945 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 258/423] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:28.447166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d46f7f13-d7a8-4297-ac08-d4a80d276bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:28.473147 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d46f7f13-d7a8-4297-ac08-d4a80d276bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1475 microversion: 2.1 time: 0.877095 Jul 26 14:04:28.474067 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 166/424] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:27 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1475 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:28.602772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5834b9a7-9357-482a-9353-11aec44fd46a tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:28.602772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5834b9a7-9357-482a-9353-11aec44fd46a tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:28.615518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5834b9a7-9357-482a-9353-11aec44fd46a tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:28.617212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5834b9a7-9357-482a-9353-11aec44fd46a tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:28.618276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5834b9a7-9357-482a-9353-11aec44fd46a tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:28.619600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5834b9a7-9357-482a-9353-11aec44fd46a tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:28.843018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a1e6ed7c-cc05-4a3c-a442-b35703b0a691 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:28.844384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a1e6ed7c-cc05-4a3c-a442-b35703b0a691 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:28.874671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1e6ed7c-cc05-4a3c-a442-b35703b0a691 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:28.875239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1e6ed7c-cc05-4a3c-a442-b35703b0a691 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:28.876164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1e6ed7c-cc05-4a3c-a442-b35703b0a691 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:28.878647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1e6ed7c-cc05-4a3c-a442-b35703b0a691 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:29.097101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a1e6ed7c-cc05-4a3c-a442-b35703b0a691 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:29.109178 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a1e6ed7c-cc05-4a3c-a442-b35703b0a691 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1281 microversion: 2.1 time: 0.278022 Jul 26 14:04:29.110602 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 167/425] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:28 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1281 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:29.124038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5834b9a7-9357-482a-9353-11aec44fd46a tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:29.191506 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5834b9a7-9357-482a-9353-11aec44fd46a tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1319 microversion: 2.1 time: 0.603492 Jul 26 14:04:29.214085 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 259/426] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:28 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1319 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:29.510550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-df2abc63-d901-45c2-a8b5-1301821b37b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:29.511476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-df2abc63-d901-45c2-a8b5-1301821b37b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:29.519493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df2abc63-d901-45c2-a8b5-1301821b37b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:29.520365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df2abc63-d901-45c2-a8b5-1301821b37b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:29.521367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df2abc63-d901-45c2-a8b5-1301821b37b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:29.522047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df2abc63-d901-45c2-a8b5-1301821b37b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:30.134603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-26573535-f651-4f92-8dc9-d2f8d3bca077 req-2378314b-b254-499e-b590-7bc68fd65943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4414ffa1-1053-4d24-864e-d1a943883be3", "tag": "a8df3bca-8031-4c87-b071-df70fe2e1de9"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:30.176789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-26573535-f651-4f92-8dc9-d2f8d3bca077 req-2378314b-b254-499e-b590-7bc68fd65943 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:30.177505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-26573535-f651-4f92-8dc9-d2f8d3bca077 req-2378314b-b254-499e-b590-7bc68fd65943 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:30.234510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-df2abc63-d901-45c2-a8b5-1301821b37b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:30.240483 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-26573535-f651-4f92-8dc9-d2f8d3bca077 req-2378314b-b254-499e-b590-7bc68fd65943 service nova] Creating event network-changed:a8df3bca-8031-4c87-b071-df70fe2e1de9 for instance 4414ffa1-1053-4d24-864e-d1a943883be3 on n-h1-833090-9 Jul 26 14:04:30.263165 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-df2abc63-d901-45c2-a8b5-1301821b37b9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1475 microversion: 2.1 time: 0.758227 Jul 26 14:04:30.263413 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 168/427] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:29 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1475 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:30.278583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-26573535-f651-4f92-8dc9-d2f8d3bca077 req-2378314b-b254-499e-b590-7bc68fd65943 service nova] Instance 4414ffa1-1053-4d24-864e-d1a943883be3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:04:30.294339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4b0908d5-cfec-470c-b93b-516493142f46 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:30.295283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4b0908d5-cfec-470c-b93b-516493142f46 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:30.328277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b0908d5-cfec-470c-b93b-516493142f46 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:30.335830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b0908d5-cfec-470c-b93b-516493142f46 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:30.338251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b0908d5-cfec-470c-b93b-516493142f46 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:30.341105 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-26573535-f651-4f92-8dc9-d2f8d3bca077 req-2378314b-b254-499e-b590-7bc68fd65943 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213417 Jul 26 14:04:30.349767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b0908d5-cfec-470c-b93b-516493142f46 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:30.350747 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 260/428] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:04:30.372999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-49fc1e66-e527-4394-91a1-c1439ca099dc tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:30.380626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-49fc1e66-e527-4394-91a1-c1439ca099dc tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:30.410096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49fc1e66-e527-4394-91a1-c1439ca099dc tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:30.416014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49fc1e66-e527-4394-91a1-c1439ca099dc tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:30.425929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49fc1e66-e527-4394-91a1-c1439ca099dc tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:30.426972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49fc1e66-e527-4394-91a1-c1439ca099dc tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:30.773264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4b0908d5-cfec-470c-b93b-516493142f46 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:30.794486 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4b0908d5-cfec-470c-b93b-516493142f46 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1281 microversion: 2.1 time: 0.519340 Jul 26 14:04:30.795555 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 169/429] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:30 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1281 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:31.037437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-49fc1e66-e527-4394-91a1-c1439ca099dc tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:31.053012 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-49fc1e66-e527-4394-91a1-c1439ca099dc tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1469 microversion: 2.1 time: 0.699522 Jul 26 14:04:31.057877 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 261/430] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:30 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1469 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:31.287302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-373cf6ed-a0dc-4e57-9a43-86de3df4ace5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:31.289683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-373cf6ed-a0dc-4e57-9a43-86de3df4ace5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:31.303022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-373cf6ed-a0dc-4e57-9a43-86de3df4ace5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:31.304746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-373cf6ed-a0dc-4e57-9a43-86de3df4ace5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:31.308796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-373cf6ed-a0dc-4e57-9a43-86de3df4ace5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:31.309600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-373cf6ed-a0dc-4e57-9a43-86de3df4ace5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:31.644241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7260d66f-a45a-44c9-a5cf-a9acefaaa70a tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:31.644812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7260d66f-a45a-44c9-a5cf-a9acefaaa70a tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:31.657476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7260d66f-a45a-44c9-a5cf-a9acefaaa70a tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:31.657939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7260d66f-a45a-44c9-a5cf-a9acefaaa70a tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:31.665119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7260d66f-a45a-44c9-a5cf-a9acefaaa70a tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:31.665591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7260d66f-a45a-44c9-a5cf-a9acefaaa70a tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:31.730852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7260d66f-a45a-44c9-a5cf-a9acefaaa70a tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:04:31.939308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:31.995745 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7260d66f-a45a-44c9-a5cf-a9acefaaa70a tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 204 len: 0 microversion: 2.1 time: 0.914581 Jul 26 14:04:32.001153 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 170/431] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:04:31 2022] DELETE /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:04:32.009277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0f0921cb-445e-467c-baae-6474353997bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:32.010565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0f0921cb-445e-467c-baae-6474353997bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:32.018892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f0921cb-445e-467c-baae-6474353997bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:32.020148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f0921cb-445e-467c-baae-6474353997bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:32.021184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f0921cb-445e-467c-baae-6474353997bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:32.021860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f0921cb-445e-467c-baae-6474353997bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:32.469126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-373cf6ed-a0dc-4e57-9a43-86de3df4ace5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:32.477585 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-373cf6ed-a0dc-4e57-9a43-86de3df4ace5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1475 microversion: 2.1 time: 1.195519 Jul 26 14:04:32.478376 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 262/432] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:31 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1475 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:32.482867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d1bcbda-b220-4e78-b50f-0940a386b260 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:32.483537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0d1bcbda-b220-4e78-b50f-0940a386b260 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:32.490776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d1bcbda-b220-4e78-b50f-0940a386b260 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:32.492627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d1bcbda-b220-4e78-b50f-0940a386b260 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:32.493778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d1bcbda-b220-4e78-b50f-0940a386b260 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:32.494434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d1bcbda-b220-4e78-b50f-0940a386b260 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:32.578434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0f0921cb-445e-467c-baae-6474353997bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:32.591404 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0f0921cb-445e-467c-baae-6474353997bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1323 microversion: 2.1 time: 0.588317 Jul 26 14:04:32.592714 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 171/433] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:32 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:33.007113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b035a81c-64dc-4d27-b8f9-d34ffa066a90 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Calling method '.version_select at 0x7f87947325e0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:33.212726 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b035a81c-64dc-4d27-b8f9-d34ffa066a90 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7" status: 200 len: 371 microversion: 2.1 time: 0.614094 Jul 26 14:04:33.216333 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 172/434] 10.222.0.70 () {58 vars in 1242 bytes} [Tue Jul 26 14:04:32 2022] GET /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 => generated 371 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:33.227203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2090faad-6d5c-47a8-93cf-dcd242af21ee tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Action: 'update', calling method: .version_select at 0x7f87946d9af0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:33.349294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0d1bcbda-b220-4e78-b50f-0940a386b260 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:33.366047 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0d1bcbda-b220-4e78-b50f-0940a386b260 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1475 microversion: 2.1 time: 0.886524 Jul 26 14:04:33.367732 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 263/435] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:32 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1475 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:33.513314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8953f8f3-59f6-4ae3-9f57-6c2e395c3661 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:33.515384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8953f8f3-59f6-4ae3-9f57-6c2e395c3661 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:33.524954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8953f8f3-59f6-4ae3-9f57-6c2e395c3661 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:33.525764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8953f8f3-59f6-4ae3-9f57-6c2e395c3661 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:33.527222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8953f8f3-59f6-4ae3-9f57-6c2e395c3661 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:33.527921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8953f8f3-59f6-4ae3-9f57-6c2e395c3661 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:33.664898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2090faad-6d5c-47a8-93cf-dcd242af21ee tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:33.665355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2090faad-6d5c-47a8-93cf-dcd242af21ee tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:33.672986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2090faad-6d5c-47a8-93cf-dcd242af21ee tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:33.674466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2090faad-6d5c-47a8-93cf-dcd242af21ee tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:33.830717 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2090faad-6d5c-47a8-93cf-dcd242af21ee tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7" status: 200 len: 328 microversion: 2.1 time: 0.607918 Jul 26 14:04:33.831854 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 173/436] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:04:33 2022] PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 => generated 328 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:04:33.851702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4a26815-6e72-4fe9-9cdf-4c1bc2bd1e62 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:33.862818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b4a26815-6e72-4fe9-9cdf-4c1bc2bd1e62 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:33.893360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4a26815-6e72-4fe9-9cdf-4c1bc2bd1e62 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:33.896211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4a26815-6e72-4fe9-9cdf-4c1bc2bd1e62 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:33.900522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4a26815-6e72-4fe9-9cdf-4c1bc2bd1e62 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:33.901317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4a26815-6e72-4fe9-9cdf-4c1bc2bd1e62 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:33.971752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8953f8f3-59f6-4ae3-9f57-6c2e395c3661 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:33.975622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:34.001018 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8953f8f3-59f6-4ae3-9f57-6c2e395c3661 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1473 microversion: 2.1 time: 0.490253 Jul 26 14:04:34.006565 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 264/437] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:33 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1473 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:34.358832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4a26815-6e72-4fe9-9cdf-4c1bc2bd1e62 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:34.367151 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b4a26815-6e72-4fe9-9cdf-4c1bc2bd1e62 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1323 microversion: 2.1 time: 0.531790 Jul 26 14:04:34.384625 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 174/438] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:33 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1323 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:34.395414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-62c76d00-d81f-4ce7-b782-8a899028d541 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:34.403903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-62c76d00-d81f-4ce7-b782-8a899028d541 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:34.412429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62c76d00-d81f-4ce7-b782-8a899028d541 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:34.413767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62c76d00-d81f-4ce7-b782-8a899028d541 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:34.414953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62c76d00-d81f-4ce7-b782-8a899028d541 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:34.415642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62c76d00-d81f-4ce7-b782-8a899028d541 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:34.664443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1990961659", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:34.783290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:04:35.028943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-62c76d00-d81f-4ce7-b782-8a899028d541 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:35.044978 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-62c76d00-d81f-4ce7-b782-8a899028d541 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1475 microversion: 2.1 time: 0.654385 Jul 26 14:04:35.045668 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 175/439] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:34 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1475 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:35.056449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7ee40fb0-7d5a-4937-8ec4-cb797c2ac9fa req-885546d6-cc37-42c1-b728-e6ea3d07c2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae8f99b-d3af-405e-974a-312c9baa0ba5", "tag": "c4bbb31b-1b2a-4aef-9293-6f0174c0689c"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:35.079822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7ee40fb0-7d5a-4937-8ec4-cb797c2ac9fa req-885546d6-cc37-42c1-b728-e6ea3d07c2ed service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:35.080589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7ee40fb0-7d5a-4937-8ec4-cb797c2ac9fa req-885546d6-cc37-42c1-b728-e6ea3d07c2ed service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:35.098942 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7ee40fb0-7d5a-4937-8ec4-cb797c2ac9fa req-885546d6-cc37-42c1-b728-e6ea3d07c2ed service nova] Creating event network-changed:c4bbb31b-1b2a-4aef-9293-6f0174c0689c for instance 9ae8f99b-d3af-405e-974a-312c9baa0ba5 on n-h2-833090-9 Jul 26 14:04:35.107373 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7ee40fb0-7d5a-4937-8ec4-cb797c2ac9fa req-885546d6-cc37-42c1-b728-e6ea3d07c2ed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059991 Jul 26 14:04:35.108518 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 176/440] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:35.120864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-964efac8-e6d8-4889-82ec-5ea391b6b1f3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:35.122276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-964efac8-e6d8-4889-82ec-5ea391b6b1f3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:35.136740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-964efac8-e6d8-4889-82ec-5ea391b6b1f3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:35.138514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-964efac8-e6d8-4889-82ec-5ea391b6b1f3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:35.139912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-964efac8-e6d8-4889-82ec-5ea391b6b1f3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:35.140925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-964efac8-e6d8-4889-82ec-5ea391b6b1f3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:35.151232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:35.342374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:04:35.343749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:04:35.344606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:04:35.345113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:04:35.345616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:04:35.361971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:35.367728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:35.367728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:35.367728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:35.395420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Getting quotas for project 2557523d126843c9bb4057ca96cbfeb7. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:04:35.407307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Getting quotas for user 7da8a4c2b1bd46a59262eecd7028d7da and project 2557523d126843c9bb4057ca96cbfeb7. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:04:35.430032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.utils [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] cores quota exceeded for 2557523d126843c9bb4057ca96cbfeb7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119479) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 26 14:04:35.432267 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Request method failure captured: Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 145 Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RuVKlozH8f_3ocd2lvvSNesvMiWyQnkuwI-1keeep8bzaOp5I_6ZnZtWbKhbooyuFxH-kGTVNiVdRq2imkjTiDXrSavhzhCtn1YOLHr77AJ0V_sYWgDKzHut_6ftSihZK5wTVTJmVSbbp1sQlIemvjVaDVX_-Tii0PLovopa7ZyxI Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2557523d126843c9bb4057ca96cbfeb7 Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:35.436281 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2557523d126843c9bb4057ca96cbfeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2557523d126843c9bb4057ca96cbfeb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2557523d126843c9bb4057ca96cbfeb7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2557523d126843c9bb4057ca96cbfeb7"}]}] Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2557523d126843c9bb4057ca96cbfeb7 Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-QuotasAdminNegativeTest-1332934117-project Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7da8a4c2b1bd46a59262eecd7028d7da Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-QuotasAdminNegativeTest-1332934117-project Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1990961659", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} Jul 26 14:04:35.437857 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1990961659', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452'}}} Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 14:04:35.438743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:35.440738 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.442281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:35.443810 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:35.443810 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:35.443810 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:35.443810 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:35.443810 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 26 14:04:35.443810 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.446419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:35.447805 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d1401532-6096-4118-8a0b-fdbb045e2932 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.265926 Jul 26 14:04:35.449071 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 265/441] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:04:34 2022] POST /compute/v2.1/servers => generated 111 bytes in 1268 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:35.458331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-964efac8-e6d8-4889-82ec-5ea391b6b1f3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:35.480654 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-964efac8-e6d8-4889-82ec-5ea391b6b1f3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1470 microversion: 2.1 time: 0.370502 Jul 26 14:04:35.485523 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 177/442] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:35 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1470 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:35.509451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4980e438-9009-41e5-90d3-67c46d0c70ac tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:35.511016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4980e438-9009-41e5-90d3-67c46d0c70ac tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:35.529076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4980e438-9009-41e5-90d3-67c46d0c70ac tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:35.530786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4980e438-9009-41e5-90d3-67c46d0c70ac tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:35.534282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4980e438-9009-41e5-90d3-67c46d0c70ac tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:35.535466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4980e438-9009-41e5-90d3-67c46d0c70ac tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:35.792125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4980e438-9009-41e5-90d3-67c46d0c70ac tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:35.812624 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4980e438-9009-41e5-90d3-67c46d0c70ac tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1323 microversion: 2.1 time: 0.325663 Jul 26 14:04:35.813242 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 178/443] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:35 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1323 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:35.824115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bbee7d15-4d9b-40c9-b776-fc4042627039 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Action: 'update', calling method: .version_select at 0x7f8794696f70>, body: {"quota_set": {"cores": 20}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:35.913229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74462958-63a7-4840-82ad-44cdaed5fd31 tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507 tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:35.914853 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:35.914853 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:35.916064 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-74462958-63a7-4840-82ad-44cdaed5fd31 tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507 tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74462958-63a7-4840-82ad-44cdaed5fd31 tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507 tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507-project-admin] Request method failure captured: Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Ry_v6vgSaAOQFaznB3-lEGVuWP-J5ghUP6Q9bYUYv6xlp2JxqIBMTKr3XrHEu48w6fPxPhq-_Ss2V_eMLiC7RC7E-so7sUf6BtDyMc1YEaFRVnnbRoYHuijAVEuJXWjCRkIKbTTF10XhNCnPS9jbukyqvvfk1d4-BzH7G5RGe9x68 Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 0aee87ef271a431088d41f8e8cf03c4c Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507 Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:04:35.924500 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0aee87ef271a431088d41f8e8cf03c4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0aee87ef271a431088d41f8e8cf03c4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0aee87ef271a431088d41f8e8cf03c4c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0aee87ef271a431088d41f8e8cf03c4c"}]}] Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507 Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 0aee87ef271a431088d41f8e8cf03c4c Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507 Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507-project-admin Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 66c8159d4ea440e9a61dd0ca55ff36ae Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507-project-admin Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:35.925983 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid timestamp for date invalid_time Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'invalid_time'} Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:35.926619 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 26 14:04:35.927700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:35.930693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74462958-63a7-4840-82ad-44cdaed5fd31 tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507 tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:35.932236 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-74462958-63a7-4840-82ad-44cdaed5fd31 tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507 tempest-InstanceUsageAuditLogNegativeTestJSON-1144127507-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.481913 Jul 26 14:04:35.938607 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 266/444] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Jul 26 14:04:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 489 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:04:35.947310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0baf0755-1141-4196-9c16-7d8255fea4f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:35.948169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0baf0755-1141-4196-9c16-7d8255fea4f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:35.956784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0baf0755-1141-4196-9c16-7d8255fea4f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:35.957591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0baf0755-1141-4196-9c16-7d8255fea4f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:35.958606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0baf0755-1141-4196-9c16-7d8255fea4f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:35.959347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0baf0755-1141-4196-9c16-7d8255fea4f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:36.103281 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0baf0755-1141-4196-9c16-7d8255fea4f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3/action" status: 204 len: 0 microversion: 2.1 time: 0.162535 Jul 26 14:04:36.105940 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 267/445] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:04:35 2022] POST /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3/action => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:04:36.303360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbee7d15-4d9b-40c9-b776-fc4042627039 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:36.305368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbee7d15-4d9b-40c9-b776-fc4042627039 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:36.306563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbee7d15-4d9b-40c9-b776-fc4042627039 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:36.307910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbee7d15-4d9b-40c9-b776-fc4042627039 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:36.409575 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bbee7d15-4d9b-40c9-b776-fc4042627039 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7" status: 200 len: 329 microversion: 2.1 time: 0.594780 Jul 26 14:04:36.410483 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 179/446] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:04:35 2022] PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 => generated 329 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:36.417238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f659a25f-056d-41e4-919b-b73fb23f8014 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:36.418285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f659a25f-056d-41e4-919b-b73fb23f8014 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:36.426171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f659a25f-056d-41e4-919b-b73fb23f8014 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:36.426900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f659a25f-056d-41e4-919b-b73fb23f8014 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:36.428197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f659a25f-056d-41e4-919b-b73fb23f8014 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:36.429023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f659a25f-056d-41e4-919b-b73fb23f8014 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:36.671803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f659a25f-056d-41e4-919b-b73fb23f8014 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:36.682613 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f659a25f-056d-41e4-919b-b73fb23f8014 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 200 len: 1475 microversion: 2.1 time: 0.270760 Jul 26 14:04:36.699709 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 180/447] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:36 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 1475 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:36.705520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-574f16b9-ece9-4eea-9922-c440de9a10f1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:36.706150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-574f16b9-ece9-4eea-9922-c440de9a10f1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:36.714775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-574f16b9-ece9-4eea-9922-c440de9a10f1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:36.715339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-574f16b9-ece9-4eea-9922-c440de9a10f1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:36.716490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-574f16b9-ece9-4eea-9922-c440de9a10f1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:36.717128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-574f16b9-ece9-4eea-9922-c440de9a10f1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:36.766529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0dd845a1-7447-4357-931f-fff7ec07c03c tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:36.767591 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:36.767591 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:36.774517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0dd845a1-7447-4357-931f-fff7ec07c03c tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'b7404d46ced348ba91d32565eb64ca32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac13618dc0ff4ab49f9ca0a7f0c5fa34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0dd845a1-7447-4357-931f-fff7ec07c03c tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project] Request method failure captured: Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RxQYyIyfhacGac_s7LoYG6yvgyzwwYCyx-XR2leq73fU3z_Tjjnxfl3W3u8NYBUWrqAj-jpztQuuL1J0R4RjMSJ9u411EOFGNX1rzqUwLzrH4UEOMgfcolpOy_g_ouiaM3h6PIiyJ_zmlLE99R7Kbve-esICm6WG8nj9kGmVhi4GQ Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ac13618dc0ff4ab49f9ca0a7f0c5fa34 Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:36.777890 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ac13618dc0ff4ab49f9ca0a7f0c5fa34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ac13618dc0ff4ab49f9ca0a7f0c5fa34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ac13618dc0ff4ab49f9ca0a7f0c5fa34", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ac13618dc0ff4ab49f9ca0a7f0c5fa34"}]}] Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ac13618dc0ff4ab49f9ca0a7f0c5fa34 Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b7404d46ced348ba91d32565eb64ca32 Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:36.780336 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: action_args: {} Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:04:36.781596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:36.785757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0dd845a1-7447-4357-931f-fff7ec07c03c tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:36.791095 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0dd845a1-7447-4357-931f-fff7ec07c03c tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.671614 Jul 26 14:04:36.791095 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 268/448] 10.222.0.70 () {58 vars in 1185 bytes} [Tue Jul 26 14:04:36 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 674 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:36.792687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e209a22b-2285-45ea-9465-d93bf9bcd988 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Calling method '.version_select at 0x7f8794d99040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:37.055097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-574f16b9-ece9-4eea-9922-c440de9a10f1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:37.062951 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e209a22b-2285-45ea-9465-d93bf9bcd988 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7" status: 200 len: 371 microversion: 2.1 time: 0.275784 Jul 26 14:04:37.063977 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-574f16b9-ece9-4eea-9922-c440de9a10f1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1470 microversion: 2.1 time: 0.363195 Jul 26 14:04:37.064749 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 269/449] 10.222.0.70 () {58 vars in 1242 bytes} [Tue Jul 26 14:04:36 2022] GET /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 => generated 371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:37.067943 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 181/450] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:36 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1470 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:37.091572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1193ea3d-c407-4ddb-a77d-bc6ac625a846 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:37.098146 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:37.098146 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:04:37.106486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1193ea3d-c407-4ddb-a77d-bc6ac625a846 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'b7404d46ced348ba91d32565eb64ca32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac13618dc0ff4ab49f9ca0a7f0c5fa34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1193ea3d-c407-4ddb-a77d-bc6ac625a846 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project] Request method failure captured: Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26%2014:04:36 HTTP/1.1 Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RxQYyIyfhacGac_s7LoYG6yvgyzwwYCyx-XR2leq73fU3z_Tjjnxfl3W3u8NYBUWrqAj-jpztQuuL1J0R4RjMSJ9u411EOFGNX1rzqUwLzrH4UEOMgfcolpOy_g_ouiaM3h6PIiyJ_zmlLE99R7Kbve-esICm6WG8nj9kGmVhi4GQ Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ac13618dc0ff4ab49f9ca0a7f0c5fa34 Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:04:37.122155 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ac13618dc0ff4ab49f9ca0a7f0c5fa34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ac13618dc0ff4ab49f9ca0a7f0c5fa34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ac13618dc0ff4ab49f9ca0a7f0c5fa34", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ac13618dc0ff4ab49f9ca0a7f0c5fa34"}]}] Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ac13618dc0ff4ab49f9ca0a7f0c5fa34 Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b7404d46ced348ba91d32565eb64ca32 Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:04:37.123689 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '2022-07-26 14:04:36'} Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:04:37.124492 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:37.125588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1193ea3d-c407-4ddb-a77d-bc6ac625a846 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:37.126527 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1193ea3d-c407-4ddb-a77d-bc6ac625a846 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087 tempest-InstanceUsageAuditLogNegativeTestJSON-347244087-project] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26 14:04:36" status: 403 len: 128 microversion: 2.1 time: 0.057231 Jul 26 14:04:37.138397 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 182/451] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 14:04:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-26%2014%3A04%3A36 => generated 128 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:37.154728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-03bbf540-561f-4452-8ab4-88a1b4c66a55 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:37.155466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-03bbf540-561f-4452-8ab4-88a1b4c66a55 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:37.193959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03bbf540-561f-4452-8ab4-88a1b4c66a55 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.195171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03bbf540-561f-4452-8ab4-88a1b4c66a55 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.203515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03bbf540-561f-4452-8ab4-88a1b4c66a55 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.204270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03bbf540-561f-4452-8ab4-88a1b4c66a55 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.227163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Calling method '.version_select at 0x7f87948f30d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:37.230289 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:37.230289 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:04:37.232549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.233447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.255561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.256430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.290480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.291627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.313313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.314139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.386390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=86,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:37.388641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.389300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.413086 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1aafe7c6-d3ef-4986-8497-dda5453a25c0 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.346432 Jul 26 14:04:37.424800 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 270/452] 10.222.0.70 () {60 vars in 1243 bytes} [Tue Jul 26 14:04:37 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:04:37.431464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b4861124-7742-4fc8-864e-8a08bb14e72b req-58608ee9-77b4-440c-88e4-bfb8bf491e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981f15eb-5be0-4e4d-a32d-b0c2767da842", "name": "network-vif-deleted", "tag": "9f8ea724-e72e-4f98-ad81-d7fd01389960"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:37.446674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b4861124-7742-4fc8-864e-8a08bb14e72b req-58608ee9-77b4-440c-88e4-bfb8bf491e0b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.448448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b4861124-7742-4fc8-864e-8a08bb14e72b req-58608ee9-77b4-440c-88e4-bfb8bf491e0b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.467025 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b4861124-7742-4fc8-864e-8a08bb14e72b req-58608ee9-77b4-440c-88e4-bfb8bf491e0b service nova] Creating event network-vif-deleted:9f8ea724-e72e-4f98-ad81-d7fd01389960 for instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 on n-h1-833090-9 Jul 26 14:04:37.473899 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b4861124-7742-4fc8-864e-8a08bb14e72b req-58608ee9-77b4-440c-88e4-bfb8bf491e0b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047575 Jul 26 14:04:37.475231 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 271/453] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:37.481459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4d2fa6f-d8d5-43e6-a97d-0ef4c56fa69c tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Action: 'update', calling method: .version_select at 0x7f87948f64c0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:37.523452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-03bbf540-561f-4452-8ab4-88a1b4c66a55 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:37.543303 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-03bbf540-561f-4452-8ab4-88a1b4c66a55 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1323 microversion: 2.1 time: 0.403546 Jul 26 14:04:37.545733 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 183/454] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:37 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1323 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:37.556320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Calling method '.version_select at 0x7f8794636dc0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:37.562299 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:37.562299 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:04:37.563764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.564170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.628946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.629593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.692246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.695546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.715969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.716760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.766397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.767229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.793193 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4e504034-44fd-45eb-b21f-7e958fb2f2e8 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.242684 Jul 26 14:04:37.796228 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 184/455] 10.222.0.70 () {60 vars in 1222 bytes} [Tue Jul 26 14:04:37 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:04:37.810450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-560e774d-d6e1-4d34-bdcf-e5332975537f req-a27448b9-c924-45b4-85aa-9c135847e56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4414ffa1-1053-4d24-864e-d1a943883be3", "name": "network-vif-plugged", "status": "completed", "tag": "a8df3bca-8031-4c87-b071-df70fe2e1de9"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:37.836268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-560e774d-d6e1-4d34-bdcf-e5332975537f req-a27448b9-c924-45b4-85aa-9c135847e56f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.839072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-560e774d-d6e1-4d34-bdcf-e5332975537f req-a27448b9-c924-45b4-85aa-9c135847e56f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.878450 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-560e774d-d6e1-4d34-bdcf-e5332975537f req-a27448b9-c924-45b4-85aa-9c135847e56f service nova] Creating event network-vif-plugged:a8df3bca-8031-4c87-b071-df70fe2e1de9 for instance 4414ffa1-1053-4d24-864e-d1a943883be3 on n-h1-833090-9 Jul 26 14:04:37.905314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-560e774d-d6e1-4d34-bdcf-e5332975537f req-a27448b9-c924-45b4-85aa-9c135847e56f service nova] Instance 4414ffa1-1053-4d24-864e-d1a943883be3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:04:37.924200 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-560e774d-d6e1-4d34-bdcf-e5332975537f req-a27448b9-c924-45b4-85aa-9c135847e56f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124781 Jul 26 14:04:37.925816 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 185/456] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:37.936801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b25eda11-2300-4520-ae0e-b7751da8f1ca tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:37.938321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b25eda11-2300-4520-ae0e-b7751da8f1ca tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:37.951000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25eda11-2300-4520-ae0e-b7751da8f1ca tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.951854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25eda11-2300-4520-ae0e-b7751da8f1ca tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.953235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25eda11-2300-4520-ae0e-b7751da8f1ca tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:37.953889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25eda11-2300-4520-ae0e-b7751da8f1ca tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:37.977817 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b25eda11-2300-4520-ae0e-b7751da8f1ca tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] HTTP exception thrown: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b25eda11-2300-4520-ae0e-b7751da8f1ca tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Request method failure captured: Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 HTTP/1.1 Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RZ_MwA4rEpMpxVEe9RuEh9CHmYQo3ZXBHDbaE_jS8pIfPVkW_OAppeYt0mNS7jDgKqJ2jlBWaZ9rSV9jjHcmMvCZhV1dOnOWWcbfiPwKbDtJj30TakX5vRYWim63moFVcSTqmHNvJ_YRyYjXSyXKo2mTCcmqyBdl9kSClmA2BWR0M Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:04:37.980475 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b98f74644a4e4143a94639544a446934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b98f74644a4e4143a94639544a446934", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}] Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4fd3638503c149d0a41f9ab0a4d57423 Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:04:37.981710 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '981f15eb-5be0-4e4d-a32d-b0c2767da842'} Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:37.982496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:04:37.984873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:37.988439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b25eda11-2300-4520-ae0e-b7751da8f1ca tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Returning 404 to user: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:37.990456 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b25eda11-2300-4520-ae0e-b7751da8f1ca tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 404 len: 111 microversion: 2.1 time: 0.061563 Jul 26 14:04:37.991997 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 186/457] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:37 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:37.998588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3847170a-b1e2-4943-990d-0a0ab52bb1c6 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Calling method '.version_select at 0x7f8794692700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:38.001624 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:04:38.001624 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:04:38.003384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3847170a-b1e2-4943-990d-0a0ab52bb1c6 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:38.004160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3847170a-b1e2-4943-990d-0a0ab52bb1c6 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:38.023843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4d2fa6f-d8d5-43e6-a97d-0ef4c56fa69c tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:38.024468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4d2fa6f-d8d5-43e6-a97d-0ef4c56fa69c tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:38.025178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4d2fa6f-d8d5-43e6-a97d-0ef4c56fa69c tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:38.025628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4d2fa6f-d8d5-43e6-a97d-0ef4c56fa69c tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:38.029808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3847170a-b1e2-4943-990d-0a0ab52bb1c6 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:38.030399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3847170a-b1e2-4943-990d-0a0ab52bb1c6 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:38.037487 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3847170a-b1e2-4943-990d-0a0ab52bb1c6 tempest-HypervisorAdminV253TestBase-1872792500 tempest-HypervisorAdminV253TestBase-1872792500-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/cd7e41ce-debe-4c2c-9910-f846b38f6986" status: 200 len: 792 microversion: 2.53 time: 0.043114 Jul 26 14:04:38.039164 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 187/458] 10.222.0.70 () {60 vars in 1298 bytes} [Tue Jul 26 14:04:37 2022] GET /compute/v2.1/os-hypervisors/cd7e41ce-debe-4c2c-9910-f846b38f6986 => generated 792 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:04:38.090976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-88c834c3-eb03-4d10-99e1-d06ef9dc4d94 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:38.092399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-88c834c3-eb03-4d10-99e1-d06ef9dc4d94 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:38.109881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-88c834c3-eb03-4d10-99e1-d06ef9dc4d94 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:38.113747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-88c834c3-eb03-4d10-99e1-d06ef9dc4d94 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:38.115043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-88c834c3-eb03-4d10-99e1-d06ef9dc4d94 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:38.115669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-88c834c3-eb03-4d10-99e1-d06ef9dc4d94 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:38.132183 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4d2fa6f-d8d5-43e6-a97d-0ef4c56fa69c tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7" status: 200 len: 328 microversion: 2.1 time: 0.654698 Jul 26 14:04:38.135234 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 272/459] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:04:37 2022] PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 => generated 328 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:38.217563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1072516318", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:38.345488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:04:38.905329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-88c834c3-eb03-4d10-99e1-d06ef9dc4d94 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:38.923155 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-88c834c3-eb03-4d10-99e1-d06ef9dc4d94 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1470 microversion: 2.1 time: 0.837546 Jul 26 14:04:38.923997 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 188/460] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:38 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1470 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:38.929391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1410353219", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:39.052799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:04:39.334545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:04:39.335672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:04:39.336620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:04:39.337180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:04:39.337602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:04:39.355589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:39.357154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:39.359663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:39.360314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:39.433463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Getting quotas for project b98f74644a4e4143a94639544a446934. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:04:39.441043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Getting quotas for user 4fd3638503c149d0a41f9ab0a4d57423 and project b98f74644a4e4143a94639544a446934. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:04:39.482055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:04:39.484429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:04:39.566826 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e8b003d5-5d8b-44b7-b1a9-6ccf3058764c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353219 Jul 26 14:04:39.579035 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 273/461] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:04:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:04:39.595483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ce60140d-d31f-4b4e-ada6-30bd976336ea tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:39.597607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ce60140d-d31f-4b4e-ada6-30bd976336ea tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:39.611216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce60140d-d31f-4b4e-ada6-30bd976336ea tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:39.612000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce60140d-d31f-4b4e-ada6-30bd976336ea tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:39.624599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce60140d-d31f-4b4e-ada6-30bd976336ea tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:39.625277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce60140d-d31f-4b4e-ada6-30bd976336ea tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:39.882937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:04:39.883922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:04:39.884594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:04:39.885300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:04:39.886107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:04:39.911409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:39.919395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:39.920618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:39.921380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:39.983165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Getting quotas for project 2557523d126843c9bb4057ca96cbfeb7. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:04:39.998706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Getting quotas for user 7da8a4c2b1bd46a59262eecd7028d7da and project 2557523d126843c9bb4057ca96cbfeb7. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:04:40.027943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.utils [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] instances quota exceeded for 2557523d126843c9bb4057ca96cbfeb7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119478) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 26 14:04:40.030610 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Request method failure captured: Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 145 Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RuVKlozH8f_3ocd2lvvSNesvMiWyQnkuwI-1keeep8bzaOp5I_6ZnZtWbKhbooyuFxH-kGTVNiVdRq2imkjTiDXrSavhzhCtn1YOLHr77AJ0V_sYWgDKzHut_6ftSihZK5wTVTJmVSbbp1sQlIemvjVaDVX_-Tii0PLovopa7ZyxI Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2557523d126843c9bb4057ca96cbfeb7 Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:04:40.036436 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2557523d126843c9bb4057ca96cbfeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2557523d126843c9bb4057ca96cbfeb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2557523d126843c9bb4057ca96cbfeb7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2557523d126843c9bb4057ca96cbfeb7"}]}] Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2557523d126843c9bb4057ca96cbfeb7 Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-QuotasAdminNegativeTest-1332934117-project Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7da8a4c2b1bd46a59262eecd7028d7da Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-QuotasAdminNegativeTest-1332934117-project Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1410353219", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} Jul 26 14:04:40.037920 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1410353219', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452'}}} Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 14:04:40.039318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:40.040520 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:40.041915 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:40.043287 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:40.043287 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:40.043287 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:40.043287 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:40.043287 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 26 14:04:40.043287 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:40.043287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:40.043287 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7a77a698-30de-40e7-8333-86d7abe3cbcd tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.115057 Jul 26 14:04:40.046872 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 189/462] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:04:38 2022] POST /compute/v2.1/servers => generated 119 bytes in 1122 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:40.055022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e1b69c93-46d6-4790-849d-cafe242ab253 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:40.056181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e1b69c93-46d6-4790-849d-cafe242ab253 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:40.068299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1b69c93-46d6-4790-849d-cafe242ab253 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:40.068850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1b69c93-46d6-4790-849d-cafe242ab253 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:40.069719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1b69c93-46d6-4790-849d-cafe242ab253 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:40.070191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1b69c93-46d6-4790-849d-cafe242ab253 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:40.126743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e1b69c93-46d6-4790-849d-cafe242ab253 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:04:40.263904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ce60140d-d31f-4b4e-ada6-30bd976336ea tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:40.272033 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e1b69c93-46d6-4790-849d-cafe242ab253 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 204 len: 0 microversion: 2.1 time: 0.222758 Jul 26 14:04:40.276160 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 190/463] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:04:40 2022] DELETE /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:04:40.302508 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ce60140d-d31f-4b4e-ada6-30bd976336ea tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1323 microversion: 2.1 time: 0.722229 Jul 26 14:04:40.308214 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 274/464] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:39 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1323 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:40.313600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3c929aa6-6cac-40c8-a1ba-2161f3c2f1f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:40.314430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3c929aa6-6cac-40c8-a1ba-2161f3c2f1f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:40.331995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d3d2172-1bde-4852-a36b-c1b4a645b705 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:40.332661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c929aa6-6cac-40c8-a1ba-2161f3c2f1f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:40.332789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3d3d2172-1bde-4852-a36b-c1b4a645b705 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:40.333923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c929aa6-6cac-40c8-a1ba-2161f3c2f1f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:40.336368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c929aa6-6cac-40c8-a1ba-2161f3c2f1f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:40.337691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c929aa6-6cac-40c8-a1ba-2161f3c2f1f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:40.557528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3d3d2172-1bde-4852-a36b-c1b4a645b705 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:40.570590 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3d3d2172-1bde-4852-a36b-c1b4a645b705 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1220 microversion: 2.1 time: 0.292196 Jul 26 14:04:40.572713 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 191/465] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:40 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1220 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:40.587759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fcc034fb-745b-4324-8e53-10325ed2f529 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Action: 'update', calling method: .version_select at 0x7f8794563ca0>, body: {"quota_set": {"instances": 10}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:40.754933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3c929aa6-6cac-40c8-a1ba-2161f3c2f1f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:40.769948 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3c929aa6-6cac-40c8-a1ba-2161f3c2f1f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1462 microversion: 2.1 time: 0.456921 Jul 26 14:04:40.785381 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 275/466] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:40 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1462 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:40.797702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-153924921", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "1378323926", "adminPass": "***", "networks": [{"uuid": "ef14aa4d-5b69-4691-8a08-b7e7f20ad659"}], "security_groups": [{"name": "tempest-securitygroup--2104653547"}], "key_name": "tempest-keypair-1514025668", "user_data": "}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:41.112676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] validate_networks() for [('ef14aa4d-5b69-4691-8a08-b7e7f20ad659', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:04:41.197484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcc034fb-745b-4324-8e53-10325ed2f529 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:41.198066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcc034fb-745b-4324-8e53-10325ed2f529 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:41.198949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcc034fb-745b-4324-8e53-10325ed2f529 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:41.199406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcc034fb-745b-4324-8e53-10325ed2f529 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:41.248465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:41.441912 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fcc034fb-745b-4324-8e53-10325ed2f529 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7" status: 200 len: 329 microversion: 2.1 time: 0.866168 Jul 26 14:04:41.442484 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 192/467] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:04:40 2022] PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 => generated 329 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:41.461680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-474ff585-6c13-40e0-b4c0-33a49face79d tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:41.486717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-474ff585-6c13-40e0-b4c0-33a49face79d tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:41.498537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-474ff585-6c13-40e0-b4c0-33a49face79d tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:41.499012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-474ff585-6c13-40e0-b4c0-33a49face79d tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:41.500163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-474ff585-6c13-40e0-b4c0-33a49face79d tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:41.500622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-474ff585-6c13-40e0-b4c0-33a49face79d tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:41.867361 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-474ff585-6c13-40e0-b4c0-33a49face79d tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1613 microversion: 2.1 time: 0.412914 Jul 26 14:04:41.899730 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 193/468] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:41 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1613 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:41.930346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b15bc992-9259-412d-a00e-6f049c40f8cd req-2de2830a-0cdd-4594-90d4-eb70c65274f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae8f99b-d3af-405e-974a-312c9baa0ba5", "name": "network-vif-plugged", "status": "completed", "tag": "c4bbb31b-1b2a-4aef-9293-6f0174c0689c"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:41.959443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b15bc992-9259-412d-a00e-6f049c40f8cd req-2de2830a-0cdd-4594-90d4-eb70c65274f1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:41.962877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b15bc992-9259-412d-a00e-6f049c40f8cd req-2de2830a-0cdd-4594-90d4-eb70c65274f1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:41.994763 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b15bc992-9259-412d-a00e-6f049c40f8cd req-2de2830a-0cdd-4594-90d4-eb70c65274f1 service nova] Creating event network-vif-plugged:c4bbb31b-1b2a-4aef-9293-6f0174c0689c for instance 9ae8f99b-d3af-405e-974a-312c9baa0ba5 on n-h2-833090-9 Jul 26 14:04:42.006396 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b15bc992-9259-412d-a00e-6f049c40f8cd req-2de2830a-0cdd-4594-90d4-eb70c65274f1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104616 Jul 26 14:04:42.024238 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 194/469] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:42.047073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3727af04-bef2-49e9-928e-03e3d5a83178 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:42.048291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3727af04-bef2-49e9-928e-03e3d5a83178 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:42.071480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3727af04-bef2-49e9-928e-03e3d5a83178 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:42.071973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3727af04-bef2-49e9-928e-03e3d5a83178 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:42.072776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3727af04-bef2-49e9-928e-03e3d5a83178 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:42.073220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3727af04-bef2-49e9-928e-03e3d5a83178 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:42.418990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:04:42.419557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:04:42.420606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:04:42.421064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:04:42.421519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:04:42.439149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:42.439608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:42.442197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:42.442723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:42.494363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Getting quotas for project 2853b779839a488cb28341b8a9744c60. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:04:42.500028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Getting quotas for user b41f5df8d0844f078e147aa5f454d5d3 and project 2853b779839a488cb28341b8a9744c60. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:04:42.502250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3727af04-bef2-49e9-928e-03e3d5a83178 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:42.520088 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3727af04-bef2-49e9-928e-03e3d5a83178 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1323 microversion: 2.1 time: 0.492351 Jul 26 14:04:42.525397 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 195/470] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:42 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:42.532628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:04:42.538720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:04:42.562306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0544a998-a6e9-494d-ab22-ae157bb2d0e7 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Calling method '.version_select at 0x7f87947b2040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:42.701367 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5022596b-2204-4864-b787-cc75b08fdcdd tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.911460 Jul 26 14:04:42.711611 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 276/471] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:04:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:04:42.716954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d58d759-a080-4013-9e67-8e9878e600ad tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:42.717843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d58d759-a080-4013-9e67-8e9878e600ad tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:42.732428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d58d759-a080-4013-9e67-8e9878e600ad tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:42.733135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d58d759-a080-4013-9e67-8e9878e600ad tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:42.734252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d58d759-a080-4013-9e67-8e9878e600ad tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:42.735514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d58d759-a080-4013-9e67-8e9878e600ad tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:42.884343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d58d759-a080-4013-9e67-8e9878e600ad tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:42.894671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d58d759-a080-4013-9e67-8e9878e600ad tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1278 microversion: 2.1 time: 0.180169 Jul 26 14:04:42.895686 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 277/472] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:42 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:42.901196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ef1df58-5c29-4463-b1b8-32454bcbc795 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '.version_select at 0x7f8794a2fdc0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:42.905910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ef1df58-5c29-4463-b1b8-32454bcbc795 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:42.906764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ef1df58-5c29-4463-b1b8-32454bcbc795 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:42.928376 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ef1df58-5c29-4463-b1b8-32454bcbc795 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.030053 Jul 26 14:04:42.930520 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 278/473] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:04:42 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:43.161935 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0544a998-a6e9-494d-ab22-ae157bb2d0e7 tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7" status: 200 len: 371 microversion: 2.1 time: 0.617707 Jul 26 14:04:43.164585 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 196/474] 10.222.0.70 () {58 vars in 1242 bytes} [Tue Jul 26 14:04:42 2022] GET /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 => generated 371 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:43.177053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5b07e4da-f956-4e8d-913f-8a1ed08da345 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:43.180717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b07e4da-f956-4e8d-913f-8a1ed08da345 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:43.292415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5b07e4da-f956-4e8d-913f-8a1ed08da345 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:43.305093 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5b07e4da-f956-4e8d-913f-8a1ed08da345 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1264 microversion: 2.1 time: 0.134040 Jul 26 14:04:43.305858 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 197/475] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:43 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:43.319232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-228fdcc7-130a-4676-92ad-589026e729fb tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Action: 'update', calling method: .version_select at 0x7f87945d9b80>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:43.392996 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9e0c721f-3af1-47a2-a245-90e389a6bf72 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] 10.222.0.70 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.461070 Jul 26 14:04:43.394007 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 279/476] 10.222.0.70 () {58 vars in 1128 bytes} [Tue Jul 26 14:04:42 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 14:04:43.404443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-283247467", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:43.493672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:04:43.535902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-228fdcc7-130a-4676-92ad-589026e729fb tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:43.536439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-228fdcc7-130a-4676-92ad-589026e729fb tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:43.537202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-228fdcc7-130a-4676-92ad-589026e729fb tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:43.537641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-228fdcc7-130a-4676-92ad-589026e729fb tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:43.600346 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-228fdcc7-130a-4676-92ad-589026e729fb tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7" status: 200 len: 325 microversion: 2.1 time: 0.289078 Jul 26 14:04:43.608013 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 198/477] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:04:43 2022] PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 => generated 325 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:43.633091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6acc2f9d-96f1-4a9e-89fc-deebecbc492c tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Calling method '.version_select at 0x7f87945f9f70>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:43.707547 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-6acc2f9d-96f1-4a9e-89fc-deebecbc492c tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] HTTP exception thrown: Image not found. Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6acc2f9d-96f1-4a9e-89fc-deebecbc492c tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Request method failure captured: Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_R6kNDZIMilcPEFUAIpYBheaj6yIvYgjQVQm5N5gaQ-d6pZY68n4upHtAaPU48GqXYafOlO6gCFMh0T1VQ-ZfHOBrCvcj8yGtTWukFL0CeSZipz5MH5v1DOUWf8g5ArozoCqmCLzbHb_fryc8eQGnu-P27ltnXSjJ5jD4MfJz-2Kx8 Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 278a9e0ef45f4f27a71f7ac7e80bc003 Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:04:43.730409 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/278a9e0ef45f4f27a71f7ac7e80bc003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/278a9e0ef45f4f27a71f7ac7e80bc003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_278a9e0ef45f4f27a71f7ac7e80bc003", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/278a9e0ef45f4f27a71f7ac7e80bc003"}]}] Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 278a9e0ef45f4f27a71f7ac7e80bc003 Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesDeleteNegativeTestJSON-467257152-project Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: c647d855e7aa4b6e8fd3364651f33907 Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-467257152-project Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '-1'} Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:43.732040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:43.733148 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:43.734444 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6acc2f9d-96f1-4a9e-89fc-deebecbc492c tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6acc2f9d-96f1-4a9e-89fc-deebecbc492c tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] 10.222.0.70 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.122448 Jul 26 14:04:43.735563 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 199/478] 10.222.0.70 () {58 vars in 1134 bytes} [Tue Jul 26 14:04:43 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:04:43.743103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f53758c7-e0fc-4992-ad5e-20b195b2495d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:43.744609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f53758c7-e0fc-4992-ad5e-20b195b2495d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:43.760729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f53758c7-e0fc-4992-ad5e-20b195b2495d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:43.761792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f53758c7-e0fc-4992-ad5e-20b195b2495d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:43.763790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f53758c7-e0fc-4992-ad5e-20b195b2495d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:43.764704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f53758c7-e0fc-4992-ad5e-20b195b2495d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:43.817774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:43.995432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:04:43.996400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:04:43.997567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:04:43.998498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:04:43.999405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:04:44.015010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:44.016909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:44.018796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:44.019930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:44.052837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for project d2c43d5f86804cc181b575525a402873. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:04:44.061665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for user 753d20ca575a4270b73b1c686bf657dd and project d2c43d5f86804cc181b575525a402873. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:04:44.073766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f53758c7-e0fc-4992-ad5e-20b195b2495d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:44.083924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:04:44.088645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:04:44.094330 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f53758c7-e0fc-4992-ad5e-20b195b2495d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1323 microversion: 2.1 time: 0.358562 Jul 26 14:04:44.099999 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 200/479] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:43 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1323 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:44.126147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ceff65b9-8c1f-43ac-b069-4e5d2d2c7908 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Calling method '.version_select at 0x7f87945d99d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:44.160217 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ceff65b9-8c1f-43ac-b069-4e5d2d2c7908 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] HTTP exception thrown: Image not found. Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ceff65b9-8c1f-43ac-b069-4e5d2d2c7908 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Request method failure captured: Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/images/50fe407f-796c-415b-8a27-7035052d19fj HTTP/1.1 Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_R6kNDZIMilcPEFUAIpYBheaj6yIvYgjQVQm5N5gaQ-d6pZY68n4upHtAaPU48GqXYafOlO6gCFMh0T1VQ-ZfHOBrCvcj8yGtTWukFL0CeSZipz5MH5v1DOUWf8g5ArozoCqmCLzbHb_fryc8eQGnu-P27ltnXSjJ5jD4MfJz-2Kx8 Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 278a9e0ef45f4f27a71f7ac7e80bc003 Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:04:44.164517 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/278a9e0ef45f4f27a71f7ac7e80bc003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/278a9e0ef45f4f27a71f7ac7e80bc003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_278a9e0ef45f4f27a71f7ac7e80bc003", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/278a9e0ef45f4f27a71f7ac7e80bc003"}]}] Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 278a9e0ef45f4f27a71f7ac7e80bc003 Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesDeleteNegativeTestJSON-467257152-project Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: c647d855e7aa4b6e8fd3364651f33907 Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-467257152-project Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '50fe407f-796c-415b-8a27-7035052d19fj'} Jul 26 14:04:44.166295 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 50fe407f-796c-415b-8a27-7035052d19fj to delete Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:44.167764 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 50fe407f-796c-415b-8a27-7035052d19fj could not be found. Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:44.169780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:04:44.170857 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.192247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ceff65b9-8c1f-43ac-b069-4e5d2d2c7908 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:44.199546 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ceff65b9-8c1f-43ac-b069-4e5d2d2c7908 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] 10.222.0.70 "DELETE /compute/v2.1/images/50fe407f-796c-415b-8a27-7035052d19fj" status: 404 len: 62 microversion: 2.1 time: 0.098221 Jul 26 14:04:44.200730 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 201/480] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:44 2022] DELETE /compute/v2.1/images/50fe407f-796c-415b-8a27-7035052d19fj => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:04:44.210881 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fc321a88-864c-47a1-a23f-d87f15ca63fa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.814469 Jul 26 14:04:44.214026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1197447005", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:44.218988 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 280/481] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:04:44.225125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bc5ea784-dbe6-4a6a-a770-691548995048 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:44.226279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bc5ea784-dbe6-4a6a-a770-691548995048 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:44.234069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc5ea784-dbe6-4a6a-a770-691548995048 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:44.234940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc5ea784-dbe6-4a6a-a770-691548995048 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:44.236546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc5ea784-dbe6-4a6a-a770-691548995048 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:44.237341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc5ea784-dbe6-4a6a-a770-691548995048 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:44.356580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:04:44.377257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bc5ea784-dbe6-4a6a-a770-691548995048 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:44.394230 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bc5ea784-dbe6-4a6a-a770-691548995048 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1278 microversion: 2.1 time: 0.166219 Jul 26 14:04:44.398673 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 281/482] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:44 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:44.422649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9f6f3e2-3c4d-408c-9921-2d4cef6b6278 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Calling method '.version_select at 0x7f87948f63a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:44.460695 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a9f6f3e2-3c4d-408c-9921-2d4cef6b6278 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] HTTP exception thrown: Image not found. Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9f6f3e2-3c4d-408c-9921-2d4cef6b6278 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Request method failure captured: Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/images/8d0264cc-bc38-46f2-a33e-739f9c11881d1 HTTP/1.1 Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_R6kNDZIMilcPEFUAIpYBheaj6yIvYgjQVQm5N5gaQ-d6pZY68n4upHtAaPU48GqXYafOlO6gCFMh0T1VQ-ZfHOBrCvcj8yGtTWukFL0CeSZipz5MH5v1DOUWf8g5ArozoCqmCLzbHb_fryc8eQGnu-P27ltnXSjJ5jD4MfJz-2Kx8 Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 278a9e0ef45f4f27a71f7ac7e80bc003 Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:44.468093 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/278a9e0ef45f4f27a71f7ac7e80bc003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/278a9e0ef45f4f27a71f7ac7e80bc003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_278a9e0ef45f4f27a71f7ac7e80bc003", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/278a9e0ef45f4f27a71f7ac7e80bc003"}]}] Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 278a9e0ef45f4f27a71f7ac7e80bc003 Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesDeleteNegativeTestJSON-467257152-project Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c647d855e7aa4b6e8fd3364651f33907 Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-467257152-project Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: exception: Image not found. Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '8d0264cc-bc38-46f2-a33e-739f9c11881d1'} Jul 26 14:04:44.469820 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8d0264cc-bc38-46f2-a33e-739f9c11881d1 to delete Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:44.470783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8d0264cc-bc38-46f2-a33e-739f9c11881d1 could not be found. Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:44.472102 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:04:44.475265 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:44.483225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9f6f3e2-3c4d-408c-9921-2d4cef6b6278 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Returning 404 to user: Image not found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:44.484693 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a9f6f3e2-3c4d-408c-9921-2d4cef6b6278 tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] 10.222.0.70 "DELETE /compute/v2.1/images/8d0264cc-bc38-46f2-a33e-739f9c11881d1" status: 404 len: 62 microversion: 2.1 time: 0.084738 Jul 26 14:04:44.491845 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 282/483] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:04:44 2022] DELETE /compute/v2.1/images/8d0264cc-bc38-46f2-a33e-739f9c11881d1 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:04:44.498789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-48394ccd-f824-4e63-b3ba-25efca0a099c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:44.508349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-48394ccd-f824-4e63-b3ba-25efca0a099c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:44.703639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-48394ccd-f824-4e63-b3ba-25efca0a099c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:44.715409 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-48394ccd-f824-4e63-b3ba-25efca0a099c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1212 microversion: 2.1 time: 0.222021 Jul 26 14:04:44.716180 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 283/484] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:44 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1212 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:44.734468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-205b049a-3cc6-4c91-af67-1ded684aa878 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:44.735313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-205b049a-3cc6-4c91-af67-1ded684aa878 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:44.742921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-205b049a-3cc6-4c91-af67-1ded684aa878 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:44.745970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-205b049a-3cc6-4c91-af67-1ded684aa878 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:44.754573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-205b049a-3cc6-4c91-af67-1ded684aa878 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:44.755327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-205b049a-3cc6-4c91-af67-1ded684aa878 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:45.009436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-205b049a-3cc6-4c91-af67-1ded684aa878 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:45.037036 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-205b049a-3cc6-4c91-af67-1ded684aa878 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1334 microversion: 2.1 time: 0.319526 Jul 26 14:04:45.039883 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 284/485] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:44 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1334 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:45.081321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c19d4512-aa8d-47b8-98ae-04f0bc47c1fa tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Calling method '.version_select at 0x7f87948b11f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:45.129147 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c19d4512-aa8d-47b8-98ae-04f0bc47c1fa tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] HTTP exception thrown: Image not found. Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c19d4512-aa8d-47b8-98ae-04f0bc47c1fa tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Request method failure captured: Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/images/tempest-invalid-609804231 HTTP/1.1 Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_R6kNDZIMilcPEFUAIpYBheaj6yIvYgjQVQm5N5gaQ-d6pZY68n4upHtAaPU48GqXYafOlO6gCFMh0T1VQ-ZfHOBrCvcj8yGtTWukFL0CeSZipz5MH5v1DOUWf8g5ArozoCqmCLzbHb_fryc8eQGnu-P27ltnXSjJ5jD4MfJz-2Kx8 Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 278a9e0ef45f4f27a71f7ac7e80bc003 Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:45.130906 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/278a9e0ef45f4f27a71f7ac7e80bc003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/278a9e0ef45f4f27a71f7ac7e80bc003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_278a9e0ef45f4f27a71f7ac7e80bc003", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/278a9e0ef45f4f27a71f7ac7e80bc003"}]}] Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 278a9e0ef45f4f27a71f7ac7e80bc003 Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesDeleteNegativeTestJSON-467257152-project Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c647d855e7aa4b6e8fd3364651f33907 Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-467257152-project Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: exception: Image not found. Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'tempest-invalid-609804231'} Jul 26 14:04:45.132882 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-609804231 to delete Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:45.133660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-609804231 could not be found. Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:45.135101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c19d4512-aa8d-47b8-98ae-04f0bc47c1fa tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Returning 404 to user: Image not found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:45.137207 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c19d4512-aa8d-47b8-98ae-04f0bc47c1fa tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] 10.222.0.70 "DELETE /compute/v2.1/images/tempest-invalid-609804231" status: 404 len: 62 microversion: 2.1 time: 0.069305 Jul 26 14:04:45.139411 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 285/486] 10.222.0.70 () {58 vars in 1203 bytes} [Tue Jul 26 14:04:45 2022] DELETE /compute/v2.1/images/tempest-invalid-609804231 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:04:45.141232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8eeb1d4f-a499-45fc-8692-0f037e24cb03 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:45.141887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8eeb1d4f-a499-45fc-8692-0f037e24cb03 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:45.162029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8eeb1d4f-a499-45fc-8692-0f037e24cb03 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:45.162490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8eeb1d4f-a499-45fc-8692-0f037e24cb03 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:45.163692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8eeb1d4f-a499-45fc-8692-0f037e24cb03 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:45.164331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8eeb1d4f-a499-45fc-8692-0f037e24cb03 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:45.270732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:04:45.271301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:04:45.271722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:04:45.272293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:04:45.272981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:04:45.287083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:45.287838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:45.290097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:45.290950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:45.314844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Getting quotas for project 2557523d126843c9bb4057ca96cbfeb7. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:04:45.320476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Getting quotas for user 7da8a4c2b1bd46a59262eecd7028d7da and project 2557523d126843c9bb4057ca96cbfeb7. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:04:45.334717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.utils [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] ram quota exceeded for 2557523d126843c9bb4057ca96cbfeb7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119478) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 26 14:04:45.337016 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Request method failure captured: Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 145 Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RuVKlozH8f_3ocd2lvvSNesvMiWyQnkuwI-1keeep8bzaOp5I_6ZnZtWbKhbooyuFxH-kGTVNiVdRq2imkjTiDXrSavhzhCtn1YOLHr77AJ0V_sYWgDKzHut_6ftSihZK5wTVTJmVSbbp1sQlIemvjVaDVX_-Tii0PLovopa7ZyxI Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2557523d126843c9bb4057ca96cbfeb7 Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:04:45.339568 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2557523d126843c9bb4057ca96cbfeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2557523d126843c9bb4057ca96cbfeb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2557523d126843c9bb4057ca96cbfeb7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2557523d126843c9bb4057ca96cbfeb7"}]}] Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2557523d126843c9bb4057ca96cbfeb7 Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-QuotasAdminNegativeTest-1332934117-project Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7da8a4c2b1bd46a59262eecd7028d7da Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-QuotasAdminNegativeTest-1332934117-project Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1197447005", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} Jul 26 14:04:45.341187 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1197447005', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452'}}} Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 14:04:45.342060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:45.343257 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.344774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.346225 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:45.346225 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:45.346225 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:45.346225 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:45.346225 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 26 14:04:45.346225 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.348033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:45.349126 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ca1f5453-6dd9-4305-bd43-767e5d4093f5 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.146189 Jul 26 14:04:45.350214 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 202/487] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:04:44 2022] POST /compute/v2.1/servers => generated 110 bytes in 1148 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:45.358133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-59872b98-e045-4fc6-8e96-4cd48f89526a tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Calling method '.version_select at 0x7f8794622a60>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:45.391121 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-59872b98-e045-4fc6-8e96-4cd48f89526a tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] HTTP exception thrown: Image not found. Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-59872b98-e045-4fc6-8e96-4cd48f89526a tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Request method failure captured: Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/images/a2a337a8-8516-49d0-a415-6114449ec40e HTTP/1.1 Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_R6kNDZIMilcPEFUAIpYBheaj6yIvYgjQVQm5N5gaQ-d6pZY68n4upHtAaPU48GqXYafOlO6gCFMh0T1VQ-ZfHOBrCvcj8yGtTWukFL0CeSZipz5MH5v1DOUWf8g5ArozoCqmCLzbHb_fryc8eQGnu-P27ltnXSjJ5jD4MfJz-2Kx8 Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 278a9e0ef45f4f27a71f7ac7e80bc003 Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:04:45.394928 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/278a9e0ef45f4f27a71f7ac7e80bc003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/278a9e0ef45f4f27a71f7ac7e80bc003"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_278a9e0ef45f4f27a71f7ac7e80bc003", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/278a9e0ef45f4f27a71f7ac7e80bc003"}]}] Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 278a9e0ef45f4f27a71f7ac7e80bc003 Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-467257152 Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesDeleteNegativeTestJSON-467257152-project Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: c647d855e7aa4b6e8fd3364651f33907 Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-467257152-project Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'a2a337a8-8516-49d0-a415-6114449ec40e'} Jul 26 14:04:45.399162 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a2a337a8-8516-49d0-a415-6114449ec40e to delete Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:45.400882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a2a337a8-8516-49d0-a415-6114449ec40e could not be found. Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:45.403722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:04:45.409007 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:45.417524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-59872b98-e045-4fc6-8e96-4cd48f89526a tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:45.419022 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-59872b98-e045-4fc6-8e96-4cd48f89526a tempest-ImagesDeleteNegativeTestJSON-467257152 tempest-ImagesDeleteNegativeTestJSON-467257152-project] 10.222.0.70 "DELETE /compute/v2.1/images/a2a337a8-8516-49d0-a415-6114449ec40e" status: 404 len: 62 microversion: 2.1 time: 0.066999 Jul 26 14:04:45.420184 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 203/488] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:45 2022] DELETE /compute/v2.1/images/a2a337a8-8516-49d0-a415-6114449ec40e => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:04:45.428621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71bb3717-1519-48b2-b308-37febc15991b tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Action: 'update', calling method: .version_select at 0x7f8794540ca0>, body: {"quota_set": {"ram": 51200}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:45.981945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8eeb1d4f-a499-45fc-8692-0f037e24cb03 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:46.001772 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8eeb1d4f-a499-45fc-8692-0f037e24cb03 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1471 microversion: 2.1 time: 0.866202 Jul 26 14:04:46.017167 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 286/489] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:45 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1471 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:46.028477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d255bd86-fde9-40c6-95cc-d43df3667584 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:46.029357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d255bd86-fde9-40c6-95cc-d43df3667584 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:46.036999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d255bd86-fde9-40c6-95cc-d43df3667584 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:46.038070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d255bd86-fde9-40c6-95cc-d43df3667584 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:46.039650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d255bd86-fde9-40c6-95cc-d43df3667584 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:46.040307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d255bd86-fde9-40c6-95cc-d43df3667584 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:46.364660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71bb3717-1519-48b2-b308-37febc15991b tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:46.365245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71bb3717-1519-48b2-b308-37febc15991b tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:46.366171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71bb3717-1519-48b2-b308-37febc15991b tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:46.367569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71bb3717-1519-48b2-b308-37febc15991b tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:46.475284 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-71bb3717-1519-48b2-b308-37febc15991b tempest-QuotasAdminNegativeTest-2069260571 tempest-QuotasAdminNegativeTest-2069260571-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7" status: 200 len: 329 microversion: 2.1 time: 1.052728 Jul 26 14:04:46.475926 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 204/490] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:04:45 2022] PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 => generated 329 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:46.489818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2efd5dbc-ba30-413d-aea5-d10963e5d762 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:46.490744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2efd5dbc-ba30-413d-aea5-d10963e5d762 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:46.508376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2efd5dbc-ba30-413d-aea5-d10963e5d762 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:46.509173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2efd5dbc-ba30-413d-aea5-d10963e5d762 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:46.510125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2efd5dbc-ba30-413d-aea5-d10963e5d762 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:46.510750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2efd5dbc-ba30-413d-aea5-d10963e5d762 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:46.906576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2efd5dbc-ba30-413d-aea5-d10963e5d762 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:46.921211 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2efd5dbc-ba30-413d-aea5-d10963e5d762 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1282 microversion: 2.1 time: 0.443928 Jul 26 14:04:46.922784 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 205/491] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:46 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1282 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:46.932727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c706265a-b0cc-4f9f-bdc6-2ac7466900d2 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:46.933471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c706265a-b0cc-4f9f-bdc6-2ac7466900d2 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:46.943624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c706265a-b0cc-4f9f-bdc6-2ac7466900d2 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:46.944116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c706265a-b0cc-4f9f-bdc6-2ac7466900d2 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:46.944944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c706265a-b0cc-4f9f-bdc6-2ac7466900d2 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:46.945582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c706265a-b0cc-4f9f-bdc6-2ac7466900d2 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:47.000347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c706265a-b0cc-4f9f-bdc6-2ac7466900d2 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c706265a-b0cc-4f9f-bdc6-2ac7466900d2 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Request method failure captured: Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5/diagnostics HTTP/1.1 Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RluhRvCzHBMkpXT-humwLkbTgCrAnnIy9GaNV5OqP5cuahwUTVt3esNWAJeJl5RFpv43yXutD6wSJZ9_HxBBrXg_YMpab6uHoTrU0xfnXMZ1vM7f9uUmY96ARA3LFNJ5XL05krVSXsJgPNNrYJjuclBs43at-AoHAqWPvmprmnJh4 Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: e9e2b96bde2a4879855a7dfcc1ebb8f2 Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1984020770 Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:04:47.002540 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e9e2b96bde2a4879855a7dfcc1ebb8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e9e2b96bde2a4879855a7dfcc1ebb8f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e9e2b96bde2a4879855a7dfcc1ebb8f2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e9e2b96bde2a4879855a7dfcc1ebb8f2"}]}] Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1984020770 Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: e9e2b96bde2a4879855a7dfcc1ebb8f2 Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1984020770 Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerDiagnosticsNegativeTest-1984020770-project Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 285d6eb93c904aa7ab0328aace826df9 Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1984020770-project Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:04:47.003844 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': '9ae8f99b-d3af-405e-974a-312c9baa0ba5'} Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:04:47.004611 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 26 14:04:47.005923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:04:47.018092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c706265a-b0cc-4f9f-bdc6-2ac7466900d2 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:47.019741 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c706265a-b0cc-4f9f-bdc6-2ac7466900d2 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.094501 Jul 26 14:04:47.020848 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 206/492] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:04:46 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5/diagnostics => generated 117 bytes in 97 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:47.026653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cce8632d-216a-4420-9f8e-a8277c7ecaa3 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:47.034728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cce8632d-216a-4420-9f8e-a8277c7ecaa3 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:47.042781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cce8632d-216a-4420-9f8e-a8277c7ecaa3 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:47.050371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cce8632d-216a-4420-9f8e-a8277c7ecaa3 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:47.051452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cce8632d-216a-4420-9f8e-a8277c7ecaa3 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:47.052503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cce8632d-216a-4420-9f8e-a8277c7ecaa3 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:47.146079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d255bd86-fde9-40c6-95cc-d43df3667584 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:47.159014 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d255bd86-fde9-40c6-95cc-d43df3667584 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1320 microversion: 2.1 time: 1.140254 Jul 26 14:04:47.159598 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 287/493] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:46 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1320 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:47.178881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92282074-ddb1-470a-9bdf-3a952412c099 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Action: 'update', calling method: .version_select at 0x7f87948c18b0>, body: {"quota_set": {"ram": 0}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:47.184699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-92282074-ddb1-470a-9bdf-3a952412c099 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '7da8a4c2b1bd46a59262eecd7028d7da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2557523d126843c9bb4057ca96cbfeb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92282074-ddb1-470a-9bdf-3a952412c099 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Request method failure captured: Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 HTTP/1.1 Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 25 Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RuVKlozH8f_3ocd2lvvSNesvMiWyQnkuwI-1keeep8bzaOp5I_6ZnZtWbKhbooyuFxH-kGTVNiVdRq2imkjTiDXrSavhzhCtn1YOLHr77AJ0V_sYWgDKzHut_6ftSihZK5wTVTJmVSbbp1sQlIemvjVaDVX_-Tii0PLovopa7ZyxI Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2557523d126843c9bb4057ca96cbfeb7 Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:47.193093 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2557523d126843c9bb4057ca96cbfeb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2557523d126843c9bb4057ca96cbfeb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2557523d126843c9bb4057ca96cbfeb7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2557523d126843c9bb4057ca96cbfeb7"}]}] Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2557523d126843c9bb4057ca96cbfeb7 Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1332934117 Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-QuotasAdminNegativeTest-1332934117-project Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7da8a4c2b1bd46a59262eecd7028d7da Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-QuotasAdminNegativeTest-1332934117-project Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: {"quota_set": {"ram": 0}} Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 26 14:04:47.194577 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '2557523d126843c9bb4057ca96cbfeb7', 'body': {'quota_set': {'ram': 0}}} Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:04:47.195483 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:47.196937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:47.200370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:47.200370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:47.200370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:04:47.200370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:04:47.200370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 26 14:04:47.200370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:47.203325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92282074-ddb1-470a-9bdf-3a952412c099 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:47.204502 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-92282074-ddb1-470a-9bdf-3a952412c099 tempest-QuotasAdminNegativeTest-1332934117 tempest-QuotasAdminNegativeTest-1332934117-project] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7" status: 403 len: 116 microversion: 2.1 time: 0.039959 Jul 26 14:04:47.209284 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 288/494] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:04:47 2022] PUT /compute/v2.1/os-quota-sets/2557523d126843c9bb4057ca96cbfeb7 => generated 116 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:47.222600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-faad6b58-2ba9-45a1-8292-73cab21e6b43 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:47.223369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-faad6b58-2ba9-45a1-8292-73cab21e6b43 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:47.241223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faad6b58-2ba9-45a1-8292-73cab21e6b43 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:47.244858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faad6b58-2ba9-45a1-8292-73cab21e6b43 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:47.246268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faad6b58-2ba9-45a1-8292-73cab21e6b43 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:47.246993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faad6b58-2ba9-45a1-8292-73cab21e6b43 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:47.312887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-faad6b58-2ba9-45a1-8292-73cab21e6b43 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:04:47.438036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cce8632d-216a-4420-9f8e-a8277c7ecaa3 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:47.447379 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cce8632d-216a-4420-9f8e-a8277c7ecaa3 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1322 microversion: 2.1 time: 0.425303 Jul 26 14:04:47.471660 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 207/495] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:47 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:47.482993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-5b2a623e-7742-4674-85b1-488873107276 req-904697e9-47db-49fe-9f45-19cba869530f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae", "name": "network-vif-deleted", "tag": "04498d04-b08b-4461-aadb-a16fe8c57ea4"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:47.513645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5b2a623e-7742-4674-85b1-488873107276 req-904697e9-47db-49fe-9f45-19cba869530f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:47.514796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5b2a623e-7742-4674-85b1-488873107276 req-904697e9-47db-49fe-9f45-19cba869530f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:47.571335 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-5b2a623e-7742-4674-85b1-488873107276 req-904697e9-47db-49fe-9f45-19cba869530f service nova] Creating event network-vif-deleted:04498d04-b08b-4461-aadb-a16fe8c57ea4 for instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae on n-h1-833090-9 Jul 26 14:04:47.583208 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-5b2a623e-7742-4674-85b1-488873107276 req-904697e9-47db-49fe-9f45-19cba869530f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107659 Jul 26 14:04:47.586926 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 208/496] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:47.693711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:47.786542 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-faad6b58-2ba9-45a1-8292-73cab21e6b43 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 204 len: 0 microversion: 2.1 time: 0.575001 Jul 26 14:04:47.787141 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 289/497] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:04:47 2022] DELETE /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:04:47.796981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-407ff0f9-d1a5-4783-8237-fd0946053cb1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:47.798015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-407ff0f9-d1a5-4783-8237-fd0946053cb1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:47.816580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-407ff0f9-d1a5-4783-8237-fd0946053cb1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:47.817043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-407ff0f9-d1a5-4783-8237-fd0946053cb1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:47.823158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-407ff0f9-d1a5-4783-8237-fd0946053cb1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:47.825607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-407ff0f9-d1a5-4783-8237-fd0946053cb1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:47.946195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-25d98495-cc6d-41e8-84c4-bc71d3f70040 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:47.946808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-25d98495-cc6d-41e8-84c4-bc71d3f70040 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:47.967932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25d98495-cc6d-41e8-84c4-bc71d3f70040 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:47.968483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25d98495-cc6d-41e8-84c4-bc71d3f70040 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:47.969279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25d98495-cc6d-41e8-84c4-bc71d3f70040 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:47.969719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25d98495-cc6d-41e8-84c4-bc71d3f70040 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:48.762456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25d98495-cc6d-41e8-84c4-bc71d3f70040 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:48.771807 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-25d98495-cc6d-41e8-84c4-bc71d3f70040 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1270 microversion: 2.1 time: 0.830608 Jul 26 14:04:48.787989 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 290/498] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:47 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1270 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:48.793310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4e2332ce-2506-4478-85fc-895724883801 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:48.793951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4e2332ce-2506-4478-85fc-895724883801 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:48.801611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e2332ce-2506-4478-85fc-895724883801 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:48.802070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e2332ce-2506-4478-85fc-895724883801 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:48.803215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e2332ce-2506-4478-85fc-895724883801 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:48.804063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e2332ce-2506-4478-85fc-895724883801 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:48.921142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-407ff0f9-d1a5-4783-8237-fd0946053cb1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:48.964642 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-407ff0f9-d1a5-4783-8237-fd0946053cb1 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1477 microversion: 2.1 time: 1.172734 Jul 26 14:04:48.973027 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 209/499] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:47 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1477 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:48.999037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b7d998aa-3f25-46b5-8649-2b4f19b4d74f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:49.001581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b7d998aa-3f25-46b5-8649-2b4f19b4d74f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:49.042227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7d998aa-3f25-46b5-8649-2b4f19b4d74f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:49.044058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7d998aa-3f25-46b5-8649-2b4f19b4d74f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:49.048085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7d998aa-3f25-46b5-8649-2b4f19b4d74f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:49.049566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7d998aa-3f25-46b5-8649-2b4f19b4d74f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:49.353370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b7d998aa-3f25-46b5-8649-2b4f19b4d74f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:49.356457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4e2332ce-2506-4478-85fc-895724883801 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:49.365548 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4e2332ce-2506-4478-85fc-895724883801 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1320 microversion: 2.1 time: 0.586543 Jul 26 14:04:49.366424 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b7d998aa-3f25-46b5-8649-2b4f19b4d74f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1322 microversion: 2.1 time: 0.391927 Jul 26 14:04:49.367264 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 210/500] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:48 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:49.380188 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 291/501] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:48 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1320 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:49.803667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a12235cb-5faa-4ec1-85bc-c1bc4eca6209 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:49.804959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a12235cb-5faa-4ec1-85bc-c1bc4eca6209 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:49.813582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a12235cb-5faa-4ec1-85bc-c1bc4eca6209 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:49.814045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a12235cb-5faa-4ec1-85bc-c1bc4eca6209 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:49.814835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a12235cb-5faa-4ec1-85bc-c1bc4eca6209 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:49.815291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a12235cb-5faa-4ec1-85bc-c1bc4eca6209 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:49.925240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7f8c93a8-3abf-4148-b854-88a7a3bf01b5 req-d7dc8261-b1d7-4af2-ab0b-2e5f91362342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca8382cf-84cb-4c99-8a6a-aa871672d6df", "tag": "3f2e1c4a-8e86-4d0c-addd-f5ab96ba55cb"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:49.937849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7f8c93a8-3abf-4148-b854-88a7a3bf01b5 req-d7dc8261-b1d7-4af2-ab0b-2e5f91362342 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:49.938333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7f8c93a8-3abf-4148-b854-88a7a3bf01b5 req-d7dc8261-b1d7-4af2-ab0b-2e5f91362342 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:49.951166 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7f8c93a8-3abf-4148-b854-88a7a3bf01b5 req-d7dc8261-b1d7-4af2-ab0b-2e5f91362342 service nova] Creating event network-changed:3f2e1c4a-8e86-4d0c-addd-f5ab96ba55cb for instance ca8382cf-84cb-4c99-8a6a-aa871672d6df on n-h2-833090-9 Jul 26 14:04:49.956620 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7f8c93a8-3abf-4148-b854-88a7a3bf01b5 req-d7dc8261-b1d7-4af2-ab0b-2e5f91362342 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039072 Jul 26 14:04:49.957796 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 292/502] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:50.000682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e7092301-6070-496b-a42b-fd46a81b2e6d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:50.001532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e7092301-6070-496b-a42b-fd46a81b2e6d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:50.005907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:50.016733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7092301-6070-496b-a42b-fd46a81b2e6d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:50.021032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7092301-6070-496b-a42b-fd46a81b2e6d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:50.021876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7092301-6070-496b-a42b-fd46a81b2e6d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:50.022501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7092301-6070-496b-a42b-fd46a81b2e6d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:50.058628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a12235cb-5faa-4ec1-85bc-c1bc4eca6209 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:50.074328 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a12235cb-5faa-4ec1-85bc-c1bc4eca6209 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1270 microversion: 2.1 time: 0.277249 Jul 26 14:04:50.075647 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 211/503] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:49 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1270 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:50.388271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-197e7e3d-3518-42f1-b807-bef237a3e185 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:50.388895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-197e7e3d-3518-42f1-b807-bef237a3e185 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:50.401268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-197e7e3d-3518-42f1-b807-bef237a3e185 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:50.401721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-197e7e3d-3518-42f1-b807-bef237a3e185 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:50.402510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-197e7e3d-3518-42f1-b807-bef237a3e185 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:50.402952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-197e7e3d-3518-42f1-b807-bef237a3e185 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:50.529885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e7092301-6070-496b-a42b-fd46a81b2e6d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:50.559646 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e7092301-6070-496b-a42b-fd46a81b2e6d tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1477 microversion: 2.1 time: 0.563858 Jul 26 14:04:50.572712 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 293/504] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:49 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1477 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:50.594712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-395b5ebd-c823-4abb-8268-a821440e417c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:50.595350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-395b5ebd-c823-4abb-8268-a821440e417c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:50.620362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-395b5ebd-c823-4abb-8268-a821440e417c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:50.622560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-395b5ebd-c823-4abb-8268-a821440e417c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:50.627754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-395b5ebd-c823-4abb-8268-a821440e417c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:50.628881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-395b5ebd-c823-4abb-8268-a821440e417c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:51.128271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-197e7e3d-3518-42f1-b807-bef237a3e185 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:51.139191 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-197e7e3d-3518-42f1-b807-bef237a3e185 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1390 microversion: 2.1 time: 0.754389 Jul 26 14:04:51.139784 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 212/505] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:50 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1390 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:51.150795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-80c1d68f-8b5b-4a79-8827-9db96eb66c47 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:51.155693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-80c1d68f-8b5b-4a79-8827-9db96eb66c47 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:51.166571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80c1d68f-8b5b-4a79-8827-9db96eb66c47 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:51.167275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80c1d68f-8b5b-4a79-8827-9db96eb66c47 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:51.168368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80c1d68f-8b5b-4a79-8827-9db96eb66c47 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:51.169028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80c1d68f-8b5b-4a79-8827-9db96eb66c47 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:51.656874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-395b5ebd-c823-4abb-8268-a821440e417c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:51.671203 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-395b5ebd-c823-4abb-8268-a821440e417c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1320 microversion: 2.1 time: 1.095350 Jul 26 14:04:51.684907 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 294/506] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:50 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1320 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:51.686522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a409355-0f44-4d92-bf38-715657861943 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:51.687167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a409355-0f44-4d92-bf38-715657861943 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:51.715169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a409355-0f44-4d92-bf38-715657861943 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:51.715913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a409355-0f44-4d92-bf38-715657861943 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:51.716992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a409355-0f44-4d92-bf38-715657861943 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:51.717632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a409355-0f44-4d92-bf38-715657861943 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:52.101703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a409355-0f44-4d92-bf38-715657861943 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:52.112415 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a409355-0f44-4d92-bf38-715657861943 tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1435 microversion: 2.1 time: 0.436627 Jul 26 14:04:52.115201 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 295/507] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:51 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1435 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:52.140920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-73dc6997-ad1e-46ae-b1e1-2ffd425a4ace req-1d7f86f9-ac69-4c27-ae96-d9436e632d2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae8f99b-d3af-405e-974a-312c9baa0ba5", "name": "network-vif-deleted", "tag": "c4bbb31b-1b2a-4aef-9293-6f0174c0689c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:52.172113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-73dc6997-ad1e-46ae-b1e1-2ffd425a4ace req-1d7f86f9-ac69-4c27-ae96-d9436e632d2b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:52.173135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-73dc6997-ad1e-46ae-b1e1-2ffd425a4ace req-1d7f86f9-ac69-4c27-ae96-d9436e632d2b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:52.189351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80c1d68f-8b5b-4a79-8827-9db96eb66c47 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:52.198806 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-80c1d68f-8b5b-4a79-8827-9db96eb66c47 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1312 microversion: 2.1 time: 1.057539 Jul 26 14:04:52.203377 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 213/508] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:51 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1312 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:52.221522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb312374-b01b-4272-878e-f55666a6f815 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:52.222495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eb312374-b01b-4272-878e-f55666a6f815 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:52.233928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb312374-b01b-4272-878e-f55666a6f815 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:52.234736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb312374-b01b-4272-878e-f55666a6f815 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:52.235903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb312374-b01b-4272-878e-f55666a6f815 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:52.236185 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-73dc6997-ad1e-46ae-b1e1-2ffd425a4ace req-1d7f86f9-ac69-4c27-ae96-d9436e632d2b service nova] Creating event network-vif-deleted:c4bbb31b-1b2a-4aef-9293-6f0174c0689c for instance 9ae8f99b-d3af-405e-974a-312c9baa0ba5 on n-h2-833090-9 Jul 26 14:04:52.236720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb312374-b01b-4272-878e-f55666a6f815 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:52.249970 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-73dc6997-ad1e-46ae-b1e1-2ffd425a4ace req-1d7f86f9-ac69-4c27-ae96-d9436e632d2b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118096 Jul 26 14:04:52.253918 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 296/509] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:52.707066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d9d2656-0e93-4a4e-b056-30785e91cac7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:52.708958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d9d2656-0e93-4a4e-b056-30785e91cac7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:52.724016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-eb312374-b01b-4272-878e-f55666a6f815 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:52.738769 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eb312374-b01b-4272-878e-f55666a6f815 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1390 microversion: 2.1 time: 0.526012 Jul 26 14:04:52.754292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d9d2656-0e93-4a4e-b056-30785e91cac7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:52.754973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d9d2656-0e93-4a4e-b056-30785e91cac7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:52.756091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d9d2656-0e93-4a4e-b056-30785e91cac7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:52.759831 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 214/510] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:52 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1390 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:52.775069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d9d2656-0e93-4a4e-b056-30785e91cac7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:53.138518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:53.139416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:53.170541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:53.170541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:53.170541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:53.170541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:53.263092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:53.264236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:53.264854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lazy-loading 'fault' on Instance uuid 9ae8f99b-d3af-405e-974a-312c9baa0ba5 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:04:53.610362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285d6eb93c904aa7ab0328aace826df9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9e2b96bde2a4879855a7dfcc1ebb8f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:53.626229 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-be7ae856-46e7-4a33-b685-4b4e002d4c2e tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 200 len: 1313 microversion: 2.1 time: 0.491585 Jul 26 14:04:53.628978 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 215/511] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:53 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:53.647096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c29a8eac-6aa2-453c-a5df-0caf44a874e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:53.648974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c29a8eac-6aa2-453c-a5df-0caf44a874e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:53.669210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c29a8eac-6aa2-453c-a5df-0caf44a874e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:53.671445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c29a8eac-6aa2-453c-a5df-0caf44a874e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:53.674392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c29a8eac-6aa2-453c-a5df-0caf44a874e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:53.676681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c29a8eac-6aa2-453c-a5df-0caf44a874e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:54.034228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=10 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:54.055113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d9d2656-0e93-4a4e-b056-30785e91cac7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:54.072110 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d9d2656-0e93-4a4e-b056-30785e91cac7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1320 microversion: 2.1 time: 1.371007 Jul 26 14:04:54.073580 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 297/512] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:52 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1320 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:54.093535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-281d2291-94ff-4193-8fcd-bb22ecbe4c4d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:54.097417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-281d2291-94ff-4193-8fcd-bb22ecbe4c4d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:54.113405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-281d2291-94ff-4193-8fcd-bb22ecbe4c4d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:54.116272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-281d2291-94ff-4193-8fcd-bb22ecbe4c4d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:54.118965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-281d2291-94ff-4193-8fcd-bb22ecbe4c4d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:54.120460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-281d2291-94ff-4193-8fcd-bb22ecbe4c4d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:54.307813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c29a8eac-6aa2-453c-a5df-0caf44a874e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:54.317203 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c29a8eac-6aa2-453c-a5df-0caf44a874e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1312 microversion: 2.1 time: 0.685961 Jul 26 14:04:54.321722 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 216/513] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:53 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1312 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:54.334978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-1d1ec052-2cc6-4588-8968-4e472e2ac284 req-7c477db2-a94d-49d6-9e5c-94b32664e6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9611ccf6-16ec-4945-aecf-3cfcb058ec91", "tag": "803157f9-374f-4edf-b468-6e317b5c706e"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:54.359022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1d1ec052-2cc6-4588-8968-4e472e2ac284 req-7c477db2-a94d-49d6-9e5c-94b32664e6d5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:54.359695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1d1ec052-2cc6-4588-8968-4e472e2ac284 req-7c477db2-a94d-49d6-9e5c-94b32664e6d5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:54.387708 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-1d1ec052-2cc6-4588-8968-4e472e2ac284 req-7c477db2-a94d-49d6-9e5c-94b32664e6d5 service nova] Creating event network-changed:803157f9-374f-4edf-b468-6e317b5c706e for instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 on n-h1-833090-9 Jul 26 14:04:54.395877 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-1d1ec052-2cc6-4588-8968-4e472e2ac284 req-7c477db2-a94d-49d6-9e5c-94b32664e6d5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072567 Jul 26 14:04:54.397697 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 217/514] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:54.708074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=38 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:54.837135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-48a38231-30cc-4ffa-b50c-d67eae8eb3c3 tempest-NetworksTest-255537173 tempest-NetworksTest-255537173-project-admin] Calling method '.version_select at 0x7f87945f9a60>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:54.900936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-281d2291-94ff-4193-8fcd-bb22ecbe4c4d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:54.916557 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-281d2291-94ff-4193-8fcd-bb22ecbe4c4d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1390 microversion: 2.1 time: 0.841478 Jul 26 14:04:54.939102 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 298/515] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:54 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1390 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:54.956639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fcfdb42d-d5fa-4bdc-9cb5-0ffa1bf7b0bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:54.957665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fcfdb42d-d5fa-4bdc-9cb5-0ffa1bf7b0bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] [instance: 9ae8f99b-d3af-405e-974a-312c9baa0ba5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:54.995547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcfdb42d-d5fa-4bdc-9cb5-0ffa1bf7b0bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:54.999784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcfdb42d-d5fa-4bdc-9cb5-0ffa1bf7b0bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:55.000972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcfdb42d-d5fa-4bdc-9cb5-0ffa1bf7b0bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:55.008626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcfdb42d-d5fa-4bdc-9cb5-0ffa1bf7b0bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:55.047471 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-fcfdb42d-d5fa-4bdc-9cb5-0ffa1bf7b0bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] HTTP exception thrown: Instance 9ae8f99b-d3af-405e-974a-312c9baa0ba5 could not be found. Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fcfdb42d-d5fa-4bdc-9cb5-0ffa1bf7b0bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Request method failure captured: Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 HTTP/1.1 Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_RluhRvCzHBMkpXT-humwLkbTgCrAnnIy9GaNV5OqP5cuahwUTVt3esNWAJeJl5RFpv43yXutD6wSJZ9_HxBBrXg_YMpab6uHoTrU0xfnXMZ1vM7f9uUmY96ARA3LFNJ5XL05krVSXsJgPNNrYJjuclBs43at-AoHAqWPvmprmnJh4 Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: e9e2b96bde2a4879855a7dfcc1ebb8f2 Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1984020770 Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:04:55.049362 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e9e2b96bde2a4879855a7dfcc1ebb8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e9e2b96bde2a4879855a7dfcc1ebb8f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e9e2b96bde2a4879855a7dfcc1ebb8f2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e9e2b96bde2a4879855a7dfcc1ebb8f2"}]}] Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1984020770 Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: e9e2b96bde2a4879855a7dfcc1ebb8f2 Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1984020770 Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerDiagnosticsNegativeTest-1984020770-project Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 285d6eb93c904aa7ab0328aace826df9 Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1984020770-project Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 9ae8f99b-d3af-405e-974a-312c9baa0ba5 could not be found. Jul 26 14:04:55.050812 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '9ae8f99b-d3af-405e-974a-312c9baa0ba5'} Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae8f99b-d3af-405e-974a-312c9baa0ba5 could not be found. Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:04:55.051544 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae8f99b-d3af-405e-974a-312c9baa0ba5 could not be found. Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae8f99b-d3af-405e-974a-312c9baa0ba5 could not be found. Jul 26 14:04:55.052780 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:04:55.056321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fcfdb42d-d5fa-4bdc-9cb5-0ffa1bf7b0bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] Returning 404 to user: Instance 9ae8f99b-d3af-405e-974a-312c9baa0ba5 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:04:55.060674 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fcfdb42d-d5fa-4bdc-9cb5-0ffa1bf7b0bd tempest-ServerDiagnosticsNegativeTest-1984020770 tempest-ServerDiagnosticsNegativeTest-1984020770-project] 10.222.0.70 "GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5" status: 404 len: 111 microversion: 2.1 time: 0.119800 Jul 26 14:04:55.064009 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 299/516] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:54 2022] GET /compute/v2.1/servers/9ae8f99b-d3af-405e-974a-312c9baa0ba5 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:04:55.082953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9a1a09ad-89b1-49df-b87a-fd714c73e307 req-3576d248-4349-4d7f-bc9b-0154e143fdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9a10de-f7c8-4e73-8803-471376cb000a", "tag": "6728d156-9e70-4308-aeaa-e54d42714d76"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:55.112250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9a1a09ad-89b1-49df-b87a-fd714c73e307 req-3576d248-4349-4d7f-bc9b-0154e143fdf4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:55.113439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9a1a09ad-89b1-49df-b87a-fd714c73e307 req-3576d248-4349-4d7f-bc9b-0154e143fdf4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:55.141945 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9a1a09ad-89b1-49df-b87a-fd714c73e307 req-3576d248-4349-4d7f-bc9b-0154e143fdf4 service nova] Creating event network-changed:6728d156-9e70-4308-aeaa-e54d42714d76 for instance af9a10de-f7c8-4e73-8803-471376cb000a on n-h2-833090-9 Jul 26 14:04:55.152578 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9a1a09ad-89b1-49df-b87a-fd714c73e307 req-3576d248-4349-4d7f-bc9b-0154e143fdf4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086995 Jul 26 14:04:55.154939 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 300/517] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:55.170429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-65ee4832-40e7-4d72-ab59-eec1a5cbc636 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:55.172763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-65ee4832-40e7-4d72-ab59-eec1a5cbc636 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:55.184513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65ee4832-40e7-4d72-ab59-eec1a5cbc636 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:55.185978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65ee4832-40e7-4d72-ab59-eec1a5cbc636 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:55.188861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65ee4832-40e7-4d72-ab59-eec1a5cbc636 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:55.191153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65ee4832-40e7-4d72-ab59-eec1a5cbc636 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:55.436496 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-48a38231-30cc-4ffa-b50c-d67eae8eb3c3 tempest-NetworksTest-255537173 tempest-NetworksTest-255537173-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks" status: 200 len: 4702 microversion: 2.1 time: 0.818216 Jul 26 14:04:55.441977 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 218/518] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:04:54 2022] GET /compute/v2.1/os-networks => generated 4702 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:55.447728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3fadc985-727e-4d67-8f26-c30864078517 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:55.448522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3fadc985-727e-4d67-8f26-c30864078517 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:55.451631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:55.467686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fadc985-727e-4d67-8f26-c30864078517 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:55.471642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fadc985-727e-4d67-8f26-c30864078517 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:55.481294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fadc985-727e-4d67-8f26-c30864078517 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:55.482602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fadc985-727e-4d67-8f26-c30864078517 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:55.730617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-65ee4832-40e7-4d72-ab59-eec1a5cbc636 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:55.740776 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-65ee4832-40e7-4d72-ab59-eec1a5cbc636 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1320 microversion: 2.1 time: 0.583922 Jul 26 14:04:55.758246 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 301/519] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:55 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1320 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:55.765611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9fce43a0-def8-47f2-9dc3-6179bf3ca0ba tempest-NetworksTest-255537173 tempest-NetworksTest-255537173-project-admin] Calling method '.version_select at 0x7f87948c9700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:55.984685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3fadc985-727e-4d67-8f26-c30864078517 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:55.996700 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3fadc985-727e-4d67-8f26-c30864078517 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1312 microversion: 2.1 time: 0.553153 Jul 26 14:04:56.003741 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9fce43a0-def8-47f2-9dc3-6179bf3ca0ba tempest-NetworksTest-255537173 tempest-NetworksTest-255537173-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks/dcd70a68-ffc7-49ed-b975-70685c5b60c9" status: 200 len: 652 microversion: 2.1 time: 0.243489 Jul 26 14:04:56.004577 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 302/521] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:04:55 2022] GET /compute/v2.1/os-networks/dcd70a68-ffc7-49ed-b975-70685c5b60c9 => generated 652 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:56.010978 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 219/521] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:55 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1312 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:56.015738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81de60aa-f6f3-4567-9983-28fc0cb1bf1e tempest-NetworksTest-255537173 tempest-NetworksTest-255537173-project-admin] Calling method '.version_select at 0x7f87945f9c10>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:56.022282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e593f6e8-16cc-4ff8-9cbf-171f0ba3c3bc tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:56.023396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e593f6e8-16cc-4ff8-9cbf-171f0ba3c3bc tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:56.040965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e593f6e8-16cc-4ff8-9cbf-171f0ba3c3bc tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:56.042232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e593f6e8-16cc-4ff8-9cbf-171f0ba3c3bc tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:56.045512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e593f6e8-16cc-4ff8-9cbf-171f0ba3c3bc tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:56.046243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e593f6e8-16cc-4ff8-9cbf-171f0ba3c3bc tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:56.302002 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-81de60aa-f6f3-4567-9983-28fc0cb1bf1e tempest-NetworksTest-255537173 tempest-NetworksTest-255537173-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks" status: 200 len: 4702 microversion: 2.1 time: 0.289755 Jul 26 14:04:56.302638 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 220/522] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:04:56 2022] GET /compute/v2.1/os-networks => generated 4702 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:56.360123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e593f6e8-16cc-4ff8-9cbf-171f0ba3c3bc tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:56.370625 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e593f6e8-16cc-4ff8-9cbf-171f0ba3c3bc tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1390 microversion: 2.1 time: 0.364528 Jul 26 14:04:56.371282 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 303/523] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:56 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1390 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:56.760064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=16 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:56.760893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=66 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:56.765522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-322fed5e-0e3d-4113-8a5c-d908be1855a5 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:56.766447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-322fed5e-0e3d-4113-8a5c-d908be1855a5 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:56.774346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-322fed5e-0e3d-4113-8a5c-d908be1855a5 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:56.775136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-322fed5e-0e3d-4113-8a5c-d908be1855a5 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:56.776504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-322fed5e-0e3d-4113-8a5c-d908be1855a5 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:56.777095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-322fed5e-0e3d-4113-8a5c-d908be1855a5 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:57.024178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c6f0d5e7-fa6f-4e3b-bb2f-9411bfe48776 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:57.025211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c6f0d5e7-fa6f-4e3b-bb2f-9411bfe48776 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:57.036141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6f0d5e7-fa6f-4e3b-bb2f-9411bfe48776 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:57.042600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6f0d5e7-fa6f-4e3b-bb2f-9411bfe48776 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:57.043760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6f0d5e7-fa6f-4e3b-bb2f-9411bfe48776 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:57.044708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6f0d5e7-fa6f-4e3b-bb2f-9411bfe48776 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:57.303192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-322fed5e-0e3d-4113-8a5c-d908be1855a5 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:57.332330 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-322fed5e-0e3d-4113-8a5c-d908be1855a5 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1320 microversion: 2.1 time: 0.567943 Jul 26 14:04:57.340771 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 221/524] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:56 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1320 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:57.397416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f72bda79-5997-4339-aa7a-d8b1b9bcf95d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:57.398672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f72bda79-5997-4339-aa7a-d8b1b9bcf95d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:57.418116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f72bda79-5997-4339-aa7a-d8b1b9bcf95d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:57.418546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f72bda79-5997-4339-aa7a-d8b1b9bcf95d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:57.420753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f72bda79-5997-4339-aa7a-d8b1b9bcf95d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:57.428141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f72bda79-5997-4339-aa7a-d8b1b9bcf95d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:57.813804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c6f0d5e7-fa6f-4e3b-bb2f-9411bfe48776 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:57.826359 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c6f0d5e7-fa6f-4e3b-bb2f-9411bfe48776 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1312 microversion: 2.1 time: 0.807367 Jul 26 14:04:57.826977 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 304/525] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:57 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1312 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:57.846994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6f1f2f48-01f6-4cfb-a3ca-d19c2fc5fc17 req-9872e1d8-de24-4a9e-9a89-1d81edfc1177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca8382cf-84cb-4c99-8a6a-aa871672d6df", "name": "network-vif-plugged", "status": "completed", "tag": "3f2e1c4a-8e86-4d0c-addd-f5ab96ba55cb"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:04:57.872403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6f1f2f48-01f6-4cfb-a3ca-d19c2fc5fc17 req-9872e1d8-de24-4a9e-9a89-1d81edfc1177 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:57.873339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6f1f2f48-01f6-4cfb-a3ca-d19c2fc5fc17 req-9872e1d8-de24-4a9e-9a89-1d81edfc1177 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:57.893260 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6f1f2f48-01f6-4cfb-a3ca-d19c2fc5fc17 req-9872e1d8-de24-4a9e-9a89-1d81edfc1177 service nova] Creating event network-vif-plugged:3f2e1c4a-8e86-4d0c-addd-f5ab96ba55cb for instance ca8382cf-84cb-4c99-8a6a-aa871672d6df on n-h2-833090-9 Jul 26 14:04:57.901681 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6f1f2f48-01f6-4cfb-a3ca-d19c2fc5fc17 req-9872e1d8-de24-4a9e-9a89-1d81edfc1177 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072982 Jul 26 14:04:57.903472 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 305/526] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:04:58.028484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f72bda79-5997-4339-aa7a-d8b1b9bcf95d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:58.043079 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f72bda79-5997-4339-aa7a-d8b1b9bcf95d tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1390 microversion: 2.1 time: 0.650293 Jul 26 14:04:58.045237 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 222/527] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:57 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1390 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:58.365654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5e031905-953b-4374-b851-6e0e58246fa4 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:58.367412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5e031905-953b-4374-b851-6e0e58246fa4 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:58.381208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e031905-953b-4374-b851-6e0e58246fa4 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:58.381878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e031905-953b-4374-b851-6e0e58246fa4 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:58.383562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e031905-953b-4374-b851-6e0e58246fa4 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:58.389938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e031905-953b-4374-b851-6e0e58246fa4 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:58.842909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5e031905-953b-4374-b851-6e0e58246fa4 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:58.855431 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5e031905-953b-4374-b851-6e0e58246fa4 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1320 microversion: 2.1 time: 0.493832 Jul 26 14:04:58.856044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 306/528] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:58 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:04:58.866362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3475a4d8-1b0e-4d90-bdba-e980fc93b0dd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:58.867796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3475a4d8-1b0e-4d90-bdba-e980fc93b0dd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:58.885768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3475a4d8-1b0e-4d90-bdba-e980fc93b0dd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:58.888168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3475a4d8-1b0e-4d90-bdba-e980fc93b0dd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:58.890991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3475a4d8-1b0e-4d90-bdba-e980fc93b0dd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:58.893033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3475a4d8-1b0e-4d90-bdba-e980fc93b0dd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:59.066181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70a7dc11-a141-4ef9-8d97-ad87d4fb1636 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:59.067155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70a7dc11-a141-4ef9-8d97-ad87d4fb1636 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:59.075145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a7dc11-a141-4ef9-8d97-ad87d4fb1636 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:59.085792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a7dc11-a141-4ef9-8d97-ad87d4fb1636 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:59.087219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a7dc11-a141-4ef9-8d97-ad87d4fb1636 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:59.088133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a7dc11-a141-4ef9-8d97-ad87d4fb1636 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:59.181677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3475a4d8-1b0e-4d90-bdba-e980fc93b0dd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:59.189363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:04:59.203792 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3475a4d8-1b0e-4d90-bdba-e980fc93b0dd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1312 microversion: 2.1 time: 0.344389 Jul 26 14:04:59.204494 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 223/529] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:58 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1312 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:59.374322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70a7dc11-a141-4ef9-8d97-ad87d4fb1636 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:04:59.428645 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70a7dc11-a141-4ef9-8d97-ad87d4fb1636 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1390 microversion: 2.1 time: 0.355440 Jul 26 14:04:59.437830 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 307/530] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:59 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1390 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:04:59.894249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7079ccf9-ae7e-4016-9481-0ce817a51dbb tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:04:59.895420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7079ccf9-ae7e-4016-9481-0ce817a51dbb tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:04:59.907330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7079ccf9-ae7e-4016-9481-0ce817a51dbb tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:59.907773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7079ccf9-ae7e-4016-9481-0ce817a51dbb tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:04:59.908596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7079ccf9-ae7e-4016-9481-0ce817a51dbb tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:04:59.913529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7079ccf9-ae7e-4016-9481-0ce817a51dbb tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:00.232324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3a0f0c82-019e-4b60-851e-2fcd9b7537e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:00.233139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3a0f0c82-019e-4b60-851e-2fcd9b7537e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:00.247877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a0f0c82-019e-4b60-851e-2fcd9b7537e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:00.251385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a0f0c82-019e-4b60-851e-2fcd9b7537e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:00.254065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a0f0c82-019e-4b60-851e-2fcd9b7537e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:00.256331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a0f0c82-019e-4b60-851e-2fcd9b7537e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:00.295785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7079ccf9-ae7e-4016-9481-0ce817a51dbb tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:00.309362 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7079ccf9-ae7e-4016-9481-0ce817a51dbb tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1320 microversion: 2.1 time: 0.419214 Jul 26 14:05:00.311163 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 224/531] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:04:59 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:00.453678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b9421f9d-aec8-41c0-9dd3-a072ddaed10f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:00.454587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b9421f9d-aec8-41c0-9dd3-a072ddaed10f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:00.487170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9421f9d-aec8-41c0-9dd3-a072ddaed10f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:00.492957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9421f9d-aec8-41c0-9dd3-a072ddaed10f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:00.495291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9421f9d-aec8-41c0-9dd3-a072ddaed10f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:00.497150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9421f9d-aec8-41c0-9dd3-a072ddaed10f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:00.890603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3a0f0c82-019e-4b60-851e-2fcd9b7537e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:00.914391 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3a0f0c82-019e-4b60-851e-2fcd9b7537e2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1312 microversion: 2.1 time: 0.686491 Jul 26 14:05:00.917412 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 308/532] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:00 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1312 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:01.167755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b9421f9d-aec8-41c0-9dd3-a072ddaed10f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:01.184862 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b9421f9d-aec8-41c0-9dd3-a072ddaed10f tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1390 microversion: 2.1 time: 0.735982 Jul 26 14:05:01.196788 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 225/533] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:00 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1390 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:05:01.339099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f54b1d94-94df-4dc9-9eea-e1f857112f5b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:01.339923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f54b1d94-94df-4dc9-9eea-e1f857112f5b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:01.367796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f54b1d94-94df-4dc9-9eea-e1f857112f5b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:01.370684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f54b1d94-94df-4dc9-9eea-e1f857112f5b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:01.378740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f54b1d94-94df-4dc9-9eea-e1f857112f5b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:01.379370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f54b1d94-94df-4dc9-9eea-e1f857112f5b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:01.587726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f54b1d94-94df-4dc9-9eea-e1f857112f5b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:01.614780 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f54b1d94-94df-4dc9-9eea-e1f857112f5b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1470 microversion: 2.1 time: 0.272964 Jul 26 14:05:01.619389 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 309/534] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:01 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:01.643359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-abf51c9a-9bd9-463d-a4ca-f95e8785da09 tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:01.647650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-abf51c9a-9bd9-463d-a4ca-f95e8785da09 tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:01.660259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abf51c9a-9bd9-463d-a4ca-f95e8785da09 tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:01.665110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abf51c9a-9bd9-463d-a4ca-f95e8785da09 tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:01.666332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abf51c9a-9bd9-463d-a4ca-f95e8785da09 tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:01.666990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abf51c9a-9bd9-463d-a4ca-f95e8785da09 tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:01.818827 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-abf51c9a-9bd9-463d-a4ca-f95e8785da09 tempest-DeleteServersAdminTestJSON-1548255869 tempest-DeleteServersAdminTestJSON-1548255869-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df/action" status: 202 len: 0 microversion: 2.1 time: 0.180167 Jul 26 14:05:01.820732 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 226/535] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:05:01 2022] POST /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:05:01.830263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:01.831179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:01.841073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:01.842090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:01.843250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:01.844140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:01.912072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:01.913017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:01.914603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lazy-loading 'fault' on Instance uuid ca8382cf-84cb-4c99-8a6a-aa871672d6df {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:05:01.918850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:01.941297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a2152d92-d072-46f7-a31e-27808271f53c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:01.942886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a2152d92-d072-46f7-a31e-27808271f53c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:01.970028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2152d92-d072-46f7-a31e-27808271f53c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:01.971571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2152d92-d072-46f7-a31e-27808271f53c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:01.973661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2152d92-d072-46f7-a31e-27808271f53c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:01.975460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2152d92-d072-46f7-a31e-27808271f53c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:02.123586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:02.135251 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a1faae66-b5be-4ad0-81a9-7407d5f9f225 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1453 microversion: 2.1 time: 0.309690 Jul 26 14:05:02.137662 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 310/536] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:01 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1453 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:05:02.162207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9703a4f2-ff1c-4fb6-a3df-61c641bebc00 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:02.162721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9703a4f2-ff1c-4fb6-a3df-61c641bebc00 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:02.170641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9703a4f2-ff1c-4fb6-a3df-61c641bebc00 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:02.171823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9703a4f2-ff1c-4fb6-a3df-61c641bebc00 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:02.172852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9703a4f2-ff1c-4fb6-a3df-61c641bebc00 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:02.173521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9703a4f2-ff1c-4fb6-a3df-61c641bebc00 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:02.204747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9703a4f2-ff1c-4fb6-a3df-61c641bebc00 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:05:02.317367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a2152d92-d072-46f7-a31e-27808271f53c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:02.325839 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a2152d92-d072-46f7-a31e-27808271f53c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1312 microversion: 2.1 time: 0.389346 Jul 26 14:05:02.326425 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 227/537] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:01 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1312 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:05:02.333265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b9cff147-9858-42b2-990c-790907c495c6 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:02.333577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b9cff147-9858-42b2-990c-790907c495c6 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:02.356275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9cff147-9858-42b2-990c-790907c495c6 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:02.357950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9cff147-9858-42b2-990c-790907c495c6 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:02.358950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9cff147-9858-42b2-990c-790907c495c6 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:02.361515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9cff147-9858-42b2-990c-790907c495c6 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:02.377328 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9703a4f2-ff1c-4fb6-a3df-61c641bebc00 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 204 len: 0 microversion: 2.1 time: 0.219322 Jul 26 14:05:02.382051 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 311/538] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:05:02 2022] DELETE /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:05:02.609296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b9cff147-9858-42b2-990c-790907c495c6 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:02.626834 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b9cff147-9858-42b2-990c-790907c495c6 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1390 microversion: 2.1 time: 0.299505 Jul 26 14:05:02.634580 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 228/539] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:02 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1390 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:02.645038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c36de491-0366-4178-a748-c9cc995d073a req-a27e7f00-6262-4b5a-a276-d081a262141c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9611ccf6-16ec-4945-aecf-3cfcb058ec91", "name": "network-vif-plugged", "status": "completed", "tag": "803157f9-374f-4edf-b468-6e317b5c706e"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:02.677898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c36de491-0366-4178-a748-c9cc995d073a req-a27e7f00-6262-4b5a-a276-d081a262141c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:02.678713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c36de491-0366-4178-a748-c9cc995d073a req-a27e7f00-6262-4b5a-a276-d081a262141c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:02.708952 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c36de491-0366-4178-a748-c9cc995d073a req-a27e7f00-6262-4b5a-a276-d081a262141c service nova] Creating event network-vif-plugged:803157f9-374f-4edf-b468-6e317b5c706e for instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 on n-h1-833090-9 Jul 26 14:05:02.718173 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c36de491-0366-4178-a748-c9cc995d073a req-a27e7f00-6262-4b5a-a276-d081a262141c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081971 Jul 26 14:05:02.718388 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 229/540] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:02.741084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:02.742392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:02.762342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:02.762803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:02.763591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:02.766737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:02.860742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:02.861669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:02.862162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lazy-loading 'fault' on Instance uuid ca8382cf-84cb-4c99-8a6a-aa871672d6df {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:05:02.983232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ff78ac09-2dd5-4cfd-aca9-88dbff8cd6a5 tempest-FlavorsV2NegativeTest-670275908 tempest-FlavorsV2NegativeTest-670275908-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:03.018552 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ff78ac09-2dd5-4cfd-aca9-88dbff8cd6a5 tempest-FlavorsV2NegativeTest-670275908 tempest-FlavorsV2NegativeTest-670275908-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.631050 Jul 26 14:05:03.033593 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 312/541] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:03.219874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2005370165", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:03.377128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:05:03.909716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:03.920753 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c920674-0b6b-4864-b543-39ff0878c38c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1459 microversion: 2.1 time: 1.195334 Jul 26 14:05:03.924276 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 230/542] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:02 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1459 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:03.940394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1aa2d106-c063-44eb-b81c-819b8573ea7f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:03.942321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1aa2d106-c063-44eb-b81c-819b8573ea7f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:03.958544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1aa2d106-c063-44eb-b81c-819b8573ea7f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:03.959362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1aa2d106-c063-44eb-b81c-819b8573ea7f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:03.961025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1aa2d106-c063-44eb-b81c-819b8573ea7f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:03.963024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1aa2d106-c063-44eb-b81c-819b8573ea7f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:04.106844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:05:04.108109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:05:04.108865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:05:04.109500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:05:04.110134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:05:04.142111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:04.143542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:04.144696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:04.145631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:04.192434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Getting quotas for project 8e90b10ccea94aa292a1c993c6d4424c. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:05:04.203421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Getting quotas for user 7de821a9c74948e5a98e667c24606af9 and project 8e90b10ccea94aa292a1c993c6d4424c. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:05:04.246707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1aa2d106-c063-44eb-b81c-819b8573ea7f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:04.259016 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1aa2d106-c063-44eb-b81c-819b8573ea7f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1312 microversion: 2.1 time: 0.332659 Jul 26 14:05:04.260505 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 231/543] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:03 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1312 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:04.268567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:05:04.278590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-73283a1c-4251-424e-b372-6283180ff24b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:04.279757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-73283a1c-4251-424e-b372-6283180ff24b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:04.284187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:05:04.294394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73283a1c-4251-424e-b372-6283180ff24b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:04.294995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73283a1c-4251-424e-b372-6283180ff24b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:04.296087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73283a1c-4251-424e-b372-6283180ff24b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:04.296929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73283a1c-4251-424e-b372-6283180ff24b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:04.395697 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-22754c89-7545-4256-bac2-a502fca74ed4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.355509 Jul 26 14:05:04.420041 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 313/544] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:05:04.605861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-73283a1c-4251-424e-b372-6283180ff24b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:04.626098 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-73283a1c-4251-424e-b372-6283180ff24b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1390 microversion: 2.1 time: 0.362598 Jul 26 14:05:04.627677 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 232/545] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:04 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1390 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:04.636065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7df4c736-01c5-4bb1-bc87-ed866eda9380 tempest-FlavorsV2NegativeTest-670275908 tempest-FlavorsV2NegativeTest-670275908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-30525037", "imageRef": "e78f8791-c45a-4e0d-9989-bd09342b8157", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:04.773278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-7df4c736-01c5-4bb1-bc87-ed866eda9380 tempest-FlavorsV2NegativeTest-670275908 tempest-FlavorsV2NegativeTest-670275908-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:05:04.958072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cfd1241e-6871-44bb-a9a0-481b5e805423 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:04.976995 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cfd1241e-6871-44bb-a9a0-481b5e805423 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.541324 Jul 26 14:05:04.979544 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 314/546] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:04.984554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1050883986", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:05.083469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:05:05.290982 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-7df4c736-01c5-4bb1-bc87-ed866eda9380 tempest-FlavorsV2NegativeTest-670275908 tempest-FlavorsV2NegativeTest-670275908-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7df4c736-01c5-4bb1-bc87-ed866eda9380 tempest-FlavorsV2NegativeTest-670275908 tempest-FlavorsV2NegativeTest-670275908-project] Request method failure captured: Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 141 Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_SOq6x0idXDER-EOP_RUYqLT_jObSje6ZhIn2HhQrRnsspa7G8eA2VA1c-bmHRSvj4YlZCeGRO3HKx9zOSm8eHofLW4pymLjYEF2v47hE0Kmq3GMDZ3BFXqZ7ZJCxQPtav7iHPX1uN7HwvY4YsyuwuCPbV5JaiEhXzaf0najnQOapA Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 280e803d30cc4da8835d502efbefe7b4 Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FlavorsV2NegativeTest-670275908 Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:05.292854 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/280e803d30cc4da8835d502efbefe7b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/280e803d30cc4da8835d502efbefe7b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_280e803d30cc4da8835d502efbefe7b4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/280e803d30cc4da8835d502efbefe7b4"}]}] Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FlavorsV2NegativeTest-670275908 Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 280e803d30cc4da8835d502efbefe7b4 Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-670275908 Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FlavorsV2NegativeTest-670275908-project Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 174a20914ce644e7875c2063fcc57692 Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FlavorsV2NegativeTest-670275908-project Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-30525037", "imageRef": "e78f8791-c45a-4e0d-9989-bd09342b8157", "flavorRef": "452"}} Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:05.294228 n-d-833090-9 devstack@n-api.service[119478]: exception: Flavor's memory is too small for requested image. Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-30525037', 'imageRef': 'e78f8791-c45a-4e0d-9989-bd09342b8157', 'flavorRef': '452'}}} Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:05.295038 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:05.296245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:05.297415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:05.297415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:05.297415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:05.297415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:05.297415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 26 14:05:05.297415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:05.297415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7df4c736-01c5-4bb1-bc87-ed866eda9380 tempest-FlavorsV2NegativeTest-670275908 tempest-FlavorsV2NegativeTest-670275908-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:05.297415 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7df4c736-01c5-4bb1-bc87-ed866eda9380 tempest-FlavorsV2NegativeTest-670275908 tempest-FlavorsV2NegativeTest-670275908-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.664737 Jul 26 14:05:05.297415 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 233/547] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:05:04 2022] POST /compute/v2.1/servers => generated 93 bytes in 666 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:05:05.303855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-6d0f5af6-e577-424d-b350-cccaa69f1c6d req-d98cd7a5-5a47-40f7-a4f2-61ec2a04bca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9a10de-f7c8-4e73-8803-471376cb000a", "name": "network-vif-plugged", "status": "completed", "tag": "6728d156-9e70-4308-aeaa-e54d42714d76"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:05.322533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6d0f5af6-e577-424d-b350-cccaa69f1c6d req-d98cd7a5-5a47-40f7-a4f2-61ec2a04bca5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:05.322988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6d0f5af6-e577-424d-b350-cccaa69f1c6d req-d98cd7a5-5a47-40f7-a4f2-61ec2a04bca5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:05.352957 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-6d0f5af6-e577-424d-b350-cccaa69f1c6d req-d98cd7a5-5a47-40f7-a4f2-61ec2a04bca5 service nova] Creating event network-vif-plugged:6728d156-9e70-4308-aeaa-e54d42714d76 for instance af9a10de-f7c8-4e73-8803-471376cb000a on n-h2-833090-9 Jul 26 14:05:05.364151 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-6d0f5af6-e577-424d-b350-cccaa69f1c6d req-d98cd7a5-5a47-40f7-a4f2-61ec2a04bca5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067571 Jul 26 14:05:05.367842 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 234/548] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:05.383697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:05.394475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:05.433639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:05.434208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:05.435071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:05.440692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:05.533956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:05.536099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:05.537149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lazy-loading 'fault' on Instance uuid ca8382cf-84cb-4c99-8a6a-aa871672d6df {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:05:05.656565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:05:05.657119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:05:05.657444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:05:05.658068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:05:05.658756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:05:05.674445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:05.677341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:05.678330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:05.678945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:05.726809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Getting quotas for project 8e90b10ccea94aa292a1c993c6d4424c. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:05:05.738085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Getting quotas for user 7de821a9c74948e5a98e667c24606af9 and project 8e90b10ccea94aa292a1c993c6d4424c. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:05:05.776930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:05:05.779215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:05:05.897660 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9381addc-a932-4469-b59d-723459ee7f2f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916885 Jul 26 14:05:05.902730 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 315/549] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:05:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:05:05.911252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3a145c0b-aae1-43d6-84d1-bea82ddc4483 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:05.986741 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3a145c0b-aae1-43d6-84d1-bea82ddc4483 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 3081 microversion: 2.1 time: 0.072085 Jul 26 14:05:05.998453 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 316/550] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:05:05 2022] GET /compute/v2.1/flavors => generated 3081 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:06.003614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cecb8fbd-eec2-490d-a056-89757ad8c975 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:06.009472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cecb8fbd-eec2-490d-a056-89757ad8c975 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:06.023723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cecb8fbd-eec2-490d-a056-89757ad8c975 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:06.027792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cecb8fbd-eec2-490d-a056-89757ad8c975 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:06.029551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cecb8fbd-eec2-490d-a056-89757ad8c975 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:06.032144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cecb8fbd-eec2-490d-a056-89757ad8c975 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:06.071373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:06.080950 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6b7e6843-4c04-4735-9417-bb3b559a1470 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1459 microversion: 2.1 time: 0.711673 Jul 26 14:05:06.088687 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 235/551] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:05 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1459 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:06.098002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7b3d9e95-f2bc-4a9a-99af-181de60d8188 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:06.108302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7b3d9e95-f2bc-4a9a-99af-181de60d8188 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:06.136924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b3d9e95-f2bc-4a9a-99af-181de60d8188 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:06.139919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b3d9e95-f2bc-4a9a-99af-181de60d8188 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:06.140823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b3d9e95-f2bc-4a9a-99af-181de60d8188 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:06.141267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b3d9e95-f2bc-4a9a-99af-181de60d8188 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:06.760952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cecb8fbd-eec2-490d-a056-89757ad8c975 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:06.770324 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cecb8fbd-eec2-490d-a056-89757ad8c975 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1312 microversion: 2.1 time: 0.770444 Jul 26 14:05:06.789980 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 317/552] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:05 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1312 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:06.803301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-42436221-d801-4c5e-89b1-f0912d3f22cc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:06.806663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-42436221-d801-4c5e-89b1-f0912d3f22cc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:06.833893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7b3d9e95-f2bc-4a9a-99af-181de60d8188 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:06.856438 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7b3d9e95-f2bc-4a9a-99af-181de60d8188 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1589 microversion: 2.1 time: 0.765162 Jul 26 14:05:06.864377 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 236/553] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:06 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1589 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:06.892993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a7cf7606-4a6b-4ee2-9be7-f154e822390b tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:06.932227 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a7cf7606-4a6b-4ee2-9be7-f154e822390b tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.066114 Jul 26 14:05:06.938497 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 237/554] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:06.944855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7992db18-e276-4af7-9818-226b876a960b req-0e00e0fd-e335-47c3-99f2-ab726aab437f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca8382cf-84cb-4c99-8a6a-aa871672d6df", "name": "network-vif-deleted", "tag": "3f2e1c4a-8e86-4d0c-addd-f5ab96ba55cb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:06.984920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7992db18-e276-4af7-9818-226b876a960b req-0e00e0fd-e335-47c3-99f2-ab726aab437f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:06.986647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7992db18-e276-4af7-9818-226b876a960b req-0e00e0fd-e335-47c3-99f2-ab726aab437f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:07.054925 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7992db18-e276-4af7-9818-226b876a960b req-0e00e0fd-e335-47c3-99f2-ab726aab437f service nova] Creating event network-vif-deleted:3f2e1c4a-8e86-4d0c-addd-f5ab96ba55cb for instance ca8382cf-84cb-4c99-8a6a-aa871672d6df on n-h2-833090-9 Jul 26 14:05:07.069774 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7992db18-e276-4af7-9818-226b876a960b req-0e00e0fd-e335-47c3-99f2-ab726aab437f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129571 Jul 26 14:05:07.072022 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 238/555] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:07.096957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-01d8c7be-8669-4e06-bbb8-ce850334c541 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:07.101666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-01d8c7be-8669-4e06-bbb8-ce850334c541 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:07.128603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01d8c7be-8669-4e06-bbb8-ce850334c541 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:07.129065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01d8c7be-8669-4e06-bbb8-ce850334c541 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:07.133647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01d8c7be-8669-4e06-bbb8-ce850334c541 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:07.134389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01d8c7be-8669-4e06-bbb8-ce850334c541 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:07.369502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-42436221-d801-4c5e-89b1-f0912d3f22cc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:07.384262 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-42436221-d801-4c5e-89b1-f0912d3f22cc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1214 microversion: 2.1 time: 0.591672 Jul 26 14:05:07.385485 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 318/556] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:06 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1214 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:07.395374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9fadc520-ddf4-4163-a4a0-a81827236db8 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:07.417234 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9fadc520-ddf4-4163-a4a0-a81827236db8 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030406 Jul 26 14:05:07.417902 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 319/557] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:07.422933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:07.432252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:07.450646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:07.451456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:07.452769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:07.453436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:07.525873 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-01d8c7be-8669-4e06-bbb8-ce850334c541 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.452389 Jul 26 14:05:07.527054 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 239/558] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:05:07 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91/os-interface => generated 285 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:07.532896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0f5ff679-e477-46f0-9cbd-08c2f00a57ed tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:07.546181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:07.550652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:07.551721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lazy-loading 'fault' on Instance uuid ca8382cf-84cb-4c99-8a6a-aa871672d6df {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:05:07.629204 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0f5ff679-e477-46f0-9cbd-08c2f00a57ed tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.099574 Jul 26 14:05:07.633313 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 240/559] 10.222.0.70 () {58 vars in 1165 bytes} [Tue Jul 26 14:05:07 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:07.652657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ac3fa902-c5f4-4f55-8c24-2362097d1501 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:07.673685 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ac3fa902-c5f4-4f55-8c24-2362097d1501 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025675 Jul 26 14:05:07.675795 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 241/560] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:05:07.694044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-974a9c64-bbe4-4000-b21c-3343bf709d44 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:07.731191 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-974a9c64-bbe4-4000-b21c-3343bf709d44 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.046154 Jul 26 14:05:07.732478 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 242/561] 10.222.0.70 () {58 vars in 1169 bytes} [Tue Jul 26 14:05:07 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:07.752521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fd3638503c149d0a41f9ab0a4d57423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98f74644a4e4143a94639544a446934', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:07.756248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-33a6a234-9189-4d2f-91b3-8cee4e1012fb tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:07.768150 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e5ad4228-4991-4388-b7e3-de3d14b6ab1b tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 200 len: 1310 microversion: 2.1 time: 0.348819 Jul 26 14:05:07.769458 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 320/562] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:07 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 1310 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:07.797813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d836e50-0893-4343-a802-f79e808d3d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:07.798862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d836e50-0893-4343-a802-f79e808d3d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:07.808296 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-33a6a234-9189-4d2f-91b3-8cee4e1012fb tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.059237 Jul 26 14:05:07.810558 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 243/563] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:05:07 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:05:07.821067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d836e50-0893-4343-a802-f79e808d3d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:07.824816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d836e50-0893-4343-a802-f79e808d3d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:07.825806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-48c68bb4-8bc1-4d88-86f3-f29db65505da tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:07.828929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d836e50-0893-4343-a802-f79e808d3d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:07.830005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d836e50-0893-4343-a802-f79e808d3d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:07.852675 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-48c68bb4-8bc1-4d88-86f3-f29db65505da tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031640 Jul 26 14:05:07.872183 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 244/564] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:07.880587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3eb60a8-8f87-4ac3-a5cd-2973d6550484 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.015118 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f3eb60a8-8f87-4ac3-a5cd-2973d6550484 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.144712 Jul 26 14:05:08.020050 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 245/565] 10.222.0.70 () {58 vars in 1167 bytes} [Tue Jul 26 14:05:07 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:08.035999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f379dc82-7916-42bd-a1be-330125e875a0 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.052693 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f379dc82-7916-42bd-a1be-330125e875a0 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021418 Jul 26 14:05:08.056838 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 246/566] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:08.079507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-daed35f4-8b73-40dc-b723-a65a8be22190 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.115311 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-daed35f4-8b73-40dc-b723-a65a8be22190 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.049650 Jul 26 14:05:08.118316 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 247/567] 10.222.0.70 () {58 vars in 1144 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:08.132379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-74fed8b2-ebaf-4c01-9d0c-21feb26c0e29 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.155751 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-74fed8b2-ebaf-4c01-9d0c-21feb26c0e29 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025256 Jul 26 14:05:08.157661 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 248/568] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:08.175606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e731d136-63c7-43ff-a054-5f7b48bf485b tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.221275 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e731d136-63c7-43ff-a054-5f7b48bf485b tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.049131 Jul 26 14:05:08.222302 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 249/569] 10.222.0.70 () {58 vars in 1148 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:08.236810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-75eed7fa-37c0-42d4-a882-a68d19de5d01 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.259615 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-75eed7fa-37c0-42d4-a882-a68d19de5d01 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026752 Jul 26 14:05:08.268492 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 250/570] 10.222.0.70 () {58 vars in 1140 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:05:08.286379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7042508-f253-4d97-a968-f9f8d7858006 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.300752 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7042508-f253-4d97-a968-f9f8d7858006 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030736 Jul 26 14:05:08.301392 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 251/571] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:08.317171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-993ce8d1-8318-4481-8d01-df4fe8c955db tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.336637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d836e50-0893-4343-a802-f79e808d3d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:08.357894 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d836e50-0893-4343-a802-f79e808d3d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1461 microversion: 2.1 time: 0.561945 Jul 26 14:05:08.359830 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 321/572] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:07 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1461 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:08.387139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:08.391469 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-993ce8d1-8318-4481-8d01-df4fe8c955db tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.075434 Jul 26 14:05:08.400583 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 252/573] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:08.408901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1cd46442-46b5-4c06-bd04-a334e1e41810 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.420736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:08.443001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:08.443673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:08.445795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:08.447146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:08.454820 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1cd46442-46b5-4c06-bd04-a334e1e41810 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.051572 Jul 26 14:05:08.468093 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 253/574] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:08.469064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f2e4abf5-64f9-40f7-89b4-f93bde6c0285 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.469752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f2e4abf5-64f9-40f7-89b4-f93bde6c0285 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:08.485972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2e4abf5-64f9-40f7-89b4-f93bde6c0285 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:08.486508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2e4abf5-64f9-40f7-89b4-f93bde6c0285 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:08.487440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2e4abf5-64f9-40f7-89b4-f93bde6c0285 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:08.487887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2e4abf5-64f9-40f7-89b4-f93bde6c0285 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:08.668997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f2e4abf5-64f9-40f7-89b4-f93bde6c0285 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:08.679871 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f2e4abf5-64f9-40f7-89b4-f93bde6c0285 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1266 microversion: 2.1 time: 0.223106 Jul 26 14:05:08.729324 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 254/575] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:08.733488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-50e6941b-7514-4ddd-a42e-8c8f41c36920 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.763595 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-50e6941b-7514-4ddd-a42e-8c8f41c36920 tempest-FlavorsV2TestJSON-408748136 tempest-FlavorsV2TestJSON-408748136-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045733 Jul 26 14:05:08.764547 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 255/576] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:08.798292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-370b0a4f-7f29-4d34-94ca-9c07bead04f3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.799842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-370b0a4f-7f29-4d34-94ca-9c07bead04f3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:08.818212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-370b0a4f-7f29-4d34-94ca-9c07bead04f3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:08.823116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-370b0a4f-7f29-4d34-94ca-9c07bead04f3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:08.825716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-370b0a4f-7f29-4d34-94ca-9c07bead04f3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:08.827866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-370b0a4f-7f29-4d34-94ca-9c07bead04f3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:08.837562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:08.847507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Old instance type m1.heat2, new instance type m1.heat {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 14:05:08.868533 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-370b0a4f-7f29-4d34-94ca-9c07bead04f3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] HTTP exception thrown: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:08.872890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:05:08.873321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:05:08.873848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:05:08.874268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:05:08.874685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-370b0a4f-7f29-4d34-94ca-9c07bead04f3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Request method failure captured: Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df HTTP/1.1 Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RZ_MwA4rEpMpxVEe9RuEh9CHmYQo3ZXBHDbaE_jS8pIfPVkW_OAppeYt0mNS7jDgKqJ2jlBWaZ9rSV9jjHcmMvCZhV1dOnOWWcbfiPwKbDtJj30TakX5vRYWim63moFVcSTqmHNvJ_YRyYjXSyXKo2mTCcmqyBdl9kSClmA2BWR0M Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:08.880099 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b98f74644a4e4143a94639544a446934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b98f74644a4e4143a94639544a446934", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}] Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4fd3638503c149d0a41f9ab0a4d57423 Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:08.881802 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'ca8382cf-84cb-4c99-8a6a-aa871672d6df'} Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:08.883233 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:08.884694 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:08.885739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-370b0a4f-7f29-4d34-94ca-9c07bead04f3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Returning 404 to user: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:08.885739 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-370b0a4f-7f29-4d34-94ca-9c07bead04f3 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 404 len: 111 microversion: 2.1 time: 0.090388 Jul 26 14:05:08.888440 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 256/577] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:08.901780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:08.908237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-100cb7fa-b100-465c-8be6-45edf6840d58 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.909494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-100cb7fa-b100-465c-8be6-45edf6840d58 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:08.925110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-100cb7fa-b100-465c-8be6-45edf6840d58 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:08.925701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-100cb7fa-b100-465c-8be6-45edf6840d58 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:08.926862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-100cb7fa-b100-465c-8be6-45edf6840d58 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:08.927385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-100cb7fa-b100-465c-8be6-45edf6840d58 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:08.953124 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-100cb7fa-b100-465c-8be6-45edf6840d58 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] HTTP exception thrown: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-100cb7fa-b100-465c-8be6-45edf6840d58 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Request method failure captured: Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df HTTP/1.1 Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RZ_MwA4rEpMpxVEe9RuEh9CHmYQo3ZXBHDbaE_jS8pIfPVkW_OAppeYt0mNS7jDgKqJ2jlBWaZ9rSV9jjHcmMvCZhV1dOnOWWcbfiPwKbDtJj30TakX5vRYWim63moFVcSTqmHNvJ_YRyYjXSyXKo2mTCcmqyBdl9kSClmA2BWR0M Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:08.955068 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b98f74644a4e4143a94639544a446934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b98f74644a4e4143a94639544a446934", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}] Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4fd3638503c149d0a41f9ab0a4d57423 Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:08.956635 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'ca8382cf-84cb-4c99-8a6a-aa871672d6df'} Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:08.957414 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:08.958908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:08.973224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-100cb7fa-b100-465c-8be6-45edf6840d58 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Returning 404 to user: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:08.978128 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-100cb7fa-b100-465c-8be6-45edf6840d58 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 404 len: 111 microversion: 2.1 time: 0.081357 Jul 26 14:05:08.979454 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 257/578] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:05:08 2022] DELETE /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:08.989170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7e0556c9-0a0d-4b72-af37-420380325a5e tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:08.990698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7e0556c9-0a0d-4b72-af37-420380325a5e tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: ca8382cf-84cb-4c99-8a6a-aa871672d6df] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:09.002529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e0556c9-0a0d-4b72-af37-420380325a5e tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:09.003209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e0556c9-0a0d-4b72-af37-420380325a5e tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:09.004193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e0556c9-0a0d-4b72-af37-420380325a5e tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:09.004953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e0556c9-0a0d-4b72-af37-420380325a5e tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:09.026321 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-7e0556c9-0a0d-4b72-af37-420380325a5e tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] HTTP exception thrown: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7e0556c9-0a0d-4b72-af37-420380325a5e tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Request method failure captured: Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df HTTP/1.1 Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RZ_MwA4rEpMpxVEe9RuEh9CHmYQo3ZXBHDbaE_jS8pIfPVkW_OAppeYt0mNS7jDgKqJ2jlBWaZ9rSV9jjHcmMvCZhV1dOnOWWcbfiPwKbDtJj30TakX5vRYWim63moFVcSTqmHNvJ_YRyYjXSyXKo2mTCcmqyBdl9kSClmA2BWR0M Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:09.028492 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b98f74644a4e4143a94639544a446934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b98f74644a4e4143a94639544a446934", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}] Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4fd3638503c149d0a41f9ab0a4d57423 Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:09.030391 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'ca8382cf-84cb-4c99-8a6a-aa871672d6df'} Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:09.031921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. Jul 26 14:05:09.034597 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.035690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7e0556c9-0a0d-4b72-af37-420380325a5e tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Returning 404 to user: Instance ca8382cf-84cb-4c99-8a6a-aa871672d6df could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:09.036762 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7e0556c9-0a0d-4b72-af37-420380325a5e tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df" status: 404 len: 111 microversion: 2.1 time: 0.049510 Jul 26 14:05:09.037603 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 258/579] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:08 2022] GET /compute/v2.1/servers/ca8382cf-84cb-4c99-8a6a-aa871672d6df => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:09.048072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5cc55fd4-f483-424f-adf3-5688809b3ee7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:09.052774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5cc55fd4-f483-424f-adf3-5688809b3ee7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:09.066550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5cc55fd4-f483-424f-adf3-5688809b3ee7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:09.072511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5cc55fd4-f483-424f-adf3-5688809b3ee7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:09.073622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5cc55fd4-f483-424f-adf3-5688809b3ee7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:09.074356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5cc55fd4-f483-424f-adf3-5688809b3ee7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:09.098813 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-5cc55fd4-f483-424f-adf3-5688809b3ee7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] HTTP exception thrown: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5cc55fd4-f483-424f-adf3-5688809b3ee7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Request method failure captured: Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 HTTP/1.1 Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RZ_MwA4rEpMpxVEe9RuEh9CHmYQo3ZXBHDbaE_jS8pIfPVkW_OAppeYt0mNS7jDgKqJ2jlBWaZ9rSV9jjHcmMvCZhV1dOnOWWcbfiPwKbDtJj30TakX5vRYWim63moFVcSTqmHNvJ_YRyYjXSyXKo2mTCcmqyBdl9kSClmA2BWR0M Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:09.100787 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b98f74644a4e4143a94639544a446934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b98f74644a4e4143a94639544a446934", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}] Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4fd3638503c149d0a41f9ab0a4d57423 Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:05:09.102927 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '981f15eb-5be0-4e4d-a32d-b0c2767da842'} Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:09.103767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:05:09.105192 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.106755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5cc55fd4-f483-424f-adf3-5688809b3ee7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Returning 404 to user: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:09.107774 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5cc55fd4-f483-424f-adf3-5688809b3ee7 tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "DELETE /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 404 len: 111 microversion: 2.1 time: 0.063973 Jul 26 14:05:09.108879 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 259/580] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:05:09 2022] DELETE /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:05:09.133615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93eee506-ade1-4949-94d9-ed4e56d2475c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:09.136367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-93eee506-ade1-4949-94d9-ed4e56d2475c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] [instance: 981f15eb-5be0-4e4d-a32d-b0c2767da842] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:09.144955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93eee506-ade1-4949-94d9-ed4e56d2475c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:09.146122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93eee506-ade1-4949-94d9-ed4e56d2475c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:09.147423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93eee506-ade1-4949-94d9-ed4e56d2475c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:09.150688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93eee506-ade1-4949-94d9-ed4e56d2475c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:09.170270 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-93eee506-ade1-4949-94d9-ed4e56d2475c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] HTTP exception thrown: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93eee506-ade1-4949-94d9-ed4e56d2475c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Request method failure captured: Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 HTTP/1.1 Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_RZ_MwA4rEpMpxVEe9RuEh9CHmYQo3ZXBHDbaE_jS8pIfPVkW_OAppeYt0mNS7jDgKqJ2jlBWaZ9rSV9jjHcmMvCZhV1dOnOWWcbfiPwKbDtJj30TakX5vRYWim63moFVcSTqmHNvJ_YRyYjXSyXKo2mTCcmqyBdl9kSClmA2BWR0M Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:09.172211 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b98f74644a4e4143a94639544a446934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b98f74644a4e4143a94639544a446934", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b98f74644a4e4143a94639544a446934"}]}] Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: b98f74644a4e4143a94639544a446934 Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460926169 Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4fd3638503c149d0a41f9ab0a4d57423 Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460926169-project Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:05:09.173513 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '981f15eb-5be0-4e4d-a32d-b0c2767da842'} Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:09.174322 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. Jul 26 14:05:09.183342 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:09.188551 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ff363fba-a383-4f83-b0e9-edee6b7d5273 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a/action" status: 202 len: 0 microversion: 2.1 time: 0.796955 Jul 26 14:05:09.189847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93eee506-ade1-4949-94d9-ed4e56d2475c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] Returning 404 to user: Instance 981f15eb-5be0-4e4d-a32d-b0c2767da842 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:09.190090 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 322/581] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:05:08 2022] POST /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:05:09.190355 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-93eee506-ade1-4949-94d9-ed4e56d2475c tempest-DeleteServersAdminTestJSON-1460926169 tempest-DeleteServersAdminTestJSON-1460926169-project] 10.222.0.70 "GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842" status: 404 len: 111 microversion: 2.1 time: 0.058322 Jul 26 14:05:09.190355 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 260/582] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:09 2022] GET /compute/v2.1/servers/981f15eb-5be0-4e4d-a32d-b0c2767da842 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:09.196605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca0cb473-18dc-497a-91f5-8778f40a51a8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:09.197228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ca0cb473-18dc-497a-91f5-8778f40a51a8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:09.207686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca0cb473-18dc-497a-91f5-8778f40a51a8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:09.208195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca0cb473-18dc-497a-91f5-8778f40a51a8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:09.209145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca0cb473-18dc-497a-91f5-8778f40a51a8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:09.211921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca0cb473-18dc-497a-91f5-8778f40a51a8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:09.738392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c5b874e-1ebf-4b93-bc7f-44f42d72cead tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:09.739015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c5b874e-1ebf-4b93-bc7f-44f42d72cead tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:09.747429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c5b874e-1ebf-4b93-bc7f-44f42d72cead tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:09.747883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c5b874e-1ebf-4b93-bc7f-44f42d72cead tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:09.748692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c5b874e-1ebf-4b93-bc7f-44f42d72cead tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:09.749131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c5b874e-1ebf-4b93-bc7f-44f42d72cead tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:09.752084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:09.998136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c5b874e-1ebf-4b93-bc7f-44f42d72cead tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:10.027497 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c5b874e-1ebf-4b93-bc7f-44f42d72cead tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1272 microversion: 2.1 time: 0.293969 Jul 26 14:05:10.032744 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 261/583] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:09 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:05:10.438356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ca0cb473-18dc-497a-91f5-8778f40a51a8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:10.458137 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca0cb473-18dc-497a-91f5-8778f40a51a8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1470 microversion: 2.1 time: 1.268199 Jul 26 14:05:10.461476 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 323/584] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:09 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1470 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:11.057121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-161dffd5-ed03-4495-b41e-55e7ee26b5c0 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:11.058273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-161dffd5-ed03-4495-b41e-55e7ee26b5c0 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:11.066603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-161dffd5-ed03-4495-b41e-55e7ee26b5c0 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:11.067244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-161dffd5-ed03-4495-b41e-55e7ee26b5c0 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:11.068265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-161dffd5-ed03-4495-b41e-55e7ee26b5c0 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:11.068873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-161dffd5-ed03-4495-b41e-55e7ee26b5c0 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:11.482047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-161dffd5-ed03-4495-b41e-55e7ee26b5c0 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:11.487854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ae78bea-a053-49da-8973-9271159f5b46 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:11.490394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ae78bea-a053-49da-8973-9271159f5b46 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:11.504849 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-161dffd5-ed03-4495-b41e-55e7ee26b5c0 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1272 microversion: 2.1 time: 0.453706 Jul 26 14:05:11.523254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ae78bea-a053-49da-8973-9271159f5b46 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:11.524050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ae78bea-a053-49da-8973-9271159f5b46 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:11.524532 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 262/585] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:11 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1272 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:11.526042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ae78bea-a053-49da-8973-9271159f5b46 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:11.528660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ae78bea-a053-49da-8973-9271159f5b46 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:12.300008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7ae78bea-a053-49da-8973-9271159f5b46 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:12.314664 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ae78bea-a053-49da-8973-9271159f5b46 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1470 microversion: 2.1 time: 0.830872 Jul 26 14:05:12.316044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 324/586] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:11 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1470 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:12.532299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d7641812-040a-4775-80b0-a3ac37d58755 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:12.533168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d7641812-040a-4775-80b0-a3ac37d58755 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:12.547585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7641812-040a-4775-80b0-a3ac37d58755 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:12.559222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7641812-040a-4775-80b0-a3ac37d58755 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:12.560603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7641812-040a-4775-80b0-a3ac37d58755 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:12.561224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7641812-040a-4775-80b0-a3ac37d58755 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:12.822078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d7641812-040a-4775-80b0-a3ac37d58755 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:12.838429 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d7641812-040a-4775-80b0-a3ac37d58755 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1272 microversion: 2.1 time: 0.312314 Jul 26 14:05:12.839531 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 263/587] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:12 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:13.343251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3f7e1511-5c00-4d45-8606-decff223a206 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:13.344258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3f7e1511-5c00-4d45-8606-decff223a206 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:13.362501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f7e1511-5c00-4d45-8606-decff223a206 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:13.363545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f7e1511-5c00-4d45-8606-decff223a206 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:13.364676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f7e1511-5c00-4d45-8606-decff223a206 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:13.369595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f7e1511-5c00-4d45-8606-decff223a206 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:13.624727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-918436482", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "dec9c441-e518-4bde-a78f-08d7b612e87d"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:13.744404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] validate_networks() for [('dec9c441-e518-4bde-a78f-08d7b612e87d', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:05:13.971374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3f7e1511-5c00-4d45-8606-decff223a206 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:13.979619 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3f7e1511-5c00-4d45-8606-decff223a206 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1470 microversion: 2.1 time: 0.640473 Jul 26 14:05:13.980234 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 264/588] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:13 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1470 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:05:14.008254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c313dee5-2174-4bc9-905e-1f9f32d0ecc9 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:14.008946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c313dee5-2174-4bc9-905e-1f9f32d0ecc9 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:14.016889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c313dee5-2174-4bc9-905e-1f9f32d0ecc9 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:14.018331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c313dee5-2174-4bc9-905e-1f9f32d0ecc9 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:14.023056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c313dee5-2174-4bc9-905e-1f9f32d0ecc9 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:14.024223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c313dee5-2174-4bc9-905e-1f9f32d0ecc9 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:14.900299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c313dee5-2174-4bc9-905e-1f9f32d0ecc9 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:14.914824 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c313dee5-2174-4bc9-905e-1f9f32d0ecc9 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1589 microversion: 2.1 time: 0.916282 Jul 26 14:05:14.915555 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 265/589] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:13 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1589 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:14.946720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-742212c4-da60-4067-b40c-4741be7b48de tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:14.948733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-742212c4-da60-4067-b40c-4741be7b48de tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:14.980521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-742212c4-da60-4067-b40c-4741be7b48de tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:14.981113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-742212c4-da60-4067-b40c-4741be7b48de tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:14.981762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-742212c4-da60-4067-b40c-4741be7b48de tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:14.982915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-742212c4-da60-4067-b40c-4741be7b48de tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:15.703699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:16.218421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-742212c4-da60-4067-b40c-4741be7b48de tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:16.234764 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-742212c4-da60-4067-b40c-4741be7b48de tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1314 microversion: 2.1 time: 1.309677 Jul 26 14:05:16.236038 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 266/590] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:14 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1314 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:16.244193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4852751a-4928-4c44-b214-ca491b90a100 req-d6cd5c0a-dbbf-4c2c-89f8-e2725387773a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9611ccf6-16ec-4945-aecf-3cfcb058ec91", "tag": "803157f9-374f-4edf-b468-6e317b5c706e"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:16.261402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:16.267842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4852751a-4928-4c44-b214-ca491b90a100 req-d6cd5c0a-dbbf-4c2c-89f8-e2725387773a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:16.268756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4852751a-4928-4c44-b214-ca491b90a100 req-d6cd5c0a-dbbf-4c2c-89f8-e2725387773a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:16.289473 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4852751a-4928-4c44-b214-ca491b90a100 req-d6cd5c0a-dbbf-4c2c-89f8-e2725387773a service nova] Creating event network-changed:803157f9-374f-4edf-b468-6e317b5c706e for instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 on n-h1-833090-9 Jul 26 14:05:16.299133 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4852751a-4928-4c44-b214-ca491b90a100 req-d6cd5c0a-dbbf-4c2c-89f8-e2725387773a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061049 Jul 26 14:05:16.300732 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 267/591] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:16.338438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0a33f21a-917c-4f15-96a4-16cc40a905f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:16.340366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0a33f21a-917c-4f15-96a4-16cc40a905f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:16.364829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a33f21a-917c-4f15-96a4-16cc40a905f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:16.366723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a33f21a-917c-4f15-96a4-16cc40a905f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:16.372424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a33f21a-917c-4f15-96a4-16cc40a905f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:16.372886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a33f21a-917c-4f15-96a4-16cc40a905f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:17.381682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=14 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:17.434888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0a33f21a-917c-4f15-96a4-16cc40a905f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:17.448303 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0a33f21a-917c-4f15-96a4-16cc40a905f7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1475 microversion: 2.1 time: 1.145501 Jul 26 14:05:17.450132 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 268/592] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:16 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1475 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:17.469433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-787dbd9f-80cc-4c14-acbf-2f9b8c1327c4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:17.470068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-787dbd9f-80cc-4c14-acbf-2f9b8c1327c4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:17.494523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-787dbd9f-80cc-4c14-acbf-2f9b8c1327c4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:17.495121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-787dbd9f-80cc-4c14-acbf-2f9b8c1327c4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:17.496002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-787dbd9f-80cc-4c14-acbf-2f9b8c1327c4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:17.496462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-787dbd9f-80cc-4c14-acbf-2f9b8c1327c4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:17.777747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:05:17.778183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:05:17.778717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:05:17.779140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:05:17.779908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:05:17.795942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:17.796892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:17.798147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:17.799016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:17.870126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Getting quotas for project 40c093b8d104424886d49b50d824ffd5. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:05:17.876407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Getting quotas for user a4b200c9a691499d8a2e56d607fdc29f and project 40c093b8d104424886d49b50d824ffd5. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:05:17.897699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:05:17.901242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:05:17.978981 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b5f15b2c-df5e-4346-ad6f-9ac79efb2a7b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.972517 Jul 26 14:05:17.984280 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 325/593] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:05:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:05:18.002401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-901919aa-88d1-4e28-8f3d-d511b0e40d42 req-22986c9f-6bb6-46e9-98fb-2536089d8353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf4359c-96f3-43bf-aea5-1cb4685a4493", "tag": "0f1776dc-c5aa-4946-80e1-ec3dbca3eb36"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:18.054089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-901919aa-88d1-4e28-8f3d-d511b0e40d42 req-22986c9f-6bb6-46e9-98fb-2536089d8353 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:18.055255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-787dbd9f-80cc-4c14-acbf-2f9b8c1327c4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:18.057467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-901919aa-88d1-4e28-8f3d-d511b0e40d42 req-22986c9f-6bb6-46e9-98fb-2536089d8353 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:18.068889 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-787dbd9f-80cc-4c14-acbf-2f9b8c1327c4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1314 microversion: 2.1 time: 0.614962 Jul 26 14:05:18.069493 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 269/594] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:17 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:18.085215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ef39b1d-6524-4f47-904b-9db882c9a6a7 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:18.086010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ef39b1d-6524-4f47-904b-9db882c9a6a7 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:18.096790 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-901919aa-88d1-4e28-8f3d-d511b0e40d42 req-22986c9f-6bb6-46e9-98fb-2536089d8353 service nova] Creating event network-changed:0f1776dc-c5aa-4946-80e1-ec3dbca3eb36 for instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 on n-h1-833090-9 Jul 26 14:05:18.111743 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-901919aa-88d1-4e28-8f3d-d511b0e40d42 req-22986c9f-6bb6-46e9-98fb-2536089d8353 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124874 Jul 26 14:05:18.114982 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 326/595] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:18.224837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8ef39b1d-6524-4f47-904b-9db882c9a6a7 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:18.234389 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ef39b1d-6524-4f47-904b-9db882c9a6a7 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1215 microversion: 2.1 time: 0.163603 Jul 26 14:05:18.235071 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 270/596] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:18 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:18.382545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-265efe7d-0b30-43a3-848f-40f61aaa6216 req-be1b63ae-2511-458f-9b07-aea4c5789c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b45315-c940-435c-9769-226630fcf63d", "tag": "39bc3d90-adda-4d10-a83d-27393453117a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:18.418501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-265efe7d-0b30-43a3-848f-40f61aaa6216 req-be1b63ae-2511-458f-9b07-aea4c5789c95 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:18.422357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-265efe7d-0b30-43a3-848f-40f61aaa6216 req-be1b63ae-2511-458f-9b07-aea4c5789c95 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:18.464317 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-265efe7d-0b30-43a3-848f-40f61aaa6216 req-be1b63ae-2511-458f-9b07-aea4c5789c95 service nova] Creating event network-changed:39bc3d90-adda-4d10-a83d-27393453117a for instance 99b45315-c940-435c-9769-226630fcf63d on n-h2-833090-9 Jul 26 14:05:18.476783 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-265efe7d-0b30-43a3-848f-40f61aaa6216 req-be1b63ae-2511-458f-9b07-aea4c5789c95 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098027 Jul 26 14:05:18.479563 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 271/597] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:05:18.487840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-886cfa9a-c495-4832-ade5-e83d49c051f5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:18.496864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-886cfa9a-c495-4832-ade5-e83d49c051f5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:18.513808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-886cfa9a-c495-4832-ade5-e83d49c051f5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:18.514368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-886cfa9a-c495-4832-ade5-e83d49c051f5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:18.520725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-886cfa9a-c495-4832-ade5-e83d49c051f5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:18.521005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-886cfa9a-c495-4832-ade5-e83d49c051f5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:18.608092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a228cb0-5d39-4bf3-b9a6-ca3fc1eb5ab0 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Calling method '.version_select at 0x7f879482baf0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:18.609784 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:18.609784 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:05:18.611553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a228cb0-5d39-4bf3-b9a6-ca3fc1eb5ab0 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:18.612941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a228cb0-5d39-4bf3-b9a6-ca3fc1eb5ab0 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:18.638125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a228cb0-5d39-4bf3-b9a6-ca3fc1eb5ab0 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:18.641739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a228cb0-5d39-4bf3-b9a6-ca3fc1eb5ab0 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:18.656275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a228cb0-5d39-4bf3-b9a6-ca3fc1eb5ab0 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:18.657478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a228cb0-5d39-4bf3-b9a6-ca3fc1eb5ab0 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:18.665842 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1a228cb0-5d39-4bf3-b9a6-ca3fc1eb5ab0 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.290945 Jul 26 14:05:18.667263 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 327/598] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:05:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:18.986286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cd1a11a-6a99-4393-98b5-2164d24ec585 tempest-HypervisorAdminNegativeUnderV252Test-1831311955 tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project] Calling method '.version_select at 0x7f87948c9e50>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:18.988389 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:18.988389 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:05:18.993393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5cd1a11a-6a99-4393-98b5-2164d24ec585 tempest-HypervisorAdminNegativeUnderV252Test-1831311955 tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '79433e20c9064ac0be5c9f131d68477a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536fc0499cad4750a13047c2434d029f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cd1a11a-6a99-4393-98b5-2164d24ec585 tempest-HypervisorAdminNegativeUnderV252Test-1831311955 tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project] Request method failure captured: Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hypervisors/n-h1-833090-9/search HTTP/1.1 Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ScK6GqB-59m4wWsTVqF1wbz3LWoGvqcgGutzTtXXIO1JsgTqN5QQe9ZQhgC8UzI8fdrm4jlFR09hHJ1aJOCYbZgTB6IlgtI1aQcGaIp-3Usxivil135PsmwOI6pCWscFsGoB8F_YKoSuCDA_3vIA4FCX8cnn2iKCf0jobZMlugAos Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 536fc0499cad4750a13047c2434d029f Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1831311955 Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:05:18.999704 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/536fc0499cad4750a13047c2434d029f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/536fc0499cad4750a13047c2434d029f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_536fc0499cad4750a13047c2434d029f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/536fc0499cad4750a13047c2434d029f"}]}] Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1831311955 Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 536fc0499cad4750a13047c2434d029f Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1831311955 Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 79433e20c9064ac0be5c9f131d68477a Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 26 14:05:19.001220 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'n-h1-833090-9'} Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:05:19.002070 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 26 14:05:19.003266 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.009834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cd1a11a-6a99-4393-98b5-2164d24ec585 tempest-HypervisorAdminNegativeUnderV252Test-1831311955 tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:19.013055 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5cd1a11a-6a99-4393-98b5-2164d24ec585 tempest-HypervisorAdminNegativeUnderV252Test-1831311955 tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h1-833090-9/search" status: 403 len: 117 microversion: 2.1 time: 0.338699 Jul 26 14:05:19.014578 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 328/599] 10.222.0.70 () {58 vars in 1209 bytes} [Tue Jul 26 14:05:18 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-9/search => generated 117 bytes in 341 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:19.034039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-081bbb49-dfcb-42eb-ac65-7602c6bcdd5e tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Calling method '.version_select at 0x7f87947a1b80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:19.037715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-081bbb49-dfcb-42eb-ac65-7602c6bcdd5e tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:19.040945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-081bbb49-dfcb-42eb-ac65-7602c6bcdd5e tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:19.052809 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-081bbb49-dfcb-42eb-ac65-7602c6bcdd5e tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-081bbb49-dfcb-42eb-ac65-7602c6bcdd5e tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Request method failure captured: Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_SeoxBmvYvDn6crdV_BNXMt9_fxsbpjT5cqsB6jcgj8-RMp2TK0-S10oiNg-5gmKcJ0YdRd7pYSe9FKY9pyvDv2q8-KbqwaCchx-W6hKnx3kVfldcZChPEi7I_5wI6ERD0sLxb-NqO2hFHIaHiYU21OU1ps1DUR-nnMCurqb9KW8RA Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 70645907d46f4dcc857017f37308fb93 Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1648027178 Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:05:19.054583 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/70645907d46f4dcc857017f37308fb93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/70645907d46f4dcc857017f37308fb93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_70645907d46f4dcc857017f37308fb93", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/70645907d46f4dcc857017f37308fb93"}]}] Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1648027178 Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 70645907d46f4dcc857017f37308fb93 Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1648027178 Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6a05e208da0c45688aa6d9b611bd858f Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 14:05:19.056426 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:19.057224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:19.058410 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:19.058410 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:19.058410 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:19.058410 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 26 14:05:19.058410 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.064429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-081bbb49-dfcb-42eb-ac65-7602c6bcdd5e tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:19.067046 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-081bbb49-dfcb-42eb-ac65-7602c6bcdd5e tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.045597 Jul 26 14:05:19.072180 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 329/600] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 14:05:19 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:19.089846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-628b6060-9f7a-401b-823c-039a47181162 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Calling method '.version_select at 0x7f8794acd160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:19.091331 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:19.091331 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:05:19.099942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-628b6060-9f7a-401b-823c-039a47181162 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:19.106855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-628b6060-9f7a-401b-823c-039a47181162 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:19.150583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-628b6060-9f7a-401b-823c-039a47181162 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:19.152894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-628b6060-9f7a-401b-823c-039a47181162 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:19.203458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-628b6060-9f7a-401b-823c-039a47181162 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:19.206576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-628b6060-9f7a-401b-823c-039a47181162 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:19.231469 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-628b6060-9f7a-401b-823c-039a47181162 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.156600 Jul 26 14:05:19.232849 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 330/601] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:05:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:19.248283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-813f0533-378e-468d-a640-777f47e8313c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:19.250051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-813f0533-378e-468d-a640-777f47e8313c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:19.275655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-813f0533-378e-468d-a640-777f47e8313c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:19.277825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-813f0533-378e-468d-a640-777f47e8313c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:19.279765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-813f0533-378e-468d-a640-777f47e8313c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:19.282476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-813f0533-378e-468d-a640-777f47e8313c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:19.308309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-886cfa9a-c495-4832-ade5-e83d49c051f5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:19.325164 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-886cfa9a-c495-4832-ade5-e83d49c051f5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1475 microversion: 2.1 time: 0.843520 Jul 26 14:05:19.332529 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 272/602] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:18 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1475 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:19.353125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c0978bb-c207-4343-a2b7-54812ba0189b tempest-HypervisorAdminNegativeUnderV252Test-1831311955 tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project] Calling method '.version_select at 0x7f87945f90d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:19.359434 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:19.359434 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:05:19.360814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5c0978bb-c207-4343-a2b7-54812ba0189b tempest-HypervisorAdminNegativeUnderV252Test-1831311955 tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '79433e20c9064ac0be5c9f131d68477a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536fc0499cad4750a13047c2434d029f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c0978bb-c207-4343-a2b7-54812ba0189b tempest-HypervisorAdminNegativeUnderV252Test-1831311955 tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project] Request method failure captured: Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ScK6GqB-59m4wWsTVqF1wbz3LWoGvqcgGutzTtXXIO1JsgTqN5QQe9ZQhgC8UzI8fdrm4jlFR09hHJ1aJOCYbZgTB6IlgtI1aQcGaIp-3Usxivil135PsmwOI6pCWscFsGoB8F_YKoSuCDA_3vIA4FCX8cnn2iKCf0jobZMlugAos Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 536fc0499cad4750a13047c2434d029f Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1831311955 Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:19.362628 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/536fc0499cad4750a13047c2434d029f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/536fc0499cad4750a13047c2434d029f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_536fc0499cad4750a13047c2434d029f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/536fc0499cad4750a13047c2434d029f"}]}] Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1831311955 Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 536fc0499cad4750a13047c2434d029f Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1831311955 Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 79433e20c9064ac0be5c9f131d68477a Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 26 14:05:19.363942 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '1'} Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:05:19.364933 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 26 14:05:19.366087 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.367222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c0978bb-c207-4343-a2b7-54812ba0189b tempest-HypervisorAdminNegativeUnderV252Test-1831311955 tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:19.367222 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5c0978bb-c207-4343-a2b7-54812ba0189b tempest-HypervisorAdminNegativeUnderV252Test-1831311955 tempest-HypervisorAdminNegativeUnderV252Test-1831311955-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.029480 Jul 26 14:05:19.380037 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 273/603] 10.222.0.70 () {58 vars in 1176 bytes} [Tue Jul 26 14:05:19 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:19.385835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-82023166-a8d2-4a67-a249-10451bc4a94d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:19.386451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-82023166-a8d2-4a67-a249-10451bc4a94d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:19.427696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82023166-a8d2-4a67-a249-10451bc4a94d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:19.427934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82023166-a8d2-4a67-a249-10451bc4a94d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:19.430570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82023166-a8d2-4a67-a249-10451bc4a94d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:19.431426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82023166-a8d2-4a67-a249-10451bc4a94d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:19.619386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-82023166-a8d2-4a67-a249-10451bc4a94d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:19.640940 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-82023166-a8d2-4a67-a249-10451bc4a94d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1267 microversion: 2.1 time: 0.259519 Jul 26 14:05:19.644317 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 274/604] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:19 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:19.661622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2fdd486d-ee15-48fc-944a-93949cbb7419 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Calling method '.version_select at 0x7f87944b2700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:19.669164 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:19.669164 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:05:19.674641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2fdd486d-ee15-48fc-944a-93949cbb7419 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:19.675786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2fdd486d-ee15-48fc-944a-93949cbb7419 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:19.694204 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-2fdd486d-ee15-48fc-944a-93949cbb7419 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] HTTP exception thrown: No hypervisor matching '94ac0044-7fc8-40c7-b7d5-1d6c8ffc8887' could be found. Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2fdd486d-ee15-48fc-944a-93949cbb7419 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Request method failure captured: Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-hypervisors/94ac0044-7fc8-40c7-b7d5-1d6c8ffc8887/servers HTTP/1.1 Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_SeoxBmvYvDn6crdV_BNXMt9_fxsbpjT5cqsB6jcgj8-RMp2TK0-S10oiNg-5gmKcJ0YdRd7pYSe9FKY9pyvDv2q8-KbqwaCchx-W6hKnx3kVfldcZChPEi7I_5wI6ERD0sLxb-NqO2hFHIaHiYU21OU1ps1DUR-nnMCurqb9KW8RA Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 70645907d46f4dcc857017f37308fb93 Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1648027178 Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:05:19.700517 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/70645907d46f4dcc857017f37308fb93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/70645907d46f4dcc857017f37308fb93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_70645907d46f4dcc857017f37308fb93", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/70645907d46f4dcc857017f37308fb93"}]}] Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1648027178 Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 70645907d46f4dcc857017f37308fb93 Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1648027178 Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6a05e208da0c45688aa6d9b611bd858f Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: exception: No hypervisor matching '94ac0044-7fc8-40c7-b7d5-1d6c8ffc8887' could be found. Jul 26 14:05:19.701917 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '94ac0044-7fc8-40c7-b7d5-1d6c8ffc8887'} Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '94ac0044-7fc8-40c7-b7d5-1d6c8ffc8887' could be found. Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.702637 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:19.704072 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:19.704072 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:19.704072 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:19.704072 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:19.704072 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '94ac0044-7fc8-40c7-b7d5-1d6c8ffc8887' could be found. Jul 26 14:05:19.704072 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:19.704072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2fdd486d-ee15-48fc-944a-93949cbb7419 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] Returning 404 to user: No hypervisor matching '94ac0044-7fc8-40c7-b7d5-1d6c8ffc8887' could be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:19.704072 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2fdd486d-ee15-48fc-944a-93949cbb7419 tempest-HypervisorAdminNegativeUnderV252Test-1648027178 tempest-HypervisorAdminNegativeUnderV252Test-1648027178-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/94ac0044-7fc8-40c7-b7d5-1d6c8ffc8887/servers" status: 404 len: 123 microversion: 2.1 time: 0.055937 Jul 26 14:05:19.704072 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 275/605] 10.222.0.70 () {58 vars in 1281 bytes} [Tue Jul 26 14:05:19 2022] GET /compute/v2.1/os-hypervisors/94ac0044-7fc8-40c7-b7d5-1d6c8ffc8887/servers => generated 123 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:20.012773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-813f0533-378e-468d-a640-777f47e8313c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:20.025790 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-813f0533-378e-468d-a640-777f47e8313c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1314 microversion: 2.1 time: 0.790606 Jul 26 14:05:20.032120 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 331/606] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:19 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:20.353661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-19edef61-90d7-4878-8696-e746a85e57f8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:20.354444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-19edef61-90d7-4878-8696-e746a85e57f8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:20.369383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19edef61-90d7-4878-8696-e746a85e57f8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:20.374386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19edef61-90d7-4878-8696-e746a85e57f8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:20.375763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19edef61-90d7-4878-8696-e746a85e57f8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:20.376646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19edef61-90d7-4878-8696-e746a85e57f8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:20.667837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eb889f3c-44ba-47da-832f-083b909dc8c8 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:20.668808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eb889f3c-44ba-47da-832f-083b909dc8c8 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:20.679067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb889f3c-44ba-47da-832f-083b909dc8c8 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:20.684671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb889f3c-44ba-47da-832f-083b909dc8c8 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:20.689120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb889f3c-44ba-47da-832f-083b909dc8c8 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:20.691356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb889f3c-44ba-47da-832f-083b909dc8c8 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:20.982960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-19edef61-90d7-4878-8696-e746a85e57f8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:20.994294 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-19edef61-90d7-4878-8696-e746a85e57f8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1475 microversion: 2.1 time: 0.644325 Jul 26 14:05:20.998373 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 276/607] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:20 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1475 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:21.011288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb889f3c-44ba-47da-832f-083b909dc8c8 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:21.023031 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eb889f3c-44ba-47da-832f-083b909dc8c8 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1273 microversion: 2.1 time: 0.359833 Jul 26 14:05:21.031070 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 332/608] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:20 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1273 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:05:21.064308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-74358379-4a8c-4e1a-8f90-28fcf510770b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:21.066438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-74358379-4a8c-4e1a-8f90-28fcf510770b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:21.080673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74358379-4a8c-4e1a-8f90-28fcf510770b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:21.081716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74358379-4a8c-4e1a-8f90-28fcf510770b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:21.083694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74358379-4a8c-4e1a-8f90-28fcf510770b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:21.084391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74358379-4a8c-4e1a-8f90-28fcf510770b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:21.537678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-74358379-4a8c-4e1a-8f90-28fcf510770b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:21.559587 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-74358379-4a8c-4e1a-8f90-28fcf510770b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1314 microversion: 2.1 time: 0.503361 Jul 26 14:05:21.560636 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 277/609] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:21 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:22.022784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5bd0b49e-0454-4808-8290-32170292141b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:22.024487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5bd0b49e-0454-4808-8290-32170292141b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:22.037642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bd0b49e-0454-4808-8290-32170292141b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:22.038090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bd0b49e-0454-4808-8290-32170292141b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:22.039780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bd0b49e-0454-4808-8290-32170292141b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:22.040412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bd0b49e-0454-4808-8290-32170292141b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:22.047916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:22.057683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f17ff8bf-a6f8-411e-9e22-a70cf47e5af9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:22.059167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f17ff8bf-a6f8-411e-9e22-a70cf47e5af9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:22.081361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f17ff8bf-a6f8-411e-9e22-a70cf47e5af9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:22.081903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f17ff8bf-a6f8-411e-9e22-a70cf47e5af9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:22.082702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f17ff8bf-a6f8-411e-9e22-a70cf47e5af9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:22.083167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f17ff8bf-a6f8-411e-9e22-a70cf47e5af9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:22.919935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f17ff8bf-a6f8-411e-9e22-a70cf47e5af9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:22.946980 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f17ff8bf-a6f8-411e-9e22-a70cf47e5af9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1273 microversion: 2.1 time: 0.893758 Jul 26 14:05:22.948005 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 278/610] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:22 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1273 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:22.958247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-917b36a1-84b8-4f1b-a67c-717a064a81ba tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:22.959360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-917b36a1-84b8-4f1b-a67c-717a064a81ba tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:22.972945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-917b36a1-84b8-4f1b-a67c-717a064a81ba tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:22.973865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-917b36a1-84b8-4f1b-a67c-717a064a81ba tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:22.975320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-917b36a1-84b8-4f1b-a67c-717a064a81ba tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:22.975937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-917b36a1-84b8-4f1b-a67c-717a064a81ba tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:23.078321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5bd0b49e-0454-4808-8290-32170292141b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:23.095506 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5bd0b49e-0454-4808-8290-32170292141b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1475 microversion: 2.1 time: 1.076439 Jul 26 14:05:23.120660 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 333/611] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:22 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1475 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:23.567474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-917b36a1-84b8-4f1b-a67c-717a064a81ba tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:23.599381 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-917b36a1-84b8-4f1b-a67c-717a064a81ba tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1314 microversion: 2.1 time: 0.649072 Jul 26 14:05:23.600702 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 279/612] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:22 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:23.975588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ac0e06dc-4694-4f12-8ac9-11281e201c73 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:23.976566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ac0e06dc-4694-4f12-8ac9-11281e201c73 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:23.989768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac0e06dc-4694-4f12-8ac9-11281e201c73 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:23.990231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac0e06dc-4694-4f12-8ac9-11281e201c73 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:23.999445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac0e06dc-4694-4f12-8ac9-11281e201c73 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:24.000050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac0e06dc-4694-4f12-8ac9-11281e201c73 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:24.126102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d4407ea-4af9-4ba8-afbf-9b20cf10fa45 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:24.127123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3d4407ea-4af9-4ba8-afbf-9b20cf10fa45 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:24.142891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d4407ea-4af9-4ba8-afbf-9b20cf10fa45 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:24.144234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d4407ea-4af9-4ba8-afbf-9b20cf10fa45 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:24.147863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d4407ea-4af9-4ba8-afbf-9b20cf10fa45 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:24.148746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d4407ea-4af9-4ba8-afbf-9b20cf10fa45 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:25.100673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3d4407ea-4af9-4ba8-afbf-9b20cf10fa45 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:25.121525 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3d4407ea-4af9-4ba8-afbf-9b20cf10fa45 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1475 microversion: 2.1 time: 1.001124 Jul 26 14:05:25.122267 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 280/613] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:24 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1475 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:25.134710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a2c3d79d-6ad3-44a5-bbba-ec66f5656143 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:25.134952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ac0e06dc-4694-4f12-8ac9-11281e201c73 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:25.136289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a2c3d79d-6ad3-44a5-bbba-ec66f5656143 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:25.153579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2c3d79d-6ad3-44a5-bbba-ec66f5656143 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:25.156577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2c3d79d-6ad3-44a5-bbba-ec66f5656143 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:25.162451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2c3d79d-6ad3-44a5-bbba-ec66f5656143 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:25.165088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2c3d79d-6ad3-44a5-bbba-ec66f5656143 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:25.171205 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ac0e06dc-4694-4f12-8ac9-11281e201c73 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1315 microversion: 2.1 time: 1.198701 Jul 26 14:05:25.174512 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 334/614] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:23 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1315 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:25.635795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a2c3d79d-6ad3-44a5-bbba-ec66f5656143 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:25.642764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:25.646430 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a2c3d79d-6ad3-44a5-bbba-ec66f5656143 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1314 microversion: 2.1 time: 0.522830 Jul 26 14:05:25.649840 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 281/615] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:25 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:26.155620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-008cf845-497c-46c1-acf7-b724baa765a5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:26.156953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-008cf845-497c-46c1-acf7-b724baa765a5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:26.204983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a43f6631-87bb-451a-9a1e-c783ad796141 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:26.206764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a43f6631-87bb-451a-9a1e-c783ad796141 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:26.218486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-008cf845-497c-46c1-acf7-b724baa765a5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:26.222135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-008cf845-497c-46c1-acf7-b724baa765a5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:26.229431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-008cf845-497c-46c1-acf7-b724baa765a5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:26.233258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-008cf845-497c-46c1-acf7-b724baa765a5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:26.247391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a43f6631-87bb-451a-9a1e-c783ad796141 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:26.248015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a43f6631-87bb-451a-9a1e-c783ad796141 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:26.248831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a43f6631-87bb-451a-9a1e-c783ad796141 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:26.249272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a43f6631-87bb-451a-9a1e-c783ad796141 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:26.872573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-008cf845-497c-46c1-acf7-b724baa765a5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:26.884394 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-008cf845-497c-46c1-acf7-b724baa765a5 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1475 microversion: 2.1 time: 0.741583 Jul 26 14:05:26.891635 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 335/616] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:26 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1475 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:26.935061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a43f6631-87bb-451a-9a1e-c783ad796141 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:26.948639 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a43f6631-87bb-451a-9a1e-c783ad796141 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1315 microversion: 2.1 time: 0.755638 Jul 26 14:05:26.952067 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 282/617] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:26 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:26.958530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c52f7e50-5bf8-4d41-9b13-982ddab54975 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:26.959141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c52f7e50-5bf8-4d41-9b13-982ddab54975 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:26.989831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c52f7e50-5bf8-4d41-9b13-982ddab54975 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:26.991176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c52f7e50-5bf8-4d41-9b13-982ddab54975 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:26.992257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c52f7e50-5bf8-4d41-9b13-982ddab54975 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:26.995141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c52f7e50-5bf8-4d41-9b13-982ddab54975 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:27.377234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1412316552", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "5ef2cecf-6342-4020-8ce3-eff3cab2d670"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:27.493914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] validate_networks() for [('5ef2cecf-6342-4020-8ce3-eff3cab2d670', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:05:27.812541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:27.885420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:28.229598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:28.401187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c52f7e50-5bf8-4d41-9b13-982ddab54975 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:28.426730 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c52f7e50-5bf8-4d41-9b13-982ddab54975 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1314 microversion: 2.1 time: 1.473449 Jul 26 14:05:28.429200 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 283/618] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:26 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1314 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:28.444511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-fa635fd1-3a0f-45ce-b306-482ba3f77b64 req-8b61b1ef-a578-408d-9182-9e90a3d54798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf4359c-96f3-43bf-aea5-1cb4685a4493", "name": "network-vif-plugged", "status": "completed", "tag": "0f1776dc-c5aa-4946-80e1-ec3dbca3eb36"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:28.466854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fa635fd1-3a0f-45ce-b306-482ba3f77b64 req-8b61b1ef-a578-408d-9182-9e90a3d54798 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:28.471569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fa635fd1-3a0f-45ce-b306-482ba3f77b64 req-8b61b1ef-a578-408d-9182-9e90a3d54798 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:28.500292 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-fa635fd1-3a0f-45ce-b306-482ba3f77b64 req-8b61b1ef-a578-408d-9182-9e90a3d54798 service nova] Creating event network-vif-plugged:0f1776dc-c5aa-4946-80e1-ec3dbca3eb36 for instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 on n-h1-833090-9 Jul 26 14:05:28.511803 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-fa635fd1-3a0f-45ce-b306-482ba3f77b64 req-8b61b1ef-a578-408d-9182-9e90a3d54798 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079306 Jul 26 14:05:28.517322 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 284/619] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:28.527059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4225c938-f62d-40e0-8091-d15554788a4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:28.527797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4225c938-f62d-40e0-8091-d15554788a4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:28.547309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4225c938-f62d-40e0-8091-d15554788a4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:28.547932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4225c938-f62d-40e0-8091-d15554788a4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:28.548849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4225c938-f62d-40e0-8091-d15554788a4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:28.551989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4225c938-f62d-40e0-8091-d15554788a4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:29.350361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4225c938-f62d-40e0-8091-d15554788a4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:29.368142 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4225c938-f62d-40e0-8091-d15554788a4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1475 microversion: 2.1 time: 0.845245 Jul 26 14:05:29.369246 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 285/620] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:28 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1475 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:29.377183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0007a712-802e-4299-9291-8bf96b6f24dc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:29.378651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0007a712-802e-4299-9291-8bf96b6f24dc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:29.398057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0007a712-802e-4299-9291-8bf96b6f24dc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:29.398809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0007a712-802e-4299-9291-8bf96b6f24dc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:29.399774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0007a712-802e-4299-9291-8bf96b6f24dc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:29.400401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0007a712-802e-4299-9291-8bf96b6f24dc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:29.580379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:05:29.580930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:05:29.581728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:05:29.582098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:05:29.582524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:05:29.603598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:29.604754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:29.606290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:29.607547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:29.654566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Getting quotas for project 3c83e50f8be04fb9b086a046f5b7eb00. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:05:29.659938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Getting quotas for user 4a31af687dca4bea97ad5cb0459f0dbd and project 3c83e50f8be04fb9b086a046f5b7eb00. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:05:29.667654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0007a712-802e-4299-9291-8bf96b6f24dc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:29.674062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:05:29.676752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:05:29.678040 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0007a712-802e-4299-9291-8bf96b6f24dc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1315 microversion: 2.1 time: 0.306746 Jul 26 14:05:29.679408 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 286/621] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:29 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:29.685449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a26933e6-592e-4f7f-af43-ef59f1cee9b6 req-5ef7d484-4faf-482b-910b-740ee97959fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d38d7d-c26a-45dc-8607-631c5a626f18", "tag": "6be56b4f-6dcf-45ba-8f89-cd0d73be2ceb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:29.698085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a26933e6-592e-4f7f-af43-ef59f1cee9b6 req-5ef7d484-4faf-482b-910b-740ee97959fc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:29.698970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a26933e6-592e-4f7f-af43-ef59f1cee9b6 req-5ef7d484-4faf-482b-910b-740ee97959fc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:29.724204 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a26933e6-592e-4f7f-af43-ef59f1cee9b6 req-5ef7d484-4faf-482b-910b-740ee97959fc service nova] Creating event network-changed:6be56b4f-6dcf-45ba-8f89-cd0d73be2ceb for instance 24d38d7d-c26a-45dc-8607-631c5a626f18 on n-h2-833090-9 Jul 26 14:05:29.740457 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a26933e6-592e-4f7f-af43-ef59f1cee9b6 req-5ef7d484-4faf-482b-910b-740ee97959fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059188 Jul 26 14:05:29.741764 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 287/622] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:29.752599 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-11df0ac6-afab-42df-ab0c-2333daf6cd38 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.857627 Jul 26 14:05:29.753801 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 336/623] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2859 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:05:29.760500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-621e4db0-bd4f-4d87-97f4-66f8d92aceaa tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:29.761280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-621e4db0-bd4f-4d87-97f4-66f8d92aceaa tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:29.768388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-621e4db0-bd4f-4d87-97f4-66f8d92aceaa tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:29.768840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-621e4db0-bd4f-4d87-97f4-66f8d92aceaa tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:29.769777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-621e4db0-bd4f-4d87-97f4-66f8d92aceaa tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:29.770221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-621e4db0-bd4f-4d87-97f4-66f8d92aceaa tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:29.963340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7f01618d-c71f-440a-8841-838bf22b8b45 tempest-QuotaClassesAdminTestJSON-1424307119 tempest-QuotaClassesAdminTestJSON-1424307119-project-admin] Calling method '.version_select at 0x7f879442d0d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:29.964317 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:29.964317 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:05:30.001642 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7f01618d-c71f-440a-8841-838bf22b8b45 tempest-QuotaClassesAdminTestJSON-1424307119 tempest-QuotaClassesAdminTestJSON-1424307119-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.257061 Jul 26 14:05:30.002411 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 288/624] 10.222.0.70 () {58 vars in 1185 bytes} [Tue Jul 26 14:05:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:30.013688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64cad31a-d2a8-45f7-9664-c663edae6cb4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:30.017430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-64cad31a-d2a8-45f7-9664-c663edae6cb4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:30.052418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-621e4db0-bd4f-4d87-97f4-66f8d92aceaa tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:30.063487 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-621e4db0-bd4f-4d87-97f4-66f8d92aceaa tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1314 microversion: 2.1 time: 0.308264 Jul 26 14:05:30.077325 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 337/625] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:29 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:30.090443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04d5bec0-70c8-4f2c-a16a-de26a08df173 tempest-QuotaClassesAdminTestJSON-1424307119 tempest-QuotaClassesAdminTestJSON-1424307119-project-admin] Action: 'update', calling method: .version_select at 0x7f87948f39d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:30.102681 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:30.102681 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:05:30.153125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64cad31a-d2a8-45f7-9664-c663edae6cb4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:30.168070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64cad31a-d2a8-45f7-9664-c663edae6cb4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:30.174570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64cad31a-d2a8-45f7-9664-c663edae6cb4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:30.176580 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64cad31a-d2a8-45f7-9664-c663edae6cb4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1262 microversion: 2.25 time: 0.170898 Jul 26 14:05:30.179597 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 289/626] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:30 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1262 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:30.392481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3ad37862-9a2e-46b1-ae2f-97c585161adb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:30.394010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3ad37862-9a2e-46b1-ae2f-97c585161adb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:30.425764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ad37862-9a2e-46b1-ae2f-97c585161adb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:30.428824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ad37862-9a2e-46b1-ae2f-97c585161adb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:30.435969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ad37862-9a2e-46b1-ae2f-97c585161adb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:30.436848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ad37862-9a2e-46b1-ae2f-97c585161adb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:30.605749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=14,nova_api:UPDATE=9 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:30.683321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3ad37862-9a2e-46b1-ae2f-97c585161adb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:30.710779 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3ad37862-9a2e-46b1-ae2f-97c585161adb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1475 microversion: 2.1 time: 0.318167 Jul 26 14:05:30.713663 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 290/627] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:30 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1475 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:05:30.731838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c14fecf0-7508-4a16-b614-6701f97ab06d req-33c3433c-4386-4e98-9f9f-2a3ba972bdd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b45315-c940-435c-9769-226630fcf63d", "name": "network-vif-plugged", "status": "completed", "tag": "39bc3d90-adda-4d10-a83d-27393453117a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:30.750866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c14fecf0-7508-4a16-b614-6701f97ab06d req-33c3433c-4386-4e98-9f9f-2a3ba972bdd1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:30.755996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c14fecf0-7508-4a16-b614-6701f97ab06d req-33c3433c-4386-4e98-9f9f-2a3ba972bdd1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:30.780710 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c14fecf0-7508-4a16-b614-6701f97ab06d req-33c3433c-4386-4e98-9f9f-2a3ba972bdd1 service nova] Creating event network-vif-plugged:39bc3d90-adda-4d10-a83d-27393453117a for instance 99b45315-c940-435c-9769-226630fcf63d on n-h2-833090-9 Jul 26 14:05:30.790219 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c14fecf0-7508-4a16-b614-6701f97ab06d req-33c3433c-4386-4e98-9f9f-2a3ba972bdd1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074881 Jul 26 14:05:30.791405 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 291/628] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:30.797868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-484009f4-1549-4386-92aa-f616f278e5d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:30.826242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-484009f4-1549-4386-92aa-f616f278e5d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:30.849483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-484009f4-1549-4386-92aa-f616f278e5d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:30.850100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-484009f4-1549-4386-92aa-f616f278e5d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:30.853165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-484009f4-1549-4386-92aa-f616f278e5d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:30.855264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-484009f4-1549-4386-92aa-f616f278e5d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:30.873165 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-04d5bec0-70c8-4f2c-a16a-de26a08df173 tempest-QuotaClassesAdminTestJSON-1424307119 tempest-QuotaClassesAdminTestJSON-1424307119-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.794079 Jul 26 14:05:30.880814 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 338/629] 10.222.0.70 () {60 vars in 1206 bytes} [Tue Jul 26 14:05:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:30.893508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-54bce8ac-668c-4903-82ab-74a041e15f82 tempest-QuotaClassesAdminTestJSON-1424307119 tempest-QuotaClassesAdminTestJSON-1424307119-project-admin] Calling method '.version_select at 0x7f8794acd160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:30.894590 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:30.894590 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:05:30.917486 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-54bce8ac-668c-4903-82ab-74a041e15f82 tempest-QuotaClassesAdminTestJSON-1424307119 tempest-QuotaClassesAdminTestJSON-1424307119-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.035361 Jul 26 14:05:30.921951 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 339/630] 10.222.0.70 () {58 vars in 1185 bytes} [Tue Jul 26 14:05:30 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:30.931536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b45cd882-5d92-4c6b-a7a2-5b7c5a55425a tempest-QuotaClassesAdminTestJSON-1424307119 tempest-QuotaClassesAdminTestJSON-1424307119-project-admin] Action: 'update', calling method: .version_select at 0x7f87946e8dc0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:31.171616 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b45cd882-5d92-4c6b-a7a2-5b7c5a55425a tempest-QuotaClassesAdminTestJSON-1424307119 tempest-QuotaClassesAdminTestJSON-1424307119-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.244330 Jul 26 14:05:31.171977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-484009f4-1549-4386-92aa-f616f278e5d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:31.181242 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 340/631] 10.222.0.70 () {60 vars in 1206 bytes} [Tue Jul 26 14:05:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:05:31.190558 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-484009f4-1549-4386-92aa-f616f278e5d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1315 microversion: 2.1 time: 0.396710 Jul 26 14:05:31.192835 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 292/632] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:30 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:31.204699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da65486c-9162-4c17-825d-3b8364ce34f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:31.208289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6f881a8-f3b1-4987-963f-06a29c880772 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:31.208549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-da65486c-9162-4c17-825d-3b8364ce34f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:31.211800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6f881a8-f3b1-4987-963f-06a29c880772 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:31.221865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da65486c-9162-4c17-825d-3b8364ce34f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:31.225915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da65486c-9162-4c17-825d-3b8364ce34f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:31.228290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da65486c-9162-4c17-825d-3b8364ce34f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:31.230008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da65486c-9162-4c17-825d-3b8364ce34f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:31.230342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6f881a8-f3b1-4987-963f-06a29c880772 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:31.230812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6f881a8-f3b1-4987-963f-06a29c880772 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:31.232249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6f881a8-f3b1-4987-963f-06a29c880772 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:31.232902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6f881a8-f3b1-4987-963f-06a29c880772 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:31.364820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c6f881a8-f3b1-4987-963f-06a29c880772 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:31.380246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c6f881a8-f3b1-4987-963f-06a29c880772 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:31.382201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c6f881a8-f3b1-4987-963f-06a29c880772 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:31.384546 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6f881a8-f3b1-4987-963f-06a29c880772 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1258 microversion: 2.25 time: 0.181181 Jul 26 14:05:31.389126 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 293/633] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:31 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:31.553949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da65486c-9162-4c17-825d-3b8364ce34f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:31.565386 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-da65486c-9162-4c17-825d-3b8364ce34f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1314 microversion: 2.1 time: 0.382496 Jul 26 14:05:31.566366 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 341/634] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:31 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:31.766780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-823f66ec-c47c-43b0-9a12-ba5eefaf3bae tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:31.767666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-823f66ec-c47c-43b0-9a12-ba5eefaf3bae tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:31.786535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-823f66ec-c47c-43b0-9a12-ba5eefaf3bae tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:31.788875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-823f66ec-c47c-43b0-9a12-ba5eefaf3bae tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:31.794289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-823f66ec-c47c-43b0-9a12-ba5eefaf3bae tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:31.795119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-823f66ec-c47c-43b0-9a12-ba5eefaf3bae tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:32.217504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-30630957-1ee9-40a4-8562-b787d08cc49b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:32.218129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-30630957-1ee9-40a4-8562-b787d08cc49b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:32.237051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30630957-1ee9-40a4-8562-b787d08cc49b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:32.237904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30630957-1ee9-40a4-8562-b787d08cc49b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:32.238885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30630957-1ee9-40a4-8562-b787d08cc49b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:32.240934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30630957-1ee9-40a4-8562-b787d08cc49b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:32.505641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-823f66ec-c47c-43b0-9a12-ba5eefaf3bae tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:32.515858 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-823f66ec-c47c-43b0-9a12-ba5eefaf3bae tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1475 microversion: 2.1 time: 0.781035 Jul 26 14:05:32.517292 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 294/635] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:31 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1475 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:32.531314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5200013e-67ff-4d72-b665-8a8c715514a9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:32.532404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5200013e-67ff-4d72-b665-8a8c715514a9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:32.539914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5200013e-67ff-4d72-b665-8a8c715514a9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:32.541135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5200013e-67ff-4d72-b665-8a8c715514a9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:32.542763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5200013e-67ff-4d72-b665-8a8c715514a9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:32.543603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5200013e-67ff-4d72-b665-8a8c715514a9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:32.715362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5200013e-67ff-4d72-b665-8a8c715514a9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:32.730173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5200013e-67ff-4d72-b665-8a8c715514a9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:32.737425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5200013e-67ff-4d72-b665-8a8c715514a9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:32.745925 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5200013e-67ff-4d72-b665-8a8c715514a9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1320 microversion: 2.25 time: 0.220364 Jul 26 14:05:32.760733 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 295/636] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:32 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:32.781430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-14cb86ae-6efb-4945-a046-afe84baaf100 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:32.782778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-14cb86ae-6efb-4945-a046-afe84baaf100 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:32.802516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14cb86ae-6efb-4945-a046-afe84baaf100 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:32.803485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14cb86ae-6efb-4945-a046-afe84baaf100 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:32.804552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14cb86ae-6efb-4945-a046-afe84baaf100 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:32.805514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14cb86ae-6efb-4945-a046-afe84baaf100 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:33.014250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-30630957-1ee9-40a4-8562-b787d08cc49b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:33.030383 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-30630957-1ee9-40a4-8562-b787d08cc49b tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1315 microversion: 2.1 time: 0.814233 Jul 26 14:05:33.044173 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 342/637] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:32 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1315 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:33.546797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ac07710-5f5d-496d-9e2d-e867d6279403 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:33.547720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5ac07710-5f5d-496d-9e2d-e867d6279403 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:33.569642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ac07710-5f5d-496d-9e2d-e867d6279403 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:33.571176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ac07710-5f5d-496d-9e2d-e867d6279403 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:33.575005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ac07710-5f5d-496d-9e2d-e867d6279403 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:33.575747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ac07710-5f5d-496d-9e2d-e867d6279403 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:33.616638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-14cb86ae-6efb-4945-a046-afe84baaf100 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:33.638795 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-14cb86ae-6efb-4945-a046-afe84baaf100 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1314 microversion: 2.1 time: 0.876332 Jul 26 14:05:33.640089 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 296/638] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:32 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:33.783360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cbea3ccc-fdff-43ca-afe9-cd3351e07890 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:33.785211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cbea3ccc-fdff-43ca-afe9-cd3351e07890 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:33.806795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbea3ccc-fdff-43ca-afe9-cd3351e07890 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:33.810363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbea3ccc-fdff-43ca-afe9-cd3351e07890 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:33.811212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbea3ccc-fdff-43ca-afe9-cd3351e07890 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:33.811647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbea3ccc-fdff-43ca-afe9-cd3351e07890 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:34.256042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cbea3ccc-fdff-43ca-afe9-cd3351e07890 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:34.292277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cbea3ccc-fdff-43ca-afe9-cd3351e07890 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:34.301901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cbea3ccc-fdff-43ca-afe9-cd3351e07890 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:34.309860 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cbea3ccc-fdff-43ca-afe9-cd3351e07890 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1320 microversion: 2.25 time: 0.527532 Jul 26 14:05:34.325749 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 297/639] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:33 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1320 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:34.426570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5ac07710-5f5d-496d-9e2d-e867d6279403 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:34.449265 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ac07710-5f5d-496d-9e2d-e867d6279403 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1474 microversion: 2.1 time: 0.908190 Jul 26 14:05:34.458622 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 343/640] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:33 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1474 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:34.480244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d8b27b21-34de-4d61-9004-6734eeecacd1 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:34.481817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d8b27b21-34de-4d61-9004-6734eeecacd1 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:34.503796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8b27b21-34de-4d61-9004-6734eeecacd1 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:34.504621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8b27b21-34de-4d61-9004-6734eeecacd1 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:34.505943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8b27b21-34de-4d61-9004-6734eeecacd1 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:34.506676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8b27b21-34de-4d61-9004-6734eeecacd1 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:34.808249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-37836785", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "2348f789-06f4-41a5-a965-401de2b37b0a"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:34.921662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] validate_networks() for [('2348f789-06f4-41a5-a965-401de2b37b0a', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:05:35.579677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d8b27b21-34de-4d61-9004-6734eeecacd1 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:35.598914 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d8b27b21-34de-4d61-9004-6734eeecacd1 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1315 microversion: 2.1 time: 1.138624 Jul 26 14:05:35.600238 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 344/641] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:34 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1315 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:35.605717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bba4f38c-7bca-4170-b177-a955d43e99bf tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:35.606600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bba4f38c-7bca-4170-b177-a955d43e99bf tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:35.615016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bba4f38c-7bca-4170-b177-a955d43e99bf tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:35.616066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bba4f38c-7bca-4170-b177-a955d43e99bf tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:35.617082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bba4f38c-7bca-4170-b177-a955d43e99bf tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:35.617747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bba4f38c-7bca-4170-b177-a955d43e99bf tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:36.011734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bba4f38c-7bca-4170-b177-a955d43e99bf tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:36.030239 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bba4f38c-7bca-4170-b177-a955d43e99bf tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1464 microversion: 2.1 time: 0.428677 Jul 26 14:05:36.033569 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 345/642] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:35 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1464 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:36.817948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a2fd147f-1a06-46c2-8313-6513eb757daa tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Action: 'create', calling method: .version_select at 0x7f87948f3790>, body: {"pool": null} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:37.439560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:05:37.440138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:05:37.440840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:05:37.441326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:05:37.442070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:05:37.481066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:37.482228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:37.483249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:37.483857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:37.540893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Getting quotas for project f3d21e6b315b4543993c1a1b7271f913. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:05:37.552176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Getting quotas for user 9f84bae10984463fbb5579005d7a0a7c and project f3d21e6b315b4543993c1a1b7271f913. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:05:37.572492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:05:37.574920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:05:37.642828 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3b9efbdc-f138-4582-81ab-36e4517e2b2f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.315682 Jul 26 14:05:37.644075 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 298/643] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:05:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:05:37.650567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9b1f5324-dfbf-4765-9716-0b666d05fedd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:37.652360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9b1f5324-dfbf-4765-9716-0b666d05fedd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:37.660592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b1f5324-dfbf-4765-9716-0b666d05fedd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:37.661639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b1f5324-dfbf-4765-9716-0b666d05fedd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:37.662792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b1f5324-dfbf-4765-9716-0b666d05fedd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:37.663405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b1f5324-dfbf-4765-9716-0b666d05fedd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:38.264773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9b1f5324-dfbf-4765-9716-0b666d05fedd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:38.278781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9b1f5324-dfbf-4765-9716-0b666d05fedd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:38.284964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9b1f5324-dfbf-4765-9716-0b666d05fedd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:38.288809 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9b1f5324-dfbf-4765-9716-0b666d05fedd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1362 microversion: 2.25 time: 0.641487 Jul 26 14:05:38.302682 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 299/644] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:37 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1362 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:38.307345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-993b5041-0c8c-47b1-8b4f-32d3b545c058 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:38.307345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-993b5041-0c8c-47b1-8b4f-32d3b545c058 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:38.349214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-993b5041-0c8c-47b1-8b4f-32d3b545c058 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:38.349685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-993b5041-0c8c-47b1-8b4f-32d3b545c058 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:38.354233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-993b5041-0c8c-47b1-8b4f-32d3b545c058 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:38.358045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-993b5041-0c8c-47b1-8b4f-32d3b545c058 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:38.784230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-993b5041-0c8c-47b1-8b4f-32d3b545c058 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:38.804505 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-993b5041-0c8c-47b1-8b4f-32d3b545c058 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1472 microversion: 2.1 time: 0.512053 Jul 26 14:05:38.805220 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 300/645] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:38 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1472 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:38.814226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-22ae42c5-b7b4-4a12-bcff-5015282de954 req-e0640523-76f1-4f6e-97fb-ce1d312c2649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d38d7d-c26a-45dc-8607-631c5a626f18", "name": "network-vif-plugged", "status": "completed", "tag": "6be56b4f-6dcf-45ba-8f89-cd0d73be2ceb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:38.828299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-22ae42c5-b7b4-4a12-bcff-5015282de954 req-e0640523-76f1-4f6e-97fb-ce1d312c2649 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:38.828712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-22ae42c5-b7b4-4a12-bcff-5015282de954 req-e0640523-76f1-4f6e-97fb-ce1d312c2649 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:38.849011 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-22ae42c5-b7b4-4a12-bcff-5015282de954 req-e0640523-76f1-4f6e-97fb-ce1d312c2649 service nova] Creating event network-vif-plugged:6be56b4f-6dcf-45ba-8f89-cd0d73be2ceb for instance 24d38d7d-c26a-45dc-8607-631c5a626f18 on n-h2-833090-9 Jul 26 14:05:38.861240 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-22ae42c5-b7b4-4a12-bcff-5015282de954 req-e0640523-76f1-4f6e-97fb-ce1d312c2649 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052307 Jul 26 14:05:38.862285 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 301/646] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:38.871624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b29ce2f3-95c8-4a2d-823c-9dc88c7906e5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:38.876937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b29ce2f3-95c8-4a2d-823c-9dc88c7906e5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:38.892764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b29ce2f3-95c8-4a2d-823c-9dc88c7906e5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:38.893654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b29ce2f3-95c8-4a2d-823c-9dc88c7906e5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:38.894932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b29ce2f3-95c8-4a2d-823c-9dc88c7906e5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:38.896227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b29ce2f3-95c8-4a2d-823c-9dc88c7906e5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:39.253093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b29ce2f3-95c8-4a2d-823c-9dc88c7906e5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:39.312716 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b29ce2f3-95c8-4a2d-823c-9dc88c7906e5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1464 microversion: 2.1 time: 0.443838 Jul 26 14:05:39.323986 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 302/647] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:38 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1464 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:39.348924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-16a50c26-e3dc-42b0-befc-f4f8b9b6ec66 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:39.357521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-16a50c26-e3dc-42b0-befc-f4f8b9b6ec66 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:39.368681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16a50c26-e3dc-42b0-befc-f4f8b9b6ec66 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:39.369441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16a50c26-e3dc-42b0-befc-f4f8b9b6ec66 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:39.370441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16a50c26-e3dc-42b0-befc-f4f8b9b6ec66 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:39.371332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16a50c26-e3dc-42b0-befc-f4f8b9b6ec66 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:39.625204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:40.191867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-16a50c26-e3dc-42b0-befc-f4f8b9b6ec66 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:40.226545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:40.250056 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-16a50c26-e3dc-42b0-befc-f4f8b9b6ec66 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1315 microversion: 2.1 time: 0.926667 Jul 26 14:05:40.250998 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 303/648] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:39 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1315 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:40.270766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1b5373f5-8980-4d5b-8924-fc35d656b682 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:40.279227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1b5373f5-8980-4d5b-8924-fc35d656b682 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:40.302491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b5373f5-8980-4d5b-8924-fc35d656b682 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:40.303070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b5373f5-8980-4d5b-8924-fc35d656b682 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:40.304146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b5373f5-8980-4d5b-8924-fc35d656b682 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:40.307638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b5373f5-8980-4d5b-8924-fc35d656b682 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:40.607217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1b5373f5-8980-4d5b-8924-fc35d656b682 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:40.636014 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1b5373f5-8980-4d5b-8924-fc35d656b682 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1282 microversion: 2.1 time: 0.380488 Jul 26 14:05:40.639650 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 304/649] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:40 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1282 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:41.069116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a1da5266-854c-4324-bb1c-988f53b06419 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:41.074050 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:41.074050 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:05:41.076556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1da5266-854c-4324-bb1c-988f53b06419 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:41.078636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1da5266-854c-4324-bb1c-988f53b06419 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:41.080721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1da5266-854c-4324-bb1c-988f53b06419 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:41.083007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1da5266-854c-4324-bb1c-988f53b06419 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:41.136396 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a1da5266-854c-4324-bb1c-988f53b06419 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.492954 Jul 26 14:05:41.137908 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 305/650] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:41.143915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-193e120d-b7e7-4fd0-96d6-7c7a4fd70c11 req-ab07cd32-552a-464a-98f3-3768b61d7a4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ff036a-5fa7-4b56-af8a-afd163f7c3b5", "tag": "191708b4-b957-42c3-a0aa-284ad81e99c7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:41.156829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-193e120d-b7e7-4fd0-96d6-7c7a4fd70c11 req-ab07cd32-552a-464a-98f3-3768b61d7a4c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:41.157557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-193e120d-b7e7-4fd0-96d6-7c7a4fd70c11 req-ab07cd32-552a-464a-98f3-3768b61d7a4c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:41.167443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=48,nova_cell0:UPDATE=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:41.201077 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-193e120d-b7e7-4fd0-96d6-7c7a4fd70c11 req-ab07cd32-552a-464a-98f3-3768b61d7a4c service nova] Creating event network-changed:191708b4-b957-42c3-a0aa-284ad81e99c7 for instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 on n-h1-833090-9 Jul 26 14:05:41.217371 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-193e120d-b7e7-4fd0-96d6-7c7a4fd70c11 req-ab07cd32-552a-464a-98f3-3768b61d7a4c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077699 Jul 26 14:05:41.218008 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 306/651] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:41.240163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dbaa1424-6d4a-445e-9f45-d8a0faa3236a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:41.241595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dbaa1424-6d4a-445e-9f45-d8a0faa3236a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:41.256986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbaa1424-6d4a-445e-9f45-d8a0faa3236a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:41.258843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbaa1424-6d4a-445e-9f45-d8a0faa3236a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:41.262128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbaa1424-6d4a-445e-9f45-d8a0faa3236a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:41.264830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbaa1424-6d4a-445e-9f45-d8a0faa3236a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:41.685660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dbaa1424-6d4a-445e-9f45-d8a0faa3236a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:41.703517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dbaa1424-6d4a-445e-9f45-d8a0faa3236a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:41.706799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dbaa1424-6d4a-445e-9f45-d8a0faa3236a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:41.708252 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dbaa1424-6d4a-445e-9f45-d8a0faa3236a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1362 microversion: 2.25 time: 0.485258 Jul 26 14:05:41.708975 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 307/652] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:41 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:41.724064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1129254143", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6bf4359c-96f3-43bf-aea5-1cb4685a4493"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:41.809706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:05:42.123037 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a2fd147f-1a06-46c2-8313-6513eb757daa tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.088109 Jul 26 14:05:42.123632 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 346/653] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:05:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:42.133197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-38774152-a35d-4558-9418-30889f0ac903 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:42.134224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-38774152-a35d-4558-9418-30889f0ac903 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:42.177134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38774152-a35d-4558-9418-30889f0ac903 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.179211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38774152-a35d-4558-9418-30889f0ac903 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:42.185023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38774152-a35d-4558-9418-30889f0ac903 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.187183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38774152-a35d-4558-9418-30889f0ac903 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:42.543267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:05:42.545135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:05:42.546206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:05:42.547068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:05:42.547734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:05:42.557633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:42.566810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-38774152-a35d-4558-9418-30889f0ac903 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:42.575988 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-38774152-a35d-4558-9418-30889f0ac903 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1469 microversion: 2.1 time: 0.450929 Jul 26 14:05:42.576783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.577421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:42.578402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.579154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:42.580927 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 347/654] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:42 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1469 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:42.588517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b302267f-bd22-49f3-94f1-19428608ab58 req-c3362f97-de85-4581-be87-1181417034d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9a10de-f7c8-4e73-8803-471376cb000a", "name": "network-vif-unplugged", "status": "completed", "tag": "6728d156-9e70-4308-aeaa-e54d42714d76"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:42.607807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b302267f-bd22-49f3-94f1-19428608ab58 req-c3362f97-de85-4581-be87-1181417034d5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.608761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b302267f-bd22-49f3-94f1-19428608ab58 req-c3362f97-de85-4581-be87-1181417034d5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:42.623079 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b302267f-bd22-49f3-94f1-19428608ab58 req-c3362f97-de85-4581-be87-1181417034d5 service nova] Creating event network-vif-unplugged:6728d156-9e70-4308-aeaa-e54d42714d76 for instance af9a10de-f7c8-4e73-8803-471376cb000a on n-h2-833090-9 Jul 26 14:05:42.623324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Getting quotas for project 8e90b10ccea94aa292a1c993c6d4424c. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:05:42.634112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Getting quotas for user 7de821a9c74948e5a98e667c24606af9 and project 8e90b10ccea94aa292a1c993c6d4424c. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:05:42.648576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-b302267f-bd22-49f3-94f1-19428608ab58 req-c3362f97-de85-4581-be87-1181417034d5 service nova] Instance af9a10de-f7c8-4e73-8803-471376cb000a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:05:42.657582 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b302267f-bd22-49f3-94f1-19428608ab58 req-c3362f97-de85-4581-be87-1181417034d5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075187 Jul 26 14:05:42.661835 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 348/655] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:42.668902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95e2aac3-7703-466c-8208-b4f4e60aef57 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:42.671798 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:42.671798 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:05:42.672057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:05:42.673648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e2aac3-7703-466c-8208-b4f4e60aef57 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.674288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e2aac3-7703-466c-8208-b4f4e60aef57 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:42.675292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e2aac3-7703-466c-8208-b4f4e60aef57 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.675917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e2aac3-7703-466c-8208-b4f4e60aef57 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:42.683550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:05:42.717427 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95e2aac3-7703-466c-8208-b4f4e60aef57 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.053803 Jul 26 14:05:42.719284 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 349/656] 10.222.0.70 () {58 vars in 1170 bytes} [Tue Jul 26 14:05:42 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:42.734074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-150c2791-02e0-4b7b-a763-6dec8d309db3 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:42.735489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-150c2791-02e0-4b7b-a763-6dec8d309db3 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:42.747802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-150c2791-02e0-4b7b-a763-6dec8d309db3 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.748989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-150c2791-02e0-4b7b-a763-6dec8d309db3 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:42.750864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-150c2791-02e0-4b7b-a763-6dec8d309db3 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.751651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-150c2791-02e0-4b7b-a763-6dec8d309db3 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:42.800152 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-99550979-f838-4c04-8a43-5579184c91b4 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.088990 Jul 26 14:05:42.803125 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 308/657] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:05:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:05:42.818603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-649fe681-5717-483f-b1fa-b616fe73d654 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:42.820038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-649fe681-5717-483f-b1fa-b616fe73d654 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:42.841888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-649fe681-5717-483f-b1fa-b616fe73d654 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.842510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-649fe681-5717-483f-b1fa-b616fe73d654 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:42.843306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-649fe681-5717-483f-b1fa-b616fe73d654 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:42.843744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-649fe681-5717-483f-b1fa-b616fe73d654 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:43.235010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-649fe681-5717-483f-b1fa-b616fe73d654 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:43.252489 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-649fe681-5717-483f-b1fa-b616fe73d654 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1322 microversion: 2.1 time: 0.447639 Jul 26 14:05:43.253936 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 309/658] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:42 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1322 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:43.281824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cec7abd6-41d2-4af8-bfb2-7727beb484af tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Action: 'create', calling method: .version_select at 0x7f87944953a0>, body: {"pool": null} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:43.338701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-150c2791-02e0-4b7b-a763-6dec8d309db3 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:43.354584 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-150c2791-02e0-4b7b-a763-6dec8d309db3 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1504 microversion: 2.1 time: 0.625734 Jul 26 14:05:43.356837 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 350/659] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:42 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1504 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:43.367928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-26725f35-b325-4e9b-9ab0-19e2d34782a9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:43.368508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-26725f35-b325-4e9b-9ab0-19e2d34782a9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:43.386119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26725f35-b325-4e9b-9ab0-19e2d34782a9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:43.387696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26725f35-b325-4e9b-9ab0-19e2d34782a9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:43.392219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26725f35-b325-4e9b-9ab0-19e2d34782a9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:43.395447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26725f35-b325-4e9b-9ab0-19e2d34782a9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:43.570072 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-26725f35-b325-4e9b-9ab0-19e2d34782a9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a/action" status: 204 len: 0 microversion: 2.1 time: 0.211377 Jul 26 14:05:43.571662 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 351/660] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:05:43 2022] POST /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a/action => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:05:43.584528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ee93dcf-9701-4960-ade5-2bba586f1e3b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:43.585759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ee93dcf-9701-4960-ade5-2bba586f1e3b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:43.610949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ee93dcf-9701-4960-ade5-2bba586f1e3b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:43.612066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ee93dcf-9701-4960-ade5-2bba586f1e3b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:43.613808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ee93dcf-9701-4960-ade5-2bba586f1e3b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:43.621517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ee93dcf-9701-4960-ade5-2bba586f1e3b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:44.710782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7ee93dcf-9701-4960-ade5-2bba586f1e3b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:44.735324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7ee93dcf-9701-4960-ade5-2bba586f1e3b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:44.736776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7ee93dcf-9701-4960-ade5-2bba586f1e3b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:44.738210 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ee93dcf-9701-4960-ade5-2bba586f1e3b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1362 microversion: 2.25 time: 1.163605 Jul 26 14:05:44.738990 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 352/661] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:43 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1362 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:44.743870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29f9df3d-9691-4467-82bf-c681afda5fde tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:44.746549 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:44.746549 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:05:44.748408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29f9df3d-9691-4467-82bf-c681afda5fde tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:44.749536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29f9df3d-9691-4467-82bf-c681afda5fde tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:44.751075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29f9df3d-9691-4467-82bf-c681afda5fde tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:44.751877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29f9df3d-9691-4467-82bf-c681afda5fde tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:44.782449 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-29f9df3d-9691-4467-82bf-c681afda5fde tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.042145 Jul 26 14:05:44.783774 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 353/662] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:44.788483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43f47a58-dec8-4fe0-a4c8-183de8602d9f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:44.789337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-43f47a58-dec8-4fe0-a4c8-183de8602d9f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:44.812139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43f47a58-dec8-4fe0-a4c8-183de8602d9f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:44.812989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43f47a58-dec8-4fe0-a4c8-183de8602d9f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:44.814426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43f47a58-dec8-4fe0-a4c8-183de8602d9f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:44.815217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43f47a58-dec8-4fe0-a4c8-183de8602d9f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:45.013543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43f47a58-dec8-4fe0-a4c8-183de8602d9f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:45.021647 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43f47a58-dec8-4fe0-a4c8-183de8602d9f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 200 len: 1266 microversion: 2.1 time: 0.236633 Jul 26 14:05:45.022266 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 354/663] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:44 2022] GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:45.028936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ef86a0ba-7c9c-413c-b3a6-1baffd9eba47 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:45.029463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef86a0ba-7c9c-413c-b3a6-1baffd9eba47 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:45.036279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef86a0ba-7c9c-413c-b3a6-1baffd9eba47 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:45.036979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef86a0ba-7c9c-413c-b3a6-1baffd9eba47 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:45.037755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef86a0ba-7c9c-413c-b3a6-1baffd9eba47 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:45.038189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef86a0ba-7c9c-413c-b3a6-1baffd9eba47 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:45.041644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:45.080378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef86a0ba-7c9c-413c-b3a6-1baffd9eba47 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:05:45.172718 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ef86a0ba-7c9c-413c-b3a6-1baffd9eba47 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 204 len: 0 microversion: 2.1 time: 0.148818 Jul 26 14:05:45.173900 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 355/664] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:05:45 2022] DELETE /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:05:45.181670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-47fa8378-c483-4394-a3cd-e4f9ec3cb929 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:45.183108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47fa8378-c483-4394-a3cd-e4f9ec3cb929 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:45.190157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47fa8378-c483-4394-a3cd-e4f9ec3cb929 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:45.190609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47fa8378-c483-4394-a3cd-e4f9ec3cb929 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:45.191402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47fa8378-c483-4394-a3cd-e4f9ec3cb929 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:45.191866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47fa8378-c483-4394-a3cd-e4f9ec3cb929 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:45.567112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47fa8378-c483-4394-a3cd-e4f9ec3cb929 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:45.583628 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-47fa8378-c483-4394-a3cd-e4f9ec3cb929 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1469 microversion: 2.1 time: 0.408327 Jul 26 14:05:45.584467 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 356/665] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:45 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1469 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:45.594159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-25fecc49-6552-4d92-856c-61946cf2cb65 req-5bed9c98-b479-434f-82f2-94f24ce8e53e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96760807-513a-459f-b4b4-1cf897885ed6", "tag": "55a71149-6922-4955-9d24-b7427e70e88b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:45.609979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-25fecc49-6552-4d92-856c-61946cf2cb65 req-5bed9c98-b479-434f-82f2-94f24ce8e53e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:45.609979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-25fecc49-6552-4d92-856c-61946cf2cb65 req-5bed9c98-b479-434f-82f2-94f24ce8e53e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:45.623065 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-25fecc49-6552-4d92-856c-61946cf2cb65 req-5bed9c98-b479-434f-82f2-94f24ce8e53e service nova] Creating event network-changed:55a71149-6922-4955-9d24-b7427e70e88b for instance 96760807-513a-459f-b4b4-1cf897885ed6 on n-h2-833090-9 Jul 26 14:05:45.636757 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-25fecc49-6552-4d92-856c-61946cf2cb65 req-5bed9c98-b479-434f-82f2-94f24ce8e53e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050562 Jul 26 14:05:45.639749 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 357/666] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:45.650834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6478c4bc-6374-48b7-ab91-2060e2aa3324 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:45.651643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6478c4bc-6374-48b7-ab91-2060e2aa3324 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:45.658677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6478c4bc-6374-48b7-ab91-2060e2aa3324 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:45.659251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6478c4bc-6374-48b7-ab91-2060e2aa3324 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:45.660148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6478c4bc-6374-48b7-ab91-2060e2aa3324 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:45.660674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6478c4bc-6374-48b7-ab91-2060e2aa3324 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:45.945533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6478c4bc-6374-48b7-ab91-2060e2aa3324 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:45.963848 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6478c4bc-6374-48b7-ab91-2060e2aa3324 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1322 microversion: 2.1 time: 0.317947 Jul 26 14:05:45.966354 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 358/667] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:45 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:45.982013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4c57a100-120c-49b5-96ce-6367e772f1df req-b20a922d-d32c-4f10-8c14-10f120715626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9a10de-f7c8-4e73-8803-471376cb000a", "name": "network-vif-plugged", "status": "completed", "tag": "6728d156-9e70-4308-aeaa-e54d42714d76"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:46.009352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4c57a100-120c-49b5-96ce-6367e772f1df req-b20a922d-d32c-4f10-8c14-10f120715626 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:46.016595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4c57a100-120c-49b5-96ce-6367e772f1df req-b20a922d-d32c-4f10-8c14-10f120715626 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:46.060561 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4c57a100-120c-49b5-96ce-6367e772f1df req-b20a922d-d32c-4f10-8c14-10f120715626 service nova] Creating event network-vif-plugged:6728d156-9e70-4308-aeaa-e54d42714d76 for instance af9a10de-f7c8-4e73-8803-471376cb000a on n-h2-833090-9 Jul 26 14:05:46.078111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-4c57a100-120c-49b5-96ce-6367e772f1df req-b20a922d-d32c-4f10-8c14-10f120715626 service nova] Instance af9a10de-f7c8-4e73-8803-471376cb000a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:05:46.095151 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4c57a100-120c-49b5-96ce-6367e772f1df req-b20a922d-d32c-4f10-8c14-10f120715626 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127095 Jul 26 14:05:46.095758 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 359/668] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:46.102446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-07ad7a24-d2b3-4134-bc6c-1af21e97f09f tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:46.106776 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:46.106776 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:05:46.108973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07ad7a24-d2b3-4134-bc6c-1af21e97f09f tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:46.109617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07ad7a24-d2b3-4134-bc6c-1af21e97f09f tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:46.110875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07ad7a24-d2b3-4134-bc6c-1af21e97f09f tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:46.111493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07ad7a24-d2b3-4134-bc6c-1af21e97f09f tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:46.159300 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-07ad7a24-d2b3-4134-bc6c-1af21e97f09f tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-833090-9&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.061509 Jul 26 14:05:46.160539 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 360/669] 10.222.0.70 () {58 vars in 1194 bytes} [Tue Jul 26 14:05:46 2022] GET /compute/v2.1/os-services?host=n-d-833090-9&binary=xxx => generated 16 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:05:46.167241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ad41e2b-10df-4e9d-a823-f969f1e921a4 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:46.168182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2ad41e2b-10df-4e9d-a823-f969f1e921a4 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:46.172530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=16 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:46.179806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ad41e2b-10df-4e9d-a823-f969f1e921a4 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:46.181196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ad41e2b-10df-4e9d-a823-f969f1e921a4 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:46.182598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ad41e2b-10df-4e9d-a823-f969f1e921a4 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:46.183163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ad41e2b-10df-4e9d-a823-f969f1e921a4 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:46.841856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2ad41e2b-10df-4e9d-a823-f969f1e921a4 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:46.850317 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ad41e2b-10df-4e9d-a823-f969f1e921a4 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1510 microversion: 2.1 time: 0.688541 Jul 26 14:05:46.864941 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 361/670] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:46 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1510 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:46.879126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6a0afa7d-c3b8-4f4f-a7eb-0b853895aa70 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:46.879770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6a0afa7d-c3b8-4f4f-a7eb-0b853895aa70 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:46.894511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a0afa7d-c3b8-4f4f-a7eb-0b853895aa70 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:46.894990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a0afa7d-c3b8-4f4f-a7eb-0b853895aa70 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:46.896216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a0afa7d-c3b8-4f4f-a7eb-0b853895aa70 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:46.896877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a0afa7d-c3b8-4f4f-a7eb-0b853895aa70 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:47.267727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6a0afa7d-c3b8-4f4f-a7eb-0b853895aa70 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:47.289921 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cec7abd6-41d2-4af8-bfb2-7727beb484af tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.032988 Jul 26 14:05:47.291088 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 310/671] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:05:43 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:47.299430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6a0afa7d-c3b8-4f4f-a7eb-0b853895aa70 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:47.306242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0ab9638c-d399-4b32-826e-5bb00fdf5221 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:47.308774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6a0afa7d-c3b8-4f4f-a7eb-0b853895aa70 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:47.311077 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6a0afa7d-c3b8-4f4f-a7eb-0b853895aa70 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1362 microversion: 2.25 time: 0.444591 Jul 26 14:05:47.311339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0ab9638c-d399-4b32-826e-5bb00fdf5221 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:47.313227 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 362/672] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:46 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1362 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:47.323506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ab9638c-d399-4b32-826e-5bb00fdf5221 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:47.324195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ab9638c-d399-4b32-826e-5bb00fdf5221 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:47.325950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ab9638c-d399-4b32-826e-5bb00fdf5221 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:47.326479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ab9638c-d399-4b32-826e-5bb00fdf5221 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:47.327296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fb74d7a5-5f78-4eef-a637-08efafdade31 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:47.335035 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:47.335035 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:05:47.338322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb74d7a5-5f78-4eef-a637-08efafdade31 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:47.339239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb74d7a5-5f78-4eef-a637-08efafdade31 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:47.340782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb74d7a5-5f78-4eef-a637-08efafdade31 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:47.341739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb74d7a5-5f78-4eef-a637-08efafdade31 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:47.384929 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fb74d7a5-5f78-4eef-a637-08efafdade31 tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.069477 Jul 26 14:05:47.386436 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 363/673] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:47 2022] GET /compute/v2.1/os-services => generated 944 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:47.393985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3cdbc1fc-43f9-433e-96d4-5a3f8c166984 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:47.394901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3cdbc1fc-43f9-433e-96d4-5a3f8c166984 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:47.411562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cdbc1fc-43f9-433e-96d4-5a3f8c166984 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:47.412369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cdbc1fc-43f9-433e-96d4-5a3f8c166984 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:47.413826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cdbc1fc-43f9-433e-96d4-5a3f8c166984 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:47.414898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cdbc1fc-43f9-433e-96d4-5a3f8c166984 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:47.675424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0ab9638c-d399-4b32-826e-5bb00fdf5221 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:47.707930 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0ab9638c-d399-4b32-826e-5bb00fdf5221 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 200 len: 1314 microversion: 2.1 time: 0.414178 Jul 26 14:05:47.709001 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 311/674] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:47 2022] GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:47.736198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7a227851-2928-477c-af85-e18a2313929d tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:47.737663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7a227851-2928-477c-af85-e18a2313929d tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:47.755155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3cdbc1fc-43f9-433e-96d4-5a3f8c166984 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:47.773938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a227851-2928-477c-af85-e18a2313929d tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:47.780409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a227851-2928-477c-af85-e18a2313929d tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:47.783375 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3cdbc1fc-43f9-433e-96d4-5a3f8c166984 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1469 microversion: 2.1 time: 0.395030 Jul 26 14:05:47.784837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a227851-2928-477c-af85-e18a2313929d tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:47.785812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a227851-2928-477c-af85-e18a2313929d tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:47.808125 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 364/675] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:47 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1469 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:47.821683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5214888f-799a-489f-a740-b0990ea1c0f8 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Action: 'create', calling method: .version_select at 0x7f87946d84c0>, body: {"pool": null} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:48.554215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7a227851-2928-477c-af85-e18a2313929d tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:48.564416 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7a227851-2928-477c-af85-e18a2313929d tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1322 microversion: 2.1 time: 0.848075 Jul 26 14:05:48.567125 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 312/676] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:47 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1322 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:48.584897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-74695c91-0796-4a20-9de3-5bb623b5da0c tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:48.594252 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:48.594252 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:05:48.596468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74695c91-0796-4a20-9de3-5bb623b5da0c tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:48.597906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74695c91-0796-4a20-9de3-5bb623b5da0c tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:48.599164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74695c91-0796-4a20-9de3-5bb623b5da0c tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:48.599941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74695c91-0796-4a20-9de3-5bb623b5da0c tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:48.638645 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-74695c91-0796-4a20-9de3-5bb623b5da0c tempest-ServicesAdminNegativeTestJSON-1759989645 tempest-ServicesAdminNegativeTestJSON-1759989645-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.070046 Jul 26 14:05:48.640456 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 313/677] 10.222.0.70 () {58 vars in 1198 bytes} [Tue Jul 26 14:05:48 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:05:48.646416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-30418785-3676-4302-8c86-b77ced3893e5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:48.647499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-30418785-3676-4302-8c86-b77ced3893e5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:48.661428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30418785-3676-4302-8c86-b77ced3893e5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:48.662343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30418785-3676-4302-8c86-b77ced3893e5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:48.663802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30418785-3676-4302-8c86-b77ced3893e5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:48.664433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30418785-3676-4302-8c86-b77ced3893e5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:48.708192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-30418785-3676-4302-8c86-b77ced3893e5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:05:48.872804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-30418785-3676-4302-8c86-b77ced3893e5 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 204 len: 0 microversion: 2.1 time: 0.230394 Jul 26 14:05:48.873952 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 314/678] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:05:48 2022] DELETE /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:05:48.888431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8c938a05-f4d6-440a-b7b8-ae606252addc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:48.889229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8c938a05-f4d6-440a-b7b8-ae606252addc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:48.896800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c938a05-f4d6-440a-b7b8-ae606252addc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:48.897261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c938a05-f4d6-440a-b7b8-ae606252addc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:48.899679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c938a05-f4d6-440a-b7b8-ae606252addc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:48.900452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c938a05-f4d6-440a-b7b8-ae606252addc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:49.249003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8c938a05-f4d6-440a-b7b8-ae606252addc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b200c9a691499d8a2e56d607fdc29f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40c093b8d104424886d49b50d824ffd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:49.261093 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8c938a05-f4d6-440a-b7b8-ae606252addc tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 200 len: 1510 microversion: 2.1 time: 0.385565 Jul 26 14:05:49.261713 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 315/679] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:48 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:49.266983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4b6d4eb4-c0ac-4da6-9517-3014035c8fa7 req-2a0100b0-8f19-4d2d-adeb-106c9256e498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6317e9-619d-4230-b5c8-58452de314b9", "tag": "0ec18604-bd18-435d-8f2e-dac83bd6066b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:49.286448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4b6d4eb4-c0ac-4da6-9517-3014035c8fa7 req-2a0100b0-8f19-4d2d-adeb-106c9256e498 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:49.287181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4b6d4eb4-c0ac-4da6-9517-3014035c8fa7 req-2a0100b0-8f19-4d2d-adeb-106c9256e498 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:49.322713 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4b6d4eb4-c0ac-4da6-9517-3014035c8fa7 req-2a0100b0-8f19-4d2d-adeb-106c9256e498 service nova] Creating event network-changed:0ec18604-bd18-435d-8f2e-dac83bd6066b for instance 4d6317e9-619d-4230-b5c8-58452de314b9 on n-h1-833090-9 Jul 26 14:05:49.328186 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4b6d4eb4-c0ac-4da6-9517-3014035c8fa7 req-2a0100b0-8f19-4d2d-adeb-106c9256e498 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064969 Jul 26 14:05:49.329975 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 316/680] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:49.341023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a8ea1fcd-9039-43aa-a157-6e749e9f1e13 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:49.342486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a8ea1fcd-9039-43aa-a157-6e749e9f1e13 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:49.351621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a8ea1fcd-9039-43aa-a157-6e749e9f1e13 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:49.352898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a8ea1fcd-9039-43aa-a157-6e749e9f1e13 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:49.353867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a8ea1fcd-9039-43aa-a157-6e749e9f1e13 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:49.354312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a8ea1fcd-9039-43aa-a157-6e749e9f1e13 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:49.688381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a8ea1fcd-9039-43aa-a157-6e749e9f1e13 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:49.703883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a8ea1fcd-9039-43aa-a157-6e749e9f1e13 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:49.705796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a8ea1fcd-9039-43aa-a157-6e749e9f1e13 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:49.707533 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a8ea1fcd-9039-43aa-a157-6e749e9f1e13 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1362 microversion: 2.25 time: 0.375507 Jul 26 14:05:49.724952 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 317/681] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:49 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:49.903791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-98c64ae9-36bf-4059-8d33-b9bd1de792d6 tempest-ServicesAdminNegativeTestJSON-127118663 tempest-ServicesAdminNegativeTestJSON-127118663-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:49.907673 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:49.907673 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:05:49.909020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-98c64ae9-36bf-4059-8d33-b9bd1de792d6 tempest-ServicesAdminNegativeTestJSON-127118663 tempest-ServicesAdminNegativeTestJSON-127118663-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b4e83c13772f4db8bf9e55a8415c0fb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073d0d8d719a4a3bb12352da5dc611f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-98c64ae9-36bf-4059-8d33-b9bd1de792d6 tempest-ServicesAdminNegativeTestJSON-127118663 tempest-ServicesAdminNegativeTestJSON-127118663-project] Request method failure captured: Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_SxtarB5KAyWrBx6spAsXXoXB2CkY_UPo-1pgX-zbBvLXDzKPQOnLBMVEa8iHpcJymPtKpzDn6fbWMFXWXPvhs8iBPh79YUwOOaXTHJ9p_wCQSm8eapfX2vvjjduGHNBFt22Mg8yr5_3oZnkc4ka-cINUG64qYMird0g7smPoTViyw Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 073d0d8d719a4a3bb12352da5dc611f5 Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-127118663 Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:49.911444 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/073d0d8d719a4a3bb12352da5dc611f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/073d0d8d719a4a3bb12352da5dc611f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_073d0d8d719a4a3bb12352da5dc611f5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/073d0d8d719a4a3bb12352da5dc611f5"}]}] Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-127118663 Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 073d0d8d719a4a3bb12352da5dc611f5 Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-127118663 Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServicesAdminNegativeTestJSON-127118663-project Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b4e83c13772f4db8bf9e55a8415c0fb9 Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-127118663-project Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 14:05:49.913151 n-d-833090-9 devstack@n-api.service[119478]: action_args: {} Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:05:49.914046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 14:05:49.917359 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:49.920286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-98c64ae9-36bf-4059-8d33-b9bd1de792d6 tempest-ServicesAdminNegativeTestJSON-127118663 tempest-ServicesAdminNegativeTestJSON-127118663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:49.920286 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-98c64ae9-36bf-4059-8d33-b9bd1de792d6 tempest-ServicesAdminNegativeTestJSON-127118663 tempest-ServicesAdminNegativeTestJSON-127118663-project] 10.222.0.70 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.186735 Jul 26 14:05:49.920286 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 318/682] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:05:49 2022] GET /compute/v2.1/os-services => generated 112 bytes in 188 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:49.924915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4bf08fbf-f74d-42b1-b68b-0cd9cbc278bd req-599136fa-e200-40b2-87bd-b21dafdc603e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ff036a-5fa7-4b56-af8a-afd163f7c3b5", "name": "network-vif-plugged", "status": "completed", "tag": "191708b4-b957-42c3-a0aa-284ad81e99c7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:49.939046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4bf08fbf-f74d-42b1-b68b-0cd9cbc278bd req-599136fa-e200-40b2-87bd-b21dafdc603e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:49.939812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4bf08fbf-f74d-42b1-b68b-0cd9cbc278bd req-599136fa-e200-40b2-87bd-b21dafdc603e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:49.958273 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4bf08fbf-f74d-42b1-b68b-0cd9cbc278bd req-599136fa-e200-40b2-87bd-b21dafdc603e service nova] Creating event network-vif-plugged:191708b4-b957-42c3-a0aa-284ad81e99c7 for instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 on n-h1-833090-9 Jul 26 14:05:49.973353 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4bf08fbf-f74d-42b1-b68b-0cd9cbc278bd req-599136fa-e200-40b2-87bd-b21dafdc603e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047156 Jul 26 14:05:49.976958 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 319/683] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:49.987693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-92e609d7-c191-42d9-9c9c-43077c846867 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:49.993100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-92e609d7-c191-42d9-9c9c-43077c846867 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:50.007872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92e609d7-c191-42d9-9c9c-43077c846867 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:50.008911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92e609d7-c191-42d9-9c9c-43077c846867 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:50.009727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92e609d7-c191-42d9-9c9c-43077c846867 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:50.010175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92e609d7-c191-42d9-9c9c-43077c846867 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:50.362717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-92e609d7-c191-42d9-9c9c-43077c846867 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:50.374762 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-92e609d7-c191-42d9-9c9c-43077c846867 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 200 len: 1314 microversion: 2.1 time: 0.396228 Jul 26 14:05:50.375644 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 320/684] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:49 2022] GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:50.396483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-df3dd7c2-9a55-4303-b530-b3c1684403bf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:50.397375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-df3dd7c2-9a55-4303-b530-b3c1684403bf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:50.417389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df3dd7c2-9a55-4303-b530-b3c1684403bf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:50.417930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df3dd7c2-9a55-4303-b530-b3c1684403bf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:50.419176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df3dd7c2-9a55-4303-b530-b3c1684403bf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:50.423788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df3dd7c2-9a55-4303-b530-b3c1684403bf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:50.777776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-df3dd7c2-9a55-4303-b530-b3c1684403bf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:50.793990 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-df3dd7c2-9a55-4303-b530-b3c1684403bf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1461 microversion: 2.1 time: 0.403979 Jul 26 14:05:50.808942 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 321/685] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:50 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1461 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:50.826200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-62de7519-5a50-4bc7-925a-7eefc20842db tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:50.827261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-62de7519-5a50-4bc7-925a-7eefc20842db tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:50.840686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62de7519-5a50-4bc7-925a-7eefc20842db tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:50.841573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62de7519-5a50-4bc7-925a-7eefc20842db tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:50.843146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62de7519-5a50-4bc7-925a-7eefc20842db tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:50.844079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62de7519-5a50-4bc7-925a-7eefc20842db tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:50.856454 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5214888f-799a-489f-a740-b0990ea1c0f8 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.047065 Jul 26 14:05:50.857552 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 365/686] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:05:47 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:50.864010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0f7eebb6-80c3-4418-8089-08a32c2198fb tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:50.865155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0f7eebb6-80c3-4418-8089-08a32c2198fb tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:50.875572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f7eebb6-80c3-4418-8089-08a32c2198fb tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:50.879655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f7eebb6-80c3-4418-8089-08a32c2198fb tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:50.881774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f7eebb6-80c3-4418-8089-08a32c2198fb tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:50.882829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f7eebb6-80c3-4418-8089-08a32c2198fb tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.270428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-62de7519-5a50-4bc7-925a-7eefc20842db tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:51.286558 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-62de7519-5a50-4bc7-925a-7eefc20842db tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1713 microversion: 2.1 time: 0.476079 Jul 26 14:05:51.287874 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 322/687] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:50 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1713 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:51.294821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b517915c-66c6-47bd-8d80-17b3a3ed7fe2 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:51.295705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b517915c-66c6-47bd-8d80-17b3a3ed7fe2 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:51.303272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b517915c-66c6-47bd-8d80-17b3a3ed7fe2 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.304014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b517915c-66c6-47bd-8d80-17b3a3ed7fe2 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.304995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0f7eebb6-80c3-4418-8089-08a32c2198fb tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:51.305179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b517915c-66c6-47bd-8d80-17b3a3ed7fe2 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.306260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b517915c-66c6-47bd-8d80-17b3a3ed7fe2 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.317631 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0f7eebb6-80c3-4418-8089-08a32c2198fb tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1322 microversion: 2.1 time: 0.458648 Jul 26 14:05:51.319699 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 366/688] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:50 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:51.322236 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b517915c-66c6-47bd-8d80-17b3a3ed7fe2 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] HTTP exception thrown: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b517915c-66c6-47bd-8d80-17b3a3ed7fe2 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Request method failure captured: Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 HTTP/1.1 Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_SYlyhgwedVdC1Mdeeh9-idhXVPl36lvQT5vHYrwufe87EHV1vkba-rJ3vV9Mt6gtm-LopGu0B4DMSqmda5iwXQ8_hF9TOpj4Ic9HfHQj65-fL3uh80TP1M-3STXpX6ZhWwF5BBNglME87YabPsKcWy9AoAPu83rg48nVmI-Vp9FHk Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:51.324337 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40c093b8d104424886d49b50d824ffd5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}] Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: a4b200c9a691499d8a2e56d607fdc29f Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:51.326320 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '24d38d7d-c26a-45dc-8607-631c5a626f18'} Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:51.327129 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:51.328392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:51.331226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b517915c-66c6-47bd-8d80-17b3a3ed7fe2 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Returning 404 to user: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:51.332792 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b517915c-66c6-47bd-8d80-17b3a3ed7fe2 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 404 len: 111 microversion: 2.1 time: 0.043405 Jul 26 14:05:51.334159 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 323/689] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:51 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:51.342562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-78b8a246-2d6f-4fdf-9d8c-882734188e3e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:51.344215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-78b8a246-2d6f-4fdf-9d8c-882734188e3e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:51.345959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-465b009b-d6df-4870-9edc-511c9039fff3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:51.347503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-465b009b-d6df-4870-9edc-511c9039fff3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:51.358851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78b8a246-2d6f-4fdf-9d8c-882734188e3e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.359606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78b8a246-2d6f-4fdf-9d8c-882734188e3e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.360723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78b8a246-2d6f-4fdf-9d8c-882734188e3e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.361631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78b8a246-2d6f-4fdf-9d8c-882734188e3e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.368326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-465b009b-d6df-4870-9edc-511c9039fff3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.372329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-465b009b-d6df-4870-9edc-511c9039fff3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.373885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-465b009b-d6df-4870-9edc-511c9039fff3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.374929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-465b009b-d6df-4870-9edc-511c9039fff3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.848633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-78b8a246-2d6f-4fdf-9d8c-882734188e3e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:51.857647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-465b009b-d6df-4870-9edc-511c9039fff3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:51.859206 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-78b8a246-2d6f-4fdf-9d8c-882734188e3e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1461 microversion: 2.1 time: 0.523275 Jul 26 14:05:51.860304 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 324/690] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:51 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1461 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:51.873427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-465b009b-d6df-4870-9edc-511c9039fff3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:51.875346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-465b009b-d6df-4870-9edc-511c9039fff3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:51.876858 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-465b009b-d6df-4870-9edc-511c9039fff3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1362 microversion: 2.25 time: 0.555806 Jul 26 14:05:51.877412 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 367/691] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:51 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1362 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:51.888194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0356a200-d026-4348-820e-2d56d42c1269 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Action: 'create', calling method: .version_select at 0x7f87943e88b0>, body: {"pool": null} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:51.893516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-80349138-069c-47be-9fe1-084320065a61 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1701394489", "metadata": {"image_type": "test"}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:51.896519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-80349138-069c-47be-9fe1-084320065a61 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:51.903917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80349138-069c-47be-9fe1-084320065a61 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.904425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80349138-069c-47be-9fe1-084320065a61 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.905197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80349138-069c-47be-9fe1-084320065a61 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.905796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80349138-069c-47be-9fe1-084320065a61 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.920771 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-80349138-069c-47be-9fe1-084320065a61 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] HTTP exception thrown: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-80349138-069c-47be-9fe1-084320065a61 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Request method failure captured: Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18/action HTTP/1.1 Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 112 Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_SYlyhgwedVdC1Mdeeh9-idhXVPl36lvQT5vHYrwufe87EHV1vkba-rJ3vV9Mt6gtm-LopGu0B4DMSqmda5iwXQ8_hF9TOpj4Ic9HfHQj65-fL3uh80TP1M-3STXpX6ZhWwF5BBNglME87YabPsKcWy9AoAPu83rg48nVmI-Vp9FHk Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:05:51.922576 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40c093b8d104424886d49b50d824ffd5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}] Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: a4b200c9a691499d8a2e56d607fdc29f Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1701394489", "metadata": {"image_type": "test"}}} Jul 26 14:05:51.924053 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '24d38d7d-c26a-45dc-8607-631c5a626f18', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1701394489', 'metadata': {'image_type': 'test'}}}} Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:51.924794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:51.926557 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:51.927835 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:51.927835 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:51.927835 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:51.927835 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:51.927835 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:51.927835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-80349138-069c-47be-9fe1-084320065a61 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Returning 404 to user: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:51.927835 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-80349138-069c-47be-9fe1-084320065a61 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "POST /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18/action" status: 404 len: 111 microversion: 2.1 time: 0.034430 Jul 26 14:05:51.927835 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 368/692] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jul 26 14:05:51 2022] POST /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:51.929419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-313788e4-df17-4619-9970-282f81a0e577 req-4b503b3a-a077-4a34-bc34-86a60fe7fe1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d38d7d-c26a-45dc-8607-631c5a626f18", "name": "network-vif-deleted", "tag": "6be56b4f-6dcf-45ba-8f89-cd0d73be2ceb"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:51.940656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-313788e4-df17-4619-9970-282f81a0e577 req-4b503b3a-a077-4a34-bc34-86a60fe7fe1c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.941247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-313788e4-df17-4619-9970-282f81a0e577 req-4b503b3a-a077-4a34-bc34-86a60fe7fe1c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.953474 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-313788e4-df17-4619-9970-282f81a0e577 req-4b503b3a-a077-4a34-bc34-86a60fe7fe1c service nova] Creating event network-vif-deleted:6be56b4f-6dcf-45ba-8f89-cd0d73be2ceb for instance 24d38d7d-c26a-45dc-8607-631c5a626f18 on n-h2-833090-9 Jul 26 14:05:51.958645 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-313788e4-df17-4619-9970-282f81a0e577 req-4b503b3a-a077-4a34-bc34-86a60fe7fe1c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032896 Jul 26 14:05:51.959203 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 369/693] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:51.965179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-345460bf-f29b-4e36-93a7-20bd5db1f778 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:51.965886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-345460bf-f29b-4e36-93a7-20bd5db1f778 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:51.972739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-345460bf-f29b-4e36-93a7-20bd5db1f778 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.973061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-345460bf-f29b-4e36-93a7-20bd5db1f778 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:51.973830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-345460bf-f29b-4e36-93a7-20bd5db1f778 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:51.974273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-345460bf-f29b-4e36-93a7-20bd5db1f778 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:52.624349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-345460bf-f29b-4e36-93a7-20bd5db1f778 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:52.636295 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-345460bf-f29b-4e36-93a7-20bd5db1f778 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 200 len: 1314 microversion: 2.1 time: 0.675769 Jul 26 14:05:52.636815 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 370/694] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:51 2022] GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:52.644634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-083d6196-0d55-4e1d-b2ee-db430696bce0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'create', calling method: .version_select at 0x7f87946d80d0>, body: {"keypair": {"name": "tempest-keypair-1655734378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbssO60qJuES6He9GbFCi70JuUux/qJCCf+uR+K8GXHzHYvS5/V2Mw0KKWiTuhws9v0X+nA/CCYDo84HkmprX6KegStXYUNOBasDNj84mx9QWrmFvjtC3QxiMB4pr+h9w=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:52.653978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=16 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:52.681372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-083d6196-0d55-4e1d-b2ee-db430696bce0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for project d2c43d5f86804cc181b575525a402873. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:05:52.689122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-083d6196-0d55-4e1d-b2ee-db430696bce0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for user 753d20ca575a4270b73b1c686bf657dd and project d2c43d5f86804cc181b575525a402873. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:05:52.736915 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-083d6196-0d55-4e1d-b2ee-db430696bce0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098998 Jul 26 14:05:52.745302 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 371/695] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:05:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:52.754576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b19992df-bec2-4ec9-8824-c9182a8b2b90 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1181656381", "metadata": {"image_type": "test"}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:52.757160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b19992df-bec2-4ec9-8824-c9182a8b2b90 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Failed to fetch instance by id tempest-invalid-1248234244 {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 14:05:52.759060 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-b19992df-bec2-4ec9-8824-c9182a8b2b90 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] HTTP exception thrown: Instance tempest-invalid-1248234244 could not be found. Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b19992df-bec2-4ec9-8824-c9182a8b2b90 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Request method failure captured: Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/tempest-invalid-1248234244/action HTTP/1.1 Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 112 Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_SYlyhgwedVdC1Mdeeh9-idhXVPl36lvQT5vHYrwufe87EHV1vkba-rJ3vV9Mt6gtm-LopGu0B4DMSqmda5iwXQ8_hF9TOpj4Ic9HfHQj65-fL3uh80TP1M-3STXpX6ZhWwF5BBNglME87YabPsKcWy9AoAPu83rg48nVmI-Vp9FHk Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:05:52.761070 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40c093b8d104424886d49b50d824ffd5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}] Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: a4b200c9a691499d8a2e56d607fdc29f Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1181656381", "metadata": {"image_type": "test"}}} Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:05:52.762343 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance tempest-invalid-1248234244 could not be found. Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'tempest-invalid-1248234244', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1181656381', 'metadata': {'image_type': 'test'}}}} Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1248234244 could not be found. Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:52.763163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1248234244 could not be found. Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1248234244 could not be found. Jul 26 14:05:52.764406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:52.765607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b19992df-bec2-4ec9-8824-c9182a8b2b90 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Returning 404 to user: Instance tempest-invalid-1248234244 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:52.765607 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b19992df-bec2-4ec9-8824-c9182a8b2b90 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "POST /compute/v2.1/servers/tempest-invalid-1248234244/action" status: 404 len: 101 microversion: 2.1 time: 0.017207 Jul 26 14:05:52.765607 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 372/696] 10.222.0.70 () {60 vars in 1249 bytes} [Tue Jul 26 14:05:52 2022] POST /compute/v2.1/servers/tempest-invalid-1248234244/action => generated 101 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:52.771567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-fa2dfbc2-f8a8-402b-9c62-2d179240ab19 req-8274a6a4-3af2-4c97-aac2-cff61d049c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96760807-513a-459f-b4b4-1cf897885ed6", "name": "network-vif-plugged", "status": "completed", "tag": "55a71149-6922-4955-9d24-b7427e70e88b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:52.783310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fa2dfbc2-f8a8-402b-9c62-2d179240ab19 req-8274a6a4-3af2-4c97-aac2-cff61d049c5e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:52.783830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fa2dfbc2-f8a8-402b-9c62-2d179240ab19 req-8274a6a4-3af2-4c97-aac2-cff61d049c5e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:52.798266 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-fa2dfbc2-f8a8-402b-9c62-2d179240ab19 req-8274a6a4-3af2-4c97-aac2-cff61d049c5e service nova] Creating event network-vif-plugged:55a71149-6922-4955-9d24-b7427e70e88b for instance 96760807-513a-459f-b4b4-1cf897885ed6 on n-h2-833090-9 Jul 26 14:05:52.804641 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-fa2dfbc2-f8a8-402b-9c62-2d179240ab19 req-8274a6a4-3af2-4c97-aac2-cff61d049c5e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037867 Jul 26 14:05:52.814566 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 373/697] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:52.826457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-318fa307-5221-44a7-b553-b870c272181b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:52.827451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-318fa307-5221-44a7-b553-b870c272181b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:52.835353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-318fa307-5221-44a7-b553-b870c272181b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:52.844064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-318fa307-5221-44a7-b553-b870c272181b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:52.847691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-318fa307-5221-44a7-b553-b870c272181b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:52.848223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-318fa307-5221-44a7-b553-b870c272181b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:53.027468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-318fa307-5221-44a7-b553-b870c272181b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41f5df8d0844f078e147aa5f454d5d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2853b779839a488cb28341b8a9744c60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:53.047131 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-318fa307-5221-44a7-b553-b870c272181b tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 200 len: 1645 microversion: 2.1 time: 0.229906 Jul 26 14:05:53.048241 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 374/698] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:52 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 1645 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:53.053399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e305774b-5d8a-4ba4-b6d4-5073e71521ff tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:53.054130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e305774b-5d8a-4ba4-b6d4-5073e71521ff tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:53.064110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e305774b-5d8a-4ba4-b6d4-5073e71521ff tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:53.064996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e305774b-5d8a-4ba4-b6d4-5073e71521ff tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:53.066025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e305774b-5d8a-4ba4-b6d4-5073e71521ff tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:53.066829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e305774b-5d8a-4ba4-b6d4-5073e71521ff tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:53.646088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e305774b-5d8a-4ba4-b6d4-5073e71521ff tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:53.680130 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e305774b-5d8a-4ba4-b6d4-5073e71521ff tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1322 microversion: 2.1 time: 0.623146 Jul 26 14:05:53.682056 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 375/699] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:53 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:53.716993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6cd60576-3ce5-4329-bbfa-5ff2b8fa420a tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1595466721"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:53.743685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6cd60576-3ce5-4329-bbfa-5ff2b8fa420a tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 14:05:53.747941 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-6cd60576-3ce5-4329-bbfa-5ff2b8fa420a tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6cd60576-3ce5-4329-bbfa-5ff2b8fa420a tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Request method failure captured: Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 57 Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_SYlyhgwedVdC1Mdeeh9-idhXVPl36lvQT5vHYrwufe87EHV1vkba-rJ3vV9Mt6gtm-LopGu0B4DMSqmda5iwXQ8_hF9TOpj4Ic9HfHQj65-fL3uh80TP1M-3STXpX6ZhWwF5BBNglME87YabPsKcWy9AoAPu83rg48nVmI-Vp9FHk Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:05:53.754196 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40c093b8d104424886d49b50d824ffd5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}] Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: a4b200c9a691499d8a2e56d607fdc29f Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: {"createImage": {"name": "tempest-test-snap-1595466721"}} Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:05:53.755926 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1595466721'}}} Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:53.757271 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 14:05:53.760144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:53.764318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6cd60576-3ce5-4329-bbfa-5ff2b8fa420a tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:53.765777 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6cd60576-3ce5-4329-bbfa-5ff2b8fa420a tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.081706 Jul 26 14:05:53.767255 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 376/700] 10.222.0.70 () {60 vars in 1275 bytes} [Tue Jul 26 14:05:53 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:53.778165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d8b62e91-ec85-4b93-8946-5bedaf24dccd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:53.779076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d8b62e91-ec85-4b93-8946-5bedaf24dccd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:53.793697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8b62e91-ec85-4b93-8946-5bedaf24dccd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:53.795082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8b62e91-ec85-4b93-8946-5bedaf24dccd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:53.797226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8b62e91-ec85-4b93-8946-5bedaf24dccd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:53.798345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8b62e91-ec85-4b93-8946-5bedaf24dccd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:54.280169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d8b62e91-ec85-4b93-8946-5bedaf24dccd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:54.294407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d8b62e91-ec85-4b93-8946-5bedaf24dccd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:54.299991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d8b62e91-ec85-4b93-8946-5bedaf24dccd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:54.308505 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d8b62e91-ec85-4b93-8946-5bedaf24dccd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1557 microversion: 2.25 time: 0.534973 Jul 26 14:05:54.309724 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 377/701] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:53 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1557 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:54.314829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85dc405b-1907-4434-b082-da2178e7de59 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:54.318312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85dc405b-1907-4434-b082-da2178e7de59 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:54.342709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85dc405b-1907-4434-b082-da2178e7de59 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:54.343159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85dc405b-1907-4434-b082-da2178e7de59 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:54.344009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85dc405b-1907-4434-b082-da2178e7de59 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:54.351618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85dc405b-1907-4434-b082-da2178e7de59 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:54.411376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:54.759862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-85dc405b-1907-4434-b082-da2178e7de59 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:54.787922 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85dc405b-1907-4434-b082-da2178e7de59 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 200 len: 1314 microversion: 2.1 time: 0.476427 Jul 26 14:05:54.793940 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 378/702] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:54 2022] GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:54.812449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2c8ea25-3bf2-46a3-86e1-f3dc49564011 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-423954789"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:54.817235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e2c8ea25-3bf2-46a3-86e1-f3dc49564011 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 14:05:54.827089 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e2c8ea25-3bf2-46a3-86e1-f3dc49564011 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2c8ea25-3bf2-46a3-86e1-f3dc49564011 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Request method failure captured: Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 56 Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_SYlyhgwedVdC1Mdeeh9-idhXVPl36lvQT5vHYrwufe87EHV1vkba-rJ3vV9Mt6gtm-LopGu0B4DMSqmda5iwXQ8_hF9TOpj4Ic9HfHQj65-fL3uh80TP1M-3STXpX6ZhWwF5BBNglME87YabPsKcWy9AoAPu83rg48nVmI-Vp9FHk Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:05:54.828768 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40c093b8d104424886d49b50d824ffd5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}] Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: a4b200c9a691499d8a2e56d607fdc29f Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: {"createImage": {"name": "tempest-test-snap-423954789"}} Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:05:54.831655 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-423954789'}}} Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:54.833309 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 26 14:05:54.835555 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:54.838348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2c8ea25-3bf2-46a3-86e1-f3dc49564011 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:54.838348 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e2c8ea25-3bf2-46a3-86e1-f3dc49564011 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.034621 Jul 26 14:05:54.838348 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 379/703] 10.222.0.70 () {60 vars in 1281 bytes} [Tue Jul 26 14:05:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:54.843999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ab9131fb-1649-4db1-a80e-929c01a9e562 req-b01b2377-8b25-4e34-85c2-65164ef2abe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9611ccf6-16ec-4945-aecf-3cfcb058ec91", "name": "network-vif-deleted", "tag": "803157f9-374f-4edf-b468-6e317b5c706e"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:54.870379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ab9131fb-1649-4db1-a80e-929c01a9e562 req-b01b2377-8b25-4e34-85c2-65164ef2abe2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:54.871019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ab9131fb-1649-4db1-a80e-929c01a9e562 req-b01b2377-8b25-4e34-85c2-65164ef2abe2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:54.897281 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ab9131fb-1649-4db1-a80e-929c01a9e562 req-b01b2377-8b25-4e34-85c2-65164ef2abe2 service nova] Creating event network-vif-deleted:803157f9-374f-4edf-b468-6e317b5c706e for instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 on n-h1-833090-9 Jul 26 14:05:54.914042 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ab9131fb-1649-4db1-a80e-929c01a9e562 req-b01b2377-8b25-4e34-85c2-65164ef2abe2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078986 Jul 26 14:05:54.917265 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 380/704] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:54.929469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ebb71e64-98d0-4d0b-b20b-4a2d090bf4b8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:54.933536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ebb71e64-98d0-4d0b-b20b-4a2d090bf4b8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:54.950613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebb71e64-98d0-4d0b-b20b-4a2d090bf4b8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:54.953932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebb71e64-98d0-4d0b-b20b-4a2d090bf4b8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:54.959287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebb71e64-98d0-4d0b-b20b-4a2d090bf4b8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:54.960534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebb71e64-98d0-4d0b-b20b-4a2d090bf4b8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:55.006320 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-ebb71e64-98d0-4d0b-b20b-4a2d090bf4b8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] HTTP exception thrown: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ebb71e64-98d0-4d0b-b20b-4a2d090bf4b8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Request method failure captured: Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 HTTP/1.1 Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QnA6rofr9HuDYfYNllQZK254p-r3F6roWRsB54ahA3eZrgyONZe7-_dmKLqcj5klZbATc8bDeXu2iQhFDTUHoX_M-uZU7YC5LHV2jUhvvW4L45IQtaXGwqMbwEuwGXU6hJ77E3uxHwYEC1du9XqnCG5DHYAitWsTZLO0CNgbmhndA Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:05:55.012146 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2853b779839a488cb28341b8a9744c60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2853b779839a488cb28341b8a9744c60", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}] Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b41f5df8d0844f078e147aa5f454d5d3 Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:05:55.013549 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '9611ccf6-16ec-4945-aecf-3cfcb058ec91'} Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:55.014318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:05:55.015525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:55.021224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ebb71e64-98d0-4d0b-b20b-4a2d090bf4b8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Returning 404 to user: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:55.022689 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ebb71e64-98d0-4d0b-b20b-4a2d090bf4b8 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 404 len: 111 microversion: 2.1 time: 0.103654 Jul 26 14:05:55.025204 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 381/705] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:54 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:55.456734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f936fc4-2950-49e9-8f32-9f115e7e4914 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:55.458486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f936fc4-2950-49e9-8f32-9f115e7e4914 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:55.468003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f936fc4-2950-49e9-8f32-9f115e7e4914 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:55.468563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f936fc4-2950-49e9-8f32-9f115e7e4914 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:55.470048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f936fc4-2950-49e9-8f32-9f115e7e4914 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:55.470735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f936fc4-2950-49e9-8f32-9f115e7e4914 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:55.853762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-3f936fc4-2950-49e9-8f32-9f115e7e4914 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:05:55.920528 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f936fc4-2950-49e9-8f32-9f115e7e4914 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 2050 microversion: 2.25 time: 0.891530 Jul 26 14:05:55.921951 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 382/706] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:55 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 2050 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:55.927486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ab6c78e5-254e-4f6a-b3e6-49f95b1fb316 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:55.928553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ab6c78e5-254e-4f6a-b3e6-49f95b1fb316 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:55.935833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab6c78e5-254e-4f6a-b3e6-49f95b1fb316 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:55.936684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab6c78e5-254e-4f6a-b3e6-49f95b1fb316 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:55.937709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab6c78e5-254e-4f6a-b3e6-49f95b1fb316 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:55.938383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab6c78e5-254e-4f6a-b3e6-49f95b1fb316 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.162147 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0356a200-d026-4348-820e-2d56d42c1269 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.286597 Jul 26 14:05:56.163706 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 325/707] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:05:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:56.170273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ca36430-6e20-4d5f-a28c-ba4aeade704d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:56.171142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ca36430-6e20-4d5f-a28c-ba4aeade704d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:56.180002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ca36430-6e20-4d5f-a28c-ba4aeade704d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:56.181379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ca36430-6e20-4d5f-a28c-ba4aeade704d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.182272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ca36430-6e20-4d5f-a28c-ba4aeade704d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:56.183314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ca36430-6e20-4d5f-a28c-ba4aeade704d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.212690 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8ca36430-6e20-4d5f-a28c-ba4aeade704d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] HTTP exception thrown: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ca36430-6e20-4d5f-a28c-ba4aeade704d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Request method failure captured: Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 HTTP/1.1 Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_SYlyhgwedVdC1Mdeeh9-idhXVPl36lvQT5vHYrwufe87EHV1vkba-rJ3vV9Mt6gtm-LopGu0B4DMSqmda5iwXQ8_hF9TOpj4Ic9HfHQj65-fL3uh80TP1M-3STXpX6ZhWwF5BBNglME87YabPsKcWy9AoAPu83rg48nVmI-Vp9FHk Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:56.215795 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40c093b8d104424886d49b50d824ffd5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}] Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: a4b200c9a691499d8a2e56d607fdc29f Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:56.217429 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '24d38d7d-c26a-45dc-8607-631c5a626f18'} Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:56.218343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:56.219781 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.222725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ca36430-6e20-4d5f-a28c-ba4aeade704d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Returning 404 to user: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:56.224333 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ca36430-6e20-4d5f-a28c-ba4aeade704d tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 404 len: 111 microversion: 2.1 time: 0.058450 Jul 26 14:05:56.225362 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 326/708] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:05:56 2022] DELETE /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:56.234807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4da08ade-9599-4208-bc98-27b3b576c543 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:56.235595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4da08ade-9599-4208-bc98-27b3b576c543 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:56.247651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4da08ade-9599-4208-bc98-27b3b576c543 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:56.248447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ab6c78e5-254e-4f6a-b3e6-49f95b1fb316 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:56.248579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4da08ade-9599-4208-bc98-27b3b576c543 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.250074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4da08ade-9599-4208-bc98-27b3b576c543 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:56.250860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4da08ade-9599-4208-bc98-27b3b576c543 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.255554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:56.256600 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ab6c78e5-254e-4f6a-b3e6-49f95b1fb316 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1517 microversion: 2.1 time: 0.333330 Jul 26 14:05:56.257289 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 383/709] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:55 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1517 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:56.275490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-deeee9c1-5ede-4c1b-81b4-4c52ea540d90 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:56.275989 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-4da08ade-9599-4208-bc98-27b3b576c543 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] HTTP exception thrown: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:05:56.276787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-deeee9c1-5ede-4c1b-81b4-4c52ea540d90 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4da08ade-9599-4208-bc98-27b3b576c543 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Request method failure captured: Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae HTTP/1.1 Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QnA6rofr9HuDYfYNllQZK254p-r3F6roWRsB54ahA3eZrgyONZe7-_dmKLqcj5klZbATc8bDeXu2iQhFDTUHoX_M-uZU7YC5LHV2jUhvvW4L45IQtaXGwqMbwEuwGXU6hJ77E3uxHwYEC1du9XqnCG5DHYAitWsTZLO0CNgbmhndA Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:56.277590 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2853b779839a488cb28341b8a9744c60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2853b779839a488cb28341b8a9744c60", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}] Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b41f5df8d0844f078e147aa5f454d5d3 Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:05:56.278882 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae'} Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:56.279612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:05:56.280851 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.284079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4da08ade-9599-4208-bc98-27b3b576c543 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Returning 404 to user: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:56.284079 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4da08ade-9599-4208-bc98-27b3b576c543 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 404 len: 111 microversion: 2.1 time: 0.052060 Jul 26 14:05:56.284079 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 327/710] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:05:56 2022] DELETE /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:56.284708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0e2e9cae-cc45-4e87-9586-4cf803d41a57 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:56.285634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0e2e9cae-cc45-4e87-9586-4cf803d41a57 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:56.294446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e2e9cae-cc45-4e87-9586-4cf803d41a57 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:56.294774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e2e9cae-cc45-4e87-9586-4cf803d41a57 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.295573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e2e9cae-cc45-4e87-9586-4cf803d41a57 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:56.296050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e2e9cae-cc45-4e87-9586-4cf803d41a57 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.298022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-deeee9c1-5ede-4c1b-81b4-4c52ea540d90 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:56.298827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-deeee9c1-5ede-4c1b-81b4-4c52ea540d90 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.300228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-deeee9c1-5ede-4c1b-81b4-4c52ea540d90 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:56.301074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-deeee9c1-5ede-4c1b-81b4-4c52ea540d90 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.557431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-deeee9c1-5ede-4c1b-81b4-4c52ea540d90 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:05:56.565660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-0e2e9cae-cc45-4e87-9586-4cf803d41a57 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:05:56.585759 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-deeee9c1-5ede-4c1b-81b4-4c52ea540d90 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 200 len: 1314 microversion: 2.1 time: 0.326222 Jul 26 14:05:56.600061 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 384/711] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:56 2022] GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:05:56.601875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-007b2654-7f65-470f-b4f9-6cefa3a4b118 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Calling method '.version_select at 0x7f879466d0d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:56.643793 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0e2e9cae-cc45-4e87-9586-4cf803d41a57 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 2050 microversion: 2.25 time: 0.362715 Jul 26 14:05:56.644637 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 328/712] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:05:56 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 2050 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:05:56.651769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2367cc75-4b32-4d1e-a37b-d45ce6f615d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:56.653115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2367cc75-4b32-4d1e-a37b-d45ce6f615d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] [instance: 24d38d7d-c26a-45dc-8607-631c5a626f18] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:56.663766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2367cc75-4b32-4d1e-a37b-d45ce6f615d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:56.664906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2367cc75-4b32-4d1e-a37b-d45ce6f615d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.666494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2367cc75-4b32-4d1e-a37b-d45ce6f615d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:56.667421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2367cc75-4b32-4d1e-a37b-d45ce6f615d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:56.694194 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-2367cc75-4b32-4d1e-a37b-d45ce6f615d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] HTTP exception thrown: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2367cc75-4b32-4d1e-a37b-d45ce6f615d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Request method failure captured: Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 HTTP/1.1 Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_SYlyhgwedVdC1Mdeeh9-idhXVPl36lvQT5vHYrwufe87EHV1vkba-rJ3vV9Mt6gtm-LopGu0B4DMSqmda5iwXQ8_hF9TOpj4Ic9HfHQj65-fL3uh80TP1M-3STXpX6ZhWwF5BBNglME87YabPsKcWy9AoAPu83rg48nVmI-Vp9FHk Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:05:56.698435 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/40c093b8d104424886d49b50d824ffd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_40c093b8d104424886d49b50d824ffd5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/40c093b8d104424886d49b50d824ffd5"}]}] Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 40c093b8d104424886d49b50d824ffd5 Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1649972571 Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: a4b200c9a691499d8a2e56d607fdc29f Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesNegativeTestJSON-1649972571-project Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:56.701295 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '24d38d7d-c26a-45dc-8607-631c5a626f18'} Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:56.702905 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. Jul 26 14:05:56.705569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:05:56.709268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2367cc75-4b32-4d1e-a37b-d45ce6f615d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] Returning 404 to user: Instance 24d38d7d-c26a-45dc-8607-631c5a626f18 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:56.711088 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2367cc75-4b32-4d1e-a37b-d45ce6f615d9 tempest-ImagesNegativeTestJSON-1649972571 tempest-ImagesNegativeTestJSON-1649972571-project] 10.222.0.70 "GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18" status: 404 len: 111 microversion: 2.1 time: 0.064774 Jul 26 14:05:56.713055 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 329/713] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:56 2022] GET /compute/v2.1/servers/24d38d7d-c26a-45dc-8607-631c5a626f18 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:56.722043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bbb6b641-4843-4208-b7bf-b8c73f55c7e5 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Action: 'create', calling method: .version_select at 0x7f87944b29d0>, body: {"pool": null} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:57.287089 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-007b2654-7f65-470f-b4f9-6cefa3a4b118 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/c7d10b21-4006-437d-83d4-ddd865f70c25" status: 200 len: 141 microversion: 2.1 time: 0.694589 Jul 26 14:05:57.290578 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 385/714] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:05:56 2022] GET /compute/v2.1/os-floating-ips/c7d10b21-4006-437d-83d4-ddd865f70c25 => generated 141 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:57.309981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-faa47a4e-2981-4acd-acdb-21e1b62c1d49 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:57.311042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-faa47a4e-2981-4acd-acdb-21e1b62c1d49 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:05:57.323346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faa47a4e-2981-4acd-acdb-21e1b62c1d49 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:57.324200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faa47a4e-2981-4acd-acdb-21e1b62c1d49 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:57.326102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faa47a4e-2981-4acd-acdb-21e1b62c1d49 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:57.328003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faa47a4e-2981-4acd-acdb-21e1b62c1d49 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:57.351378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:05:57.354436 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-faa47a4e-2981-4acd-acdb-21e1b62c1d49 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] HTTP exception thrown: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-faa47a4e-2981-4acd-acdb-21e1b62c1d49 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Request method failure captured: Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae HTTP/1.1 Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_QnA6rofr9HuDYfYNllQZK254p-r3F6roWRsB54ahA3eZrgyONZe7-_dmKLqcj5klZbATc8bDeXu2iQhFDTUHoX_M-uZU7YC5LHV2jUhvvW4L45IQtaXGwqMbwEuwGXU6hJ77E3uxHwYEC1du9XqnCG5DHYAitWsTZLO0CNgbmhndA Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:05:57.357534 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2853b779839a488cb28341b8a9744c60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2853b779839a488cb28341b8a9744c60", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}] Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b41f5df8d0844f078e147aa5f454d5d3 Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:05:57.359526 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae'} Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:05:57.360858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:05:57.363128 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:05:57.367979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-faa47a4e-2981-4acd-acdb-21e1b62c1d49 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Returning 404 to user: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:05:57.369706 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-faa47a4e-2981-4acd-acdb-21e1b62c1d49 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 404 len: 111 microversion: 2.1 time: 0.076536 Jul 26 14:05:57.370830 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 386/715] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:05:57 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:05:57.375616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6bdb02e3-927d-4f51-8d0f-8636d2b4f47a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '.version_select at 0x7f879466d430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:57.380999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bdb02e3-927d-4f51-8d0f-8636d2b4f47a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:57.382350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bdb02e3-927d-4f51-8d0f-8636d2b4f47a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:57.393010 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6bdb02e3-927d-4f51-8d0f-8636d2b4f47a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 802 microversion: 2.1 time: 0.020860 Jul 26 14:05:57.395745 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 387/716] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:05:57 2022] GET /compute/v2.1/os-migrations => generated 802 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:57.412095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-cafcf8fb-9b7f-40a1-b520-cc092a5e8b86 req-3dde7265-299e-4521-861a-d80ce2c9fbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6317e9-619d-4230-b5c8-58452de314b9", "name": "network-vif-plugged", "status": "completed", "tag": "0ec18604-bd18-435d-8f2e-dac83bd6066b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:05:57.425175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-cafcf8fb-9b7f-40a1-b520-cc092a5e8b86 req-3dde7265-299e-4521-861a-d80ce2c9fbc8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:57.426102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-cafcf8fb-9b7f-40a1-b520-cc092a5e8b86 req-3dde7265-299e-4521-861a-d80ce2c9fbc8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:57.456647 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-cafcf8fb-9b7f-40a1-b520-cc092a5e8b86 req-3dde7265-299e-4521-861a-d80ce2c9fbc8 service nova] Creating event network-vif-plugged:0ec18604-bd18-435d-8f2e-dac83bd6066b for instance 4d6317e9-619d-4230-b5c8-58452de314b9 on n-h1-833090-9 Jul 26 14:05:57.463151 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-cafcf8fb-9b7f-40a1-b520-cc092a5e8b86 req-3dde7265-299e-4521-861a-d80ce2c9fbc8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064940 Jul 26 14:05:57.463974 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 388/717] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:05:57.469680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-247f3c40-c12f-400f-a0ea-cf92efaf164c tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:57.474167 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:05:57.474167 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:05:57.475930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-247f3c40-c12f-400f-a0ea-cf92efaf164c tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:57.476638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-247f3c40-c12f-400f-a0ea-cf92efaf164c tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:57.477937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-247f3c40-c12f-400f-a0ea-cf92efaf164c tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:05:57.478854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-247f3c40-c12f-400f-a0ea-cf92efaf164c tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:05:57.516570 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-247f3c40-c12f-400f-a0ea-cf92efaf164c tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.050260 Jul 26 14:05:57.526220 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 389/718] 10.222.0.70 () {60 vars in 1217 bytes} [Tue Jul 26 14:05:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:05:57.526220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74e5b8df-1aea-4328-b3ea-06f8d5bfbd2a tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Calling method '.version_select at 0x7f87948c1820>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:05:58.611273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:00.891507 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-74e5b8df-1aea-4328-b3ea-06f8d5bfbd2a tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/c7d10b21-4006-437d-83d4-ddd865f70c25" status: 202 len: 0 microversion: 2.1 time: 3.372098 Jul 26 14:06:00.901106 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 390/719] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:05:57 2022] DELETE /compute/v2.1/os-floating-ips/c7d10b21-4006-437d-83d4-ddd865f70c25 => generated 0 bytes in 3383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:00.911966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-738f0e1e-b04e-4eee-9424-6b2c460369d9 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '.version_select at 0x7f879466dd30>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:00.959813 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-738f0e1e-b04e-4eee-9424-6b2c460369d9 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514025668" status: 202 len: 0 microversion: 2.1 time: 0.057020 Jul 26 14:06:00.962428 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 391/720] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514025668 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:00.974868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3e28b1e-feec-4048-a604-cb84af0ec455 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:00.987919 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3e28b1e-feec-4048-a604-cb84af0ec455 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017099 Jul 26 14:06:00.989413 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 392/721] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:06:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:00.998469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8fed3c8d-b50b-42b2-b95e-3650b577aeee tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-9", "block_migration": "auto"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:01.002561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8fed3c8d-b50b-42b2-b95e-3650b577aeee tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:01.011711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fed3c8d-b50b-42b2-b95e-3650b577aeee tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:01.013036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fed3c8d-b50b-42b2-b95e-3650b577aeee tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:01.014428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fed3c8d-b50b-42b2-b95e-3650b577aeee tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:01.015914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fed3c8d-b50b-42b2-b95e-3650b577aeee tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:01.061752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-8fed3c8d-b50b-42b2-b95e-3650b577aeee tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'flavor' on Instance uuid 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:06:01.089108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8fed3c8d-b50b-42b2-b95e-3650b577aeee tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Going to try to live migrate instance to n-h2-833090-9 {{(pid=119479) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 14:06:02.599846 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bbb6b641-4843-4208-b7bf-b8c73f55c7e5 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.884537 Jul 26 14:06:02.600993 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 330/722] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:05:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:02.638059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-384163cd-e93f-468a-9260-c9dac72fed7a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:02.668766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-384163cd-e93f-468a-9260-c9dac72fed7a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:02.694241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-384163cd-e93f-468a-9260-c9dac72fed7a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:02.694712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-384163cd-e93f-468a-9260-c9dac72fed7a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:02.695742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-384163cd-e93f-468a-9260-c9dac72fed7a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:02.698294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-384163cd-e93f-468a-9260-c9dac72fed7a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:02.699244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:03.038263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-384163cd-e93f-468a-9260-c9dac72fed7a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:03.060725 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-384163cd-e93f-468a-9260-c9dac72fed7a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 200 len: 1464 microversion: 2.1 time: 0.428688 Jul 26 14:06:03.061531 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 331/723] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:02 2022] GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 1464 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:03.066005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9d5e6ce2-9818-4b2d-b5a2-31b45e8391b8 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Calling method '.version_select at 0x7f87945f9d30>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:03.655899 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9d5e6ce2-9818-4b2d-b5a2-31b45e8391b8 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.593319 Jul 26 14:06:03.656637 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 332/724] 10.222.0.70 () {58 vars in 1164 bytes} [Tue Jul 26 14:06:03 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:06:03.662431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fa387bfb-1798-4df7-b357-b984874c40b1 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-32874240", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:03.673727 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:06:03.673727 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:06:03.704432 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fa387bfb-1798-4df7-b357-b984874c40b1 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.046133 Jul 26 14:06:03.705770 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 333/725] 10.222.0.70 () {60 vars in 1146 bytes} [Tue Jul 26 14:06:03 2022] POST /compute/v2.1/flavors => generated 497 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:03.711620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1398489653", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "2348f789-06f4-41a5-a965-401de2b37b0a"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:03.829208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] validate_networks() for [('2348f789-06f4-41a5-a965-401de2b37b0a', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:06:04.761638 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8fed3c8d-b50b-42b2-b95e-3650b577aeee tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5/action" status: 202 len: 0 microversion: 2.25 time: 3.769422 Jul 26 14:06:04.764022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:06:04.771274 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 393/726] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:06:00 2022] POST /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5/action => generated 0 bytes in 3781 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:06:04.771940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:06:04.775543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:06:04.776372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:06:04.777161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:06:04.833594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:04.834319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:04.835789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:04.836594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:04.891774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Getting quotas for project f3d21e6b315b4543993c1a1b7271f913. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:06:04.902800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Getting quotas for user 9f84bae10984463fbb5579005d7a0a7c and project f3d21e6b315b4543993c1a1b7271f913. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:06:04.929285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:06:04.935942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:06:05.091671 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-113678fe-4f97-4e23-9492-8537d5cb5e54 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.384470 Jul 26 14:06:05.100324 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 334/727] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:06:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:06:05.108286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f26d765b-d11f-4958-b192-60019c29dc9d tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:05.109295 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:06:05.109295 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:06:05.135318 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f26d765b-d11f-4958-b192-60019c29dc9d tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/2006998507" status: 202 len: 0 microversion: 2.1 time: 0.033083 Jul 26 14:06:05.136828 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 335/728] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:06:05 2022] DELETE /compute/v2.1/flavors/2006998507 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:05.148000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f929eb2f-f0ef-4418-b336-510d67cedfb5 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Calling method '.version_select at 0x7f87944fe5e0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:05.367638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d498024-014c-4ab1-96ce-c749d172b818 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:05.382912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4d498024-014c-4ab1-96ce-c749d172b818 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Searching by: {'deleted': False, 'project_id': 'c6ed5e35b5a84bcc949f849042090d10'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:06:05.420304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d498024-014c-4ab1-96ce-c749d172b818 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:05.420819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d498024-014c-4ab1-96ce-c749d172b818 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:05.422223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d498024-014c-4ab1-96ce-c749d172b818 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:05.425520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d498024-014c-4ab1-96ce-c749d172b818 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:05.609438 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d498024-014c-4ab1-96ce-c749d172b818 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.827545 Jul 26 14:06:05.610308 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 394/729] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:06:04 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:06:05.625384 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f929eb2f-f0ef-4418-b336-510d67cedfb5 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.487136 Jul 26 14:06:05.626523 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 336/730] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Jul 26 14:06:05 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:05.632737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-197902d5-7014-4b34-8b94-6236700f97f8 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:05.645732 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-197902d5-7014-4b34-8b94-6236700f97f8 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033792 Jul 26 14:06:05.646505 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 395/731] 10.222.0.70 () {58 vars in 1182 bytes} [Tue Jul 26 14:06:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:06:05.660638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aada2a92-115c-4709-9df2-a912ac792457 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:05.662171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aada2a92-115c-4709-9df2-a912ac792457 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:05.679069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aada2a92-115c-4709-9df2-a912ac792457 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:05.683138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aada2a92-115c-4709-9df2-a912ac792457 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:05.684920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aada2a92-115c-4709-9df2-a912ac792457 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:05.686971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aada2a92-115c-4709-9df2-a912ac792457 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:05.771540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-955071678", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:05.882780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:06:06.271968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aada2a92-115c-4709-9df2-a912ac792457 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:06.287709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aada2a92-115c-4709-9df2-a912ac792457 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:06.290570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aada2a92-115c-4709-9df2-a912ac792457 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:06.292277 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aada2a92-115c-4709-9df2-a912ac792457 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1567 microversion: 2.25 time: 0.644582 Jul 26 14:06:06.292879 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 396/732] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:05 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1567 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:06.299916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b8a4ed09-54e0-4bb0-b9c0-12473009a6f8 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:06.300570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b8a4ed09-54e0-4bb0-b9c0-12473009a6f8 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:06.309761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8a4ed09-54e0-4bb0-b9c0-12473009a6f8 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:06.310216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8a4ed09-54e0-4bb0-b9c0-12473009a6f8 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:06.311016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8a4ed09-54e0-4bb0-b9c0-12473009a6f8 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:06.311470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8a4ed09-54e0-4bb0-b9c0-12473009a6f8 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:06.819657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b8a4ed09-54e0-4bb0-b9c0-12473009a6f8 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:06.831084 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b8a4ed09-54e0-4bb0-b9c0-12473009a6f8 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 200 len: 1220 microversion: 2.1 time: 0.537009 Jul 26 14:06:06.831997 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 397/733] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:06 2022] GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 1220 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:06.836640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a7cb1352-7de1-4cf3-8e18-5943d554e758 tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:06.893661 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a7cb1352-7de1-4cf3-8e18-5943d554e758 tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5892 microversion: 2.1 time: 0.060585 Jul 26 14:06:06.895028 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 398/734] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:06:06 2022] GET /compute/v2.1/flavors/detail => generated 5892 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:06.904583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-046c12e0-253a-4815-a454-210ab3739395 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:06.918318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-046c12e0-253a-4815-a454-210ab3739395 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Searching by: {'deleted': False} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:06:06.926794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-046c12e0-253a-4815-a454-210ab3739395 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:06.927991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-046c12e0-253a-4815-a454-210ab3739395 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:06.929885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-046c12e0-253a-4815-a454-210ab3739395 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:06.931397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-046c12e0-253a-4815-a454-210ab3739395 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:06.995644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:06:06.996506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:06:06.996678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:06:06.997176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:06:06.997659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:06:07.012868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:07.013618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:07.014969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:07.015721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:07.067610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Getting quotas for project f83f5c16243748bb9122828119f5bbef. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:06:07.077738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Getting quotas for user 6f6b9f5f3cb54ecbb1c1d7603bb3ae79 and project f83f5c16243748bb9122828119f5bbef. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:06:07.099637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:06:07.108059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:06:07.142144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:07.147523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-046c12e0-253a-4815-a454-210ab3739395 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:06:07.216178 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-930734a6-6972-482c-91f8-4c63e6ea11e4 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580341 Jul 26 14:06:07.232357 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 337/735] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:06:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:06:07.248567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-74420b5d-6c28-4872-96ce-5d8f88b1c336 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Calling method '.version_select at 0x7f87944c4b80>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:07.612424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-046c12e0-253a-4815-a454-210ab3739395 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:07.613190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-046c12e0-253a-4815-a454-210ab3739395 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:08.894699 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-046c12e0-253a-4815-a454-210ab3739395 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12786 microversion: 2.1 time: 1.997917 Jul 26 14:06:08.907692 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 399/736] 10.222.0.70 () {58 vars in 1171 bytes} [Tue Jul 26 14:06:06 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12786 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:06:08.934763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1970576301", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "d0b7a172-7066-4282-a625-2b397dc88e8b"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:09.066924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:06:09.874473 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-74420b5d-6c28-4872-96ce-5d8f88b1c336 tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/605a15e2-978d-4564-bbaf-4971eea8e34a" status: 202 len: 0 microversion: 2.1 time: 2.640229 Jul 26 14:06:09.875658 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 338/737] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:06:07 2022] DELETE /compute/v2.1/os-floating-ips/605a15e2-978d-4564-bbaf-4971eea8e34a => generated 0 bytes in 2642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:09.881493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af47eaa8-8668-41ec-91f1-574ab8b82ac2 tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:09.883322 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:06:09.883322 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:06:09.965259 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af47eaa8-8668-41ec-91f1-574ab8b82ac2 tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1378323926" status: 202 len: 0 microversion: 2.1 time: 0.087536 Jul 26 14:06:09.969825 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 339/738] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:06:09 2022] DELETE /compute/v2.1/flavors/1378323926 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:09.988177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb36f030-c4db-444a-a4d1-981b5ac93b14 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:09.997004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bb36f030-c4db-444a-a4d1-981b5ac93b14 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:10.020976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb36f030-c4db-444a-a4d1-981b5ac93b14 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:10.021697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb36f030-c4db-444a-a4d1-981b5ac93b14 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:10.030271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb36f030-c4db-444a-a4d1-981b5ac93b14 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:10.031503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb36f030-c4db-444a-a4d1-981b5ac93b14 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:10.048165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:06:10.048909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:06:10.050318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:06:10.051364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:06:10.052229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:06:10.088583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:10.089399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:10.091041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:10.091747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:10.171727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for project d2c43d5f86804cc181b575525a402873. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:06:10.218761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for user 753d20ca575a4270b73b1c686bf657dd and project d2c43d5f86804cc181b575525a402873. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:06:10.275719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:06:10.278395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:06:10.297255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bb36f030-c4db-444a-a4d1-981b5ac93b14 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:10.311722 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bb36f030-c4db-444a-a4d1-981b5ac93b14 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1274 microversion: 2.1 time: 0.337659 Jul 26 14:06:10.325632 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 340/739] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:09 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1274 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:10.347140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9f4f8712-83aa-4be3-a059-8d2daffade45 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:10.348792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9f4f8712-83aa-4be3-a059-8d2daffade45 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:10.366270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f4f8712-83aa-4be3-a059-8d2daffade45 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:10.368903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f4f8712-83aa-4be3-a059-8d2daffade45 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:10.370280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f4f8712-83aa-4be3-a059-8d2daffade45 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:10.372994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f4f8712-83aa-4be3-a059-8d2daffade45 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:10.391201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:10.452209 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c7719358-93b8-40d1-892c-b212e55119c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.542851 Jul 26 14:06:10.456787 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 400/740] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:06:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:06:10.473317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-832e0e2d-9996-4319-b134-1cc28fea18aa req-6abcb53d-11e5-4209-baaa-a9435ec1c884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ff036a-5fa7-4b56-af8a-afd163f7c3b5", "name": "network-vif-unplugged", "status": "completed", "tag": "191708b4-b957-42c3-a0aa-284ad81e99c7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:10.493624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-832e0e2d-9996-4319-b134-1cc28fea18aa req-6abcb53d-11e5-4209-baaa-a9435ec1c884 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:10.494825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-832e0e2d-9996-4319-b134-1cc28fea18aa req-6abcb53d-11e5-4209-baaa-a9435ec1c884 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:10.513562 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-832e0e2d-9996-4319-b134-1cc28fea18aa req-6abcb53d-11e5-4209-baaa-a9435ec1c884 service nova] Creating event network-vif-unplugged:191708b4-b957-42c3-a0aa-284ad81e99c7 for instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 on n-h1-833090-9 Jul 26 14:06:10.521056 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-832e0e2d-9996-4319-b134-1cc28fea18aa req-6abcb53d-11e5-4209-baaa-a9435ec1c884 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061928 Jul 26 14:06:10.522344 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 401/741] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:10.532468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-75bf324e-1bd2-4b5e-8c26-08826b867c68 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:10.534219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-75bf324e-1bd2-4b5e-8c26-08826b867c68 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:10.544398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75bf324e-1bd2-4b5e-8c26-08826b867c68 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:10.545357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75bf324e-1bd2-4b5e-8c26-08826b867c68 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:10.549292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75bf324e-1bd2-4b5e-8c26-08826b867c68 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:10.551598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75bf324e-1bd2-4b5e-8c26-08826b867c68 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:10.830012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9f4f8712-83aa-4be3-a059-8d2daffade45 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:10.845712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9f4f8712-83aa-4be3-a059-8d2daffade45 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:10.849860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9f4f8712-83aa-4be3-a059-8d2daffade45 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:10.854571 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9f4f8712-83aa-4be3-a059-8d2daffade45 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1567 microversion: 2.25 time: 0.514767 Jul 26 14:06:10.873160 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 341/742] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:10 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1567 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:10.975598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-240644284", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "57f75734-76a5-4e60-8803-969954ea1915"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:11.006522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-75bf324e-1bd2-4b5e-8c26-08826b867c68 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:11.018514 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-75bf324e-1bd2-4b5e-8c26-08826b867c68 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 200 len: 1324 microversion: 2.1 time: 0.492810 Jul 26 14:06:11.019669 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 402/743] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:10 2022] GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 1324 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:11.031574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7e59743c-c90e-41f1-883e-f8d997ac37f2 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:11.047994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e59743c-c90e-41f1-883e-f8d997ac37f2 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Searching by: {'deleted': False, 'project_id': 'c6ed5e35b5a84bcc949f849042090d10'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:06:11.090704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e59743c-c90e-41f1-883e-f8d997ac37f2 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:11.091983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e59743c-c90e-41f1-883e-f8d997ac37f2 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:11.093313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e59743c-c90e-41f1-883e-f8d997ac37f2 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:11.094011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e59743c-c90e-41f1-883e-f8d997ac37f2 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:11.122169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] validate_networks() for [('57f75734-76a5-4e60-8803-969954ea1915', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:06:11.148404 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7e59743c-c90e-41f1-883e-f8d997ac37f2 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?tenant_id=8e90b10ccea94aa292a1c993c6d4424c" status: 200 len: 15 microversion: 2.1 time: 0.127164 Jul 26 14:06:11.152328 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 403/744] 10.222.0.70 () {58 vars in 1231 bytes} [Tue Jul 26 14:06:11 2022] GET /compute/v2.1/servers/detail?tenant_id=8e90b10ccea94aa292a1c993c6d4424c => generated 15 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:06:11.172776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7e9a9805-41f2-48bd-8d32-8af58be3b0ca tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Calling method '.version_select at 0x7f87948c9670>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:12.367701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:06:12.369296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:06:12.371893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:06:12.373030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:06:12.376782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:06:12.401389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:12.402106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:12.403089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:12.403689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:12.449401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Getting quotas for project 492092ab9cd04b469f35de121b33deda. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:06:12.463031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Getting quotas for user cb330c470ebb4a0b9140e8a58d05f6a0 and project 492092ab9cd04b469f35de121b33deda. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:06:12.501070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:06:12.510916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:06:12.591757 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5aa96ebe-e8b3-46ec-ae5f-cc6d0f040276 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.714062 Jul 26 14:06:12.600257 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 342/745] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:06:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:06:12.622199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d0a9c67-5029-4b91-afb0-386f209e811a tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:12.682877 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4d0a9c67-5029-4b91-afb0-386f209e811a tempest-ServersWithSpecificFlavorTestJSON-985441890 tempest-ServersWithSpecificFlavorTestJSON-985441890-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5478 microversion: 2.1 time: 0.080058 Jul 26 14:06:12.685252 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 343/746] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:06:12 2022] GET /compute/v2.1/flavors/detail => generated 5478 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:12.695802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e49f178-bc47-41f2-a849-0d66dc20259a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:12.698195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e49f178-bc47-41f2-a849-0d66dc20259a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:12.716799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e49f178-bc47-41f2-a849-0d66dc20259a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:12.717779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e49f178-bc47-41f2-a849-0d66dc20259a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:12.718891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e49f178-bc47-41f2-a849-0d66dc20259a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:12.719581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e49f178-bc47-41f2-a849-0d66dc20259a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:13.297373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2e49f178-bc47-41f2-a849-0d66dc20259a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:13.314514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e49f178-bc47-41f2-a849-0d66dc20259a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1339 microversion: 2.1 time: 0.625994 Jul 26 14:06:13.315691 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 344/747] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:12 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1339 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:13.328386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b7ab3d2e-2b7b-48f9-8644-b878bf9f0fcc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:13.356512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b7ab3d2e-2b7b-48f9-8644-b878bf9f0fcc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Searching by: {'tenant_id': '8e90b10ccea94aa292a1c993c6d4424c', 'deleted': False} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:06:13.375765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7ab3d2e-2b7b-48f9-8644-b878bf9f0fcc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:13.377941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7ab3d2e-2b7b-48f9-8644-b878bf9f0fcc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:13.379734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7ab3d2e-2b7b-48f9-8644-b878bf9f0fcc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:13.380911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7ab3d2e-2b7b-48f9-8644-b878bf9f0fcc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:13.573471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-b7ab3d2e-2b7b-48f9-8644-b878bf9f0fcc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:06:13.867036 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7e9a9805-41f2-48bd-8d32-8af58be3b0ca tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/5e96c73b-d36e-4560-bfb9-7b1d9a27468d" status: 202 len: 0 microversion: 2.1 time: 2.711369 Jul 26 14:06:13.867992 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 404/748] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:06:11 2022] DELETE /compute/v2.1/os-floating-ips/5e96c73b-d36e-4560-bfb9-7b1d9a27468d => generated 0 bytes in 2715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:13.876601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-efe73ff2-9120-4abb-ad5e-93521779f079 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:13.877245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-efe73ff2-9120-4abb-ad5e-93521779f079 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:13.892072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efe73ff2-9120-4abb-ad5e-93521779f079 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:13.893393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efe73ff2-9120-4abb-ad5e-93521779f079 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:13.895519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efe73ff2-9120-4abb-ad5e-93521779f079 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:13.896424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efe73ff2-9120-4abb-ad5e-93521779f079 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.116379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7ab3d2e-2b7b-48f9-8644-b878bf9f0fcc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.117170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7ab3d2e-2b7b-48f9-8644-b878bf9f0fcc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.188638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-efe73ff2-9120-4abb-ad5e-93521779f079 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:14.204136 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-efe73ff2-9120-4abb-ad5e-93521779f079 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1316 microversion: 2.1 time: 0.334301 Jul 26 14:06:14.205613 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 405/749] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:13 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:14.215818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bbbeb09f-b350-401d-8af0-62f1e94026ff tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:14.217059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bbbeb09f-b350-401d-8af0-62f1e94026ff tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:14.227146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbbeb09f-b350-401d-8af0-62f1e94026ff tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.228566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbbeb09f-b350-401d-8af0-62f1e94026ff tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.230192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbbeb09f-b350-401d-8af0-62f1e94026ff tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.231053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbbeb09f-b350-401d-8af0-62f1e94026ff tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.353818 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b7ab3d2e-2b7b-48f9-8644-b878bf9f0fcc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8e90b10ccea94aa292a1c993c6d4424c" status: 200 len: 4828 microversion: 2.1 time: 1.036304 Jul 26 14:06:14.354731 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 345/750] 10.222.0.70 () {58 vars in 1257 bytes} [Tue Jul 26 14:06:13 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=8e90b10ccea94aa292a1c993c6d4424c => generated 4828 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:14.365573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6cc7b006-9de0-4b31-9164-a02e15d8c246 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:14.366766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6cc7b006-9de0-4b31-9164-a02e15d8c246 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:14.383630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6cc7b006-9de0-4b31-9164-a02e15d8c246 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.385375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6cc7b006-9de0-4b31-9164-a02e15d8c246 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.386277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6cc7b006-9de0-4b31-9164-a02e15d8c246 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.386864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6cc7b006-9de0-4b31-9164-a02e15d8c246 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.541745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bbbeb09f-b350-401d-8af0-62f1e94026ff tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:14.545081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:14.596427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bbbeb09f-b350-401d-8af0-62f1e94026ff tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:14.599315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bbbeb09f-b350-401d-8af0-62f1e94026ff tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:14.600801 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bbbeb09f-b350-401d-8af0-62f1e94026ff tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1567 microversion: 2.25 time: 0.393533 Jul 26 14:06:14.602164 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 406/751] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:14 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1567 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:14.612087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ae51d79-f50c-4194-93c0-64f9ecdef2a9 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:14.613100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5ae51d79-f50c-4194-93c0-64f9ecdef2a9 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:14.624851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ae51d79-f50c-4194-93c0-64f9ecdef2a9 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.626242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ae51d79-f50c-4194-93c0-64f9ecdef2a9 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.627656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ae51d79-f50c-4194-93c0-64f9ecdef2a9 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.629191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ae51d79-f50c-4194-93c0-64f9ecdef2a9 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.675573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6cc7b006-9de0-4b31-9164-a02e15d8c246 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:14.694365 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6cc7b006-9de0-4b31-9164-a02e15d8c246 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 200 len: 1324 microversion: 2.1 time: 0.337216 Jul 26 14:06:14.695663 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 346/752] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:14 2022] GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:14.738597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-292af7f1-231b-4e13-9e81-c3e65ae7eb06 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:14.739333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-292af7f1-231b-4e13-9e81-c3e65ae7eb06 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:14.748807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-292af7f1-231b-4e13-9e81-c3e65ae7eb06 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.749797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-292af7f1-231b-4e13-9e81-c3e65ae7eb06 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.756245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-292af7f1-231b-4e13-9e81-c3e65ae7eb06 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.757321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-292af7f1-231b-4e13-9e81-c3e65ae7eb06 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.801237 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-292af7f1-231b-4e13-9e81-c3e65ae7eb06 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] HTTP exception thrown: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-292af7f1-231b-4e13-9e81-c3e65ae7eb06 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Request method failure captured: Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 HTTP/1.1 Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QnA6rofr9HuDYfYNllQZK254p-r3F6roWRsB54ahA3eZrgyONZe7-_dmKLqcj5klZbATc8bDeXu2iQhFDTUHoX_M-uZU7YC5LHV2jUhvvW4L45IQtaXGwqMbwEuwGXU6hJ77E3uxHwYEC1du9XqnCG5DHYAitWsTZLO0CNgbmhndA Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:06:14.808390 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2853b779839a488cb28341b8a9744c60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2853b779839a488cb28341b8a9744c60", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}] Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b41f5df8d0844f078e147aa5f454d5d3 Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:06:14.810927 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '9611ccf6-16ec-4945-aecf-3cfcb058ec91'} Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:06:14.812495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:06:14.814641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:14.823672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-292af7f1-231b-4e13-9e81-c3e65ae7eb06 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Returning 404 to user: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:06:14.825792 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-292af7f1-231b-4e13-9e81-c3e65ae7eb06 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 404 len: 111 microversion: 2.1 time: 0.114783 Jul 26 14:06:14.833606 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 347/753] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:06:14 2022] DELETE /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:06:14.835679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5ae51d79-f50c-4194-93c0-64f9ecdef2a9 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:14.847212 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ae51d79-f50c-4194-93c0-64f9ecdef2a9 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1235 microversion: 2.1 time: 0.242900 Jul 26 14:06:14.847813 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 407/754] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:14 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1235 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:14.850209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2f31472f-14e7-48b5-81ea-f0be45960a08 req-b3571067-5b69-4714-85f1-891fd3fb2311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ff036a-5fa7-4b56-af8a-afd163f7c3b5", "tag": "191708b4-b957-42c3-a0aa-284ad81e99c7"}, {"name": "network-changed", "server_uuid": "79382aab-866e-4dbd-ab77-400cdedef926", "tag": "4774806d-f309-48d1-8829-26baf46f3ce5"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:14.874286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2f31472f-14e7-48b5-81ea-f0be45960a08 req-b3571067-5b69-4714-85f1-891fd3fb2311 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.874499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2f31472f-14e7-48b5-81ea-f0be45960a08 req-b3571067-5b69-4714-85f1-891fd3fb2311 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.900708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-977935fe-c14a-40b6-bf29-4610571c4fbf tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] Calling method '.version_select at 0x7f87946f2e50>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:14.910546 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2f31472f-14e7-48b5-81ea-f0be45960a08 req-b3571067-5b69-4714-85f1-891fd3fb2311 service nova] Creating event network-changed:191708b4-b957-42c3-a0aa-284ad81e99c7 for instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 on n-h1-833090-9 Jul 26 14:06:14.911126 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2f31472f-14e7-48b5-81ea-f0be45960a08 req-b3571067-5b69-4714-85f1-891fd3fb2311 service nova] Creating event network-changed:4774806d-f309-48d1-8829-26baf46f3ce5 for instance 79382aab-866e-4dbd-ab77-400cdedef926 on n-h2-833090-9 Jul 26 14:06:14.940061 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2f31472f-14e7-48b5-81ea-f0be45960a08 req-b3571067-5b69-4714-85f1-891fd3fb2311 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.103626 Jul 26 14:06:14.942845 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 348/755] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:14.954043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-85d88191-029a-41c9-b51d-67b7220396bd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:14.960478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-85d88191-029a-41c9-b51d-67b7220396bd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:14.978591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85d88191-029a-41c9-b51d-67b7220396bd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.979518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85d88191-029a-41c9-b51d-67b7220396bd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:14.980881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85d88191-029a-41c9-b51d-67b7220396bd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:14.981555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85d88191-029a-41c9-b51d-67b7220396bd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:15.506924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-85d88191-029a-41c9-b51d-67b7220396bd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:15.521914 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-85d88191-029a-41c9-b51d-67b7220396bd tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1379 microversion: 2.1 time: 0.573958 Jul 26 14:06:15.541472 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 349/756] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:14 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1379 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:15.541472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86455a69-0521-4814-a232-46598cb00db0 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:15.541472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-86455a69-0521-4814-a232-46598cb00db0 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Searching by: {'tenant_id': 'c6ed5e35b5a84bcc949f849042090d10', 'deleted': False} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:06:15.553113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86455a69-0521-4814-a232-46598cb00db0 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:15.553995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86455a69-0521-4814-a232-46598cb00db0 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:15.556785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86455a69-0521-4814-a232-46598cb00db0 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:15.557597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86455a69-0521-4814-a232-46598cb00db0 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:15.598594 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-86455a69-0521-4814-a232-46598cb00db0 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c6ed5e35b5a84bcc949f849042090d10" status: 200 len: 15 microversion: 2.1 time: 0.071636 Jul 26 14:06:15.599196 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 350/757] 10.222.0.70 () {58 vars in 1257 bytes} [Tue Jul 26 14:06:15 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c6ed5e35b5a84bcc949f849042090d10 => generated 15 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:06:15.605879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-feea0961-82fb-42d7-af03-bcb067794888 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:15.606527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-feea0961-82fb-42d7-af03-bcb067794888 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 9611ccf6-16ec-4945-aecf-3cfcb058ec91] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:15.617080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feea0961-82fb-42d7-af03-bcb067794888 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:15.618134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feea0961-82fb-42d7-af03-bcb067794888 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:15.619808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feea0961-82fb-42d7-af03-bcb067794888 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:15.620783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feea0961-82fb-42d7-af03-bcb067794888 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:15.657190 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-feea0961-82fb-42d7-af03-bcb067794888 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] HTTP exception thrown: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-feea0961-82fb-42d7-af03-bcb067794888 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Request method failure captured: Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 HTTP/1.1 Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QnA6rofr9HuDYfYNllQZK254p-r3F6roWRsB54ahA3eZrgyONZe7-_dmKLqcj5klZbATc8bDeXu2iQhFDTUHoX_M-uZU7YC5LHV2jUhvvW4L45IQtaXGwqMbwEuwGXU6hJ77E3uxHwYEC1du9XqnCG5DHYAitWsTZLO0CNgbmhndA Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:06:15.659424 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2853b779839a488cb28341b8a9744c60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2853b779839a488cb28341b8a9744c60", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}] Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b41f5df8d0844f078e147aa5f454d5d3 Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:06:15.660797 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '9611ccf6-16ec-4945-aecf-3cfcb058ec91'} Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:06:15.662729 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. Jul 26 14:06:15.663937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:15.667288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-feea0961-82fb-42d7-af03-bcb067794888 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Returning 404 to user: Instance 9611ccf6-16ec-4945-aecf-3cfcb058ec91 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:06:15.668531 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-feea0961-82fb-42d7-af03-bcb067794888 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91" status: 404 len: 111 microversion: 2.1 time: 0.067988 Jul 26 14:06:15.670383 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 351/758] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:15 2022] GET /compute/v2.1/servers/9611ccf6-16ec-4945-aecf-3cfcb058ec91 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:06:15.675723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-83f641f8-5aca-4b42-b168-5d0899d9cc6f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:15.677144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-83f641f8-5aca-4b42-b168-5d0899d9cc6f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:15.685462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83f641f8-5aca-4b42-b168-5d0899d9cc6f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:15.686278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83f641f8-5aca-4b42-b168-5d0899d9cc6f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:15.692453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83f641f8-5aca-4b42-b168-5d0899d9cc6f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:15.693669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83f641f8-5aca-4b42-b168-5d0899d9cc6f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:16.192427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-83f641f8-5aca-4b42-b168-5d0899d9cc6f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:16.211126 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-83f641f8-5aca-4b42-b168-5d0899d9cc6f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1316 microversion: 2.1 time: 0.539350 Jul 26 14:06:16.225338 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 352/759] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:15 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1316 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:16.238047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9dcc4a05-b40a-486d-965e-c13250d589bd tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:16.252992 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9dcc4a05-b40a-486d-965e-c13250d589bd tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.026004 Jul 26 14:06:16.255527 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 353/760] 10.222.0.70 () {58 vars in 1189 bytes} [Tue Jul 26 14:06:16 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:06:16.263018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4c459281-8e1c-46ce-9c38-d17abfc621dc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:16.264912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4c459281-8e1c-46ce-9c38-d17abfc621dc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:16.286592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c459281-8e1c-46ce-9c38-d17abfc621dc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:16.287647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c459281-8e1c-46ce-9c38-d17abfc621dc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:16.290525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c459281-8e1c-46ce-9c38-d17abfc621dc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:16.291060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c459281-8e1c-46ce-9c38-d17abfc621dc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:16.789808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4c459281-8e1c-46ce-9c38-d17abfc621dc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:16.812446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4c459281-8e1c-46ce-9c38-d17abfc621dc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:16.819005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4c459281-8e1c-46ce-9c38-d17abfc621dc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:16.821374 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4c459281-8e1c-46ce-9c38-d17abfc621dc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1567 microversion: 2.25 time: 0.566056 Jul 26 14:06:16.825693 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 354/761] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:16 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1567 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:16.836417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c0424ab-a6b6-401a-9928-c6a2fa032a50 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:16.838361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0c0424ab-a6b6-401a-9928-c6a2fa032a50 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:16.854597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0424ab-a6b6-401a-9928-c6a2fa032a50 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:16.855734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0424ab-a6b6-401a-9928-c6a2fa032a50 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:16.856962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0424ab-a6b6-401a-9928-c6a2fa032a50 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:16.857740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0424ab-a6b6-401a-9928-c6a2fa032a50 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:16.879720 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-0c0424ab-a6b6-401a-9928-c6a2fa032a50 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] HTTP exception thrown: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c0424ab-a6b6-401a-9928-c6a2fa032a50 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Request method failure captured: Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae HTTP/1.1 Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QnA6rofr9HuDYfYNllQZK254p-r3F6roWRsB54ahA3eZrgyONZe7-_dmKLqcj5klZbATc8bDeXu2iQhFDTUHoX_M-uZU7YC5LHV2jUhvvW4L45IQtaXGwqMbwEuwGXU6hJ77E3uxHwYEC1du9XqnCG5DHYAitWsTZLO0CNgbmhndA Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:06:16.881934 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2853b779839a488cb28341b8a9744c60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2853b779839a488cb28341b8a9744c60", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}] Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b41f5df8d0844f078e147aa5f454d5d3 Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:06:16.885792 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae'} Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:06:16.887227 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:06:16.891033 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:16.893974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c0424ab-a6b6-401a-9928-c6a2fa032a50 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Returning 404 to user: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:06:16.893974 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c0424ab-a6b6-401a-9928-c6a2fa032a50 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 404 len: 111 microversion: 2.1 time: 0.056552 Jul 26 14:06:16.893974 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 355/762] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:06:16 2022] DELETE /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:06:16.899851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8bafd264-06c7-4eed-b011-271b10afb600 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:16.901696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8bafd264-06c7-4eed-b011-271b10afb600 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:16.926669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bafd264-06c7-4eed-b011-271b10afb600 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:16.927713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bafd264-06c7-4eed-b011-271b10afb600 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:16.929233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bafd264-06c7-4eed-b011-271b10afb600 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:16.930045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bafd264-06c7-4eed-b011-271b10afb600 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:17.108108 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-977935fe-c14a-40b6-bf29-4610571c4fbf tempest-FloatingIPDetailsTestJSON-1030494054 tempest-FloatingIPDetailsTestJSON-1030494054-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/df100c37-dd05-47f8-b5aa-fd5aad209759" status: 202 len: 0 microversion: 2.1 time: 2.244621 Jul 26 14:06:17.109983 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 408/763] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:06:14 2022] DELETE /compute/v2.1/os-floating-ips/df100c37-dd05-47f8-b5aa-fd5aad209759 => generated 0 bytes in 2261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:17.138403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d91c8c8-ec93-4289-94fc-be0ceaf91dea tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:17.139766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0d91c8c8-ec93-4289-94fc-be0ceaf91dea tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:17.168427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d91c8c8-ec93-4289-94fc-be0ceaf91dea tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:17.176231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d91c8c8-ec93-4289-94fc-be0ceaf91dea tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:17.183978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d91c8c8-ec93-4289-94fc-be0ceaf91dea tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:17.187781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d91c8c8-ec93-4289-94fc-be0ceaf91dea tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:17.373199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0d91c8c8-ec93-4289-94fc-be0ceaf91dea tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:17.378137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8bafd264-06c7-4eed-b011-271b10afb600 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:17.386191 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8bafd264-06c7-4eed-b011-271b10afb600 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 200 len: 1324 microversion: 2.1 time: 0.493321 Jul 26 14:06:17.386786 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 356/764] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:16 2022] GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:17.401728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-629b0a4a-72b0-4468-835c-c6fbfd0b8499 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:17.412310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-629b0a4a-72b0-4468-835c-c6fbfd0b8499 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:17.420195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-629b0a4a-72b0-4468-835c-c6fbfd0b8499 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:17.420823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-629b0a4a-72b0-4468-835c-c6fbfd0b8499 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:17.421953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-629b0a4a-72b0-4468-835c-c6fbfd0b8499 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:17.423421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-629b0a4a-72b0-4468-835c-c6fbfd0b8499 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:17.426219 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0d91c8c8-ec93-4289-94fc-be0ceaf91dea tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1289 microversion: 2.1 time: 0.313679 Jul 26 14:06:17.428357 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 409/765] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:17 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1289 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:17.436339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-69f534e5-811d-4e75-88f2-966ededac43b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:17.437712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-69f534e5-811d-4e75-88f2-966ededac43b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:17.450438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69f534e5-811d-4e75-88f2-966ededac43b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:17.451596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69f534e5-811d-4e75-88f2-966ededac43b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:17.453437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69f534e5-811d-4e75-88f2-966ededac43b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:17.454483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69f534e5-811d-4e75-88f2-966ededac43b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:17.529479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:17.579714 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-629b0a4a-72b0-4468-835c-c6fbfd0b8499 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action" status: 202 len: 0 microversion: 2.1 time: 0.191409 Jul 26 14:06:17.584063 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 357/766] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:17 2022] POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:17.586912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d932ae89-2975-4250-ae97-049ea03e79f0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:17.588214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d932ae89-2975-4250-ae97-049ea03e79f0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] [instance: 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:17.596280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d932ae89-2975-4250-ae97-049ea03e79f0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:17.596740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d932ae89-2975-4250-ae97-049ea03e79f0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:17.598614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d932ae89-2975-4250-ae97-049ea03e79f0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:17.598614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d932ae89-2975-4250-ae97-049ea03e79f0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:17.616588 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d932ae89-2975-4250-ae97-049ea03e79f0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] HTTP exception thrown: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d932ae89-2975-4250-ae97-049ea03e79f0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Request method failure captured: Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae HTTP/1.1 Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QnA6rofr9HuDYfYNllQZK254p-r3F6roWRsB54ahA3eZrgyONZe7-_dmKLqcj5klZbATc8bDeXu2iQhFDTUHoX_M-uZU7YC5LHV2jUhvvW4L45IQtaXGwqMbwEuwGXU6hJ77E3uxHwYEC1du9XqnCG5DHYAitWsTZLO0CNgbmhndA Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:06:17.618772 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2853b779839a488cb28341b8a9744c60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2853b779839a488cb28341b8a9744c60", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2853b779839a488cb28341b8a9744c60"}]}] Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2853b779839a488cb28341b8a9744c60 Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866 Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b41f5df8d0844f078e147aa5f454d5d3 Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-527159866-project Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:06:17.621725 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae'} Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:06:17.624816 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. Jul 26 14:06:17.627159 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:06:17.631453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d932ae89-2975-4250-ae97-049ea03e79f0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] Returning 404 to user: Instance 5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:06:17.631453 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d932ae89-2975-4250-ae97-049ea03e79f0 tempest-ServersWithSpecificFlavorTestJSON-527159866 tempest-ServersWithSpecificFlavorTestJSON-527159866-project] 10.222.0.70 "GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae" status: 404 len: 111 microversion: 2.1 time: 0.038904 Jul 26 14:06:17.631453 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 358/767] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:17 2022] GET /compute/v2.1/servers/5962ad8a-da95-47fb-bcd2-0b70e6b0c1ae => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:06:17.631453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c239207-5a2b-4ab9-8fe7-44d36d6c88e7 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:17.631453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5c239207-5a2b-4ab9-8fe7-44d36d6c88e7 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:17.633691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c239207-5a2b-4ab9-8fe7-44d36d6c88e7 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:17.634777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c239207-5a2b-4ab9-8fe7-44d36d6c88e7 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:17.635539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c239207-5a2b-4ab9-8fe7-44d36d6c88e7 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:17.636183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c239207-5a2b-4ab9-8fe7-44d36d6c88e7 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:18.028855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-69f534e5-811d-4e75-88f2-966ededac43b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:18.047814 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-69f534e5-811d-4e75-88f2-966ededac43b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1379 microversion: 2.1 time: 0.617410 Jul 26 14:06:18.048569 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 410/768] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:17 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1379 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:18.074455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df98f77a-6731-457c-86e5-b7fc4615662f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:18.094726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df98f77a-6731-457c-86e5-b7fc4615662f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:18.096100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df98f77a-6731-457c-86e5-b7fc4615662f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:06:18.122525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df98f77a-6731-457c-86e5-b7fc4615662f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:18.123685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df98f77a-6731-457c-86e5-b7fc4615662f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:18.125542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df98f77a-6731-457c-86e5-b7fc4615662f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:18.126412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df98f77a-6731-457c-86e5-b7fc4615662f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:18.317675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-df98f77a-6731-457c-86e5-b7fc4615662f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:06:18.428837 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df98f77a-6731-457c-86e5-b7fc4615662f tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.378864 Jul 26 14:06:18.429435 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 411/769] 10.222.0.70 () {58 vars in 1150 bytes} [Tue Jul 26 14:06:18 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:18.435641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-89b9448b-ef8d-4324-a7c9-2f5d5834f632 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:18.436783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-89b9448b-ef8d-4324-a7c9-2f5d5834f632 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:18.444619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89b9448b-ef8d-4324-a7c9-2f5d5834f632 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:18.445303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89b9448b-ef8d-4324-a7c9-2f5d5834f632 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:18.448242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89b9448b-ef8d-4324-a7c9-2f5d5834f632 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:18.448848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89b9448b-ef8d-4324-a7c9-2f5d5834f632 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:18.779294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5c239207-5a2b-4ab9-8fe7-44d36d6c88e7 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:18.807588 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5c239207-5a2b-4ab9-8fe7-44d36d6c88e7 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1316 microversion: 2.1 time: 1.176379 Jul 26 14:06:18.808398 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 359/770] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:17 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1316 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:18.828756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-dd4a3be4-3858-4839-92a5-b36032473246 req-c3ff50a5-a58d-4eb6-b3d2-7d78c75948b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ff036a-5fa7-4b56-af8a-afd163f7c3b5", "name": "network-vif-unplugged", "status": "completed", "tag": "191708b4-b957-42c3-a0aa-284ad81e99c7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:18.847209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-dd4a3be4-3858-4839-92a5-b36032473246 req-c3ff50a5-a58d-4eb6-b3d2-7d78c75948b1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:18.847805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-dd4a3be4-3858-4839-92a5-b36032473246 req-c3ff50a5-a58d-4eb6-b3d2-7d78c75948b1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:18.864964 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-dd4a3be4-3858-4839-92a5-b36032473246 req-c3ff50a5-a58d-4eb6-b3d2-7d78c75948b1 service nova] Creating event network-vif-unplugged:191708b4-b957-42c3-a0aa-284ad81e99c7 for instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 on n-h1-833090-9 Jul 26 14:06:18.872944 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-dd4a3be4-3858-4839-92a5-b36032473246 req-c3ff50a5-a58d-4eb6-b3d2-7d78c75948b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058947 Jul 26 14:06:18.873788 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 360/771] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:18.879581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9b609799-a6f1-4d5f-a3ee-50a4ccc13536 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:18.880690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9b609799-a6f1-4d5f-a3ee-50a4ccc13536 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:18.889386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b609799-a6f1-4d5f-a3ee-50a4ccc13536 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:18.890260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b609799-a6f1-4d5f-a3ee-50a4ccc13536 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:18.891499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b609799-a6f1-4d5f-a3ee-50a4ccc13536 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:18.892243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b609799-a6f1-4d5f-a3ee-50a4ccc13536 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:19.153857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-89b9448b-ef8d-4324-a7c9-2f5d5834f632 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:19.194142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-89b9448b-ef8d-4324-a7c9-2f5d5834f632 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:19.201590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-89b9448b-ef8d-4324-a7c9-2f5d5834f632 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:19.203886 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-89b9448b-ef8d-4324-a7c9-2f5d5834f632 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1567 microversion: 2.25 time: 0.773005 Jul 26 14:06:19.208318 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 412/772] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:18 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1567 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:19.214807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1de0e0c5-590f-41eb-96c6-5e4cc3728a99 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:19.217779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1de0e0c5-590f-41eb-96c6-5e4cc3728a99 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:19.230744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1de0e0c5-590f-41eb-96c6-5e4cc3728a99 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:19.231909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1de0e0c5-590f-41eb-96c6-5e4cc3728a99 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:19.232818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1de0e0c5-590f-41eb-96c6-5e4cc3728a99 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:19.233262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1de0e0c5-590f-41eb-96c6-5e4cc3728a99 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:19.401568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9b609799-a6f1-4d5f-a3ee-50a4ccc13536 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:19.420240 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9b609799-a6f1-4d5f-a3ee-50a4ccc13536 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 200 len: 1324 microversion: 2.1 time: 0.544787 Jul 26 14:06:19.420881 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 361/773] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:18 2022] GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 1324 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:19.435120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d8ca4d99-c53d-4ad9-80df-f75d11517b5a tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:19.436001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d8ca4d99-c53d-4ad9-80df-f75d11517b5a tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:19.442976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8ca4d99-c53d-4ad9-80df-f75d11517b5a tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:19.443649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8ca4d99-c53d-4ad9-80df-f75d11517b5a tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:19.444683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8ca4d99-c53d-4ad9-80df-f75d11517b5a tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:19.445345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8ca4d99-c53d-4ad9-80df-f75d11517b5a tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:19.466297 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1de0e0c5-590f-41eb-96c6-5e4cc3728a99 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action" status: 202 len: 0 microversion: 2.1 time: 0.255478 Jul 26 14:06:19.471180 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 413/774] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:19 2022] POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:19.481813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-16180336-c020-41c0-b2ee-98589b78cc7a req-b9c9d12b-82ad-4a39-8946-42c27af0779c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79382aab-866e-4dbd-ab77-400cdedef926", "name": "network-vif-plugged", "status": "completed", "tag": "4774806d-f309-48d1-8829-26baf46f3ce5"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:19.506494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-16180336-c020-41c0-b2ee-98589b78cc7a req-b9c9d12b-82ad-4a39-8946-42c27af0779c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:19.507426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-16180336-c020-41c0-b2ee-98589b78cc7a req-b9c9d12b-82ad-4a39-8946-42c27af0779c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:19.534747 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-16180336-c020-41c0-b2ee-98589b78cc7a req-b9c9d12b-82ad-4a39-8946-42c27af0779c service nova] Creating event network-vif-plugged:4774806d-f309-48d1-8829-26baf46f3ce5 for instance 79382aab-866e-4dbd-ab77-400cdedef926 on n-h2-833090-9 Jul 26 14:06:19.542233 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-16180336-c020-41c0-b2ee-98589b78cc7a req-b9c9d12b-82ad-4a39-8946-42c27af0779c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070107 Jul 26 14:06:19.542971 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 414/775] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:19.551684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca6535be-313d-45ad-8c94-997127a69caf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:19.552884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ca6535be-313d-45ad-8c94-997127a69caf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:19.562446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca6535be-313d-45ad-8c94-997127a69caf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:19.563144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca6535be-313d-45ad-8c94-997127a69caf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:19.564223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca6535be-313d-45ad-8c94-997127a69caf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:19.564503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca6535be-313d-45ad-8c94-997127a69caf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:19.960009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d8ca4d99-c53d-4ad9-80df-f75d11517b5a tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:19.972804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d8ca4d99-c53d-4ad9-80df-f75d11517b5a tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1331 microversion: 2.1 time: 0.541202 Jul 26 14:06:19.987341 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 362/776] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:19 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1331 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:19.997636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e993b11d-45c0-458f-8fc0-39a169cbb9fc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:19.998632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e993b11d-45c0-458f-8fc0-39a169cbb9fc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:20.008845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e993b11d-45c0-458f-8fc0-39a169cbb9fc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:20.010058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e993b11d-45c0-458f-8fc0-39a169cbb9fc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:20.012393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e993b11d-45c0-458f-8fc0-39a169cbb9fc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:20.013216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e993b11d-45c0-458f-8fc0-39a169cbb9fc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:20.195122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ca6535be-313d-45ad-8c94-997127a69caf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:20.209557 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca6535be-313d-45ad-8c94-997127a69caf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1379 microversion: 2.1 time: 0.659724 Jul 26 14:06:20.219775 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 415/777] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:19 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1379 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:20.225606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73cab49f-aff4-4649-99d7-243b34eb43e2 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:20.226530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-73cab49f-aff4-4649-99d7-243b34eb43e2 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:20.236504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73cab49f-aff4-4649-99d7-243b34eb43e2 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:20.236965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73cab49f-aff4-4649-99d7-243b34eb43e2 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:20.237743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73cab49f-aff4-4649-99d7-243b34eb43e2 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:20.238425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73cab49f-aff4-4649-99d7-243b34eb43e2 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:20.246309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:20.596529 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e993b11d-45c0-458f-8fc0-39a169cbb9fc tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1615 microversion: 2.1 time: 0.605747 Jul 26 14:06:20.598693 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 363/778] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:19 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1615 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:20.616519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87781bd6-2e61-470d-90ac-b1075bdd8d19 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:20.618511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-87781bd6-2e61-470d-90ac-b1075bdd8d19 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:20.622756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-73cab49f-aff4-4649-99d7-243b34eb43e2 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:20.631332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87781bd6-2e61-470d-90ac-b1075bdd8d19 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:20.632014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87781bd6-2e61-470d-90ac-b1075bdd8d19 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:20.632963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87781bd6-2e61-470d-90ac-b1075bdd8d19 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:20.633776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87781bd6-2e61-470d-90ac-b1075bdd8d19 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:20.639042 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-73cab49f-aff4-4649-99d7-243b34eb43e2 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1316 microversion: 2.1 time: 0.417670 Jul 26 14:06:20.653026 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 416/779] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:20 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:20.667895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3b56f532-7668-48d1-bc2e-83622c7f5699 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:20.669354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3b56f532-7668-48d1-bc2e-83622c7f5699 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:20.676813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b56f532-7668-48d1-bc2e-83622c7f5699 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:20.677619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b56f532-7668-48d1-bc2e-83622c7f5699 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:20.678659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b56f532-7668-48d1-bc2e-83622c7f5699 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:20.679307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b56f532-7668-48d1-bc2e-83622c7f5699 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:21.198370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-87781bd6-2e61-470d-90ac-b1075bdd8d19 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:21.218534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-87781bd6-2e61-470d-90ac-b1075bdd8d19 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:21.225884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-87781bd6-2e61-470d-90ac-b1075bdd8d19 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:21.229318 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-87781bd6-2e61-470d-90ac-b1075bdd8d19 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1567 microversion: 2.25 time: 0.627941 Jul 26 14:06:21.235486 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 364/780] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:20 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1567 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:21.241147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-04c9db19-d9c9-4191-828c-d4aae53be11d tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:21.241856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-04c9db19-d9c9-4191-828c-d4aae53be11d tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:21.257548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04c9db19-d9c9-4191-828c-d4aae53be11d tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:21.258824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04c9db19-d9c9-4191-828c-d4aae53be11d tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:21.261362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04c9db19-d9c9-4191-828c-d4aae53be11d tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:21.262029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04c9db19-d9c9-4191-828c-d4aae53be11d tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:21.267070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3b56f532-7668-48d1-bc2e-83622c7f5699 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:21.284669 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3b56f532-7668-48d1-bc2e-83622c7f5699 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 200 len: 1324 microversion: 2.1 time: 0.629374 Jul 26 14:06:21.286765 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 417/781] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:20 2022] GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 1324 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:21.299184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-c60d369c-7693-40d0-b67d-e5626c65d0c3 req-f4f88a81-524e-4092-892f-75a6054f582a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c20b152-e109-4ec5-882c-9640b942901e", "tag": "0023117a-fed6-48c7-9154-388efdf05982"}, {"name": "network-changed", "server_uuid": "b122f14c-3b42-4a25-9908-f4b9fb64a2f2", "tag": "26dcbb26-ecb6-4dc2-8c29-abb0b023eb10"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:21.322138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c60d369c-7693-40d0-b67d-e5626c65d0c3 req-f4f88a81-524e-4092-892f-75a6054f582a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:21.323718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c60d369c-7693-40d0-b67d-e5626c65d0c3 req-f4f88a81-524e-4092-892f-75a6054f582a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:21.354357 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-c60d369c-7693-40d0-b67d-e5626c65d0c3 req-f4f88a81-524e-4092-892f-75a6054f582a service nova] Creating event network-changed:0023117a-fed6-48c7-9154-388efdf05982 for instance 8c20b152-e109-4ec5-882c-9640b942901e on n-h2-833090-9 Jul 26 14:06:21.354944 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-c60d369c-7693-40d0-b67d-e5626c65d0c3 req-f4f88a81-524e-4092-892f-75a6054f582a service nova] Creating event network-changed:26dcbb26-ecb6-4dc2-8c29-abb0b023eb10 for instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 on n-h1-833090-9 Jul 26 14:06:21.372478 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-c60d369c-7693-40d0-b67d-e5626c65d0c3 req-f4f88a81-524e-4092-892f-75a6054f582a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083048 Jul 26 14:06:21.373559 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 418/782] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:21.386080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fcc7f35f-0a68-4f87-b5e3-2ae4f8d4aec4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:21.388243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fcc7f35f-0a68-4f87-b5e3-2ae4f8d4aec4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:21.400727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcc7f35f-0a68-4f87-b5e3-2ae4f8d4aec4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:21.401864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcc7f35f-0a68-4f87-b5e3-2ae4f8d4aec4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:21.403512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcc7f35f-0a68-4f87-b5e3-2ae4f8d4aec4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:21.404835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcc7f35f-0a68-4f87-b5e3-2ae4f8d4aec4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:21.803507 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-04c9db19-d9c9-4191-828c-d4aae53be11d tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1615 microversion: 2.1 time: 0.566290 Jul 26 14:06:21.804134 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 365/783] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:21 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1615 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:21.814284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bbacfcdb-8c3f-4b8f-979a-f84e4bc6d8d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:21.819454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bbacfcdb-8c3f-4b8f-979a-f84e4bc6d8d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:21.835378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbacfcdb-8c3f-4b8f-979a-f84e4bc6d8d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:21.836068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbacfcdb-8c3f-4b8f-979a-f84e4bc6d8d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:21.837835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbacfcdb-8c3f-4b8f-979a-f84e4bc6d8d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:21.838677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbacfcdb-8c3f-4b8f-979a-f84e4bc6d8d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:21.874919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fcc7f35f-0a68-4f87-b5e3-2ae4f8d4aec4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:21.887580 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fcc7f35f-0a68-4f87-b5e3-2ae4f8d4aec4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1331 microversion: 2.1 time: 0.511416 Jul 26 14:06:21.889064 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 419/784] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:21 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1331 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:21.897241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-230363d6-7f62-4254-9816-907ea706a445 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:21.898286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-230363d6-7f62-4254-9816-907ea706a445 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:21.910850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-230363d6-7f62-4254-9816-907ea706a445 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:21.911330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-230363d6-7f62-4254-9816-907ea706a445 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:21.912149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-230363d6-7f62-4254-9816-907ea706a445 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:21.912588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-230363d6-7f62-4254-9816-907ea706a445 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:22.666979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bbacfcdb-8c3f-4b8f-979a-f84e4bc6d8d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:22.698572 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bbacfcdb-8c3f-4b8f-979a-f84e4bc6d8d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1379 microversion: 2.1 time: 0.892840 Jul 26 14:06:22.699991 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 366/785] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:21 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1379 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:22.708163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b5f17bcc-8cfd-445c-8131-f4b3815a2e20 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:22.721043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b5f17bcc-8cfd-445c-8131-f4b3815a2e20 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Searching by: {'host': 'n-h1-833090-9', 'deleted': False} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:06:22.730832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5f17bcc-8cfd-445c-8131-f4b3815a2e20 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:22.731916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5f17bcc-8cfd-445c-8131-f4b3815a2e20 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:22.734203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5f17bcc-8cfd-445c-8131-f4b3815a2e20 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:22.735699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5f17bcc-8cfd-445c-8131-f4b3815a2e20 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:22.752804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-230363d6-7f62-4254-9816-907ea706a445 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:22.768732 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-230363d6-7f62-4254-9816-907ea706a445 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1316 microversion: 2.1 time: 0.877934 Jul 26 14:06:22.777770 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 420/786] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:21 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1316 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:22.792069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8fba50cf-e801-4962-9e18-9d248a9a1bfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:22.793030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8fba50cf-e801-4962-9e18-9d248a9a1bfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:22.802172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fba50cf-e801-4962-9e18-9d248a9a1bfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:22.802827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fba50cf-e801-4962-9e18-9d248a9a1bfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:22.803943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fba50cf-e801-4962-9e18-9d248a9a1bfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:22.804860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fba50cf-e801-4962-9e18-9d248a9a1bfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:22.887840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-b5f17bcc-8cfd-445c-8131-f4b3815a2e20 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:06:22.964167 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b5f17bcc-8cfd-445c-8131-f4b3815a2e20 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers?host=n-h1-833090-9&all_tenants=1" status: 200 len: 1650 microversion: 2.1 time: 0.262289 Jul 26 14:06:22.964765 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 367/787] 10.222.0.70 () {58 vars in 1190 bytes} [Tue Jul 26 14:06:22 2022] GET /compute/v2.1/servers?host=n-h1-833090-9&all_tenants=1 => generated 1650 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:22.977640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-066fcc91-946a-4968-b873-1601d104dbda tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:22.978928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-066fcc91-946a-4968-b873-1601d104dbda tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:22.989181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-066fcc91-946a-4968-b873-1601d104dbda tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:22.989764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-066fcc91-946a-4968-b873-1601d104dbda tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:22.990856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-066fcc91-946a-4968-b873-1601d104dbda tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:22.991300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-066fcc91-946a-4968-b873-1601d104dbda tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.313000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8fba50cf-e801-4962-9e18-9d248a9a1bfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:23.327220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8fba50cf-e801-4962-9e18-9d248a9a1bfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:23.329964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8fba50cf-e801-4962-9e18-9d248a9a1bfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:23.331442 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8fba50cf-e801-4962-9e18-9d248a9a1bfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1567 microversion: 2.25 time: 0.545798 Jul 26 14:06:23.343982 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 421/788] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:22 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1567 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:23.343982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f5fa1ff0-3ad6-47d5-99e6-696276768485 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:23.343982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f5fa1ff0-3ad6-47d5-99e6-696276768485 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:23.352962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5fa1ff0-3ad6-47d5-99e6-696276768485 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.352962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5fa1ff0-3ad6-47d5-99e6-696276768485 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.357467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5fa1ff0-3ad6-47d5-99e6-696276768485 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.357467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5fa1ff0-3ad6-47d5-99e6-696276768485 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.521794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-066fcc91-946a-4968-b873-1601d104dbda tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:23.533005 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-066fcc91-946a-4968-b873-1601d104dbda tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 200 len: 1324 microversion: 2.1 time: 0.559461 Jul 26 14:06:23.539027 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 368/789] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:22 2022] GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 1324 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:23.545180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4632d51b-fdf4-4550-bc94-0412a752729c tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:23.552492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4632d51b-fdf4-4550-bc94-0412a752729c tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:06:23.565467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4632d51b-fdf4-4550-bc94-0412a752729c tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.566040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4632d51b-fdf4-4550-bc94-0412a752729c tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.566954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4632d51b-fdf4-4550-bc94-0412a752729c tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.567505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4632d51b-fdf4-4550-bc94-0412a752729c tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.616930 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4632d51b-fdf4-4550-bc94-0412a752729c tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.075837 Jul 26 14:06:23.617962 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 369/790] 10.222.0.70 () {58 vars in 1196 bytes} [Tue Jul 26 14:06:23 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:06:23.641191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-baa1d6f1-a5fd-4a90-a18d-d9662b0e26e6 req-bece14b8-2ba1-4810-a488-b31ad34fb773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770654ea-0d11-480c-b5f7-6fb864a9b9dc", "tag": "a338cd22-92c3-454a-82f2-73b6e140b886"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:23.660258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-baa1d6f1-a5fd-4a90-a18d-d9662b0e26e6 req-bece14b8-2ba1-4810-a488-b31ad34fb773 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.661396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-baa1d6f1-a5fd-4a90-a18d-d9662b0e26e6 req-bece14b8-2ba1-4810-a488-b31ad34fb773 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.698278 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-baa1d6f1-a5fd-4a90-a18d-d9662b0e26e6 req-bece14b8-2ba1-4810-a488-b31ad34fb773 service nova] Creating event network-changed:a338cd22-92c3-454a-82f2-73b6e140b886 for instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc on n-h2-833090-9 Jul 26 14:06:23.717364 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-baa1d6f1-a5fd-4a90-a18d-d9662b0e26e6 req-bece14b8-2ba1-4810-a488-b31ad34fb773 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086850 Jul 26 14:06:23.718736 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 370/791] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:23.729332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af025c92-9fa5-43be-ab51-bbfbc380145f tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:23.732254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-af025c92-9fa5-43be-ab51-bbfbc380145f tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:23.756857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af025c92-9fa5-43be-ab51-bbfbc380145f tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.757807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af025c92-9fa5-43be-ab51-bbfbc380145f tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.760162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af025c92-9fa5-43be-ab51-bbfbc380145f tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.761198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af025c92-9fa5-43be-ab51-bbfbc380145f tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.795514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f5fa1ff0-3ad6-47d5-99e6-696276768485 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:23.824179 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f5fa1ff0-3ad6-47d5-99e6-696276768485 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1331 microversion: 2.1 time: 0.490216 Jul 26 14:06:23.829554 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 422/792] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:23 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1331 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:23.850893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0d2daec-fb6c-4579-9d02-37cfe28881ac tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:23.852467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a0d2daec-fb6c-4579-9d02-37cfe28881ac tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:23.876087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d2daec-fb6c-4579-9d02-37cfe28881ac tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.877181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d2daec-fb6c-4579-9d02-37cfe28881ac tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.878804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d2daec-fb6c-4579-9d02-37cfe28881ac tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.889537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d2daec-fb6c-4579-9d02-37cfe28881ac tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.961288 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af025c92-9fa5-43be-ab51-bbfbc380145f tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action" status: 202 len: 0 microversion: 2.1 time: 0.240317 Jul 26 14:06:23.962003 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 371/793] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:23 2022] POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:23.976754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1ee05cf5-718c-4436-8f10-631768372081 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:23.977558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1ee05cf5-718c-4436-8f10-631768372081 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:23.986734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ee05cf5-718c-4436-8f10-631768372081 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.987858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ee05cf5-718c-4436-8f10-631768372081 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:23.989371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ee05cf5-718c-4436-8f10-631768372081 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:23.990961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ee05cf5-718c-4436-8f10-631768372081 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:24.102287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=20 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:24.468250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0d2daec-fb6c-4579-9d02-37cfe28881ac tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:24.473808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ee05cf5-718c-4436-8f10-631768372081 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:24.475721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:24.483370 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a0d2daec-fb6c-4579-9d02-37cfe28881ac tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1379 microversion: 2.1 time: 0.652008 Jul 26 14:06:24.484511 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1ee05cf5-718c-4436-8f10-631768372081 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1316 microversion: 2.1 time: 0.519398 Jul 26 14:06:24.485164 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 372/794] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:23 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:24.486554 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 423/795] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:23 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1379 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:24.491286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:24.495497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:24.499729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b48035f5-9c36-4bbc-9625-25e9f0a2b1b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:24.502593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b48035f5-9c36-4bbc-9625-25e9f0a2b1b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:24.506689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:24.507368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:24.513993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:24.516185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:24.517476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b48035f5-9c36-4bbc-9625-25e9f0a2b1b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:24.518998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b48035f5-9c36-4bbc-9625-25e9f0a2b1b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:24.522919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b48035f5-9c36-4bbc-9625-25e9f0a2b1b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:24.524224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b48035f5-9c36-4bbc-9625-25e9f0a2b1b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:24.699531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:06:24.711066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:06:24.715341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:06:24.715341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:06:24.715341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:06:24.768069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:24.828878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b48035f5-9c36-4bbc-9625-25e9f0a2b1b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:24.842870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b48035f5-9c36-4bbc-9625-25e9f0a2b1b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:24.845192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b48035f5-9c36-4bbc-9625-25e9f0a2b1b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:24.851411 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b48035f5-9c36-4bbc-9625-25e9f0a2b1b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1567 microversion: 2.25 time: 0.362311 Jul 26 14:06:24.852382 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 424/796] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:24 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1567 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:24.867013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-676109ec-24b5-4d12-9145-a7a73285c933 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:24.869801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-676109ec-24b5-4d12-9145-a7a73285c933 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:24.891552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-676109ec-24b5-4d12-9145-a7a73285c933 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:24.912912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-676109ec-24b5-4d12-9145-a7a73285c933 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:24.921330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-676109ec-24b5-4d12-9145-a7a73285c933 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:24.922896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:24.924559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-676109ec-24b5-4d12-9145-a7a73285c933 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:24.950529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:24.953219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:24.954335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:24.955051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:25.038174 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fa9b5340-89f2-4766-971f-349c653a9449 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action" status: 202 len: 1068 microversion: 2.1 time: 0.551214 Jul 26 14:06:25.052284 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 373/797] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:24 2022] POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action => generated 1068 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 14:06:25.058855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dcfbda83-4198-4a0f-9a49-ca72533a44b6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:25.059999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dcfbda83-4198-4a0f-9a49-ca72533a44b6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:25.084608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcfbda83-4198-4a0f-9a49-ca72533a44b6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:25.088377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcfbda83-4198-4a0f-9a49-ca72533a44b6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:25.089924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcfbda83-4198-4a0f-9a49-ca72533a44b6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:25.093906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcfbda83-4198-4a0f-9a49-ca72533a44b6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:25.399534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-676109ec-24b5-4d12-9145-a7a73285c933 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:25.432778 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-676109ec-24b5-4d12-9145-a7a73285c933 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 200 len: 1520 microversion: 2.1 time: 0.575144 Jul 26 14:06:25.435789 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 425/798] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:24 2022] GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 1520 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:25.449264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-705025f3-d5f8-40a0-8062-9b22a6fbeae5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:25.466687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-705025f3-d5f8-40a0-8062-9b22a6fbeae5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:25.502173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-705025f3-d5f8-40a0-8062-9b22a6fbeae5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:25.503762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-705025f3-d5f8-40a0-8062-9b22a6fbeae5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:25.512513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-705025f3-d5f8-40a0-8062-9b22a6fbeae5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:25.513617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-705025f3-d5f8-40a0-8062-9b22a6fbeae5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:25.705950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dcfbda83-4198-4a0f-9a49-ca72533a44b6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:25.727837 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dcfbda83-4198-4a0f-9a49-ca72533a44b6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1331 microversion: 2.1 time: 0.673766 Jul 26 14:06:25.729283 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 374/799] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:25 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1331 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:25.741908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Action: 'action', calling method: .version_select at 0x7f8796d2e3a0>, body: {"addFloatingIp": {"address": "172.25.2.170"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:25.748483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:25.753566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:DELETE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:25.763290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:25.764087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:25.765549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:25.766274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:25.839485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-705025f3-d5f8-40a0-8062-9b22a6fbeae5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:25.862731 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-705025f3-d5f8-40a0-8062-9b22a6fbeae5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1472 microversion: 2.1 time: 0.424835 Jul 26 14:06:25.868185 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 426/800] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:25 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1472 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:25.893650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1e6ae68-4144-4951-a30f-6994ff84ab8d tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:25.895067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f1e6ae68-4144-4951-a30f-6994ff84ab8d tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:25.923732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1e6ae68-4144-4951-a30f-6994ff84ab8d tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:25.924592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1e6ae68-4144-4951-a30f-6994ff84ab8d tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:25.926441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1e6ae68-4144-4951-a30f-6994ff84ab8d tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:25.926906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1e6ae68-4144-4951-a30f-6994ff84ab8d tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:25.951542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Acquired lock "refresh_cache-96760807-513a-459f-b4b4-1cf897885ed6" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:06:26.518095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1e6ae68-4144-4951-a30f-6994ff84ab8d tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:26.532029 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f1e6ae68-4144-4951-a30f-6994ff84ab8d tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1316 microversion: 2.1 time: 0.659109 Jul 26 14:06:26.534073 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 427/801] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:25 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:26.541311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-269027c4-dc84-4d8f-8bf2-bfafbe3f7b48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:26.542845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-269027c4-dc84-4d8f-8bf2-bfafbe3f7b48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:26.572662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-269027c4-dc84-4d8f-8bf2-bfafbe3f7b48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:26.573882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-269027c4-dc84-4d8f-8bf2-bfafbe3f7b48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:26.583121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-269027c4-dc84-4d8f-8bf2-bfafbe3f7b48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:26.584422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-269027c4-dc84-4d8f-8bf2-bfafbe3f7b48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:27.077090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-269027c4-dc84-4d8f-8bf2-bfafbe3f7b48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:27.088413 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-269027c4-dc84-4d8f-8bf2-bfafbe3f7b48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1379 microversion: 2.1 time: 0.552871 Jul 26 14:06:27.100651 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 428/802] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:26 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1379 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:27.123400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-827d202c-159e-4e9a-bd00-442bb6529d88 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:27.125036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-827d202c-159e-4e9a-bd00-442bb6529d88 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:27.135542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-827d202c-159e-4e9a-bd00-442bb6529d88 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:27.136759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-827d202c-159e-4e9a-bd00-442bb6529d88 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:27.138472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-827d202c-159e-4e9a-bd00-442bb6529d88 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:27.139521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-827d202c-159e-4e9a-bd00-442bb6529d88 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:27.874606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-827d202c-159e-4e9a-bd00-442bb6529d88 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:27.885953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-827d202c-159e-4e9a-bd00-442bb6529d88 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:27.887845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-827d202c-159e-4e9a-bd00-442bb6529d88 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:27.889273 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-827d202c-159e-4e9a-bd00-442bb6529d88 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1567 microversion: 2.25 time: 0.786688 Jul 26 14:06:27.890161 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 429/803] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:27 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1567 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:27.895175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5821e054-f7bd-445e-8a46-2a71b70c4505 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:27.896186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5821e054-f7bd-445e-8a46-2a71b70c4505 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:27.903430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5821e054-f7bd-445e-8a46-2a71b70c4505 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:27.903765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5821e054-f7bd-445e-8a46-2a71b70c4505 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:27.904904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5821e054-f7bd-445e-8a46-2a71b70c4505 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:27.905532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5821e054-f7bd-445e-8a46-2a71b70c4505 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:28.191648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:28.310853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5821e054-f7bd-445e-8a46-2a71b70c4505 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:28.330570 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5821e054-f7bd-445e-8a46-2a71b70c4505 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1331 microversion: 2.1 time: 0.439057 Jul 26 14:06:28.333374 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 430/804] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:27 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1331 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:28.341610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-656beb14-19a7-4057-84a3-a7c03724a4c7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:28.343528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-656beb14-19a7-4057-84a3-a7c03724a4c7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:28.355031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-656beb14-19a7-4057-84a3-a7c03724a4c7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:28.356678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-656beb14-19a7-4057-84a3-a7c03724a4c7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:28.359017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-656beb14-19a7-4057-84a3-a7c03724a4c7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:28.361258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-656beb14-19a7-4057-84a3-a7c03724a4c7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:28.850975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-656beb14-19a7-4057-84a3-a7c03724a4c7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:28.861243 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-656beb14-19a7-4057-84a3-a7c03724a4c7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1472 microversion: 2.1 time: 0.525042 Jul 26 14:06:28.861633 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 431/805] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:28 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1472 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:28.868668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-048ec79c-9676-4849-935a-877bba2243f2 req-ed8ac41e-5358-43a6-a61b-10f367aaa528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b122f14c-3b42-4a25-9908-f4b9fb64a2f2", "name": "network-vif-plugged", "status": "completed", "tag": "26dcbb26-ecb6-4dc2-8c29-abb0b023eb10"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:28.896972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-048ec79c-9676-4849-935a-877bba2243f2 req-ed8ac41e-5358-43a6-a61b-10f367aaa528 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:28.898178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-048ec79c-9676-4849-935a-877bba2243f2 req-ed8ac41e-5358-43a6-a61b-10f367aaa528 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:28.923147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Building network info cache for instance {{(pid=119478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 14:06:28.927821 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-048ec79c-9676-4849-935a-877bba2243f2 req-ed8ac41e-5358-43a6-a61b-10f367aaa528 service nova] Creating event network-vif-plugged:26dcbb26-ecb6-4dc2-8c29-abb0b023eb10 for instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 on n-h1-833090-9 Jul 26 14:06:28.936205 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-048ec79c-9676-4849-935a-877bba2243f2 req-ed8ac41e-5358-43a6-a61b-10f367aaa528 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073393 Jul 26 14:06:28.937475 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 432/806] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:28.963513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2cb3df31-c40b-4357-83cd-6f320d49e1f3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:28.969474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2cb3df31-c40b-4357-83cd-6f320d49e1f3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:28.984506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cb3df31-c40b-4357-83cd-6f320d49e1f3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:28.985938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cb3df31-c40b-4357-83cd-6f320d49e1f3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:28.988177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cb3df31-c40b-4357-83cd-6f320d49e1f3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:28.990467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cb3df31-c40b-4357-83cd-6f320d49e1f3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:29.499829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2cb3df31-c40b-4357-83cd-6f320d49e1f3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:29.544420 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2cb3df31-c40b-4357-83cd-6f320d49e1f3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1316 microversion: 2.1 time: 0.604577 Jul 26 14:06:29.547587 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 433/807] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:28 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1316 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:29.579281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c9617b69-38d5-46c1-8343-514c8d9e83d9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:29.589628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c9617b69-38d5-46c1-8343-514c8d9e83d9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:29.607188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9617b69-38d5-46c1-8343-514c8d9e83d9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:29.608085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9617b69-38d5-46c1-8343-514c8d9e83d9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:29.609310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9617b69-38d5-46c1-8343-514c8d9e83d9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:29.610124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9617b69-38d5-46c1-8343-514c8d9e83d9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:29.975291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c9617b69-38d5-46c1-8343-514c8d9e83d9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:29.987728 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c9617b69-38d5-46c1-8343-514c8d9e83d9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1379 microversion: 2.1 time: 0.432698 Jul 26 14:06:29.988731 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 434/808] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:29 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1379 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:29.995594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63d8a952-5ac4-4cda-bfea-49e70d71b3dd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:29.997595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63d8a952-5ac4-4cda-bfea-49e70d71b3dd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:30.013713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63d8a952-5ac4-4cda-bfea-49e70d71b3dd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:30.014834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63d8a952-5ac4-4cda-bfea-49e70d71b3dd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:30.016178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63d8a952-5ac4-4cda-bfea-49e70d71b3dd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:30.017501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63d8a952-5ac4-4cda-bfea-49e70d71b3dd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:30.273628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63d8a952-5ac4-4cda-bfea-49e70d71b3dd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:30.298395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63d8a952-5ac4-4cda-bfea-49e70d71b3dd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:30.301501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63d8a952-5ac4-4cda-bfea-49e70d71b3dd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:30.303544 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63d8a952-5ac4-4cda-bfea-49e70d71b3dd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1557 microversion: 2.25 time: 0.313410 Jul 26 14:06:30.306227 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 435/809] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:29 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1557 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:30.311844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-12a6a7b1-462e-4bb2-a75f-81c660761fbc req-40cf6186-22a4-428d-bf1c-b09a0a32aa0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96760807-513a-459f-b4b4-1cf897885ed6", "tag": "55a71149-6922-4955-9d24-b7427e70e88b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:30.336320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-12a6a7b1-462e-4bb2-a75f-81c660761fbc req-40cf6186-22a4-428d-bf1c-b09a0a32aa0f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:30.337102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-12a6a7b1-462e-4bb2-a75f-81c660761fbc req-40cf6186-22a4-428d-bf1c-b09a0a32aa0f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:30.359096 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-12a6a7b1-462e-4bb2-a75f-81c660761fbc req-40cf6186-22a4-428d-bf1c-b09a0a32aa0f service nova] Creating event network-changed:55a71149-6922-4955-9d24-b7427e70e88b for instance 96760807-513a-459f-b4b4-1cf897885ed6 on n-h2-833090-9 Jul 26 14:06:30.365171 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-12a6a7b1-462e-4bb2-a75f-81c660761fbc req-40cf6186-22a4-428d-bf1c-b09a0a32aa0f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057121 Jul 26 14:06:30.366108 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 436/810] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:30.373066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba760f48-57bb-4c45-b4c8-688d0a14612b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:30.373476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba760f48-57bb-4c45-b4c8-688d0a14612b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:30.380805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba760f48-57bb-4c45-b4c8-688d0a14612b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:30.381298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba760f48-57bb-4c45-b4c8-688d0a14612b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:30.382499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba760f48-57bb-4c45-b4c8-688d0a14612b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:30.383296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba760f48-57bb-4c45-b4c8-688d0a14612b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:30.579617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Updating instance_info_cache with network_info: [{"id": "55a71149-6922-4955-9d24-b7427e70e88b", "address": "fa:16:3e:d6:5e:53", "network": {"id": "2348f789-06f4-41a5-a965-401de2b37b0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-748933619-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f3d21e6b315b4543993c1a1b7271f913", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap55a71149-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:06:30.623453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Releasing lock "refresh_cache-96760807-513a-459f-b4b4-1cf897885ed6" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:06:30.635882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba760f48-57bb-4c45-b4c8-688d0a14612b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:30.642573 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-835dffb5-cf2c-4fc8-a232-94f7c434e63b tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "POST /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6/action" status: 202 len: 0 microversion: 2.1 time: 4.893336 Jul 26 14:06:30.644533 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 375/811] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:25 2022] POST /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6/action => generated 0 bytes in 4914 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 14:06:30.647191 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba760f48-57bb-4c45-b4c8-688d0a14612b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1331 microversion: 2.1 time: 0.274693 Jul 26 14:06:30.647915 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 437/812] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:30 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1331 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:30.656615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-edbd0913-4a0f-42e8-b14a-bd1edc859c88 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:30.657333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-edbd0913-4a0f-42e8-b14a-bd1edc859c88 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:30.667937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e7b45f92-3f05-4a94-b773-7f8a49acfca1 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '.version_select at 0x7f87948f63a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:30.673834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7b45f92-3f05-4a94-b773-7f8a49acfca1 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:30.674489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7b45f92-3f05-4a94-b773-7f8a49acfca1 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:30.682543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edbd0913-4a0f-42e8-b14a-bd1edc859c88 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:30.683336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edbd0913-4a0f-42e8-b14a-bd1edc859c88 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:30.684712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edbd0913-4a0f-42e8-b14a-bd1edc859c88 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:30.685805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edbd0913-4a0f-42e8-b14a-bd1edc859c88 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:30.724257 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e7b45f92-3f05-4a94-b773-7f8a49acfca1 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1525 microversion: 2.25 time: 0.074299 Jul 26 14:06:30.725895 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 438/813] 10.222.0.70 () {60 vars in 1184 bytes} [Tue Jul 26 14:06:30 2022] GET /compute/v2.1/os-migrations => generated 1525 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:30.739064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cd0b4d7-a9f9-42db-85e6-f82025ce7591 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:30.740720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5cd0b4d7-a9f9-42db-85e6-f82025ce7591 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:30.785874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cd0b4d7-a9f9-42db-85e6-f82025ce7591 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:30.789262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cd0b4d7-a9f9-42db-85e6-f82025ce7591 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:30.792135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cd0b4d7-a9f9-42db-85e6-f82025ce7591 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:30.793382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cd0b4d7-a9f9-42db-85e6-f82025ce7591 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:31.078349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-edbd0913-4a0f-42e8-b14a-bd1edc859c88 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:31.102828 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-edbd0913-4a0f-42e8-b14a-bd1edc859c88 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1472 microversion: 2.1 time: 0.453920 Jul 26 14:06:31.107478 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 376/814] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:30 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1472 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:31.125225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.170"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:31.133059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:31.149443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:31.153207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:31.154359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:31.156827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:31.211607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5cd0b4d7-a9f9-42db-85e6-f82025ce7591 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:31.235855 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5cd0b4d7-a9f9-42db-85e6-f82025ce7591 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1316 microversion: 2.1 time: 0.508066 Jul 26 14:06:31.240330 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 439/815] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:30 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:31.249774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Acquired lock "refresh_cache-79382aab-866e-4dbd-ab77-400cdedef926" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:06:31.277660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3afa0ec8-9c86-4fd4-8294-e71162aa1e50 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:31.280600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3afa0ec8-9c86-4fd4-8294-e71162aa1e50 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:31.304905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3afa0ec8-9c86-4fd4-8294-e71162aa1e50 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:31.306126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3afa0ec8-9c86-4fd4-8294-e71162aa1e50 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:31.312178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3afa0ec8-9c86-4fd4-8294-e71162aa1e50 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:31.312698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3afa0ec8-9c86-4fd4-8294-e71162aa1e50 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:31.916813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-3afa0ec8-9c86-4fd4-8294-e71162aa1e50 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:06:31.938106 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3afa0ec8-9c86-4fd4-8294-e71162aa1e50 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 2050 microversion: 2.25 time: 0.693757 Jul 26 14:06:31.939784 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 440/816] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:31 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 2050 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:31.946353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9ad26c02-bf25-40c6-b9ec-5f58377cd696 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:31.947357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9ad26c02-bf25-40c6-b9ec-5f58377cd696 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:31.954651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ad26c02-bf25-40c6-b9ec-5f58377cd696 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:31.955718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ad26c02-bf25-40c6-b9ec-5f58377cd696 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:31.956809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ad26c02-bf25-40c6-b9ec-5f58377cd696 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:31.957467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ad26c02-bf25-40c6-b9ec-5f58377cd696 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:32.445639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ad26c02-bf25-40c6-b9ec-5f58377cd696 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:32.484954 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9ad26c02-bf25-40c6-b9ec-5f58377cd696 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1529 microversion: 2.1 time: 0.543636 Jul 26 14:06:32.486036 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 441/817] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:31 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1529 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:32.497429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-0863ce92-a30a-4c0c-917f-a706422ae212 req-f1e07d29-ef36-4997-8ebe-5259c38c0efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c20b152-e109-4ec5-882c-9640b942901e", "name": "network-vif-plugged", "status": "completed", "tag": "0023117a-fed6-48c7-9154-388efdf05982"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:32.536045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0863ce92-a30a-4c0c-917f-a706422ae212 req-f1e07d29-ef36-4997-8ebe-5259c38c0efc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:32.537878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0863ce92-a30a-4c0c-917f-a706422ae212 req-f1e07d29-ef36-4997-8ebe-5259c38c0efc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:32.561424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:32.585955 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-0863ce92-a30a-4c0c-917f-a706422ae212 req-f1e07d29-ef36-4997-8ebe-5259c38c0efc service nova] Creating event network-vif-plugged:0023117a-fed6-48c7-9154-388efdf05982 for instance 8c20b152-e109-4ec5-882c-9640b942901e on n-h2-833090-9 Jul 26 14:06:32.597288 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-0863ce92-a30a-4c0c-917f-a706422ae212 req-f1e07d29-ef36-4997-8ebe-5259c38c0efc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106314 Jul 26 14:06:32.599468 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 442/818] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:32.610197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d8d54090-d4ae-4087-9e2f-a531e4e77b7f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:32.613391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d8d54090-d4ae-4087-9e2f-a531e4e77b7f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:32.626151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8d54090-d4ae-4087-9e2f-a531e4e77b7f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:32.627632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8d54090-d4ae-4087-9e2f-a531e4e77b7f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:32.629519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8d54090-d4ae-4087-9e2f-a531e4e77b7f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:32.630853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8d54090-d4ae-4087-9e2f-a531e4e77b7f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:33.489870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d8d54090-d4ae-4087-9e2f-a531e4e77b7f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:33.507149 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d8d54090-d4ae-4087-9e2f-a531e4e77b7f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1331 microversion: 2.1 time: 0.905053 Jul 26 14:06:33.510886 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 443/819] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:32 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1331 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:33.522998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c770c527-c75b-40cb-bd1e-304877d75e15 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:33.524576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c770c527-c75b-40cb-bd1e-304877d75e15 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:33.537873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c770c527-c75b-40cb-bd1e-304877d75e15 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:33.538767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c770c527-c75b-40cb-bd1e-304877d75e15 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:33.540286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c770c527-c75b-40cb-bd1e-304877d75e15 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:33.541976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c770c527-c75b-40cb-bd1e-304877d75e15 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:33.574333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=14 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:33.867818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c770c527-c75b-40cb-bd1e-304877d75e15 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:33.881918 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c770c527-c75b-40cb-bd1e-304877d75e15 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1472 microversion: 2.1 time: 0.368225 Jul 26 14:06:33.907343 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 444/820] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:33 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:33.920755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-653414706", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "5ef2cecf-6342-4020-8ce3-eff3cab2d670"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:34.024226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] validate_networks() for [('5ef2cecf-6342-4020-8ce3-eff3cab2d670', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:06:35.204992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:06:35.205868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:06:35.207565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:06:35.208443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:06:35.209266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:06:35.245822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:35.256804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:35.258720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:35.260322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:35.320114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Getting quotas for project 3c83e50f8be04fb9b086a046f5b7eb00. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:06:35.333215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Getting quotas for user 4a31af687dca4bea97ad5cb0459f0dbd and project 3c83e50f8be04fb9b086a046f5b7eb00. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:06:35.367413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:06:35.371303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:06:35.441320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:35.505571 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8978fbbf-7eea-465c-a1b8-8b5e71cb0945 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.592294 Jul 26 14:06:35.507288 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 445/821] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:06:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:06:35.518265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4424ca23-96d6-4516-a68d-c1ea9150c1b6 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:35.519258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4424ca23-96d6-4516-a68d-c1ea9150c1b6 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:35.532472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4424ca23-96d6-4516-a68d-c1ea9150c1b6 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:35.533616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4424ca23-96d6-4516-a68d-c1ea9150c1b6 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:35.535719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4424ca23-96d6-4516-a68d-c1ea9150c1b6 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:35.536986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4424ca23-96d6-4516-a68d-c1ea9150c1b6 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:36.417306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4424ca23-96d6-4516-a68d-c1ea9150c1b6 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:36.440429 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4424ca23-96d6-4516-a68d-c1ea9150c1b6 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1466 microversion: 2.1 time: 0.931605 Jul 26 14:06:36.458134 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 446/822] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:35 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1466 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:36.463776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c5d77341-86e4-427d-92cc-b8a8e6f95f13 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:36.472213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c5d77341-86e4-427d-92cc-b8a8e6f95f13 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:36.480232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5d77341-86e4-427d-92cc-b8a8e6f95f13 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:36.480705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5d77341-86e4-427d-92cc-b8a8e6f95f13 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:36.481505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5d77341-86e4-427d-92cc-b8a8e6f95f13 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:36.482172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5d77341-86e4-427d-92cc-b8a8e6f95f13 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:36.889061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c5d77341-86e4-427d-92cc-b8a8e6f95f13 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:36.903803 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c5d77341-86e4-427d-92cc-b8a8e6f95f13 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1529 microversion: 2.1 time: 0.443963 Jul 26 14:06:36.906786 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 447/823] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:36 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1529 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:36.916055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-945b5d81-ae22-4e81-80c4-69b077270ee5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:36.921166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-945b5d81-ae22-4e81-80c4-69b077270ee5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:36.926899 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.network.neutron [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] re-assign floating IP 172.25.2.170 from instance 96760807-513a-459f-b4b4-1cf897885ed6 Jul 26 14:06:36.937053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-945b5d81-ae22-4e81-80c4-69b077270ee5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:36.937698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-945b5d81-ae22-4e81-80c4-69b077270ee5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:36.938538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-945b5d81-ae22-4e81-80c4-69b077270ee5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:36.939302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-945b5d81-ae22-4e81-80c4-69b077270ee5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:37.042320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Building network info cache for instance {{(pid=119478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 14:06:37.739518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-945b5d81-ae22-4e81-80c4-69b077270ee5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:37.765075 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-945b5d81-ae22-4e81-80c4-69b077270ee5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1331 microversion: 2.1 time: 0.851481 Jul 26 14:06:37.766567 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 448/824] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:36 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1331 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:37.779028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-914482ee-480d-4d93-8929-017ded01777b req-0996d470-45bf-4a69-b283-5b57c7047676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770654ea-0d11-480c-b5f7-6fb864a9b9dc", "name": "network-vif-plugged", "status": "completed", "tag": "a338cd22-92c3-454a-82f2-73b6e140b886"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:37.811928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-914482ee-480d-4d93-8929-017ded01777b req-0996d470-45bf-4a69-b283-5b57c7047676 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:37.814640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-914482ee-480d-4d93-8929-017ded01777b req-0996d470-45bf-4a69-b283-5b57c7047676 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:37.836504 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-914482ee-480d-4d93-8929-017ded01777b req-0996d470-45bf-4a69-b283-5b57c7047676 service nova] Creating event network-vif-plugged:a338cd22-92c3-454a-82f2-73b6e140b886 for instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc on n-h2-833090-9 Jul 26 14:06:37.845152 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-914482ee-480d-4d93-8929-017ded01777b req-0996d470-45bf-4a69-b283-5b57c7047676 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075954 Jul 26 14:06:37.846163 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 449/825] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:37.859455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3d279415-4900-47a6-99be-6a948f7229f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:37.861319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3d279415-4900-47a6-99be-6a948f7229f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:37.877068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d279415-4900-47a6-99be-6a948f7229f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:37.878098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d279415-4900-47a6-99be-6a948f7229f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:37.879146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d279415-4900-47a6-99be-6a948f7229f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:37.879771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d279415-4900-47a6-99be-6a948f7229f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:38.618000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3d279415-4900-47a6-99be-6a948f7229f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:38.642430 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3d279415-4900-47a6-99be-6a948f7229f2 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1478 microversion: 2.1 time: 0.793020 Jul 26 14:06:38.656873 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 450/826] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:37 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1478 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:38.663570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-806d0d53-0c8b-4812-a93d-388176cc793e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:38.664338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-806d0d53-0c8b-4812-a93d-388176cc793e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:38.676054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806d0d53-0c8b-4812-a93d-388176cc793e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:38.677322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806d0d53-0c8b-4812-a93d-388176cc793e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:38.678360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806d0d53-0c8b-4812-a93d-388176cc793e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:38.679167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806d0d53-0c8b-4812-a93d-388176cc793e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:38.809416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-806d0d53-0c8b-4812-a93d-388176cc793e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:38.822967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-806d0d53-0c8b-4812-a93d-388176cc793e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:38.825624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-806d0d53-0c8b-4812-a93d-388176cc793e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:38.827310 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-806d0d53-0c8b-4812-a93d-388176cc793e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1313 microversion: 2.25 time: 0.181425 Jul 26 14:06:38.841145 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 451/827] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:38 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:38.864717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8be5c579-b92e-49ef-ba5d-27a265ec2922 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-832179488", "metadata": {"image_type": "test"}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:38.870332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8be5c579-b92e-49ef-ba5d-27a265ec2922 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:38.883264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8be5c579-b92e-49ef-ba5d-27a265ec2922 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:38.885692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8be5c579-b92e-49ef-ba5d-27a265ec2922 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:38.887497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8be5c579-b92e-49ef-ba5d-27a265ec2922 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:38.888854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8be5c579-b92e-49ef-ba5d-27a265ec2922 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:39.005062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8be5c579-b92e-49ef-ba5d-27a265ec2922 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Getting quotas for project f83f5c16243748bb9122828119f5bbef. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:06:39.015573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Updating instance_info_cache with network_info: [{"id": "55a71149-6922-4955-9d24-b7427e70e88b", "address": "fa:16:3e:d6:5e:53", "network": {"id": "2348f789-06f4-41a5-a965-401de2b37b0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-748933619-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f3d21e6b315b4543993c1a1b7271f913", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap55a71149-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:06:39.019048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8be5c579-b92e-49ef-ba5d-27a265ec2922 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Getting quotas for user 6f6b9f5f3cb54ecbb1c1d7603bb3ae79 and project f83f5c16243748bb9122828119f5bbef. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:06:39.054428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Building network info cache for instance {{(pid=119478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 14:06:39.601173 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8be5c579-b92e-49ef-ba5d-27a265ec2922 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "POST /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e/action" status: 202 len: 0 microversion: 2.1 time: 0.756614 Jul 26 14:06:39.602302 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 452/828] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:38 2022] POST /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e/action => generated 0 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 14:06:39.652445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-8870cb0e-ebec-4a84-b1e2-926836c359b0 req-c8f29ae3-386f-42ce-84ed-5c49f806682e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96760807-513a-459f-b4b4-1cf897885ed6", "tag": "55a71149-6922-4955-9d24-b7427e70e88b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:39.699174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8870cb0e-ebec-4a84-b1e2-926836c359b0 req-c8f29ae3-386f-42ce-84ed-5c49f806682e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:39.699888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8870cb0e-ebec-4a84-b1e2-926836c359b0 req-c8f29ae3-386f-42ce-84ed-5c49f806682e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:39.725742 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8870cb0e-ebec-4a84-b1e2-926836c359b0 req-c8f29ae3-386f-42ce-84ed-5c49f806682e service nova] Creating event network-changed:55a71149-6922-4955-9d24-b7427e70e88b for instance 96760807-513a-459f-b4b4-1cf897885ed6 on n-h2-833090-9 Jul 26 14:06:39.746813 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-8870cb0e-ebec-4a84-b1e2-926836c359b0 req-c8f29ae3-386f-42ce-84ed-5c49f806682e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129514 Jul 26 14:06:39.747401 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 453/829] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:39.760953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-80cbf660-e036-4c43-9927-6f3ef7930cf8 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:39.761840 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:06:39.761840 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:06:39.826393 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-80cbf660-e036-4c43-9927-6f3ef7930cf8 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/d0b7a172-7066-4282-a625-2b397dc88e8b" status: 202 len: 0 microversion: 2.1 time: 0.070239 Jul 26 14:06:39.827356 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 454/830] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:06:39 2022] DELETE /compute/v2.1/flavors/d0b7a172-7066-4282-a625-2b397dc88e8b => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:39.842055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-de151e00-8ba8-4916-8870-088403b613d6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:39.842883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-de151e00-8ba8-4916-8870-088403b613d6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:39.854471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de151e00-8ba8-4916-8870-088403b613d6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:39.858728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de151e00-8ba8-4916-8870-088403b613d6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:39.860067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de151e00-8ba8-4916-8870-088403b613d6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:39.866132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de151e00-8ba8-4916-8870-088403b613d6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:40.671074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-de151e00-8ba8-4916-8870-088403b613d6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:40.684090 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-de151e00-8ba8-4916-8870-088403b613d6 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1331 microversion: 2.1 time: 0.855347 Jul 26 14:06:40.685384 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 455/831] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:39 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1331 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:40.690647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d8ccce06-8478-4754-8d3c-4a73eb787101 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f87946195e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:40.768995 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d8ccce06-8478-4754-8d3c-4a73eb787101 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 200 len: 1423 microversion: 2.1 time: 0.081416 Jul 26 14:06:40.784611 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 456/832] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:06:40 2022] GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 1423 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:40.796226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04bd0e85-7ceb-4a46-869f-347709033608 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:40.800584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-04bd0e85-7ceb-4a46-869f-347709033608 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:40.828034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04bd0e85-7ceb-4a46-869f-347709033608 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:40.829152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04bd0e85-7ceb-4a46-869f-347709033608 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:40.833302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04bd0e85-7ceb-4a46-869f-347709033608 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:40.835326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04bd0e85-7ceb-4a46-869f-347709033608 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:41.140861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:41.737617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-04bd0e85-7ceb-4a46-869f-347709033608 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:41.782989 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-04bd0e85-7ceb-4a46-869f-347709033608 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1478 microversion: 2.1 time: 0.995813 Jul 26 14:06:41.800338 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 457/833] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:40 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1478 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:41.823310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abb99940-9fab-4b9e-93a6-7c81c1c759ea tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:41.875760 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-abb99940-9fab-4b9e-93a6-7c81c1c759ea tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072467 Jul 26 14:06:41.877828 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 458/834] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:06:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:41.889543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-256dfa50-7841-466a-bdf9-b1f7176c4693 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:41.891921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-256dfa50-7841-466a-bdf9-b1f7176c4693 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:41.911259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-256dfa50-7841-466a-bdf9-b1f7176c4693 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:41.912815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-256dfa50-7841-466a-bdf9-b1f7176c4693 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:41.914669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-256dfa50-7841-466a-bdf9-b1f7176c4693 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:41.917577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-256dfa50-7841-466a-bdf9-b1f7176c4693 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:42.200663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-256dfa50-7841-466a-bdf9-b1f7176c4693 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:42.220906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-256dfa50-7841-466a-bdf9-b1f7176c4693 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:42.222547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-256dfa50-7841-466a-bdf9-b1f7176c4693 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:42.224193 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-256dfa50-7841-466a-bdf9-b1f7176c4693 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1319 microversion: 2.25 time: 0.344544 Jul 26 14:06:42.225245 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 459/835] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:41 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:42.262397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-5fdb1909-5c27-4f1c-a67f-0655829e45db req-967f0d9e-ba87-4d6f-b0eb-0af25015763c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf4359c-96f3-43bf-aea5-1cb4685a4493", "name": "network-vif-unplugged", "status": "completed", "tag": "0f1776dc-c5aa-4946-80e1-ec3dbca3eb36"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:42.289661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5fdb1909-5c27-4f1c-a67f-0655829e45db req-967f0d9e-ba87-4d6f-b0eb-0af25015763c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:42.290639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5fdb1909-5c27-4f1c-a67f-0655829e45db req-967f0d9e-ba87-4d6f-b0eb-0af25015763c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:42.317054 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-5fdb1909-5c27-4f1c-a67f-0655829e45db req-967f0d9e-ba87-4d6f-b0eb-0af25015763c service nova] Creating event network-vif-unplugged:0f1776dc-c5aa-4946-80e1-ec3dbca3eb36 for instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 on n-h1-833090-9 Jul 26 14:06:42.327399 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-5fdb1909-5c27-4f1c-a67f-0655829e45db req-967f0d9e-ba87-4d6f-b0eb-0af25015763c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078189 Jul 26 14:06:42.329621 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 460/836] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:42.336774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c6637be6-57c4-4570-9ac4-61d875aa0046 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:42.338608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c6637be6-57c4-4570-9ac4-61d875aa0046 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:42.348128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6637be6-57c4-4570-9ac4-61d875aa0046 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:42.348988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6637be6-57c4-4570-9ac4-61d875aa0046 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:42.353518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6637be6-57c4-4570-9ac4-61d875aa0046 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:42.354643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6637be6-57c4-4570-9ac4-61d875aa0046 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:42.444238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Updating instance_info_cache with network_info: [{"id": "4774806d-f309-48d1-8829-26baf46f3ce5", "address": "fa:16:3e:56:32:ae", "network": {"id": "2348f789-06f4-41a5-a965-401de2b37b0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-748933619-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f3d21e6b315b4543993c1a1b7271f913", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4774806d-f3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:06:42.468258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Releasing lock "refresh_cache-79382aab-866e-4dbd-ab77-400cdedef926" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:06:42.470524 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4e622794-fad2-4f3e-9ec7-56324c9890b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "POST /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926/action" status: 202 len: 0 microversion: 2.1 time: 11.359886 Jul 26 14:06:42.472139 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 377/837] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:31 2022] POST /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926/action => generated 0 bytes in 11364 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 14:06:42.481252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1bdf2a1e-fed3-40bf-97d9-c95581166468 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f87944b2af0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:42.595588 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1bdf2a1e-fed3-40bf-97d9-c95581166468 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 200 len: 1423 microversion: 2.1 time: 0.118929 Jul 26 14:06:42.608053 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 378/838] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:06:42 2022] GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 1423 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:42.662923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:42.687659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:42.736061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:42.736885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:42.754833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:42.756112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:42.957406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c6637be6-57c4-4570-9ac4-61d875aa0046 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:42.968866 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c6637be6-57c4-4570-9ac4-61d875aa0046 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1535 microversion: 2.1 time: 0.637175 Jul 26 14:06:42.980714 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 461/839] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:42 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1535 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:43.001163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-07cffd5d-8795-49a3-a30b-e51380691503 req-67e9d521-132e-40e4-9cbe-3b0df560cf67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79382aab-866e-4dbd-ab77-400cdedef926", "tag": "4774806d-f309-48d1-8829-26baf46f3ce5"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:43.024401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-07cffd5d-8795-49a3-a30b-e51380691503 req-67e9d521-132e-40e4-9cbe-3b0df560cf67 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:43.026343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-07cffd5d-8795-49a3-a30b-e51380691503 req-67e9d521-132e-40e4-9cbe-3b0df560cf67 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:43.059888 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-07cffd5d-8795-49a3-a30b-e51380691503 req-67e9d521-132e-40e4-9cbe-3b0df560cf67 service nova] Creating event network-changed:4774806d-f309-48d1-8829-26baf46f3ce5 for instance 79382aab-866e-4dbd-ab77-400cdedef926 on n-h2-833090-9 Jul 26 14:06:43.080237 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-07cffd5d-8795-49a3-a30b-e51380691503 req-67e9d521-132e-40e4-9cbe-3b0df560cf67 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095713 Jul 26 14:06:43.083067 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 462/840] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:43.093837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-042391fe-cb80-46b4-91a7-16924fc85c8f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Action: 'action', calling method: .version_select at 0x7f8797744700>, body: {"removeFloatingIp": {"address": "172.25.2.170"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:43.234394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:43.267197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Old instance type tempest-test_resize_flavor_-32874240, new instance type m1.heat {{(pid=119478) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 14:06:43.298204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:06:43.302202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:06:43.307516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:06:43.312417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:06:43.313517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:06:43.717639 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2ae6b747-d487-4540-b905-21408da58674 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2/action" status: 202 len: 0 microversion: 2.1 time: 1.104944 Jul 26 14:06:43.721532 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 379/841] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:42 2022] POST /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2/action => generated 0 bytes in 1112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:06:43.731635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea07941c-2a25-4689-92f1-1dac427b090a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:43.735482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ea07941c-2a25-4689-92f1-1dac427b090a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:43.758388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea07941c-2a25-4689-92f1-1dac427b090a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:43.765305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea07941c-2a25-4689-92f1-1dac427b090a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:43.766683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea07941c-2a25-4689-92f1-1dac427b090a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:43.767538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea07941c-2a25-4689-92f1-1dac427b090a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:43.852281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-042391fe-cb80-46b4-91a7-16924fc85c8f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:43.870691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-042391fe-cb80-46b4-91a7-16924fc85c8f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:43.871233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-042391fe-cb80-46b4-91a7-16924fc85c8f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:43.880575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-042391fe-cb80-46b4-91a7-16924fc85c8f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:43.881861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-042391fe-cb80-46b4-91a7-16924fc85c8f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:45.081775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ea07941c-2a25-4689-92f1-1dac427b090a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:45.108673 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ea07941c-2a25-4689-92f1-1dac427b090a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1478 microversion: 2.1 time: 1.385545 Jul 26 14:06:45.116629 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 380/842] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:43 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1478 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:45.159440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e5bbc8e5-6f14-49a4-bc09-16bca349766f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Action: 'create', calling method: .version_select at 0x7f879454f8b0>, body: {"pool": "dcd70a68-ffc7-49ed-b975-70685c5b60c9"} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:45.286549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:45.357601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:45.861803 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-042391fe-cb80-46b4-91a7-16924fc85c8f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] HTTP exception thrown: Floating IP 172.25.2.170 is not associated with instance 96760807-513a-459f-b4b4-1cf897885ed6. Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-042391fe-cb80-46b4-91a7-16924fc85c8f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Request method failure captured: Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6/action HTTP/1.1 Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 49 Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_St64GenKZ87KAkvHDGyRb7HiYM1IthLwlzgvoKvCR_phOn-TticwNzta5bNDk_6ECvjojhVsi6ZR3_0UOESITgs2ieYG1ANS_0FntJ3ERXsIZ5LfgAC078Krje6PA47sXgX4UJxeTjVtlLlFtiqaBys5c0jgR7tQ-1dsRldVSEBRU Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f3d21e6b315b4543993c1a1b7271f913 Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:06:45.868348 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3d21e6b315b4543993c1a1b7271f913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f3d21e6b315b4543993c1a1b7271f913"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f3d21e6b315b4543993c1a1b7271f913", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3d21e6b315b4543993c1a1b7271f913"}]}] Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f3d21e6b315b4543993c1a1b7271f913 Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FloatingIPsAssociationTestJSON-458980477-project Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 9f84bae10984463fbb5579005d7a0a7c Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-458980477-project Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: {"removeFloatingIp": {"address": "172.25.2.170"}} Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:06:45.871087 n-d-833090-9 devstack@n-api.service[119479]: exception: Floating IP 172.25.2.170 is not associated with instance 96760807-513a-459f-b4b4-1cf897885ed6. Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '96760807-513a-459f-b4b4-1cf897885ed6', 'body': {'removeFloatingIp': {'address': '172.25.2.170'}}} Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.170 is not associated with instance 96760807-513a-459f-b4b4-1cf897885ed6. Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:06:45.872818 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:06:45.875507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:06:45.875507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:06:45.875507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:06:45.875507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:06:45.875507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.170 is not associated with instance 96760807-513a-459f-b4b4-1cf897885ed6. Jul 26 14:06:45.875507 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:06:45.875507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-042391fe-cb80-46b4-91a7-16924fc85c8f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Returning 409 to user: Floating IP 172.25.2.170 is not associated with instance 96760807-513a-459f-b4b4-1cf897885ed6. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:06:45.877887 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-042391fe-cb80-46b4-91a7-16924fc85c8f tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "POST /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6/action" status: 409 len: 146 microversion: 2.1 time: 2.792329 Jul 26 14:06:45.885955 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 463/843] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:43 2022] POST /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6/action => generated 146 bytes in 2802 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:06:45.899060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-46641135-02a6-4dbb-b0a3-701cce42b496 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:45.901492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-46641135-02a6-4dbb-b0a3-701cce42b496 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:45.918373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46641135-02a6-4dbb-b0a3-701cce42b496 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:45.919173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46641135-02a6-4dbb-b0a3-701cce42b496 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:45.922025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46641135-02a6-4dbb-b0a3-701cce42b496 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:45.923577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46641135-02a6-4dbb-b0a3-701cce42b496 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:45.936429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:46.660115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-46641135-02a6-4dbb-b0a3-701cce42b496 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:46.685612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-46641135-02a6-4dbb-b0a3-701cce42b496 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:46.688668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-46641135-02a6-4dbb-b0a3-701cce42b496 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:46.694011 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-46641135-02a6-4dbb-b0a3-701cce42b496 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1361 microversion: 2.25 time: 0.806288 Jul 26 14:06:46.701296 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 464/844] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:45 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1361 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:46.710227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-12644427-5c64-441a-8699-92cabae70ea2 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8794969ca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:46.879042 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-12644427-5c64-441a-8699-92cabae70ea2 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 200 len: 1423 microversion: 2.1 time: 0.175949 Jul 26 14:06:46.888608 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 465/845] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:06:46 2022] GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 1423 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:46.908823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0ae75c5d-5a65-451b-a396-3e1023e6f14c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:46.910083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0ae75c5d-5a65-451b-a396-3e1023e6f14c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:46.929294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae75c5d-5a65-451b-a396-3e1023e6f14c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:46.930619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae75c5d-5a65-451b-a396-3e1023e6f14c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:46.934119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae75c5d-5a65-451b-a396-3e1023e6f14c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:46.934773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae75c5d-5a65-451b-a396-3e1023e6f14c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:48.593163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ae75c5d-5a65-451b-a396-3e1023e6f14c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:48.628415 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0ae75c5d-5a65-451b-a396-3e1023e6f14c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1538 microversion: 2.1 time: 1.737202 Jul 26 14:06:48.661046 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 466/846] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:46 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1538 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:48.670154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-64c42f92-0d9d-45e7-8acc-dbfd60d77110 req-fac4f3ea-752e-4c76-9974-d69644b7aa6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf4359c-96f3-43bf-aea5-1cb4685a4493", "name": "network-vif-plugged", "status": "completed", "tag": "0f1776dc-c5aa-4946-80e1-ec3dbca3eb36"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:48.711391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-64c42f92-0d9d-45e7-8acc-dbfd60d77110 req-fac4f3ea-752e-4c76-9974-d69644b7aa6b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:48.717637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-64c42f92-0d9d-45e7-8acc-dbfd60d77110 req-fac4f3ea-752e-4c76-9974-d69644b7aa6b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:48.768085 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-64c42f92-0d9d-45e7-8acc-dbfd60d77110 req-fac4f3ea-752e-4c76-9974-d69644b7aa6b service nova] Creating event network-vif-plugged:0f1776dc-c5aa-4946-80e1-ec3dbca3eb36 for instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 on n-h1-833090-9 Jul 26 14:06:48.795514 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-64c42f92-0d9d-45e7-8acc-dbfd60d77110 req-fac4f3ea-752e-4c76-9974-d69644b7aa6b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131350 Jul 26 14:06:48.798261 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 467/847] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:48.827894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.170"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:49.975082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:49.994050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:49.995789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:49.997787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:49.998883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:51.096373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Acquired lock "refresh_cache-79382aab-866e-4dbd-ab77-400cdedef926" {{(pid=119479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:06:53.750540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:54.404736 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e5bbc8e5-6f14-49a4-bc09-16bca349766f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.284415 Jul 26 14:06:54.406222 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 381/848] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:06:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:54.414999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-086b9246-5d86-41f4-9380-e828a2470f54 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:54.441793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-086b9246-5d86-41f4-9380-e828a2470f54 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:54.466949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086b9246-5d86-41f4-9380-e828a2470f54 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:54.469445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086b9246-5d86-41f4-9380-e828a2470f54 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:54.473947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086b9246-5d86-41f4-9380-e828a2470f54 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:54.484907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086b9246-5d86-41f4-9380-e828a2470f54 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:55.046777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-086b9246-5d86-41f4-9380-e828a2470f54 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:55.052578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=5,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:06:55.061994 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-086b9246-5d86-41f4-9380-e828a2470f54 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1464 microversion: 2.1 time: 0.653761 Jul 26 14:06:55.062780 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 382/849] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:54 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1464 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:55.119286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3e8e93e1-3480-44ef-974e-c88084c75afd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:55.120796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3e8e93e1-3480-44ef-974e-c88084c75afd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:55.137771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Building network info cache for instance {{(pid=119479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 14:06:55.166003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e8e93e1-3480-44ef-974e-c88084c75afd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:55.171186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e8e93e1-3480-44ef-974e-c88084c75afd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:55.173241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e8e93e1-3480-44ef-974e-c88084c75afd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:55.175129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e8e93e1-3480-44ef-974e-c88084c75afd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:55.887020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3e8e93e1-3480-44ef-974e-c88084c75afd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:55.899069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3e8e93e1-3480-44ef-974e-c88084c75afd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:55.902124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3e8e93e1-3480-44ef-974e-c88084c75afd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:55.904155 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3e8e93e1-3480-44ef-974e-c88084c75afd tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1361 microversion: 2.25 time: 0.801595 Jul 26 14:06:55.920560 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 383/850] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:55 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1361 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:55.936028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1dd66399-65da-45e7-b362-18cd90988f7c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8794732d30>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:56.078066 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1dd66399-65da-45e7-b362-18cd90988f7c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 200 len: 1423 microversion: 2.1 time: 0.154951 Jul 26 14:06:56.080067 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 384/851] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:06:55 2022] GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 1423 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:56.096951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9cbea1b3-f23d-450b-a3c9-cf559cdc9ccf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:56.097940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9cbea1b3-f23d-450b-a3c9-cf559cdc9ccf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:56.109833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9cbea1b3-f23d-450b-a3c9-cf559cdc9ccf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:56.111738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9cbea1b3-f23d-450b-a3c9-cf559cdc9ccf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:56.113609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9cbea1b3-f23d-450b-a3c9-cf559cdc9ccf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:56.114259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9cbea1b3-f23d-450b-a3c9-cf559cdc9ccf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:56.799434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9cbea1b3-f23d-450b-a3c9-cf559cdc9ccf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:56.829134 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9cbea1b3-f23d-450b-a3c9-cf559cdc9ccf tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1543 microversion: 2.1 time: 0.745011 Jul 26 14:06:56.830975 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 385/852] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:56 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1543 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:56.848292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e2e79c62-2d2e-4501-bd25-3b81f07adac4 req-776bc96b-650e-4ea6-b443-dd1b0662c693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f842736-4c37-478b-a26b-94b53377cc43", "tag": "f1af542a-ca59-4955-b962-e2934fce33bb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:56.879614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e2e79c62-2d2e-4501-bd25-3b81f07adac4 req-776bc96b-650e-4ea6-b443-dd1b0662c693 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:56.883649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e2e79c62-2d2e-4501-bd25-3b81f07adac4 req-776bc96b-650e-4ea6-b443-dd1b0662c693 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:56.912575 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e2e79c62-2d2e-4501-bd25-3b81f07adac4 req-776bc96b-650e-4ea6-b443-dd1b0662c693 service nova] Creating event network-changed:f1af542a-ca59-4955-b962-e2934fce33bb for instance 8f842736-4c37-478b-a26b-94b53377cc43 on n-h1-833090-9 Jul 26 14:06:56.929772 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e2e79c62-2d2e-4501-bd25-3b81f07adac4 req-776bc96b-650e-4ea6-b443-dd1b0662c693 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096284 Jul 26 14:06:56.930721 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 386/853] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:56.966408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a180cd92-1a6f-4eaf-a010-e4803e87b591 req-c5688ee5-fc71-4474-9491-90af52ad2284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c20b152-e109-4ec5-882c-9640b942901e", "name": "network-vif-plugged", "status": "completed", "tag": "0023117a-fed6-48c7-9154-388efdf05982"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:57.008531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a180cd92-1a6f-4eaf-a010-e4803e87b591 req-c5688ee5-fc71-4474-9491-90af52ad2284 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:57.013548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a180cd92-1a6f-4eaf-a010-e4803e87b591 req-c5688ee5-fc71-4474-9491-90af52ad2284 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:57.051706 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a180cd92-1a6f-4eaf-a010-e4803e87b591 req-c5688ee5-fc71-4474-9491-90af52ad2284 service nova] Creating event network-vif-plugged:0023117a-fed6-48c7-9154-388efdf05982 for instance 8c20b152-e109-4ec5-882c-9640b942901e on n-h2-833090-9 Jul 26 14:06:57.069232 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a180cd92-1a6f-4eaf-a010-e4803e87b591 req-c5688ee5-fc71-4474-9491-90af52ad2284 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133404 Jul 26 14:06:57.075015 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 387/854] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:57.501706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Updating instance_info_cache with network_info: [{"id": "4774806d-f309-48d1-8829-26baf46f3ce5", "address": "fa:16:3e:56:32:ae", "network": {"id": "2348f789-06f4-41a5-a965-401de2b37b0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-748933619-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f3d21e6b315b4543993c1a1b7271f913", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap4774806d-f3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:06:57.560921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Releasing lock "refresh_cache-79382aab-866e-4dbd-ab77-400cdedef926" {{(pid=119479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:06:57.564534 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cedfb312-3d08-41bd-8c9a-db2babba9636 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "POST /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926/action" status: 202 len: 0 microversion: 2.1 time: 8.760445 Jul 26 14:06:57.567257 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 468/855] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:48 2022] POST /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926/action => generated 0 bytes in 8766 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 14:06:57.581748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Action: 'action', calling method: .version_select at 0x7f87977448b0>, body: {"addFloatingIp": {"address": "172.25.2.171"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:57.589240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:57.602916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:57.603788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:57.609535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:57.610213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:57.642758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3161e060-c3e6-40d8-b094-7a034f720fbf tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-258928058", "id": 300018498, "os-flavor-access:is_public": "False"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:57.649610 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:06:57.649610 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:06:57.684300 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3161e060-c3e6-40d8-b094-7a034f720fbf tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.606136 Jul 26 14:06:57.694646 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 388/856] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:06:57 2022] POST /compute/v2.1/flavors => generated 435 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:57.703597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4bd00514-f925-4492-9b85-abb5515c7e82 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:57.705098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4bd00514-f925-4492-9b85-abb5515c7e82 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:57.709042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Acquired lock "refresh_cache-770654ea-0d11-480c-b5f7-6fb864a9b9dc" {{(pid=119479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:06:57.719409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bd00514-f925-4492-9b85-abb5515c7e82 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:57.720266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bd00514-f925-4492-9b85-abb5515c7e82 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:57.721330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bd00514-f925-4492-9b85-abb5515c7e82 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:57.721935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bd00514-f925-4492-9b85-abb5515c7e82 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:58.446578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4bd00514-f925-4492-9b85-abb5515c7e82 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:58.484831 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4bd00514-f925-4492-9b85-abb5515c7e82 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1464 microversion: 2.1 time: 0.784714 Jul 26 14:06:58.486072 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 389/857] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:06:57 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1464 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:58.493851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d627ba5e-2ccd-4a63-881e-fe689b7ab508 req-40cb9599-f98e-4983-a3de-eff4f11bd514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79382aab-866e-4dbd-ab77-400cdedef926", "tag": "4774806d-f309-48d1-8829-26baf46f3ce5"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:58.528291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d627ba5e-2ccd-4a63-881e-fe689b7ab508 req-40cb9599-f98e-4983-a3de-eff4f11bd514 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:58.529351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d627ba5e-2ccd-4a63-881e-fe689b7ab508 req-40cb9599-f98e-4983-a3de-eff4f11bd514 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:58.564581 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d627ba5e-2ccd-4a63-881e-fe689b7ab508 req-40cb9599-f98e-4983-a3de-eff4f11bd514 service nova] Creating event network-changed:4774806d-f309-48d1-8829-26baf46f3ce5 for instance 79382aab-866e-4dbd-ab77-400cdedef926 on n-h2-833090-9 Jul 26 14:06:58.571243 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d627ba5e-2ccd-4a63-881e-fe689b7ab508 req-40cb9599-f98e-4983-a3de-eff4f11bd514 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082736 Jul 26 14:06:58.572890 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 390/858] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:06:58.579081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-617994d7-9f82-4a3e-bb23-89c78b1973c7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:58.580075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-617994d7-9f82-4a3e-bb23-89c78b1973c7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:06:58.591510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-617994d7-9f82-4a3e-bb23-89c78b1973c7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:58.592704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-617994d7-9f82-4a3e-bb23-89c78b1973c7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:58.602114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-617994d7-9f82-4a3e-bb23-89c78b1973c7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:06:58.603176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-617994d7-9f82-4a3e-bb23-89c78b1973c7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:06:59.470918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-617994d7-9f82-4a3e-bb23-89c78b1973c7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:59.488889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-617994d7-9f82-4a3e-bb23-89c78b1973c7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:59.491210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-617994d7-9f82-4a3e-bb23-89c78b1973c7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:06:59.497900 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-617994d7-9f82-4a3e-bb23-89c78b1973c7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1361 microversion: 2.25 time: 0.921154 Jul 26 14:06:59.500008 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 391/859] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:06:58 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1361 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:06:59.505081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-08dd2472-a0d5-4f3b-a81a-3bc3fcce15bb tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f87947b2e50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:06:59.669745 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-08dd2472-a0d5-4f3b-a81a-3bc3fcce15bb tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 200 len: 1423 microversion: 2.1 time: 0.168035 Jul 26 14:06:59.670859 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 392/860] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:06:59 2022] GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 1423 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:06:59.832589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-849629725", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "a25f5344-bc1c-4e07-a47f-5585d3cd8924"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:06:59.996206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] validate_networks() for [('a25f5344-bc1c-4e07-a47f-5585d3cd8924', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:07:01.194231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:07:01.196480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:07:01.196993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:07:01.197415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:07:01.200958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:07:01.229948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:01.231784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:01.233330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:01.234275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:01.247545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Building network info cache for instance {{(pid=119479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 14:07:01.283743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Getting quotas for project 46f25f5febd140a69cc213cb54ecdf5f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:07:01.296808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Getting quotas for user 7b8a1556b59644acbe6edf7c64fa76f5 and project 46f25f5febd140a69cc213cb54ecdf5f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:07:01.335437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:07:01.337928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:07:01.474478 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8a7b2ca4-5bb4-4de8-8eff-a99070b883fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.785210 Jul 26 14:07:01.476591 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 393/861] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:07:01.497231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7e249c9a-2a78-416b-a33a-02a4809b2926 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:01.498915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7e249c9a-2a78-416b-a33a-02a4809b2926 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:01.540760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e249c9a-2a78-416b-a33a-02a4809b2926 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:01.545702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e249c9a-2a78-416b-a33a-02a4809b2926 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:01.557870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e249c9a-2a78-416b-a33a-02a4809b2926 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:01.558762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e249c9a-2a78-416b-a33a-02a4809b2926 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:01.654164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7e249c9a-2a78-416b-a33a-02a4809b2926 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:07:01.986331 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7e249c9a-2a78-416b-a33a-02a4809b2926 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "DELETE /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 204 len: 0 microversion: 2.1 time: 0.507158 Jul 26 14:07:02.000386 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 394/862] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:07:01 2022] DELETE /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:07:02.011429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-184c3d19-5dea-4d3c-b7db-2f70a2f8d382 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9230d28019e14c33a468765fcfbe94bd"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:02.016380 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:02.016380 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:02.253941 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-184c3d19-5dea-4d3c-b7db-2f70a2f8d382 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/300018498/action" status: 200 len: 96 microversion: 2.1 time: 0.251709 Jul 26 14:07:02.254913 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 395/863] 10.222.0.70 () {60 vars in 1197 bytes} [Tue Jul 26 14:07:02 2022] POST /compute/v2.1/flavors/300018498/action => generated 96 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:07:02.278076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4748d745-98f0-4fe3-9f4b-e4c74bc4d382 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:02.279124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4748d745-98f0-4fe3-9f4b-e4c74bc4d382 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:02.317765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4748d745-98f0-4fe3-9f4b-e4c74bc4d382 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:02.318571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4748d745-98f0-4fe3-9f4b-e4c74bc4d382 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:02.319818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4748d745-98f0-4fe3-9f4b-e4c74bc4d382 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:02.320954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4748d745-98f0-4fe3-9f4b-e4c74bc4d382 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:02.462062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Updating instance_info_cache with network_info: [{"id": "a338cd22-92c3-454a-82f2-73b6e140b886", "address": "fa:16:3e:7e:e5:f9", "network": {"id": "57f75734-76a5-4e60-8803-969954ea1915", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-613619647-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "492092ab9cd04b469f35de121b33deda", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa338cd22-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:07:02.477716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Releasing lock "refresh_cache-770654ea-0d11-480c-b5f7-6fb864a9b9dc" {{(pid=119479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:07:02.481358 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d6a0fa86-24e2-4399-84b2-284c1a60438f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action" status: 202 len: 0 microversion: 2.1 time: 4.910602 Jul 26 14:07:02.482273 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 469/864] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:06:57 2022] POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action => generated 0 bytes in 4914 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 14:07:02.498511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:02.507416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:02.531486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:02.533183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:02.536659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:02.539346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:02.716886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4748d745-98f0-4fe3-9f4b-e4c74bc4d382 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:02.731984 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4748d745-98f0-4fe3-9f4b-e4c74bc4d382 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1543 microversion: 2.1 time: 0.464312 Jul 26 14:07:02.733177 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 396/865] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:02 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1543 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:02.768547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d6dd8e8d-083a-430b-8026-6e621e6976cf req-526ec044-6eca-4e05-af94-ef16ff9579e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f842736-4c37-478b-a26b-94b53377cc43", "name": "network-vif-plugged", "status": "completed", "tag": "f1af542a-ca59-4955-b962-e2934fce33bb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:02.803130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:07:02.804297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:07:02.805443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:07:02.806507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:07:02.807692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:07:02.812766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d6dd8e8d-083a-430b-8026-6e621e6976cf req-526ec044-6eca-4e05-af94-ef16ff9579e1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:02.814870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d6dd8e8d-083a-430b-8026-6e621e6976cf req-526ec044-6eca-4e05-af94-ef16ff9579e1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:02.854511 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d6dd8e8d-083a-430b-8026-6e621e6976cf req-526ec044-6eca-4e05-af94-ef16ff9579e1 service nova] Creating event network-vif-plugged:f1af542a-ca59-4955-b962-e2934fce33bb for instance 8f842736-4c37-478b-a26b-94b53377cc43 on n-h1-833090-9 Jul 26 14:07:02.865155 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d6dd8e8d-083a-430b-8026-6e621e6976cf req-526ec044-6eca-4e05-af94-ef16ff9579e1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130079 Jul 26 14:07:02.867016 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 397/866] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:02.897797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-586c6722-6180-4e4c-a6b3-aae5aa02ecf9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:02.903428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-586c6722-6180-4e4c-a6b3-aae5aa02ecf9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:02.917035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-586c6722-6180-4e4c-a6b3-aae5aa02ecf9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:02.918581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-586c6722-6180-4e4c-a6b3-aae5aa02ecf9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:02.922649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-586c6722-6180-4e4c-a6b3-aae5aa02ecf9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:02.925132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-586c6722-6180-4e4c-a6b3-aae5aa02ecf9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:02.956651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:02.967065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:02.968102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:02.969103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:02.969721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:03.065894 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-074af202-a6a3-4863-b158-7abed4d92109 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action" status: 202 len: 1068 microversion: 2.1 time: 0.579729 Jul 26 14:07:03.069606 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 470/867] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:02 2022] POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action => generated 1068 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 14:07:03.092932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-baf4c3b8-177e-4f7e-bc62-62c22995a64f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f87943c4a60>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:03.238153 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-baf4c3b8-177e-4f7e-bc62-62c22995a64f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 200 len: 1423 microversion: 2.1 time: 0.160879 Jul 26 14:07:03.239540 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 471/868] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:03 2022] GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 1423 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:03.254408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2ef88308-8589-4473-ba2e-dc2b283633ba req-62a0e5b5-00ab-4383-b819-31d90ecb2065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770654ea-0d11-480c-b5f7-6fb864a9b9dc", "tag": "a338cd22-92c3-454a-82f2-73b6e140b886"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:03.272712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2ef88308-8589-4473-ba2e-dc2b283633ba req-62a0e5b5-00ab-4383-b819-31d90ecb2065 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:03.273744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2ef88308-8589-4473-ba2e-dc2b283633ba req-62a0e5b5-00ab-4383-b819-31d90ecb2065 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:03.294823 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2ef88308-8589-4473-ba2e-dc2b283633ba req-62a0e5b5-00ab-4383-b819-31d90ecb2065 service nova] Creating event network-changed:a338cd22-92c3-454a-82f2-73b6e140b886 for instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc on n-h2-833090-9 Jul 26 14:07:03.303645 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2ef88308-8589-4473-ba2e-dc2b283633ba req-62a0e5b5-00ab-4383-b819-31d90ecb2065 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062109 Jul 26 14:07:03.305626 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 472/869] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:03.315580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0302ee9d-2b6d-4f86-9b9a-6703a41af52b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:03.316795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0302ee9d-2b6d-4f86-9b9a-6703a41af52b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:03.327354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0302ee9d-2b6d-4f86-9b9a-6703a41af52b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:03.328363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0302ee9d-2b6d-4f86-9b9a-6703a41af52b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:03.332329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0302ee9d-2b6d-4f86-9b9a-6703a41af52b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:03.333303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0302ee9d-2b6d-4f86-9b9a-6703a41af52b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:03.386832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-586c6722-6180-4e4c-a6b3-aae5aa02ecf9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:03.420193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-586c6722-6180-4e4c-a6b3-aae5aa02ecf9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:03.426895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-586c6722-6180-4e4c-a6b3-aae5aa02ecf9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:03.428538 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-586c6722-6180-4e4c-a6b3-aae5aa02ecf9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1361 microversion: 2.25 time: 0.559044 Jul 26 14:07:03.430179 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 398/870] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:02 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1361 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:03.455398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.170"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:03.466665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:03.518588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:03.532546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:03.534555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:03.538362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:03.630504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0302ee9d-2b6d-4f86-9b9a-6703a41af52b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:03.648086 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0302ee9d-2b6d-4f86-9b9a-6703a41af52b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1221 microversion: 2.1 time: 0.338987 Jul 26 14:07:03.668137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Acquired lock "refresh_cache-96760807-513a-459f-b4b4-1cf897885ed6" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:07:03.668695 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 473/871] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:03 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1221 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:03.707941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cd868275-07ea-4417-853e-4db9a8ce1dc2 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9230d28019e14c33a468765fcfbe94bd"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:03.713815 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:03.713815 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:03.895436 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-cd868275-07ea-4417-853e-4db9a8ce1dc2 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] HTTP exception thrown: Flavor access already exists for flavor 36 and project 9230d28019e14c33a468765fcfbe94bd combination. Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cd868275-07ea-4417-853e-4db9a8ce1dc2 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Request method failure captured: Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/flavors/300018498/action HTTP/1.1 Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 67 Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_T7CfFEcg5QctjH-qIO__yl766daX-SFCLHyGxpw89k7ZfZ5WevEnKVPGpp2tTiLrKi7xdbn8l_OHskujJ6tSBYSkAR_dUz-w3Kq54eGFtnL6RlQiFEgkUeDwR6wtg6CEYytut0rl7Z1bCmw_SSzbLQwhG3iP7Zt3GcSMKYNu2M6Xg Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 60c857f4df4143efa3fedee8524cd1c8 Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1570258264 Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:07:03.917197 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60c857f4df4143efa3fedee8524cd1c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/60c857f4df4143efa3fedee8524cd1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_60c857f4df4143efa3fedee8524cd1c8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60c857f4df4143efa3fedee8524cd1c8"}]}] Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1570258264 Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 60c857f4df4143efa3fedee8524cd1c8 Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1570258264 Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e4a36493bb5245d98177c148db768deb Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: {"addTenantAccess": {"tenant": "9230d28019e14c33a468765fcfbe94bd"}} Jul 26 14:07:03.919309 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: exception: Flavor access already exists for flavor 36 and project 9230d28019e14c33a468765fcfbe94bd combination. Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '300018498', 'body': {'addTenantAccess': {'tenant': '9230d28019e14c33a468765fcfbe94bd'}}} Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result.read() Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:07:03.921044 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '36-9230d28019e14c33a468765fcfbe94bd' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi session.flush() Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:07:03.922990 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:07:03.924924 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:07:03.929935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result.read() Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '36-9230d28019e14c33a468765fcfbe94bd' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 26, 14, 7, 3, 887531), 'updated_at': None, 'flavor_id': 36, 'project_id': '9230d28019e14c33a468765fcfbe94bd'}] Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:03.933523 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 36 and project 9230d28019e14c33a468765fcfbe94bd combination. Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:03.936214 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 36 and project 9230d28019e14c33a468765fcfbe94bd combination. Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:03.940147 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:03.945588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 36 and project 9230d28019e14c33a468765fcfbe94bd combination. Jul 26 14:07:03.945588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:03.945588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cd868275-07ea-4417-853e-4db9a8ce1dc2 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Returning 409 to user: Flavor access already exists for flavor 36 and project 9230d28019e14c33a468765fcfbe94bd combination. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:03.945588 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cd868275-07ea-4417-853e-4db9a8ce1dc2 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/300018498/action" status: 409 len: 152 microversion: 2.1 time: 0.254942 Jul 26 14:07:03.945588 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 474/872] 10.222.0.70 () {60 vars in 1197 bytes} [Tue Jul 26 14:07:03 2022] POST /compute/v2.1/flavors/300018498/action => generated 152 bytes in 260 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:07:03.958567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-05a1dcb5-d442-4fdb-815f-9a1fe9021b6a tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Action: 'create', calling method: .version_select at 0x7f87943c4e50>, body: {"pool": "dcd70a68-ffc7-49ed-b975-70685c5b60c9"} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:06.918182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Building network info cache for instance {{(pid=119478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 14:07:08.920321 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-05a1dcb5-d442-4fdb-815f-9a1fe9021b6a tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.987940 Jul 26 14:07:08.921502 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 475/873] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:07:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:08.926422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0d30e29-35bb-4859-9af2-137ae76a0600 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:08.927288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0d30e29-35bb-4859-9af2-137ae76a0600 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:08.929512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:08.941902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d30e29-35bb-4859-9af2-137ae76a0600 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:08.944733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d30e29-35bb-4859-9af2-137ae76a0600 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:08.951434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d30e29-35bb-4859-9af2-137ae76a0600 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:08.952249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d30e29-35bb-4859-9af2-137ae76a0600 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:09.017596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Updating instance_info_cache with network_info: [{"id": "55a71149-6922-4955-9d24-b7427e70e88b", "address": "fa:16:3e:d6:5e:53", "network": {"id": "2348f789-06f4-41a5-a965-401de2b37b0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-748933619-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f3d21e6b315b4543993c1a1b7271f913", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap55a71149-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:07:09.044036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Releasing lock "refresh_cache-96760807-513a-459f-b4b4-1cf897885ed6" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:07:09.054506 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-367b2a78-2eb8-4711-a78a-f781c1b9233c tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "POST /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6/action" status: 202 len: 0 microversion: 2.1 time: 5.615301 Jul 26 14:07:09.062397 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 399/874] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:03 2022] POST /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6/action => generated 0 bytes in 5627 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 14:07:09.077780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af2570b6-59c3-461e-b897-198bc4cadae9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:09.078423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-af2570b6-59c3-461e-b897-198bc4cadae9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:09.106534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af2570b6-59c3-461e-b897-198bc4cadae9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:09.117069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af2570b6-59c3-461e-b897-198bc4cadae9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:09.139756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af2570b6-59c3-461e-b897-198bc4cadae9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:09.140732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af2570b6-59c3-461e-b897-198bc4cadae9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:09.395200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0d30e29-35bb-4859-9af2-137ae76a0600 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:09.412393 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0d30e29-35bb-4859-9af2-137ae76a0600 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1473 microversion: 2.1 time: 0.489565 Jul 26 14:07:09.431515 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 476/875] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:08 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1473 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:09.441773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-18908e09-921a-479a-add6-e021593d1e03 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9230d28019e14c33a468765fcfbe94bd"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:09.444888 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:09.444888 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:09.622692 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-18908e09-921a-479a-add6-e021593d1e03 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/300018498/action" status: 200 len: 21 microversion: 2.1 time: 0.188566 Jul 26 14:07:09.625378 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 477/876] 10.222.0.70 () {60 vars in 1197 bytes} [Tue Jul 26 14:07:09 2022] POST /compute/v2.1/flavors/300018498/action => generated 21 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:07:09.629443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-af2570b6-59c3-461e-b897-198bc4cadae9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:09.644991 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af2570b6-59c3-461e-b897-198bc4cadae9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1542 microversion: 2.1 time: 0.582972 Jul 26 14:07:09.648382 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 400/877] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:09 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1542 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:09.653276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0b3a26da-ea79-4fbf-80b9-79a668494c57 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8794061ca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:09.665631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5b92f23e-d54a-4867-af20-f1fc765f4865 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:09.671375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b92f23e-d54a-4867-af20-f1fc765f4865 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:09.689066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b92f23e-d54a-4867-af20-f1fc765f4865 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:09.691555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b92f23e-d54a-4867-af20-f1fc765f4865 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:09.695757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b92f23e-d54a-4867-af20-f1fc765f4865 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:09.696732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b92f23e-d54a-4867-af20-f1fc765f4865 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:09.776426 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0b3a26da-ea79-4fbf-80b9-79a668494c57 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 200 len: 1423 microversion: 2.1 time: 0.141880 Jul 26 14:07:09.787047 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 478/878] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:09 2022] GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 1423 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:09.787047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-338042cf-e07c-4e5e-897a-2bdd705da88e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:09.787047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-338042cf-e07c-4e5e-897a-2bdd705da88e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:09.794019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-338042cf-e07c-4e5e-897a-2bdd705da88e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:09.794623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-338042cf-e07c-4e5e-897a-2bdd705da88e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:09.796406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-338042cf-e07c-4e5e-897a-2bdd705da88e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:09.797114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-338042cf-e07c-4e5e-897a-2bdd705da88e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:10.190662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5b92f23e-d54a-4867-af20-f1fc765f4865 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:10.209333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-338042cf-e07c-4e5e-897a-2bdd705da88e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:10.225562 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-338042cf-e07c-4e5e-897a-2bdd705da88e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1317 microversion: 2.1 time: 0.444336 Jul 26 14:07:10.239105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5b92f23e-d54a-4867-af20-f1fc765f4865 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:10.240756 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 479/879] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:09 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:10.250982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5b92f23e-d54a-4867-af20-f1fc765f4865 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:10.253511 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5b92f23e-d54a-4867-af20-f1fc765f4865 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1557 microversion: 2.25 time: 0.603460 Jul 26 14:07:10.255697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9609dc44-47ca-45bf-9e0a-44c1d7548179 req-c99d0c8e-a1e0-4fcf-92c7-f7089e719fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96760807-513a-459f-b4b4-1cf897885ed6", "tag": "55a71149-6922-4955-9d24-b7427e70e88b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:10.256672 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 401/880] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:09 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1557 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:10.266499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ec53a3c8-bbde-4773-ab80-ad3c51a8badf req-ee243bdd-2536-46e5-9dff-21fa1092929f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79382aab-866e-4dbd-ab77-400cdedef926", "name": "network-vif-deleted", "tag": "4774806d-f309-48d1-8829-26baf46f3ce5"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:10.280503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9609dc44-47ca-45bf-9e0a-44c1d7548179 req-c99d0c8e-a1e0-4fcf-92c7-f7089e719fbf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:10.285710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9609dc44-47ca-45bf-9e0a-44c1d7548179 req-c99d0c8e-a1e0-4fcf-92c7-f7089e719fbf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:10.295094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ec53a3c8-bbde-4773-ab80-ad3c51a8badf req-ee243bdd-2536-46e5-9dff-21fa1092929f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:10.296157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ec53a3c8-bbde-4773-ab80-ad3c51a8badf req-ee243bdd-2536-46e5-9dff-21fa1092929f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:10.314353 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9609dc44-47ca-45bf-9e0a-44c1d7548179 req-c99d0c8e-a1e0-4fcf-92c7-f7089e719fbf service nova] Creating event network-changed:55a71149-6922-4955-9d24-b7427e70e88b for instance 96760807-513a-459f-b4b4-1cf897885ed6 on n-h2-833090-9 Jul 26 14:07:10.321037 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9609dc44-47ca-45bf-9e0a-44c1d7548179 req-c99d0c8e-a1e0-4fcf-92c7-f7089e719fbf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077358 Jul 26 14:07:10.321328 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ec53a3c8-bbde-4773-ab80-ad3c51a8badf req-ee243bdd-2536-46e5-9dff-21fa1092929f service nova] Creating event network-vif-deleted:4774806d-f309-48d1-8829-26baf46f3ce5 for instance 79382aab-866e-4dbd-ab77-400cdedef926 on n-h2-833090-9 Jul 26 14:07:10.327827 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 480/881] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:10.328757 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ec53a3c8-bbde-4773-ab80-ad3c51a8badf req-ee243bdd-2536-46e5-9dff-21fa1092929f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066148 Jul 26 14:07:10.329983 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 402/882] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:10.337449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-79995192-0f4b-483b-bb1b-c7d32685af11 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '.version_select at 0x7f879454fca0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:10.353687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.103"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:10.358839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:10.370283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:10.372379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:10.374826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:10.377088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:10.446175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Acquired lock "refresh_cache-770654ea-0d11-480c-b5f7-6fb864a9b9dc" {{(pid=119479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:07:10.785059 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-79995192-0f4b-483b-bb1b-c7d32685af11 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/dadefeb6-d82f-42d3-a8fd-07764ee5006d" status: 200 len: 184 microversion: 2.1 time: 0.453471 Jul 26 14:07:10.798296 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 403/883] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:07:10 2022] GET /compute/v2.1/os-floating-ips/dadefeb6-d82f-42d3-a8fd-07764ee5006d => generated 184 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:10.814821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6792a852-6e94-421a-b26f-e4f9da51b029 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:10.817356 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:10.817356 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:10.842992 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6792a852-6e94-421a-b26f-e4f9da51b029 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/300018498" status: 202 len: 0 microversion: 2.1 time: 0.039460 Jul 26 14:07:10.844735 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 404/884] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:07:10 2022] DELETE /compute/v2.1/flavors/300018498 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:07:10.851205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c19698ad-296b-4976-bac4-b17f52643b9a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:10.852250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c19698ad-296b-4976-bac4-b17f52643b9a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:10.863293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c19698ad-296b-4976-bac4-b17f52643b9a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:10.864136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c19698ad-296b-4976-bac4-b17f52643b9a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:10.865321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c19698ad-296b-4976-bac4-b17f52643b9a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:10.865991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c19698ad-296b-4976-bac4-b17f52643b9a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:11.129238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.103 (323c6894-5789-45fa-9004-d6eae32dec98) with port a338cd22-92c3-454a-82f2-73b6e140b886 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network dcd70a68-ffc7-49ed-b975-70685c5b60c9.", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:07:11.131148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Releasing lock "refresh_cache-770654ea-0d11-480c-b5f7-6fb864a9b9dc" {{(pid=119479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:07:11.131910 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.103 (323c6894-5789-45fa-9004-d6eae32dec98) with port a338cd22-92c3-454a-82f2-73b6e140b886 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network dcd70a68-ffc7-49ed-b975-70685c5b60c9. Jul 26 14:07:11.131910 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-1f2d3f60-123f-4e8a-8dde-7e4ad0e308a2'] Jul 26 14:07:11.145866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-c19698ad-296b-4976-bac4-b17f52643b9a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 8f842736-4c37-478b-a26b-94b53377cc43 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Request method failure captured: Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action HTTP/1.1 Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 46 Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_TPMVBzSu6LpbM_m_duqtUmoZvY__uidXTUb08ufj-rE0IRaXSvmMlyGhwda1H9n7f8DUqjGLogsMi7Do0X83F8Ja3tDvXPQpaHcdIXDuklf2kDw_8pp78QIQgnbN_mWi91r7aswt02ptnYOPjFYx2ZqjdT0Jk3IJzYD8bOUZxw14g Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 492092ab9cd04b469f35de121b33deda Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:07:11.148687 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/492092ab9cd04b469f35de121b33deda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/492092ab9cd04b469f35de121b33deda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_492092ab9cd04b469f35de121b33deda", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/492092ab9cd04b469f35de121b33deda"}]}] Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 492092ab9cd04b469f35de121b33deda Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: cb330c470ebb4a0b9140e8a58d05f6a0 Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: {"addFloatingIp": {"address": "172.25.2.103"}} Jul 26 14:07:11.150049 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: exception: Cannot associate floating IP 172.25.2.103 (323c6894-5789-45fa-9004-d6eae32dec98) with port a338cd22-92c3-454a-82f2-73b6e140b886 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network dcd70a68-ffc7-49ed-b975-70685c5b60c9. Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-1f2d3f60-123f-4e8a-8dde-7e4ad0e308a2'] Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '770654ea-0d11-480c-b5f7-6fb864a9b9dc', 'body': {'addFloatingIp': {'address': '172.25.2.103'}}} Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:07:11.150828 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:07:11.152800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.103 (323c6894-5789-45fa-9004-d6eae32dec98) with port a338cd22-92c3-454a-82f2-73b6e140b886 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network dcd70a68-ffc7-49ed-b975-70685c5b60c9. Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f2d3f60-123f-4e8a-8dde-7e4ad0e308a2'] Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.103 (323c6894-5789-45fa-9004-d6eae32dec98) with port a338cd22-92c3-454a-82f2-73b6e140b886 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network dcd70a68-ffc7-49ed-b975-70685c5b60c9. Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f2d3f60-123f-4e8a-8dde-7e4ad0e308a2'] Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:11.153776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.103 (323c6894-5789-45fa-9004-d6eae32dec98) with port a338cd22-92c3-454a-82f2-73b6e140b886 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network dcd70a68-ffc7-49ed-b975-70685c5b60c9. Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f2d3f60-123f-4e8a-8dde-7e4ad0e308a2'] Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:11.156408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.103 (323c6894-5789-45fa-9004-d6eae32dec98) with port a338cd22-92c3-454a-82f2-73b6e140b886 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network dcd70a68-ffc7-49ed-b975-70685c5b60c9. Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f2d3f60-123f-4e8a-8dde-7e4ad0e308a2'] Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Returning 400 to user: Cannot associate floating IP 172.25.2.103 (323c6894-5789-45fa-9004-d6eae32dec98) with port a338cd22-92c3-454a-82f2-73b6e140b886 using fixed IP 172.20.0.13, as that fixed IP already has a floating IP on external network dcd70a68-ffc7-49ed-b975-70685c5b60c9. Jul 26 14:07:11.159609 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-1f2d3f60-123f-4e8a-8dde-7e4ad0e308a2'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:11.163510 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f53e491d-a7f7-4e37-a7ac-0a42bb65fc6c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action" status: 400 len: 382 microversion: 2.1 time: 0.814354 Jul 26 14:07:11.163510 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 481/885] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:10 2022] POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action => generated 382 bytes in 829 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:07:11.164697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4579511c-3ada-4a1a-8c3d-a8999a3646cd tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:11.165327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4579511c-3ada-4a1a-8c3d-a8999a3646cd tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:11.174822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4579511c-3ada-4a1a-8c3d-a8999a3646cd tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:11.175285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4579511c-3ada-4a1a-8c3d-a8999a3646cd tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:11.176214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4579511c-3ada-4a1a-8c3d-a8999a3646cd tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:11.177761 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c19698ad-296b-4976-bac4-b17f52643b9a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 2049 microversion: 2.25 time: 0.331599 Jul 26 14:07:11.178293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4579511c-3ada-4a1a-8c3d-a8999a3646cd tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:11.183547 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 405/886] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:10 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 2049 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:11.194851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c912e1e-22c0-49c8-a644-e460bca43bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:11.196430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5c912e1e-22c0-49c8-a644-e460bca43bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:11.204362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c912e1e-22c0-49c8-a644-e460bca43bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:11.204826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c912e1e-22c0-49c8-a644-e460bca43bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:11.206353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c912e1e-22c0-49c8-a644-e460bca43bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:11.206841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c912e1e-22c0-49c8-a644-e460bca43bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:11.239536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:11.256082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:11.329292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:11.412487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4579511c-3ada-4a1a-8c3d-a8999a3646cd tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:11.423609 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4579511c-3ada-4a1a-8c3d-a8999a3646cd tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1473 microversion: 2.1 time: 0.264175 Jul 26 14:07:11.424871 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 482/887] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:11 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1473 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:11.433436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.170"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:11.471443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5c912e1e-22c0-49c8-a644-e460bca43bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:11.482397 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5c912e1e-22c0-49c8-a644-e460bca43bfa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1542 microversion: 2.1 time: 0.296772 Jul 26 14:07:11.483106 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 406/888] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:11 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1542 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:11.490220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ecb8839a-e13f-41a4-a360-bdcbce4fa175 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8794d93820>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:11.562897 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ecb8839a-e13f-41a4-a360-bdcbce4fa175 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 200 len: 1432 microversion: 2.1 time: 0.077825 Jul 26 14:07:11.576992 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 407/889] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:11 2022] GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 1432 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:11.589485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02e07d7c-19d2-48e9-986a-20f14ccd84a1 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:11.614092 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-02e07d7c-19d2-48e9-986a-20f14ccd84a1 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034931 Jul 26 14:07:11.615234 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 408/890] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:07:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:11.620330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4fed93c0-ed06-43b2-890f-413815053f67 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '.version_select at 0x7f8794738f70>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:11.664712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:11.679171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:11.680168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:11.681402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:11.682286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:12.119334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Acquired lock "refresh_cache-96760807-513a-459f-b4b4-1cf897885ed6" {{(pid=119479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:07:13.347512 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4fed93c0-ed06-43b2-890f-413815053f67 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/323c6894-5789-45fa-9004-d6eae32dec98" status: 202 len: 0 microversion: 2.1 time: 1.728927 Jul 26 14:07:13.348693 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 409/891] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:07:11 2022] DELETE /compute/v2.1/os-floating-ips/323c6894-5789-45fa-9004-d6eae32dec98 => generated 0 bytes in 1733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:07:13.354779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3948add2-f7e4-48d1-89f4-f46be02e7f1b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:13.355671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3948add2-f7e4-48d1-89f4-f46be02e7f1b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:13.363694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3948add2-f7e4-48d1-89f4-f46be02e7f1b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:13.364167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3948add2-f7e4-48d1-89f4-f46be02e7f1b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:13.364961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3948add2-f7e4-48d1-89f4-f46be02e7f1b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:13.365393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3948add2-f7e4-48d1-89f4-f46be02e7f1b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:13.575808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Building network info cache for instance {{(pid=119479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 14:07:13.623365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-3948add2-f7e4-48d1-89f4-f46be02e7f1b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 8f842736-4c37-478b-a26b-94b53377cc43 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:07:13.640844 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3948add2-f7e4-48d1-89f4-f46be02e7f1b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 2049 microversion: 2.25 time: 0.291032 Jul 26 14:07:13.652480 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 410/892] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:13 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 2049 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:13.664171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7dab9278-fcb6-4f9e-b6b6-f6372c4b950a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:13.664171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7dab9278-fcb6-4f9e-b6b6-f6372c4b950a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:13.678054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7dab9278-fcb6-4f9e-b6b6-f6372c4b950a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:13.678054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7dab9278-fcb6-4f9e-b6b6-f6372c4b950a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:13.678737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7dab9278-fcb6-4f9e-b6b6-f6372c4b950a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:13.679750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7dab9278-fcb6-4f9e-b6b6-f6372c4b950a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:13.955668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7dab9278-fcb6-4f9e-b6b6-f6372c4b950a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:13.968942 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7dab9278-fcb6-4f9e-b6b6-f6372c4b950a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1317 microversion: 2.1 time: 0.325635 Jul 26 14:07:13.970216 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 411/893] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:13 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:13.990106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b6f03c51-e242-4f18-9bf6-48bc04fedd4b tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8794738040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:14.054569 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b6f03c51-e242-4f18-9bf6-48bc04fedd4b tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 200 len: 1432 microversion: 2.1 time: 0.075083 Jul 26 14:07:14.058785 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 412/894] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:13 2022] GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 1432 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:14.073528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-748d3f71-edfa-4b81-9cd3-2c9fef825247 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-66983243", "id": 1662014840, "os-flavor-access:is_public": "True"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:14.077240 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:14.077240 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:14.110337 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-748d3f71-edfa-4b81-9cd3-2c9fef825247 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.052956 Jul 26 14:07:14.111770 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 413/895] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:07:14 2022] POST /compute/v2.1/flavors => generated 436 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:14.122202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-efa2e9b0-5376-40fd-9df0-ae08bce83c7c req-329d4e31-9630-42d2-af69-13032a1c6058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b122f14c-3b42-4a25-9908-f4b9fb64a2f2", "name": "network-vif-unplugged", "status": "completed", "tag": "26dcbb26-ecb6-4dc2-8c29-abb0b023eb10"}, {"name": "network-changed", "server_uuid": "b122f14c-3b42-4a25-9908-f4b9fb64a2f2", "tag": "26dcbb26-ecb6-4dc2-8c29-abb0b023eb10"}, {"name": "network-changed", "server_uuid": "4c8fb600-30dc-4acb-819a-c6bd8059035a", "tag": "b033356a-67a5-4f24-846b-c91577f66641"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:14.143126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-efa2e9b0-5376-40fd-9df0-ae08bce83c7c req-329d4e31-9630-42d2-af69-13032a1c6058 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:14.144303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-efa2e9b0-5376-40fd-9df0-ae08bce83c7c req-329d4e31-9630-42d2-af69-13032a1c6058 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:14.180435 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-efa2e9b0-5376-40fd-9df0-ae08bce83c7c req-329d4e31-9630-42d2-af69-13032a1c6058 service nova] Creating event network-vif-unplugged:26dcbb26-ecb6-4dc2-8c29-abb0b023eb10 for instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 on n-h2-833090-9 Jul 26 14:07:14.180962 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-efa2e9b0-5376-40fd-9df0-ae08bce83c7c req-329d4e31-9630-42d2-af69-13032a1c6058 service nova] Creating event network-changed:26dcbb26-ecb6-4dc2-8c29-abb0b023eb10 for instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 on n-h2-833090-9 Jul 26 14:07:14.181577 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-efa2e9b0-5376-40fd-9df0-ae08bce83c7c req-329d4e31-9630-42d2-af69-13032a1c6058 service nova] Creating event network-changed:b033356a-67a5-4f24-846b-c91577f66641 for instance 4c8fb600-30dc-4acb-819a-c6bd8059035a on n-h2-833090-9 Jul 26 14:07:14.189112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-efa2e9b0-5376-40fd-9df0-ae08bce83c7c req-329d4e31-9630-42d2-af69-13032a1c6058 service nova] Instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:07:14.208750 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-efa2e9b0-5376-40fd-9df0-ae08bce83c7c req-329d4e31-9630-42d2-af69-13032a1c6058 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.094621 Jul 26 14:07:14.209627 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 414/896] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:14.216197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9ccabc93-f78e-445b-9ee2-0670399a7314 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:14.217040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9ccabc93-f78e-445b-9ee2-0670399a7314 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:14.223836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ccabc93-f78e-445b-9ee2-0670399a7314 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:14.224563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ccabc93-f78e-445b-9ee2-0670399a7314 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:14.225513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ccabc93-f78e-445b-9ee2-0670399a7314 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:14.225816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ccabc93-f78e-445b-9ee2-0670399a7314 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:14.509814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Updating instance_info_cache with network_info: [{"id": "55a71149-6922-4955-9d24-b7427e70e88b", "address": "fa:16:3e:d6:5e:53", "network": {"id": "2348f789-06f4-41a5-a965-401de2b37b0a", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-748933619-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f3d21e6b315b4543993c1a1b7271f913", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap55a71149-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:07:14.528397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Releasing lock "refresh_cache-96760807-513a-459f-b4b4-1cf897885ed6" {{(pid=119479) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:07:14.529310 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-73eef84b-c96c-4b17-aaf7-880367f8e2f6 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "POST /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6/action" status: 202 len: 0 microversion: 2.1 time: 3.103125 Jul 26 14:07:14.530034 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 483/897] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:11 2022] POST /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6/action => generated 0 bytes in 3104 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 14:07:14.535776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a4032fb-05c4-40c1-ac8f-16165aafafd7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:14.536688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9a4032fb-05c4-40c1-ac8f-16165aafafd7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:14.552942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a4032fb-05c4-40c1-ac8f-16165aafafd7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:14.553412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a4032fb-05c4-40c1-ac8f-16165aafafd7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:14.554214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a4032fb-05c4-40c1-ac8f-16165aafafd7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:14.554840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a4032fb-05c4-40c1-ac8f-16165aafafd7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:14.581144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ccabc93-f78e-445b-9ee2-0670399a7314 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:14.597927 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9ccabc93-f78e-445b-9ee2-0670399a7314 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1473 microversion: 2.1 time: 0.386679 Jul 26 14:07:14.602012 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 415/898] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:14 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1473 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:14.606655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Action: 'action', calling method: .version_select at 0x7f8796d2e430>, body: {"removeFloatingIp": {"address": "172.25.2.171"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:14.954781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9a4032fb-05c4-40c1-ac8f-16165aafafd7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:14.959428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:14.971080 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9a4032fb-05c4-40c1-ac8f-16165aafafd7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1474 microversion: 2.1 time: 0.439462 Jul 26 14:07:14.984443 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 484/899] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:14 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1474 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:14.992746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6bf14c67-327a-4508-a549-df0f4d44431e req-5cafccd4-167b-4f22-89a1-2c20894caeb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96760807-513a-459f-b4b4-1cf897885ed6", "tag": "55a71149-6922-4955-9d24-b7427e70e88b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:15.016389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6bf14c67-327a-4508-a549-df0f4d44431e req-5cafccd4-167b-4f22-89a1-2c20894caeb0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.017089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6bf14c67-327a-4508-a549-df0f4d44431e req-5cafccd4-167b-4f22-89a1-2c20894caeb0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:15.037083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:15.040465 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6bf14c67-327a-4508-a549-df0f4d44431e req-5cafccd4-167b-4f22-89a1-2c20894caeb0 service nova] Creating event network-changed:55a71149-6922-4955-9d24-b7427e70e88b for instance 96760807-513a-459f-b4b4-1cf897885ed6 on n-h2-833090-9 Jul 26 14:07:15.049843 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6bf14c67-327a-4508-a549-df0f4d44431e req-5cafccd4-167b-4f22-89a1-2c20894caeb0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062769 Jul 26 14:07:15.050844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.051295 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 485/900] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:15.051830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:15.056361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.057815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:15.061580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a010e13-2b00-45fe-a14d-9d454658751a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:15.066026 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:15.066026 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:15.068513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a010e13-2b00-45fe-a14d-9d454658751a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.069400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a010e13-2b00-45fe-a14d-9d454658751a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:15.071485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a010e13-2b00-45fe-a14d-9d454658751a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.072227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a010e13-2b00-45fe-a14d-9d454658751a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:15.218548 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1a010e13-2b00-45fe-a14d-9d454658751a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.157534 Jul 26 14:07:15.221729 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 486/901] 10.222.0.70 () {60 vars in 1217 bytes} [Tue Jul 26 14:07:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:07:15.235442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95372d3e-714a-437e-8f97-862d69934007 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:15.241549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95372d3e-714a-437e-8f97-862d69934007 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:15.268486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95372d3e-714a-437e-8f97-862d69934007 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.272791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95372d3e-714a-437e-8f97-862d69934007 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:15.274870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95372d3e-714a-437e-8f97-862d69934007 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.275754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95372d3e-714a-437e-8f97-862d69934007 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:15.729332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Acquired lock "refresh_cache-770654ea-0d11-480c-b5f7-6fb864a9b9dc" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:07:15.840644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-95372d3e-714a-437e-8f97-862d69934007 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:15.855464 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95372d3e-714a-437e-8f97-862d69934007 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1466 microversion: 2.1 time: 0.630365 Jul 26 14:07:15.856121 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 487/902] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:15 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1466 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:15.862069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fa19e619-600d-4640-8e7b-3500c8328b84 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:15.863184 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:15.863184 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:15.881705 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-fa19e619-600d-4640-8e7b-3500c8328b84 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fa19e619-600d-4640-8e7b-3500c8328b84 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Request method failure captured: Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/flavors/1662014840/os-flavor-access HTTP/1.1 Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_T7CfFEcg5QctjH-qIO__yl766daX-SFCLHyGxpw89k7ZfZ5WevEnKVPGpp2tTiLrKi7xdbn8l_OHskujJ6tSBYSkAR_dUz-w3Kq54eGFtnL6RlQiFEgkUeDwR6wtg6CEYytut0rl7Z1bCmw_SSzbLQwhG3iP7Zt3GcSMKYNu2M6Xg Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 60c857f4df4143efa3fedee8524cd1c8 Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1570258264 Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:07:15.884414 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60c857f4df4143efa3fedee8524cd1c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/60c857f4df4143efa3fedee8524cd1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_60c857f4df4143efa3fedee8524cd1c8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60c857f4df4143efa3fedee8524cd1c8"}]}] Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1570258264 Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 60c857f4df4143efa3fedee8524cd1c8 Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1570258264 Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e4a36493bb5245d98177c148db768deb Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: exception: Access list not available for public flavors. Jul 26 14:07:15.887389 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'flavor_id': '1662014840'} Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 26 14:07:15.889613 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:15.894584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fa19e619-600d-4640-8e7b-3500c8328b84 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:15.896503 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fa19e619-600d-4640-8e7b-3500c8328b84 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1662014840/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.038314 Jul 26 14:07:15.897987 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 488/903] 10.222.0.70 () {58 vars in 1209 bytes} [Tue Jul 26 14:07:15 2022] GET /compute/v2.1/flavors/1662014840/os-flavor-access => generated 91 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:07:15.909063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7176b941-9f00-4a6b-8441-862be1b30504 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:15.909777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7176b941-9f00-4a6b-8441-862be1b30504 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:15.920997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7176b941-9f00-4a6b-8441-862be1b30504 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.921758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7176b941-9f00-4a6b-8441-862be1b30504 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:15.923335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7176b941-9f00-4a6b-8441-862be1b30504 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.923810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7176b941-9f00-4a6b-8441-862be1b30504 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:15.951050 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-7176b941-9f00-4a6b-8441-862be1b30504 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] HTTP exception thrown: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7176b941-9f00-4a6b-8441-862be1b30504 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Request method failure captured: Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 HTTP/1.1 Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_St64GenKZ87KAkvHDGyRb7HiYM1IthLwlzgvoKvCR_phOn-TticwNzta5bNDk_6ECvjojhVsi6ZR3_0UOESITgs2ieYG1ANS_0FntJ3ERXsIZ5LfgAC078Krje6PA47sXgX4UJxeTjVtlLlFtiqaBys5c0jgR7tQ-1dsRldVSEBRU Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f3d21e6b315b4543993c1a1b7271f913 Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:07:15.958628 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3d21e6b315b4543993c1a1b7271f913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f3d21e6b315b4543993c1a1b7271f913"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f3d21e6b315b4543993c1a1b7271f913", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3d21e6b315b4543993c1a1b7271f913"}]}] Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f3d21e6b315b4543993c1a1b7271f913 Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FloatingIPsAssociationTestJSON-458980477-project Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 9f84bae10984463fbb5579005d7a0a7c Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-458980477-project Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. Jul 26 14:07:15.961047 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '79382aab-866e-4dbd-ab77-400cdedef926'} Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:15.962317 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. Jul 26 14:07:15.965629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:15.968749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7176b941-9f00-4a6b-8441-862be1b30504 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Returning 404 to user: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:15.968749 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7176b941-9f00-4a6b-8441-862be1b30504 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "DELETE /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 404 len: 111 microversion: 2.1 time: 0.061156 Jul 26 14:07:15.968749 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 489/904] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:07:15 2022] DELETE /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:07:15.972096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-88d094e2-be93-4100-ab81-4446bd117da4 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:15.973430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-88d094e2-be93-4100-ab81-4446bd117da4 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:15.992385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88d094e2-be93-4100-ab81-4446bd117da4 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.992385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88d094e2-be93-4100-ab81-4446bd117da4 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:15.992385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88d094e2-be93-4100-ab81-4446bd117da4 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:15.992840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88d094e2-be93-4100-ab81-4446bd117da4 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:16.343836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-88d094e2-be93-4100-ab81-4446bd117da4 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:16.357767 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-88d094e2-be93-4100-ab81-4446bd117da4 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1317 microversion: 2.1 time: 0.390685 Jul 26 14:07:16.362788 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 490/905] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:15 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:16.370904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-06b16b30-63ac-4abd-97f7-e1fb768ffb87 req-44bb3c51-c232-49ca-820f-e2a081999470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c20b152-e109-4ec5-882c-9640b942901e", "name": "network-vif-unplugged", "status": "completed", "tag": "0023117a-fed6-48c7-9154-388efdf05982"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:16.386100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-06b16b30-63ac-4abd-97f7-e1fb768ffb87 req-44bb3c51-c232-49ca-820f-e2a081999470 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:16.387277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-06b16b30-63ac-4abd-97f7-e1fb768ffb87 req-44bb3c51-c232-49ca-820f-e2a081999470 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:16.409044 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-06b16b30-63ac-4abd-97f7-e1fb768ffb87 req-44bb3c51-c232-49ca-820f-e2a081999470 service nova] Creating event network-vif-unplugged:0023117a-fed6-48c7-9154-388efdf05982 for instance 8c20b152-e109-4ec5-882c-9640b942901e on n-h2-833090-9 Jul 26 14:07:16.419784 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-06b16b30-63ac-4abd-97f7-e1fb768ffb87 req-44bb3c51-c232-49ca-820f-e2a081999470 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057179 Jul 26 14:07:16.421223 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 491/906] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:16.430219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-53ada637-519e-4142-970a-b26d73ca6276 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:16.431612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-53ada637-519e-4142-970a-b26d73ca6276 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:16.450424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53ada637-519e-4142-970a-b26d73ca6276 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:16.451097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53ada637-519e-4142-970a-b26d73ca6276 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:16.452440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53ada637-519e-4142-970a-b26d73ca6276 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:16.453183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53ada637-519e-4142-970a-b26d73ca6276 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:16.559767 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-53ada637-519e-4142-970a-b26d73ca6276 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43/action" status: 202 len: 0 microversion: 2.25 time: 0.135214 Jul 26 14:07:16.563989 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 492/907] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:07:16 2022] POST /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:07:16.570347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4172ac17-8142-4971-8089-c42e279169ab tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:16.571180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4172ac17-8142-4971-8089-c42e279169ab tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:16.579650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4172ac17-8142-4971-8089-c42e279169ab tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:16.581372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4172ac17-8142-4971-8089-c42e279169ab tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:16.581372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4172ac17-8142-4971-8089-c42e279169ab tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:16.582002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4172ac17-8142-4971-8089-c42e279169ab tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:17.277031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4172ac17-8142-4971-8089-c42e279169ab tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:17.293643 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4172ac17-8142-4971-8089-c42e279169ab tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1473 microversion: 2.1 time: 0.727962 Jul 26 14:07:17.314597 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 493/908] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:16 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1473 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:17.327700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a02c9742-e886-4700-9902-ce1d5de207cc tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f87948f63a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:17.404604 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a02c9742-e886-4700-9902-ce1d5de207cc tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/5fc64a26-e870-4f37-8cf2-dd18e171162e" status: 200 len: 784 microversion: 2.1 time: 0.084975 Jul 26 14:07:17.405636 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 494/909] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:17 2022] GET /compute/v2.1/images/5fc64a26-e870-4f37-8cf2-dd18e171162e => generated 784 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:17.419587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-40c012ef-37c6-4f9e-9f7a-a13f3eca5c28 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:17.421173 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:17.421173 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:17.423077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Building network info cache for instance {{(pid=119478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 14:07:17.456107 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-40c012ef-37c6-4f9e-9f7a-a13f3eca5c28 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1662014840" status: 202 len: 0 microversion: 2.1 time: 0.048640 Jul 26 14:07:17.461392 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 495/910] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:07:17 2022] DELETE /compute/v2.1/flavors/1662014840 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:07:17.467247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abb5d307-9603-43a2-a69c-0a53caf978d7 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:17.468043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-abb5d307-9603-43a2-a69c-0a53caf978d7 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 79382aab-866e-4dbd-ab77-400cdedef926] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:17.475781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abb5d307-9603-43a2-a69c-0a53caf978d7 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:17.477206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abb5d307-9603-43a2-a69c-0a53caf978d7 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:17.478148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abb5d307-9603-43a2-a69c-0a53caf978d7 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:17.478712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abb5d307-9603-43a2-a69c-0a53caf978d7 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:17.498416 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-abb5d307-9603-43a2-a69c-0a53caf978d7 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] HTTP exception thrown: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abb5d307-9603-43a2-a69c-0a53caf978d7 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Request method failure captured: Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 HTTP/1.1 Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_St64GenKZ87KAkvHDGyRb7HiYM1IthLwlzgvoKvCR_phOn-TticwNzta5bNDk_6ECvjojhVsi6ZR3_0UOESITgs2ieYG1ANS_0FntJ3ERXsIZ5LfgAC078Krje6PA47sXgX4UJxeTjVtlLlFtiqaBys5c0jgR7tQ-1dsRldVSEBRU Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f3d21e6b315b4543993c1a1b7271f913 Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:07:17.500276 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3d21e6b315b4543993c1a1b7271f913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f3d21e6b315b4543993c1a1b7271f913"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f3d21e6b315b4543993c1a1b7271f913", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3d21e6b315b4543993c1a1b7271f913"}]}] Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f3d21e6b315b4543993c1a1b7271f913 Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FloatingIPsAssociationTestJSON-458980477-project Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 9f84bae10984463fbb5579005d7a0a7c Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-458980477-project Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. Jul 26 14:07:17.501967 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '79382aab-866e-4dbd-ab77-400cdedef926'} Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:17.502892 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. Jul 26 14:07:17.504490 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:17.506237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abb5d307-9603-43a2-a69c-0a53caf978d7 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Returning 404 to user: Instance 79382aab-866e-4dbd-ab77-400cdedef926 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:17.506237 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-abb5d307-9603-43a2-a69c-0a53caf978d7 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926" status: 404 len: 111 microversion: 2.1 time: 0.041600 Jul 26 14:07:17.506237 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 496/911] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:17 2022] GET /compute/v2.1/servers/79382aab-866e-4dbd-ab77-400cdedef926 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:07:17.511215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3a9c1496-c86d-4eba-8939-2d6fa5c104fb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:17.511851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3a9c1496-c86d-4eba-8939-2d6fa5c104fb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:17.518121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a9c1496-c86d-4eba-8939-2d6fa5c104fb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:17.518581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a9c1496-c86d-4eba-8939-2d6fa5c104fb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:17.520321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a9c1496-c86d-4eba-8939-2d6fa5c104fb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:17.520792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a9c1496-c86d-4eba-8939-2d6fa5c104fb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:17.800124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3a9c1496-c86d-4eba-8939-2d6fa5c104fb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:17.810526 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3a9c1496-c86d-4eba-8939-2d6fa5c104fb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1471 microversion: 2.1 time: 0.304448 Jul 26 14:07:17.810994 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 497/912] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:17 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1471 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:17.816253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f54c374d-9cf1-40a2-8730-0ef8da633eaf tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:17.817270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f54c374d-9cf1-40a2-8730-0ef8da633eaf tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:17.827937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f54c374d-9cf1-40a2-8730-0ef8da633eaf tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:17.828794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f54c374d-9cf1-40a2-8730-0ef8da633eaf tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:17.829669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f54c374d-9cf1-40a2-8730-0ef8da633eaf tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:17.830260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f54c374d-9cf1-40a2-8730-0ef8da633eaf tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:18.140313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-f54c374d-9cf1-40a2-8730-0ef8da633eaf tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 8f842736-4c37-478b-a26b-94b53377cc43 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:07:18.158732 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f54c374d-9cf1-40a2-8730-0ef8da633eaf tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 2034 microversion: 2.25 time: 0.346358 Jul 26 14:07:18.175591 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 498/913] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:17 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 2034 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:18.184656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0b9e20cf-547f-4b6e-9bc1-ceba94b8ed19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:18.185704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0b9e20cf-547f-4b6e-9bc1-ceba94b8ed19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:18.194093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b9e20cf-547f-4b6e-9bc1-ceba94b8ed19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:18.194706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b9e20cf-547f-4b6e-9bc1-ceba94b8ed19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:18.195647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b9e20cf-547f-4b6e-9bc1-ceba94b8ed19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:18.196371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b9e20cf-547f-4b6e-9bc1-ceba94b8ed19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:18.351175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Updating instance_info_cache with network_info: [{"id": "a338cd22-92c3-454a-82f2-73b6e140b886", "address": "fa:16:3e:7e:e5:f9", "network": {"id": "57f75734-76a5-4e60-8803-969954ea1915", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-613619647-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "492092ab9cd04b469f35de121b33deda", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa338cd22-92", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:07:18.367018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Releasing lock "refresh_cache-770654ea-0d11-480c-b5f7-6fb864a9b9dc" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:07:18.369142 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b56ae542-9e80-421b-86dc-a1dc8231d25e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action" status: 202 len: 0 microversion: 2.1 time: 3.766557 Jul 26 14:07:18.374417 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 416/914] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:14 2022] POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action => generated 0 bytes in 3772 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 14:07:18.380401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93ad9d54-f6a5-4ad5-b641-b502e84bba46 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:18.386889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0b9e20cf-547f-4b6e-9bc1-ceba94b8ed19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:18.390895 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-93ad9d54-f6a5-4ad5-b641-b502e84bba46 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015337 Jul 26 14:07:18.399234 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0b9e20cf-547f-4b6e-9bc1-ceba94b8ed19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1317 microversion: 2.1 time: 0.219522 Jul 26 14:07:18.400522 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 417/915] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:07:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:18.405903 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 499/916] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:18 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:18.407587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d8c8b89d-61d9-4088-8f9f-5d1c5a0738af req-05872d0e-f7d2-45ec-a486-37868f7ae27f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770654ea-0d11-480c-b5f7-6fb864a9b9dc", "tag": "a338cd22-92c3-454a-82f2-73b6e140b886"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:18.411577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cbef302-23aa-4047-a31d-490cee5aff25 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:18.421359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d8c8b89d-61d9-4088-8f9f-5d1c5a0738af req-05872d0e-f7d2-45ec-a486-37868f7ae27f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:18.422279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d8c8b89d-61d9-4088-8f9f-5d1c5a0738af req-05872d0e-f7d2-45ec-a486-37868f7ae27f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:18.442568 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d8c8b89d-61d9-4088-8f9f-5d1c5a0738af req-05872d0e-f7d2-45ec-a486-37868f7ae27f service nova] Creating event network-changed:a338cd22-92c3-454a-82f2-73b6e140b886 for instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc on n-h2-833090-9 Jul 26 14:07:18.445813 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5cbef302-23aa-4047-a31d-490cee5aff25 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038644 Jul 26 14:07:18.456069 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 500/917] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:07:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:18.456771 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d8c8b89d-61d9-4088-8f9f-5d1c5a0738af req-05872d0e-f7d2-45ec-a486-37868f7ae27f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045786 Jul 26 14:07:18.456771 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 418/918] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:18.459681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cfdfc898-aacf-47e9-99f8-590967148e35 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '.version_select at 0x7f879466d8b0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:18.473516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:18.480721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:18.491988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:18.492814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:18.494347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:18.496366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:18.556432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:18.557155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:18.559591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:18.560248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:18.583185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:18.597839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for project d2c43d5f86804cc181b575525a402873. Resources: {'ram', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:07:18.607799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for user 753d20ca575a4270b73b1c686bf657dd and project d2c43d5f86804cc181b575525a402873. Resources: {'ram', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:07:18.799375 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-26c98fe5-1ae1-4287-aed8-4f83cfc099b7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2/action" status: 202 len: 0 microversion: 2.1 time: 0.345924 Jul 26 14:07:18.801233 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 419/919] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:18 2022] POST /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:07:18.813181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-03673e6d-05c0-4f45-8962-87138536c374 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-9", "block_migration": "auto"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:18.817008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-03673e6d-05c0-4f45-8962-87138536c374 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:18.827775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03673e6d-05c0-4f45-8962-87138536c374 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:18.828723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03673e6d-05c0-4f45-8962-87138536c374 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:18.830180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03673e6d-05c0-4f45-8962-87138536c374 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:18.832179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03673e6d-05c0-4f45-8962-87138536c374 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:18.944560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-03673e6d-05c0-4f45-8962-87138536c374 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'flavor' on Instance uuid 8f842736-4c37-478b-a26b-94b53377cc43 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:07:18.965524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-03673e6d-05c0-4f45-8962-87138536c374 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Going to try to live migrate instance to n-h2-833090-9 {{(pid=119478) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 14:07:19.632940 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cfdfc898-aacf-47e9-99f8-590967148e35 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/dadefeb6-d82f-42d3-a8fd-07764ee5006d" status: 202 len: 0 microversion: 2.1 time: 1.183645 Jul 26 14:07:19.634081 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 501/920] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:07:18 2022] DELETE /compute/v2.1/os-floating-ips/dadefeb6-d82f-42d3-a8fd-07764ee5006d => generated 0 bytes in 1185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:07:19.641941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5718f870-0593-4bc3-8da4-b5f9091765c1 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:19.644644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5718f870-0593-4bc3-8da4-b5f9091765c1 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:19.658821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5718f870-0593-4bc3-8da4-b5f9091765c1 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:19.660601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5718f870-0593-4bc3-8da4-b5f9091765c1 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:19.661690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5718f870-0593-4bc3-8da4-b5f9091765c1 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:19.662459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5718f870-0593-4bc3-8da4-b5f9091765c1 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:19.906260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5718f870-0593-4bc3-8da4-b5f9091765c1 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:19.916470 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5718f870-0593-4bc3-8da4-b5f9091765c1 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1473 microversion: 2.1 time: 0.281006 Jul 26 14:07:19.918625 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 502/921] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:19 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1473 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:19.946535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c357b939-818c-4977-bf7f-16d3128eb82e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '.version_select at 0x7f8787fcb5e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:20.884241 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c357b939-818c-4977-bf7f-16d3128eb82e tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/f4a009f5-b78f-4a94-906c-a5004b62bca7" status: 202 len: 0 microversion: 2.1 time: 0.964194 Jul 26 14:07:20.885016 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 503/922] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:07:19 2022] DELETE /compute/v2.1/os-floating-ips/f4a009f5-b78f-4a94-906c-a5004b62bca7 => generated 0 bytes in 966 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:07:20.890127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f792426c-587e-4473-9d56-a1bf382e6937 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8794d99af0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:21.582571 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f792426c-587e-4473-9d56-a1bf382e6937 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "DELETE /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 204 len: 0 microversion: 2.1 time: 0.696131 Jul 26 14:07:21.583154 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 504/923] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:20 2022] DELETE /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:07:21.587832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-83266f44-d3b2-476d-ad0c-d7d751aa4ecc req-4d537713-f11c-4df8-8359-6414e8f9e9ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b122f14c-3b42-4a25-9908-f4b9fb64a2f2", "name": "network-vif-plugged", "status": "completed", "tag": "26dcbb26-ecb6-4dc2-8c29-abb0b023eb10"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:21.600644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-83266f44-d3b2-476d-ad0c-d7d751aa4ecc req-4d537713-f11c-4df8-8359-6414e8f9e9ef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:21.601097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-83266f44-d3b2-476d-ad0c-d7d751aa4ecc req-4d537713-f11c-4df8-8359-6414e8f9e9ef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:21.616181 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-83266f44-d3b2-476d-ad0c-d7d751aa4ecc req-4d537713-f11c-4df8-8359-6414e8f9e9ef service nova] Creating event network-vif-plugged:26dcbb26-ecb6-4dc2-8c29-abb0b023eb10 for instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 on n-h2-833090-9 Jul 26 14:07:21.622331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-83266f44-d3b2-476d-ad0c-d7d751aa4ecc req-4d537713-f11c-4df8-8359-6414e8f9e9ef service nova] Instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:07:21.635821 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-83266f44-d3b2-476d-ad0c-d7d751aa4ecc req-4d537713-f11c-4df8-8359-6414e8f9e9ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051256 Jul 26 14:07:21.636489 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 505/924] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:21.641913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7971a07b-8b67-4301-bdf5-e343afc9f258 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1069118359", "id": 1066760492, "os-flavor-access:is_public": "False"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:21.646588 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:21.646588 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:21.668893 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7971a07b-8b67-4301-bdf5-e343afc9f258 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.030793 Jul 26 14:07:21.670049 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 506/925] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:07:21 2022] POST /compute/v2.1/flavors => generated 439 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:21.674930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dfc03799-f8fe-4a93-b991-ab97d9b69860 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:21.675765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dfc03799-f8fe-4a93-b991-ab97d9b69860 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:21.682793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfc03799-f8fe-4a93-b991-ab97d9b69860 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:21.683515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfc03799-f8fe-4a93-b991-ab97d9b69860 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:21.684541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfc03799-f8fe-4a93-b991-ab97d9b69860 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:21.684993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfc03799-f8fe-4a93-b991-ab97d9b69860 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:21.862415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dfc03799-f8fe-4a93-b991-ab97d9b69860 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:21.871588 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dfc03799-f8fe-4a93-b991-ab97d9b69860 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1470 microversion: 2.1 time: 0.199505 Jul 26 14:07:21.872375 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 507/926] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:21 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:21.884490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-488db672-43e0-4527-9e62-8b933674e512 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:21.884490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-488db672-43e0-4527-9e62-8b933674e512 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:21.886250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-488db672-43e0-4527-9e62-8b933674e512 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:21.887825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-488db672-43e0-4527-9e62-8b933674e512 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:21.888858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-488db672-43e0-4527-9e62-8b933674e512 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:21.889451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-488db672-43e0-4527-9e62-8b933674e512 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.060535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-488db672-43e0-4527-9e62-8b933674e512 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:22.068226 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-488db672-43e0-4527-9e62-8b933674e512 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1317 microversion: 2.1 time: 0.194757 Jul 26 14:07:22.068808 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 508/927] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:21 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:22.073429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6fd4f820-9bf3-4528-8d19-c27b9b49e7b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:22.074304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6fd4f820-9bf3-4528-8d19-c27b9b49e7b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:22.081157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fd4f820-9bf3-4528-8d19-c27b9b49e7b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.081606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fd4f820-9bf3-4528-8d19-c27b9b49e7b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.082588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fd4f820-9bf3-4528-8d19-c27b9b49e7b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.083070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fd4f820-9bf3-4528-8d19-c27b9b49e7b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.114152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6fd4f820-9bf3-4528-8d19-c27b9b49e7b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:07:22.242753 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6fd4f820-9bf3-4528-8d19-c27b9b49e7b3 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "DELETE /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 204 len: 0 microversion: 2.1 time: 0.172090 Jul 26 14:07:22.244078 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 509/928] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:07:22 2022] DELETE /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:07:22.255567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b21b128d-aacb-42da-a2bb-3d0cd7582e1b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b21b128d-aacb-42da-a2bb-3d0cd7582e1b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Request method failure captured: Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action HTTP/1.1 Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 34 Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_TPMVBzSu6LpbM_m_duqtUmoZvY__uidXTUb08ufj-rE0IRaXSvmMlyGhwda1H9n7f8DUqjGLogsMi7Do0X83F8Ja3tDvXPQpaHcdIXDuklf2kDw_8pp78QIQgnbN_mWi91r7aswt02ptnYOPjFYx2ZqjdT0Jk3IJzYD8bOUZxw14g Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 492092ab9cd04b469f35de121b33deda Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:07:22.262624 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/492092ab9cd04b469f35de121b33deda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/492092ab9cd04b469f35de121b33deda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_492092ab9cd04b469f35de121b33deda", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/492092ab9cd04b469f35de121b33deda"}]}] Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 492092ab9cd04b469f35de121b33deda Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: cb330c470ebb4a0b9140e8a58d05f6a0 Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: {"addFloatingIp": {"address": ""}} Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:07:22.264855 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '770654ea-0d11-480c-b5f7-6fb864a9b9dc', 'body': {'addFloatingIp': {'address': ''}}} Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi '' Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:22.265935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:07:22.267561 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:07:22.268765 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 26 14:07:22.268765 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.268765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b21b128d-aacb-42da-a2bb-3d0cd7582e1b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:22.268765 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b21b128d-aacb-42da-a2bb-3d0cd7582e1b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action" status: 400 len: 142 microversion: 2.1 time: 0.019006 Jul 26 14:07:22.268765 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 510/929] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:22 2022] POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action => generated 142 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:07:22.275994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-624596ca-e0e4-4a82-ab88-095ff50f2036 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:22.277409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-624596ca-e0e4-4a82-ab88-095ff50f2036 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:22.287697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-624596ca-e0e4-4a82-ab88-095ff50f2036 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.288197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-624596ca-e0e4-4a82-ab88-095ff50f2036 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.289008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-624596ca-e0e4-4a82-ab88-095ff50f2036 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.289543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-624596ca-e0e4-4a82-ab88-095ff50f2036 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.293319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:22.324703 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-03673e6d-05c0-4f45-8962-87138536c374 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43/action" status: 202 len: 0 microversion: 2.25 time: 3.521105 Jul 26 14:07:22.326478 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 420/930] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:07:18 2022] POST /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43/action => generated 0 bytes in 3525 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:07:22.341949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff5e2db9-938d-4b33-8556-46e81f8a7a75 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f87949ed700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:22.376689 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ff5e2db9-938d-4b33-8556-46e81f8a7a75 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] HTTP exception thrown: Image not found. Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff5e2db9-938d-4b33-8556-46e81f8a7a75 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Request method failure captured: Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 HTTP/1.1 Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_TLvWiJnPuTEt6gY5BLjUX_iZuCJZS1_hDXuGq00a8HQ8KGdRRdQhO7kb8RPZY9_vJuuylc1LKMeZstwLJ0DnjTd3hQgUx34dRHWmxhIUI2S5C_4JsGGA1OXHVVeNADmFJJaRoQYbYqXw3BtlpU3swhbaSb-b1GbBBsnKTzj5JSOu4 Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: f83f5c16243748bb9122828119f5bbef Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesOneServerTestJSON-1935625033 Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:07:22.379088 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f83f5c16243748bb9122828119f5bbef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f83f5c16243748bb9122828119f5bbef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f83f5c16243748bb9122828119f5bbef", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f83f5c16243748bb9122828119f5bbef"}]}] Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesOneServerTestJSON-1935625033 Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: f83f5c16243748bb9122828119f5bbef Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1935625033 Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesOneServerTestJSON-1935625033-project Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6f6b9f5f3cb54ecbb1c1d7603bb3ae79 Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesOneServerTestJSON-1935625033-project Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '8742d93f-b7a3-4bfd-9e1d-891425220ae7'} Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:22.381462 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8742d93f-b7a3-4bfd-9e1d-891425220ae7 Jul 26 14:07:22.382593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:07:22.385152 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8742d93f-b7a3-4bfd-9e1d-891425220ae7 could not be found. Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:07:22.392539 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff5e2db9-938d-4b33-8556-46e81f8a7a75 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:22.394474 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff5e2db9-938d-4b33-8556-46e81f8a7a75 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 404 len: 62 microversion: 2.1 time: 0.054151 Jul 26 14:07:22.401043 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 421/931] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:22 2022] GET /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:07:22.509040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-624596ca-e0e4-4a82-ab88-095ff50f2036 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:22.519165 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-624596ca-e0e4-4a82-ab88-095ff50f2036 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1473 microversion: 2.1 time: 0.250535 Jul 26 14:07:22.519981 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 511/932] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:22 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:22.526079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d8f6279-33e5-4a71-9543-236a2a8840b9 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:22.527235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4d8f6279-33e5-4a71-9543-236a2a8840b9 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:22.535485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d8f6279-33e5-4a71-9543-236a2a8840b9 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.537142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d8f6279-33e5-4a71-9543-236a2a8840b9 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.538506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d8f6279-33e5-4a71-9543-236a2a8840b9 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.539704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d8f6279-33e5-4a71-9543-236a2a8840b9 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.548863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dbe983cf-1bbb-4507-85df-89f39791862a tempest-FlavorsAccessNegativeTestJSON-741623206 tempest-FlavorsAccessNegativeTestJSON-741623206-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9230d28019e14c33a468765fcfbe94bd"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:22.552157 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:22.552157 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:22.553128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dbe983cf-1bbb-4507-85df-89f39791862a tempest-FlavorsAccessNegativeTestJSON-741623206 tempest-FlavorsAccessNegativeTestJSON-741623206-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '818f43bc5dc74388afcd7ea353b5907d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9230d28019e14c33a468765fcfbe94bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dbe983cf-1bbb-4507-85df-89f39791862a tempest-FlavorsAccessNegativeTestJSON-741623206 tempest-FlavorsAccessNegativeTestJSON-741623206-project] Request method failure captured: Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/flavors/1066760492/action HTTP/1.1 Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 67 Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_T5P1XRhbF67VgBs6stUq2nfp_XDUeCTXASyxKNQORGY19Gyk718fZDomZwKqLnoKrDr1FgI6LbMG5D9nJL010ulEh6vIJT4ctVKPP_o-ab1XB4QQCLAM1oD7kitiTdrg0mXK8U75DfI8hD_uJCa12syHxXNNfpzOJMN5p3TpElLwg Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 9230d28019e14c33a468765fcfbe94bd Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-741623206 Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:07:22.555618 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9230d28019e14c33a468765fcfbe94bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9230d28019e14c33a468765fcfbe94bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9230d28019e14c33a468765fcfbe94bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9230d28019e14c33a468765fcfbe94bd"}]}] Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-741623206 Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 9230d28019e14c33a468765fcfbe94bd Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-741623206 Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FlavorsAccessNegativeTestJSON-741623206-project Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 818f43bc5dc74388afcd7ea353b5907d Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-741623206-project Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: {"addTenantAccess": {"tenant": "9230d28019e14c33a468765fcfbe94bd"}} Jul 26 14:07:22.558711 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '1066760492', 'body': {'addTenantAccess': {'tenant': '9230d28019e14c33a468765fcfbe94bd'}}} Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:07:22.560461 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 26 14:07:22.562674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.564848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dbe983cf-1bbb-4507-85df-89f39791862a tempest-FlavorsAccessNegativeTestJSON-741623206 tempest-FlavorsAccessNegativeTestJSON-741623206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:22.564848 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dbe983cf-1bbb-4507-85df-89f39791862a tempest-FlavorsAccessNegativeTestJSON-741623206 tempest-FlavorsAccessNegativeTestJSON-741623206-project] 10.222.0.70 "POST /compute/v2.1/flavors/1066760492/action" status: 403 len: 130 microversion: 2.1 time: 0.162803 Jul 26 14:07:22.564848 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 422/933] 10.222.0.70 () {60 vars in 1200 bytes} [Tue Jul 26 14:07:22 2022] POST /compute/v2.1/flavors/1066760492/action => generated 130 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:07:22.568033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:22.570978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:22.579311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.579724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.581038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.581491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.619193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Acquired lock "refresh_cache-770654ea-0d11-480c-b5f7-6fb864a9b9dc" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:07:22.778641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Releasing lock "refresh_cache-770654ea-0d11-480c-b5f7-6fb864a9b9dc" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:07:22.779816 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] HTTP exception thrown: floating IP not found Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Request method failure captured: Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action HTTP/1.1 Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 41 Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_TPMVBzSu6LpbM_m_duqtUmoZvY__uidXTUb08ufj-rE0IRaXSvmMlyGhwda1H9n7f8DUqjGLogsMi7Do0X83F8Ja3tDvXPQpaHcdIXDuklf2kDw_8pp78QIQgnbN_mWi91r7aswt02ptnYOPjFYx2ZqjdT0Jk3IJzYD8bOUZxw14g Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 492092ab9cd04b469f35de121b33deda Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:07:22.785889 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/492092ab9cd04b469f35de121b33deda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/492092ab9cd04b469f35de121b33deda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_492092ab9cd04b469f35de121b33deda", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/492092ab9cd04b469f35de121b33deda"}]}] Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 492092ab9cd04b469f35de121b33deda Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: cb330c470ebb4a0b9140e8a58d05f6a0 Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: exception: floating IP not found Jul 26 14:07:22.788031 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '770654ea-0d11-480c-b5f7-6fb864a9b9dc', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:22.789098 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 26 14:07:22.790508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:22.792307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Returning 404 to user: floating IP not found {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:22.792307 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-40420575-c473-49ad-9ba8-cb92b0a31750 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action" status: 404 len: 67 microversion: 2.1 time: 0.224978 Jul 26 14:07:22.792307 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 423/934] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:22 2022] POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action => generated 67 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:07:22.794349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4d8f6279-33e5-4a71-9543-236a2a8840b9 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:22.799142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c4042f3-9ace-4dd7-bc6e-6cda621009a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:22.799790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0c4042f3-9ace-4dd7-bc6e-6cda621009a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:22.806401 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d8f6279-33e5-4a71-9543-236a2a8840b9 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1523 microversion: 2.1 time: 0.284399 Jul 26 14:07:22.806788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c4042f3-9ace-4dd7-bc6e-6cda621009a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.807287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c4042f3-9ace-4dd7-bc6e-6cda621009a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.811799 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 512/935] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:22 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:22.812132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c4042f3-9ace-4dd7-bc6e-6cda621009a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.812132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c4042f3-9ace-4dd7-bc6e-6cda621009a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.814456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9d20b4db-2a4c-46b1-83d2-01309937e66c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2083111182"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:22.817150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9d20b4db-2a4c-46b1-83d2-01309937e66c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:22.827005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d20b4db-2a4c-46b1-83d2-01309937e66c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.827702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d20b4db-2a4c-46b1-83d2-01309937e66c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.828989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d20b4db-2a4c-46b1-83d2-01309937e66c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:22.829655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d20b4db-2a4c-46b1-83d2-01309937e66c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:22.981491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0c4042f3-9ace-4dd7-bc6e-6cda621009a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:22.993125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0c4042f3-9ace-4dd7-bc6e-6cda621009a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:22.995608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0c4042f3-9ace-4dd7-bc6e-6cda621009a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:22.997006 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c4042f3-9ace-4dd7-bc6e-6cda621009a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 0.202376 Jul 26 14:07:23.008192 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 424/936] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:22 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:23.008192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d83d3e5-5ef0-49de-87b8-1e697041cdfd tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:23.008192 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:23.008192 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:23.029276 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d83d3e5-5ef0-49de-87b8-1e697041cdfd tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1066760492" status: 202 len: 0 microversion: 2.1 time: 0.029751 Jul 26 14:07:23.030100 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 425/937] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:07:22 2022] DELETE /compute/v2.1/flavors/1066760492 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:07:23.037914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f969dafc-ac0a-4f89-b2ec-9411f6473413 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:23.095302 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9d20b4db-2a4c-46b1-83d2-01309937e66c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "POST /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e/action" status: 202 len: 0 microversion: 2.1 time: 0.285299 Jul 26 14:07:23.096240 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 513/938] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:22 2022] POST /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 14:07:23.099028 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-f969dafc-ac0a-4f89-b2ec-9411f6473413 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f969dafc-ac0a-4f89-b2ec-9411f6473413 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Request method failure captured: Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action HTTP/1.1 Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 44 Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_TPMVBzSu6LpbM_m_duqtUmoZvY__uidXTUb08ufj-rE0IRaXSvmMlyGhwda1H9n7f8DUqjGLogsMi7Do0X83F8Ja3tDvXPQpaHcdIXDuklf2kDw_8pp78QIQgnbN_mWi91r7aswt02ptnYOPjFYx2ZqjdT0Jk3IJzYD8bOUZxw14g Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 492092ab9cd04b469f35de121b33deda Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:07:23.101131 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/492092ab9cd04b469f35de121b33deda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/492092ab9cd04b469f35de121b33deda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_492092ab9cd04b469f35de121b33deda", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/492092ab9cd04b469f35de121b33deda"}]}] Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 492092ab9cd04b469f35de121b33deda Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: cb330c470ebb4a0b9140e8a58d05f6a0 Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:07:23.103560 n-d-833090-9 devstack@n-api.service[119478]: exception: Floating IP not found for address 0.0.0.0. Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '770654ea-0d11-480c-b5f7-6fb864a9b9dc', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:23.106698 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 26 14:07:23.111153 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:23.115725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f969dafc-ac0a-4f89-b2ec-9411f6473413 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:23.115725 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f969dafc-ac0a-4f89-b2ec-9411f6473413 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action" status: 404 len: 88 microversion: 2.1 time: 0.071124 Jul 26 14:07:23.116099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-66bbabd8-0a39-4938-85da-171d120b9926 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:23.116289 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 426/939] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:23 2022] POST /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc/action => generated 88 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:07:23.116478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-66bbabd8-0a39-4938-85da-171d120b9926 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:23.116685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ab91a78-4e0c-4a7b-be3d-9652270ce66d tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:23.116858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66bbabd8-0a39-4938-85da-171d120b9926 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.116858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66bbabd8-0a39-4938-85da-171d120b9926 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.116858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66bbabd8-0a39-4938-85da-171d120b9926 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.116858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66bbabd8-0a39-4938-85da-171d120b9926 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.133223 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ab91a78-4e0c-4a7b-be3d-9652270ce66d tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028736 Jul 26 14:07:23.133870 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 427/940] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:07:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:23.138862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5684aa14-b195-40c1-9070-351d68e9e7e9 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:23.139562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5684aa14-b195-40c1-9070-351d68e9e7e9 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:23.146839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5684aa14-b195-40c1-9070-351d68e9e7e9 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.147298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5684aa14-b195-40c1-9070-351d68e9e7e9 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.148225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5684aa14-b195-40c1-9070-351d68e9e7e9 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.148588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5684aa14-b195-40c1-9070-351d68e9e7e9 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.350949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-66bbabd8-0a39-4938-85da-171d120b9926 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:23.356439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5684aa14-b195-40c1-9070-351d68e9e7e9 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:23.360002 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-66bbabd8-0a39-4938-85da-171d120b9926 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1470 microversion: 2.1 time: 0.262028 Jul 26 14:07:23.360626 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 514/941] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:23 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:23.367861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6b133f25-ba02-4e72-884e-b4ad8321993a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787fd6ca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:23.372491 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5684aa14-b195-40c1-9070-351d68e9e7e9 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1317 microversion: 2.1 time: 0.237442 Jul 26 14:07:23.373113 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 428/942] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:23 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:23.379688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0f2df5b-3c69-430e-9ad5-07cd5fb105e4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:23.380235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c0f2df5b-3c69-430e-9ad5-07cd5fb105e4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:23.387444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0f2df5b-3c69-430e-9ad5-07cd5fb105e4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.388321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0f2df5b-3c69-430e-9ad5-07cd5fb105e4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.389326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0f2df5b-3c69-430e-9ad5-07cd5fb105e4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.389950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0f2df5b-3c69-430e-9ad5-07cd5fb105e4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.407855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=5,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:23.424079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c0f2df5b-3c69-430e-9ad5-07cd5fb105e4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:07:23.437947 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6b133f25-ba02-4e72-884e-b4ad8321993a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.076093 Jul 26 14:07:23.438533 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 515/943] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:23 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:23.443365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4dff287e-728c-480a-8570-ca88b3a1c34c tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2106787697", "id": 1535486957, "os-flavor-access:is_public": "False"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:23.446423 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:23.446423 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:23.465616 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4dff287e-728c-480a-8570-ca88b3a1c34c tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.025208 Jul 26 14:07:23.466190 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 516/944] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:07:23 2022] POST /compute/v2.1/flavors => generated 439 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:23.478521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9abf612-132d-4245-90fc-2c79a53d2fa2 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9230d28019e14c33a468765fcfbe94bd"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:23.482210 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:23.482210 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:23.523941 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c0f2df5b-3c69-430e-9ad5-07cd5fb105e4 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "DELETE /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 204 len: 0 microversion: 2.1 time: 0.148767 Jul 26 14:07:23.524556 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 429/945] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:07:23 2022] DELETE /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:07:23.533919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cae6aec8-c065-49fd-8673-6c1988a12cf5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:23.535026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cae6aec8-c065-49fd-8673-6c1988a12cf5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:23.543158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cae6aec8-c065-49fd-8673-6c1988a12cf5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.543870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cae6aec8-c065-49fd-8673-6c1988a12cf5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.545146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cae6aec8-c065-49fd-8673-6c1988a12cf5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.545682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cae6aec8-c065-49fd-8673-6c1988a12cf5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.572266 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d9abf612-132d-4245-90fc-2c79a53d2fa2 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1535486957/action" status: 200 len: 97 microversion: 2.1 time: 0.097518 Jul 26 14:07:23.572779 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 517/946] 10.222.0.70 () {60 vars in 1200 bytes} [Tue Jul 26 14:07:23 2022] POST /compute/v2.1/flavors/1535486957/action => generated 97 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 14:07:23.578041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-686f0e0b-c374-416c-8524-0d42283c7410 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:23.578752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-686f0e0b-c374-416c-8524-0d42283c7410 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:23.586244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-686f0e0b-c374-416c-8524-0d42283c7410 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.586826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-686f0e0b-c374-416c-8524-0d42283c7410 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.587868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-686f0e0b-c374-416c-8524-0d42283c7410 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.589216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-686f0e0b-c374-416c-8524-0d42283c7410 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.752728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cae6aec8-c065-49fd-8673-6c1988a12cf5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:23.764200 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cae6aec8-c065-49fd-8673-6c1988a12cf5 tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1541 microversion: 2.1 time: 0.234099 Jul 26 14:07:23.765276 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 430/947] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:23 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1541 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:07:23.773948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fabd4472-5877-4fbb-81c3-c1ebfa5dafd1 tempest-FlavorsAccessNegativeTestJSON-741623206 tempest-FlavorsAccessNegativeTestJSON-741623206-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9230d28019e14c33a468765fcfbe94bd"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:23.780754 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:23.780754 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:23.780754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fabd4472-5877-4fbb-81c3-c1ebfa5dafd1 tempest-FlavorsAccessNegativeTestJSON-741623206 tempest-FlavorsAccessNegativeTestJSON-741623206-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '818f43bc5dc74388afcd7ea353b5907d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9230d28019e14c33a468765fcfbe94bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fabd4472-5877-4fbb-81c3-c1ebfa5dafd1 tempest-FlavorsAccessNegativeTestJSON-741623206 tempest-FlavorsAccessNegativeTestJSON-741623206-project] Request method failure captured: Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/flavors/1535486957/action HTTP/1.1 Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 70 Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_T5P1XRhbF67VgBs6stUq2nfp_XDUeCTXASyxKNQORGY19Gyk718fZDomZwKqLnoKrDr1FgI6LbMG5D9nJL010ulEh6vIJT4ctVKPP_o-ab1XB4QQCLAM1oD7kitiTdrg0mXK8U75DfI8hD_uJCa12syHxXNNfpzOJMN5p3TpElLwg Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 9230d28019e14c33a468765fcfbe94bd Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-741623206 Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:07:23.782703 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9230d28019e14c33a468765fcfbe94bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9230d28019e14c33a468765fcfbe94bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9230d28019e14c33a468765fcfbe94bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9230d28019e14c33a468765fcfbe94bd"}]}] Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-741623206 Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 9230d28019e14c33a468765fcfbe94bd Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-741623206 Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FlavorsAccessNegativeTestJSON-741623206-project Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 818f43bc5dc74388afcd7ea353b5907d Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-741623206-project Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: {"removeTenantAccess": {"tenant": "9230d28019e14c33a468765fcfbe94bd"}} Jul 26 14:07:23.784312 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '1535486957', 'body': {'removeTenantAccess': {'tenant': '9230d28019e14c33a468765fcfbe94bd'}}} Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can( Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:07:23.788767 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 26 14:07:23.790217 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:23.791452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fabd4472-5877-4fbb-81c3-c1ebfa5dafd1 tempest-FlavorsAccessNegativeTestJSON-741623206 tempest-FlavorsAccessNegativeTestJSON-741623206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:23.791452 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fabd4472-5877-4fbb-81c3-c1ebfa5dafd1 tempest-FlavorsAccessNegativeTestJSON-741623206 tempest-FlavorsAccessNegativeTestJSON-741623206-project] 10.222.0.70 "POST /compute/v2.1/flavors/1535486957/action" status: 403 len: 133 microversion: 2.1 time: 0.017578 Jul 26 14:07:23.791452 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 431/948] 10.222.0.70 () {60 vars in 1200 bytes} [Tue Jul 26 14:07:23 2022] POST /compute/v2.1/flavors/1535486957/action => generated 133 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:07:23.791691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-686f0e0b-c374-416c-8524-0d42283c7410 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:23.791840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-106daeee-bdcc-4593-a23f-be44cb327147 req-9eb50b94-faef-4743-b838-d8b16f8ef9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8fb600-30dc-4acb-819a-c6bd8059035a", "name": "network-vif-plugged", "status": "completed", "tag": "b033356a-67a5-4f24-846b-c91577f66641"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:23.797618 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-686f0e0b-c374-416c-8524-0d42283c7410 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1473 microversion: 2.1 time: 0.223439 Jul 26 14:07:23.798807 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 518/949] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:23 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1473 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:23.803631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-106daeee-bdcc-4593-a23f-be44cb327147 req-9eb50b94-faef-4743-b838-d8b16f8ef9c2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.804128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-106daeee-bdcc-4593-a23f-be44cb327147 req-9eb50b94-faef-4743-b838-d8b16f8ef9c2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.806119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d47f0e82-9d01-4336-8c7b-4c44e57aa0a1 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9230d28019e14c33a468765fcfbe94bd"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:23.810818 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:23.810818 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:23.816724 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-106daeee-bdcc-4593-a23f-be44cb327147 req-9eb50b94-faef-4743-b838-d8b16f8ef9c2 service nova] Creating event network-vif-plugged:b033356a-67a5-4f24-846b-c91577f66641 for instance 4c8fb600-30dc-4acb-819a-c6bd8059035a on n-h2-833090-9 Jul 26 14:07:23.821850 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-106daeee-bdcc-4593-a23f-be44cb327147 req-9eb50b94-faef-4743-b838-d8b16f8ef9c2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035720 Jul 26 14:07:23.822466 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 432/950] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:23.837589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c34a73d4-69ce-48d3-9681-3787b69b0002 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:23.840154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c34a73d4-69ce-48d3-9681-3787b69b0002 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:23.850259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c34a73d4-69ce-48d3-9681-3787b69b0002 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.851007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c34a73d4-69ce-48d3-9681-3787b69b0002 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.852470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c34a73d4-69ce-48d3-9681-3787b69b0002 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:23.853040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c34a73d4-69ce-48d3-9681-3787b69b0002 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:23.901673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:23.920150 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d47f0e82-9d01-4336-8c7b-4c44e57aa0a1 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1535486957/action" status: 200 len: 21 microversion: 2.1 time: 0.119718 Jul 26 14:07:23.921093 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 519/951] 10.222.0.70 () {60 vars in 1200 bytes} [Tue Jul 26 14:07:23 2022] POST /compute/v2.1/flavors/1535486957/action => generated 21 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:07:23.934557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09e8f9fe-e46b-4c93-a27b-90e3cf255aca tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:23.935546 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:23.935546 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:23.963311 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-09e8f9fe-e46b-4c93-a27b-90e3cf255aca tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1535486957" status: 202 len: 0 microversion: 2.1 time: 0.035412 Jul 26 14:07:23.964979 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 520/952] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:07:23 2022] DELETE /compute/v2.1/flavors/1535486957 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:07:23.975841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fffe5211-143a-4ba7-87cf-a05a5d6f5d8c tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:24.000778 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fffe5211-143a-4ba7-87cf-a05a5d6f5d8c tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030095 Jul 26 14:07:24.002600 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 521/953] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:07:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:24.029491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8acd4012-e8fd-4e23-9660-23eeddb81d1e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:24.030129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8acd4012-e8fd-4e23-9660-23eeddb81d1e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:24.044148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8acd4012-e8fd-4e23-9660-23eeddb81d1e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:24.044635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8acd4012-e8fd-4e23-9660-23eeddb81d1e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:24.046404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8acd4012-e8fd-4e23-9660-23eeddb81d1e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:24.047109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8acd4012-e8fd-4e23-9660-23eeddb81d1e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:24.133697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c34a73d4-69ce-48d3-9681-3787b69b0002 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:24.142907 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c34a73d4-69ce-48d3-9681-3787b69b0002 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1523 microversion: 2.1 time: 0.312077 Jul 26 14:07:24.142907 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 433/954] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:23 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:07:24.147432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d396ac06-84d6-4ab0-998c-d95d9cd0d241 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-186633122", "id": 663067205, "os-flavor-access:is_public": "False"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:24.150599 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:24.150599 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:24.172512 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d396ac06-84d6-4ab0-998c-d95d9cd0d241 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.028424 Jul 26 14:07:24.174767 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 434/955] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:07:24 2022] POST /compute/v2.1/flavors => generated 435 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:24.195506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d8d69462-4855-4481-a8d9-775be9af2724 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d226dbc449e34326a2523dcbc3941eb3"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:24.199292 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:24.199292 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:24.268969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8acd4012-e8fd-4e23-9660-23eeddb81d1e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:24.283055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8acd4012-e8fd-4e23-9660-23eeddb81d1e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:24.285561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8acd4012-e8fd-4e23-9660-23eeddb81d1e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:24.287174 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8acd4012-e8fd-4e23-9660-23eeddb81d1e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 0.264311 Jul 26 14:07:24.288542 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 522/956] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:24 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:24.291193 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d8d69462-4855-4481-a8d9-775be9af2724 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] HTTP exception thrown: Flavor access not found for 40 / d226dbc449e34326a2523dcbc3941eb3 combination. Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d8d69462-4855-4481-a8d9-775be9af2724 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Request method failure captured: Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/flavors/663067205/action HTTP/1.1 Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 70 Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_T7CfFEcg5QctjH-qIO__yl766daX-SFCLHyGxpw89k7ZfZ5WevEnKVPGpp2tTiLrKi7xdbn8l_OHskujJ6tSBYSkAR_dUz-w3Kq54eGFtnL6RlQiFEgkUeDwR6wtg6CEYytut0rl7Z1bCmw_SSzbLQwhG3iP7Zt3GcSMKYNu2M6Xg Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 60c857f4df4143efa3fedee8524cd1c8 Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1570258264 Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:07:24.294513 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60c857f4df4143efa3fedee8524cd1c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/60c857f4df4143efa3fedee8524cd1c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_60c857f4df4143efa3fedee8524cd1c8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/60c857f4df4143efa3fedee8524cd1c8"}]}] Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1570258264 Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 60c857f4df4143efa3fedee8524cd1c8 Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1570258264 Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: e4a36493bb5245d98177c148db768deb Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: {"removeTenantAccess": {"tenant": "d226dbc449e34326a2523dcbc3941eb3"}} Jul 26 14:07:24.297221 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: exception: Flavor access not found for 40 / d226dbc449e34326a2523dcbc3941eb3 combination. Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '663067205', 'body': {'removeTenantAccess': {'tenant': 'd226dbc449e34326a2523dcbc3941eb3'}}} Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 26 14:07:24.298208 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 40 / d226dbc449e34326a2523dcbc3941eb3 combination. Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 40 / d226dbc449e34326a2523dcbc3941eb3 combination. Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:24.300337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:24.304054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:24.304054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:24.304054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:24.304054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:24.304054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 40 / d226dbc449e34326a2523dcbc3941eb3 combination. Jul 26 14:07:24.304054 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:24.304054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d8d69462-4855-4481-a8d9-775be9af2724 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Returning 404 to user: Flavor access not found for 40 / d226dbc449e34326a2523dcbc3941eb3 combination. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:24.304054 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d8d69462-4855-4481-a8d9-775be9af2724 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/663067205/action" status: 404 len: 124 microversion: 2.1 time: 0.108060 Jul 26 14:07:24.304054 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 435/957] 10.222.0.70 () {60 vars in 1197 bytes} [Tue Jul 26 14:07:24 2022] POST /compute/v2.1/flavors/663067205/action => generated 124 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:07:24.309817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cafecff2-ea00-4f60-ae29-9f00bd7ab245 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:24.310668 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:24.310668 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:24.328634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cafecff2-ea00-4f60-ae29-9f00bd7ab245 tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/663067205" status: 202 len: 0 microversion: 2.1 time: 0.023328 Jul 26 14:07:24.329231 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 523/958] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:07:24 2022] DELETE /compute/v2.1/flavors/663067205 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:07:24.339524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d204c43-73ac-4130-a99f-3b764c7caa7a tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:24.361250 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6d204c43-73ac-4130-a99f-3b764c7caa7a tempest-FlavorsAccessNegativeTestJSON-1570258264 tempest-FlavorsAccessNegativeTestJSON-1570258264-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025770 Jul 26 14:07:24.362003 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 436/959] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:07:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:24.382600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-276a4dc5-f96b-4002-865f-8df772732600 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:24.383235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-276a4dc5-f96b-4002-865f-8df772732600 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:24.389694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-276a4dc5-f96b-4002-865f-8df772732600 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:24.390146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-276a4dc5-f96b-4002-865f-8df772732600 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:24.390954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-276a4dc5-f96b-4002-865f-8df772732600 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:24.391392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-276a4dc5-f96b-4002-865f-8df772732600 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:24.399305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dfc90fb0-5b2b-4ba0-be45-05c3c781783f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:24.400457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dfc90fb0-5b2b-4ba0-be45-05c3c781783f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:24.415327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfc90fb0-5b2b-4ba0-be45-05c3c781783f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:24.416212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfc90fb0-5b2b-4ba0-be45-05c3c781783f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:24.418050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfc90fb0-5b2b-4ba0-be45-05c3c781783f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:24.418746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfc90fb0-5b2b-4ba0-be45-05c3c781783f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:24.605053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-276a4dc5-f96b-4002-865f-8df772732600 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:24.615121 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-276a4dc5-f96b-4002-865f-8df772732600 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1470 microversion: 2.1 time: 0.236477 Jul 26 14:07:24.625336 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 524/960] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:24 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:24.631323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b154635-6a94-4640-b3d4-ca49586723ff tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787fd6040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:24.654069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dfc90fb0-5b2b-4ba0-be45-05c3c781783f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:24.663618 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dfc90fb0-5b2b-4ba0-be45-05c3c781783f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1317 microversion: 2.1 time: 0.269703 Jul 26 14:07:24.674647 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 437/961] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:24 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:07:24.694877 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b154635-6a94-4640-b3d4-ca49586723ff tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.077601 Jul 26 14:07:24.695624 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 525/962] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:24 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:24.787516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b49743e-4346-44e9-be23-f6a1163a270b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:24.788253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b49743e-4346-44e9-be23-f6a1163a270b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:24.795876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b49743e-4346-44e9-be23-f6a1163a270b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:24.796363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b49743e-4346-44e9-be23-f6a1163a270b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:24.797159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b49743e-4346-44e9-be23-f6a1163a270b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:24.797675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b49743e-4346-44e9-be23-f6a1163a270b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:24.824620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-639192ac-0788-4721-ba3d-a3a9a830781a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:24.825719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-639192ac-0788-4721-ba3d-a3a9a830781a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:24.837173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-639192ac-0788-4721-ba3d-a3a9a830781a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:24.837945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-639192ac-0788-4721-ba3d-a3a9a830781a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:24.839886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-639192ac-0788-4721-ba3d-a3a9a830781a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:24.841567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-639192ac-0788-4721-ba3d-a3a9a830781a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:25.050034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b49743e-4346-44e9-be23-f6a1163a270b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:25.061476 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b49743e-4346-44e9-be23-f6a1163a270b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1541 microversion: 2.1 time: 0.278535 Jul 26 14:07:25.062252 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 438/963] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:24 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1541 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:07:25.093651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:25.100597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-639192ac-0788-4721-ba3d-a3a9a830781a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:25.112353 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-639192ac-0788-4721-ba3d-a3a9a830781a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1473 microversion: 2.1 time: 0.295660 Jul 26 14:07:25.113123 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 526/964] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:24 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1473 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:25.171396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1ae0060d-2d68-48be-a1b6-d3b71f9c6358 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:25.172469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1ae0060d-2d68-48be-a1b6-d3b71f9c6358 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:25.178702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ae0060d-2d68-48be-a1b6-d3b71f9c6358 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:25.179156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ae0060d-2d68-48be-a1b6-d3b71f9c6358 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:25.179961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ae0060d-2d68-48be-a1b6-d3b71f9c6358 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:25.180422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ae0060d-2d68-48be-a1b6-d3b71f9c6358 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:25.314315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5bde536b-4554-4253-aeea-ff02a85add01 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:25.315994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5bde536b-4554-4253-aeea-ff02a85add01 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:25.325356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bde536b-4554-4253-aeea-ff02a85add01 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:25.325816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bde536b-4554-4253-aeea-ff02a85add01 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:25.326605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bde536b-4554-4253-aeea-ff02a85add01 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:25.327062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bde536b-4554-4253-aeea-ff02a85add01 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:25.363596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ae0060d-2d68-48be-a1b6-d3b71f9c6358 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:25.377429 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1ae0060d-2d68-48be-a1b6-d3b71f9c6358 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1523 microversion: 2.1 time: 0.210613 Jul 26 14:07:25.379213 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 439/965] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:25 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:25.527521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5bde536b-4554-4253-aeea-ff02a85add01 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:25.538708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5bde536b-4554-4253-aeea-ff02a85add01 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:25.540694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5bde536b-4554-4253-aeea-ff02a85add01 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:25.542075 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5bde536b-4554-4253-aeea-ff02a85add01 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 0.233329 Jul 26 14:07:25.543155 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 527/966] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:25 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:25.639804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-807b36c3-d11d-44c8-9a61-38ff723db46d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:25.640563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-807b36c3-d11d-44c8-9a61-38ff723db46d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:25.648894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-807b36c3-d11d-44c8-9a61-38ff723db46d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:25.650261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-807b36c3-d11d-44c8-9a61-38ff723db46d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:25.652420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-807b36c3-d11d-44c8-9a61-38ff723db46d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:25.653212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-807b36c3-d11d-44c8-9a61-38ff723db46d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:25.689396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8b657650-183b-4833-92bb-6207218b3815 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:25.690496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8b657650-183b-4833-92bb-6207218b3815 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:25.699976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b657650-183b-4833-92bb-6207218b3815 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:25.700865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b657650-183b-4833-92bb-6207218b3815 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:25.702005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b657650-183b-4833-92bb-6207218b3815 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:25.702610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b657650-183b-4833-92bb-6207218b3815 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:25.895150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-807b36c3-d11d-44c8-9a61-38ff723db46d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:25.919188 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-807b36c3-d11d-44c8-9a61-38ff723db46d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1470 microversion: 2.1 time: 0.283611 Jul 26 14:07:25.920595 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 440/967] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:25 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:25.939723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32dc06f2-0350-4458-b207-1b8594440c4f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8794495040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:25.945206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8b657650-183b-4833-92bb-6207218b3815 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:25.966640 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8b657650-183b-4833-92bb-6207218b3815 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1317 microversion: 2.1 time: 0.280171 Jul 26 14:07:25.968971 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 528/968] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:25 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:07:26.005458 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32dc06f2-0350-4458-b207-1b8594440c4f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.080447 Jul 26 14:07:26.006276 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 441/969] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:25 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:26.079426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e6f00da3-0b1f-4390-aeb9-9021d2b4b480 req-19f27611-1e04-4ebd-9156-aa56b7963dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b122f14c-3b42-4a25-9908-f4b9fb64a2f2", "name": "network-vif-unplugged", "status": "completed", "tag": "26dcbb26-ecb6-4dc2-8c29-abb0b023eb10"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:26.083478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b17c9fdb-0bb8-40cb-b8eb-ac59281c0a9b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:26.084307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b17c9fdb-0bb8-40cb-b8eb-ac59281c0a9b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:26.099490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b17c9fdb-0bb8-40cb-b8eb-ac59281c0a9b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.101918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b17c9fdb-0bb8-40cb-b8eb-ac59281c0a9b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.103036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b17c9fdb-0bb8-40cb-b8eb-ac59281c0a9b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.106083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b17c9fdb-0bb8-40cb-b8eb-ac59281c0a9b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.108394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e6f00da3-0b1f-4390-aeb9-9021d2b4b480 req-19f27611-1e04-4ebd-9156-aa56b7963dca service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.109731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e6f00da3-0b1f-4390-aeb9-9021d2b4b480 req-19f27611-1e04-4ebd-9156-aa56b7963dca service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.145308 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e6f00da3-0b1f-4390-aeb9-9021d2b4b480 req-19f27611-1e04-4ebd-9156-aa56b7963dca service nova] Creating event network-vif-unplugged:26dcbb26-ecb6-4dc2-8c29-abb0b023eb10 for instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 on n-h2-833090-9 Jul 26 14:07:26.157064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-e6f00da3-0b1f-4390-aeb9-9021d2b4b480 req-19f27611-1e04-4ebd-9156-aa56b7963dca service nova] Instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:07:26.181436 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e6f00da3-0b1f-4390-aeb9-9021d2b4b480 req-19f27611-1e04-4ebd-9156-aa56b7963dca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107871 Jul 26 14:07:26.182263 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 529/970] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:26.195008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-39817890-e72b-4b68-a137-11ae46db7b6a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:26.196030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-39817890-e72b-4b68-a137-11ae46db7b6a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:26.221260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39817890-e72b-4b68-a137-11ae46db7b6a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.236468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39817890-e72b-4b68-a137-11ae46db7b6a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.239211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39817890-e72b-4b68-a137-11ae46db7b6a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.240293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39817890-e72b-4b68-a137-11ae46db7b6a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.387131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b17c9fdb-0bb8-40cb-b8eb-ac59281c0a9b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:26.399486 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b17c9fdb-0bb8-40cb-b8eb-ac59281c0a9b tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1541 microversion: 2.1 time: 0.320117 Jul 26 14:07:26.421081 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 442/971] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:26 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1541 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:07:26.426315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12c44e7b-a248-47a9-9d3d-7475599c0b34 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:26.427293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-12c44e7b-a248-47a9-9d3d-7475599c0b34 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:26.436768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12c44e7b-a248-47a9-9d3d-7475599c0b34 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.437610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12c44e7b-a248-47a9-9d3d-7475599c0b34 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.438651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12c44e7b-a248-47a9-9d3d-7475599c0b34 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.439158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12c44e7b-a248-47a9-9d3d-7475599c0b34 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.479740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-39817890-e72b-4b68-a137-11ae46db7b6a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:26.487685 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-39817890-e72b-4b68-a137-11ae46db7b6a tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1479 microversion: 2.1 time: 0.303845 Jul 26 14:07:26.494731 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 530/972] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:26 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1479 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:26.579527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3f22f80-8b9b-42cf-90fd-23523c620db7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:26.580338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b3f22f80-8b9b-42cf-90fd-23523c620db7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:26.587719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3f22f80-8b9b-42cf-90fd-23523c620db7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.588217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3f22f80-8b9b-42cf-90fd-23523c620db7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.589628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3f22f80-8b9b-42cf-90fd-23523c620db7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.590426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3f22f80-8b9b-42cf-90fd-23523c620db7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.611364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-12c44e7b-a248-47a9-9d3d-7475599c0b34 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:26.622151 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-12c44e7b-a248-47a9-9d3d-7475599c0b34 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1523 microversion: 2.1 time: 0.199741 Jul 26 14:07:26.623191 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 443/973] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:26 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:26.951399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-04717ce1-bd81-47d1-980d-f7b677a6320e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:26.953421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-04717ce1-bd81-47d1-980d-f7b677a6320e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:26.969599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04717ce1-bd81-47d1-980d-f7b677a6320e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.971225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04717ce1-bd81-47d1-980d-f7b677a6320e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.972134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3f22f80-8b9b-42cf-90fd-23523c620db7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:26.983801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04717ce1-bd81-47d1-980d-f7b677a6320e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:26.985943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04717ce1-bd81-47d1-980d-f7b677a6320e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:26.987848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3f22f80-8b9b-42cf-90fd-23523c620db7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:26.989794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3f22f80-8b9b-42cf-90fd-23523c620db7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:26.991677 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3f22f80-8b9b-42cf-90fd-23523c620db7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 0.416984 Jul 26 14:07:26.993072 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 531/974] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:26 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:07:27.013336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-47b1afc3-07ed-456c-ad61-0d468afc1ebf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:27.016076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47b1afc3-07ed-456c-ad61-0d468afc1ebf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:27.029344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47b1afc3-07ed-456c-ad61-0d468afc1ebf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:27.030144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47b1afc3-07ed-456c-ad61-0d468afc1ebf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:27.031611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47b1afc3-07ed-456c-ad61-0d468afc1ebf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:27.032414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47b1afc3-07ed-456c-ad61-0d468afc1ebf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:27.523182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-04717ce1-bd81-47d1-980d-f7b677a6320e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:27.556690 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-04717ce1-bd81-47d1-980d-f7b677a6320e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1536 microversion: 2.1 time: 0.615933 Jul 26 14:07:27.570752 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 444/975] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:26 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1536 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:27.574418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47b1afc3-07ed-456c-ad61-0d468afc1ebf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:27.587802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4cfc281a-0750-42b2-8238-0e0c44fd419f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8794455c10>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:27.591690 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-47b1afc3-07ed-456c-ad61-0d468afc1ebf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1317 microversion: 2.1 time: 0.596779 Jul 26 14:07:27.592349 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 532/976] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:26 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:27.603153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-273d7a32-35b3-4b66-a87f-840ef419a70c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:27.608206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-273d7a32-35b3-4b66-a87f-840ef419a70c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:27.622122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-273d7a32-35b3-4b66-a87f-840ef419a70c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:27.623477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-273d7a32-35b3-4b66-a87f-840ef419a70c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:27.629607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-273d7a32-35b3-4b66-a87f-840ef419a70c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:27.629907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-273d7a32-35b3-4b66-a87f-840ef419a70c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:27.694590 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4cfc281a-0750-42b2-8238-0e0c44fd419f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.116871 Jul 26 14:07:27.710820 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 445/977] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:27 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:27.723615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a90f6820-9fcb-405a-afcd-31ae4e6ed6b5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:27.732335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a90f6820-9fcb-405a-afcd-31ae4e6ed6b5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:27.764367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a90f6820-9fcb-405a-afcd-31ae4e6ed6b5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:27.765506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a90f6820-9fcb-405a-afcd-31ae4e6ed6b5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:27.787479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a90f6820-9fcb-405a-afcd-31ae4e6ed6b5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:27.792691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a90f6820-9fcb-405a-afcd-31ae4e6ed6b5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:27.809733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-273d7a32-35b3-4b66-a87f-840ef419a70c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb330c470ebb4a0b9140e8a58d05f6a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492092ab9cd04b469f35de121b33deda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:27.826528 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-273d7a32-35b3-4b66-a87f-840ef419a70c tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 200 len: 1499 microversion: 2.1 time: 0.232723 Jul 26 14:07:27.834661 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 533/978] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:27 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 1499 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:27.843777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-210c7ae8-5155-4b55-9e53-0d325e6bdc03 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:27.851462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-210c7ae8-5155-4b55-9e53-0d325e6bdc03 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:27.872714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-210c7ae8-5155-4b55-9e53-0d325e6bdc03 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:27.873579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-210c7ae8-5155-4b55-9e53-0d325e6bdc03 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:27.874637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-210c7ae8-5155-4b55-9e53-0d325e6bdc03 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:27.875209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-210c7ae8-5155-4b55-9e53-0d325e6bdc03 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:28.130877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-210c7ae8-5155-4b55-9e53-0d325e6bdc03 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f84bae10984463fbb5579005d7a0a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d21e6b315b4543993c1a1b7271f913', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:28.134681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:28.161715 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-210c7ae8-5155-4b55-9e53-0d325e6bdc03 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 200 len: 1481 microversion: 2.1 time: 0.325403 Jul 26 14:07:28.170892 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 534/979] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:27 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 1481 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:28.208224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-5cd2e673-81a6-4a5a-ab7b-6fe9e36a816f req-f8f358de-8cbc-405a-972b-09b7ce475874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770654ea-0d11-480c-b5f7-6fb864a9b9dc", "name": "network-vif-deleted", "tag": "a338cd22-92c3-454a-82f2-73b6e140b886"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:28.233944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5cd2e673-81a6-4a5a-ab7b-6fe9e36a816f req-f8f358de-8cbc-405a-972b-09b7ce475874 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:28.237635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5cd2e673-81a6-4a5a-ab7b-6fe9e36a816f req-f8f358de-8cbc-405a-972b-09b7ce475874 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:28.268138 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-5cd2e673-81a6-4a5a-ab7b-6fe9e36a816f req-f8f358de-8cbc-405a-972b-09b7ce475874 service nova] Creating event network-vif-deleted:a338cd22-92c3-454a-82f2-73b6e140b886 for instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc on n-h2-833090-9 Jul 26 14:07:28.292659 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-5cd2e673-81a6-4a5a-ab7b-6fe9e36a816f req-f8f358de-8cbc-405a-972b-09b7ce475874 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118696 Jul 26 14:07:28.293753 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 535/980] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:28.322118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08fe85ba-0a01-4c3b-b1fe-f6986c3d0ce8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:28.332502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08fe85ba-0a01-4c3b-b1fe-f6986c3d0ce8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:28.340988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08fe85ba-0a01-4c3b-b1fe-f6986c3d0ce8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:28.343270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08fe85ba-0a01-4c3b-b1fe-f6986c3d0ce8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:28.345730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08fe85ba-0a01-4c3b-b1fe-f6986c3d0ce8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:28.352851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08fe85ba-0a01-4c3b-b1fe-f6986c3d0ce8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:28.579433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:29.240244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a90f6820-9fcb-405a-afcd-31ae4e6ed6b5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:29.262924 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a90f6820-9fcb-405a-afcd-31ae4e6ed6b5 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1479 microversion: 2.1 time: 1.549695 Jul 26 14:07:29.264015 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 446/981] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:27 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1479 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:29.301296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-11765fa7-cb56-44b5-9475-345105638e52 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:29.302438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-11765fa7-cb56-44b5-9475-345105638e52 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:29.325337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11765fa7-cb56-44b5-9475-345105638e52 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:29.326284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11765fa7-cb56-44b5-9475-345105638e52 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:29.328294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11765fa7-cb56-44b5-9475-345105638e52 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:29.329486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11765fa7-cb56-44b5-9475-345105638e52 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:29.637257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-08fe85ba-0a01-4c3b-b1fe-f6986c3d0ce8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:29.670825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-08fe85ba-0a01-4c3b-b1fe-f6986c3d0ce8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:29.674250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-08fe85ba-0a01-4c3b-b1fe-f6986c3d0ce8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:29.677142 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08fe85ba-0a01-4c3b-b1fe-f6986c3d0ce8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 1.379861 Jul 26 14:07:29.678369 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 536/982] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:28 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:29.699565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0b658575-f0b0-432c-8d19-213f28c7b9f1 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:29.702934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0b658575-f0b0-432c-8d19-213f28c7b9f1 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:29.724461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b658575-f0b0-432c-8d19-213f28c7b9f1 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:29.727290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b658575-f0b0-432c-8d19-213f28c7b9f1 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:29.729502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b658575-f0b0-432c-8d19-213f28c7b9f1 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:29.731831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b658575-f0b0-432c-8d19-213f28c7b9f1 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:30.303374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0b658575-f0b0-432c-8d19-213f28c7b9f1 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:30.319234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-11765fa7-cb56-44b5-9475-345105638e52 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:30.323594 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0b658575-f0b0-432c-8d19-213f28c7b9f1 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1508 microversion: 2.1 time: 0.641418 Jul 26 14:07:30.336189 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-11765fa7-cb56-44b5-9475-345105638e52 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1536 microversion: 2.1 time: 1.070453 Jul 26 14:07:30.347983 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 447/983] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:29 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1536 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:30.354199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-17720e8e-4e80-4142-9cc5-3a4eb4bede80 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f87947b29d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:30.368869 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 537/984] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:29 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1508 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:30.379201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c49fd161-8f5c-488c-901c-83d8c7fc473f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:30.380554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c49fd161-8f5c-488c-901c-83d8c7fc473f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] [instance: 770654ea-0d11-480c-b5f7-6fb864a9b9dc] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:30.398145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c49fd161-8f5c-488c-901c-83d8c7fc473f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:30.398797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c49fd161-8f5c-488c-901c-83d8c7fc473f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:30.400199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c49fd161-8f5c-488c-901c-83d8c7fc473f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:30.401954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c49fd161-8f5c-488c-901c-83d8c7fc473f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:30.461621 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c49fd161-8f5c-488c-901c-83d8c7fc473f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] HTTP exception thrown: Instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc could not be found. Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c49fd161-8f5c-488c-901c-83d8c7fc473f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Request method failure captured: Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc HTTP/1.1 Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_TPMVBzSu6LpbM_m_duqtUmoZvY__uidXTUb08ufj-rE0IRaXSvmMlyGhwda1H9n7f8DUqjGLogsMi7Do0X83F8Ja3tDvXPQpaHcdIXDuklf2kDw_8pp78QIQgnbN_mWi91r7aswt02ptnYOPjFYx2ZqjdT0Jk3IJzYD8bOUZxw14g Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 492092ab9cd04b469f35de121b33deda Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:07:30.467186 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/492092ab9cd04b469f35de121b33deda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/492092ab9cd04b469f35de121b33deda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_492092ab9cd04b469f35de121b33deda", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/492092ab9cd04b469f35de121b33deda"}]}] Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 492092ab9cd04b469f35de121b33deda Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364 Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: cb330c470ebb4a0b9140e8a58d05f6a0 Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc could not be found. Jul 26 14:07:30.470052 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '770654ea-0d11-480c-b5f7-6fb864a9b9dc'} Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc could not be found. Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:30.474088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc could not be found. Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc could not be found. Jul 26 14:07:30.482623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:30.486752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c49fd161-8f5c-488c-901c-83d8c7fc473f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] Returning 404 to user: Instance 770654ea-0d11-480c-b5f7-6fb864a9b9dc could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:30.490203 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c49fd161-8f5c-488c-901c-83d8c7fc473f tempest-FloatingIPsAssociationNegativeTestJSON-560852364 tempest-FloatingIPsAssociationNegativeTestJSON-560852364-project] 10.222.0.70 "GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc" status: 404 len: 111 microversion: 2.1 time: 0.119405 Jul 26 14:07:30.491870 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 538/985] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:30 2022] GET /compute/v2.1/servers/770654ea-0d11-480c-b5f7-6fb864a9b9dc => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:07:30.503977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-61193de1-53d5-4459-916e-efbfa062de00 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:30.505143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-61193de1-53d5-4459-916e-efbfa062de00 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] [instance: 96760807-513a-459f-b4b4-1cf897885ed6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:30.511841 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-17720e8e-4e80-4142-9cc5-3a4eb4bede80 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.172539 Jul 26 14:07:30.513465 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 448/986] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:30 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:30.520183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4529704d-9279-49fd-85c1-920d89e00d55 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:30.530657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4529704d-9279-49fd-85c1-920d89e00d55 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:30.539134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61193de1-53d5-4459-916e-efbfa062de00 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:30.542713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61193de1-53d5-4459-916e-efbfa062de00 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:30.552550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61193de1-53d5-4459-916e-efbfa062de00 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:30.553389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61193de1-53d5-4459-916e-efbfa062de00 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:30.555251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4529704d-9279-49fd-85c1-920d89e00d55 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:30.556295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4529704d-9279-49fd-85c1-920d89e00d55 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:30.558020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4529704d-9279-49fd-85c1-920d89e00d55 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:30.558707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4529704d-9279-49fd-85c1-920d89e00d55 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:30.594774 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-61193de1-53d5-4459-916e-efbfa062de00 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] HTTP exception thrown: Instance 96760807-513a-459f-b4b4-1cf897885ed6 could not be found. Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-61193de1-53d5-4459-916e-efbfa062de00 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Request method failure captured: Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 HTTP/1.1 Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_St64GenKZ87KAkvHDGyRb7HiYM1IthLwlzgvoKvCR_phOn-TticwNzta5bNDk_6ECvjojhVsi6ZR3_0UOESITgs2ieYG1ANS_0FntJ3ERXsIZ5LfgAC078Krje6PA47sXgX4UJxeTjVtlLlFtiqaBys5c0jgR7tQ-1dsRldVSEBRU Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f3d21e6b315b4543993c1a1b7271f913 Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:07:30.601396 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3d21e6b315b4543993c1a1b7271f913"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f3d21e6b315b4543993c1a1b7271f913"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f3d21e6b315b4543993c1a1b7271f913", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3d21e6b315b4543993c1a1b7271f913"}]}] Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f3d21e6b315b4543993c1a1b7271f913 Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-458980477 Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FloatingIPsAssociationTestJSON-458980477-project Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 9f84bae10984463fbb5579005d7a0a7c Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-458980477-project Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 96760807-513a-459f-b4b4-1cf897885ed6 could not be found. Jul 26 14:07:30.604513 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '96760807-513a-459f-b4b4-1cf897885ed6'} Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96760807-513a-459f-b4b4-1cf897885ed6 could not be found. Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:30.606711 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96760807-513a-459f-b4b4-1cf897885ed6 could not be found. Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96760807-513a-459f-b4b4-1cf897885ed6 could not be found. Jul 26 14:07:30.616175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:30.621536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-61193de1-53d5-4459-916e-efbfa062de00 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] Returning 404 to user: Instance 96760807-513a-459f-b4b4-1cf897885ed6 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:30.621536 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-61193de1-53d5-4459-916e-efbfa062de00 tempest-FloatingIPsAssociationTestJSON-458980477 tempest-FloatingIPsAssociationTestJSON-458980477-project] 10.222.0.70 "GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6" status: 404 len: 111 microversion: 2.1 time: 0.121465 Jul 26 14:07:30.624968 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 539/987] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:30 2022] GET /compute/v2.1/servers/96760807-513a-459f-b4b4-1cf897885ed6 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:07:30.636804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-42039042-805c-44a1-9218-0d89e84084ea req-e968fdbd-0388-47c2-859f-8ac4840c78d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96760807-513a-459f-b4b4-1cf897885ed6", "name": "network-vif-deleted", "tag": "55a71149-6922-4955-9d24-b7427e70e88b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:30.661463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-42039042-805c-44a1-9218-0d89e84084ea req-e968fdbd-0388-47c2-859f-8ac4840c78d0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:30.664505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-42039042-805c-44a1-9218-0d89e84084ea req-e968fdbd-0388-47c2-859f-8ac4840c78d0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:30.752367 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-42039042-805c-44a1-9218-0d89e84084ea req-e968fdbd-0388-47c2-859f-8ac4840c78d0 service nova] Creating event network-vif-deleted:55a71149-6922-4955-9d24-b7427e70e88b for instance 96760807-513a-459f-b4b4-1cf897885ed6 on n-h2-833090-9 Jul 26 14:07:30.777157 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-42039042-805c-44a1-9218-0d89e84084ea req-e968fdbd-0388-47c2-859f-8ac4840c78d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146593 Jul 26 14:07:30.780703 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 540/988] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:30.794017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2f5e2f99-3d1b-42f1-8345-82883b195208 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:30.796127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2f5e2f99-3d1b-42f1-8345-82883b195208 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:30.826830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f5e2f99-3d1b-42f1-8345-82883b195208 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:30.829424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f5e2f99-3d1b-42f1-8345-82883b195208 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:30.832484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f5e2f99-3d1b-42f1-8345-82883b195208 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:30.836809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f5e2f99-3d1b-42f1-8345-82883b195208 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:31.243499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4529704d-9279-49fd-85c1-920d89e00d55 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:31.289857 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4529704d-9279-49fd-85c1-920d89e00d55 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1479 microversion: 2.1 time: 0.774968 Jul 26 14:07:31.293893 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 449/989] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:30 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1479 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:31.299818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-33b19f56-33ea-4d34-833c-b59a9239c27a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:31.300710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-33b19f56-33ea-4d34-833c-b59a9239c27a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:31.317421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33b19f56-33ea-4d34-833c-b59a9239c27a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:31.318123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33b19f56-33ea-4d34-833c-b59a9239c27a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:31.319490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33b19f56-33ea-4d34-833c-b59a9239c27a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:31.320922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33b19f56-33ea-4d34-833c-b59a9239c27a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:31.691369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2f5e2f99-3d1b-42f1-8345-82883b195208 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:31.712413 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2f5e2f99-3d1b-42f1-8345-82883b195208 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1508 microversion: 2.1 time: 0.920520 Jul 26 14:07:31.717125 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 541/990] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:30 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1508 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:31.743319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e0217b9c-1395-4a25-9944-01e114d17281 req-f1b5ac73-d36a-42b4-afb4-735a926a8810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf4359c-96f3-43bf-aea5-1cb4685a4493", "name": "network-vif-plugged", "status": "completed", "tag": "0f1776dc-c5aa-4946-80e1-ec3dbca3eb36"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:31.771071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e0217b9c-1395-4a25-9944-01e114d17281 req-f1b5ac73-d36a-42b4-afb4-735a926a8810 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:31.771668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e0217b9c-1395-4a25-9944-01e114d17281 req-f1b5ac73-d36a-42b4-afb4-735a926a8810 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:31.822079 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e0217b9c-1395-4a25-9944-01e114d17281 req-f1b5ac73-d36a-42b4-afb4-735a926a8810 service nova] Creating event network-vif-plugged:0f1776dc-c5aa-4946-80e1-ec3dbca3eb36 for instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 on n-h1-833090-9 Jul 26 14:07:31.835259 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e0217b9c-1395-4a25-9944-01e114d17281 req-f1b5ac73-d36a-42b4-afb4-735a926a8810 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111869 Jul 26 14:07:31.836163 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 542/991] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:31.847231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a28b9a65-290b-4c35-8613-697e6eccd10e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:31.857285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a28b9a65-290b-4c35-8613-697e6eccd10e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:31.866052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a28b9a65-290b-4c35-8613-697e6eccd10e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:31.869831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a28b9a65-290b-4c35-8613-697e6eccd10e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:31.871495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a28b9a65-290b-4c35-8613-697e6eccd10e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:31.873968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a28b9a65-290b-4c35-8613-697e6eccd10e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:32.123711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-33b19f56-33ea-4d34-833c-b59a9239c27a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:32.137434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-33b19f56-33ea-4d34-833c-b59a9239c27a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:32.141037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-33b19f56-33ea-4d34-833c-b59a9239c27a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:32.142706 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-33b19f56-33ea-4d34-833c-b59a9239c27a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 0.847526 Jul 26 14:07:32.143600 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 450/992] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:31 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:32.151106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7cc5438b-f245-45d4-8e8d-b4a42c2e5477 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787f463a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:32.249295 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7cc5438b-f245-45d4-8e8d-b4a42c2e5477 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.104347 Jul 26 14:07:32.252824 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 451/993] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:32 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:32.267461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ced69bb3-9322-4da8-abd9-2315a59f4fd6 req-8f2fcf39-3603-4c34-9380-f0078b51b878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b122f14c-3b42-4a25-9908-f4b9fb64a2f2", "tag": "26dcbb26-ecb6-4dc2-8c29-abb0b023eb10"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:32.296644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ced69bb3-9322-4da8-abd9-2315a59f4fd6 req-8f2fcf39-3603-4c34-9380-f0078b51b878 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:32.307511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ced69bb3-9322-4da8-abd9-2315a59f4fd6 req-8f2fcf39-3603-4c34-9380-f0078b51b878 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:32.332706 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ced69bb3-9322-4da8-abd9-2315a59f4fd6 req-8f2fcf39-3603-4c34-9380-f0078b51b878 service nova] Creating event network-changed:26dcbb26-ecb6-4dc2-8c29-abb0b023eb10 for instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 on n-h1-833090-9 Jul 26 14:07:32.341208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-ced69bb3-9322-4da8-abd9-2315a59f4fd6 req-8f2fcf39-3603-4c34-9380-f0078b51b878 service nova] Instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:07:32.360547 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ced69bb3-9322-4da8-abd9-2315a59f4fd6 req-8f2fcf39-3603-4c34-9380-f0078b51b878 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105308 Jul 26 14:07:32.362179 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 452/994] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:32.391727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:32.399920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:32.437043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:32.437953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:32.439930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:32.440726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:32.489431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:32.620063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:07:32.622631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:07:32.624882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:07:32.626072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:07:32.627246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:07:32.800415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:32.829450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:32.834832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:32.836423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:32.837069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:32.872984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a28b9a65-290b-4c35-8613-697e6eccd10e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:32.886799 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a28b9a65-290b-4c35-8613-697e6eccd10e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1536 microversion: 2.1 time: 1.046565 Jul 26 14:07:32.888155 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 543/995] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:31 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1536 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:32.900887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9c78b876-987a-40e7-b88b-dec3ecc68efc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:32.915838 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "POST /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a/action" status: 202 len: 1110 microversion: 2.1 time: 0.543408 Jul 26 14:07:32.916833 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 453/996] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:32 2022] POST /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a/action => generated 1110 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 14:07:32.923743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9c78b876-987a-40e7-b88b-dec3ecc68efc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:32.952531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:32.954205 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-49eb7a94-1419-4245-bfe0-811632fce083 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002256 Jul 26 14:07:32.954801 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 454/997] 10.222.0.70 () {56 vars in 886 bytes} [Tue Jul 26 14:07:32 2022] GET /compute/ => generated 377 bytes in 37 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 14:07:32.978716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c78b876-987a-40e7-b88b-dec3ecc68efc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:32.983142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c78b876-987a-40e7-b88b-dec3ecc68efc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:32.989271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c78b876-987a-40e7-b88b-dec3ecc68efc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:32.991937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c78b876-987a-40e7-b88b-dec3ecc68efc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:32.997401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3a2a66f2-9d9e-4beb-9f4e-ee16c9bae040 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:33.000279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3a2a66f2-9d9e-4beb-9f4e-ee16c9bae040 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:33.046899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a2a66f2-9d9e-4beb-9f4e-ee16c9bae040 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:33.047853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a2a66f2-9d9e-4beb-9f4e-ee16c9bae040 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:33.049109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a2a66f2-9d9e-4beb-9f4e-ee16c9bae040 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:33.049884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a2a66f2-9d9e-4beb-9f4e-ee16c9bae040 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:33.832981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9c78b876-987a-40e7-b88b-dec3ecc68efc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:33.848756 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9c78b876-987a-40e7-b88b-dec3ecc68efc tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1479 microversion: 2.1 time: 0.959263 Jul 26 14:07:33.850118 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 544/998] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:32 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1479 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:33.865836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-07cde87e-48c1-4ab4-8b20-77ba72cf89e4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:33.874041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-07cde87e-48c1-4ab4-8b20-77ba72cf89e4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:33.881394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07cde87e-48c1-4ab4-8b20-77ba72cf89e4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:33.892761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07cde87e-48c1-4ab4-8b20-77ba72cf89e4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:33.893931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07cde87e-48c1-4ab4-8b20-77ba72cf89e4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:33.894550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07cde87e-48c1-4ab4-8b20-77ba72cf89e4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:33.913683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3a2a66f2-9d9e-4beb-9f4e-ee16c9bae040 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:33.942203 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3a2a66f2-9d9e-4beb-9f4e-ee16c9bae040 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 0.979798 Jul 26 14:07:33.943124 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 455/999] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:32 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:33.948153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7f16838-d14c-41aa-8705-72dae1cb0b56 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787f84dc0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:34.160368 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7f16838-d14c-41aa-8705-72dae1cb0b56 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.215635 Jul 26 14:07:34.176964 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 456/1000] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:33 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:34.197842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e116f5b8-bff4-4038-a1bf-3440a16ec19d req-741ab9fb-79fc-4261-a198-3022d7cb67de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c20b152-e109-4ec5-882c-9640b942901e", "name": "network-vif-plugged", "status": "completed", "tag": "0023117a-fed6-48c7-9154-388efdf05982"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:34.223688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e116f5b8-bff4-4038-a1bf-3440a16ec19d req-741ab9fb-79fc-4261-a198-3022d7cb67de service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:34.248589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e116f5b8-bff4-4038-a1bf-3440a16ec19d req-741ab9fb-79fc-4261-a198-3022d7cb67de service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:34.266266 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e116f5b8-bff4-4038-a1bf-3440a16ec19d req-741ab9fb-79fc-4261-a198-3022d7cb67de service nova] Creating event network-vif-plugged:0023117a-fed6-48c7-9154-388efdf05982 for instance 8c20b152-e109-4ec5-882c-9640b942901e on n-h2-833090-9 Jul 26 14:07:34.285629 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e116f5b8-bff4-4038-a1bf-3440a16ec19d req-741ab9fb-79fc-4261-a198-3022d7cb67de service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106889 Jul 26 14:07:34.286869 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 457/1001] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:34.300130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-868ec98a-ba1f-4974-b0b6-5d5acf2c1e16 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:34.301392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-868ec98a-ba1f-4974-b0b6-5d5acf2c1e16 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:34.333807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-868ec98a-ba1f-4974-b0b6-5d5acf2c1e16 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:34.334497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-868ec98a-ba1f-4974-b0b6-5d5acf2c1e16 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:34.335548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-868ec98a-ba1f-4974-b0b6-5d5acf2c1e16 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:34.336219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-868ec98a-ba1f-4974-b0b6-5d5acf2c1e16 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:34.963190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-07cde87e-48c1-4ab4-8b20-77ba72cf89e4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:34.994872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-07cde87e-48c1-4ab4-8b20-77ba72cf89e4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:34.997639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-07cde87e-48c1-4ab4-8b20-77ba72cf89e4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:35.007972 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-07cde87e-48c1-4ab4-8b20-77ba72cf89e4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 1.156187 Jul 26 14:07:35.028237 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 545/1002] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:33 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:35.047805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4aaf34da-ed5a-4dc0-bd13-910113afa1f6 req-16a74729-5e03-4768-963e-c6bcc65d2777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f842736-4c37-478b-a26b-94b53377cc43", "name": "network-vif-unplugged", "status": "completed", "tag": "f1af542a-ca59-4955-b962-e2934fce33bb"}, {"name": "network-changed", "server_uuid": "8f842736-4c37-478b-a26b-94b53377cc43", "tag": "f1af542a-ca59-4955-b962-e2934fce33bb"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:35.073617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4aaf34da-ed5a-4dc0-bd13-910113afa1f6 req-16a74729-5e03-4768-963e-c6bcc65d2777 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:35.075340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4aaf34da-ed5a-4dc0-bd13-910113afa1f6 req-16a74729-5e03-4768-963e-c6bcc65d2777 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:35.108383 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4aaf34da-ed5a-4dc0-bd13-910113afa1f6 req-16a74729-5e03-4768-963e-c6bcc65d2777 service nova] Creating event network-vif-unplugged:f1af542a-ca59-4955-b962-e2934fce33bb for instance 8f842736-4c37-478b-a26b-94b53377cc43 on n-h1-833090-9 Jul 26 14:07:35.116212 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4aaf34da-ed5a-4dc0-bd13-910113afa1f6 req-16a74729-5e03-4768-963e-c6bcc65d2777 service nova] Creating event network-changed:f1af542a-ca59-4955-b962-e2934fce33bb for instance 8f842736-4c37-478b-a26b-94b53377cc43 on n-h1-833090-9 Jul 26 14:07:35.132787 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4aaf34da-ed5a-4dc0-bd13-910113afa1f6 req-16a74729-5e03-4768-963e-c6bcc65d2777 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.099291 Jul 26 14:07:35.135533 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 546/1003] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:35.153487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d66bd982-33df-462c-a921-330612dfbf0c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:35.154981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d66bd982-33df-462c-a921-330612dfbf0c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:35.167182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d66bd982-33df-462c-a921-330612dfbf0c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:35.168919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d66bd982-33df-462c-a921-330612dfbf0c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:35.170737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d66bd982-33df-462c-a921-330612dfbf0c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:35.171787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d66bd982-33df-462c-a921-330612dfbf0c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:35.271072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-868ec98a-ba1f-4974-b0b6-5d5acf2c1e16 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:35.285169 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-868ec98a-ba1f-4974-b0b6-5d5acf2c1e16 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1536 microversion: 2.1 time: 0.996587 Jul 26 14:07:35.287545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 458/1004] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:34 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1536 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:35.296140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1e77d4eb-3069-4664-a552-6e0d5e74cf20 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:35.297420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1e77d4eb-3069-4664-a552-6e0d5e74cf20 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:35.306593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e77d4eb-3069-4664-a552-6e0d5e74cf20 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:35.307501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e77d4eb-3069-4664-a552-6e0d5e74cf20 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:35.309496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e77d4eb-3069-4664-a552-6e0d5e74cf20 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:35.310239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e77d4eb-3069-4664-a552-6e0d5e74cf20 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:35.794706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1e77d4eb-3069-4664-a552-6e0d5e74cf20 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:35.801370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d66bd982-33df-462c-a921-330612dfbf0c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:35.803856 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1e77d4eb-3069-4664-a552-6e0d5e74cf20 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 0.514789 Jul 26 14:07:35.812675 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 459/1005] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:35 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:35.814093 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d66bd982-33df-462c-a921-330612dfbf0c tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1464 microversion: 2.1 time: 0.670251 Jul 26 14:07:35.815979 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 547/1006] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:35 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1464 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:35.822569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-28777d5d-e1ff-4e8a-8035-2dd0e4a27a3c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787fa45e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:35.869968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-467b5e42-06a2-475c-9b5a-668adb0c3d29 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:35.873067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-467b5e42-06a2-475c-9b5a-668adb0c3d29 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:35.890506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-467b5e42-06a2-475c-9b5a-668adb0c3d29 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:35.891017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-467b5e42-06a2-475c-9b5a-668adb0c3d29 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:35.891821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-467b5e42-06a2-475c-9b5a-668adb0c3d29 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:35.900906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-467b5e42-06a2-475c-9b5a-668adb0c3d29 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:35.927286 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-28777d5d-e1ff-4e8a-8035-2dd0e4a27a3c tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.109864 Jul 26 14:07:35.929237 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 548/1007] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:35 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:36.056880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c3371397-30ab-44a3-b70b-b536c88e3bb1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:36.059362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c3371397-30ab-44a3-b70b-b536c88e3bb1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:36.075299 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-467b5e42-06a2-475c-9b5a-668adb0c3d29 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action" status: 202 len: 0 microversion: 2.1 time: 0.208692 Jul 26 14:07:36.077141 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 460/1008] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:35 2022] POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:07:36.078542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3371397-30ab-44a3-b70b-b536c88e3bb1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:36.079015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3371397-30ab-44a3-b70b-b536c88e3bb1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:36.079838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3371397-30ab-44a3-b70b-b536c88e3bb1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:36.081145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3371397-30ab-44a3-b70b-b536c88e3bb1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:36.104668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-349cf130-5d9d-445c-98d5-ed042dff7943 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:36.106335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-349cf130-5d9d-445c-98d5-ed042dff7943 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:36.122420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-349cf130-5d9d-445c-98d5-ed042dff7943 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:36.123094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-349cf130-5d9d-445c-98d5-ed042dff7943 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:36.124540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-349cf130-5d9d-445c-98d5-ed042dff7943 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:36.125211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-349cf130-5d9d-445c-98d5-ed042dff7943 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:36.202463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-349cf130-5d9d-445c-98d5-ed042dff7943 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:36.204318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-349cf130-5d9d-445c-98d5-ed042dff7943 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:36.211281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-349cf130-5d9d-445c-98d5-ed042dff7943 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lazy-loading 'fault' on Instance uuid 6bf4359c-96f3-43bf-aea5-1cb4685a4493 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:07:36.585139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c3371397-30ab-44a3-b70b-b536c88e3bb1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:36.610069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c3371397-30ab-44a3-b70b-b536c88e3bb1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:36.615420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c3371397-30ab-44a3-b70b-b536c88e3bb1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:36.621585 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c3371397-30ab-44a3-b70b-b536c88e3bb1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 0.581444 Jul 26 14:07:36.625318 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 549/1009] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:36 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:07:36.632381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9848f615-9b93-4c46-adc6-ad1f4ac53f20 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:36.633274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9848f615-9b93-4c46-adc6-ad1f4ac53f20 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:36.648991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9848f615-9b93-4c46-adc6-ad1f4ac53f20 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:36.649765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9848f615-9b93-4c46-adc6-ad1f4ac53f20 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:36.650755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9848f615-9b93-4c46-adc6-ad1f4ac53f20 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:36.673250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9848f615-9b93-4c46-adc6-ad1f4ac53f20 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:36.838664 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-349cf130-5d9d-445c-98d5-ed042dff7943 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1598 microversion: 2.1 time: 0.747384 Jul 26 14:07:36.842225 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 461/1010] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:36 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1598 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:36.900876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-31771e4b-7d82-4763-a7e5-68c0f751fef3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:36.902689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-31771e4b-7d82-4763-a7e5-68c0f751fef3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:36.907451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:36.935331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31771e4b-7d82-4763-a7e5-68c0f751fef3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:36.942404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31771e4b-7d82-4763-a7e5-68c0f751fef3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:36.944455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31771e4b-7d82-4763-a7e5-68c0f751fef3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:36.945513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31771e4b-7d82-4763-a7e5-68c0f751fef3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:37.554485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9848f615-9b93-4c46-adc6-ad1f4ac53f20 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:37.580389 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9848f615-9b93-4c46-adc6-ad1f4ac53f20 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1536 microversion: 2.1 time: 0.953743 Jul 26 14:07:37.581290 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 550/1011] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:36 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1536 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:37.604328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fc341b9a-8dda-4af1-b66e-4f5970a83216 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:37.608954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fc341b9a-8dda-4af1-b66e-4f5970a83216 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:37.623933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc341b9a-8dda-4af1-b66e-4f5970a83216 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:37.630632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc341b9a-8dda-4af1-b66e-4f5970a83216 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:37.631845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc341b9a-8dda-4af1-b66e-4f5970a83216 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:37.637046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc341b9a-8dda-4af1-b66e-4f5970a83216 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:37.856422 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fc341b9a-8dda-4af1-b66e-4f5970a83216 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action" status: 202 len: 0 microversion: 2.1 time: 0.269729 Jul 26 14:07:37.857983 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 551/1012] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:07:37 2022] POST /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:07:37.865473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7cf99301-17a8-4d7f-ac12-f5adab70bb97 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787fa43a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:37.951204 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7cf99301-17a8-4d7f-ac12-f5adab70bb97 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.089746 Jul 26 14:07:37.952527 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 552/1013] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:37 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:37.958877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-769ae35c-c909-46d5-9f93-384ded1e8b08 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:37.960022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-769ae35c-c909-46d5-9f93-384ded1e8b08 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:37.972420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-769ae35c-c909-46d5-9f93-384ded1e8b08 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:37.973697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-769ae35c-c909-46d5-9f93-384ded1e8b08 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:37.975434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-769ae35c-c909-46d5-9f93-384ded1e8b08 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:37.976830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-769ae35c-c909-46d5-9f93-384ded1e8b08 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:38.007156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31771e4b-7d82-4763-a7e5-68c0f751fef3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:38.019888 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-31771e4b-7d82-4763-a7e5-68c0f751fef3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 1.162925 Jul 26 14:07:38.028627 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 462/1014] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:36 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:38.043465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b22ab741-5088-4887-8b18-6520fb4ff161 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:38.048800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b22ab741-5088-4887-8b18-6520fb4ff161 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:38.061547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b22ab741-5088-4887-8b18-6520fb4ff161 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:38.062411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b22ab741-5088-4887-8b18-6520fb4ff161 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:38.064304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b22ab741-5088-4887-8b18-6520fb4ff161 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:38.064995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b22ab741-5088-4887-8b18-6520fb4ff161 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:39.291629 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b22ab741-5088-4887-8b18-6520fb4ff161 tempest-ServersAdminTestJSON-381903249 tempest-ServersAdminTestJSON-381903249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1615 microversion: 2.1 time: 1.261105 Jul 26 14:07:39.303997 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 463/1015] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:38 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1615 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:39.309098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-77b22aa9-71ff-47eb-8af6-b60106119482 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:39.315426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-769ae35c-c909-46d5-9f93-384ded1e8b08 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:39.324348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-77b22aa9-71ff-47eb-8af6-b60106119482 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:39.333660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-769ae35c-c909-46d5-9f93-384ded1e8b08 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:39.342830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-769ae35c-c909-46d5-9f93-384ded1e8b08 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:39.345011 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-769ae35c-c909-46d5-9f93-384ded1e8b08 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 1.391177 Jul 26 14:07:39.350623 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 553/1016] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:37 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:39.357565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-917f1f44-b0f4-494e-94df-cdb22eff3faa tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787f99b80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:39.378809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77b22aa9-71ff-47eb-8af6-b60106119482 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:39.379407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77b22aa9-71ff-47eb-8af6-b60106119482 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:39.390286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77b22aa9-71ff-47eb-8af6-b60106119482 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:39.392354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77b22aa9-71ff-47eb-8af6-b60106119482 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:39.553777 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-917f1f44-b0f4-494e-94df-cdb22eff3faa tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.201214 Jul 26 14:07:39.557389 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 554/1017] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:39 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:39.570469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6f740d4-db1e-4ec9-9b6f-fb833490b822 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:39.576583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e6f740d4-db1e-4ec9-9b6f-fb833490b822 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:39.615815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f740d4-db1e-4ec9-9b6f-fb833490b822 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:39.617967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f740d4-db1e-4ec9-9b6f-fb833490b822 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:39.619305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f740d4-db1e-4ec9-9b6f-fb833490b822 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:39.619916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f740d4-db1e-4ec9-9b6f-fb833490b822 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:39.891616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-77b22aa9-71ff-47eb-8af6-b60106119482 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:39.909655 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-77b22aa9-71ff-47eb-8af6-b60106119482 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1529 microversion: 2.1 time: 0.608776 Jul 26 14:07:39.910306 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 464/1018] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:39 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1529 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:39.925944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9f744ee1-9876-4fab-b9c5-a1cc95cd8ba6 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:39.927839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9f744ee1-9876-4fab-b9c5-a1cc95cd8ba6 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:39.951527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f744ee1-9876-4fab-b9c5-a1cc95cd8ba6 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:39.953134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f744ee1-9876-4fab-b9c5-a1cc95cd8ba6 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:39.956923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f744ee1-9876-4fab-b9c5-a1cc95cd8ba6 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:39.958271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f744ee1-9876-4fab-b9c5-a1cc95cd8ba6 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:40.034678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9f744ee1-9876-4fab-b9c5-a1cc95cd8ba6 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:07:40.256703 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9f744ee1-9876-4fab-b9c5-a1cc95cd8ba6 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 204 len: 0 microversion: 2.1 time: 0.342867 Jul 26 14:07:40.261664 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 465/1019] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:07:39 2022] DELETE /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:07:40.285959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f6d63471-66ed-43e1-bd7b-94de1595ec73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:40.287866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f6d63471-66ed-43e1-bd7b-94de1595ec73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:40.313408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6d63471-66ed-43e1-bd7b-94de1595ec73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:40.314319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6d63471-66ed-43e1-bd7b-94de1595ec73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:40.319814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6d63471-66ed-43e1-bd7b-94de1595ec73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:40.321006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6d63471-66ed-43e1-bd7b-94de1595ec73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:40.339057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e6f740d4-db1e-4ec9-9b6f-fb833490b822 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:40.383088 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e6f740d4-db1e-4ec9-9b6f-fb833490b822 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 0.822745 Jul 26 14:07:40.387660 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 555/1020] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:39 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:40.469785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ced576f0-831d-4f88-a491-e0f077432f43 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:40.472659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ced576f0-831d-4f88-a491-e0f077432f43 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:40.503053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ced576f0-831d-4f88-a491-e0f077432f43 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:40.506225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ced576f0-831d-4f88-a491-e0f077432f43 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:40.507764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ced576f0-831d-4f88-a491-e0f077432f43 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:40.508571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ced576f0-831d-4f88-a491-e0f077432f43 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:41.725673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f6d63471-66ed-43e1-bd7b-94de1595ec73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:41.754991 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f6d63471-66ed-43e1-bd7b-94de1595ec73 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1529 microversion: 2.1 time: 1.491577 Jul 26 14:07:41.765287 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 466/1021] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:40 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1529 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:41.785012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3531de8e-8765-4643-a1d8-f8091aaba3fa tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:41.801083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3531de8e-8765-4643-a1d8-f8091aaba3fa tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:41.833753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3531de8e-8765-4643-a1d8-f8091aaba3fa tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:41.837997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3531de8e-8765-4643-a1d8-f8091aaba3fa tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:41.841305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3531de8e-8765-4643-a1d8-f8091aaba3fa tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:41.841837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3531de8e-8765-4643-a1d8-f8091aaba3fa tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:41.848632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ced576f0-831d-4f88-a491-e0f077432f43 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:41.853001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:41.855774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:41.862852 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ced576f0-831d-4f88-a491-e0f077432f43 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 200 len: 1470 microversion: 2.1 time: 1.473184 Jul 26 14:07:41.874477 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 556/1022] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:40 2022] GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 1470 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:41.882345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7bd70547-5094-48ad-aeba-773aab9b597a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787f8e1f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:42.025166 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7bd70547-5094-48ad-aeba-773aab9b597a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.148777 Jul 26 14:07:42.037420 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 557/1023] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:41 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:42.051832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b878bc97-ee65-4660-9392-5910d4fd4111 req-a439b4c9-179e-4229-aec5-6b08ec6e986c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f842736-4c37-478b-a26b-94b53377cc43", "name": "network-vif-unplugged", "status": "completed", "tag": "f1af542a-ca59-4955-b962-e2934fce33bb"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:42.079192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b878bc97-ee65-4660-9392-5910d4fd4111 req-a439b4c9-179e-4229-aec5-6b08ec6e986c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:42.082302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b878bc97-ee65-4660-9392-5910d4fd4111 req-a439b4c9-179e-4229-aec5-6b08ec6e986c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:42.110550 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b878bc97-ee65-4660-9392-5910d4fd4111 req-a439b4c9-179e-4229-aec5-6b08ec6e986c service nova] Creating event network-vif-unplugged:f1af542a-ca59-4955-b962-e2934fce33bb for instance 8f842736-4c37-478b-a26b-94b53377cc43 on n-h1-833090-9 Jul 26 14:07:42.119098 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b878bc97-ee65-4660-9392-5910d4fd4111 req-a439b4c9-179e-4229-aec5-6b08ec6e986c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079409 Jul 26 14:07:42.122523 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 558/1024] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:42.131068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-619c4457-6178-4323-8fe5-30a40804a558 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:42.131913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-619c4457-6178-4323-8fe5-30a40804a558 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:42.155841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-619c4457-6178-4323-8fe5-30a40804a558 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:42.156297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-619c4457-6178-4323-8fe5-30a40804a558 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:42.158491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-619c4457-6178-4323-8fe5-30a40804a558 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:42.160238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-619c4457-6178-4323-8fe5-30a40804a558 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:43.524971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3531de8e-8765-4643-a1d8-f8091aaba3fa tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:43.547202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3531de8e-8765-4643-a1d8-f8091aaba3fa tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:43.549341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3531de8e-8765-4643-a1d8-f8091aaba3fa tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:43.555467 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3531de8e-8765-4643-a1d8-f8091aaba3fa tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 1.778076 Jul 26 14:07:43.608694 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 467/1025] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:41 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:43.648354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-bd34b7c4-bd36-45f8-91d1-4a9881c94bc3 req-7d397a74-ee94-457f-b116-40638147f3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f842736-4c37-478b-a26b-94b53377cc43", "name": "network-vif-unplugged", "status": "completed", "tag": "f1af542a-ca59-4955-b962-e2934fce33bb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:43.694311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bd34b7c4-bd36-45f8-91d1-4a9881c94bc3 req-7d397a74-ee94-457f-b116-40638147f3ce service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:43.694770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bd34b7c4-bd36-45f8-91d1-4a9881c94bc3 req-7d397a74-ee94-457f-b116-40638147f3ce service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:43.732913 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-bd34b7c4-bd36-45f8-91d1-4a9881c94bc3 req-7d397a74-ee94-457f-b116-40638147f3ce service nova] Creating event network-vif-unplugged:f1af542a-ca59-4955-b962-e2934fce33bb for instance 8f842736-4c37-478b-a26b-94b53377cc43 on n-h1-833090-9 Jul 26 14:07:43.747228 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-bd34b7c4-bd36-45f8-91d1-4a9881c94bc3 req-7d397a74-ee94-457f-b116-40638147f3ce service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122647 Jul 26 14:07:43.751581 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 468/1026] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:43.770474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32a5d9af-68ee-46bd-b3a6-1f22a07daec6 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:43.773306 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:43.773306 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:43.786147 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-32a5d9af-68ee-46bd-b3a6-1f22a07daec6 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] HTTP exception thrown: Flavor d0b7a172-7066-4282-a625-2b397dc88e8b could not be found. Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32a5d9af-68ee-46bd-b3a6-1f22a07daec6 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Request method failure captured: Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/flavors/d0b7a172-7066-4282-a625-2b397dc88e8b HTTP/1.1 Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_QeZ9snkxR2s_mBlPWiPXSeWhFo_ytyd3mDXHDbS5HLPb9dSAVHCEneATiQtFfsO-PIQaP7T_3qydfMs6l8CR4NBhRDstsQn-KFRYW88ibn_cWB6soKUcS0LDCrZ9T3yPIyBpiylkPYa_bGZAqAZHlKWjPA1wmJrxXcBl-veCabP5Y Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 859c66e51f1744549f7147e367a179dc Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-MigrationsAdminTest-1960127943 Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:07:43.802980 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/859c66e51f1744549f7147e367a179dc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/859c66e51f1744549f7147e367a179dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_859c66e51f1744549f7147e367a179dc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/859c66e51f1744549f7147e367a179dc"}]}] Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-MigrationsAdminTest-1960127943 Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 859c66e51f1744549f7147e367a179dc Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-MigrationsAdminTest-1960127943 Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-MigrationsAdminTest-1960127943-project-admin Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 1fc3b9ab00b44314a7949a031f3327e8 Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-MigrationsAdminTest-1960127943-project-admin Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: exception: Flavor d0b7a172-7066-4282-a625-2b397dc88e8b could not be found. Jul 26 14:07:43.804909 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd0b7a172-7066-4282-a625-2b397dc88e8b'} Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor d0b7a172-7066-4282-a625-2b397dc88e8b could not be found. Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:43.805899 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor d0b7a172-7066-4282-a625-2b397dc88e8b could not be found. Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor d0b7a172-7066-4282-a625-2b397dc88e8b could not be found. Jul 26 14:07:43.807457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:07:43.812925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32a5d9af-68ee-46bd-b3a6-1f22a07daec6 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Returning 404 to user: Flavor d0b7a172-7066-4282-a625-2b397dc88e8b could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:43.815585 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32a5d9af-68ee-46bd-b3a6-1f22a07daec6 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/d0b7a172-7066-4282-a625-2b397dc88e8b" status: 404 len: 109 microversion: 2.1 time: 0.062749 Jul 26 14:07:43.820650 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 469/1027] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:07:43 2022] DELETE /compute/v2.1/flavors/d0b7a172-7066-4282-a625-2b397dc88e8b => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:07:43.832983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:43.834035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:43.852221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:43.856367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:43.858093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:43.858700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:43.945164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:43.945614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:43.946071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lazy-loading 'fault' on Instance uuid 4d6317e9-619d-4230-b5c8-58452de314b9 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:07:44.395569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:44.430213 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4d150a38-00ae-4c99-847d-379a66be10ae tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 200 len: 1304 microversion: 2.1 time: 0.607749 Jul 26 14:07:44.433353 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 470/1028] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:43 2022] GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 1304 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:44.475019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-619c4457-6178-4323-8fe5-30a40804a558 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:44.485718 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-619c4457-6178-4323-8fe5-30a40804a558 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 2.360476 Jul 26 14:07:44.485965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-310b92c9-563a-4d58-b9e1-9060d12b85a1 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f879454fca0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:44.487620 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 559/1029] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:42 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:44.496933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ae0b245b-e2ba-4dc9-ad38-c1eb367d82d5 req-3867532c-6a44-4282-87f4-318c57aa02d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6317e9-619d-4230-b5c8-58452de314b9", "name": "network-vif-deleted", "tag": "0ec18604-bd18-435d-8f2e-dac83bd6066b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:44.520167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ae0b245b-e2ba-4dc9-ad38-c1eb367d82d5 req-3867532c-6a44-4282-87f4-318c57aa02d3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:44.520831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ae0b245b-e2ba-4dc9-ad38-c1eb367d82d5 req-3867532c-6a44-4282-87f4-318c57aa02d3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:44.550210 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ae0b245b-e2ba-4dc9-ad38-c1eb367d82d5 req-3867532c-6a44-4282-87f4-318c57aa02d3 service nova] Creating event network-vif-deleted:0ec18604-bd18-435d-8f2e-dac83bd6066b for instance 4d6317e9-619d-4230-b5c8-58452de314b9 on n-h1-833090-9 Jul 26 14:07:44.565145 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ae0b245b-e2ba-4dc9-ad38-c1eb367d82d5 req-3867532c-6a44-4282-87f4-318c57aa02d3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071138 Jul 26 14:07:44.566178 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 560/1030] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:44.775523 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-310b92c9-563a-4d58-b9e1-9060d12b85a1 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.336794 Jul 26 14:07:44.776182 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 471/1031] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:44 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:44.803991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3eab45f4-00a1-4286-a33a-be9f9124b759 req-0e0a383f-744c-4b70-97f7-fe177f9c71ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b122f14c-3b42-4a25-9908-f4b9fb64a2f2", "name": "network-vif-plugged", "status": "completed", "tag": "26dcbb26-ecb6-4dc2-8c29-abb0b023eb10"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:44.838742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3eab45f4-00a1-4286-a33a-be9f9124b759 req-0e0a383f-744c-4b70-97f7-fe177f9c71ba service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:44.842068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3eab45f4-00a1-4286-a33a-be9f9124b759 req-0e0a383f-744c-4b70-97f7-fe177f9c71ba service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:44.879285 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3eab45f4-00a1-4286-a33a-be9f9124b759 req-0e0a383f-744c-4b70-97f7-fe177f9c71ba service nova] Creating event network-vif-plugged:26dcbb26-ecb6-4dc2-8c29-abb0b023eb10 for instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 on n-h1-833090-9 Jul 26 14:07:44.888374 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3eab45f4-00a1-4286-a33a-be9f9124b759 req-0e0a383f-744c-4b70-97f7-fe177f9c71ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107337 Jul 26 14:07:44.889934 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 472/1032] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:44.927234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-315191970", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:44.950836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-864e62de-301f-459f-8afb-29ff3bab4a60 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Calling method '.version_select at 0x7f8787fe2c10>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:44.953630 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:44.953630 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:44.955118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-864e62de-301f-459f-8afb-29ff3bab4a60 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:44.956208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-864e62de-301f-459f-8afb-29ff3bab4a60 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:44.958316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-864e62de-301f-459f-8afb-29ff3bab4a60 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:44.958763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-864e62de-301f-459f-8afb-29ff3bab4a60 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:44.997048 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-864e62de-301f-459f-8afb-29ff3bab4a60 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.429345 Jul 26 14:07:45.000030 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 561/1033] 10.222.0.70 () {58 vars in 1128 bytes} [Tue Jul 26 14:07:44 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:45.006574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cca794b2-b21b-4105-af69-4c8c0b23f029 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:45.007558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cca794b2-b21b-4105-af69-4c8c0b23f029 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:45.017475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cca794b2-b21b-4105-af69-4c8c0b23f029 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:45.018474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cca794b2-b21b-4105-af69-4c8c0b23f029 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:45.019454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cca794b2-b21b-4105-af69-4c8c0b23f029 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:45.020097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cca794b2-b21b-4105-af69-4c8c0b23f029 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:45.022257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:07:45.728815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cca794b2-b21b-4105-af69-4c8c0b23f029 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:45.742222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cca794b2-b21b-4105-af69-4c8c0b23f029 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:45.743796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cca794b2-b21b-4105-af69-4c8c0b23f029 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:45.745002 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cca794b2-b21b-4105-af69-4c8c0b23f029 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 0.743432 Jul 26 14:07:45.763726 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 562/1034] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:45 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:45.767178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-de9bb955-b8db-4101-b9a2-9a131231f4bf tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Calling method '.version_select at 0x7f8787f99ca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:45.786149 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:45.786149 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:45.787473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de9bb955-b8db-4101-b9a2-9a131231f4bf tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:45.787938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de9bb955-b8db-4101-b9a2-9a131231f4bf tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:45.788775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de9bb955-b8db-4101-b9a2-9a131231f4bf tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:45.789214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de9bb955-b8db-4101-b9a2-9a131231f4bf tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:45.837362 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-de9bb955-b8db-4101-b9a2-9a131231f4bf tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.077051 Jul 26 14:07:45.838309 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 563/1035] 10.222.0.70 () {58 vars in 1139 bytes} [Tue Jul 26 14:07:45 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:45.844603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d82a5eb8-141d-4c33-8b0f-a40552767940 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:45.849441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d82a5eb8-141d-4c33-8b0f-a40552767940 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 4d6317e9-619d-4230-b5c8-58452de314b9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:45.862063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d82a5eb8-141d-4c33-8b0f-a40552767940 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:45.863522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d82a5eb8-141d-4c33-8b0f-a40552767940 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:45.865438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d82a5eb8-141d-4c33-8b0f-a40552767940 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:45.866196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d82a5eb8-141d-4c33-8b0f-a40552767940 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:45.910240 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d82a5eb8-141d-4c33-8b0f-a40552767940 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] HTTP exception thrown: Instance 4d6317e9-619d-4230-b5c8-58452de314b9 could not be found. Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d82a5eb8-141d-4c33-8b0f-a40552767940 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Request method failure captured: Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 HTTP/1.1 Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_SNfkHZCdOaRPcr7PZSF32hJG9gh_1_MFjeSQZyVXIzKJJ6C-gdkmUu11TO2q3z5DJMSmh49XgBcqHHkkHFtKToGUsWmCP-heIHtyxB1jcxT8CWG24rySzMm4JZVmR1-BFXuhkgR22Xkp2BOOajoPhSM-UMilrfj7vk5WAyQY4hXfM Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e90b10ccea94aa292a1c993c6d4424c Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersAdminTestJSON-1029940560 Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:07:45.917221 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e90b10ccea94aa292a1c993c6d4424c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e90b10ccea94aa292a1c993c6d4424c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e90b10ccea94aa292a1c993c6d4424c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e90b10ccea94aa292a1c993c6d4424c"}]}] Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersAdminTestJSON-1029940560 Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e90b10ccea94aa292a1c993c6d4424c Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersAdminTestJSON-1029940560 Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersAdminTestJSON-1029940560-project Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7de821a9c74948e5a98e667c24606af9 Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersAdminTestJSON-1029940560-project Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 4d6317e9-619d-4230-b5c8-58452de314b9 could not be found. Jul 26 14:07:45.919512 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4d6317e9-619d-4230-b5c8-58452de314b9'} Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6317e9-619d-4230-b5c8-58452de314b9 could not be found. Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:45.920341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6317e9-619d-4230-b5c8-58452de314b9 could not be found. Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6317e9-619d-4230-b5c8-58452de314b9 could not be found. Jul 26 14:07:45.921574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:45.929334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d82a5eb8-141d-4c33-8b0f-a40552767940 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Returning 404 to user: Instance 4d6317e9-619d-4230-b5c8-58452de314b9 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:45.931395 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d82a5eb8-141d-4c33-8b0f-a40552767940 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9" status: 404 len: 111 microversion: 2.1 time: 0.091948 Jul 26 14:07:45.934300 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 564/1036] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:45 2022] GET /compute/v2.1/servers/4d6317e9-619d-4230-b5c8-58452de314b9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:07:45.964092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6bafd551-ef14-48fd-9fb3-81702aff4380 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:45.967558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6bafd551-ef14-48fd-9fb3-81702aff4380 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:45.986265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bafd551-ef14-48fd-9fb3-81702aff4380 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:45.988141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bafd551-ef14-48fd-9fb3-81702aff4380 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:45.992453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bafd551-ef14-48fd-9fb3-81702aff4380 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:45.993152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bafd551-ef14-48fd-9fb3-81702aff4380 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:46.179760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:07:46.180793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:07:46.181441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:07:46.182020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:07:46.182785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:07:46.203803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:46.204591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:46.206673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:46.210248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:46.263980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for project d2c43d5f86804cc181b575525a402873. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:07:46.273984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Getting quotas for user 753d20ca575a4270b73b1c686bf657dd and project d2c43d5f86804cc181b575525a402873. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:07:46.310236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:07:46.312688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:07:46.433060 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5d065c16-4a3f-4166-9780-db80e87bcca4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541831 Jul 26 14:07:46.434776 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 473/1037] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:07:46.445398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff38e83e-d823-462b-8aca-822a2b7854ed tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f87945d99d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:46.575001 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff38e83e-d823-462b-8aca-822a2b7854ed tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.133262 Jul 26 14:07:46.584637 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 474/1038] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:46 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:46.589945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff2780b2-307b-421e-b513-2927beda342a tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Calling method '.version_select at 0x7f8794b6c670>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:46.607730 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:46.607730 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:46.614044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff2780b2-307b-421e-b513-2927beda342a tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:46.647146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6bafd551-ef14-48fd-9fb3-81702aff4380 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:46.652310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff2780b2-307b-421e-b513-2927beda342a tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:46.653969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff2780b2-307b-421e-b513-2927beda342a tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:46.654428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff2780b2-307b-421e-b513-2927beda342a tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:46.662167 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6bafd551-ef14-48fd-9fb3-81702aff4380 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 0.725532 Jul 26 14:07:46.677984 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 565/1039] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:45 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:46.696152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7153d789-ff21-4458-a5c9-8871098d1947 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:46.699266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7153d789-ff21-4458-a5c9-8871098d1947 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:46.716710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:46.719282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7153d789-ff21-4458-a5c9-8871098d1947 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:46.720240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7153d789-ff21-4458-a5c9-8871098d1947 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:46.721239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7153d789-ff21-4458-a5c9-8871098d1947 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:46.722763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7153d789-ff21-4458-a5c9-8871098d1947 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:46.757666 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff2780b2-307b-421e-b513-2927beda342a tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.171574 Jul 26 14:07:46.765758 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 475/1040] 10.222.0.70 () {58 vars in 1145 bytes} [Tue Jul 26 14:07:46 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:07:46.809176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e6ab772-b8b9-43c5-a4f7-5a62d342278b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:46.810370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e6ab772-b8b9-43c5-a4f7-5a62d342278b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:46.842439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7153d789-ff21-4458-a5c9-8871098d1947 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:07:47.072296 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7153d789-ff21-4458-a5c9-8871098d1947 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "DELETE /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 204 len: 0 microversion: 2.1 time: 0.392522 Jul 26 14:07:47.076953 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 566/1041] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:07:46 2022] DELETE /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:07:47.103508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df56ab4f-d59d-49be-ab64-cb5a9adcffab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:47.104726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df56ab4f-d59d-49be-ab64-cb5a9adcffab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:47.122001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df56ab4f-d59d-49be-ab64-cb5a9adcffab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:47.124648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df56ab4f-d59d-49be-ab64-cb5a9adcffab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:47.126027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df56ab4f-d59d-49be-ab64-cb5a9adcffab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:47.130353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df56ab4f-d59d-49be-ab64-cb5a9adcffab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:47.991572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2e6ab772-b8b9-43c5-a4f7-5a62d342278b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:48.004174 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e6ab772-b8b9-43c5-a4f7-5a62d342278b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1212 microversion: 2.1 time: 1.235496 Jul 26 14:07:48.005945 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 476/1042] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:46 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1212 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:48.012008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fdee6f1d-3c39-4829-9304-82f962e208d0 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Calling method '.version_select at 0x7f87946cca60>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:48.015003 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:48.015003 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:48.017795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdee6f1d-3c39-4829-9304-82f962e208d0 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:48.020640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdee6f1d-3c39-4829-9304-82f962e208d0 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:48.022140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdee6f1d-3c39-4829-9304-82f962e208d0 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:48.023700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdee6f1d-3c39-4829-9304-82f962e208d0 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:48.116588 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fdee6f1d-3c39-4829-9304-82f962e208d0 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.107962 Jul 26 14:07:48.119702 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 477/1043] 10.222.0.70 () {58 vars in 1128 bytes} [Tue Jul 26 14:07:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:48.132170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-691ca202-353a-4523-a33b-b977d4193d37 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:48.133932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-691ca202-353a-4523-a33b-b977d4193d37 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:48.149758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-691ca202-353a-4523-a33b-b977d4193d37 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:48.151054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-691ca202-353a-4523-a33b-b977d4193d37 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:48.152889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-691ca202-353a-4523-a33b-b977d4193d37 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:48.156049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-691ca202-353a-4523-a33b-b977d4193d37 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:48.207419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df56ab4f-d59d-49be-ab64-cb5a9adcffab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:48.224307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df56ab4f-d59d-49be-ab64-cb5a9adcffab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:48.231009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df56ab4f-d59d-49be-ab64-cb5a9adcffab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:48.232298 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df56ab4f-d59d-49be-ab64-cb5a9adcffab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 1.152277 Jul 26 14:07:48.240288 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 567/1044] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:47 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:48.256939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8e594e9c-3333-4bfc-94f9-418e9a84a3a0 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787fa4820>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:48.332383 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8e594e9c-3333-4bfc-94f9-418e9a84a3a0 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.088232 Jul 26 14:07:48.334125 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 568/1045] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:48 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:48.341709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85587cf6-ec1b-4644-845a-07404563475b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:48.342755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85587cf6-ec1b-4644-845a-07404563475b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:48.353311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85587cf6-ec1b-4644-845a-07404563475b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:48.354187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85587cf6-ec1b-4644-845a-07404563475b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:48.356837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85587cf6-ec1b-4644-845a-07404563475b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:48.370948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85587cf6-ec1b-4644-845a-07404563475b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:48.702041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-691ca202-353a-4523-a33b-b977d4193d37 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:48.718173 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-691ca202-353a-4523-a33b-b977d4193d37 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1470 microversion: 2.1 time: 0.595855 Jul 26 14:07:48.726051 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 478/1046] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:48 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1470 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:48.748887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-be99710d-fbe5-458e-b013-a85e14646e86 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Calling method '.version_select at 0x7f8794455430>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:48.751832 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:48.751832 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:48.777865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be99710d-fbe5-458e-b013-a85e14646e86 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:48.778907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be99710d-fbe5-458e-b013-a85e14646e86 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:48.780350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be99710d-fbe5-458e-b013-a85e14646e86 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:48.780956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be99710d-fbe5-458e-b013-a85e14646e86 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:48.847246 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-be99710d-fbe5-458e-b013-a85e14646e86 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.118306 Jul 26 14:07:48.848635 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 479/1047] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:07:48 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:48.875250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d626076c-8ced-40c5-a160-8b19a6a1a4eb tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Calling method '.version_select at 0x7f8796057820>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:48.878079 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:48.878079 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:48.887797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d626076c-8ced-40c5-a160-8b19a6a1a4eb tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:48.889292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d626076c-8ced-40c5-a160-8b19a6a1a4eb tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:48.894532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d626076c-8ced-40c5-a160-8b19a6a1a4eb tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:48.895188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d626076c-8ced-40c5-a160-8b19a6a1a4eb tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:48.970895 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d626076c-8ced-40c5-a160-8b19a6a1a4eb tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.110794 Jul 26 14:07:48.976134 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 480/1048] 10.222.0.70 () {58 vars in 1128 bytes} [Tue Jul 26 14:07:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:48.993374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-77e39e48-0bf6-4855-a455-3a82f173e992 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Calling method '.version_select at 0x7f87946cce50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:48.995405 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:48.995405 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:49.012000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77e39e48-0bf6-4855-a455-3a82f173e992 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:49.016949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77e39e48-0bf6-4855-a455-3a82f173e992 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:49.027026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-85587cf6-ec1b-4644-845a-07404563475b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:49.047523 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85587cf6-ec1b-4644-845a-07404563475b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 0.711979 Jul 26 14:07:49.050082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77e39e48-0bf6-4855-a455-3a82f173e992 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:49.050082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77e39e48-0bf6-4855-a455-3a82f173e992 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:49.053108 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 569/1049] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:48 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:49.069504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c6063e70-5687-4a56-a405-2e2f27f7acfc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:49.070479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c6063e70-5687-4a56-a405-2e2f27f7acfc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:49.084183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6063e70-5687-4a56-a405-2e2f27f7acfc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:49.086504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6063e70-5687-4a56-a405-2e2f27f7acfc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:49.087600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6063e70-5687-4a56-a405-2e2f27f7acfc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:49.090825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6063e70-5687-4a56-a405-2e2f27f7acfc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:49.122303 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-77e39e48-0bf6-4855-a455-3a82f173e992 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-h1-833090-9" status: 200 len: 729 microversion: 2.1 time: 0.127641 Jul 26 14:07:49.133981 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 481/1050] 10.222.0.70 () {58 vars in 1170 bytes} [Tue Jul 26 14:07:48 2022] GET /compute/v2.1/os-hosts/n-h1-833090-9 => generated 729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:49.140290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-24f7c0a7-5b6c-47df-803b-8c4d9cdc0d56 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Calling method '.version_select at 0x7f8787f1cee0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:49.141366 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:49.141366 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:49.150604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24f7c0a7-5b6c-47df-803b-8c4d9cdc0d56 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:49.152474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24f7c0a7-5b6c-47df-803b-8c4d9cdc0d56 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:49.206325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24f7c0a7-5b6c-47df-803b-8c4d9cdc0d56 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:49.208903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24f7c0a7-5b6c-47df-803b-8c4d9cdc0d56 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:49.291319 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-24f7c0a7-5b6c-47df-803b-8c4d9cdc0d56 tempest-HostsAdminTestJSON-346254494 tempest-HostsAdminTestJSON-346254494-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-h2-833090-9" status: 200 len: 990 microversion: 2.1 time: 0.155275 Jul 26 14:07:49.303043 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 482/1051] 10.222.0.70 () {58 vars in 1170 bytes} [Tue Jul 26 14:07:49 2022] GET /compute/v2.1/os-hosts/n-h2-833090-9 => generated 990 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:07:49.317565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e2e2b259-dddb-44eb-bed7-eeb223864fa3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:49.327570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e2e2b259-dddb-44eb-bed7-eeb223864fa3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:49.344601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2e2b259-dddb-44eb-bed7-eeb223864fa3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:49.352388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2e2b259-dddb-44eb-bed7-eeb223864fa3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:49.353747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2e2b259-dddb-44eb-bed7-eeb223864fa3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:49.359658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2e2b259-dddb-44eb-bed7-eeb223864fa3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:49.437608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c6063e70-5687-4a56-a405-2e2f27f7acfc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:49.458674 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c6063e70-5687-4a56-a405-2e2f27f7acfc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1264 microversion: 2.1 time: 0.400799 Jul 26 14:07:49.481645 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 570/1052] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:49 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1264 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:49.502305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d2e783e-a5fc-4d00-9803-df3e373ad057 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787f8e4c0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:49.613977 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0d2e783e-a5fc-4d00-9803-df3e373ad057 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.130766 Jul 26 14:07:49.618897 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 571/1053] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:49 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:49.769360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f2046965-f5df-4c21-828e-1cd4d0e58408 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:49.772332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f2046965-f5df-4c21-828e-1cd4d0e58408 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:49.793072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2046965-f5df-4c21-828e-1cd4d0e58408 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:49.793610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2046965-f5df-4c21-828e-1cd4d0e58408 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:49.794422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2046965-f5df-4c21-828e-1cd4d0e58408 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:49.794865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2046965-f5df-4c21-828e-1cd4d0e58408 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:50.383703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e2e2b259-dddb-44eb-bed7-eeb223864fa3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:50.394558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e2e2b259-dddb-44eb-bed7-eeb223864fa3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:50.402925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e2e2b259-dddb-44eb-bed7-eeb223864fa3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:50.404676 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e2e2b259-dddb-44eb-bed7-eeb223864fa3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1567 microversion: 2.25 time: 1.099788 Jul 26 14:07:50.405782 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 483/1054] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:49 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1567 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:50.419026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5df2993e-eb29-4cfc-824d-6266c9ab5704 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:50.420874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5df2993e-eb29-4cfc-824d-6266c9ab5704 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:50.441797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5df2993e-eb29-4cfc-824d-6266c9ab5704 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:50.443659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5df2993e-eb29-4cfc-824d-6266c9ab5704 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:50.445148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5df2993e-eb29-4cfc-824d-6266c9ab5704 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:50.446747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5df2993e-eb29-4cfc-824d-6266c9ab5704 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:50.756161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f2046965-f5df-4c21-828e-1cd4d0e58408 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:50.771818 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f2046965-f5df-4c21-828e-1cd4d0e58408 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1470 microversion: 2.1 time: 1.021371 Jul 26 14:07:50.772916 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 572/1055] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:49 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1470 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:50.781897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-530ae1a5-1dec-4e9a-aeff-aca2c90cff48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:50.783160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-530ae1a5-1dec-4e9a-aeff-aca2c90cff48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:50.794206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-530ae1a5-1dec-4e9a-aeff-aca2c90cff48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:50.794899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-530ae1a5-1dec-4e9a-aeff-aca2c90cff48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:50.795805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-530ae1a5-1dec-4e9a-aeff-aca2c90cff48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:50.796565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-530ae1a5-1dec-4e9a-aeff-aca2c90cff48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:50.970456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-530ae1a5-1dec-4e9a-aeff-aca2c90cff48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:50.980563 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-530ae1a5-1dec-4e9a-aeff-aca2c90cff48 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1270 microversion: 2.1 time: 0.205772 Jul 26 14:07:50.989027 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 573/1056] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:50 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1270 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:51.010471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58874162-e968-4c27-ac30-d788f0eddf4b tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787faab80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:51.082725 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-58874162-e968-4c27-ac30-d788f0eddf4b tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.073696 Jul 26 14:07:51.084234 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 574/1057] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:51 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:51.221058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5df2993e-eb29-4cfc-824d-6266c9ab5704 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:51.232514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5df2993e-eb29-4cfc-824d-6266c9ab5704 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 0.821639 Jul 26 14:07:51.234268 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 484/1058] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:50 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:51.433835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-40470a72-4fa0-4e35-87f7-52a677b205e2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:51.436453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-40470a72-4fa0-4e35-87f7-52a677b205e2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:51.449591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40470a72-4fa0-4e35-87f7-52a677b205e2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:51.454330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40470a72-4fa0-4e35-87f7-52a677b205e2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:51.455426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40470a72-4fa0-4e35-87f7-52a677b205e2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:51.467924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40470a72-4fa0-4e35-87f7-52a677b205e2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:51.799002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1738f172-d52d-4163-8a93-7200abc33a9d tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:51.800200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1738f172-d52d-4163-8a93-7200abc33a9d tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:51.830789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1738f172-d52d-4163-8a93-7200abc33a9d tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:51.834103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1738f172-d52d-4163-8a93-7200abc33a9d tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:51.846231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1738f172-d52d-4163-8a93-7200abc33a9d tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:51.847030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1738f172-d52d-4163-8a93-7200abc33a9d tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:51.922443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-40470a72-4fa0-4e35-87f7-52a677b205e2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:51.936957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-40470a72-4fa0-4e35-87f7-52a677b205e2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:51.944639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-40470a72-4fa0-4e35-87f7-52a677b205e2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:51.948518 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-40470a72-4fa0-4e35-87f7-52a677b205e2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1542 microversion: 2.25 time: 0.519681 Jul 26 14:07:51.953116 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 575/1059] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:51 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1542 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:51.958834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-bad8fe9b-861c-4d70-80af-89a162f8ef13 req-2445f653-40e0-4d9a-91d3-451f3c6c3de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b45315-c940-435c-9769-226630fcf63d", "name": "network-vif-deleted", "tag": "39bc3d90-adda-4d10-a83d-27393453117a"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:52.021638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-bad8fe9b-861c-4d70-80af-89a162f8ef13 req-2445f653-40e0-4d9a-91d3-451f3c6c3de5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:52.029277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-bad8fe9b-861c-4d70-80af-89a162f8ef13 req-2445f653-40e0-4d9a-91d3-451f3c6c3de5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:52.075516 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-bad8fe9b-861c-4d70-80af-89a162f8ef13 req-2445f653-40e0-4d9a-91d3-451f3c6c3de5 service nova] Creating event network-vif-deleted:39bc3d90-adda-4d10-a83d-27393453117a for instance 99b45315-c940-435c-9769-226630fcf63d on n-h2-833090-9 Jul 26 14:07:52.095846 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-bad8fe9b-861c-4d70-80af-89a162f8ef13 req-2445f653-40e0-4d9a-91d3-451f3c6c3de5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140603 Jul 26 14:07:52.109096 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 576/1060] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:52.115368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9c835600-e94b-428e-a341-113463a59015 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '.version_select at 0x7f8787f99c10>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:52.119763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c835600-e94b-428e-a341-113463a59015 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:52.121180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c835600-e94b-428e-a341-113463a59015 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:52.188711 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9c835600-e94b-428e-a341-113463a59015 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 2365 microversion: 2.25 time: 0.077767 Jul 26 14:07:52.192758 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 577/1061] 10.222.0.70 () {60 vars in 1184 bytes} [Tue Jul 26 14:07:52 2022] GET /compute/v2.1/os-migrations => generated 2365 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:52.221545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f9331b5-b257-4e94-a3e1-7d0836d9d5c7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:52.223381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4f9331b5-b257-4e94-a3e1-7d0836d9d5c7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:52.247323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f9331b5-b257-4e94-a3e1-7d0836d9d5c7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:52.255770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f9331b5-b257-4e94-a3e1-7d0836d9d5c7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:52.258302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f9331b5-b257-4e94-a3e1-7d0836d9d5c7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:52.259503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f9331b5-b257-4e94-a3e1-7d0836d9d5c7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:52.361067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1738f172-d52d-4163-8a93-7200abc33a9d tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:52.390425 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1738f172-d52d-4163-8a93-7200abc33a9d tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 200 len: 1299 microversion: 2.1 time: 0.590746 Jul 26 14:07:52.395639 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 485/1062] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:51 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 1299 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:52.423206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-218bc119-0f50-4d2b-9b30-0380ad0c6cb5 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787f0f280>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:52.562283 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-218bc119-0f50-4d2b-9b30-0380ad0c6cb5 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.164907 Jul 26 14:07:52.565424 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 486/1063] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:52 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:52.581061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bc3164a9-219c-4041-819f-62082e1cc9d2 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:52.584363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bc3164a9-219c-4041-819f-62082e1cc9d2 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:52.609609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc3164a9-219c-4041-819f-62082e1cc9d2 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:52.610348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc3164a9-219c-4041-819f-62082e1cc9d2 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:52.612303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc3164a9-219c-4041-819f-62082e1cc9d2 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:52.612998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc3164a9-219c-4041-819f-62082e1cc9d2 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:52.739445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4f9331b5-b257-4e94-a3e1-7d0836d9d5c7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:52.751696 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4f9331b5-b257-4e94-a3e1-7d0836d9d5c7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1270 microversion: 2.1 time: 0.557295 Jul 26 14:07:52.754185 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 578/1064] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:52 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1270 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:52.765597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cded2526-3277-4fc8-85d3-26276b03a0bf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:52.769944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cded2526-3277-4fc8-85d3-26276b03a0bf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:52.787528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cded2526-3277-4fc8-85d3-26276b03a0bf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:52.788933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cded2526-3277-4fc8-85d3-26276b03a0bf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:52.791730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cded2526-3277-4fc8-85d3-26276b03a0bf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:52.794606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cded2526-3277-4fc8-85d3-26276b03a0bf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:53.738627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cded2526-3277-4fc8-85d3-26276b03a0bf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:53.773806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-bc3164a9-219c-4041-819f-62082e1cc9d2 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 8f842736-4c37-478b-a26b-94b53377cc43 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:07:53.783035 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cded2526-3277-4fc8-85d3-26276b03a0bf tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 1.021833 Jul 26 14:07:53.789024 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 579/1065] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:52 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:53.814601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e620b283-f2ad-43e0-9509-590664c54881 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:53.817140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e620b283-f2ad-43e0-9509-590664c54881 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 99b45315-c940-435c-9769-226630fcf63d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:53.849141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e620b283-f2ad-43e0-9509-590664c54881 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:53.857050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e620b283-f2ad-43e0-9509-590664c54881 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:53.859553 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bc3164a9-219c-4041-819f-62082e1cc9d2 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 2034 microversion: 2.25 time: 1.287848 Jul 26 14:07:53.861325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e620b283-f2ad-43e0-9509-590664c54881 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:53.862206 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 487/1066] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:07:52 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 2034 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:07:53.866357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e620b283-f2ad-43e0-9509-590664c54881 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:53.882221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b0063afd-97ab-44bd-a923-13d386d85a4f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787f84e50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:53.930748 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e620b283-f2ad-43e0-9509-590664c54881 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] HTTP exception thrown: Instance 99b45315-c940-435c-9769-226630fcf63d could not be found. Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e620b283-f2ad-43e0-9509-590664c54881 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Request method failure captured: Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d HTTP/1.1 Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_SNfkHZCdOaRPcr7PZSF32hJG9gh_1_MFjeSQZyVXIzKJJ6C-gdkmUu11TO2q3z5DJMSmh49XgBcqHHkkHFtKToGUsWmCP-heIHtyxB1jcxT8CWG24rySzMm4JZVmR1-BFXuhkgR22Xkp2BOOajoPhSM-UMilrfj7vk5WAyQY4hXfM Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e90b10ccea94aa292a1c993c6d4424c Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersAdminTestJSON-1029940560 Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:07:53.941075 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e90b10ccea94aa292a1c993c6d4424c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e90b10ccea94aa292a1c993c6d4424c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e90b10ccea94aa292a1c993c6d4424c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e90b10ccea94aa292a1c993c6d4424c"}]}] Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersAdminTestJSON-1029940560 Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e90b10ccea94aa292a1c993c6d4424c Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersAdminTestJSON-1029940560 Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersAdminTestJSON-1029940560-project Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7de821a9c74948e5a98e667c24606af9 Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersAdminTestJSON-1029940560-project Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 99b45315-c940-435c-9769-226630fcf63d could not be found. Jul 26 14:07:53.942868 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '99b45315-c940-435c-9769-226630fcf63d'} Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b45315-c940-435c-9769-226630fcf63d could not be found. Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:07:53.943783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b45315-c940-435c-9769-226630fcf63d could not be found. Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b45315-c940-435c-9769-226630fcf63d could not be found. Jul 26 14:07:53.945338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:07:53.948645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e620b283-f2ad-43e0-9509-590664c54881 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Returning 404 to user: Instance 99b45315-c940-435c-9769-226630fcf63d could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:07:53.950846 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e620b283-f2ad-43e0-9509-590664c54881 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d" status: 404 len: 111 microversion: 2.1 time: 0.157942 Jul 26 14:07:53.955215 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 580/1067] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:53 2022] GET /compute/v2.1/servers/99b45315-c940-435c-9769-226630fcf63d => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:07:53.981872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d79bee83-084a-4440-943f-f4514775156c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:53.986923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d79bee83-084a-4440-943f-f4514775156c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:54.012541 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b0063afd-97ab-44bd-a923-13d386d85a4f tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.147933 Jul 26 14:07:54.016482 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 488/1068] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:53 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:54.022677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d79bee83-084a-4440-943f-f4514775156c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:54.045119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d79bee83-084a-4440-943f-f4514775156c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:54.051353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d79bee83-084a-4440-943f-f4514775156c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:54.053683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d79bee83-084a-4440-943f-f4514775156c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:54.074428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1853f44-3d3d-43c0-941d-c9090a9bdd93 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Action: 'create', calling method: .version_select at 0x7f8787f0faf0>, body: {"keypair": {"name": "tempest-keypair-248746982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHzC48zUh4lZhJrjKM2wkAGTrI4g7qClxUJYmL5S98+E9QjfO+w+j8jrmzqB+2e3vbPcaidM369cuyroqgjWuh3VOTdAntH52SOE5B5QZTBtXqmjIMTyu5SKSVY1yxScQ=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:54.097425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:54.156071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b1853f44-3d3d-43c0-941d-c9090a9bdd93 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Getting quotas for project 3c83e50f8be04fb9b086a046f5b7eb00. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:07:54.186884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b1853f44-3d3d-43c0-941d-c9090a9bdd93 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Getting quotas for user 4a31af687dca4bea97ad5cb0459f0dbd and project 3c83e50f8be04fb9b086a046f5b7eb00. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:07:54.274683 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b1853f44-3d3d-43c0-941d-c9090a9bdd93 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.255926 Jul 26 14:07:54.276851 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 489/1069] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Jul 26 14:07:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 260 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 14:07:54.291323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7649cb7-a884-419b-b1ec-bdea994be2fb tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:54.297269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f7649cb7-a884-419b-b1ec-bdea994be2fb tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:54.312822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7649cb7-a884-419b-b1ec-bdea994be2fb tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:54.315544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7649cb7-a884-419b-b1ec-bdea994be2fb tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:54.317097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7649cb7-a884-419b-b1ec-bdea994be2fb tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:54.319138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7649cb7-a884-419b-b1ec-bdea994be2fb tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:54.397754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f7649cb7-a884-419b-b1ec-bdea994be2fb tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:07:54.638224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:54.649406 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7649cb7-a884-419b-b1ec-bdea994be2fb tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 204 len: 0 microversion: 2.1 time: 0.369777 Jul 26 14:07:54.659196 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 490/1070] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:07:54 2022] DELETE /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:07:54.669667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-591aa1cd-0a86-479d-a820-eaeae9c697f7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:54.670690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-591aa1cd-0a86-479d-a820-eaeae9c697f7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:54.678649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-591aa1cd-0a86-479d-a820-eaeae9c697f7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:54.679348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-591aa1cd-0a86-479d-a820-eaeae9c697f7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:54.680620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-591aa1cd-0a86-479d-a820-eaeae9c697f7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:54.681247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-591aa1cd-0a86-479d-a820-eaeae9c697f7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:55.655110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d79bee83-084a-4440-943f-f4514775156c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:55.678647 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d79bee83-084a-4440-943f-f4514775156c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1312 microversion: 2.1 time: 1.713052 Jul 26 14:07:55.679352 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 581/1071] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:53 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1312 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:55.684854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-89565607-d4a8-402a-81e3-81971225eae3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:55.685665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-89565607-d4a8-402a-81e3-81971225eae3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:55.732186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-591aa1cd-0a86-479d-a820-eaeae9c697f7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:55.738652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89565607-d4a8-402a-81e3-81971225eae3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:55.739811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89565607-d4a8-402a-81e3-81971225eae3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:55.742042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89565607-d4a8-402a-81e3-81971225eae3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:55.742579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89565607-d4a8-402a-81e3-81971225eae3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:55.748460 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-591aa1cd-0a86-479d-a820-eaeae9c697f7 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1470 microversion: 2.1 time: 1.085310 Jul 26 14:07:55.749058 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 491/1072] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:54 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1470 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:55.764959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c195eee-0439-4b92-914c-9b807d791929 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787f39160>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:55.799129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:55.851696 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c195eee-0439-4b92-914c-9b807d791929 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.101167 Jul 26 14:07:55.861083 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 492/1073] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:55 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:56.704999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6df52bd1-9c03-4194-87eb-d05dda169ce8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:56.706910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6df52bd1-9c03-4194-87eb-d05dda169ce8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:56.741434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6df52bd1-9c03-4194-87eb-d05dda169ce8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:56.742078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6df52bd1-9c03-4194-87eb-d05dda169ce8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:56.753086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6df52bd1-9c03-4194-87eb-d05dda169ce8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:56.754303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6df52bd1-9c03-4194-87eb-d05dda169ce8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:57.440233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-89565607-d4a8-402a-81e3-81971225eae3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:57.450294 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-89565607-d4a8-402a-81e3-81971225eae3 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 1.769620 Jul 26 14:07:57.451528 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 582/1074] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:55 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:57.458546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43a2bde7-356d-43af-ad6b-88afef1f7020 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:57.459414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-43a2bde7-356d-43af-ad6b-88afef1f7020 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:57.466715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43a2bde7-356d-43af-ad6b-88afef1f7020 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:57.480081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43a2bde7-356d-43af-ad6b-88afef1f7020 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:57.484444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43a2bde7-356d-43af-ad6b-88afef1f7020 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:57.496139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43a2bde7-356d-43af-ad6b-88afef1f7020 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:57.594802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6df52bd1-9c03-4194-87eb-d05dda169ce8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:57.610722 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6df52bd1-9c03-4194-87eb-d05dda169ce8 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1312 microversion: 2.1 time: 0.911630 Jul 26 14:07:57.614283 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 493/1075] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:56 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1312 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:07:57.625477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-37e8bf8e-6822-4f36-aa74-a093b4079cf7 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787fa1f70>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:57.720757 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-37e8bf8e-6822-4f36-aa74-a093b4079cf7 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1429 microversion: 2.1 time: 0.103983 Jul 26 14:07:57.722964 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 494/1076] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:57 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1429 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:57.734701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-9b2a7577-db30-40af-92a9-71b3bfa7d11a req-bd47cc7e-3dbc-4195-b4e2-10fbd95b3760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8beadb53-ad09-4a21-a4b8-1a8d1e561129", "tag": "81fe2ba7-46e4-409a-8bd8-03c67c1e0702"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:57.811142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9b2a7577-db30-40af-92a9-71b3bfa7d11a req-bd47cc7e-3dbc-4195-b4e2-10fbd95b3760 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:57.811801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9b2a7577-db30-40af-92a9-71b3bfa7d11a req-bd47cc7e-3dbc-4195-b4e2-10fbd95b3760 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:57.833011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:57.869368 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-9b2a7577-db30-40af-92a9-71b3bfa7d11a req-bd47cc7e-3dbc-4195-b4e2-10fbd95b3760 service nova] Creating event network-changed:81fe2ba7-46e4-409a-8bd8-03c67c1e0702 for instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 on n-h1-833090-9 Jul 26 14:07:57.878569 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-9b2a7577-db30-40af-92a9-71b3bfa7d11a req-bd47cc7e-3dbc-4195-b4e2-10fbd95b3760 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153964 Jul 26 14:07:57.880003 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 495/1077] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:58.071053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43a2bde7-356d-43af-ad6b-88afef1f7020 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:58.082706 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43a2bde7-356d-43af-ad6b-88afef1f7020 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1470 microversion: 2.1 time: 0.629809 Jul 26 14:07:58.098940 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 583/1078] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:57 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1470 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:58.476111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-306dc239-370c-453a-a519-5741f75d610c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:58.477308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-306dc239-370c-453a-a519-5741f75d610c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:58.523677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-306dc239-370c-453a-a519-5741f75d610c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:58.524524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-306dc239-370c-453a-a519-5741f75d610c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:58.528192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-306dc239-370c-453a-a519-5741f75d610c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:58.530818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-306dc239-370c-453a-a519-5741f75d610c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:58.640647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-efbfa204-2b7c-4f23-84a2-7a9c1d5c6e98 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:58.641311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-efbfa204-2b7c-4f23-84a2-7a9c1d5c6e98 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:58.651809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efbfa204-2b7c-4f23-84a2-7a9c1d5c6e98 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:58.652422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efbfa204-2b7c-4f23-84a2-7a9c1d5c6e98 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:58.657096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efbfa204-2b7c-4f23-84a2-7a9c1d5c6e98 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:58.659335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efbfa204-2b7c-4f23-84a2-7a9c1d5c6e98 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:58.917853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:07:59.180243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-306dc239-370c-453a-a519-5741f75d610c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:59.195120 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-306dc239-370c-453a-a519-5741f75d610c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 0.726488 Jul 26 14:07:59.197710 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 496/1079] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:58 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:59.207699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d4b4e3c-584d-48f6-8276-25d17ad3a46e tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787ed8040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:59.242903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-efbfa204-2b7c-4f23-84a2-7a9c1d5c6e98 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:07:59.253845 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-efbfa204-2b7c-4f23-84a2-7a9c1d5c6e98 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1312 microversion: 2.1 time: 0.617790 Jul 26 14:07:59.268323 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 584/1080] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:58 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1312 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:59.733553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4729a138-3edc-4bac-952e-2d7822d737a5 tempest-QuotaClassesAdmin257Test-753688695 tempest-QuotaClassesAdmin257Test-753688695-project-admin] Calling method '.version_select at 0x7f8787f99ca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:59.739905 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:59.739905 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:07:59.769548 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4729a138-3edc-4bac-952e-2d7822d737a5 tempest-QuotaClassesAdmin257Test-753688695 tempest-QuotaClassesAdmin257Test-753688695-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.498340 Jul 26 14:07:59.770496 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 585/1081] 10.222.0.70 () {60 vars in 1226 bytes} [Tue Jul 26 14:07:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:07:59.782258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-76e59d8b-e1b4-46c3-8e96-4168f340f916 req-9d3575f0-1d6f-49cc-aa3f-13f70dbe8d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf4359c-96f3-43bf-aea5-1cb4685a4493", "name": "network-vif-deleted", "tag": "0f1776dc-c5aa-4946-80e1-ec3dbca3eb36"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:59.820904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-76e59d8b-e1b4-46c3-8e96-4168f340f916 req-9d3575f0-1d6f-49cc-aa3f-13f70dbe8d7e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:59.822142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-76e59d8b-e1b4-46c3-8e96-4168f340f916 req-9d3575f0-1d6f-49cc-aa3f-13f70dbe8d7e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:59.850970 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-76e59d8b-e1b4-46c3-8e96-4168f340f916 req-9d3575f0-1d6f-49cc-aa3f-13f70dbe8d7e service nova] Creating event network-vif-deleted:0f1776dc-c5aa-4946-80e1-ec3dbca3eb36 for instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 on n-h1-833090-9 Jul 26 14:07:59.851452 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d4b4e3c-584d-48f6-8276-25d17ad3a46e tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1438 microversion: 2.1 time: 0.648376 Jul 26 14:07:59.858928 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-76e59d8b-e1b4-46c3-8e96-4168f340f916 req-9d3575f0-1d6f-49cc-aa3f-13f70dbe8d7e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086974 Jul 26 14:07:59.860711 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 586/1082] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:07:59.866886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:07:59.867917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:07:59.870242 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 497/1083] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:07:59 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1438 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:07:59.876234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e948adb1-e921-4072-9afd-913492f092b0 tempest-QuotaClassesAdmin257Test-753688695 tempest-QuotaClassesAdmin257Test-753688695-project-admin] Action: 'update', calling method: .version_select at 0x7f8787f3f5e0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:07:59.876777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:59.877451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:59.878829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:59.879489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:59.893467 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:07:59.893467 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:07:59.930990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:07:59.932762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:07:59.935394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lazy-loading 'fault' on Instance uuid 6bf4359c-96f3-43bf-aea5-1cb4685a4493 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:08:00.061138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de821a9c74948e5a98e667c24606af9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e90b10ccea94aa292a1c993c6d4424c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:00.091113 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f0866db9-3e30-42a3-b21a-a13fc9db8296 tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 200 len: 1304 microversion: 2.1 time: 0.228697 Jul 26 14:08:00.097539 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 587/1084] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:07:59 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 1304 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:00.103856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f9be20df-ef91-42e6-b647-521a3d90a1c3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787fa43a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:00.111643 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e948adb1-e921-4072-9afd-913492f092b0 tempest-QuotaClassesAdmin257Test-753688695 tempest-QuotaClassesAdmin257Test-753688695-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.239326 Jul 26 14:08:00.113526 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 498/1085] 10.222.0.70 () {62 vars in 1247 bytes} [Tue Jul 26 14:07:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:08:00.126748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a136ed5f-2cef-45a6-b2e4-3937c03d9b28 tempest-QuotaClassesAdmin257Test-753688695 tempest-QuotaClassesAdmin257Test-753688695-project-admin] Calling method '.version_select at 0x7f87945d9790>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:00.129212 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:08:00.129212 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:08:00.145996 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a136ed5f-2cef-45a6-b2e4-3937c03d9b28 tempest-QuotaClassesAdmin257Test-753688695 tempest-QuotaClassesAdmin257Test-753688695-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.023761 Jul 26 14:08:00.146903 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 499/1086] 10.222.0.70 () {60 vars in 1226 bytes} [Tue Jul 26 14:08:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:08:00.161056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fd30fa8b-4e97-4907-95bf-d4eccbebe692 tempest-QuotaClassesAdmin257Test-753688695 tempest-QuotaClassesAdmin257Test-753688695-project-admin] Action: 'update', calling method: .version_select at 0x7f8787f3fb80>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:00.206759 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f9be20df-ef91-42e6-b647-521a3d90a1c3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 200 len: 1438 microversion: 2.1 time: 0.107644 Jul 26 14:08:00.218975 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 588/1087] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:08:00 2022] GET /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:00.236708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9fcc34bf-103b-4ffc-a8a6-9b487a39513a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:00.237974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9fcc34bf-103b-4ffc-a8a6-9b487a39513a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:00.251216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fcc34bf-103b-4ffc-a8a6-9b487a39513a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:00.254073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fcc34bf-103b-4ffc-a8a6-9b487a39513a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:00.257121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fcc34bf-103b-4ffc-a8a6-9b487a39513a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:00.257853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fcc34bf-103b-4ffc-a8a6-9b487a39513a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:00.309284 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fd30fa8b-4e97-4907-95bf-d4eccbebe692 tempest-QuotaClassesAdmin257Test-753688695 tempest-QuotaClassesAdmin257Test-753688695-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.151630 Jul 26 14:08:00.311235 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 500/1088] 10.222.0.70 () {62 vars in 1247 bytes} [Tue Jul 26 14:08:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:08:00.321860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6e8d182-f034-4379-aeb8-5b5d2ce18736 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:00.322582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6e8d182-f034-4379-aeb8-5b5d2ce18736 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:00.332928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6e8d182-f034-4379-aeb8-5b5d2ce18736 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:00.333602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6e8d182-f034-4379-aeb8-5b5d2ce18736 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:00.334275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6e8d182-f034-4379-aeb8-5b5d2ce18736 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:00.334786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6e8d182-f034-4379-aeb8-5b5d2ce18736 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:01.066866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c6e8d182-f034-4379-aeb8-5b5d2ce18736 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:01.087550 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6e8d182-f034-4379-aeb8-5b5d2ce18736 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1479 microversion: 2.1 time: 0.774811 Jul 26 14:08:01.091016 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 501/1089] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:00 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1479 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:01.097746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9a597731-c0bc-4298-adb9-c0ca07d0da11 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:01.098705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9a597731-c0bc-4298-adb9-c0ca07d0da11 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:01.129149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a597731-c0bc-4298-adb9-c0ca07d0da11 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:01.131267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a597731-c0bc-4298-adb9-c0ca07d0da11 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:01.135284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a597731-c0bc-4298-adb9-c0ca07d0da11 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:01.136944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a597731-c0bc-4298-adb9-c0ca07d0da11 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:01.242398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9fcc34bf-103b-4ffc-a8a6-9b487a39513a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:01.266323 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9fcc34bf-103b-4ffc-a8a6-9b487a39513a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1515 microversion: 2.1 time: 1.045332 Jul 26 14:08:01.266742 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 589/1090] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:00 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1515 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:01.290427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1003e963-b4a9-45e9-a17c-9c44a8f8923b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:01.291198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1003e963-b4a9-45e9-a17c-9c44a8f8923b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] [instance: 6bf4359c-96f3-43bf-aea5-1cb4685a4493] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:01.304489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1003e963-b4a9-45e9-a17c-9c44a8f8923b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:01.305251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1003e963-b4a9-45e9-a17c-9c44a8f8923b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:01.306340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1003e963-b4a9-45e9-a17c-9c44a8f8923b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:01.306963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1003e963-b4a9-45e9-a17c-9c44a8f8923b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:01.330668 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-1003e963-b4a9-45e9-a17c-9c44a8f8923b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] HTTP exception thrown: Instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 could not be found. Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1003e963-b4a9-45e9-a17c-9c44a8f8923b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Request method failure captured: Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 HTTP/1.1 Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_SNfkHZCdOaRPcr7PZSF32hJG9gh_1_MFjeSQZyVXIzKJJ6C-gdkmUu11TO2q3z5DJMSmh49XgBcqHHkkHFtKToGUsWmCP-heIHtyxB1jcxT8CWG24rySzMm4JZVmR1-BFXuhkgR22Xkp2BOOajoPhSM-UMilrfj7vk5WAyQY4hXfM Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e90b10ccea94aa292a1c993c6d4424c Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersAdminTestJSON-1029940560 Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:08:01.334300 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e90b10ccea94aa292a1c993c6d4424c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e90b10ccea94aa292a1c993c6d4424c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e90b10ccea94aa292a1c993c6d4424c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e90b10ccea94aa292a1c993c6d4424c"}]}] Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersAdminTestJSON-1029940560 Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e90b10ccea94aa292a1c993c6d4424c Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersAdminTestJSON-1029940560 Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersAdminTestJSON-1029940560-project Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7de821a9c74948e5a98e667c24606af9 Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersAdminTestJSON-1029940560-project Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 could not be found. Jul 26 14:08:01.336675 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '6bf4359c-96f3-43bf-aea5-1cb4685a4493'} Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 could not be found. Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:01.337849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 could not be found. Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 could not be found. Jul 26 14:08:01.341305 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:01.360842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1003e963-b4a9-45e9-a17c-9c44a8f8923b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] Returning 404 to user: Instance 6bf4359c-96f3-43bf-aea5-1cb4685a4493 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:01.363026 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1003e963-b4a9-45e9-a17c-9c44a8f8923b tempest-ServersAdminTestJSON-1029940560 tempest-ServersAdminTestJSON-1029940560-project] 10.222.0.70 "GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493" status: 404 len: 111 microversion: 2.1 time: 0.095017 Jul 26 14:08:01.364717 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 590/1091] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:01 2022] GET /compute/v2.1/servers/6bf4359c-96f3-43bf-aea5-1cb4685a4493 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:08:01.680389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a597731-c0bc-4298-adb9-c0ca07d0da11 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:01.690425 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9a597731-c0bc-4298-adb9-c0ca07d0da11 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1312 microversion: 2.1 time: 0.597575 Jul 26 14:08:01.706589 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 502/1092] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:01 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1312 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:02.122874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-049ff8a3-66dc-4f95-882f-6a39e3135761 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:02.127975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-049ff8a3-66dc-4f95-882f-6a39e3135761 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:02.147408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-049ff8a3-66dc-4f95-882f-6a39e3135761 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:02.148979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-049ff8a3-66dc-4f95-882f-6a39e3135761 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:02.150670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-049ff8a3-66dc-4f95-882f-6a39e3135761 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:02.151400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-049ff8a3-66dc-4f95-882f-6a39e3135761 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:02.295613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-48e4b929-1cf0-4644-86dd-efbf8fc2c946 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:02.296561 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-48e4b929-1cf0-4644-86dd-efbf8fc2c946 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:02.317275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48e4b929-1cf0-4644-86dd-efbf8fc2c946 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:02.318560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48e4b929-1cf0-4644-86dd-efbf8fc2c946 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:02.320112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48e4b929-1cf0-4644-86dd-efbf8fc2c946 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:02.321313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48e4b929-1cf0-4644-86dd-efbf8fc2c946 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:02.837140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-48e4b929-1cf0-4644-86dd-efbf8fc2c946 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:02.847278 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-48e4b929-1cf0-4644-86dd-efbf8fc2c946 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1521 microversion: 2.1 time: 0.557135 Jul 26 14:08:02.849178 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 503/1093] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:02 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1521 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:02.860564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0e085d79-ccda-4815-a985-6564712463aa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:02.862886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0e085d79-ccda-4815-a985-6564712463aa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:02.874046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e085d79-ccda-4815-a985-6564712463aa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:02.875049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e085d79-ccda-4815-a985-6564712463aa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:02.876253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e085d79-ccda-4815-a985-6564712463aa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:02.877587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e085d79-ccda-4815-a985-6564712463aa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:03.094617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-049ff8a3-66dc-4f95-882f-6a39e3135761 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:03.109157 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-049ff8a3-66dc-4f95-882f-6a39e3135761 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1466 microversion: 2.1 time: 0.997127 Jul 26 14:08:03.110615 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 591/1094] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:02 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1466 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:03.122851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0e085d79-ccda-4815-a985-6564712463aa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:03.132574 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0e085d79-ccda-4815-a985-6564712463aa tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1312 microversion: 2.1 time: 0.281961 Jul 26 14:08:03.139596 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 504/1095] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:02 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1312 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:03.162224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c3243886-914c-4547-a5f3-e949d4f45478 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787fa49d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:03.282819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-505942534", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "5ef2cecf-6342-4020-8ce3-eff3cab2d670"}], "security_groups": [{"name": "tempest-securitygroup--111857685"}], "key_name": "tempest-keypair-248746982", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:03.562223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] validate_networks() for [('5ef2cecf-6342-4020-8ce3-eff3cab2d670', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:08:04.813761 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c3243886-914c-4547-a5f3-e949d4f45478 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "DELETE /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba" status: 204 len: 0 microversion: 2.1 time: 1.672153 Jul 26 14:08:04.814329 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 592/1096] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:03 2022] DELETE /compute/v2.1/images/cc2c83fd-64a8-4b53-847c-398d40eaa2ba => generated 0 bytes in 1677 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:08:04.819154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0957ead1-4e3d-436b-93f5-7cb6be82d12f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:04.820454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0957ead1-4e3d-436b-93f5-7cb6be82d12f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:04.836755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0957ead1-4e3d-436b-93f5-7cb6be82d12f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:04.837538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0957ead1-4e3d-436b-93f5-7cb6be82d12f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:04.843404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0957ead1-4e3d-436b-93f5-7cb6be82d12f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:04.843869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0957ead1-4e3d-436b-93f5-7cb6be82d12f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:05.005451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:08:05.005965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:08:05.006470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:08:05.006899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:08:05.007322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:08:05.029127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:05.029589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:05.033331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:05.034107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:05.089808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Getting quotas for project 3c83e50f8be04fb9b086a046f5b7eb00. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:05.104046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Getting quotas for user 4a31af687dca4bea97ad5cb0459f0dbd and project 3c83e50f8be04fb9b086a046f5b7eb00. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:05.146029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:08:05.159375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:08:05.293432 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e264d192-bb89-4e62-89c3-89d2d2036e8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.015331 Jul 26 14:08:05.303454 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 505/1097] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:08:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 2027 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 14:08:05.316821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fbcf55eb-3936-4edc-b8e1-6661b3ce39d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:05.318277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fbcf55eb-3936-4edc-b8e1-6661b3ce39d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:05.339311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fbcf55eb-3936-4edc-b8e1-6661b3ce39d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:05.341306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fbcf55eb-3936-4edc-b8e1-6661b3ce39d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:05.344067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fbcf55eb-3936-4edc-b8e1-6661b3ce39d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:05.345480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fbcf55eb-3936-4edc-b8e1-6661b3ce39d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:05.415663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0957ead1-4e3d-436b-93f5-7cb6be82d12f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:05.423887 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0957ead1-4e3d-436b-93f5-7cb6be82d12f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1521 microversion: 2.1 time: 0.608517 Jul 26 14:08:05.429796 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 593/1098] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:04 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1521 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:05.452369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ccd3843f-9690-4d45-bdcf-8af28cff1c95 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '.version_select at 0x7f8787fa44c0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:05.535993 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-ccd3843f-9690-4d45-bdcf-8af28cff1c95 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] HTTP exception thrown: Image not found. Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ccd3843f-9690-4d45-bdcf-8af28cff1c95 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Request method failure captured: Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 HTTP/1.1 Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_TLvWiJnPuTEt6gY5BLjUX_iZuCJZS1_hDXuGq00a8HQ8KGdRRdQhO7kb8RPZY9_vJuuylc1LKMeZstwLJ0DnjTd3hQgUx34dRHWmxhIUI2S5C_4JsGGA1OXHVVeNADmFJJaRoQYbYqXw3BtlpU3swhbaSb-b1GbBBsnKTzj5JSOu4 Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f83f5c16243748bb9122828119f5bbef Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesOneServerTestJSON-1935625033 Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:08:05.538434 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f83f5c16243748bb9122828119f5bbef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f83f5c16243748bb9122828119f5bbef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f83f5c16243748bb9122828119f5bbef", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f83f5c16243748bb9122828119f5bbef"}]}] Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesOneServerTestJSON-1935625033 Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f83f5c16243748bb9122828119f5bbef Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1935625033 Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesOneServerTestJSON-1935625033-project Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6f6b9f5f3cb54ecbb1c1d7603bb3ae79 Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesOneServerTestJSON-1935625033-project Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: exception: Image not found. Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '8742d93f-b7a3-4bfd-9e1d-891425220ae7'} Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:05.540518 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8742d93f-b7a3-4bfd-9e1d-891425220ae7 to delete Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:05.541640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8742d93f-b7a3-4bfd-9e1d-891425220ae7 could not be found. Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:05.542895 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ccd3843f-9690-4d45-bdcf-8af28cff1c95 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Returning 404 to user: Image not found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ccd3843f-9690-4d45-bdcf-8af28cff1c95 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "DELETE /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7" status: 404 len: 62 microversion: 2.1 time: 0.108189 Jul 26 14:08:05.547196 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 594/1099] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:05 2022] DELETE /compute/v2.1/images/8742d93f-b7a3-4bfd-9e1d-891425220ae7 => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:08:05.550380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-0da6e8bf-0e4f-4859-9c97-cd0f92167829 req-1552b013-e75c-48c4-8a06-b1c9ba339f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8beadb53-ad09-4a21-a4b8-1a8d1e561129", "name": "network-vif-plugged", "status": "completed", "tag": "81fe2ba7-46e4-409a-8bd8-03c67c1e0702"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:05.575530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0da6e8bf-0e4f-4859-9c97-cd0f92167829 req-1552b013-e75c-48c4-8a06-b1c9ba339f43 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:05.580284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0da6e8bf-0e4f-4859-9c97-cd0f92167829 req-1552b013-e75c-48c4-8a06-b1c9ba339f43 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:05.606708 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-0da6e8bf-0e4f-4859-9c97-cd0f92167829 req-1552b013-e75c-48c4-8a06-b1c9ba339f43 service nova] Creating event network-vif-plugged:81fe2ba7-46e4-409a-8bd8-03c67c1e0702 for instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 on n-h1-833090-9 Jul 26 14:08:05.616602 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-0da6e8bf-0e4f-4859-9c97-cd0f92167829 req-1552b013-e75c-48c4-8a06-b1c9ba339f43 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072822 Jul 26 14:08:05.619098 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 595/1100] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:05.649064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83131e33-b584-4c0f-b5b0-dffd75b4218b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:05.650382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-83131e33-b584-4c0f-b5b0-dffd75b4218b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:05.895399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-83131e33-b584-4c0f-b5b0-dffd75b4218b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:05.916439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-83131e33-b584-4c0f-b5b0-dffd75b4218b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:05.919243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-83131e33-b584-4c0f-b5b0-dffd75b4218b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:05.920867 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-83131e33-b584-4c0f-b5b0-dffd75b4218b tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1284 microversion: 2.25 time: 0.300379 Jul 26 14:08:05.926290 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 596/1101] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:08:05 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1284 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:08:05.951212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ed71b97-bcbe-4392-a935-15f82a6da9c3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:05.954106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fbcf55eb-3936-4edc-b8e1-6661b3ce39d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:05.954477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ed71b97-bcbe-4392-a935-15f82a6da9c3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:05.972921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ed71b97-bcbe-4392-a935-15f82a6da9c3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:05.978150 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fbcf55eb-3936-4edc-b8e1-6661b3ce39d6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1312 microversion: 2.1 time: 0.666781 Jul 26 14:08:05.979525 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 506/1102] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:05 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1312 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:06.001232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ed71b97-bcbe-4392-a935-15f82a6da9c3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:06.002791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ed71b97-bcbe-4392-a935-15f82a6da9c3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:06.003621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ed71b97-bcbe-4392-a935-15f82a6da9c3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:06.093505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ed71b97-bcbe-4392-a935-15f82a6da9c3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:08:06.395705 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ed71b97-bcbe-4392-a935-15f82a6da9c3 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 204 len: 0 microversion: 2.1 time: 0.460152 Jul 26 14:08:06.409314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-73a4cf91-c8ca-4a58-a54e-3c2edaf9322a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:06.410791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-73a4cf91-c8ca-4a58-a54e-3c2edaf9322a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:06.415744 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 597/1103] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:08:05 2022] DELETE /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:08:06.427686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73a4cf91-c8ca-4a58-a54e-3c2edaf9322a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:06.432953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73a4cf91-c8ca-4a58-a54e-3c2edaf9322a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:06.435174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73a4cf91-c8ca-4a58-a54e-3c2edaf9322a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:06.439135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73a4cf91-c8ca-4a58-a54e-3c2edaf9322a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:06.458668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0fda0ed0-5207-4dc0-9dec-b1e7a1015cfc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:06.459848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0fda0ed0-5207-4dc0-9dec-b1e7a1015cfc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:06.476792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0fda0ed0-5207-4dc0-9dec-b1e7a1015cfc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:06.483882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0fda0ed0-5207-4dc0-9dec-b1e7a1015cfc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:06.486424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0fda0ed0-5207-4dc0-9dec-b1e7a1015cfc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:06.488259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0fda0ed0-5207-4dc0-9dec-b1e7a1015cfc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:07.006847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-73a4cf91-c8ca-4a58-a54e-3c2edaf9322a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:07.020361 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-73a4cf91-c8ca-4a58-a54e-3c2edaf9322a tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1472 microversion: 2.1 time: 0.613288 Jul 26 14:08:07.036079 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 507/1104] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:06 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1472 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:07.079145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0fda0ed0-5207-4dc0-9dec-b1e7a1015cfc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:07.089300 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0fda0ed0-5207-4dc0-9dec-b1e7a1015cfc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1521 microversion: 2.1 time: 0.635377 Jul 26 14:08:07.091090 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 598/1105] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:06 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1521 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:07.100118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-048a4f23-f354-4ecb-b994-48ccba171df4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:07.101014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-048a4f23-f354-4ecb-b994-48ccba171df4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:07.110668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-048a4f23-f354-4ecb-b994-48ccba171df4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:07.111347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-048a4f23-f354-4ecb-b994-48ccba171df4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:07.112437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-048a4f23-f354-4ecb-b994-48ccba171df4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:07.113053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-048a4f23-f354-4ecb-b994-48ccba171df4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:07.215656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-048a4f23-f354-4ecb-b994-48ccba171df4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:07.229618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-048a4f23-f354-4ecb-b994-48ccba171df4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:07.232221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-048a4f23-f354-4ecb-b994-48ccba171df4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:07.236642 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-048a4f23-f354-4ecb-b994-48ccba171df4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1288 microversion: 2.25 time: 0.144222 Jul 26 14:08:07.237686 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 599/1106] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:08:07 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1288 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:08:07.243925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-20fed6b1-4497-48ee-a678-b89d593604ef tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:07.244598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-20fed6b1-4497-48ee-a678-b89d593604ef tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:07.252426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20fed6b1-4497-48ee-a678-b89d593604ef tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:07.253125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20fed6b1-4497-48ee-a678-b89d593604ef tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:07.254100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20fed6b1-4497-48ee-a678-b89d593604ef tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:07.254553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20fed6b1-4497-48ee-a678-b89d593604ef tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:07.509465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-20fed6b1-4497-48ee-a678-b89d593604ef tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:07.519439 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-20fed6b1-4497-48ee-a678-b89d593604ef tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1312 microversion: 2.1 time: 0.280453 Jul 26 14:08:07.520561 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 600/1107] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:07 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:07.672890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-37431bb0-7cdf-4e01-a8d0-bfd236ee1317 tempest-FloatingIPDetailsNegativeTestJSON-151653727 tempest-FloatingIPDetailsNegativeTestJSON-151653727-project] Calling method '.version_select at 0x7f8787ee80d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:07.785958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-320d6bd2-116b-4b3b-bd81-58b4ac948ac7 req-39567e20-ee03-4b4d-b9df-3229f4757910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8fb600-30dc-4acb-819a-c6bd8059035a", "name": "network-vif-plugged", "status": "completed", "tag": "b033356a-67a5-4f24-846b-c91577f66641"}, {"server_uuid": "8c20b152-e109-4ec5-882c-9640b942901e", "name": "network-vif-unplugged", "status": "completed", "tag": "0023117a-fed6-48c7-9154-388efdf05982"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:07.812399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-37431bb0-7cdf-4e01-a8d0-bfd236ee1317 tempest-FloatingIPDetailsNegativeTestJSON-151653727 tempest-FloatingIPDetailsNegativeTestJSON-151653727-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5b5b4725-a7d2-4a48-ae7f-9b4982e430cc could not be found", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:08:07.813327 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-37431bb0-7cdf-4e01-a8d0-bfd236ee1317 tempest-FloatingIPDetailsNegativeTestJSON-151653727 tempest-FloatingIPDetailsNegativeTestJSON-151653727-project] HTTP exception thrown: Floating IP not found for ID 5b5b4725-a7d2-4a48-ae7f-9b4982e430cc Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-37431bb0-7cdf-4e01-a8d0-bfd236ee1317 tempest-FloatingIPDetailsNegativeTestJSON-151653727 tempest-FloatingIPDetailsNegativeTestJSON-151653727-project] Request method failure captured: Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-floating-ips/5b5b4725-a7d2-4a48-ae7f-9b4982e430cc HTTP/1.1 Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VG1X6OvC591yOXVXFu5V1eTYDySOXPIpk46u4A4GjjlokQX7M0TcXblOKpYZUocRKKg4zn1v81_o3-l--PugwKRTNMfKneocBUqtmjbVEyFZc2MS_KbmI9MCc2G993a8Ic8diaCacgkvMO21x4TzyMo8A6ZjP6nSUqJrQNh9zLj6s Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 21d3b5fc89794e5cab39103f4a2cb09c Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-151653727 Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:08:07.818279 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/21d3b5fc89794e5cab39103f4a2cb09c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/21d3b5fc89794e5cab39103f4a2cb09c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_21d3b5fc89794e5cab39103f4a2cb09c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/21d3b5fc89794e5cab39103f4a2cb09c"}]}] Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-151653727 Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 21d3b5fc89794e5cab39103f4a2cb09c Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-151653727 Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-151653727-project Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 0ad8fd9095d243f7b79e520cfbcb6b7a Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-151653727-project Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: exception: Floating IP not found for ID 5b5b4725-a7d2-4a48-ae7f-9b4982e430cc Jul 26 14:08:07.819852 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '5b5b4725-a7d2-4a48-ae7f-9b4982e430cc'} Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:08:07.820677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5b5b4725-a7d2-4a48-ae7f-9b4982e430cc could not be found Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ab74c6d-a102-4230-b9f8-e95d8bf16346'] Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5b5b4725-a7d2-4a48-ae7f-9b4982e430cc. Jul 26 14:08:07.821984 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5b5b4725-a7d2-4a48-ae7f-9b4982e430cc Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:07.823131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:07.827232 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:07.827232 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5b5b4725-a7d2-4a48-ae7f-9b4982e430cc Jul 26 14:08:07.827232 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:07.829630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-37431bb0-7cdf-4e01-a8d0-bfd236ee1317 tempest-FloatingIPDetailsNegativeTestJSON-151653727 tempest-FloatingIPDetailsNegativeTestJSON-151653727-project] Returning 404 to user: Floating IP not found for ID 5b5b4725-a7d2-4a48-ae7f-9b4982e430cc {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:07.830707 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-37431bb0-7cdf-4e01-a8d0-bfd236ee1317 tempest-FloatingIPDetailsNegativeTestJSON-151653727 tempest-FloatingIPDetailsNegativeTestJSON-151653727-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/5b5b4725-a7d2-4a48-ae7f-9b4982e430cc" status: 404 len: 111 microversion: 2.1 time: 0.792066 Jul 26 14:08:07.831848 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 508/1108] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:08:07 2022] GET /compute/v2.1/os-floating-ips/5b5b4725-a7d2-4a48-ae7f-9b4982e430cc => generated 111 bytes in 795 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:08:07.834275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-320d6bd2-116b-4b3b-bd81-58b4ac948ac7 req-39567e20-ee03-4b4d-b9df-3229f4757910 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:07.839590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-320d6bd2-116b-4b3b-bd81-58b4ac948ac7 req-39567e20-ee03-4b4d-b9df-3229f4757910 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:07.874345 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-320d6bd2-116b-4b3b-bd81-58b4ac948ac7 req-39567e20-ee03-4b4d-b9df-3229f4757910 service nova] Creating event network-vif-plugged:b033356a-67a5-4f24-846b-c91577f66641 for instance 4c8fb600-30dc-4acb-819a-c6bd8059035a on n-h2-833090-9 Jul 26 14:08:07.877164 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-320d6bd2-116b-4b3b-bd81-58b4ac948ac7 req-39567e20-ee03-4b4d-b9df-3229f4757910 service nova] Creating event network-vif-unplugged:0023117a-fed6-48c7-9154-388efdf05982 for instance 8c20b152-e109-4ec5-882c-9640b942901e on n-h2-833090-9 Jul 26 14:08:07.899406 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-320d6bd2-116b-4b3b-bd81-58b4ac948ac7 req-39567e20-ee03-4b4d-b9df-3229f4757910 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.121989 Jul 26 14:08:07.900838 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 601/1109] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:08.044916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b200e30b-a6fd-4ccf-be74-70038da91b19 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:08.045724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b200e30b-a6fd-4ccf-be74-70038da91b19 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:08.076212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b200e30b-a6fd-4ccf-be74-70038da91b19 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:08.076965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b200e30b-a6fd-4ccf-be74-70038da91b19 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:08.078053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b200e30b-a6fd-4ccf-be74-70038da91b19 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:08.078599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b200e30b-a6fd-4ccf-be74-70038da91b19 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:08.115715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c5d22415-78f1-48ed-8099-b2b49ab13fb5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:08.117207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c5d22415-78f1-48ed-8099-b2b49ab13fb5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:08.141532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5d22415-78f1-48ed-8099-b2b49ab13fb5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:08.144951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5d22415-78f1-48ed-8099-b2b49ab13fb5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:08.148342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5d22415-78f1-48ed-8099-b2b49ab13fb5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:08.150807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5d22415-78f1-48ed-8099-b2b49ab13fb5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:09.266938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c5d22415-78f1-48ed-8099-b2b49ab13fb5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:09.281328 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c5d22415-78f1-48ed-8099-b2b49ab13fb5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1521 microversion: 2.1 time: 1.169688 Jul 26 14:08:09.290020 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 602/1110] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:08 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1521 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:08:09.290915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b200e30b-a6fd-4ccf-be74-70038da91b19 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f6b9f5f3cb54ecbb1c1d7603bb3ae79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f5c16243748bb9122828119f5bbef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:09.304930 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b200e30b-a6fd-4ccf-be74-70038da91b19 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 200 len: 1472 microversion: 2.1 time: 1.266076 Jul 26 14:08:09.306617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-53953c24-f575-4fde-a0cf-a3913b19fdef tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:09.307353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-53953c24-f575-4fde-a0cf-a3913b19fdef tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:09.311357 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 509/1111] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:08 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 1472 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:09.321417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-403735ae-1d8e-4949-b987-04666d9e132e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:09.334969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-403735ae-1d8e-4949-b987-04666d9e132e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:09.342606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53953c24-f575-4fde-a0cf-a3913b19fdef tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:09.343065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53953c24-f575-4fde-a0cf-a3913b19fdef tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:09.344032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53953c24-f575-4fde-a0cf-a3913b19fdef tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:09.344572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53953c24-f575-4fde-a0cf-a3913b19fdef tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:09.362651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-403735ae-1d8e-4949-b987-04666d9e132e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:09.366122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-403735ae-1d8e-4949-b987-04666d9e132e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:09.371360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-403735ae-1d8e-4949-b987-04666d9e132e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:09.376433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-403735ae-1d8e-4949-b987-04666d9e132e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:09.394530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:09.615453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-53953c24-f575-4fde-a0cf-a3913b19fdef tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:09.635780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-53953c24-f575-4fde-a0cf-a3913b19fdef tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:09.642459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-53953c24-f575-4fde-a0cf-a3913b19fdef tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:09.649909 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-53953c24-f575-4fde-a0cf-a3913b19fdef tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1342 microversion: 2.25 time: 0.358670 Jul 26 14:08:09.673274 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 603/1112] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:08:09 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1342 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:08:10.295425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-403735ae-1d8e-4949-b987-04666d9e132e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:10.313135 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-403735ae-1d8e-4949-b987-04666d9e132e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1460 microversion: 2.1 time: 0.994296 Jul 26 14:08:10.313796 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 510/1113] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:09 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1460 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:10.399634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d74adb6-aefe-4601-9283-d0dcc93d203b tempest-SecurityGroupsTestAdminJSON-1328104835 tempest-SecurityGroupsTestAdminJSON-1328104835-project] Action: 'create', calling method: .version_select at 0x7f8787f99040>, body: {"security_group": {"name": "tempest-securitygroup-11752476", "description": "tempest-description-1830162104"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:10.425663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2066490331", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:10.592288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:08:11.335178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:08:11.339458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:08:11.344489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:08:11.344956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:08:11.345438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:08:11.357315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:11.357964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:11.358941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:11.359544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:11.380888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=33,nova_cell0:UPDATE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:11.385256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:11.413410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:11.442412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:08:11.445527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:08:11.507831 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-362b735b-3424-4bd9-affe-a7a760bbc5b6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.192943 Jul 26 14:08:11.509061 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 511/1114] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:08:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:08:11.516539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9b7d0ab8-2d8a-44b7-ae6e-6a48d9e09089 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:11.517470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9b7d0ab8-2d8a-44b7-ae6e-6a48d9e09089 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:11.520344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=14,nova_api:INSERT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:11.529654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b7d0ab8-2d8a-44b7-ae6e-6a48d9e09089 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:11.530518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b7d0ab8-2d8a-44b7-ae6e-6a48d9e09089 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:11.532649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b7d0ab8-2d8a-44b7-ae6e-6a48d9e09089 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:11.533769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b7d0ab8-2d8a-44b7-ae6e-6a48d9e09089 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:12.375217 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0d74adb6-aefe-4601-9283-d0dcc93d203b tempest-SecurityGroupsTestAdminJSON-1328104835 tempest-SecurityGroupsTestAdminJSON-1328104835-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.659546 Jul 26 14:08:12.383498 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 604/1115] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:08:09 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:08:12.391597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ac21d3ef-9acb-4727-b9ac-a40c3b29c223 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:12.392999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ac21d3ef-9acb-4727-b9ac-a40c3b29c223 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] [instance: 8c20b152-e109-4ec5-882c-9640b942901e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:12.409000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac21d3ef-9acb-4727-b9ac-a40c3b29c223 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:12.413350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac21d3ef-9acb-4727-b9ac-a40c3b29c223 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:12.414921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac21d3ef-9acb-4727-b9ac-a40c3b29c223 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:12.415558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac21d3ef-9acb-4727-b9ac-a40c3b29c223 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:12.436768 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-ac21d3ef-9acb-4727-b9ac-a40c3b29c223 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] HTTP exception thrown: Instance 8c20b152-e109-4ec5-882c-9640b942901e could not be found. Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ac21d3ef-9acb-4727-b9ac-a40c3b29c223 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Request method failure captured: Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e HTTP/1.1 Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_TLvWiJnPuTEt6gY5BLjUX_iZuCJZS1_hDXuGq00a8HQ8KGdRRdQhO7kb8RPZY9_vJuuylc1LKMeZstwLJ0DnjTd3hQgUx34dRHWmxhIUI2S5C_4JsGGA1OXHVVeNADmFJJaRoQYbYqXw3BtlpU3swhbaSb-b1GbBBsnKTzj5JSOu4 Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f83f5c16243748bb9122828119f5bbef Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesOneServerTestJSON-1935625033 Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:08:12.438865 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f83f5c16243748bb9122828119f5bbef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f83f5c16243748bb9122828119f5bbef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f83f5c16243748bb9122828119f5bbef", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f83f5c16243748bb9122828119f5bbef"}]}] Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesOneServerTestJSON-1935625033 Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f83f5c16243748bb9122828119f5bbef Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1935625033 Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesOneServerTestJSON-1935625033-project Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6f6b9f5f3cb54ecbb1c1d7603bb3ae79 Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesOneServerTestJSON-1935625033-project Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 8c20b152-e109-4ec5-882c-9640b942901e could not be found. Jul 26 14:08:12.440679 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '8c20b152-e109-4ec5-882c-9640b942901e'} Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c20b152-e109-4ec5-882c-9640b942901e could not be found. Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:12.441590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c20b152-e109-4ec5-882c-9640b942901e could not be found. Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c20b152-e109-4ec5-882c-9640b942901e could not be found. Jul 26 14:08:12.443308 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:12.446771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ac21d3ef-9acb-4727-b9ac-a40c3b29c223 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] Returning 404 to user: Instance 8c20b152-e109-4ec5-882c-9640b942901e could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:12.447836 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ac21d3ef-9acb-4727-b9ac-a40c3b29c223 tempest-ImagesOneServerTestJSON-1935625033 tempest-ImagesOneServerTestJSON-1935625033-project] 10.222.0.70 "GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e" status: 404 len: 111 microversion: 2.1 time: 0.062458 Jul 26 14:08:12.453601 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 605/1116] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:12 2022] GET /compute/v2.1/servers/8c20b152-e109-4ec5-882c-9640b942901e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:08:12.464287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d669037e-cfdd-4837-b10b-3cae8b524599 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:12.466502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d669037e-cfdd-4837-b10b-3cae8b524599 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:12.473967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d669037e-cfdd-4837-b10b-3cae8b524599 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:12.474677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d669037e-cfdd-4837-b10b-3cae8b524599 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:12.476393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d669037e-cfdd-4837-b10b-3cae8b524599 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:12.477105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d669037e-cfdd-4837-b10b-3cae8b524599 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:12.506896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9b7d0ab8-2d8a-44b7-ae6e-6a48d9e09089 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:12.521207 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9b7d0ab8-2d8a-44b7-ae6e-6a48d9e09089 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1506 microversion: 2.1 time: 1.010660 Jul 26 14:08:12.546130 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 512/1117] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:11 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1506 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:12.739844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-9cac34b5-1501-44a7-96a5-976c685cc3bd req-3227bd2b-cfbc-49d5-86aa-43b5e64f1cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c20b152-e109-4ec5-882c-9640b942901e", "name": "network-vif-deleted", "tag": "0023117a-fed6-48c7-9154-388efdf05982"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:12.780300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9cac34b5-1501-44a7-96a5-976c685cc3bd req-3227bd2b-cfbc-49d5-86aa-43b5e64f1cff service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:12.780939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9cac34b5-1501-44a7-96a5-976c685cc3bd req-3227bd2b-cfbc-49d5-86aa-43b5e64f1cff service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:12.822025 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-9cac34b5-1501-44a7-96a5-976c685cc3bd req-3227bd2b-cfbc-49d5-86aa-43b5e64f1cff service nova] Creating event network-vif-deleted:0023117a-fed6-48c7-9154-388efdf05982 for instance 8c20b152-e109-4ec5-882c-9640b942901e on n-h2-833090-9 Jul 26 14:08:12.842852 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-9cac34b5-1501-44a7-96a5-976c685cc3bd req-3227bd2b-cfbc-49d5-86aa-43b5e64f1cff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.295215 Jul 26 14:08:12.844478 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 513/1118] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:12.873730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-970738a9-9be6-40ad-a6c5-2bcba08c5365 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:12.874498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-970738a9-9be6-40ad-a6c5-2bcba08c5365 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:12.900665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-970738a9-9be6-40ad-a6c5-2bcba08c5365 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:12.901160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-970738a9-9be6-40ad-a6c5-2bcba08c5365 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:12.903680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-970738a9-9be6-40ad-a6c5-2bcba08c5365 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:12.904898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-970738a9-9be6-40ad-a6c5-2bcba08c5365 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:13.828622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-970738a9-9be6-40ad-a6c5-2bcba08c5365 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:13.838588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-970738a9-9be6-40ad-a6c5-2bcba08c5365 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:13.841231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-970738a9-9be6-40ad-a6c5-2bcba08c5365 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:13.843097 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-970738a9-9be6-40ad-a6c5-2bcba08c5365 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1409 microversion: 2.25 time: 0.995762 Jul 26 14:08:13.844700 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 514/1119] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:08:12 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1409 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:08:13.861994 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d669037e-cfdd-4837-b10b-3cae8b524599 tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1611 microversion: 2.1 time: 1.407150 Jul 26 14:08:13.862618 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 606/1120] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:12 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1611 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:13.867380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04c8952b-4bfd-45ba-b8f8-33a3302f2401 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:13.868227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-04c8952b-4bfd-45ba-b8f8-33a3302f2401 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:13.875545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04c8952b-4bfd-45ba-b8f8-33a3302f2401 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:13.876591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04c8952b-4bfd-45ba-b8f8-33a3302f2401 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:13.877567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04c8952b-4bfd-45ba-b8f8-33a3302f2401 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:13.878825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04c8952b-4bfd-45ba-b8f8-33a3302f2401 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:13.971863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-04c8952b-4bfd-45ba-b8f8-33a3302f2401 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:13.985763 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-04c8952b-4bfd-45ba-b8f8-33a3302f2401 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 200 len: 1275 microversion: 2.1 time: 0.121233 Jul 26 14:08:13.987025 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 607/1121] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:13 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 1275 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:13.997073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-820ce41d-939a-4bd2-a6e7-54f31f832d77 tempest-SecurityGroupsTestAdminJSON-1328104835 tempest-SecurityGroupsTestAdminJSON-1328104835-project] Action: 'create', calling method: .version_select at 0x7f8787f8eb80>, body: {"security_group": {"name": "tempest-securitygroup-918731700", "description": "tempest-description-542109689"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:14.094811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a05a5f46-0450-4fd3-b19b-32250a2362a2 tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] Calling method '.version_select at 0x7f8787fa1af0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:14.245651 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a05a5f46-0450-4fd3-b19b-32250a2362a2 tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.399396 Jul 26 14:08:14.262979 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 515/1122] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Jul 26 14:08:13 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:08:14.276046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-190e6664-900f-47ad-8147-24c4c4e7cccd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:14.276811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-190e6664-900f-47ad-8147-24c4c4e7cccd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:14.303164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-190e6664-900f-47ad-8147-24c4c4e7cccd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:14.303626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-190e6664-900f-47ad-8147-24c4c4e7cccd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:14.304649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-190e6664-900f-47ad-8147-24c4c4e7cccd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:14.305100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-190e6664-900f-47ad-8147-24c4c4e7cccd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:14.753815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-190e6664-900f-47ad-8147-24c4c4e7cccd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:14.763378 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-190e6664-900f-47ad-8147-24c4c4e7cccd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 200 len: 1506 microversion: 2.1 time: 0.495142 Jul 26 14:08:14.779302 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 516/1123] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:14 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:14.787162 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-820ce41d-939a-4bd2-a6e7-54f31f832d77 tempest-SecurityGroupsTestAdminJSON-1328104835 tempest-SecurityGroupsTestAdminJSON-1328104835-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.794074 Jul 26 14:08:14.795538 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 608/1124] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:08:13 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:14.795538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6ec68acd-2a06-4da5-a735-00fcdfeb238f tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] Action: 'create', calling method: .version_select at 0x7f8787f93e50>, body: {"pool": "non_exist_pool"} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:14.796037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9d6a6adb-df27-4296-8b99-4c6d24e4371b tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:14.796849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9d6a6adb-df27-4296-8b99-4c6d24e4371b tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:14.807339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9d6a6adb-df27-4296-8b99-4c6d24e4371b tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:14.808034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9d6a6adb-df27-4296-8b99-4c6d24e4371b tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:14.809576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9d6a6adb-df27-4296-8b99-4c6d24e4371b tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:14.810181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9d6a6adb-df27-4296-8b99-4c6d24e4371b tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:14.856508 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-6ec68acd-2a06-4da5-a735-00fcdfeb238f tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] HTTP exception thrown: Floating IP pool not found. Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6ec68acd-2a06-4da5-a735-00fcdfeb238f tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] Request method failure captured: Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 26 Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VKP9v55qCbgypLO_IQ66C01rJJaozzMgKz_tmOgDCjGRy36pkKG6tFxCQtcJJb-_8msTIyWoDtA2nW1EIlTBqBvlDFahmKhXGuMz7MdnD8HRTVa6Fe4PhdWjrMP7cbRXDNAJ4vG37EdO8aQzBJxIEzVLpylDqTZhyoQOEXDNxRsMA Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 99d15e24bf984443b9aa14a323ecf4a7 Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-124102968 Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:08:14.858912 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/99d15e24bf984443b9aa14a323ecf4a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/99d15e24bf984443b9aa14a323ecf4a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_99d15e24bf984443b9aa14a323ecf4a7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/99d15e24bf984443b9aa14a323ecf4a7"}]}] Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-124102968 Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 99d15e24bf984443b9aa14a323ecf4a7 Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-124102968 Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FloatingIPsNegativeTestJSON-124102968-project Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 41fb72ee3b29433a9dc1877ce964777b Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-124102968-project Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: {"pool": "non_exist_pool"} Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: exception: Floating IP pool not found. Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 26 14:08:14.860509 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:14.861537 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 26 14:08:14.863323 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:14.867401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6ec68acd-2a06-4da5-a735-00fcdfeb238f tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] Returning 404 to user: Floating IP pool not found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:14.867401 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6ec68acd-2a06-4da5-a735-00fcdfeb238f tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.077790 Jul 26 14:08:14.867732 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 609/1125] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:08:14 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:08:14.868121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9d6a6adb-df27-4296-8b99-4c6d24e4371b tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1fc3b9ab00b44314a7949a031f3327e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859c66e51f1744549f7147e367a179dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:14.869647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9d6a6adb-df27-4296-8b99-4c6d24e4371b tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] flavor_id is None. Assuming migration. {{(pid=119478) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 14:08:14.870241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9d6a6adb-df27-4296-8b99-4c6d24e4371b tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119478) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 14:08:14.874290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b1c77e11-59f5-40b7-869f-098e7c179c0d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:14.875746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b1c77e11-59f5-40b7-869f-098e7c179c0d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:14.900416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1c77e11-59f5-40b7-869f-098e7c179c0d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:14.901989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1c77e11-59f5-40b7-869f-098e7c179c0d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:14.903389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1c77e11-59f5-40b7-869f-098e7c179c0d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:14.907548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1c77e11-59f5-40b7-869f-098e7c179c0d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:14.954507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b1c77e11-59f5-40b7-869f-098e7c179c0d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:08:15.129629 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b1c77e11-59f5-40b7-869f-098e7c179c0d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 204 len: 0 microversion: 2.1 time: 0.260414 Jul 26 14:08:15.130495 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 610/1126] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:08:14 2022] DELETE /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:08:15.172723 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9d6a6adb-df27-4296-8b99-4c6d24e4371b tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129/action" status: 202 len: 0 microversion: 2.1 time: 0.389214 Jul 26 14:08:15.173851 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 517/1127] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:08:14 2022] POST /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:08:15.187314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b7861343-a457-44a8-9b53-0d9c18decbe4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:15.189630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b7861343-a457-44a8-9b53-0d9c18decbe4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:15.208704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7861343-a457-44a8-9b53-0d9c18decbe4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:15.210102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7861343-a457-44a8-9b53-0d9c18decbe4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:15.215084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7861343-a457-44a8-9b53-0d9c18decbe4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:15.218372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7861343-a457-44a8-9b53-0d9c18decbe4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:15.672870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8ce47e0a-a8f0-47d9-8098-448713b53b1a tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Action: 'create', calling method: .version_select at 0x7f8787faad30>, body: {"security_group": {"name": "tempest-securitygroup-1476698346", "description": "tempest-description-713659270"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:15.902697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:16.041284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b7861343-a457-44a8-9b53-0d9c18decbe4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:16.047066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:16.066413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b7861343-a457-44a8-9b53-0d9c18decbe4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:16.068747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b7861343-a457-44a8-9b53-0d9c18decbe4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:16.070060 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b7861343-a457-44a8-9b53-0d9c18decbe4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1409 microversion: 2.25 time: 0.895221 Jul 26 14:08:16.070734 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 518/1128] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:08:15 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1409 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:08:16.081449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d2d2a79-a862-46ed-8d9a-8dce8f9907bf tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] Calling method '.version_select at 0x7f8787e82ee0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:16.248677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-6d2d2a79-a862-46ed-8d9a-8dce8f9907bf tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP be7c56f3-51b3-4bec-9654-b3189618abc0 could not be found", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:08:16.249908 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-6d2d2a79-a862-46ed-8d9a-8dce8f9907bf tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] HTTP exception thrown: Floating IP not found for ID be7c56f3-51b3-4bec-9654-b3189618abc0 Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d2d2a79-a862-46ed-8d9a-8dce8f9907bf tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] Request method failure captured: Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-floating-ips/be7c56f3-51b3-4bec-9654-b3189618abc0 HTTP/1.1 Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VKP9v55qCbgypLO_IQ66C01rJJaozzMgKz_tmOgDCjGRy36pkKG6tFxCQtcJJb-_8msTIyWoDtA2nW1EIlTBqBvlDFahmKhXGuMz7MdnD8HRTVa6Fe4PhdWjrMP7cbRXDNAJ4vG37EdO8aQzBJxIEzVLpylDqTZhyoQOEXDNxRsMA Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 99d15e24bf984443b9aa14a323ecf4a7 Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-124102968 Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:08:16.253485 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/99d15e24bf984443b9aa14a323ecf4a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/99d15e24bf984443b9aa14a323ecf4a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_99d15e24bf984443b9aa14a323ecf4a7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/99d15e24bf984443b9aa14a323ecf4a7"}]}] Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-124102968 Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 99d15e24bf984443b9aa14a323ecf4a7 Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-124102968 Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FloatingIPsNegativeTestJSON-124102968-project Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 41fb72ee3b29433a9dc1877ce964777b Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-124102968-project Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: exception: Floating IP not found for ID be7c56f3-51b3-4bec-9654-b3189618abc0 Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'be7c56f3-51b3-4bec-9654-b3189618abc0'} Jul 26 14:08:16.256203 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:08:16.257939 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP be7c56f3-51b3-4bec-9654-b3189618abc0 could not be found Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d58aaaf-4ece-43ab-8bc4-49646d06cc5f'] Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID be7c56f3-51b3-4bec-9654-b3189618abc0. Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:16.260507 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID be7c56f3-51b3-4bec-9654-b3189618abc0 Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:16.263060 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:16.269034 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID be7c56f3-51b3-4bec-9654-b3189618abc0 Jul 26 14:08:16.269034 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:16.269034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d2d2a79-a862-46ed-8d9a-8dce8f9907bf tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] Returning 404 to user: Floating IP not found for ID be7c56f3-51b3-4bec-9654-b3189618abc0 {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:16.269034 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6d2d2a79-a862-46ed-8d9a-8dce8f9907bf tempest-FloatingIPsNegativeTestJSON-124102968 tempest-FloatingIPsNegativeTestJSON-124102968-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/be7c56f3-51b3-4bec-9654-b3189618abc0" status: 404 len: 111 microversion: 2.1 time: 0.185735 Jul 26 14:08:16.269034 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 519/1129] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:08:16 2022] DELETE /compute/v2.1/os-floating-ips/be7c56f3-51b3-4bec-9654-b3189618abc0 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:08:16.272200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-641c4cb1-e7fc-463f-ae91-9fe147dc52cc tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:16.272978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-641c4cb1-e7fc-463f-ae91-9fe147dc52cc tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:16.299084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-641c4cb1-e7fc-463f-ae91-9fe147dc52cc tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:16.299738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-641c4cb1-e7fc-463f-ae91-9fe147dc52cc tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:16.300641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-641c4cb1-e7fc-463f-ae91-9fe147dc52cc tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:16.301085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-641c4cb1-e7fc-463f-ae91-9fe147dc52cc tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:17.149764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-641c4cb1-e7fc-463f-ae91-9fe147dc52cc tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:17.166373 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-641c4cb1-e7fc-463f-ae91-9fe147dc52cc tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 200 len: 1317 microversion: 2.1 time: 0.899733 Jul 26 14:08:17.175112 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 520/1130] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:16 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 1317 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:17.412267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7d1283c-30c5-4029-bd09-3930d9aba465 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:17.413594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f7d1283c-30c5-4029-bd09-3930d9aba465 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:17.428783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7d1283c-30c5-4029-bd09-3930d9aba465 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:17.429488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7d1283c-30c5-4029-bd09-3930d9aba465 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:17.430712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7d1283c-30c5-4029-bd09-3930d9aba465 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:17.431344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7d1283c-30c5-4029-bd09-3930d9aba465 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:17.875160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f7d1283c-30c5-4029-bd09-3930d9aba465 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:17.886085 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7d1283c-30c5-4029-bd09-3930d9aba465 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1469 microversion: 2.1 time: 0.708753 Jul 26 14:08:17.888572 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 521/1131] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:17 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1469 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:17.897883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1413744146", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "a25f5344-bc1c-4e07-a47f-5585d3cd8924"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:17.991344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] validate_networks() for [('a25f5344-bc1c-4e07-a47f-5585d3cd8924', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:08:18.065699 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8ce47e0a-a8f0-47d9-8098-448713b53b1a tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.915312 Jul 26 14:08:18.066839 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 611/1132] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:08:15 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:18.158371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-591e07e7-6c65-44f9-8f89-6cc6ac6821d3 tempest-ListImageFiltersNegativeTestJSON-1202515509 tempest-ListImageFiltersNegativeTestJSON-1202515509-project] Calling method '.version_select at 0x7f8787fa4670>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:18.181305 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-591e07e7-6c65-44f9-8f89-6cc6ac6821d3 tempest-ListImageFiltersNegativeTestJSON-1202515509 tempest-ListImageFiltersNegativeTestJSON-1202515509-project] HTTP exception thrown: Image not found. Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-591e07e7-6c65-44f9-8f89-6cc6ac6821d3 tempest-ListImageFiltersNegativeTestJSON-1202515509 tempest-ListImageFiltersNegativeTestJSON-1202515509-project] Request method failure captured: Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/images/cf983b70-b713-4b70-9269-1921ab69c055 HTTP/1.1 Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VPjiVkrGojZ7jZPRiRNVGNzxvVOin2JXuljk_Czj_dqlL-IRXu4ZP9feuotm-1TdjnPE7Zh2p2pT-w4bpe8gx83wVAQKRS9kYhzdD5Alixk6d_cRv2pARq_0i_VIIixxuNpNtluOb8oKxVbItzDo08gHTJaNOYcTdVIe1VJx96jG0 Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a63085da330e4c17ad2d1f122414e97a Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1202515509 Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:08:18.184928 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a63085da330e4c17ad2d1f122414e97a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a63085da330e4c17ad2d1f122414e97a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a63085da330e4c17ad2d1f122414e97a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a63085da330e4c17ad2d1f122414e97a"}]}] Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1202515509 Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a63085da330e4c17ad2d1f122414e97a Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1202515509 Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ListImageFiltersNegativeTestJSON-1202515509-project Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ab6a0c687a924f14ac13693a3bd2b779 Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1202515509-project Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: exception: Image not found. Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'cf983b70-b713-4b70-9269-1921ab69c055'} Jul 26 14:08:18.186287 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:18.187107 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cf983b70-b713-4b70-9269-1921ab69c055 Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:18.188233 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cf983b70-b713-4b70-9269-1921ab69c055 could not be found. Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:18.189428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:08:18.190601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:18.194938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-591e07e7-6c65-44f9-8f89-6cc6ac6821d3 tempest-ListImageFiltersNegativeTestJSON-1202515509 tempest-ListImageFiltersNegativeTestJSON-1202515509-project] Returning 404 to user: Image not found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:18.196185 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-591e07e7-6c65-44f9-8f89-6cc6ac6821d3 tempest-ListImageFiltersNegativeTestJSON-1202515509 tempest-ListImageFiltersNegativeTestJSON-1202515509-project] 10.222.0.70 "GET /compute/v2.1/images/cf983b70-b713-4b70-9269-1921ab69c055" status: 404 len: 62 microversion: 2.1 time: 0.128222 Jul 26 14:08:18.201823 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 612/1133] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:08:18 2022] GET /compute/v2.1/images/cf983b70-b713-4b70-9269-1921ab69c055 => generated 62 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:08:18.207709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2080ea48-4db0-4a5d-8bda-4788aad74d70 req-225dd1ce-4396-40bc-a938-6e60a7017f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cbff42-6659-4317-bf61-7f5f2aaaa942", "tag": "a17e340d-a5eb-45cb-9fb6-171e51e54f5b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:18.218221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:18.221995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2080ea48-4db0-4a5d-8bda-4788aad74d70 req-225dd1ce-4396-40bc-a938-6e60a7017f04 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:18.222801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2080ea48-4db0-4a5d-8bda-4788aad74d70 req-225dd1ce-4396-40bc-a938-6e60a7017f04 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:18.239896 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2080ea48-4db0-4a5d-8bda-4788aad74d70 req-225dd1ce-4396-40bc-a938-6e60a7017f04 service nova] Creating event network-changed:a17e340d-a5eb-45cb-9fb6-171e51e54f5b for instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 on n-h1-833090-9 Jul 26 14:08:18.247813 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2080ea48-4db0-4a5d-8bda-4788aad74d70 req-225dd1ce-4396-40bc-a938-6e60a7017f04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043731 Jul 26 14:08:18.248901 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 613/1134] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:18.255553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3928fe5-4c35-4979-af06-f29b902eb790 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:18.256831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3928fe5-4c35-4979-af06-f29b902eb790 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:18.266709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3928fe5-4c35-4979-af06-f29b902eb790 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:18.267723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3928fe5-4c35-4979-af06-f29b902eb790 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:18.268968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3928fe5-4c35-4979-af06-f29b902eb790 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:18.269684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3928fe5-4c35-4979-af06-f29b902eb790 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:18.666870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a3928fe5-4c35-4979-af06-f29b902eb790 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:18.677153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a3928fe5-4c35-4979-af06-f29b902eb790 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:18.679036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a3928fe5-4c35-4979-af06-f29b902eb790 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:18.680487 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a3928fe5-4c35-4979-af06-f29b902eb790 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1409 microversion: 2.25 time: 0.430254 Jul 26 14:08:18.681788 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 614/1135] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:08:18 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1409 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:08:18.689067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4fd75e3d-0d4a-40f5-bde6-92cbada9a9f8 req-55ae5f66-cddb-4b48-b37e-0b270c350f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34089008-8d17-4f4a-a989-57f47959ae93", "tag": "4b363e20-4144-4452-a88b-446bd69f43ec"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:18.700813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4fd75e3d-0d4a-40f5-bde6-92cbada9a9f8 req-55ae5f66-cddb-4b48-b37e-0b270c350f31 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:18.701422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4fd75e3d-0d4a-40f5-bde6-92cbada9a9f8 req-55ae5f66-cddb-4b48-b37e-0b270c350f31 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:18.712840 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4fd75e3d-0d4a-40f5-bde6-92cbada9a9f8 req-55ae5f66-cddb-4b48-b37e-0b270c350f31 service nova] Creating event network-changed:4b363e20-4144-4452-a88b-446bd69f43ec for instance 34089008-8d17-4f4a-a989-57f47959ae93 on n-h2-833090-9 Jul 26 14:08:18.718662 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4fd75e3d-0d4a-40f5-bde6-92cbada9a9f8 req-55ae5f66-cddb-4b48-b37e-0b270c350f31 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035349 Jul 26 14:08:18.719832 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 615/1136] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:18.726739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-477e5884-741a-4171-bd02-0ca9ad80b612 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Action: 'create', calling method: .version_select at 0x7f8787fa4790>, body: {"security_group": {"name": "tempest-securitygroup-165567258", "description": "tempest-description-778030731"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:19.852648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:08:19.853667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:08:19.854155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:08:19.854723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:08:19.855147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:08:19.870113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:19.870336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:19.872501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:19.873355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:19.904666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Getting quotas for project 46f25f5febd140a69cc213cb54ecdf5f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:19.916556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Getting quotas for user 7b8a1556b59644acbe6edf7c64fa76f5 and project 46f25f5febd140a69cc213cb54ecdf5f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:19.932415 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-477e5884-741a-4171-bd02-0ca9ad80b612 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.210485 Jul 26 14:08:19.933250 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 616/1137] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:08:18 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:19.947854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-96d1ec13-2aa2-4906-b846-0e9b44910e29 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:19.949347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-96d1ec13-2aa2-4906-b846-0e9b44910e29 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:19.960289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:08:19.970074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:08:19.973312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96d1ec13-2aa2-4906-b846-0e9b44910e29 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:19.974830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96d1ec13-2aa2-4906-b846-0e9b44910e29 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:19.975794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96d1ec13-2aa2-4906-b846-0e9b44910e29 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:19.976632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96d1ec13-2aa2-4906-b846-0e9b44910e29 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:20.073802 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9f664ba9-5d2e-4bd1-92d3-7775cca38c3e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.183868 Jul 26 14:08:20.076358 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 522/1138] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:08:20.081910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-09fdc3d8-a16c-4878-8ddd-d7deeeb80390 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:20.083073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-09fdc3d8-a16c-4878-8ddd-d7deeeb80390 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:20.092529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09fdc3d8-a16c-4878-8ddd-d7deeeb80390 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:20.093440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09fdc3d8-a16c-4878-8ddd-d7deeeb80390 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:20.094761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09fdc3d8-a16c-4878-8ddd-d7deeeb80390 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:20.095428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09fdc3d8-a16c-4878-8ddd-d7deeeb80390 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:20.751750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-09fdc3d8-a16c-4878-8ddd-d7deeeb80390 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:20.762881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-96d1ec13-2aa2-4906-b846-0e9b44910e29 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:20.764804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-09fdc3d8-a16c-4878-8ddd-d7deeeb80390 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1469 microversion: 2.1 time: 0.686993 Jul 26 14:08:20.766101 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 523/1139] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:20 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1469 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:20.781131 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-96d1ec13-2aa2-4906-b846-0e9b44910e29 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 200 len: 1317 microversion: 2.1 time: 0.846084 Jul 26 14:08:20.792196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c563a38-308d-4b39-ab1b-f5621cdfa83d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:20.793126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c563a38-308d-4b39-ab1b-f5621cdfa83d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:20.797116 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 617/1140] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:19 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 1317 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:20.801913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c563a38-308d-4b39-ab1b-f5621cdfa83d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:20.805762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Calling method '.version_select at 0x7f8787f8e9d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:20.806709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c563a38-308d-4b39-ab1b-f5621cdfa83d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:20.807802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c563a38-308d-4b39-ab1b-f5621cdfa83d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:20.808488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c563a38-308d-4b39-ab1b-f5621cdfa83d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:21.858059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c563a38-308d-4b39-ab1b-f5621cdfa83d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:21.874029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c563a38-308d-4b39-ab1b-f5621cdfa83d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:21.876219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c563a38-308d-4b39-ab1b-f5621cdfa83d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:21.879087 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2c563a38-308d-4b39-ab1b-f5621cdfa83d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1409 microversion: 2.25 time: 1.109872 Jul 26 14:08:21.881143 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 524/1141] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:08:20 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1409 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:08:21.907423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2caf525f-62a1-4b33-b81e-9a148e75434e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:21.910451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2caf525f-62a1-4b33-b81e-9a148e75434e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:21.948530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2caf525f-62a1-4b33-b81e-9a148e75434e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:21.951840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2caf525f-62a1-4b33-b81e-9a148e75434e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:21.953265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2caf525f-62a1-4b33-b81e-9a148e75434e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:21.955487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2caf525f-62a1-4b33-b81e-9a148e75434e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:22.458409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2caf525f-62a1-4b33-b81e-9a148e75434e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:22.473895 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2caf525f-62a1-4b33-b81e-9a148e75434e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1270 microversion: 2.1 time: 0.590321 Jul 26 14:08:22.476952 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 525/1142] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:21 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1270 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:22.515871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-cedd956c-ff91-4885-9313-05d3a5943e9e req-1984e9e1-3dfd-4368-9513-17141b42bf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8fb600-30dc-4acb-819a-c6bd8059035a", "name": "network-vif-deleted", "tag": "b033356a-67a5-4f24-846b-c91577f66641"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:22.539013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cedd956c-ff91-4885-9313-05d3a5943e9e req-1984e9e1-3dfd-4368-9513-17141b42bf09 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:22.541587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cedd956c-ff91-4885-9313-05d3a5943e9e req-1984e9e1-3dfd-4368-9513-17141b42bf09 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:22.580273 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-cedd956c-ff91-4885-9313-05d3a5943e9e req-1984e9e1-3dfd-4368-9513-17141b42bf09 service nova] Creating event network-vif-deleted:b033356a-67a5-4f24-846b-c91577f66641 for instance 4c8fb600-30dc-4acb-819a-c6bd8059035a on n-h2-833090-9 Jul 26 14:08:22.590034 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-cedd956c-ff91-4885-9313-05d3a5943e9e req-1984e9e1-3dfd-4368-9513-17141b42bf09 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099592 Jul 26 14:08:22.594381 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 526/1143] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:22.609326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7de496e5-0862-4471-a5a1-e3e9d6739191 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:22.610554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7de496e5-0862-4471-a5a1-e3e9d6739191 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:22.629295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7de496e5-0862-4471-a5a1-e3e9d6739191 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:22.630168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7de496e5-0862-4471-a5a1-e3e9d6739191 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:22.631215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7de496e5-0862-4471-a5a1-e3e9d6739191 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:22.631869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7de496e5-0862-4471-a5a1-e3e9d6739191 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:23.092403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7de496e5-0862-4471-a5a1-e3e9d6739191 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:23.108599 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7de496e5-0862-4471-a5a1-e3e9d6739191 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 0.511457 Jul 26 14:08:23.109542 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 527/1144] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:22 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:23.114951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8801dc73-24f9-4819-bf20-159bacd5c1aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:23.116490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8801dc73-24f9-4819-bf20-159bacd5c1aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:23.125873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8801dc73-24f9-4819-bf20-159bacd5c1aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:23.126662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8801dc73-24f9-4819-bf20-159bacd5c1aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:23.127980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8801dc73-24f9-4819-bf20-159bacd5c1aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:23.128697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8801dc73-24f9-4819-bf20-159bacd5c1aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:23.495900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8801dc73-24f9-4819-bf20-159bacd5c1aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:23.516704 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8801dc73-24f9-4819-bf20-159bacd5c1aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 200 len: 1317 microversion: 2.1 time: 0.405851 Jul 26 14:08:23.529661 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 528/1145] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:23 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:23.729758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bf32aaf6-496f-4f73-9b5d-7b1dd91007e3 tempest-ListImagesTestJSON-1835623346 tempest-ListImagesTestJSON-1835623346-project] Calling method '.version_select at 0x7f8787ee8790>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:23.781819 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bf32aaf6-496f-4f73-9b5d-7b1dd91007e3 tempest-ListImagesTestJSON-1835623346 tempest-ListImagesTestJSON-1835623346-project] 10.222.0.70 "GET /compute/v2.1/images/5fc64a26-e870-4f37-8cf2-dd18e171162e" status: 200 len: 784 microversion: 2.1 time: 0.250652 Jul 26 14:08:23.782869 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 529/1146] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:08:23 2022] GET /compute/v2.1/images/5fc64a26-e870-4f37-8cf2-dd18e171162e => generated 784 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:23.787694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-23bbd57b-5595-41fa-b605-7f85d2c39f7d req-cd10cf77-9a4c-4266-a971-8b63a903c727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cbff42-6659-4317-bf61-7f5f2aaaa942", "name": "network-vif-plugged", "status": "completed", "tag": "a17e340d-a5eb-45cb-9fb6-171e51e54f5b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:23.800004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-23bbd57b-5595-41fa-b605-7f85d2c39f7d req-cd10cf77-9a4c-4266-a971-8b63a903c727 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:23.800955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-23bbd57b-5595-41fa-b605-7f85d2c39f7d req-cd10cf77-9a4c-4266-a971-8b63a903c727 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:23.816194 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-23bbd57b-5595-41fa-b605-7f85d2c39f7d req-cd10cf77-9a4c-4266-a971-8b63a903c727 service nova] Creating event network-vif-plugged:a17e340d-a5eb-45cb-9fb6-171e51e54f5b for instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 on n-h1-833090-9 Jul 26 14:08:23.823591 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-23bbd57b-5595-41fa-b605-7f85d2c39f7d req-cd10cf77-9a4c-4266-a971-8b63a903c727 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038977 Jul 26 14:08:23.824956 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 530/1147] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:23.832945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-418008e0-6e81-49a8-bae1-84e87f422046 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:23.833948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-418008e0-6e81-49a8-bae1-84e87f422046 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:23.840866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-418008e0-6e81-49a8-bae1-84e87f422046 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:23.841946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-418008e0-6e81-49a8-bae1-84e87f422046 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:23.842956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-418008e0-6e81-49a8-bae1-84e87f422046 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:23.843744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-418008e0-6e81-49a8-bae1-84e87f422046 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:24.358270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-418008e0-6e81-49a8-bae1-84e87f422046 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:24.368180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-418008e0-6e81-49a8-bae1-84e87f422046 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:24.370409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-418008e0-6e81-49a8-bae1-84e87f422046 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:24.372134 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-418008e0-6e81-49a8-bae1-84e87f422046 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1409 microversion: 2.25 time: 0.545295 Jul 26 14:08:24.372968 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 531/1148] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:08:23 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1409 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:08:24.392635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7bbecf32-f376-4578-a975-6513a86fcf11 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:24.393627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7bbecf32-f376-4578-a975-6513a86fcf11 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:24.414500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bbecf32-f376-4578-a975-6513a86fcf11 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:24.414961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bbecf32-f376-4578-a975-6513a86fcf11 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:24.416812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bbecf32-f376-4578-a975-6513a86fcf11 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:24.417273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bbecf32-f376-4578-a975-6513a86fcf11 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:24.887023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7bbecf32-f376-4578-a975-6513a86fcf11 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:24.905270 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7bbecf32-f376-4578-a975-6513a86fcf11 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1318 microversion: 2.1 time: 0.530703 Jul 26 14:08:24.907527 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 532/1149] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:24 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:24.913776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6355ecda-a374-4463-82d9-814124480ed5 tempest-ListImagesTestJSON-1835623346 tempest-ListImagesTestJSON-1835623346-project] Calling method '.version_select at 0x7f8787ed83a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:25.035455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6355ecda-a374-4463-82d9-814124480ed5 tempest-ListImagesTestJSON-1835623346 tempest-ListImagesTestJSON-1835623346-project] 10.222.0.70 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.124617 Jul 26 14:08:25.036837 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 533/1150] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Jul 26 14:08:24 2022] GET /compute/v2.1/images => generated 445 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:25.060856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7955fd74-8aec-4a3b-b414-b7f8212c11f6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:25.061491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7955fd74-8aec-4a3b-b414-b7f8212c11f6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:25.083228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7955fd74-8aec-4a3b-b414-b7f8212c11f6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:25.083699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7955fd74-8aec-4a3b-b414-b7f8212c11f6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:25.084517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7955fd74-8aec-4a3b-b414-b7f8212c11f6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:25.084959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7955fd74-8aec-4a3b-b414-b7f8212c11f6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:25.437597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7955fd74-8aec-4a3b-b414-b7f8212c11f6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:25.451393 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7955fd74-8aec-4a3b-b414-b7f8212c11f6 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 0.406596 Jul 26 14:08:25.452452 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 534/1151] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:25 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:25.458165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce66b503-dfb7-48bd-a61e-ee4eb1331b5e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:25.460804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce66b503-dfb7-48bd-a61e-ee4eb1331b5e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:25.485001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce66b503-dfb7-48bd-a61e-ee4eb1331b5e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:25.486774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce66b503-dfb7-48bd-a61e-ee4eb1331b5e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:25.488004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce66b503-dfb7-48bd-a61e-ee4eb1331b5e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:25.490102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce66b503-dfb7-48bd-a61e-ee4eb1331b5e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:25.761767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ce66b503-dfb7-48bd-a61e-ee4eb1331b5e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:25.776487 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce66b503-dfb7-48bd-a61e-ee4eb1331b5e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 200 len: 1317 microversion: 2.1 time: 0.322538 Jul 26 14:08:25.777067 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 535/1152] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:25 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:25.796280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b68de88d-a216-4839-b281-7b2af984a363 req-a78f506f-9f57-4103-b65e-90f032e1bf8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c2ebb15-8fe0-418b-9bff-62df9ad91d33", "tag": "be2577e0-b145-4d72-a27c-d8bc65019933"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:25.813207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b68de88d-a216-4839-b281-7b2af984a363 req-a78f506f-9f57-4103-b65e-90f032e1bf8d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:25.813916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b68de88d-a216-4839-b281-7b2af984a363 req-a78f506f-9f57-4103-b65e-90f032e1bf8d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:25.830571 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b68de88d-a216-4839-b281-7b2af984a363 req-a78f506f-9f57-4103-b65e-90f032e1bf8d service nova] Creating event network-changed:be2577e0-b145-4d72-a27c-d8bc65019933 for instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 on n-h2-833090-9 Jul 26 14:08:25.849555 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b68de88d-a216-4839-b281-7b2af984a363 req-a78f506f-9f57-4103-b65e-90f032e1bf8d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070266 Jul 26 14:08:25.852500 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 536/1153] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:25.859350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2ed9c3be-bb31-45fa-8b67-7da2fa4537ec tempest-ListImagesTestJSON-1835623346 tempest-ListImagesTestJSON-1835623346-project] Calling method '.version_select at 0x7f8787f3f0d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:25.987530 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2ed9c3be-bb31-45fa-8b67-7da2fa4537ec tempest-ListImagesTestJSON-1835623346 tempest-ListImagesTestJSON-1835623346-project] 10.222.0.70 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.133483 Jul 26 14:08:25.992943 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 537/1154] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:08:25 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:26.004345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-31765fe3-e880-4fc2-ab1a-1542aad3c76e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:26.005307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-31765fe3-e880-4fc2-ab1a-1542aad3c76e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:26.029262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31765fe3-e880-4fc2-ab1a-1542aad3c76e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.029728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31765fe3-e880-4fc2-ab1a-1542aad3c76e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.030545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31765fe3-e880-4fc2-ab1a-1542aad3c76e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.035343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31765fe3-e880-4fc2-ab1a-1542aad3c76e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.260021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b84941cd-9fbc-475f-ac66-2dcc8bd8de87 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:08:26.261727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Neutron security group b84941cd-9fbc-475f-ac66-2dcc8bd8de87 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:08:26.262796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.security_groups [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Security Group ID b84941cd-9fbc-475f-ac66-2dcc8bd8de87 does not exist {{(pid=119479) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 26 14:08:26.267562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31765fe3-e880-4fc2-ab1a-1542aad3c76e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:26.279492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31765fe3-e880-4fc2-ab1a-1542aad3c76e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:26.281629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31765fe3-e880-4fc2-ab1a-1542aad3c76e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:26.282634 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-31765fe3-e880-4fc2-ab1a-1542aad3c76e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1605 microversion: 2.25 time: 0.288090 Jul 26 14:08:26.283365 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 538/1155] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:08:25 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1605 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:08:26.302420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b84941cd-9fbc-475f-ac66-2dcc8bd8de87 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:08:26.302667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-91d1a200-f8a3-4613-b344-9454dd314ceb req-1b6bef5c-cdb1-4f44-8385-a494cfc70166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34089008-8d17-4f4a-a989-57f47959ae93", "name": "network-vif-plugged", "status": "completed", "tag": "4b363e20-4144-4452-a88b-446bd69f43ec"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:26.303031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Neutron security group b84941cd-9fbc-475f-ac66-2dcc8bd8de87 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:08:26.303485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.security_groups [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Security Group ID b84941cd-9fbc-475f-ac66-2dcc8bd8de87 does not exist {{(pid=119479) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 26 14:08:26.322457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-91d1a200-f8a3-4613-b344-9454dd314ceb req-1b6bef5c-cdb1-4f44-8385-a494cfc70166 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.322457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-91d1a200-f8a3-4613-b344-9454dd314ceb req-1b6bef5c-cdb1-4f44-8385-a494cfc70166 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.331109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7f685a8-2572-4e9e-8840-540c7d161195 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:08:26.331781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Neutron security group c7f685a8-2572-4e9e-8840-540c7d161195 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:08:26.332260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.security_groups [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Security Group ID c7f685a8-2572-4e9e-8840-540c7d161195 does not exist {{(pid=119479) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 26 14:08:26.348733 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-91d1a200-f8a3-4613-b344-9454dd314ceb req-1b6bef5c-cdb1-4f44-8385-a494cfc70166 service nova] Creating event network-vif-plugged:4b363e20-4144-4452-a88b-446bd69f43ec for instance 34089008-8d17-4f4a-a989-57f47959ae93 on n-h2-833090-9 Jul 26 14:08:26.353993 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-91d1a200-f8a3-4613-b344-9454dd314ceb req-1b6bef5c-cdb1-4f44-8385-a494cfc70166 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058940 Jul 26 14:08:26.354603 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 539/1156] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:26.359004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7f685a8-2572-4e9e-8840-540c7d161195 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:08:26.359606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Neutron security group c7f685a8-2572-4e9e-8840-540c7d161195 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:08:26.360100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.security_groups [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Security Group ID c7f685a8-2572-4e9e-8840-540c7d161195 does not exist {{(pid=119479) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Jul 26 14:08:26.361846 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-720b216c-ebde-4221-9855-842fa160f125 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] 10.222.0.70 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9953 microversion: 2.1 time: 5.563539 Jul 26 14:08:26.362436 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 618/1157] 10.222.0.70 () {58 vars in 1191 bytes} [Tue Jul 26 14:08:20 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9953 bytes in 5565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:26.363627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1a4a4a9b-cf5d-4502-96c9-0e7ffedaadd0 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:26.364517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1a4a4a9b-cf5d-4502-96c9-0e7ffedaadd0 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:26.368623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d97e6239-cf64-43eb-8465-ff0ab42ac98e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:26.369376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d97e6239-cf64-43eb-8465-ff0ab42ac98e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:26.370978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a4a4a9b-cf5d-4502-96c9-0e7ffedaadd0 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.371446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a4a4a9b-cf5d-4502-96c9-0e7ffedaadd0 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.372656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a4a4a9b-cf5d-4502-96c9-0e7ffedaadd0 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.373269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a4a4a9b-cf5d-4502-96c9-0e7ffedaadd0 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.377504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d97e6239-cf64-43eb-8465-ff0ab42ac98e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.378079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d97e6239-cf64-43eb-8465-ff0ab42ac98e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.378931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d97e6239-cf64-43eb-8465-ff0ab42ac98e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.379594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d97e6239-cf64-43eb-8465-ff0ab42ac98e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.508131 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d97e6239-cf64-43eb-8465-ff0ab42ac98e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.143994 Jul 26 14:08:26.509400 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 619/1158] 10.222.0.70 () {60 vars in 1316 bytes} [Tue Jul 26 14:08:26 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:08:26.515543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d643d599-bdc3-49a2-a3e3-f13d8215116b tempest-SecurityGroupsTestAdminJSON-1328104835 tempest-SecurityGroupsTestAdminJSON-1328104835-project] Calling method '.version_select at 0x7f8787f76e50>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:26.629922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1a4a4a9b-cf5d-4502-96c9-0e7ffedaadd0 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:26.639239 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1a4a4a9b-cf5d-4502-96c9-0e7ffedaadd0 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1318 microversion: 2.1 time: 0.280185 Jul 26 14:08:26.653518 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 540/1159] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:26 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:26.660234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-98f7cda9-3a54-4da6-81f8-bbd8d7b6b41f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:26.661983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-98f7cda9-3a54-4da6-81f8-bbd8d7b6b41f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:26.674816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-98f7cda9-3a54-4da6-81f8-bbd8d7b6b41f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.676144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-98f7cda9-3a54-4da6-81f8-bbd8d7b6b41f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.677496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-98f7cda9-3a54-4da6-81f8-bbd8d7b6b41f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.680629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-98f7cda9-3a54-4da6-81f8-bbd8d7b6b41f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.859674 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d643d599-bdc3-49a2-a3e3-f13d8215116b tempest-SecurityGroupsTestAdminJSON-1328104835 tempest-SecurityGroupsTestAdminJSON-1328104835-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.348501 Jul 26 14:08:26.860506 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 620/1160] 10.222.0.70 () {58 vars in 1191 bytes} [Tue Jul 26 14:08:26 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:26.873662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4e704ffe-30c2-444c-925a-2444be2ac662 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:26.874362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4e704ffe-30c2-444c-925a-2444be2ac662 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:26.883201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e704ffe-30c2-444c-925a-2444be2ac662 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.883866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e704ffe-30c2-444c-925a-2444be2ac662 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.884694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e704ffe-30c2-444c-925a-2444be2ac662 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:26.885355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e704ffe-30c2-444c-925a-2444be2ac662 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:26.912157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-98f7cda9-3a54-4da6-81f8-bbd8d7b6b41f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:26.923302 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-98f7cda9-3a54-4da6-81f8-bbd8d7b6b41f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 0.268094 Jul 26 14:08:26.924441 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 541/1161] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:26 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:26.933282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f10b2cc2-2335-416f-b61f-7168c925b7c7 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Calling method '.version_select at 0x7f8787e71f70>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:27.335285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4e704ffe-30c2-444c-925a-2444be2ac662 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:27.356915 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4e704ffe-30c2-444c-925a-2444be2ac662 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 200 len: 1317 microversion: 2.1 time: 0.494543 Jul 26 14:08:27.357436 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 621/1162] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:26 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:27.503185 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f10b2cc2-2335-416f-b61f-7168c925b7c7 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/24659686-a6ed-4274-9ff2-768f89214bee" status: 202 len: 0 microversion: 2.1 time: 0.577187 Jul 26 14:08:27.503802 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 542/1163] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:08:26 2022] DELETE /compute/v2.1/os-security-groups/24659686-a6ed-4274-9ff2-768f89214bee => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:08:27.515527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-78a6362e-e121-411c-a7fb-8db6702e9947 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] Calling method '.version_select at 0x7f8787e71e50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:27.644352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6de46d63-e430-4508-b2a4-b130907c83f9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] Calling method '.version_select at 0x7f8787f25b80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:27.672410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6de46d63-e430-4508-b2a4-b130907c83f9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:27.672787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6de46d63-e430-4508-b2a4-b130907c83f9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:27.675176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6de46d63-e430-4508-b2a4-b130907c83f9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:27.675788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6de46d63-e430-4508-b2a4-b130907c83f9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:27.711993 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6de46d63-e430-4508-b2a4-b130907c83f9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] 10.222.0.70 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.352848 Jul 26 14:08:27.713519 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 622/1164] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Jul 26 14:08:27 2022] GET /compute/v2.1/limits => generated 511 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:27.727077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-33a7082d-0e76-48f9-b516-0c53a6ece923 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:27.727077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-33a7082d-0e76-48f9-b516-0c53a6ece923 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:27.747226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33a7082d-0e76-48f9-b516-0c53a6ece923 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:27.747774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33a7082d-0e76-48f9-b516-0c53a6ece923 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:27.749453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33a7082d-0e76-48f9-b516-0c53a6ece923 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:27.749940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33a7082d-0e76-48f9-b516-0c53a6ece923 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:28.406388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-33a7082d-0e76-48f9-b516-0c53a6ece923 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:28.421872 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-33a7082d-0e76-48f9-b516-0c53a6ece923 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1318 microversion: 2.1 time: 0.706381 Jul 26 14:08:28.423327 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 623/1165] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:27 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:28.428468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9709e87-2a1e-44f0-a250-529afdea12d9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1485443875", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:28.469024 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-78a6362e-e121-411c-a7fb-8db6702e9947 tempest-SecurityGroupsTestAdminJSON-1933266306 tempest-SecurityGroupsTestAdminJSON-1933266306-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/2fa90165-ac03-410b-bb06-a1d3af392d05" status: 202 len: 0 microversion: 2.1 time: 0.958063 Jul 26 14:08:28.470637 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 543/1166] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:08:27 2022] DELETE /compute/v2.1/os-security-groups/2fa90165-ac03-410b-bb06-a1d3af392d05 => generated 0 bytes in 961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:08:28.479070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-776ee129-62c1-4eca-8710-0d97a523a914 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787ee8280>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:28.524268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-b9709e87-2a1e-44f0-a250-529afdea12d9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:08:28.556568 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-776ee129-62c1-4eca-8710-0d97a523a914 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/d15a4749-f78a-45eb-876f-267a338ef6e3" status: 200 len: 661 microversion: 2.1 time: 0.083957 Jul 26 14:08:28.558242 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 544/1167] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:08:28 2022] GET /compute/v2.1/images/d15a4749-f78a-45eb-876f-267a338ef6e3 => generated 661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:28.566186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5fed646b-76bb-4dd0-b36e-009d73bc3547 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:28.567268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5fed646b-76bb-4dd0-b36e-009d73bc3547 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:28.579294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fed646b-76bb-4dd0-b36e-009d73bc3547 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:28.580261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fed646b-76bb-4dd0-b36e-009d73bc3547 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:28.581889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fed646b-76bb-4dd0-b36e-009d73bc3547 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:28.582859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fed646b-76bb-4dd0-b36e-009d73bc3547 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:28.882655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5fed646b-76bb-4dd0-b36e-009d73bc3547 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:28.886165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:28.898497 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5fed646b-76bb-4dd0-b36e-009d73bc3547 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 0.337812 Jul 26 14:08:28.899096 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 545/1168] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:28 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:28.906613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d401d0f-1fe1-4419-a60a-9f5043910b52 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:28.908394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d401d0f-1fe1-4419-a60a-9f5043910b52 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:28.941606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d401d0f-1fe1-4419-a60a-9f5043910b52 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:28.942073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d401d0f-1fe1-4419-a60a-9f5043910b52 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:28.942880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d401d0f-1fe1-4419-a60a-9f5043910b52 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:28.943546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d401d0f-1fe1-4419-a60a-9f5043910b52 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:29.018502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-b9709e87-2a1e-44f0-a250-529afdea12d9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] Getting quotas for project 76189dd2ce5f4365b9fcd9de8edb36c0. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:29.029855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-b9709e87-2a1e-44f0-a250-529afdea12d9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] Getting quotas for user c021a53deb184a54a389367a9483f30c and project 76189dd2ce5f4365b9fcd9de8edb36c0. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:29.062604 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-b9709e87-2a1e-44f0-a250-529afdea12d9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9709e87-2a1e-44f0-a250-529afdea12d9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] Request method failure captured: Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 1752 Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VbrtUGrllQra6kR3fzPPVnFXybAfQTqwDBmnhAX7QXRm9w58nYMIGRKPQu1U-AgOv9MwOPiRbBktJnYxL0fS9vLhIfPdgyhN8Fuu-dWnYI79RC7g2aa4X1Phh4RgNqkZrjYRyjljnEBKNFpfm_kOky8ReXktsCpp_QuKW7Vf4tugE Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 76189dd2ce5f4365b9fcd9de8edb36c0 Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1161655891 Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/76189dd2ce5f4365b9fcd9de8edb36c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/76189dd2ce5f4365b9fcd9de8edb36c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_76189dd2ce5f4365b9fcd9de8edb36c0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/76189dd2ce5f4365b9fcd9de8edb36c0"}]}] Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1161655891 Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 76189dd2ce5f4365b9fcd9de8edb36c0 Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1161655891 Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c021a53deb184a54a389367a9483f30c Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1485443875", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:08:29.065898 n-d-833090-9 devstack@n-api.service[119479]: exception: Maximum number of metadata items exceeds 128 Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1485443875', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:29.068745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9709e87-2a1e-44f0-a250-529afdea12d9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b9709e87-2a1e-44f0-a250-529afdea12d9 tempest-AbsoluteLimitsNegativeTestJSON-1161655891 tempest-AbsoluteLimitsNegativeTestJSON-1161655891-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.643245 Jul 26 14:08:29.071690 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 624/1169] 10.222.0.70 () {60 vars in 1148 bytes} [Tue Jul 26 14:08:28 2022] POST /compute/v2.1/servers => generated 87 bytes in 644 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:08:29.074421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6ae93c08-c7d9-4019-8cbe-d184a7de8a68 tempest-SecurityGroupsTestAdminJSON-1328104835 tempest-SecurityGroupsTestAdminJSON-1328104835-project] Calling method '.version_select at 0x7f8787f8e1f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:29.206992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0d401d0f-1fe1-4419-a60a-9f5043910b52 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:29.222378 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d401d0f-1fe1-4419-a60a-9f5043910b52 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 200 len: 1467 microversion: 2.1 time: 0.322007 Jul 26 14:08:29.225677 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 546/1170] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:28 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 1467 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:29.234043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-14988ce9-bb1c-470a-8e04-f8f6562188c4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787e71700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:29.308854 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-14988ce9-bb1c-470a-8e04-f8f6562188c4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/d15a4749-f78a-45eb-876f-267a338ef6e3" status: 200 len: 661 microversion: 2.1 time: 0.082062 Jul 26 14:08:29.315257 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 547/1171] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:08:29 2022] GET /compute/v2.1/images/d15a4749-f78a-45eb-876f-267a338ef6e3 => generated 661 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:29.323496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-6c71b892-4735-4a43-ad98-ab264a28768a req-073880db-d071-4a92-ae76-2632a6d7f395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cbff42-6659-4317-bf61-7f5f2aaaa942", "tag": "a17e340d-a5eb-45cb-9fb6-171e51e54f5b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:29.354001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6c71b892-4735-4a43-ad98-ab264a28768a req-073880db-d071-4a92-ae76-2632a6d7f395 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:29.354459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6c71b892-4735-4a43-ad98-ab264a28768a req-073880db-d071-4a92-ae76-2632a6d7f395 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:29.393228 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-6c71b892-4735-4a43-ad98-ab264a28768a req-073880db-d071-4a92-ae76-2632a6d7f395 service nova] Creating event network-changed:a17e340d-a5eb-45cb-9fb6-171e51e54f5b for instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 on n-h1-833090-9 Jul 26 14:08:29.405046 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-6c71b892-4735-4a43-ad98-ab264a28768a req-073880db-d071-4a92-ae76-2632a6d7f395 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085838 Jul 26 14:08:29.405700 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 548/1172] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:29.611655 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6ae93c08-c7d9-4019-8cbe-d184a7de8a68 tempest-SecurityGroupsTestAdminJSON-1328104835 tempest-SecurityGroupsTestAdminJSON-1328104835-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/16576269-e9da-44f0-babc-7fbf15df6a6d" status: 202 len: 0 microversion: 2.1 time: 0.542194 Jul 26 14:08:29.612271 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 625/1173] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:08:29 2022] DELETE /compute/v2.1/os-security-groups/16576269-e9da-44f0-babc-7fbf15df6a6d => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:08:29.617571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db5e3320-6ee0-4c0a-bee9-eadfce6cdea2 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:29.618197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-db5e3320-6ee0-4c0a-bee9-eadfce6cdea2 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:29.626831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db5e3320-6ee0-4c0a-bee9-eadfce6cdea2 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:29.627279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db5e3320-6ee0-4c0a-bee9-eadfce6cdea2 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:29.628089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db5e3320-6ee0-4c0a-bee9-eadfce6cdea2 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:29.628529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db5e3320-6ee0-4c0a-bee9-eadfce6cdea2 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:29.889042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:29.889773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-db5e3320-6ee0-4c0a-bee9-eadfce6cdea2 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:29.898146 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db5e3320-6ee0-4c0a-bee9-eadfce6cdea2 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1318 microversion: 2.1 time: 0.284431 Jul 26 14:08:29.900729 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 626/1174] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:29 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:29.913290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a083727e-26b4-4bdb-8a3b-2ea6f3185b33 tempest-SecurityGroupsTestAdminJSON-1328104835 tempest-SecurityGroupsTestAdminJSON-1328104835-project] Calling method '.version_select at 0x7f8787f760d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:29.923872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-10715080-8ab3-4387-a6ab-c4a345ef3181 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:29.925007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-10715080-8ab3-4387-a6ab-c4a345ef3181 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:29.934492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10715080-8ab3-4387-a6ab-c4a345ef3181 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:29.935335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10715080-8ab3-4387-a6ab-c4a345ef3181 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:29.936910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10715080-8ab3-4387-a6ab-c4a345ef3181 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:29.937516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10715080-8ab3-4387-a6ab-c4a345ef3181 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:29.945268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=9 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:30.578874 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a083727e-26b4-4bdb-8a3b-2ea6f3185b33 tempest-SecurityGroupsTestAdminJSON-1328104835 tempest-SecurityGroupsTestAdminJSON-1328104835-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/898ccdd6-eb41-46fe-8c27-05bdc59c65a4" status: 202 len: 0 microversion: 2.1 time: 0.675545 Jul 26 14:08:30.579433 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 627/1175] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:08:29 2022] DELETE /compute/v2.1/os-security-groups/898ccdd6-eb41-46fe-8c27-05bdc59c65a4 => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:08:30.716819 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-10715080-8ab3-4387-a6ab-c4a345ef3181 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 200 len: 1618 microversion: 2.1 time: 1.303021 Jul 26 14:08:30.719746 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 549/1176] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:29 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 1618 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:30.737590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71428250-bd95-4463-ac2d-905bec89f976 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:30.739608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-71428250-bd95-4463-ac2d-905bec89f976 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:30.764169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71428250-bd95-4463-ac2d-905bec89f976 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:30.765462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71428250-bd95-4463-ac2d-905bec89f976 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:30.766887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71428250-bd95-4463-ac2d-905bec89f976 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:30.770376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71428250-bd95-4463-ac2d-905bec89f976 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:31.042950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-71428250-bd95-4463-ac2d-905bec89f976 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:31.056357 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-71428250-bd95-4463-ac2d-905bec89f976 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 0.334087 Jul 26 14:08:31.057826 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 550/1177] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:30 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:31.069391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-65e167f7-d39a-4dca-ac52-0d4d13d45846 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Action: 'create', calling method: .version_select at 0x7f8794b6c670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2100256631", "policies": ["affinity"]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:31.072425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4af2bec0-ef73-4103-9c9d-149aa7d491f7 req-6c2e9fdd-b798-4540-8959-56f7bf00ec9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2ebb15-8fe0-418b-9bff-62df9ad91d33", "name": "network-vif-plugged", "status": "completed", "tag": "be2577e0-b145-4d72-a27c-d8bc65019933"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:31.091120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4af2bec0-ef73-4103-9c9d-149aa7d491f7 req-6c2e9fdd-b798-4540-8959-56f7bf00ec9e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:31.092331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4af2bec0-ef73-4103-9c9d-149aa7d491f7 req-6c2e9fdd-b798-4540-8959-56f7bf00ec9e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:31.100584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-65e167f7-d39a-4dca-ac52-0d4d13d45846 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:31.107584 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4af2bec0-ef73-4103-9c9d-149aa7d491f7 req-6c2e9fdd-b798-4540-8959-56f7bf00ec9e service nova] Creating event network-vif-plugged:be2577e0-b145-4d72-a27c-d8bc65019933 for instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 on n-h2-833090-9 Jul 26 14:08:31.115089 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4af2bec0-ef73-4103-9c9d-149aa7d491f7 req-6c2e9fdd-b798-4540-8959-56f7bf00ec9e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.533257 Jul 26 14:08:31.117779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-65e167f7-d39a-4dca-ac52-0d4d13d45846 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:31.121405 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 628/1178] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:31.160209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2aec5cbb-3738-4ef5-8238-17038ecc048c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:31.172702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2aec5cbb-3738-4ef5-8238-17038ecc048c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:31.200408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-65e167f7-d39a-4dca-ac52-0d4d13d45846 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:31.206008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aec5cbb-3738-4ef5-8238-17038ecc048c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:31.206835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aec5cbb-3738-4ef5-8238-17038ecc048c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:31.208265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aec5cbb-3738-4ef5-8238-17038ecc048c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:31.208932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-65e167f7-d39a-4dca-ac52-0d4d13d45846 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:31.214850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:31.217156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aec5cbb-3738-4ef5-8238-17038ecc048c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:31.235109 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-65e167f7-d39a-4dca-ac52-0d4d13d45846 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.175500 Jul 26 14:08:31.249861 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 551/1179] 10.222.0.70 () {60 vars in 1174 bytes} [Tue Jul 26 14:08:31 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:31.433020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1ddbb5b9-9cd1-4d97-b29b-e95ac8d98443 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787eee160>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:31.496201 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1ddbb5b9-9cd1-4d97-b29b-e95ac8d98443 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/9d5cdc96-366f-4d0d-b009-7ef2fb5172dc" status: 200 len: 661 microversion: 2.1 time: 0.067884 Jul 26 14:08:31.497213 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 552/1180] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:08:31 2022] GET /compute/v2.1/images/9d5cdc96-366f-4d0d-b009-7ef2fb5172dc => generated 661 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:31.519222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2119742001", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f6dd8340-f728-4215-9479-c6bcde1c3831"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:31.607496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2aec5cbb-3738-4ef5-8238-17038ecc048c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:31.610412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:08:31.623249 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2aec5cbb-3738-4ef5-8238-17038ecc048c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1318 microversion: 2.1 time: 0.485638 Jul 26 14:08:31.640912 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 629/1181] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:31 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:31.654825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85bc036c-2f12-4d9c-b3ba-40a6bd18a90d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787f99430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:31.719690 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85bc036c-2f12-4d9c-b3ba-40a6bd18a90d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/9d5cdc96-366f-4d0d-b009-7ef2fb5172dc" status: 200 len: 661 microversion: 2.1 time: 0.076088 Jul 26 14:08:31.720318 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 630/1182] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:08:31 2022] GET /compute/v2.1/images/9d5cdc96-366f-4d0d-b009-7ef2fb5172dc => generated 661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:32.081515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57a07efa-f386-45f4-bdc2-2869075cd41a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:32.081515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-57a07efa-f386-45f4-bdc2-2869075cd41a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:32.094842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57a07efa-f386-45f4-bdc2-2869075cd41a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:32.095316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57a07efa-f386-45f4-bdc2-2869075cd41a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:32.098620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57a07efa-f386-45f4-bdc2-2869075cd41a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:32.104179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57a07efa-f386-45f4-bdc2-2869075cd41a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:32.176540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:08:32.177158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:08:32.177475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:08:32.178066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:08:32.178658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:08:32.227348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:32.229048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:32.232074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:32.232835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:32.265435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:32.272281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:32.294702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Going to run 2 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:08:32.299090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: d1c18346-82e5-42e8-82cc-b82ac00dea9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:08:32.351774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119478) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 26 14:08:32.409395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:32.431930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:32.531683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:32.544514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:32.557753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-57a07efa-f386-45f4-bdc2-2869075cd41a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:32.572292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=d1c18346-82e5-42e8-82cc-b82ac00dea9c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:08:32.572641 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57a07efa-f386-45f4-bdc2-2869075cd41a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 0.496326 Jul 26 14:08:32.575635 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 631/1183] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:32 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:08:32.655436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-91001aab-0203-44ef-8a3f-8d6b3766a520 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:32.665692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:32.672641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-91001aab-0203-44ef-8a3f-8d6b3766a520 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:32.673867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:32.703097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91001aab-0203-44ef-8a3f-8d6b3766a520 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:32.703810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91001aab-0203-44ef-8a3f-8d6b3766a520 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:32.729852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91001aab-0203-44ef-8a3f-8d6b3766a520 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:32.730617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91001aab-0203-44ef-8a3f-8d6b3766a520 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:32.806172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:32.815972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:32.895216 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-37865552-56b0-4a47-8b6c-2bf54fd82912 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.396801 Jul 26 14:08:32.897772 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 553/1184] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:08:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 1400 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 26 14:08:32.929563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ecc7af00-7b1e-4ea4-a014-c4ff5b95f301 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:32.968427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ecc7af00-7b1e-4ea4-a014-c4ff5b95f301 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:32.969668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ecc7af00-7b1e-4ea4-a014-c4ff5b95f301 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Searching by: {'deleted': False, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:08:33.029306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecc7af00-7b1e-4ea4-a014-c4ff5b95f301 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:33.030672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecc7af00-7b1e-4ea4-a014-c4ff5b95f301 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:33.034375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecc7af00-7b1e-4ea4-a014-c4ff5b95f301 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:33.038481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecc7af00-7b1e-4ea4-a014-c4ff5b95f301 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:33.392204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-ecc7af00-7b1e-4ea4-a014-c4ff5b95f301 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:08:33.522484 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ecc7af00-7b1e-4ea4-a014-c4ff5b95f301 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.613817 Jul 26 14:08:33.528537 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 554/1185] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:08:32 2022] GET /compute/v2.1/servers => generated 1004 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:33.564089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ef8bf65-8101-44b8-851f-68bf0c0b0932 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:33.564983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4ef8bf65-8101-44b8-851f-68bf0c0b0932 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:33.812579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-91001aab-0203-44ef-8a3f-8d6b3766a520 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:33.837118 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-91001aab-0203-44ef-8a3f-8d6b3766a520 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1318 microversion: 2.1 time: 1.190932 Jul 26 14:08:33.865374 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 632/1186] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:32 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1318 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:33.874268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b212c648-517f-466f-bc4f-cb5c6370054b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:33.875769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b212c648-517f-466f-bc4f-cb5c6370054b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:33.886023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b212c648-517f-466f-bc4f-cb5c6370054b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:33.886590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b212c648-517f-466f-bc4f-cb5c6370054b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:33.888109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b212c648-517f-466f-bc4f-cb5c6370054b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:33.889031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b212c648-517f-466f-bc4f-cb5c6370054b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:33.941066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ef8bf65-8101-44b8-851f-68bf0c0b0932 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:33.962953 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ef8bf65-8101-44b8-851f-68bf0c0b0932 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1219 microversion: 2.1 time: 0.415087 Jul 26 14:08:33.964489 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 555/1187] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:33 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1219 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:34.001842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-18c856e7-4142-4e2c-ab47-5082df45b0cd tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787eee5e0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:34.079380 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-18c856e7-4142-4e2c-ab47-5082df45b0cd tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/7fb8374a-0e04-4130-919c-418f0eb010b7" status: 200 len: 660 microversion: 2.1 time: 0.108872 Jul 26 14:08:34.080451 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 556/1188] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:08:33 2022] GET /compute/v2.1/images/7fb8374a-0e04-4130-919c-418f0eb010b7 => generated 660 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:34.104528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1466fb18-484d-4b1d-8aa9-8a2a92fdaf52 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87947320d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:34.193290 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1466fb18-484d-4b1d-8aa9-8a2a92fdaf52 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/7fb8374a-0e04-4130-919c-418f0eb010b7" status: 200 len: 660 microversion: 2.1 time: 0.102559 Jul 26 14:08:34.195060 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 557/1189] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:08:34 2022] GET /compute/v2.1/images/7fb8374a-0e04-4130-919c-418f0eb010b7 => generated 660 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:08:34.498163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1258437097", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:34.597064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:08:34.943010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b212c648-517f-466f-bc4f-cb5c6370054b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:34.953630 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b212c648-517f-466f-bc4f-cb5c6370054b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 1.086504 Jul 26 14:08:34.965481 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 633/1190] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:33 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:34.977295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0feafb04-d5d8-4332-bf8e-372d87df1642 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:34.978119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0feafb04-d5d8-4332-bf8e-372d87df1642 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:34.988840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0feafb04-d5d8-4332-bf8e-372d87df1642 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:34.989646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0feafb04-d5d8-4332-bf8e-372d87df1642 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:34.991546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0feafb04-d5d8-4332-bf8e-372d87df1642 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:34.993090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0feafb04-d5d8-4332-bf8e-372d87df1642 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:35.004573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:35.655900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:08:35.656435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:08:35.658978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:08:35.659529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:08:35.660487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:08:35.693423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:35.694227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:35.695600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:35.696325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:35.726792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Getting quotas for project 808a7de5ab4d4088be3f5ea8e46c89c0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:35.737002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Getting quotas for user 0ee81280d69849688f68653a7a985805 and project 808a7de5ab4d4088be3f5ea8e46c89c0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:35.759281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:08:35.764808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:08:35.798787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0feafb04-d5d8-4332-bf8e-372d87df1642 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:35.811493 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0feafb04-d5d8-4332-bf8e-372d87df1642 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1508 microversion: 2.1 time: 0.844128 Jul 26 14:08:35.832202 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 634/1191] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:34 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1508 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:35.842394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-370f98e9-f627-4123-b68d-aa2f2fce55b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:35.843012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-370f98e9-f627-4123-b68d-aa2f2fce55b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:35.865780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-370f98e9-f627-4123-b68d-aa2f2fce55b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:35.866662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-370f98e9-f627-4123-b68d-aa2f2fce55b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:35.872963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-370f98e9-f627-4123-b68d-aa2f2fce55b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:35.873673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-370f98e9-f627-4123-b68d-aa2f2fce55b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:35.908903 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8da053bb-9d84-4d87-bce6-f4fe76580a61 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414246 Jul 26 14:08:35.916952 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 558/1192] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:08:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:08:35.940429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4386bde5-227c-46b6-8ced-558ade3d05dd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:35.942892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4386bde5-227c-46b6-8ced-558ade3d05dd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:35.966724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4386bde5-227c-46b6-8ced-558ade3d05dd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:35.970647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4386bde5-227c-46b6-8ced-558ade3d05dd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:35.972429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4386bde5-227c-46b6-8ced-558ade3d05dd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:35.973224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4386bde5-227c-46b6-8ced-558ade3d05dd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:36.114504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-370f98e9-f627-4123-b68d-aa2f2fce55b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:36.131513 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-370f98e9-f627-4123-b68d-aa2f2fce55b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1271 microversion: 2.1 time: 0.297468 Jul 26 14:08:36.132163 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 635/1193] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:35 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1271 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:36.142426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a768c693-bd2c-4c22-b780-a4fc699b4097 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:36.146867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a768c693-bd2c-4c22-b780-a4fc699b4097 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:36.174412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a768c693-bd2c-4c22-b780-a4fc699b4097 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:36.174887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a768c693-bd2c-4c22-b780-a4fc699b4097 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:36.179062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a768c693-bd2c-4c22-b780-a4fc699b4097 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:36.179567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a768c693-bd2c-4c22-b780-a4fc699b4097 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:36.783864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4386bde5-227c-46b6-8ced-558ade3d05dd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:36.802841 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4386bde5-227c-46b6-8ced-558ade3d05dd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1508 microversion: 2.1 time: 0.881230 Jul 26 14:08:36.804127 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 559/1194] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:35 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1508 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:36.806828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a768c693-bd2c-4c22-b780-a4fc699b4097 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:36.832918 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a768c693-bd2c-4c22-b780-a4fc699b4097 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 0.698715 Jul 26 14:08:36.834807 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 636/1195] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:36 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:36.859181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1255606363", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:36.976250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:08:37.073803 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1eb239e5-52b5-4f95-9585-7389853be767 tempest-TenantUsagesNegativeTestJSON-801822467 tempest-TenantUsagesNegativeTestJSON-801822467-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-25T14%3A08%3A36.054958&end=2022-07-27T14%3A08%3A36.054958" status: 404 len: 112 microversion: - time: 0.255031 Jul 26 14:08:37.074338 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 560/1196] 10.222.0.70 () {58 vars in 1316 bytes} [Tue Jul 26 14:08:36 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-25T14%3A08%3A36.054958&end=2022-07-27T14%3A08%3A36.054958 => generated 112 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 14:08:37.092617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e4720ae5-8a56-4027-ace1-176c88dad706 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:37.099638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e4720ae5-8a56-4027-ace1-176c88dad706 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:37.104938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:37.113101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4720ae5-8a56-4027-ace1-176c88dad706 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:37.113969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4720ae5-8a56-4027-ace1-176c88dad706 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:37.116144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4720ae5-8a56-4027-ace1-176c88dad706 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:37.116860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4720ae5-8a56-4027-ace1-176c88dad706 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:37.239305 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e4720ae5-8a56-4027-ace1-176c88dad706 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "PUT /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1080 microversion: 2.1 time: 0.163754 Jul 26 14:08:37.253793 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 561/1197] 10.222.0.70 () {60 vars in 1256 bytes} [Tue Jul 26 14:08:37 2022] PUT /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1080 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:37.262370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-234c0a68-3533-40fa-bc0c-a6c9549ed48e tempest-TenantUsagesNegativeTestJSON-801822467 tempest-TenantUsagesNegativeTestJSON-801822467-project-admin] Calling method '.version_select at 0x7f8787d79280>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:37.271389 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-234c0a68-3533-40fa-bc0c-a6c9549ed48e tempest-TenantUsagesNegativeTestJSON-801822467 tempest-TenantUsagesNegativeTestJSON-801822467-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-234c0a68-3533-40fa-bc0c-a6c9549ed48e tempest-TenantUsagesNegativeTestJSON-801822467 tempest-TenantUsagesNegativeTestJSON-801822467-project-admin] Request method failure captured: Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-simple-tenant-usage/a4c498269bd649929c4990e8ccf369af?start=2022-07-27T14%3A08%3A36.054958&end=2022-07-25T14%3A08%3A36.054958 HTTP/1.1 Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VjVYGBYWH7_C52ivwv2antslaqoE6b8i5i2Ek47ixAORLo5x0FiJC-qJ0hD5fqUzRlnStohwdQWYeL9iKGbEx1AUMrxCePC5NupGRgltO8uZR6eAzST68NBPWPc8bX-Iy1cVyIOClYGD0kK1J5gZwzcFC4dpPrpQ2zerQ2z6i4zoE Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14310a361162461da4fa4e0fea5d70a5 Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-801822467 Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14310a361162461da4fa4e0fea5d70a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14310a361162461da4fa4e0fea5d70a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14310a361162461da4fa4e0fea5d70a5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14310a361162461da4fa4e0fea5d70a5"}]}] Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-801822467 Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14310a361162461da4fa4e0fea5d70a5 Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-801822467 Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TenantUsagesNegativeTestJSON-801822467-project-admin Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: d3378da347a148d680fb4ebaf02fe499 Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-801822467-project-admin Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid start time. The start time cannot occur after the end time. Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'a4c498269bd649929c4990e8ccf369af'} Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 26 14:08:37.274415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:37.280519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-234c0a68-3533-40fa-bc0c-a6c9549ed48e tempest-TenantUsagesNegativeTestJSON-801822467 tempest-TenantUsagesNegativeTestJSON-801822467-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:37.281656 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-234c0a68-3533-40fa-bc0c-a6c9549ed48e tempest-TenantUsagesNegativeTestJSON-801822467 tempest-TenantUsagesNegativeTestJSON-801822467-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/a4c498269bd649929c4990e8ccf369af?start=2022-07-27T14%3A08%3A36.054958&end=2022-07-25T14%3A08%3A36.054958" status: 400 len: 111 microversion: 2.1 time: 0.025012 Jul 26 14:08:37.283668 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 562/1198] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jul 26 14:08:37 2022] GET /compute/v2.1/os-simple-tenant-usage/a4c498269bd649929c4990e8ccf369af?start=2022-07-27T14%3A08%3A36.054958&end=2022-07-25T14%3A08%3A36.054958 => generated 111 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:08:37.291820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-662a8323-2ddb-4059-be5b-9e35e05d03f2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:37.292822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-662a8323-2ddb-4059-be5b-9e35e05d03f2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:37.306013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-662a8323-2ddb-4059-be5b-9e35e05d03f2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:37.307005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-662a8323-2ddb-4059-be5b-9e35e05d03f2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:37.308288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-662a8323-2ddb-4059-be5b-9e35e05d03f2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:37.309067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-662a8323-2ddb-4059-be5b-9e35e05d03f2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:37.462798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-662a8323-2ddb-4059-be5b-9e35e05d03f2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:37.484096 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-662a8323-2ddb-4059-be5b-9e35e05d03f2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1277 microversion: 2.1 time: 0.199055 Jul 26 14:08:37.488127 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 563/1199] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:37 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:37.496009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cbcf3ca2-87ed-4fdf-a3a0-dea774ea6491 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:37.497375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cbcf3ca2-87ed-4fdf-a3a0-dea774ea6491 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:37.511363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbcf3ca2-87ed-4fdf-a3a0-dea774ea6491 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:37.513000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbcf3ca2-87ed-4fdf-a3a0-dea774ea6491 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:37.514593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbcf3ca2-87ed-4fdf-a3a0-dea774ea6491 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:37.515513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbcf3ca2-87ed-4fdf-a3a0-dea774ea6491 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:37.585935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:08:37.586535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:08:37.587039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:08:37.587733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:08:37.588536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:08:37.618947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:37.619404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:37.620308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:37.620934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:37.663093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Getting quotas for project 808a7de5ab4d4088be3f5ea8e46c89c0. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:37.669464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Getting quotas for user 0ee81280d69849688f68653a7a985805 and project 808a7de5ab4d4088be3f5ea8e46c89c0. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:37.704801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:08:37.707283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:08:37.831329 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63fa9ecd-482a-425f-9a1c-74e538b54e8f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993362 Jul 26 14:08:37.832896 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 637/1200] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:08:38.126770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21ecd6ea-a94f-4e78-b0ff-df3ab7beb7ad tempest-TenantUsagesNegativeTestJSON-262979630 tempest-TenantUsagesNegativeTestJSON-262979630-project] Calling method '.version_select at 0x7f8787f76940>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:38.136620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-21ecd6ea-a94f-4e78-b0ff-df3ab7beb7ad tempest-TenantUsagesNegativeTestJSON-262979630 tempest-TenantUsagesNegativeTestJSON-262979630-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'c583a499de134cad8ad0a2d9f44e9556', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4c498269bd649929c4990e8ccf369af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21ecd6ea-a94f-4e78-b0ff-df3ab7beb7ad tempest-TenantUsagesNegativeTestJSON-262979630 tempest-TenantUsagesNegativeTestJSON-262979630-project] Request method failure captured: Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T14%3A08%3A36.054958&end=2022-07-27T14%3A08%3A36.054958&detailed=1 HTTP/1.1 Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ViIzhyQfFJEBmLpCrPHuYTlR3lFA1JE1_DYu9sgJRkG-mU0vfRwVED89YsIl-vwDSooT3xRE8tEmKTf6ljiP4BE9YUsuXWkX-sf0qSpCfHI8fBQyOcnFJ4M0Mh4zUXpppU3TpEk5LoBLPXvaCpp31E-7BnN5nOINP6Ja_cQ9VUuv4 Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a4c498269bd649929c4990e8ccf369af Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-262979630 Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a4c498269bd649929c4990e8ccf369af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a4c498269bd649929c4990e8ccf369af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a4c498269bd649929c4990e8ccf369af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a4c498269bd649929c4990e8ccf369af"}]}] Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-262979630 Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a4c498269bd649929c4990e8ccf369af Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-262979630 Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TenantUsagesNegativeTestJSON-262979630-project Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c583a499de134cad8ad0a2d9f44e9556 Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-262979630-project Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: action_args: {} Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:08:38.143112 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 26 14:08:38.149489 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:38.153136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21ecd6ea-a94f-4e78-b0ff-df3ab7beb7ad tempest-TenantUsagesNegativeTestJSON-262979630 tempest-TenantUsagesNegativeTestJSON-262979630-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:38.157560 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-21ecd6ea-a94f-4e78-b0ff-df3ab7beb7ad tempest-TenantUsagesNegativeTestJSON-262979630 tempest-TenantUsagesNegativeTestJSON-262979630-project] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T14%3A08%3A36.054958&end=2022-07-27T14%3A08%3A36.054958&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.321816 Jul 26 14:08:38.159508 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 638/1201] 10.222.0.70 () {58 vars in 1335 bytes} [Tue Jul 26 14:08:37 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T14%3A08%3A36.054958&end=2022-07-27T14%3A08%3A36.054958&detailed=1 => generated 123 bytes in 326 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:08:38.201613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5d654e50-26c3-499b-b68d-5c4254d4a67e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:38.202785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cbcf3ca2-87ed-4fdf-a3a0-dea774ea6491 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:38.208339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5d654e50-26c3-499b-b68d-5c4254d4a67e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:38.225199 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cbcf3ca2-87ed-4fdf-a3a0-dea774ea6491 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1506 microversion: 2.1 time: 0.734941 Jul 26 14:08:38.241167 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 564/1202] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:37 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1506 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:38.266790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-303b0dfe-2a3b-4bb8-9b9c-ccd616513bb1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:38.269533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-303b0dfe-2a3b-4bb8-9b9c-ccd616513bb1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:38.303572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-303b0dfe-2a3b-4bb8-9b9c-ccd616513bb1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:38.326465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-303b0dfe-2a3b-4bb8-9b9c-ccd616513bb1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:38.331193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-303b0dfe-2a3b-4bb8-9b9c-ccd616513bb1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:38.332926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-303b0dfe-2a3b-4bb8-9b9c-ccd616513bb1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:38.686264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5d654e50-26c3-499b-b68d-5c4254d4a67e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:38.698697 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5d654e50-26c3-499b-b68d-5c4254d4a67e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1218 microversion: 2.1 time: 0.537356 Jul 26 14:08:38.699622 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 639/1203] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:38 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1218 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:38.714883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-753f3159-29f1-44d0-8f17-23e143ba5c22 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:38.725730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-753f3159-29f1-44d0-8f17-23e143ba5c22 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:38.735120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-753f3159-29f1-44d0-8f17-23e143ba5c22 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:38.735754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-753f3159-29f1-44d0-8f17-23e143ba5c22 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:38.737026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-753f3159-29f1-44d0-8f17-23e143ba5c22 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:38.737862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-753f3159-29f1-44d0-8f17-23e143ba5c22 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:39.136756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-753f3159-29f1-44d0-8f17-23e143ba5c22 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:39.157562 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-753f3159-29f1-44d0-8f17-23e143ba5c22 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1506 microversion: 2.1 time: 0.450882 Jul 26 14:08:39.168050 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 640/1204] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:38 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:39.188563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f135096-051a-4be2-a718-354858a94aaa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:39.190902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f135096-051a-4be2-a718-354858a94aaa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:39.222050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f135096-051a-4be2-a718-354858a94aaa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:39.222688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f135096-051a-4be2-a718-354858a94aaa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:39.224984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f135096-051a-4be2-a718-354858a94aaa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:39.226440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f135096-051a-4be2-a718-354858a94aaa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:39.514429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-303b0dfe-2a3b-4bb8-9b9c-ccd616513bb1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:39.523761 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-303b0dfe-2a3b-4bb8-9b9c-ccd616513bb1 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 1.280246 Jul 26 14:08:39.530623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f135096-051a-4be2-a718-354858a94aaa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:39.539404 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f135096-051a-4be2-a718-354858a94aaa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1277 microversion: 2.1 time: 0.369565 Jul 26 14:08:39.540001 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 641/1205] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:39 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1277 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:39.542075 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 565/1206] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:38 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:39.548979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:39.559556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:39.583305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:39.584272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:39.585497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:39.586273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:39.728046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4498cff9-5c97-462f-9803-49ddb7462d0d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:39.728932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4498cff9-5c97-462f-9803-49ddb7462d0d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:39.750828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:08:39.751179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:08:39.751666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:08:39.752172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:08:39.752653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:08:39.758456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4498cff9-5c97-462f-9803-49ddb7462d0d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:39.759284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4498cff9-5c97-462f-9803-49ddb7462d0d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:39.760774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4498cff9-5c97-462f-9803-49ddb7462d0d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:39.762457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4498cff9-5c97-462f-9803-49ddb7462d0d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:39.928310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:39.963159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:39.963682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:39.964619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:39.964953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4498cff9-5c97-462f-9803-49ddb7462d0d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:39.965264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:39.985692 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4498cff9-5c97-462f-9803-49ddb7462d0d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1270 microversion: 2.1 time: 0.264137 Jul 26 14:08:39.987062 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 642/1207] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:39 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1270 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:08:40.039084 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8acdb6e5-bae5-4649-8e1d-5caf7e38167c tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "POST /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33/action" status: 202 len: 1112 microversion: 2.1 time: 0.494883 Jul 26 14:08:40.041578 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 566/1208] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:08:39 2022] POST /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33/action => generated 1112 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 14:08:40.060878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af212646-65bb-48b1-aadc-3b4544de8b5e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:40.061834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af212646-65bb-48b1-aadc-3b4544de8b5e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:40.072007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af212646-65bb-48b1-aadc-3b4544de8b5e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:40.076030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af212646-65bb-48b1-aadc-3b4544de8b5e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:40.077883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af212646-65bb-48b1-aadc-3b4544de8b5e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:40.079103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af212646-65bb-48b1-aadc-3b4544de8b5e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:40.575314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4eb5cf4c-0e6f-478e-9440-c34d95e3077a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:40.576526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4eb5cf4c-0e6f-478e-9440-c34d95e3077a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:40.611521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4eb5cf4c-0e6f-478e-9440-c34d95e3077a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:40.612028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4eb5cf4c-0e6f-478e-9440-c34d95e3077a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:40.612863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4eb5cf4c-0e6f-478e-9440-c34d95e3077a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:40.613324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4eb5cf4c-0e6f-478e-9440-c34d95e3077a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:41.404826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af212646-65bb-48b1-aadc-3b4544de8b5e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:41.424283 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af212646-65bb-48b1-aadc-3b4544de8b5e tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 1.368857 Jul 26 14:08:41.426037 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 643/1209] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:40 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:41.434943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2be76f26-eb88-4fc6-90e9-d6cf086820e7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:41.436528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2be76f26-eb88-4fc6-90e9-d6cf086820e7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:41.465085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be76f26-eb88-4fc6-90e9-d6cf086820e7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:41.469856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be76f26-eb88-4fc6-90e9-d6cf086820e7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:41.471385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be76f26-eb88-4fc6-90e9-d6cf086820e7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:41.473111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be76f26-eb88-4fc6-90e9-d6cf086820e7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:41.675451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4eb5cf4c-0e6f-478e-9440-c34d95e3077a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:41.686958 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4eb5cf4c-0e6f-478e-9440-c34d95e3077a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1319 microversion: 2.1 time: 1.119054 Jul 26 14:08:41.707187 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 567/1210] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:40 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1319 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:41.714026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1dc1a529-85f0-4250-8447-cc3e0d4cb493 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:41.715387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1dc1a529-85f0-4250-8447-cc3e0d4cb493 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:41.729224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dc1a529-85f0-4250-8447-cc3e0d4cb493 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:41.730018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dc1a529-85f0-4250-8447-cc3e0d4cb493 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:41.731402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dc1a529-85f0-4250-8447-cc3e0d4cb493 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:41.732151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dc1a529-85f0-4250-8447-cc3e0d4cb493 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:41.964428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1dc1a529-85f0-4250-8447-cc3e0d4cb493 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:42.005278 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1dc1a529-85f0-4250-8447-cc3e0d4cb493 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1276 microversion: 2.1 time: 0.295306 Jul 26 14:08:42.011274 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 568/1211] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:41 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1276 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:42.079618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2be76f26-eb88-4fc6-90e9-d6cf086820e7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:42.097511 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2be76f26-eb88-4fc6-90e9-d6cf086820e7 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 0.669408 Jul 26 14:08:42.098411 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 644/1212] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:41 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:42.478269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-116c49b6-ce6d-4aa3-9605-8f54d7f1a25a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:42.478269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-116c49b6-ce6d-4aa3-9605-8f54d7f1a25a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:42.480075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-116c49b6-ce6d-4aa3-9605-8f54d7f1a25a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:42.487851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-116c49b6-ce6d-4aa3-9605-8f54d7f1a25a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:42.490167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-116c49b6-ce6d-4aa3-9605-8f54d7f1a25a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:42.490656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-116c49b6-ce6d-4aa3-9605-8f54d7f1a25a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:42.584825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:42.718488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0387d66e-9638-472f-a29f-5e052e1d4850 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:42.720379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0387d66e-9638-472f-a29f-5e052e1d4850 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:42.740724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0387d66e-9638-472f-a29f-5e052e1d4850 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:42.743673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0387d66e-9638-472f-a29f-5e052e1d4850 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:42.749642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0387d66e-9638-472f-a29f-5e052e1d4850 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:42.750119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0387d66e-9638-472f-a29f-5e052e1d4850 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:43.130862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-116c49b6-ce6d-4aa3-9605-8f54d7f1a25a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:43.163703 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-116c49b6-ce6d-4aa3-9605-8f54d7f1a25a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 0.713661 Jul 26 14:08:43.177267 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 569/1213] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:42 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:43.193001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55c9f58b-630c-4e99-aa66-26e83e0fe523 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:43.196397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-55c9f58b-630c-4e99-aa66-26e83e0fe523 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:43.219229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c9f58b-630c-4e99-aa66-26e83e0fe523 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:43.219930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c9f58b-630c-4e99-aa66-26e83e0fe523 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:43.221007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c9f58b-630c-4e99-aa66-26e83e0fe523 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:43.221495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c9f58b-630c-4e99-aa66-26e83e0fe523 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:43.452475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-55c9f58b-630c-4e99-aa66-26e83e0fe523 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:43.469189 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-55c9f58b-630c-4e99-aa66-26e83e0fe523 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1276 microversion: 2.1 time: 0.290603 Jul 26 14:08:43.470084 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 570/1214] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:43 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:43.490313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4569f1a3-27b4-479e-9509-50cedb30046c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:43.496394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4569f1a3-27b4-479e-9509-50cedb30046c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:43.516202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4569f1a3-27b4-479e-9509-50cedb30046c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:43.518946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4569f1a3-27b4-479e-9509-50cedb30046c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:43.519905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4569f1a3-27b4-479e-9509-50cedb30046c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:43.520560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4569f1a3-27b4-479e-9509-50cedb30046c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:43.635181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0387d66e-9638-472f-a29f-5e052e1d4850 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:43.652295 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0387d66e-9638-472f-a29f-5e052e1d4850 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1319 microversion: 2.1 time: 0.941198 Jul 26 14:08:43.659710 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 645/1215] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:42 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1319 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:43.928330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4569f1a3-27b4-479e-9509-50cedb30046c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:43.947691 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4569f1a3-27b4-479e-9509-50cedb30046c tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1474 microversion: 2.1 time: 0.474222 Jul 26 14:08:43.948702 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 571/1216] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:43 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1474 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:44.177183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-dec3b679-4d9c-49c6-9987-76291bb5440b req-9eacd6b1-a264-44bc-9027-f1ad9ce3f80d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1c18346-82e5-42e8-82cc-b82ac00dea9c", "tag": "f4041f43-d3c2-4b8a-a23e-9a236c0ded93"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:44.189869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fc9c95ff-ba8c-4236-8076-302737d653bc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:44.191763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fc9c95ff-ba8c-4236-8076-302737d653bc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:44.206090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc9c95ff-ba8c-4236-8076-302737d653bc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:44.206956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-dec3b679-4d9c-49c6-9987-76291bb5440b req-9eacd6b1-a264-44bc-9027-f1ad9ce3f80d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:44.209273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-dec3b679-4d9c-49c6-9987-76291bb5440b req-9eacd6b1-a264-44bc-9027-f1ad9ce3f80d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:44.212926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc9c95ff-ba8c-4236-8076-302737d653bc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:44.214531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc9c95ff-ba8c-4236-8076-302737d653bc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:44.217506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc9c95ff-ba8c-4236-8076-302737d653bc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:44.247811 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-dec3b679-4d9c-49c6-9987-76291bb5440b req-9eacd6b1-a264-44bc-9027-f1ad9ce3f80d service nova] Creating event network-changed:f4041f43-d3c2-4b8a-a23e-9a236c0ded93 for instance d1c18346-82e5-42e8-82cc-b82ac00dea9c on n-h1-833090-9 Jul 26 14:08:44.262680 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-dec3b679-4d9c-49c6-9987-76291bb5440b req-9eacd6b1-a264-44bc-9027-f1ad9ce3f80d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.600829 Jul 26 14:08:44.270757 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 646/1217] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:44.496012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6f428aea-ba7d-4f4c-a36d-f9f07c45503f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:44.496719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6f428aea-ba7d-4f4c-a36d-f9f07c45503f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:44.520845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f428aea-ba7d-4f4c-a36d-f9f07c45503f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:44.521793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f428aea-ba7d-4f4c-a36d-f9f07c45503f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:44.522832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f428aea-ba7d-4f4c-a36d-f9f07c45503f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:44.526835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f428aea-ba7d-4f4c-a36d-f9f07c45503f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:45.205349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fc9c95ff-ba8c-4236-8076-302737d653bc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:45.220040 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fc9c95ff-ba8c-4236-8076-302737d653bc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 1.034737 Jul 26 14:08:45.220923 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 572/1218] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:44 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:08:45.233312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-489b9286-e1e1-48e0-a6aa-778e5d45d8a1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:45.233950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-489b9286-e1e1-48e0-a6aa-778e5d45d8a1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:45.252500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-489b9286-e1e1-48e0-a6aa-778e5d45d8a1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:45.252995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-489b9286-e1e1-48e0-a6aa-778e5d45d8a1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:45.253839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-489b9286-e1e1-48e0-a6aa-778e5d45d8a1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:45.254290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-489b9286-e1e1-48e0-a6aa-778e5d45d8a1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:45.708861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:45.748885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=38 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:45.930946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6f428aea-ba7d-4f4c-a36d-f9f07c45503f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:45.943344 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6f428aea-ba7d-4f4c-a36d-f9f07c45503f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1318 microversion: 2.1 time: 1.451290 Jul 26 14:08:45.947551 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 647/1219] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:44 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1318 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:45.978912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-78ceb6ab-8b76-4326-a808-60cd21f9c2f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:45.983915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-78ceb6ab-8b76-4326-a808-60cd21f9c2f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:46.017377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78ceb6ab-8b76-4326-a808-60cd21f9c2f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:46.017841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78ceb6ab-8b76-4326-a808-60cd21f9c2f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:46.019794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78ceb6ab-8b76-4326-a808-60cd21f9c2f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:46.020330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78ceb6ab-8b76-4326-a808-60cd21f9c2f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:46.762943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-78ceb6ab-8b76-4326-a808-60cd21f9c2f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:46.788731 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-78ceb6ab-8b76-4326-a808-60cd21f9c2f9 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1473 microversion: 2.1 time: 0.826320 Jul 26 14:08:46.792027 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 648/1220] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:45 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1473 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:46.816896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3b18896c-84eb-416f-b175-5143a2fc9237 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:46.817644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3b18896c-84eb-416f-b175-5143a2fc9237 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:46.834429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b18896c-84eb-416f-b175-5143a2fc9237 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:46.838505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b18896c-84eb-416f-b175-5143a2fc9237 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:46.841694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b18896c-84eb-416f-b175-5143a2fc9237 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:46.842125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b18896c-84eb-416f-b175-5143a2fc9237 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:47.462272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-489b9286-e1e1-48e0-a6aa-778e5d45d8a1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:47.475789 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-489b9286-e1e1-48e0-a6aa-778e5d45d8a1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1319 microversion: 2.1 time: 2.253461 Jul 26 14:08:47.479067 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 573/1221] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:45 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1319 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:47.489672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d61a6806-5f5d-4f36-bf14-2324ddc918e9 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:47.490298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d61a6806-5f5d-4f36-bf14-2324ddc918e9 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:47.533890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d61a6806-5f5d-4f36-bf14-2324ddc918e9 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:47.536952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d61a6806-5f5d-4f36-bf14-2324ddc918e9 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:47.537970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d61a6806-5f5d-4f36-bf14-2324ddc918e9 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:47.538533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d61a6806-5f5d-4f36-bf14-2324ddc918e9 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:47.642658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:47.777511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3b18896c-84eb-416f-b175-5143a2fc9237 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:47.799636 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3b18896c-84eb-416f-b175-5143a2fc9237 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 1.006053 Jul 26 14:08:47.802413 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 649/1222] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:46 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:47.828262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9993fbe0-77d4-45cf-9d6a-e63a178d9fa6 req-72e3f0d9-b766-4f55-ba39-7e2dbff70543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a345c969-f3a8-466b-9909-8fea3469456b", "tag": "3d1684cb-2ff6-4116-a7f5-540e7296d1f3"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:47.840944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9993fbe0-77d4-45cf-9d6a-e63a178d9fa6 req-72e3f0d9-b766-4f55-ba39-7e2dbff70543 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:47.841854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9993fbe0-77d4-45cf-9d6a-e63a178d9fa6 req-72e3f0d9-b766-4f55-ba39-7e2dbff70543 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:47.863153 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9993fbe0-77d4-45cf-9d6a-e63a178d9fa6 req-72e3f0d9-b766-4f55-ba39-7e2dbff70543 service nova] Creating event network-changed:3d1684cb-2ff6-4116-a7f5-540e7296d1f3 for instance a345c969-f3a8-466b-9909-8fea3469456b on n-h1-833090-9 Jul 26 14:08:47.875086 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9993fbe0-77d4-45cf-9d6a-e63a178d9fa6 req-72e3f0d9-b766-4f55-ba39-7e2dbff70543 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069671 Jul 26 14:08:47.876385 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 650/1223] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:47.884161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ef6deffa-8a18-45f3-85da-0c9b5ef7f9e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:47.885884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef6deffa-8a18-45f3-85da-0c9b5ef7f9e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:47.899607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef6deffa-8a18-45f3-85da-0c9b5ef7f9e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:47.900322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef6deffa-8a18-45f3-85da-0c9b5ef7f9e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:47.901513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef6deffa-8a18-45f3-85da-0c9b5ef7f9e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:47.902132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef6deffa-8a18-45f3-85da-0c9b5ef7f9e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:47.930104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d61a6806-5f5d-4f36-bf14-2324ddc918e9 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:47.945672 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d61a6806-5f5d-4f36-bf14-2324ddc918e9 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1318 microversion: 2.1 time: 0.465448 Jul 26 14:08:47.952559 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 574/1224] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:47 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:48.126906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ef6deffa-8a18-45f3-85da-0c9b5ef7f9e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:48.148215 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ef6deffa-8a18-45f3-85da-0c9b5ef7f9e4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1473 microversion: 2.1 time: 0.269954 Jul 26 14:08:48.149404 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 651/1225] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:47 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1473 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:48.485224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7ab8470-349e-45bf-ae06-c01ff9a97dd2 tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Calling method '.version_select at 0x7f8787e71e50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:48.521740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b62ee8cf-6b0b-4c78-9dac-40f12d89564f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:48.523138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b62ee8cf-6b0b-4c78-9dac-40f12d89564f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:48.534891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:48.550350 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c7ab8470-349e-45bf-ae06-c01ff9a97dd2 tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] HTTP exception thrown: Image not found. Jul 26 14:08:48.554308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b62ee8cf-6b0b-4c78-9dac-40f12d89564f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7ab8470-349e-45bf-ae06-c01ff9a97dd2 tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Request method failure captured: Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/images/87aa4b55-e4cf-465f-a408-34850349006a/metadata/os_distro HTTP/1.1 Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VvX7lRk6LOIJB-4IttG4dyyKu40wkFHITctHSM0oPOzPQsF4yA68Z17e32A5DXobAQXpNEwMzjlFSTq9J85o29KESEndr-YZj5oZfaeihbhsqoyZL3m9PAwucE7vbahRPdI2D4EHlXSJh9LbJK1nUZCu9Z9nGpFNzzZqMOvDKQ6SQ Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0fba14e8cbea4f1ab4d6df665c566171", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}] Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 73b7301225e34c6bb0a04f3be5749361 Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'image_id': '87aa4b55-e4cf-465f-a408-34850349006a', 'id': 'os_distro'} Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 87aa4b55-e4cf-465f-a408-34850349006a Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 14:08:48.554593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 87aa4b55-e4cf-465f-a408-34850349006a could not be found. Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7ab8470-349e-45bf-ae06-c01ff9a97dd2 tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c7ab8470-349e-45bf-ae06-c01ff9a97dd2 tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] 10.222.0.70 "DELETE /compute/v2.1/images/87aa4b55-e4cf-465f-a408-34850349006a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.344574 Jul 26 14:08:48.564265 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 575/1226] 10.222.0.70 () {58 vars in 1293 bytes} [Tue Jul 26 14:08:48 2022] DELETE /compute/v2.1/images/87aa4b55-e4cf-465f-a408-34850349006a/metadata/os_distro => generated 62 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 26 14:08:48.576620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b62ee8cf-6b0b-4c78-9dac-40f12d89564f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:48.576620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b62ee8cf-6b0b-4c78-9dac-40f12d89564f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:48.576620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b62ee8cf-6b0b-4c78-9dac-40f12d89564f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:48.577119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ac6b128e-2f1f-4af9-a247-bf89065b43bd tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Calling method '.version_select at 0x7f8787cc8e50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:48.639100 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ac6b128e-2f1f-4af9-a247-bf89065b43bd tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] HTTP exception thrown: Image not found. Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ac6b128e-2f1f-4af9-a247-bf89065b43bd tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Request method failure captured: Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/images/0dbb0718-ba69-4885-b55a-bc1e112b1df4/metadata/os_version HTTP/1.1 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VvX7lRk6LOIJB-4IttG4dyyKu40wkFHITctHSM0oPOzPQsF4yA68Z17e32A5DXobAQXpNEwMzjlFSTq9J85o29KESEndr-YZj5oZfaeihbhsqoyZL3m9PAwucE7vbahRPdI2D4EHlXSJh9LbJK1nUZCu9Z9nGpFNzzZqMOvDKQ6SQ Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0fba14e8cbea4f1ab4d6df665c566171", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}] Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 73b7301225e34c6bb0a04f3be5749361 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'image_id': '0dbb0718-ba69-4885-b55a-bc1e112b1df4', 'id': 'os_version'} Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0dbb0718-ba69-4885-b55a-bc1e112b1df4 Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 14:08:48.643722 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0dbb0718-ba69-4885-b55a-bc1e112b1df4 could not be found. Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:08:48.647659 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.657870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ac6b128e-2f1f-4af9-a247-bf89065b43bd tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:48.657870 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ac6b128e-2f1f-4af9-a247-bf89065b43bd tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] 10.222.0.70 "GET /compute/v2.1/images/0dbb0718-ba69-4885-b55a-bc1e112b1df4/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.089365 Jul 26 14:08:48.657870 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 576/1227] 10.222.0.70 () {58 vars in 1293 bytes} [Tue Jul 26 14:08:48 2022] GET /compute/v2.1/images/0dbb0718-ba69-4885-b55a-bc1e112b1df4/metadata/os_version => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:08:48.674795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-874daaaf-884d-46d1-b434-b6b1b468146e tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Calling method '.version_select at 0x7f8787cc8af0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:48.702078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=14 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:48.742144 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-874daaaf-884d-46d1-b434-b6b1b468146e tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] HTTP exception thrown: Image not found. Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-874daaaf-884d-46d1-b434-b6b1b468146e tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Request method failure captured: Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/images/6b4eac05-bfa9-4ac8-a1e8-1b49f99a25d3/metadata HTTP/1.1 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VvX7lRk6LOIJB-4IttG4dyyKu40wkFHITctHSM0oPOzPQsF4yA68Z17e32A5DXobAQXpNEwMzjlFSTq9J85o29KESEndr-YZj5oZfaeihbhsqoyZL3m9PAwucE7vbahRPdI2D4EHlXSJh9LbJK1nUZCu9Z9nGpFNzzZqMOvDKQ6SQ Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0fba14e8cbea4f1ab4d6df665c566171", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}] Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 73b7301225e34c6bb0a04f3be5749361 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'image_id': '6b4eac05-bfa9-4ac8-a1e8-1b49f99a25d3'} Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6b4eac05-bfa9-4ac8-a1e8-1b49f99a25d3 Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 14:08:48.744382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b4eac05-bfa9-4ac8-a1e8-1b49f99a25d3 could not be found. Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-874daaaf-884d-46d1-b434-b6b1b468146e tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:48.749040 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-874daaaf-884d-46d1-b434-b6b1b468146e tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] 10.222.0.70 "GET /compute/v2.1/images/6b4eac05-bfa9-4ac8-a1e8-1b49f99a25d3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.080656 Jul 26 14:08:48.757336 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 577/1228] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:08:48 2022] GET /compute/v2.1/images/6b4eac05-bfa9-4ac8-a1e8-1b49f99a25d3/metadata => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 26 14:08:48.765622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7335c7aa-363a-443e-b239-7bff00b8b24c tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Action: 'update_all', calling method: .version_select at 0x7f8787d33700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:48.812592 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-7335c7aa-363a-443e-b239-7bff00b8b24c tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] HTTP exception thrown: Image not found. Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7335c7aa-363a-443e-b239-7bff00b8b24c tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Request method failure captured: Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: request: PUT /compute/v2.1/images/1a309987-54f8-41a7-9c41-9a7aa33cd925/metadata HTTP/1.1 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 57 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VvX7lRk6LOIJB-4IttG4dyyKu40wkFHITctHSM0oPOzPQsF4yA68Z17e32A5DXobAQXpNEwMzjlFSTq9J85o29KESEndr-YZj5oZfaeihbhsqoyZL3m9PAwucE7vbahRPdI2D4EHlXSJh9LbJK1nUZCu9Z9nGpFNzzZqMOvDKQ6SQ Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0fba14e8cbea4f1ab4d6df665c566171", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}] Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 73b7301225e34c6bb0a04f3be5749361 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'image_id': '1a309987-54f8-41a7-9c41-9a7aa33cd925', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1a309987-54f8-41a7-9c41-9a7aa33cd925 Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 14:08:48.816101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1a309987-54f8-41a7-9c41-9a7aa33cd925 could not be found. Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7335c7aa-363a-443e-b239-7bff00b8b24c tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7335c7aa-363a-443e-b239-7bff00b8b24c tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] 10.222.0.70 "PUT /compute/v2.1/images/1a309987-54f8-41a7-9c41-9a7aa33cd925/metadata" status: 404 len: 62 microversion: 2.1 time: 0.061676 Jul 26 14:08:48.832009 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 578/1229] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:08:48 2022] PUT /compute/v2.1/images/1a309987-54f8-41a7-9c41-9a7aa33cd925/metadata => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:08:48.842060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-73e816bd-2c38-40e7-bd94-9559014f9e89 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:48.842060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-73e816bd-2c38-40e7-bd94-9559014f9e89 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:48.846419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73e816bd-2c38-40e7-bd94-9559014f9e89 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:48.846892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73e816bd-2c38-40e7-bd94-9559014f9e89 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:48.847696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73e816bd-2c38-40e7-bd94-9559014f9e89 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:48.848177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73e816bd-2c38-40e7-bd94-9559014f9e89 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:49.124851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b62ee8cf-6b0b-4c78-9dac-40f12d89564f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:49.140706 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b62ee8cf-6b0b-4c78-9dac-40f12d89564f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1319 microversion: 2.1 time: 0.626125 Jul 26 14:08:49.148454 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 652/1230] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:48 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1319 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:49.155226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92a27410-fc43-4d7f-9694-3e3b538a8a92 tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Action: 'update', calling method: .version_select at 0x7f8787f8ca60>, body: {"meta": {"os_distro": "alt"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:49.227205 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-92a27410-fc43-4d7f-9694-3e3b538a8a92 tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] HTTP exception thrown: Image not found. Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92a27410-fc43-4d7f-9694-3e3b538a8a92 tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Request method failure captured: Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/images/59aa4a82-074c-4176-90f5-5d120b7b1dca/metadata/os_distro HTTP/1.1 Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 30 Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VvX7lRk6LOIJB-4IttG4dyyKu40wkFHITctHSM0oPOzPQsF4yA68Z17e32A5DXobAQXpNEwMzjlFSTq9J85o29KESEndr-YZj5oZfaeihbhsqoyZL3m9PAwucE7vbahRPdI2D4EHlXSJh9LbJK1nUZCu9Z9nGpFNzzZqMOvDKQ6SQ Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0fba14e8cbea4f1ab4d6df665c566171", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}] Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 73b7301225e34c6bb0a04f3be5749361 Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: {"meta": {"os_distro": "alt"}} Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: exception: Image not found. Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'image_id': '59aa4a82-074c-4176-90f5-5d120b7b1dca', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 59aa4a82-074c-4176-90f5-5d120b7b1dca Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 14:08:49.229906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 59aa4a82-074c-4176-90f5-5d120b7b1dca could not be found. Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92a27410-fc43-4d7f-9694-3e3b538a8a92 tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Returning 404 to user: Image not found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-92a27410-fc43-4d7f-9694-3e3b538a8a92 tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] 10.222.0.70 "PUT /compute/v2.1/images/59aa4a82-074c-4176-90f5-5d120b7b1dca/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.081449 Jul 26 14:08:49.235938 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 653/1231] 10.222.0.70 () {60 vars in 1310 bytes} [Tue Jul 26 14:08:49 2022] PUT /compute/v2.1/images/59aa4a82-074c-4176-90f5-5d120b7b1dca/metadata/os_distro => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:08:49.254251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9cdd4dea-2b87-4768-aefd-997f0525efa6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:49.261825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9cdd4dea-2b87-4768-aefd-997f0525efa6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:49.298684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cdd4dea-2b87-4768-aefd-997f0525efa6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:49.299359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cdd4dea-2b87-4768-aefd-997f0525efa6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:49.303651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cdd4dea-2b87-4768-aefd-997f0525efa6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:49.307374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cdd4dea-2b87-4768-aefd-997f0525efa6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:50.450971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-73e816bd-2c38-40e7-bd94-9559014f9e89 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:50.478295 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-73e816bd-2c38-40e7-bd94-9559014f9e89 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 1.656755 Jul 26 14:08:50.479917 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 579/1232] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:48 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:08:50.495679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6befb197-16bc-4c04-b20c-467bed05192f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:50.497862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6befb197-16bc-4c04-b20c-467bed05192f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:50.528339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6befb197-16bc-4c04-b20c-467bed05192f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:50.530805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6befb197-16bc-4c04-b20c-467bed05192f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:50.532010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6befb197-16bc-4c04-b20c-467bed05192f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:50.532841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6befb197-16bc-4c04-b20c-467bed05192f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:50.613128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9cdd4dea-2b87-4768-aefd-997f0525efa6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:50.635805 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9cdd4dea-2b87-4768-aefd-997f0525efa6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1318 microversion: 2.1 time: 1.397966 Jul 26 14:08:50.659689 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 654/1233] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:49 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1318 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:50.664922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9f8bd5f2-31d0-4951-b0b6-ffb896b7b91a tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Action: 'create', calling method: .version_select at 0x7f8787f99ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:50.698595 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-9f8bd5f2-31d0-4951-b0b6-ffb896b7b91a tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] HTTP exception thrown: Image not found. Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9f8bd5f2-31d0-4951-b0b6-ffb896b7b91a tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Request method failure captured: Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/images/22487a99-d663-4417-975a-3e18fa58bd48/metadata HTTP/1.1 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 57 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VvX7lRk6LOIJB-4IttG4dyyKu40wkFHITctHSM0oPOzPQsF4yA68Z17e32A5DXobAQXpNEwMzjlFSTq9J85o29KESEndr-YZj5oZfaeihbhsqoyZL3m9PAwucE7vbahRPdI2D4EHlXSJh9LbJK1nUZCu9Z9nGpFNzzZqMOvDKQ6SQ Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0fba14e8cbea4f1ab4d6df665c566171"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0fba14e8cbea4f1ab4d6df665c566171", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fba14e8cbea4f1ab4d6df665c566171"}]}] Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 0fba14e8cbea4f1ab4d6df665c566171 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 73b7301225e34c6bb0a04f3be5749361 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1689987084-project Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: exception: Image not found. Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'image_id': '22487a99-d663-4417-975a-3e18fa58bd48', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 22487a99-d663-4417-975a-3e18fa58bd48 Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 14:08:50.702215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22487a99-d663-4417-975a-3e18fa58bd48 could not be found. Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:08:50.708487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:50.716951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9f8bd5f2-31d0-4951-b0b6-ffb896b7b91a tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] Returning 404 to user: Image not found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:50.719241 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9f8bd5f2-31d0-4951-b0b6-ffb896b7b91a tempest-ImagesMetadataNegativeTestJSON-1689987084 tempest-ImagesMetadataNegativeTestJSON-1689987084-project] 10.222.0.70 "POST /compute/v2.1/images/22487a99-d663-4417-975a-3e18fa58bd48/metadata" status: 404 len: 62 microversion: 2.1 time: 0.058005 Jul 26 14:08:50.727045 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 655/1234] 10.222.0.70 () {60 vars in 1281 bytes} [Tue Jul 26 14:08:50 2022] POST /compute/v2.1/images/22487a99-d663-4417-975a-3e18fa58bd48/metadata => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:08:50.736113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-8b02f514-8aa6-479c-9ea7-c0a2fed497e9 req-2eb4af7e-a82d-4171-a312-54017dbb6d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8beadb53-ad09-4a21-a4b8-1a8d1e561129", "name": "network-vif-unplugged", "status": "completed", "tag": "81fe2ba7-46e4-409a-8bd8-03c67c1e0702"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:50.755511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8b02f514-8aa6-479c-9ea7-c0a2fed497e9 req-2eb4af7e-a82d-4171-a312-54017dbb6d61 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:50.756561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8b02f514-8aa6-479c-9ea7-c0a2fed497e9 req-2eb4af7e-a82d-4171-a312-54017dbb6d61 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:50.772589 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8b02f514-8aa6-479c-9ea7-c0a2fed497e9 req-2eb4af7e-a82d-4171-a312-54017dbb6d61 service nova] Creating event network-vif-unplugged:81fe2ba7-46e4-409a-8bd8-03c67c1e0702 for instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 on n-h2-833090-9 Jul 26 14:08:50.781345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-8b02f514-8aa6-479c-9ea7-c0a2fed497e9 req-2eb4af7e-a82d-4171-a312-54017dbb6d61 service nova] Instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:08:50.797536 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-8b02f514-8aa6-479c-9ea7-c0a2fed497e9 req-2eb4af7e-a82d-4171-a312-54017dbb6d61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068428 Jul 26 14:08:50.798369 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 656/1235] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:50.805419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7f9d7629-c8fc-467b-ace0-eae7751b9a44 req-d21dbcdb-3019-4c56-b540-0e4fe8ed1238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3d38f13-5f5e-4574-b415-d21bb454b9d2", "tag": "133fb10c-c93f-49e6-9134-3165e0e34866"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:50.819414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7f9d7629-c8fc-467b-ace0-eae7751b9a44 req-d21dbcdb-3019-4c56-b540-0e4fe8ed1238 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:50.820350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7f9d7629-c8fc-467b-ace0-eae7751b9a44 req-d21dbcdb-3019-4c56-b540-0e4fe8ed1238 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:50.847444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:50.858174 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7f9d7629-c8fc-467b-ace0-eae7751b9a44 req-d21dbcdb-3019-4c56-b540-0e4fe8ed1238 service nova] Creating event network-changed:133fb10c-c93f-49e6-9134-3165e0e34866 for instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 on n-h2-833090-9 Jul 26 14:08:50.867129 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7f9d7629-c8fc-467b-ace0-eae7751b9a44 req-d21dbcdb-3019-4c56-b540-0e4fe8ed1238 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067028 Jul 26 14:08:50.871430 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 657/1236] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:50.881851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bfd481a8-a53d-4e80-992a-0bb58c49592b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:50.884913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bfd481a8-a53d-4e80-992a-0bb58c49592b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:50.915707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bfd481a8-a53d-4e80-992a-0bb58c49592b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:50.916623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bfd481a8-a53d-4e80-992a-0bb58c49592b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:50.918086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bfd481a8-a53d-4e80-992a-0bb58c49592b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:50.921800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bfd481a8-a53d-4e80-992a-0bb58c49592b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:51.311403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6befb197-16bc-4c04-b20c-467bed05192f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:51.324661 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6befb197-16bc-4c04-b20c-467bed05192f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1473 microversion: 2.1 time: 0.843150 Jul 26 14:08:51.331926 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 580/1237] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:50 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1473 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:51.517193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64bbe104-178d-4d81-a4ed-276bd6eb0417 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:51.517856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-64bbe104-178d-4d81-a4ed-276bd6eb0417 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:51.535419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64bbe104-178d-4d81-a4ed-276bd6eb0417 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:51.535968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64bbe104-178d-4d81-a4ed-276bd6eb0417 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:51.536906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64bbe104-178d-4d81-a4ed-276bd6eb0417 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:51.537365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64bbe104-178d-4d81-a4ed-276bd6eb0417 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:51.709731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bfd481a8-a53d-4e80-992a-0bb58c49592b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:51.744051 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bfd481a8-a53d-4e80-992a-0bb58c49592b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1319 microversion: 2.1 time: 0.868932 Jul 26 14:08:51.749670 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 658/1238] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:50 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1319 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:51.767081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27c26f12-6d7a-4d81-af9a-5549953b8886 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:51.767727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27c26f12-6d7a-4d81-af9a-5549953b8886 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:51.785120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27c26f12-6d7a-4d81-af9a-5549953b8886 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:51.790582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27c26f12-6d7a-4d81-af9a-5549953b8886 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:51.792929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27c26f12-6d7a-4d81-af9a-5549953b8886 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:51.793620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27c26f12-6d7a-4d81-af9a-5549953b8886 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:52.306819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64bbe104-178d-4d81-a4ed-276bd6eb0417 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:52.329309 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64bbe104-178d-4d81-a4ed-276bd6eb0417 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 0.817188 Jul 26 14:08:52.330317 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 581/1239] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:51 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:52.357056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-03b9ad88-2775-4921-b726-a8d7d7c19e1e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:52.358568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-03b9ad88-2775-4921-b726-a8d7d7c19e1e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:52.366529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03b9ad88-2775-4921-b726-a8d7d7c19e1e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:52.367235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03b9ad88-2775-4921-b726-a8d7d7c19e1e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:52.368568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03b9ad88-2775-4921-b726-a8d7d7c19e1e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:52.369349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03b9ad88-2775-4921-b726-a8d7d7c19e1e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:52.378196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27c26f12-6d7a-4d81-af9a-5549953b8886 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:52.395419 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27c26f12-6d7a-4d81-af9a-5549953b8886 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1318 microversion: 2.1 time: 0.642275 Jul 26 14:08:52.396008 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 659/1240] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:51 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:52.784709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-17337a63-b682-4495-abd5-9f0c66ffa54f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:52.786963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-17337a63-b682-4495-abd5-9f0c66ffa54f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:52.798084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17337a63-b682-4495-abd5-9f0c66ffa54f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:52.799146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17337a63-b682-4495-abd5-9f0c66ffa54f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:52.800226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17337a63-b682-4495-abd5-9f0c66ffa54f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:52.801052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17337a63-b682-4495-abd5-9f0c66ffa54f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:52.863578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-03b9ad88-2775-4921-b726-a8d7d7c19e1e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:52.881317 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-03b9ad88-2775-4921-b726-a8d7d7c19e1e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1473 microversion: 2.1 time: 0.534142 Jul 26 14:08:52.896273 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 582/1241] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:52 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1473 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:52.909985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-75ae6691-44f3-46ad-9469-556b7d872d03 req-02f3639d-334a-43c9-bc80-23994d5738a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8beadb53-ad09-4a21-a4b8-1a8d1e561129", "tag": "81fe2ba7-46e4-409a-8bd8-03c67c1e0702"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:52.921360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-75ae6691-44f3-46ad-9469-556b7d872d03 req-02f3639d-334a-43c9-bc80-23994d5738a2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:52.922057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-75ae6691-44f3-46ad-9469-556b7d872d03 req-02f3639d-334a-43c9-bc80-23994d5738a2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:52.941038 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-75ae6691-44f3-46ad-9469-556b7d872d03 req-02f3639d-334a-43c9-bc80-23994d5738a2 service nova] Creating event network-changed:81fe2ba7-46e4-409a-8bd8-03c67c1e0702 for instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 on n-h2-833090-9 Jul 26 14:08:52.947820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-75ae6691-44f3-46ad-9469-556b7d872d03 req-02f3639d-334a-43c9-bc80-23994d5738a2 service nova] Instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:08:52.967463 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-75ae6691-44f3-46ad-9469-556b7d872d03 req-02f3639d-334a-43c9-bc80-23994d5738a2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069313 Jul 26 14:08:52.969006 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 583/1242] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:52.975417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-5b1cdeb6-9247-47dc-afea-a7699526a9cb req-03936974-05ce-41e3-b295-78b092c45d79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807e080b-51bc-48e9-9b38-a4c49734b15d", "tag": "54d86a16-b218-474f-8fa1-ab8322e59564"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:52.996680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5b1cdeb6-9247-47dc-afea-a7699526a9cb req-03936974-05ce-41e3-b295-78b092c45d79 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:52.998195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5b1cdeb6-9247-47dc-afea-a7699526a9cb req-03936974-05ce-41e3-b295-78b092c45d79 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:53.019523 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-5b1cdeb6-9247-47dc-afea-a7699526a9cb req-03936974-05ce-41e3-b295-78b092c45d79 service nova] Creating event network-changed:54d86a16-b218-474f-8fa1-ab8322e59564 for instance 807e080b-51bc-48e9-9b38-a4c49734b15d on n-h2-833090-9 Jul 26 14:08:53.029266 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-5b1cdeb6-9247-47dc-afea-a7699526a9cb req-03936974-05ce-41e3-b295-78b092c45d79 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057759 Jul 26 14:08:53.031222 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 584/1243] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:53.362602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3afeeb16-476a-4443-b64b-4d0b2179ed86 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:53.365093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3afeeb16-476a-4443-b64b-4d0b2179ed86 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:53.386791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3afeeb16-476a-4443-b64b-4d0b2179ed86 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:53.389896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3afeeb16-476a-4443-b64b-4d0b2179ed86 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:53.391772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3afeeb16-476a-4443-b64b-4d0b2179ed86 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:53.396122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3afeeb16-476a-4443-b64b-4d0b2179ed86 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:53.489795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-17337a63-b682-4495-abd5-9f0c66ffa54f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:53.515381 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-17337a63-b682-4495-abd5-9f0c66ffa54f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1319 microversion: 2.1 time: 0.743423 Jul 26 14:08:53.516181 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 660/1244] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:52 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1319 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:53.532563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af59f5c8-4202-47ba-b8df-92afc45a4966 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:53.539832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af59f5c8-4202-47ba-b8df-92afc45a4966 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:53.560864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af59f5c8-4202-47ba-b8df-92afc45a4966 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:53.562061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af59f5c8-4202-47ba-b8df-92afc45a4966 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:53.563712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af59f5c8-4202-47ba-b8df-92afc45a4966 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:53.564641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af59f5c8-4202-47ba-b8df-92afc45a4966 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:54.278415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3afeeb16-476a-4443-b64b-4d0b2179ed86 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:54.302418 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3afeeb16-476a-4443-b64b-4d0b2179ed86 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 0.954464 Jul 26 14:08:54.311025 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 585/1245] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:53 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:54.318270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af59f5c8-4202-47ba-b8df-92afc45a4966 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:54.327234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f2509869-5976-4954-a635-81146693d064 req-5ca06285-761d-457c-a311-e9733b056efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c18346-82e5-42e8-82cc-b82ac00dea9c", "name": "network-vif-plugged", "status": "completed", "tag": "f4041f43-d3c2-4b8a-a23e-9a236c0ded93"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:54.336066 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af59f5c8-4202-47ba-b8df-92afc45a4966 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1318 microversion: 2.1 time: 0.818429 Jul 26 14:08:54.337585 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 661/1246] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:53 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:54.344856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c502ad08-ac34-4f93-9290-696c3cef4d63 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:54.345879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c502ad08-ac34-4f93-9290-696c3cef4d63 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:54.363608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f2509869-5976-4954-a635-81146693d064 req-5ca06285-761d-457c-a311-e9733b056efc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:54.364090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f2509869-5976-4954-a635-81146693d064 req-5ca06285-761d-457c-a311-e9733b056efc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:54.371762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c502ad08-ac34-4f93-9290-696c3cef4d63 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:54.373239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c502ad08-ac34-4f93-9290-696c3cef4d63 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:54.379773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c502ad08-ac34-4f93-9290-696c3cef4d63 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:54.380763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c502ad08-ac34-4f93-9290-696c3cef4d63 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:54.402065 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f2509869-5976-4954-a635-81146693d064 req-5ca06285-761d-457c-a311-e9733b056efc service nova] Creating event network-vif-plugged:f4041f43-d3c2-4b8a-a23e-9a236c0ded93 for instance d1c18346-82e5-42e8-82cc-b82ac00dea9c on n-h1-833090-9 Jul 26 14:08:54.422122 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f2509869-5976-4954-a635-81146693d064 req-5ca06285-761d-457c-a311-e9733b056efc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105524 Jul 26 14:08:54.423734 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 586/1247] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:54.689510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-619487ed-885e-4587-a870-06f862ef284b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Action: 'create', calling method: .version_select at 0x7f8787ce9e50>, body: {"keypair": {"name": "tempest-keypair-202666309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLuYuqvSQnU/R80zb2gOh3N3hhWolmkiw5IQH8TdPCT28QLZd9NWcO5+7ICdgEUsZIHJ6c72z9G1l7J3jL6bMm++3m3+kdaOlkAR9uXaRwmc41T2t/9hEjEKGwmm/GAfA=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:54.725362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-619487ed-885e-4587-a870-06f862ef284b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Getting quotas for project 81bcf05a19b54acbb86a46e6d8e8962e. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:54.735928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-619487ed-885e-4587-a870-06f862ef284b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Getting quotas for user 4e385295d84f494986de9861dbc068da and project 81bcf05a19b54acbb86a46e6d8e8962e. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:54.810877 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-619487ed-885e-4587-a870-06f862ef284b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.382147 Jul 26 14:08:54.828497 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 587/1248] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:08:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:54.839191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-228540ac-6be1-49c9-8a1c-2c68170d6c69 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:54.843807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-228540ac-6be1-49c9-8a1c-2c68170d6c69 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:54.862664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-228540ac-6be1-49c9-8a1c-2c68170d6c69 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:54.863151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-228540ac-6be1-49c9-8a1c-2c68170d6c69 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:54.863998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-228540ac-6be1-49c9-8a1c-2c68170d6c69 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:54.865418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-228540ac-6be1-49c9-8a1c-2c68170d6c69 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:55.102905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c502ad08-ac34-4f93-9290-696c3cef4d63 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:55.121408 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c502ad08-ac34-4f93-9290-696c3cef4d63 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1473 microversion: 2.1 time: 0.779704 Jul 26 14:08:55.125329 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 662/1249] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:54 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1473 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:55.233640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-228540ac-6be1-49c9-8a1c-2c68170d6c69 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:55.250080 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-228540ac-6be1-49c9-8a1c-2c68170d6c69 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1319 microversion: 2.1 time: 0.419988 Jul 26 14:08:55.251125 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 588/1250] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:54 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:55.343460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-82a46ad8-1db5-497a-9a4b-41c9633f9ac7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:55.345048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-82a46ad8-1db5-497a-9a4b-41c9633f9ac7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:55.375831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-49f4bd54-56d3-44f2-aa7e-3cb1002f9f7b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:55.378253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-49f4bd54-56d3-44f2-aa7e-3cb1002f9f7b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:55.388477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82a46ad8-1db5-497a-9a4b-41c9633f9ac7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:55.389319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82a46ad8-1db5-497a-9a4b-41c9633f9ac7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:55.394601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82a46ad8-1db5-497a-9a4b-41c9633f9ac7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:55.398091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82a46ad8-1db5-497a-9a4b-41c9633f9ac7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:55.409962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49f4bd54-56d3-44f2-aa7e-3cb1002f9f7b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:55.413942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49f4bd54-56d3-44f2-aa7e-3cb1002f9f7b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:55.424388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49f4bd54-56d3-44f2-aa7e-3cb1002f9f7b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:55.426015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49f4bd54-56d3-44f2-aa7e-3cb1002f9f7b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:56.823024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-82a46ad8-1db5-497a-9a4b-41c9633f9ac7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:56.833652 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-82a46ad8-1db5-497a-9a4b-41c9633f9ac7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 1.497749 Jul 26 14:08:56.840537 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 663/1251] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:55 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:56.846297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7dd536db-1b65-4337-bb27-91028bdd06f2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:56.855070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7dd536db-1b65-4337-bb27-91028bdd06f2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:56.857185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-49f4bd54-56d3-44f2-aa7e-3cb1002f9f7b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:56.864532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7dd536db-1b65-4337-bb27-91028bdd06f2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:56.871853 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-49f4bd54-56d3-44f2-aa7e-3cb1002f9f7b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1318 microversion: 2.1 time: 1.506864 Jul 26 14:08:56.873548 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 589/1252] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:55 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1318 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:08:56.875240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7dd536db-1b65-4337-bb27-91028bdd06f2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:56.876153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7dd536db-1b65-4337-bb27-91028bdd06f2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:56.876613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7dd536db-1b65-4337-bb27-91028bdd06f2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:56.909539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8e162b94-d91d-49a4-9ec7-e65a48dcf0f8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:56.911267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8e162b94-d91d-49a4-9ec7-e65a48dcf0f8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:56.944883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e162b94-d91d-49a4-9ec7-e65a48dcf0f8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:56.946746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e162b94-d91d-49a4-9ec7-e65a48dcf0f8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:56.949558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e162b94-d91d-49a4-9ec7-e65a48dcf0f8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:56.962031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e162b94-d91d-49a4-9ec7-e65a48dcf0f8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:57.494032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8e162b94-d91d-49a4-9ec7-e65a48dcf0f8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:57.505588 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8e162b94-d91d-49a4-9ec7-e65a48dcf0f8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1319 microversion: 2.1 time: 0.628637 Jul 26 14:08:57.516194 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 590/1253] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:56 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1319 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:57.550117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7dd536db-1b65-4337-bb27-91028bdd06f2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:57.571381 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7dd536db-1b65-4337-bb27-91028bdd06f2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1471 microversion: 2.1 time: 0.728149 Jul 26 14:08:57.574146 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 664/1254] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:56 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1471 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:57.800619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-799d4545-0a44-495b-abd1-cb126df8c75d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Action: 'create', calling method: .version_select at 0x7f8787e808b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjlM5K4V+xQseXBlB7wtHCr5fPwOJPit5Ivd5hRUlHOJ2qEO+pzVhhSEm/i4luqm+Fsd5XgIuk7o3Yi9ZoUZF3FTyJnDbywbXLfNAUkiE8vZ1ifiu6t3jlJA5MJ4PB7Q=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:57.813436 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-799d4545-0a44-495b-abd1-cb126df8c75d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-799d4545-0a44-495b-abd1-cb126df8c75d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Request method failure captured: Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 257 Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_V4lr2Euuykj70PLNlRGQEPxa8w-j6mSe_fKYr-_DkA-tFAvyj_w_RET-JPi6wSoXkrb2df7n8KoaycnXwBSZrLm9gyZDfzbeJu9jAI2hYkDKXWtY5-9R2NOLTkc8o7QIkjP2wf9J-BkuZ8xYweDjDI3_oROFkXoD1Aesxe-iQkOxU Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4bdd5041b39341dabb21291b1c8ad610", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}] Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjlM5K4V+xQseXBlB7wtHCr5fPwOJPit5Ivd5hRUlHOJ2qEO+pzVhhSEm/i4luqm+Fsd5XgIuk7o3Yi9ZoUZF3FTyJnDbywbXLfNAUkiE8vZ1ifiu6t3jlJA5MJ4PB7Q=="}} Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRjlM5K4V+xQseXBlB7wtHCr5fPwOJPit5Ivd5hRUlHOJ2qEO+pzVhhSEm/i4luqm+Fsd5XgIuk7o3Yi9ZoUZF3FTyJnDbywbXLfNAUkiE8vZ1ifiu6t3jlJA5MJ4PB7Q=='}}} Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:57.816593 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-799d4545-0a44-495b-abd1-cb126df8c75d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-799d4545-0a44-495b-abd1-cb126df8c75d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.301115 Jul 26 14:08:57.820732 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 591/1255] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:08:57 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 303 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:08:57.836326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d931536c-88f3-4acc-b9e7-dacb75db113d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Action: 'create', calling method: .version_select at 0x7f8787ec0e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1979298468", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:57.882632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-58dabb76-608b-44c1-8378-b43353025407 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:57.884794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-58dabb76-608b-44c1-8378-b43353025407 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:57.897437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d931536c-88f3-4acc-b9e7-dacb75db113d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Getting quotas for project 4bdd5041b39341dabb21291b1c8ad610. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:57.916065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58dabb76-608b-44c1-8378-b43353025407 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:57.917270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58dabb76-608b-44c1-8378-b43353025407 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:57.921195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58dabb76-608b-44c1-8378-b43353025407 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:57.924888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58dabb76-608b-44c1-8378-b43353025407 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:57.938432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d931536c-88f3-4acc-b9e7-dacb75db113d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Getting quotas for user 319cac6b75544f9db91d8f3bab7d6a67 and project 4bdd5041b39341dabb21291b1c8ad610. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:58.009543 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d931536c-88f3-4acc-b9e7-dacb75db113d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d931536c-88f3-4acc-b9e7-dacb75db113d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Request method failure captured: Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 2167 Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_V4lr2Euuykj70PLNlRGQEPxa8w-j6mSe_fKYr-_DkA-tFAvyj_w_RET-JPi6wSoXkrb2df7n8KoaycnXwBSZrLm9gyZDfzbeJu9jAI2hYkDKXWtY5-9R2NOLTkc8o7QIkjP2wf9J-BkuZ8xYweDjDI3_oROFkXoD1Aesxe-iQkOxU Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4bdd5041b39341dabb21291b1c8ad610", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}] Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1979298468", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:08:58.027832 n-d-833090-9 devstack@n-api.service[119479]: exception: Keypair data is invalid: failed to generate fingerprint Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1979298468', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:08:58.031301 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d931536c-88f3-4acc-b9e7-dacb75db113d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d931536c-88f3-4acc-b9e7-dacb75db113d tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.204308 Jul 26 14:08:58.035572 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 665/1256] 10.222.0.70 () {60 vars in 1160 bytes} [Tue Jul 26 14:08:57 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:08:58.039128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed1492d9-dd2d-4ef9-8bf4-b0d40dcc0440 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:58.039128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ed1492d9-dd2d-4ef9-8bf4-b0d40dcc0440 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:58.055156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed1492d9-dd2d-4ef9-8bf4-b0d40dcc0440 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:58.055620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed1492d9-dd2d-4ef9-8bf4-b0d40dcc0440 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:58.062433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed1492d9-dd2d-4ef9-8bf4-b0d40dcc0440 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:58.063261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed1492d9-dd2d-4ef9-8bf4-b0d40dcc0440 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:58.444113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-58dabb76-608b-44c1-8378-b43353025407 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:58.453332 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-58dabb76-608b-44c1-8378-b43353025407 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 0.577027 Jul 26 14:08:58.467903 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 592/1257] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:57 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:58.467903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8fd75fc0-b99a-4ffd-a601-b17959d4f117 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Action: 'create', calling method: .version_select at 0x7f8787ed80d0>, body: {"keypair": {"name": "tempest-keypair-1930851535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdgGU69aSarlBUrarXmZnBNPu8wvCuexcFhCJQPHZCqZs6PVQJ5a/LNg3TpiuPB7Wx/Zdy5Ghn2R5OJN0HzGrA1L98DRUD+YM7+xcrfXY0aK5DQfoMJ3v9cSStQiveBDA=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:58.499151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8fd75fc0-b99a-4ffd-a601-b17959d4f117 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Getting quotas for project 4bdd5041b39341dabb21291b1c8ad610. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:58.512320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8fd75fc0-b99a-4ffd-a601-b17959d4f117 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Getting quotas for user 319cac6b75544f9db91d8f3bab7d6a67 and project 4bdd5041b39341dabb21291b1c8ad610. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:08:58.594471 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8fd75fc0-b99a-4ffd-a601-b17959d4f117 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138954 Jul 26 14:08:58.604834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ed1492d9-dd2d-4ef9-8bf4-b0d40dcc0440 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:58.606241 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 593/1258] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:08:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:58.613138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-fb94b29b-d7ae-4e72-9a01-610c39d77e21 req-ce4accf6-621f-491a-ad9c-10e314be8596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a345c969-f3a8-466b-9909-8fea3469456b", "name": "network-vif-plugged", "status": "completed", "tag": "3d1684cb-2ff6-4116-a7f5-540e7296d1f3"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:58.635145 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed1492d9-dd2d-4ef9-8bf4-b0d40dcc0440 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1318 microversion: 2.1 time: 0.601960 Jul 26 14:08:58.636006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fb94b29b-d7ae-4e72-9a01-610c39d77e21 req-ce4accf6-621f-491a-ad9c-10e314be8596 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:58.642841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fb94b29b-d7ae-4e72-9a01-610c39d77e21 req-ce4accf6-621f-491a-ad9c-10e314be8596 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:58.653467 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 666/1259] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:58 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1318 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:58.661271 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-fb94b29b-d7ae-4e72-9a01-610c39d77e21 req-ce4accf6-621f-491a-ad9c-10e314be8596 service nova] Creating event network-vif-plugged:3d1684cb-2ff6-4116-a7f5-540e7296d1f3 for instance a345c969-f3a8-466b-9909-8fea3469456b on n-h1-833090-9 Jul 26 14:08:58.663633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e39a6106-65bb-4ad6-b1b1-feef22d2ba78 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:58.665008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e39a6106-65bb-4ad6-b1b1-feef22d2ba78 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:58.667982 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-fb94b29b-d7ae-4e72-9a01-610c39d77e21 req-ce4accf6-621f-491a-ad9c-10e314be8596 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059164 Jul 26 14:08:58.672781 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 594/1260] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:08:58.679262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-40a38fd2-ecfa-43f9-a939-cb1536ce0fbe tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:58.685736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e39a6106-65bb-4ad6-b1b1-feef22d2ba78 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:58.688028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-40a38fd2-ecfa-43f9-a939-cb1536ce0fbe tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:58.690319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e39a6106-65bb-4ad6-b1b1-feef22d2ba78 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:58.693335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e39a6106-65bb-4ad6-b1b1-feef22d2ba78 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:58.696272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e39a6106-65bb-4ad6-b1b1-feef22d2ba78 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:58.705939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40a38fd2-ecfa-43f9-a939-cb1536ce0fbe tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:58.717498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40a38fd2-ecfa-43f9-a939-cb1536ce0fbe tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:58.734690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40a38fd2-ecfa-43f9-a939-cb1536ce0fbe tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:58.737009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40a38fd2-ecfa-43f9-a939-cb1536ce0fbe tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:58.803548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:08:59.777953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-40a38fd2-ecfa-43f9-a939-cb1536ce0fbe tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:59.805072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e39a6106-65bb-4ad6-b1b1-feef22d2ba78 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:08:59.811153 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-40a38fd2-ecfa-43f9-a939-cb1536ce0fbe tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1471 microversion: 2.1 time: 1.135913 Jul 26 14:08:59.811806 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 595/1261] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:58 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1471 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:59.818124 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e39a6106-65bb-4ad6-b1b1-feef22d2ba78 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1319 microversion: 2.1 time: 1.162883 Jul 26 14:08:59.829626 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 667/1262] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:58 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1319 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:08:59.839762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d57b5be8-54bd-4c0c-9f67-bfdb818eca19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:08:59.843119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-63c06db4-e105-4cfb-833e-03976d62b3a1 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Action: 'create', calling method: .version_select at 0x7f8787ce9040>, body: {"keypair": {"name": "tempest-keypair-1930851535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZXa5ZYTFCU5VxKoPRY/GrCX5+DgixejezmfWwnHVumjRQ34wGWjlYCRkyEXdi98/wO5bpbmyI3Ao4UuBJ1O27l6tlGb8SRnAGY8+dj6WaoyERPqG7+/vWt0MTxmOgFTA=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:08:59.847602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d57b5be8-54bd-4c0c-9f67-bfdb818eca19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:08:59.871831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d57b5be8-54bd-4c0c-9f67-bfdb818eca19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:59.875457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d57b5be8-54bd-4c0c-9f67-bfdb818eca19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:59.877183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d57b5be8-54bd-4c0c-9f67-bfdb818eca19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:08:59.882863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d57b5be8-54bd-4c0c-9f67-bfdb818eca19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:08:59.923639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-63c06db4-e105-4cfb-833e-03976d62b3a1 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Getting quotas for project 4bdd5041b39341dabb21291b1c8ad610. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:08:59.943311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-63c06db4-e105-4cfb-833e-03976d62b3a1 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Getting quotas for user 319cac6b75544f9db91d8f3bab7d6a67 and project 4bdd5041b39341dabb21291b1c8ad610. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:00.007193 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-63c06db4-e105-4cfb-833e-03976d62b3a1 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] HTTP exception thrown: Key pair 'tempest-keypair-1930851535' already exists. Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-63c06db4-e105-4cfb-833e-03976d62b3a1 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Request method failure captured: Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 273 Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_V4lr2Euuykj70PLNlRGQEPxa8w-j6mSe_fKYr-_DkA-tFAvyj_w_RET-JPi6wSoXkrb2df7n8KoaycnXwBSZrLm9gyZDfzbeJu9jAI2hYkDKXWtY5-9R2NOLTkc8o7QIkjP2wf9J-BkuZ8xYweDjDI3_oROFkXoD1Aesxe-iQkOxU Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4bdd5041b39341dabb21291b1c8ad610", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}] Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: {"keypair": {"name": "tempest-keypair-1930851535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZXa5ZYTFCU5VxKoPRY/GrCX5+DgixejezmfWwnHVumjRQ34wGWjlYCRkyEXdi98/wO5bpbmyI3Ao4UuBJ1O27l6tlGb8SRnAGY8+dj6WaoyERPqG7+/vWt0MTxmOgFTA=="}} Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: exception: Key pair 'tempest-keypair-1930851535' already exists. Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1930851535', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZXa5ZYTFCU5VxKoPRY/GrCX5+DgixejezmfWwnHVumjRQ34wGWjlYCRkyEXdi98/wO5bpbmyI3Ao4UuBJ1O27l6tlGb8SRnAGY8+dj6WaoyERPqG7+/vWt0MTxmOgFTA=='}}} Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result.read() Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '319cac6b75544f9db91d8f3bab7d6a67-tempest-keypair-1930851535' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 26 14:09:00.014333 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi session.flush() Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result.read() Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 26 14:09:00.019879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '319cac6b75544f9db91d8f3bab7d6a67-tempest-keypair-1930851535' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 26, 14, 8, 59, 993679), 'updated_at': None, 'name': 'tempest-keypair-1930851535', 'user_id': '319cac6b75544f9db91d8f3bab7d6a67', 'fingerprint': 'd1:4e:1b:53:44:80:a5:b3:a1:2d:b6:f6:db:df:03:20', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZXa5ZYTFCU5VxKoPRY/GrCX5+DgixejezmfWwnHVumjRQ34wGWjlYCRkyEXdi98/wO5bpbmyI3Ao4UuBJ1O27l6tlGb8SRnAGY8+dj6WaoyERPqG7+/vWt0MTxmOgFTA==', 'type': 'ssh'}] Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi keypair.create() Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._create() Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1930851535' already exists. Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 26 14:09:00.030115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1930851535' already exists. Jul 26 14:09:00.038417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.038417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:00.038417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.038417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.038417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:00.038417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:00.038417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:09:00.038417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:09:00.038417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1930851535' already exists. Jul 26 14:09:00.038417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.046678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-63c06db4-e105-4cfb-833e-03976d62b3a1 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Returning 409 to user: Key pair 'tempest-keypair-1930851535' already exists. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:09:00.048124 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-63c06db4-e105-4cfb-833e-03976d62b3a1 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.222058 Jul 26 14:09:00.049021 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 596/1263] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:08:59 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 225 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:09:00.058754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bd295b89-fb02-4681-a45d-e0a5dd144aaa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:00.065435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bd295b89-fb02-4681-a45d-e0a5dd144aaa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:00.084622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd295b89-fb02-4681-a45d-e0a5dd144aaa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:00.088130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd295b89-fb02-4681-a45d-e0a5dd144aaa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:00.089248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd295b89-fb02-4681-a45d-e0a5dd144aaa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:00.092344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd295b89-fb02-4681-a45d-e0a5dd144aaa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:00.634203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d57b5be8-54bd-4c0c-9f67-bfdb818eca19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:00.649799 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d57b5be8-54bd-4c0c-9f67-bfdb818eca19 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 0.818556 Jul 26 14:09:00.670311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bd295b89-fb02-4681-a45d-e0a5dd144aaa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:00.674493 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 668/1264] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:08:59 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:00.683399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-39d80274-2b3c-4ea4-8ae9-5d31ecc74710 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Calling method '.version_select at 0x7f8787ee50d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:00.685409 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bd295b89-fb02-4681-a45d-e0a5dd144aaa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1318 microversion: 2.1 time: 0.634314 Jul 26 14:09:00.686626 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 597/1265] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:00 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:00.730248 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-39d80274-2b3c-4ea4-8ae9-5d31ecc74710 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930851535" status: 202 len: 0 microversion: 2.1 time: 0.054040 Jul 26 14:09:00.731717 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 669/1266] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:09:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930851535 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:09:00.756350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-015db86e-2d8d-425d-aea9-ebaff3a47152 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Action: 'create', calling method: .version_select at 0x7f8787cf8d30>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1soItTtxXnWHqrNs45HVoBXtbhTdZ/r6MRK/nsS1IfdgglqijVI8r5sH0EcAG/uHpcPNydowTNo68ZvyY0EMM9DtYOziP5q6rZmdNxS2iZJL7GKWvSl64H9C3T0IAIig=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-015db86e-2d8d-425d-aea9-ebaff3a47152 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Request method failure captured: Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 247 Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_V4lr2Euuykj70PLNlRGQEPxa8w-j6mSe_fKYr-_DkA-tFAvyj_w_RET-JPi6wSoXkrb2df7n8KoaycnXwBSZrLm9gyZDfzbeJu9jAI2hYkDKXWtY5-9R2NOLTkc8o7QIkjP2wf9J-BkuZ8xYweDjDI3_oROFkXoD1Aesxe-iQkOxU Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4bdd5041b39341dabb21291b1c8ad610", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}] Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1soItTtxXnWHqrNs45HVoBXtbhTdZ/r6MRK/nsS1IfdgglqijVI8r5sH0EcAG/uHpcPNydowTNo68ZvyY0EMM9DtYOziP5q6rZmdNxS2iZJL7GKWvSl64H9C3T0IAIig=="}} Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1soItTtxXnWHqrNs45HVoBXtbhTdZ/r6MRK/nsS1IfdgglqijVI8r5sH0EcAG/uHpcPNydowTNo68ZvyY0EMM9DtYOziP5q6rZmdNxS2iZJL7GKWvSl64H9C3T0IAIig=='}}} Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi '' Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:09:00.762338 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:09:00.772215 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.777528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-015db86e-2d8d-425d-aea9-ebaff3a47152 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:09:00.778446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a4d8a378-a6dd-4f35-aac6-9626c68e5d82 req-c0efd2e7-30fa-4844-a08b-fa7a60f1f494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d38f13-5f5e-4574-b415-d21bb454b9d2", "name": "network-vif-plugged", "status": "completed", "tag": "133fb10c-c93f-49e6-9134-3165e0e34866"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:00.780159 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-015db86e-2d8d-425d-aea9-ebaff3a47152 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.034659 Jul 26 14:09:00.786485 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 598/1267] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:09:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:09:00.795043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b96a28ee-f9ba-4d46-81f4-a1fe7016f34c tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Action: 'create', calling method: .version_select at 0x7f8787cebc10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-836658287", "public_key": " "}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:00.803115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a4d8a378-a6dd-4f35-aac6-9626c68e5d82 req-c0efd2e7-30fa-4844-a08b-fa7a60f1f494 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:00.803933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a4d8a378-a6dd-4f35-aac6-9626c68e5d82 req-c0efd2e7-30fa-4844-a08b-fa7a60f1f494 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:00.817162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b96a28ee-f9ba-4d46-81f4-a1fe7016f34c tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Getting quotas for project 4bdd5041b39341dabb21291b1c8ad610. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:00.823253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:00.831344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b96a28ee-f9ba-4d46-81f4-a1fe7016f34c tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Getting quotas for user 319cac6b75544f9db91d8f3bab7d6a67 and project 4bdd5041b39341dabb21291b1c8ad610. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:00.852431 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a4d8a378-a6dd-4f35-aac6-9626c68e5d82 req-c0efd2e7-30fa-4844-a08b-fa7a60f1f494 service nova] Creating event network-vif-plugged:133fb10c-c93f-49e6-9134-3165e0e34866 for instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 on n-h2-833090-9 Jul 26 14:09:00.866628 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a4d8a378-a6dd-4f35-aac6-9626c68e5d82 req-c0efd2e7-30fa-4844-a08b-fa7a60f1f494 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091636 Jul 26 14:09:00.867656 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 670/1268] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:00.868101 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b96a28ee-f9ba-4d46-81f4-a1fe7016f34c tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 26 14:09:00.874901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8d2e99c5-36d9-4b81-b0b6-34ea06df709d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:00.875637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8d2e99c5-36d9-4b81-b0b6-34ea06df709d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b96a28ee-f9ba-4d46-81f4-a1fe7016f34c tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Request method failure captured: Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 94 Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_V4lr2Euuykj70PLNlRGQEPxa8w-j6mSe_fKYr-_DkA-tFAvyj_w_RET-JPi6wSoXkrb2df7n8KoaycnXwBSZrLm9gyZDfzbeJu9jAI2hYkDKXWtY5-9R2NOLTkc8o7QIkjP2wf9J-BkuZ8xYweDjDI3_oROFkXoD1Aesxe-iQkOxU Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4bdd5041b39341dabb21291b1c8ad610", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}] Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-836658287", "public_key": " "}} Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: exception: Keypair data is invalid: failed to generate fingerprint Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-836658287', 'public_key': ' '}}} Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:00.876880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b96a28ee-f9ba-4d46-81f4-a1fe7016f34c tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:09:00.881818 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b96a28ee-f9ba-4d46-81f4-a1fe7016f34c tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.090007 Jul 26 14:09:00.884138 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 599/1269] 10.222.0.70 () {60 vars in 1158 bytes} [Tue Jul 26 14:09:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:09:00.890725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d2e99c5-36d9-4b81-b0b6-34ea06df709d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:00.891190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d2e99c5-36d9-4b81-b0b6-34ea06df709d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:00.892104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d2e99c5-36d9-4b81-b0b6-34ea06df709d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:00.894494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eecd7722-7c42-42e1-8666-c816770b83d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:00.895126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eecd7722-7c42-42e1-8666-c816770b83d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:00.904705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d2e99c5-36d9-4b81-b0b6-34ea06df709d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:00.919273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eecd7722-7c42-42e1-8666-c816770b83d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:00.920809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eecd7722-7c42-42e1-8666-c816770b83d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:00.922973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eecd7722-7c42-42e1-8666-c816770b83d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:00.923760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eecd7722-7c42-42e1-8666-c816770b83d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:01.402286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-eecd7722-7c42-42e1-8666-c816770b83d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:01.429165 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eecd7722-7c42-42e1-8666-c816770b83d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1319 microversion: 2.1 time: 0.542835 Jul 26 14:09:01.430286 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 600/1270] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:00 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:01.442615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cfe9adbf-3281-406a-a676-ff32443ae1db tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Action: 'create', calling method: .version_select at 0x7f8787cf8e50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJBOXePVjNOJvkWUDwLsNvhVpcxLFC8oNWKkvkMUqhdlwZoxsPJmjP2cmzCjTpjlaKNHeaijLCCOgMQFvlfXKPQSH+UEJG2ib/IxCLF1UzAz21AwSYaSW0+NCxsRthPlQ=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cfe9adbf-3281-406a-a676-ff32443ae1db tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Request method failure captured: Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 507 Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_V4lr2Euuykj70PLNlRGQEPxa8w-j6mSe_fKYr-_DkA-tFAvyj_w_RET-JPi6wSoXkrb2df7n8KoaycnXwBSZrLm9gyZDfzbeJu9jAI2hYkDKXWtY5-9R2NOLTkc8o7QIkjP2wf9J-BkuZ8xYweDjDI3_oROFkXoD1Aesxe-iQkOxU Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4bdd5041b39341dabb21291b1c8ad610", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}] Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJBOXePVjNOJvkWUDwLsNvhVpcxLFC8oNWKkvkMUqhdlwZoxsPJmjP2cmzCjTpjlaKNHeaijLCCOgMQFvlfXKPQSH+UEJG2ib/IxCLF1UzAz21AwSYaSW0+NCxsRthPlQ=="}} Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJBOXePVjNOJvkWUDwLsNvhVpcxLFC8oNWKkvkMUqhdlwZoxsPJmjP2cmzCjTpjlaKNHeaijLCCOgMQFvlfXKPQSH+UEJG2ib/IxCLF1UzAz21AwSYaSW0+NCxsRthPlQ=='}}} Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 26 14:09:01.489736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 26 14:09:01.495026 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.501047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cfe9adbf-3281-406a-a676-ff32443ae1db tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:09:01.505532 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cfe9adbf-3281-406a-a676-ff32443ae1db tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.070474 Jul 26 14:09:01.515044 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 601/1271] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:09:01 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 84 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:09:01.525801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6c7f81de-0040-47c0-bfb6-fecb65f797cf tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Action: 'create', calling method: .version_select at 0x7f8787d07940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1283955481", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:01.597284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8d2e99c5-36d9-4b81-b0b6-34ea06df709d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:01.601885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-6c7f81de-0040-47c0-bfb6-fecb65f797cf tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Getting quotas for project 4bdd5041b39341dabb21291b1c8ad610. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:01.610777 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8d2e99c5-36d9-4b81-b0b6-34ea06df709d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1468 microversion: 2.1 time: 0.739938 Jul 26 14:09:01.612138 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 671/1272] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:00 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1468 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:01.616589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-6c7f81de-0040-47c0-bfb6-fecb65f797cf tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Getting quotas for user 319cac6b75544f9db91d8f3bab7d6a67 and project 4bdd5041b39341dabb21291b1c8ad610. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:01.644521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e5966d39-766f-4e49-a754-e17f50dabae3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:01.649802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e5966d39-766f-4e49-a754-e17f50dabae3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:01.670884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5966d39-766f-4e49-a754-e17f50dabae3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:01.672071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5966d39-766f-4e49-a754-e17f50dabae3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:01.676529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5966d39-766f-4e49-a754-e17f50dabae3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:01.677338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5966d39-766f-4e49-a754-e17f50dabae3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:01.682944 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-6c7f81de-0040-47c0-bfb6-fecb65f797cf tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6c7f81de-0040-47c0-bfb6-fecb65f797cf tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Request method failure captured: Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 118 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_V4lr2Euuykj70PLNlRGQEPxa8w-j6mSe_fKYr-_DkA-tFAvyj_w_RET-JPi6wSoXkrb2df7n8KoaycnXwBSZrLm9gyZDfzbeJu9jAI2hYkDKXWtY5-9R2NOLTkc8o7QIkjP2wf9J-BkuZ8xYweDjDI3_oROFkXoD1Aesxe-iQkOxU Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4bdd5041b39341dabb21291b1c8ad610", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}] Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1283955481", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: exception: Keypair data is invalid: failed to generate fingerprint Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1283955481', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 26 14:09:01.687146 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 26 14:09:01.693028 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:01.696958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6c7f81de-0040-47c0-bfb6-fecb65f797cf tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:09:01.698320 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6c7f81de-0040-47c0-bfb6-fecb65f797cf tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.179178 Jul 26 14:09:01.705762 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 602/1273] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:09:01 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:09:01.712132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d0f92ebb-add9-447e-92af-891379b20891 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:01.713054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d0f92ebb-add9-447e-92af-891379b20891 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:01.722327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0f92ebb-add9-447e-92af-891379b20891 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:01.723163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0f92ebb-add9-447e-92af-891379b20891 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:01.724203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0f92ebb-add9-447e-92af-891379b20891 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:01.724826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0f92ebb-add9-447e-92af-891379b20891 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:01.936659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d0f92ebb-add9-447e-92af-891379b20891 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:01.946744 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e5966d39-766f-4e49-a754-e17f50dabae3 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "POST /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129/action" status: 202 len: 0 microversion: 2.1 time: 0.309943 Jul 26 14:09:01.951575 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 672/1274] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:09:01 2022] POST /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:09:01.957600 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d0f92ebb-add9-447e-92af-891379b20891 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 0.249838 Jul 26 14:09:01.960325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "0cbc5f54-89cb-4eaa-9f6b-4a59388c5773"}], "security_groups": [{"name": "tempest-securitygroup--1061657763"}], "key_name": "tempest-keypair-202666309", "user_data": "}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:01.968542 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 603/1275] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:01 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:01.983601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb27255b-1185-49c1-8253-d6c0457753a7 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Calling method '.version_select at 0x7f8787cf8310>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:02.034087 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-bb27255b-1185-49c1-8253-d6c0457753a7 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-356082189 not found for user 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb27255b-1185-49c1-8253-d6c0457753a7 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Request method failure captured: Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-356082189 HTTP/1.1 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_V4lr2Euuykj70PLNlRGQEPxa8w-j6mSe_fKYr-_DkA-tFAvyj_w_RET-JPi6wSoXkrb2df7n8KoaycnXwBSZrLm9gyZDfzbeJu9jAI2hYkDKXWtY5-9R2NOLTkc8o7QIkjP2wf9J-BkuZ8xYweDjDI3_oROFkXoD1Aesxe-iQkOxU Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4bdd5041b39341dabb21291b1c8ad610"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4bdd5041b39341dabb21291b1c8ad610", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4bdd5041b39341dabb21291b1c8ad610"}]}] Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4bdd5041b39341dabb21291b1c8ad610 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2021892744 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2021892744-project Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: exception: Keypair tempest-keypair-non-existent-356082189 not found for user 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'tempest-keypair-non-existent-356082189'} Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-356082189 not found for user 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:02.051994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-356082189 not found for user 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-356082189 not found for user 319cac6b75544f9db91d8f3bab7d6a67 Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb27255b-1185-49c1-8253-d6c0457753a7 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] Returning 404 to user: Keypair tempest-keypair-non-existent-356082189 not found for user 319cac6b75544f9db91d8f3bab7d6a67 {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:09:02.059181 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bb27255b-1185-49c1-8253-d6c0457753a7 tempest-KeyPairsNegativeTestJSON-2021892744 tempest-KeyPairsNegativeTestJSON-2021892744-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-356082189" status: 404 len: 144 microversion: 2.1 time: 0.082801 Jul 26 14:09:02.075199 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 604/1276] 10.222.0.70 () {58 vars in 1257 bytes} [Tue Jul 26 14:09:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-356082189 => generated 144 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:09:02.095038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a41cb2c7-4d7b-4f79-8b18-990b765f2e59 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:02.097676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a41cb2c7-4d7b-4f79-8b18-990b765f2e59 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:02.122137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a41cb2c7-4d7b-4f79-8b18-990b765f2e59 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:02.122698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a41cb2c7-4d7b-4f79-8b18-990b765f2e59 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:02.123855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a41cb2c7-4d7b-4f79-8b18-990b765f2e59 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:02.124907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a41cb2c7-4d7b-4f79-8b18-990b765f2e59 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:02.446289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] validate_networks() for [('0cbc5f54-89cb-4eaa-9f6b-4a59388c5773', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:09:02.804287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a41cb2c7-4d7b-4f79-8b18-990b765f2e59 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:02.815765 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a41cb2c7-4d7b-4f79-8b18-990b765f2e59 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1318 microversion: 2.1 time: 0.738491 Jul 26 14:09:02.827988 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 605/1277] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:02 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:02.827988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0554ae98-434b-4ff4-b0ed-eb7b9881ab0f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:02.827988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0554ae98-434b-4ff4-b0ed-eb7b9881ab0f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:02.852730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0554ae98-434b-4ff4-b0ed-eb7b9881ab0f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:02.853296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0554ae98-434b-4ff4-b0ed-eb7b9881ab0f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:02.855189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0554ae98-434b-4ff4-b0ed-eb7b9881ab0f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:02.856344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0554ae98-434b-4ff4-b0ed-eb7b9881ab0f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:03.503147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0554ae98-434b-4ff4-b0ed-eb7b9881ab0f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:03.541773 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0554ae98-434b-4ff4-b0ed-eb7b9881ab0f tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1467 microversion: 2.1 time: 0.723871 Jul 26 14:09:03.550717 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 606/1278] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:02 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1467 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:03.567575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6f6f51bf-1b03-4917-bd34-9944aaba5187 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:03.572692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6f6f51bf-1b03-4917-bd34-9944aaba5187 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:03.625365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f6f51bf-1b03-4917-bd34-9944aaba5187 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:03.626359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f6f51bf-1b03-4917-bd34-9944aaba5187 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:03.628206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f6f51bf-1b03-4917-bd34-9944aaba5187 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:03.630604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f6f51bf-1b03-4917-bd34-9944aaba5187 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:04.105742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:09:04.106335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:09:04.107762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:09:04.108616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:09:04.109343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:09:04.124176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:04.126590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:04.130314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:04.130769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:04.197642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Getting quotas for project 81bcf05a19b54acbb86a46e6d8e8962e. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:04.218434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Getting quotas for user 4e385295d84f494986de9861dbc068da and project 81bcf05a19b54acbb86a46e6d8e8962e. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:04.252973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:09:04.258356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:09:04.356049 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3c6f0964-113b-4444-a288-8cf69cf8e303 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.401688 Jul 26 14:09:04.358626 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 673/1279] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:09:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 2406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:09:04.365212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6f6f51bf-1b03-4917-bd34-9944aaba5187 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:04.366564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56ace40c-610f-4b74-9973-6413961ce588 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:04.367531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56ace40c-610f-4b74-9973-6413961ce588 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:04.386186 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6f6f51bf-1b03-4917-bd34-9944aaba5187 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1467 microversion: 2.1 time: 0.833177 Jul 26 14:09:04.394191 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 607/1280] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:03 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1467 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:04.395495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56ace40c-610f-4b74-9973-6413961ce588 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:04.396003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56ace40c-610f-4b74-9973-6413961ce588 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:04.396703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-01dad307-19a1-40bd-a6f0-e67295e45728 req-7bba05f8-222f-46d1-815a-65c7eae42915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e080b-51bc-48e9-9b38-a4c49734b15d", "name": "network-vif-plugged", "status": "completed", "tag": "54d86a16-b218-474f-8fa1-ab8322e59564"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:04.397185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56ace40c-610f-4b74-9973-6413961ce588 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:04.397801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56ace40c-610f-4b74-9973-6413961ce588 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:04.433057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-01dad307-19a1-40bd-a6f0-e67295e45728 req-7bba05f8-222f-46d1-815a-65c7eae42915 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:04.433915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-01dad307-19a1-40bd-a6f0-e67295e45728 req-7bba05f8-222f-46d1-815a-65c7eae42915 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:04.470178 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-01dad307-19a1-40bd-a6f0-e67295e45728 req-7bba05f8-222f-46d1-815a-65c7eae42915 service nova] Creating event network-vif-plugged:54d86a16-b218-474f-8fa1-ab8322e59564 for instance 807e080b-51bc-48e9-9b38-a4c49734b15d on n-h2-833090-9 Jul 26 14:09:04.491661 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-01dad307-19a1-40bd-a6f0-e67295e45728 req-7bba05f8-222f-46d1-815a-65c7eae42915 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099324 Jul 26 14:09:04.492964 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 608/1281] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:04.499273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f16a90d3-b48c-4eb0-9acd-ab6f76477b71 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:04.510587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f16a90d3-b48c-4eb0-9acd-ab6f76477b71 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:04.527769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f16a90d3-b48c-4eb0-9acd-ab6f76477b71 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:04.528571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f16a90d3-b48c-4eb0-9acd-ab6f76477b71 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:04.530302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f16a90d3-b48c-4eb0-9acd-ab6f76477b71 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:04.533348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f16a90d3-b48c-4eb0-9acd-ab6f76477b71 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:05.116166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56ace40c-610f-4b74-9973-6413961ce588 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:05.125999 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56ace40c-610f-4b74-9973-6413961ce588 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 0.765683 Jul 26 14:09:05.131894 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 674/1282] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:04 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:05.146809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-72cc5821-46e6-40a9-bb34-886c115f6a6c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:05.150041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-72cc5821-46e6-40a9-bb34-886c115f6a6c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:05.168386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f16a90d3-b48c-4eb0-9acd-ab6f76477b71 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:05.211980 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f16a90d3-b48c-4eb0-9acd-ab6f76477b71 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1318 microversion: 2.1 time: 0.717193 Jul 26 14:09:05.225681 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 609/1283] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:04 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:05.281115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f4e2e813-e591-48a4-974c-d9d64c7002cd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:05.282696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f4e2e813-e591-48a4-974c-d9d64c7002cd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: d1c18346-82e5-42e8-82cc-b82ac00dea9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:05.303438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4e2e813-e591-48a4-974c-d9d64c7002cd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:05.305241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4e2e813-e591-48a4-974c-d9d64c7002cd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:05.306654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4e2e813-e591-48a4-974c-d9d64c7002cd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:05.311350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4e2e813-e591-48a4-974c-d9d64c7002cd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:05.585779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-72cc5821-46e6-40a9-bb34-886c115f6a6c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e385295d84f494986de9861dbc068da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bcf05a19b54acbb86a46e6d8e8962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:05.622458 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-72cc5821-46e6-40a9-bb34-886c115f6a6c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 200 len: 1225 microversion: 2.1 time: 0.488151 Jul 26 14:09:05.658342 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 675/1284] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:05 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 1225 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:05.684581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e25b35df-ce2a-4285-8862-19236b3b9988 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:05.686676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e25b35df-ce2a-4285-8862-19236b3b9988 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:05.706376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e25b35df-ce2a-4285-8862-19236b3b9988 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:05.721614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e25b35df-ce2a-4285-8862-19236b3b9988 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:05.724736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e25b35df-ce2a-4285-8862-19236b3b9988 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:05.725979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e25b35df-ce2a-4285-8862-19236b3b9988 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:06.103493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e25b35df-ce2a-4285-8862-19236b3b9988 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:06.118435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4e2e813-e591-48a4-974c-d9d64c7002cd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:06.132162 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e25b35df-ce2a-4285-8862-19236b3b9988 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1467 microversion: 2.1 time: 0.467382 Jul 26 14:09:06.134283 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 676/1285] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:05 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1467 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:06.140793 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f4e2e813-e591-48a4-974c-d9d64c7002cd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c" status: 200 len: 1468 microversion: 2.1 time: 0.913141 Jul 26 14:09:06.144576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3a96f36-1144-4f35-a73d-cded7e92ae75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:06.145411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b3a96f36-1144-4f35-a73d-cded7e92ae75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:06.152543 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 610/1286] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:05 2022] GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c => generated 1468 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:06.157945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3a96f36-1144-4f35-a73d-cded7e92ae75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:06.159284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3a96f36-1144-4f35-a73d-cded7e92ae75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:06.160506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3a96f36-1144-4f35-a73d-cded7e92ae75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:06.161022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3a96f36-1144-4f35-a73d-cded7e92ae75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:06.173286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:06.580367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f2b2e44c-e550-42a4-97d8-8aa57f477405 tempest-AbsoluteLimitsTestJSON-2080617639 tempest-AbsoluteLimitsTestJSON-2080617639-project] Calling method '.version_select at 0x7f8787ceb5e0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:06.597935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2b2e44c-e550-42a4-97d8-8aa57f477405 tempest-AbsoluteLimitsTestJSON-2080617639 tempest-AbsoluteLimitsTestJSON-2080617639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:06.598698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2b2e44c-e550-42a4-97d8-8aa57f477405 tempest-AbsoluteLimitsTestJSON-2080617639 tempest-AbsoluteLimitsTestJSON-2080617639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:06.599678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2b2e44c-e550-42a4-97d8-8aa57f477405 tempest-AbsoluteLimitsTestJSON-2080617639 tempest-AbsoluteLimitsTestJSON-2080617639-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:06.600322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2b2e44c-e550-42a4-97d8-8aa57f477405 tempest-AbsoluteLimitsTestJSON-2080617639 tempest-AbsoluteLimitsTestJSON-2080617639-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:06.642714 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f2b2e44c-e550-42a4-97d8-8aa57f477405 tempest-AbsoluteLimitsTestJSON-2080617639 tempest-AbsoluteLimitsTestJSON-2080617639-project] 10.222.0.70 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.488537 Jul 26 14:09:06.643314 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 611/1287] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Jul 26 14:09:06 2022] GET /compute/v2.1/limits => generated 511 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:06.652018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ce477f1-caf4-4f68-8e55-cb0abfab837d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:06.652646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ce477f1-caf4-4f68-8e55-cb0abfab837d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:06.665970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ce477f1-caf4-4f68-8e55-cb0abfab837d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:06.666447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ce477f1-caf4-4f68-8e55-cb0abfab837d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:06.667217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ce477f1-caf4-4f68-8e55-cb0abfab837d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:06.667662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ce477f1-caf4-4f68-8e55-cb0abfab837d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:06.901507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-b3a96f36-1144-4f35-a73d-cded7e92ae75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 38cbff42-6659-4317-bf61-7f5f2aaaa942 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:09:06.970736 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3a96f36-1144-4f35-a73d-cded7e92ae75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 2342 microversion: 2.25 time: 0.821341 Jul 26 14:09:06.993399 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 677/1288] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:09:06 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 2342 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:09:07.033863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:07.046276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:07.047860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Searching by: {'reservation_id': 'r-wn0ftatc', 'deleted': False, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:09:07.059004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:07.059864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:07.062319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:07.071908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:07.468357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:09:07.576969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8ce477f1-caf4-4f68-8e55-cb0abfab837d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:07.591983 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ce477f1-caf4-4f68-8e55-cb0abfab837d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 0.946735 Jul 26 14:09:07.592633 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 612/1289] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:06 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:07.608416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ab73a260-2c1c-4410-970c-21aa08422e64 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:07.609327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ab73a260-2c1c-4410-970c-21aa08422e64 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:07.624973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab73a260-2c1c-4410-970c-21aa08422e64 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:07.625728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab73a260-2c1c-4410-970c-21aa08422e64 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:07.626726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab73a260-2c1c-4410-970c-21aa08422e64 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:07.627751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab73a260-2c1c-4410-970c-21aa08422e64 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:07.666687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:07.687160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:07.690397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:08.260480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ab73a260-2c1c-4410-970c-21aa08422e64 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:08.280308 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ab73a260-2c1c-4410-970c-21aa08422e64 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1467 microversion: 2.1 time: 0.685089 Jul 26 14:09:08.282686 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 613/1290] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:07 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1467 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:08.304777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-949d9fa6-2071-4486-a6ca-528d1a49e4d0 req-93e6f374-7148-48ff-8682-a7900d7802a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8beadb53-ad09-4a21-a4b8-1a8d1e561129", "name": "network-vif-plugged", "status": "completed", "tag": "81fe2ba7-46e4-409a-8bd8-03c67c1e0702"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:08.327275 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b7316fc6-47c7-46bd-8db0-835a56d976c2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?reservation_id=r-wn0ftatc" status: 200 len: 2928 microversion: 2.1 time: 1.320626 Jul 26 14:09:08.329373 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 678/1291] 10.222.0.70 () {58 vars in 1197 bytes} [Tue Jul 26 14:09:06 2022] GET /compute/v2.1/servers/detail?reservation_id=r-wn0ftatc => generated 2928 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:08.345599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-949d9fa6-2071-4486-a6ca-528d1a49e4d0 req-93e6f374-7148-48ff-8682-a7900d7802a1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:08.346614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bb2ed488-66ed-48c0-812f-f94cf34086d1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:08.350569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-949d9fa6-2071-4486-a6ca-528d1a49e4d0 req-93e6f374-7148-48ff-8682-a7900d7802a1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:08.351888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bb2ed488-66ed-48c0-812f-f94cf34086d1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:08.368097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb2ed488-66ed-48c0-812f-f94cf34086d1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:08.371636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb2ed488-66ed-48c0-812f-f94cf34086d1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:08.377741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb2ed488-66ed-48c0-812f-f94cf34086d1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:08.382351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb2ed488-66ed-48c0-812f-f94cf34086d1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:08.395153 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-949d9fa6-2071-4486-a6ca-528d1a49e4d0 req-93e6f374-7148-48ff-8682-a7900d7802a1 service nova] Creating event network-vif-plugged:81fe2ba7-46e4-409a-8bd8-03c67c1e0702 for instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 on n-h2-833090-9 Jul 26 14:09:08.411157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-949d9fa6-2071-4486-a6ca-528d1a49e4d0 req-93e6f374-7148-48ff-8682-a7900d7802a1 service nova] Instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:09:08.459702 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-949d9fa6-2071-4486-a6ca-528d1a49e4d0 req-93e6f374-7148-48ff-8682-a7900d7802a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174602 Jul 26 14:09:08.460759 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 614/1292] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:08.475893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0cf5e81-0f6a-45df-90c0-5da809d911a1 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:08.480278 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:09:08.480278 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:09:08.484329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0cf5e81-0f6a-45df-90c0-5da809d911a1 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:08.485411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0cf5e81-0f6a-45df-90c0-5da809d911a1 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:08.488399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0cf5e81-0f6a-45df-90c0-5da809d911a1 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:08.490023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0cf5e81-0f6a-45df-90c0-5da809d911a1 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:08.547162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c0cf5e81-0f6a-45df-90c0-5da809d911a1 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.078139 Jul 26 14:09:08.550824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bb2ed488-66ed-48c0-812f-f94cf34086d1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e385295d84f494986de9861dbc068da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bcf05a19b54acbb86a46e6d8e8962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:08.562111 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 615/1293] 10.222.0.70 () {60 vars in 1217 bytes} [Tue Jul 26 14:09:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:09:08.570104 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bb2ed488-66ed-48c0-812f-f94cf34086d1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 200 len: 1283 microversion: 2.1 time: 0.238723 Jul 26 14:09:08.575226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5a45aa1a-7a0c-4f40-96bc-100ea7c642c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:08.577437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5a45aa1a-7a0c-4f40-96bc-100ea7c642c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:08.584719 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 679/1294] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:08 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 1283 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:08.601528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a45aa1a-7a0c-4f40-96bc-100ea7c642c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:08.603465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a45aa1a-7a0c-4f40-96bc-100ea7c642c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:08.606917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d80eeca1-2386-4aa5-a6d1-9c7fb6dcdd1c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:08.608257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d80eeca1-2386-4aa5-a6d1-9c7fb6dcdd1c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:08.608756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a45aa1a-7a0c-4f40-96bc-100ea7c642c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:08.609566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a45aa1a-7a0c-4f40-96bc-100ea7c642c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:08.620300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d80eeca1-2386-4aa5-a6d1-9c7fb6dcdd1c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:08.621741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d80eeca1-2386-4aa5-a6d1-9c7fb6dcdd1c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:08.623198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d80eeca1-2386-4aa5-a6d1-9c7fb6dcdd1c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:08.624139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d80eeca1-2386-4aa5-a6d1-9c7fb6dcdd1c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:09.201586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5a45aa1a-7a0c-4f40-96bc-100ea7c642c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:09.215248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d80eeca1-2386-4aa5-a6d1-9c7fb6dcdd1c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:09.230301 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d80eeca1-2386-4aa5-a6d1-9c7fb6dcdd1c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2" status: 200 len: 1468 microversion: 2.1 time: 0.643635 Jul 26 14:09:09.231366 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 680/1295] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:08 2022] GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2 => generated 1468 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:09.240776 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5a45aa1a-7a0c-4f40-96bc-100ea7c642c0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1467 microversion: 2.1 time: 0.676314 Jul 26 14:09:09.249242 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 616/1296] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:08 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1467 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:09.255475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6bb43876-add1-45bd-b6ad-bc9661dea611 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:09.271587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c9677c94-d32c-4273-bd20-6114cc2df106 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:09.292218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c9677c94-d32c-4273-bd20-6114cc2df106 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:09.315103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9677c94-d32c-4273-bd20-6114cc2df106 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:09.319064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9677c94-d32c-4273-bd20-6114cc2df106 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:09.329501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9677c94-d32c-4273-bd20-6114cc2df106 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:09.333445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9677c94-d32c-4273-bd20-6114cc2df106 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:09.474119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.server_groups [None req-6bb43876-add1-45bd-b6ad-bc9661dea611 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Querying cell b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) for 2 instances {{(pid=119479) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 14:09:09.477670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bb43876-add1-45bd-b6ad-bc9661dea611 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:09.478526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bb43876-add1-45bd-b6ad-bc9661dea611 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:09.596856 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6bb43876-add1-45bd-b6ad-bc9661dea611 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/f6dd8340-f728-4215-9479-c6bcde1c3831" status: 200 len: 266 microversion: 2.1 time: 0.353092 Jul 26 14:09:09.600644 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 681/1297] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:09:09 2022] GET /compute/v2.1/os-server-groups/f6dd8340-f728-4215-9479-c6bcde1c3831 => generated 266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:09.610769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c900cbbc-2c9d-41a2-b64e-c9760a77a178 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1501948438"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:09.616163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c900cbbc-2c9d-41a2-b64e-c9760a77a178 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:09.628668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c900cbbc-2c9d-41a2-b64e-c9760a77a178 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:09.630243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c900cbbc-2c9d-41a2-b64e-c9760a77a178 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:09.632317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c900cbbc-2c9d-41a2-b64e-c9760a77a178 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:09.633666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c900cbbc-2c9d-41a2-b64e-c9760a77a178 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:10.418859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c9677c94-d32c-4273-bd20-6114cc2df106 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:10.468166 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c9677c94-d32c-4273-bd20-6114cc2df106 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 1.210166 Jul 26 14:09:10.477454 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 617/1298] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:09 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:10.497508 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c900cbbc-2c9d-41a2-b64e-c9760a77a178 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "POST /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2/action" status: 202 len: 0 microversion: 2.1 time: 0.893847 Jul 26 14:09:10.502584 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 682/1299] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:09:09 2022] POST /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2/action => generated 0 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 14:09:10.506092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7f1894d-d02f-4d9b-962d-8bbf0243cb84 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:10.508322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c7f1894d-d02f-4d9b-962d-8bbf0243cb84 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:10.525316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-53649e82-a9f0-4f7d-b0c6-f5b949f1fefe tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:10.532295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-53649e82-a9f0-4f7d-b0c6-f5b949f1fefe tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:10.539419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7f1894d-d02f-4d9b-962d-8bbf0243cb84 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:10.542775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7f1894d-d02f-4d9b-962d-8bbf0243cb84 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:10.544777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7f1894d-d02f-4d9b-962d-8bbf0243cb84 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:10.550251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7f1894d-d02f-4d9b-962d-8bbf0243cb84 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:10.561174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53649e82-a9f0-4f7d-b0c6-f5b949f1fefe tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:10.565333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53649e82-a9f0-4f7d-b0c6-f5b949f1fefe tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:10.567064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53649e82-a9f0-4f7d-b0c6-f5b949f1fefe tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:10.568336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53649e82-a9f0-4f7d-b0c6-f5b949f1fefe tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:11.336837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-53649e82-a9f0-4f7d-b0c6-f5b949f1fefe tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e385295d84f494986de9861dbc068da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bcf05a19b54acbb86a46e6d8e8962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:11.347838 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-53649e82-a9f0-4f7d-b0c6-f5b949f1fefe tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 200 len: 1351 microversion: 2.1 time: 0.842873 Jul 26 14:09:11.348985 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 683/1300] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:10 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 1351 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:11.354808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-981d5e4b-6bc0-46dd-ab21-ac9760c3dab0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:11.355882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-981d5e4b-6bc0-46dd-ab21-ac9760c3dab0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:11.378786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-981d5e4b-6bc0-46dd-ab21-ac9760c3dab0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:11.386036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-981d5e4b-6bc0-46dd-ab21-ac9760c3dab0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:11.389671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-981d5e4b-6bc0-46dd-ab21-ac9760c3dab0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:11.390490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-981d5e4b-6bc0-46dd-ab21-ac9760c3dab0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:11.973414 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c7f1894d-d02f-4d9b-962d-8bbf0243cb84 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1618 microversion: 2.1 time: 1.493981 Jul 26 14:09:11.984246 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 618/1301] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:10 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1618 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:12.022489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-981d5e4b-6bc0-46dd-ab21-ac9760c3dab0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:12.022777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e2046afb-586e-4a18-9424-2f67a7a085b0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787ceb5e0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:12.034173 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-981d5e4b-6bc0-46dd-ab21-ac9760c3dab0 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1467 microversion: 2.1 time: 0.683774 Jul 26 14:09:12.035166 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 684/1302] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:11 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1467 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:12.044279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9c67eb6d-8fed-4f66-b611-c39e6220dd1f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:12.051620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9c67eb6d-8fed-4f66-b611-c39e6220dd1f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:12.065987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c67eb6d-8fed-4f66-b611-c39e6220dd1f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:12.066766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c67eb6d-8fed-4f66-b611-c39e6220dd1f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:12.067862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c67eb6d-8fed-4f66-b611-c39e6220dd1f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:12.068570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c67eb6d-8fed-4f66-b611-c39e6220dd1f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:12.261309 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e2046afb-586e-4a18-9424-2f67a7a085b0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/9f99d468-f75d-4b06-85e6-e18a9c2ae40c" status: 200 len: 1455 microversion: 2.1 time: 0.274635 Jul 26 14:09:12.261909 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 619/1303] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:11 2022] GET /compute/v2.1/images/9f99d468-f75d-4b06-85e6-e18a9c2ae40c => generated 1455 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:12.290809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-47ed29d2-181a-4d6c-a9ee-08f31ff7b3f1 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:12.291472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-47ed29d2-181a-4d6c-a9ee-08f31ff7b3f1 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] [instance: d1c18346-82e5-42e8-82cc-b82ac00dea9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:12.311653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47ed29d2-181a-4d6c-a9ee-08f31ff7b3f1 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:12.313310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47ed29d2-181a-4d6c-a9ee-08f31ff7b3f1 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:12.315281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47ed29d2-181a-4d6c-a9ee-08f31ff7b3f1 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:12.316427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47ed29d2-181a-4d6c-a9ee-08f31ff7b3f1 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:13.237242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9c67eb6d-8fed-4f66-b611-c39e6220dd1f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:13.299853 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9c67eb6d-8fed-4f66-b611-c39e6220dd1f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 1.263072 Jul 26 14:09:13.301081 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 685/1304] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:12 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:13.309253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0df27bc3-dd90-4991-b8f2-1a8eaaf8844b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:13.329299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0df27bc3-dd90-4991-b8f2-1a8eaaf8844b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:13.334326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:13.354791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0df27bc3-dd90-4991-b8f2-1a8eaaf8844b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:13.355931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0df27bc3-dd90-4991-b8f2-1a8eaaf8844b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:13.357531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0df27bc3-dd90-4991-b8f2-1a8eaaf8844b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:13.358574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0df27bc3-dd90-4991-b8f2-1a8eaaf8844b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:14.061511 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-47ed29d2-181a-4d6c-a9ee-08f31ff7b3f1 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c" status: 200 len: 1619 microversion: 2.1 time: 1.797698 Jul 26 14:09:14.087442 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 620/1305] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:12 2022] GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c => generated 1619 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:14.113493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-df0afe4a-8503-4da4-b36e-267d95061d49 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:14.116988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-df0afe4a-8503-4da4-b36e-267d95061d49 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:14.134512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df0afe4a-8503-4da4-b36e-267d95061d49 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:14.135990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df0afe4a-8503-4da4-b36e-267d95061d49 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:14.137923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df0afe4a-8503-4da4-b36e-267d95061d49 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:14.139194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df0afe4a-8503-4da4-b36e-267d95061d49 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:14.188542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:14.563638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0df27bc3-dd90-4991-b8f2-1a8eaaf8844b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e385295d84f494986de9861dbc068da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bcf05a19b54acbb86a46e6d8e8962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:14.598813 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0df27bc3-dd90-4991-b8f2-1a8eaaf8844b tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 200 len: 1351 microversion: 2.1 time: 1.296179 Jul 26 14:09:14.600996 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 686/1306] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:13 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 1351 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:14.616515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c668d667-ec43-4466-9a7b-0f9602321b03 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787f25040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:15.084826 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c668d667-ec43-4466-9a7b-0f9602321b03 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/9f99d468-f75d-4b06-85e6-e18a9c2ae40c" status: 200 len: 1455 microversion: 2.1 time: 0.479310 Jul 26 14:09:15.088780 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 687/1307] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:14 2022] GET /compute/v2.1/images/9f99d468-f75d-4b06-85e6-e18a9c2ae40c => generated 1455 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:15.095024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-df0afe4a-8503-4da4-b36e-267d95061d49 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:15.113925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-718d0745-d824-445d-9de2-e5572c557be2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Action: 'create', calling method: .version_select at 0x7f8787f25ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-121079075", "policies": ["anti-affinity"]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:15.124584 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-df0afe4a-8503-4da4-b36e-267d95061d49 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1467 microversion: 2.1 time: 1.034851 Jul 26 14:09:15.133209 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 621/1308] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:14 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1467 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:15.157696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4de8ef9b-13f9-47e7-8b16-502a15835b6f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:15.165557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4de8ef9b-13f9-47e7-8b16-502a15835b6f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:15.198072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4de8ef9b-13f9-47e7-8b16-502a15835b6f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:15.199157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-718d0745-d824-445d-9de2-e5572c557be2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:15.203251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4de8ef9b-13f9-47e7-8b16-502a15835b6f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:15.215522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4de8ef9b-13f9-47e7-8b16-502a15835b6f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:15.216021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4de8ef9b-13f9-47e7-8b16-502a15835b6f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:15.253911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-718d0745-d824-445d-9de2-e5572c557be2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:15.372136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-718d0745-d824-445d-9de2-e5572c557be2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:15.379591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-718d0745-d824-445d-9de2-e5572c557be2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:15.400711 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-718d0745-d824-445d-9de2-e5572c557be2 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.306431 Jul 26 14:09:15.413367 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 688/1309] 10.222.0.70 () {60 vars in 1174 bytes} [Tue Jul 26 14:09:15 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:15.425443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-66849a8b-e2eb-43fc-b310-0a993585912b req-ea9212d3-4c7a-4fd4-a7af-3f0b6e582065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8beadb53-ad09-4a21-a4b8-1a8d1e561129", "name": "network-vif-unplugged", "status": "completed", "tag": "81fe2ba7-46e4-409a-8bd8-03c67c1e0702"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:15.475727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-66849a8b-e2eb-43fc-b310-0a993585912b req-ea9212d3-4c7a-4fd4-a7af-3f0b6e582065 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:15.478510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-66849a8b-e2eb-43fc-b310-0a993585912b req-ea9212d3-4c7a-4fd4-a7af-3f0b6e582065 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:15.521111 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-66849a8b-e2eb-43fc-b310-0a993585912b req-ea9212d3-4c7a-4fd4-a7af-3f0b6e582065 service nova] Creating event network-vif-unplugged:81fe2ba7-46e4-409a-8bd8-03c67c1e0702 for instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 on n-h1-833090-9 Jul 26 14:09:15.543746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-66849a8b-e2eb-43fc-b310-0a993585912b req-ea9212d3-4c7a-4fd4-a7af-3f0b6e582065 service nova] Instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:09:15.574441 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-66849a8b-e2eb-43fc-b310-0a993585912b req-ea9212d3-4c7a-4fd4-a7af-3f0b6e582065 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154761 Jul 26 14:09:15.576876 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 689/1310] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:15.602169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-53bfdb73-4efd-42d4-9a3b-8f7e5f58b6a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0d85cd5-c448-4735-becc-d3a1bddda949", "device": "/dev/xvdb"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:15.631061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-53bfdb73-4efd-42d4-9a3b-8f7e5f58b6a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:15.673478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53bfdb73-4efd-42d4-9a3b-8f7e5f58b6a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:15.674722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53bfdb73-4efd-42d4-9a3b-8f7e5f58b6a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:15.680331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53bfdb73-4efd-42d4-9a3b-8f7e5f58b6a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:15.683647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-53bfdb73-4efd-42d4-9a3b-8f7e5f58b6a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:16.157649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4de8ef9b-13f9-47e7-8b16-502a15835b6f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:16.181141 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4de8ef9b-13f9-47e7-8b16-502a15835b6f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1517 microversion: 2.1 time: 1.043702 Jul 26 14:09:16.182900 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 622/1311] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:15 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1517 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:16.204483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-381369036", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "1a6cd7d7-0cdf-486c-bdb0-d97f6ac8c236"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:16.592893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=22 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:16.682191 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-53bfdb73-4efd-42d4-9a3b-8f7e5f58b6a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "POST /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.097263 Jul 26 14:09:16.689377 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 690/1312] 10.222.0.70 () {62 vars in 1364 bytes} [Tue Jul 26 14:09:15 2022] POST /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments => generated 194 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:09:16.740868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-890a1c28-b396-49f6-bf21-ebdd13c0bca6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:16.741595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-890a1c28-b396-49f6-bf21-ebdd13c0bca6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:16.767112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-890a1c28-b396-49f6-bf21-ebdd13c0bca6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:16.771274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-890a1c28-b396-49f6-bf21-ebdd13c0bca6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:16.772437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-890a1c28-b396-49f6-bf21-ebdd13c0bca6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:16.774536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-890a1c28-b396-49f6-bf21-ebdd13c0bca6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:17.171201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:17.648453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-890a1c28-b396-49f6-bf21-ebdd13c0bca6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e385295d84f494986de9861dbc068da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bcf05a19b54acbb86a46e6d8e8962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:17.670582 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-890a1c28-b396-49f6-bf21-ebdd13c0bca6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 200 len: 1351 microversion: 2.1 time: 0.974912 Jul 26 14:09:17.684033 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 691/1313] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:16 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 1351 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:17.691164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-944aab8b-7122-499f-9eab-22482954a09e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787d5fe50>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:18.503139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:25.397075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=22 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:26.163309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:26.244021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=62 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:26.752365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:27.668919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:31.347316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:09:31.354819 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-944aab8b-7122-499f-9eab-22482954a09e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/9f99d468-f75d-4b06-85e6-e18a9c2ae40c" status: 200 len: 1464 microversion: 2.1 time: 13.669237 Jul 26 14:09:31.355718 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 692/1314] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:17 2022] GET /compute/v2.1/images/9f99d468-f75d-4b06-85e6-e18a9c2ae40c => generated 1464 bytes in 13671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:31.360513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aa990459-81d1-4c08-aab2-d7cf65591e06 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:31.361144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aa990459-81d1-4c08-aab2-d7cf65591e06 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:31.367628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa990459-81d1-4c08-aab2-d7cf65591e06 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:31.368117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa990459-81d1-4c08-aab2-d7cf65591e06 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:31.369123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa990459-81d1-4c08-aab2-d7cf65591e06 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:31.369577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa990459-81d1-4c08-aab2-d7cf65591e06 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:31.640469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa990459-81d1-4c08-aab2-d7cf65591e06 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:31.652416 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aa990459-81d1-4c08-aab2-d7cf65591e06 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1460 microversion: 2.1 time: 0.295455 Jul 26 14:09:31.656525 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 693/1315] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:31 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1460 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:31.736831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:09:31.737260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:09:31.737745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:09:31.738434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:09:31.738775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:09:31.759313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:31.760660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:31.762319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:31.763145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:31.783771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:31.790077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:31.806370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Going to run 2 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:09:31.810364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: c7477433-f6e2-49bd-b9c1-ca75b172181c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:09:31.862230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1069138422", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "149b5c78-168f-45f5-835f-0d3660ada5ce"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:31.877016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:31.883125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:31.938897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] validate_networks() for [('149b5c78-168f-45f5-835f-0d3660ada5ce', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:09:31.956067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:31.965056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:31.982034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=c7477433-f6e2-49bd-b9c1-ca75b172181c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:09:32.052841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:32.059780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:32.114492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:32.120994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'server_group_members'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:32.165088 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b941448c-18d8-4682-baea-5764ff8a3bda tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 15.973845 Jul 26 14:09:32.166212 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 623/1316] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:09:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 15983 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 26 14:09:32.173874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9a5d8736-f5bb-4936-be53-4af1e2a11647 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:32.174507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9a5d8736-f5bb-4936-be53-4af1e2a11647 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:32.187980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a5d8736-f5bb-4936-be53-4af1e2a11647 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:32.188428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a5d8736-f5bb-4936-be53-4af1e2a11647 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:32.189213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a5d8736-f5bb-4936-be53-4af1e2a11647 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:32.189655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a5d8736-f5bb-4936-be53-4af1e2a11647 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:32.488532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a5d8736-f5bb-4936-be53-4af1e2a11647 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:32.497064 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9a5d8736-f5bb-4936-be53-4af1e2a11647 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1523 microversion: 2.1 time: 0.329063 Jul 26 14:09:32.497967 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 624/1317] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:32 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1523 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:32.516550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-487137d6-c0a1-43ed-b475-932b4e111081 req-7709ec86-6b47-475a-bfba-c8d4da7e27a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a4f989-1f14-4e89-a1cc-b8fa616342f0", "tag": "3ad3111b-d40f-408c-9aa3-7d8b42f8319d"}, {"name": "network-changed", "server_uuid": "8beadb53-ad09-4a21-a4b8-1a8d1e561129", "tag": "81fe2ba7-46e4-409a-8bd8-03c67c1e0702"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:32.529548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-487137d6-c0a1-43ed-b475-932b4e111081 req-7709ec86-6b47-475a-bfba-c8d4da7e27a0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:32.531495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-487137d6-c0a1-43ed-b475-932b4e111081 req-7709ec86-6b47-475a-bfba-c8d4da7e27a0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:32.539964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:09:32.541048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:09:32.541845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:09:32.542497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:09:32.543910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:09:32.554405 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-487137d6-c0a1-43ed-b475-932b4e111081 req-7709ec86-6b47-475a-bfba-c8d4da7e27a0 service nova] Creating event network-changed:3ad3111b-d40f-408c-9aa3-7d8b42f8319d for instance 15a4f989-1f14-4e89-a1cc-b8fa616342f0 on n-h1-833090-9 Jul 26 14:09:32.555173 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-487137d6-c0a1-43ed-b475-932b4e111081 req-7709ec86-6b47-475a-bfba-c8d4da7e27a0 service nova] Creating event network-changed:81fe2ba7-46e4-409a-8bd8-03c67c1e0702 for instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 on n-h1-833090-9 Jul 26 14:09:32.558142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:32.559354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:32.560756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:32.561960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:32.568053 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-487137d6-c0a1-43ed-b475-932b4e111081 req-7709ec86-6b47-475a-bfba-c8d4da7e27a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.067475 Jul 26 14:09:32.570088 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 625/1318] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:32.583592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ababd80d-25ba-4b0b-90af-4b9e7006b9eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:32.586194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ababd80d-25ba-4b0b-90af-4b9e7006b9eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:32.595981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Getting quotas for project a1df297aa8b6421da531e980c89c7051. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:32.596613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ababd80d-25ba-4b0b-90af-4b9e7006b9eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:32.597563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ababd80d-25ba-4b0b-90af-4b9e7006b9eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:32.598588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ababd80d-25ba-4b0b-90af-4b9e7006b9eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:32.599214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ababd80d-25ba-4b0b-90af-4b9e7006b9eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:32.602791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Getting quotas for user f31a364ff6c247a4a9fcb9f4d99c3464 and project a1df297aa8b6421da531e980c89c7051. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:32.620107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:09:32.622573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:09:32.689998 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2b5191a0-d5ea-404d-909f-fcc4f932dae5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032214 Jul 26 14:09:32.690824 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 694/1319] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:09:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:09:32.700800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e1e5485a-9284-49d6-a594-c30c55e8734b req-60142c7f-250e-43fa-8215-f351e93a6d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d38f13-5f5e-4574-b415-d21bb454b9d2", "name": "network-vif-plugged", "status": "completed", "tag": "133fb10c-c93f-49e6-9134-3165e0e34866"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:32.714727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e1e5485a-9284-49d6-a594-c30c55e8734b req-60142c7f-250e-43fa-8215-f351e93a6d71 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:32.715188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e1e5485a-9284-49d6-a594-c30c55e8734b req-60142c7f-250e-43fa-8215-f351e93a6d71 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:32.751281 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e1e5485a-9284-49d6-a594-c30c55e8734b req-60142c7f-250e-43fa-8215-f351e93a6d71 service nova] Creating event network-vif-plugged:133fb10c-c93f-49e6-9134-3165e0e34866 for instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 on n-h2-833090-9 Jul 26 14:09:32.757517 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e1e5485a-9284-49d6-a594-c30c55e8734b req-60142c7f-250e-43fa-8215-f351e93a6d71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065364 Jul 26 14:09:32.762348 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 695/1320] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:32.776549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2b35022d-2df3-40f1-956e-63ab2ee8f72e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787deb5e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:32.808245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ababd80d-25ba-4b0b-90af-4b9e7006b9eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e385295d84f494986de9861dbc068da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bcf05a19b54acbb86a46e6d8e8962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:32.817685 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ababd80d-25ba-4b0b-90af-4b9e7006b9eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 200 len: 1351 microversion: 2.1 time: 0.245787 Jul 26 14:09:32.818300 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 626/1321] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:32 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 1351 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:32.866271 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2b35022d-2df3-40f1-956e-63ab2ee8f72e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/9f99d468-f75d-4b06-85e6-e18a9c2ae40c" status: 200 len: 1464 microversion: 2.1 time: 0.101865 Jul 26 14:09:32.868305 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 696/1322] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:32 2022] GET /compute/v2.1/images/9f99d468-f75d-4b06-85e6-e18a9c2ae40c => generated 1464 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:32.899060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b8d25eb6-5e8d-4d01-a13a-e7423cd6b3aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:32.919094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b8d25eb6-5e8d-4d01-a13a-e7423cd6b3aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:32.922079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b8d25eb6-5e8d-4d01-a13a-e7423cd6b3aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Searching by: {'deleted': False, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:09:32.965134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8d25eb6-5e8d-4d01-a13a-e7423cd6b3aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:32.965660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8d25eb6-5e8d-4d01-a13a-e7423cd6b3aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:32.966499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8d25eb6-5e8d-4d01-a13a-e7423cd6b3aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:32.966954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8d25eb6-5e8d-4d01-a13a-e7423cd6b3aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:33.070038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b32cb5ee-5b90-4ae6-ac1a-f38549a1621a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:33.070663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b32cb5ee-5b90-4ae6-ac1a-f38549a1621a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:33.082432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b32cb5ee-5b90-4ae6-ac1a-f38549a1621a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:33.082896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b32cb5ee-5b90-4ae6-ac1a-f38549a1621a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:33.083700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b32cb5ee-5b90-4ae6-ac1a-f38549a1621a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:33.084176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b32cb5ee-5b90-4ae6-ac1a-f38549a1621a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:33.246013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-b8d25eb6-5e8d-4d01-a13a-e7423cd6b3aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:09:33.377074 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b32cb5ee-5b90-4ae6-ac1a-f38549a1621a tempest-MigrationsAdminTest-1960127943 tempest-MigrationsAdminTest-1960127943-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1611 microversion: 2.1 time: 0.557415 Jul 26 14:09:33.378271 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 627/1323] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:32 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1611 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:33.383134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1541041823", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "149b5c78-168f-45f5-835f-0d3660ada5ce"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:33.425134 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b8d25eb6-5e8d-4d01-a13a-e7423cd6b3aa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.537167 Jul 26 14:09:33.426201 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 697/1324] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:09:32 2022] GET /compute/v2.1/servers => generated 1664 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:33.431279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32d1c0a5-3b0f-4d40-9e89-1eef8ef8947b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:33.432373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32d1c0a5-3b0f-4d40-9e89-1eef8ef8947b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:33.453277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32d1c0a5-3b0f-4d40-9e89-1eef8ef8947b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:33.454264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32d1c0a5-3b0f-4d40-9e89-1eef8ef8947b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:33.456509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] validate_networks() for [('149b5c78-168f-45f5-835f-0d3660ada5ce', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:09:33.456823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32d1c0a5-3b0f-4d40-9e89-1eef8ef8947b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:33.457626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32d1c0a5-3b0f-4d40-9e89-1eef8ef8947b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:34.051867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32d1c0a5-3b0f-4d40-9e89-1eef8ef8947b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:34.062038 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-32d1c0a5-3b0f-4d40-9e89-1eef8ef8947b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2" status: 200 len: 1468 microversion: 2.1 time: 0.634567 Jul 26 14:09:34.062653 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 698/1325] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:33 2022] GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2 => generated 1468 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:34.085420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e404fad2-94f0-41fc-ba58-09bd66108b5b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:34.085950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e404fad2-94f0-41fc-ba58-09bd66108b5b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:34.105746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e404fad2-94f0-41fc-ba58-09bd66108b5b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:34.106201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e404fad2-94f0-41fc-ba58-09bd66108b5b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:34.107028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e404fad2-94f0-41fc-ba58-09bd66108b5b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:34.107626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e404fad2-94f0-41fc-ba58-09bd66108b5b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:34.184626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e404fad2-94f0-41fc-ba58-09bd66108b5b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:09:34.356961 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e404fad2-94f0-41fc-ba58-09bd66108b5b tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 204 len: 0 microversion: 2.1 time: 0.291420 Jul 26 14:09:34.357610 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 699/1326] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:09:34 2022] DELETE /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:09:34.371691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bdc51bdf-8c86-48fc-9d91-1c0950b27034 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:34.372260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bdc51bdf-8c86-48fc-9d91-1c0950b27034 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:34.391938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdc51bdf-8c86-48fc-9d91-1c0950b27034 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:34.392415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdc51bdf-8c86-48fc-9d91-1c0950b27034 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:34.393131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdc51bdf-8c86-48fc-9d91-1c0950b27034 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:34.393634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdc51bdf-8c86-48fc-9d91-1c0950b27034 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:34.542996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bdc51bdf-8c86-48fc-9d91-1c0950b27034 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:34.552456 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bdc51bdf-8c86-48fc-9d91-1c0950b27034 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1222 microversion: 2.1 time: 0.189048 Jul 26 14:09:34.553324 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 700/1327] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:34 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1222 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:34.557840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d6688c8f-4600-421e-916f-9ae207a053b6 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:34.558460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d6688c8f-4600-421e-916f-9ae207a053b6 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:34.566464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6688c8f-4600-421e-916f-9ae207a053b6 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:34.566922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6688c8f-4600-421e-916f-9ae207a053b6 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:34.567713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6688c8f-4600-421e-916f-9ae207a053b6 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:34.568193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6688c8f-4600-421e-916f-9ae207a053b6 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:35.057400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:09:35.058307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:09:35.059191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:09:35.061012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:09:35.062172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:09:35.109031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:35.109763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:35.110588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:35.111254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:35.162003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Getting quotas for project a1df297aa8b6421da531e980c89c7051. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:35.163444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d6688c8f-4600-421e-916f-9ae207a053b6 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:35.175194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Getting quotas for user f31a364ff6c247a4a9fcb9f4d99c3464 and project a1df297aa8b6421da531e980c89c7051. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:35.176871 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d6688c8f-4600-421e-916f-9ae207a053b6 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1523 microversion: 2.1 time: 0.622662 Jul 26 14:09:35.182409 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 701/1328] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:34 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1523 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:35.202961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c8222da-1cd4-433f-bc50-1aa93e5e86e3 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:35.207680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8c8222da-1cd4-433f-bc50-1aa93e5e86e3 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:35.211894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:09:35.215340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 54be76f6-dd14-406f-8f42-ed989a168646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:09:35.223457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c8222da-1cd4-433f-bc50-1aa93e5e86e3 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:35.224506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c8222da-1cd4-433f-bc50-1aa93e5e86e3 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:35.225911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c8222da-1cd4-433f-bc50-1aa93e5e86e3 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:35.227859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c8222da-1cd4-433f-bc50-1aa93e5e86e3 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:35.299603 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05e017ed-13b0-4514-93c7-2e8e76823e0e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.919895 Jul 26 14:09:35.300735 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 628/1329] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:09:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:09:35.337960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cf2569ce-9f43-4297-b299-61f9621a64d4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-687438466"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:35.345548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cf2569ce-9f43-4297-b299-61f9621a64d4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:35.369820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf2569ce-9f43-4297-b299-61f9621a64d4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:35.369820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf2569ce-9f43-4297-b299-61f9621a64d4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:35.375753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf2569ce-9f43-4297-b299-61f9621a64d4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:35.375753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf2569ce-9f43-4297-b299-61f9621a64d4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:35.669237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8c8222da-1cd4-433f-bc50-1aa93e5e86e3 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e385295d84f494986de9861dbc068da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bcf05a19b54acbb86a46e6d8e8962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:35.683096 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8c8222da-1cd4-433f-bc50-1aa93e5e86e3 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 200 len: 1351 microversion: 2.1 time: 0.499280 Jul 26 14:09:35.684232 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 702/1330] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:35 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 1351 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:35.691191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9bea3d70-ddf6-4362-8f67-4811dda67269 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:35.692291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9bea3d70-ddf6-4362-8f67-4811dda67269 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:35.716143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bea3d70-ddf6-4362-8f67-4811dda67269 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:35.716684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bea3d70-ddf6-4362-8f67-4811dda67269 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:35.718807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bea3d70-ddf6-4362-8f67-4811dda67269 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:35.719890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bea3d70-ddf6-4362-8f67-4811dda67269 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:35.793518 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cf2569ce-9f43-4297-b299-61f9621a64d4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "POST /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d/action" status: 202 len: 0 microversion: 2.1 time: 0.472535 Jul 26 14:09:35.797665 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 629/1331] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:09:35 2022] POST /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 14:09:35.839047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-804ba4b4-ed7b-4425-87b0-33c9bc97f4c8 req-2393b82c-b717-4cb6-9504-83ed3344b4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c2ebb15-8fe0-418b-9bff-62df9ad91d33", "name": "network-vif-unplugged", "status": "completed", "tag": "be2577e0-b145-4d72-a27c-d8bc65019933"}, {"server_uuid": "15a4f989-1f14-4e89-a1cc-b8fa616342f0", "name": "network-vif-plugged", "status": "completed", "tag": "3ad3111b-d40f-408c-9aa3-7d8b42f8319d"}, {"server_uuid": "2c2ebb15-8fe0-418b-9bff-62df9ad91d33", "name": "network-vif-plugged", "status": "completed", "tag": "be2577e0-b145-4d72-a27c-d8bc65019933"}, {"server_uuid": "8beadb53-ad09-4a21-a4b8-1a8d1e561129", "name": "network-vif-plugged", "status": "completed", "tag": "81fe2ba7-46e4-409a-8bd8-03c67c1e0702"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:35.856731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-804ba4b4-ed7b-4425-87b0-33c9bc97f4c8 req-2393b82c-b717-4cb6-9504-83ed3344b4a3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:35.857566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-804ba4b4-ed7b-4425-87b0-33c9bc97f4c8 req-2393b82c-b717-4cb6-9504-83ed3344b4a3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:35.918843 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-804ba4b4-ed7b-4425-87b0-33c9bc97f4c8 req-2393b82c-b717-4cb6-9504-83ed3344b4a3 service nova] Creating event network-vif-unplugged:be2577e0-b145-4d72-a27c-d8bc65019933 for instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 on n-h2-833090-9 Jul 26 14:09:35.923990 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-804ba4b4-ed7b-4425-87b0-33c9bc97f4c8 req-2393b82c-b717-4cb6-9504-83ed3344b4a3 service nova] Creating event network-vif-plugged:3ad3111b-d40f-408c-9aa3-7d8b42f8319d for instance 15a4f989-1f14-4e89-a1cc-b8fa616342f0 on n-h1-833090-9 Jul 26 14:09:35.927624 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-804ba4b4-ed7b-4425-87b0-33c9bc97f4c8 req-2393b82c-b717-4cb6-9504-83ed3344b4a3 service nova] Creating event network-vif-plugged:be2577e0-b145-4d72-a27c-d8bc65019933 for instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 on n-h2-833090-9 Jul 26 14:09:35.929788 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-804ba4b4-ed7b-4425-87b0-33c9bc97f4c8 req-2393b82c-b717-4cb6-9504-83ed3344b4a3 service nova] Creating event network-vif-plugged:81fe2ba7-46e4-409a-8bd8-03c67c1e0702 for instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 on n-h1-833090-9 Jul 26 14:09:35.970388 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-804ba4b4-ed7b-4425-87b0-33c9bc97f4c8 req-2393b82c-b717-4cb6-9504-83ed3344b4a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.162050 Jul 26 14:09:35.974603 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 630/1332] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:36.017969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bd8d30a3-b26a-48d9-becb-10723b8d4d75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:36.023813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bd8d30a3-b26a-48d9-becb-10723b8d4d75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:36.063797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd8d30a3-b26a-48d9-becb-10723b8d4d75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:36.067752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd8d30a3-b26a-48d9-becb-10723b8d4d75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:36.068569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd8d30a3-b26a-48d9-becb-10723b8d4d75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:36.068938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd8d30a3-b26a-48d9-becb-10723b8d4d75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:36.308382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9bea3d70-ddf6-4362-8f67-4811dda67269 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:36.337784 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9bea3d70-ddf6-4362-8f67-4811dda67269 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1466 microversion: 2.1 time: 0.652412 Jul 26 14:09:36.338370 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 703/1333] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:35 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1466 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:36.355860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1330013713", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "451", "networks": [{"uuid": "149b5c78-168f-45f5-835f-0d3660ada5ce"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:36.507303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] validate_networks() for [('149b5c78-168f-45f5-835f-0d3660ada5ce', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:09:36.852586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-bd8d30a3-b26a-48d9-becb-10723b8d4d75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 38cbff42-6659-4317-bf61-7f5f2aaaa942 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:09:36.899485 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bd8d30a3-b26a-48d9-becb-10723b8d4d75 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 2420 microversion: 2.25 time: 0.920201 Jul 26 14:09:36.900623 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 631/1334] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:09:35 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 2420 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:09:36.924714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f0231bca-3824-46ae-a1ab-b62214e0ebdd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:36.924714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f0231bca-3824-46ae-a1ab-b62214e0ebdd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:36.955225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:36.960332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0231bca-3824-46ae-a1ab-b62214e0ebdd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:36.961645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0231bca-3824-46ae-a1ab-b62214e0ebdd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:36.963565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0231bca-3824-46ae-a1ab-b62214e0ebdd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:36.964644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0231bca-3824-46ae-a1ab-b62214e0ebdd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:37.558707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f0231bca-3824-46ae-a1ab-b62214e0ebdd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:37.627530 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f0231bca-3824-46ae-a1ab-b62214e0ebdd tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1270 microversion: 2.1 time: 0.721092 Jul 26 14:09:37.628688 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 632/1335] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:36 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1270 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:37.668380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb05f428-4ab7-43d0-b345-5a5679c2b38f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787ceb160>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:37.884432 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eb05f428-4ab7-43d0-b345-5a5679c2b38f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.248462 Jul 26 14:09:37.900793 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 633/1336] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:37 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:37.934611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b7b9a6d0-6b60-471a-92f7-46ea08b48e2f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:37.938972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b7b9a6d0-6b60-471a-92f7-46ea08b48e2f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:37.964549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7b9a6d0-6b60-471a-92f7-46ea08b48e2f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:37.965988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7b9a6d0-6b60-471a-92f7-46ea08b48e2f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:37.969440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7b9a6d0-6b60-471a-92f7-46ea08b48e2f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:37.970616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7b9a6d0-6b60-471a-92f7-46ea08b48e2f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:38.673925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:09:38.674756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:09:38.675516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:09:38.677114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:09:38.677114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:09:38.695309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:38.695827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:38.697316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:38.702796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:38.747824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Getting quotas for project a1df297aa8b6421da531e980c89c7051. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:38.774826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Getting quotas for user f31a364ff6c247a4a9fcb9f4d99c3464 and project a1df297aa8b6421da531e980c89c7051. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:38.791425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:09:38.794386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:09:38.878412 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95c255d0-21da-4887-9c8e-cc330cd12d9d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.538483 Jul 26 14:09:38.879696 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 704/1337] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:09:38.885403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-97a4e1e7-4d96-444e-a0d6-53be9857e7eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:38.886602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-97a4e1e7-4d96-444e-a0d6-53be9857e7eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:38.896448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97a4e1e7-4d96-444e-a0d6-53be9857e7eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:38.898632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97a4e1e7-4d96-444e-a0d6-53be9857e7eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:38.899687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97a4e1e7-4d96-444e-a0d6-53be9857e7eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:38.900335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97a4e1e7-4d96-444e-a0d6-53be9857e7eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:39.229683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b7b9a6d0-6b60-471a-92f7-46ea08b48e2f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:39.246753 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b7b9a6d0-6b60-471a-92f7-46ea08b48e2f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1523 microversion: 2.1 time: 1.339864 Jul 26 14:09:39.247349 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 634/1338] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:37 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1523 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:39.267438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-538cded5-fd19-49af-a063-e81093cef016 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-9", "block_migration": "auto"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:39.271501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-538cded5-fd19-49af-a063-e81093cef016 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:39.294929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-538cded5-fd19-49af-a063-e81093cef016 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:39.295937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-538cded5-fd19-49af-a063-e81093cef016 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:39.298017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-538cded5-fd19-49af-a063-e81093cef016 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:39.303553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-538cded5-fd19-49af-a063-e81093cef016 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:39.368350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-538cded5-fd19-49af-a063-e81093cef016 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'flavor' on Instance uuid 38cbff42-6659-4317-bf61-7f5f2aaaa942 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:09:39.402191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-538cded5-fd19-49af-a063-e81093cef016 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Going to try to live migrate instance to n-h2-833090-9 {{(pid=119478) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 14:09:40.822109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-97a4e1e7-4d96-444e-a0d6-53be9857e7eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e385295d84f494986de9861dbc068da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bcf05a19b54acbb86a46e6d8e8962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:40.838031 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-97a4e1e7-4d96-444e-a0d6-53be9857e7eb tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 200 len: 1351 microversion: 2.1 time: 1.956805 Jul 26 14:09:40.866182 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 705/1339] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:38 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 1351 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:40.879247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:40.880563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:40.891133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:40.922186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:40.923512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:40.930124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:41.077076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:41.119989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:41.125458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lazy-loading 'fault' on Instance uuid 8beadb53-ad09-4a21-a4b8-1a8d1e561129 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:09:41.419852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:41.462388 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3dabd63d-0726-4a5c-9eed-40879827173a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 200 len: 1302 microversion: 2.1 time: 0.589184 Jul 26 14:09:41.464392 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 706/1340] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:40 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 1302 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:41.478836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-760b237e-e482-4767-9472-2259023b05f3 req-e0a5c2e2-4134-4092-a89c-08ed97605de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d38f13-5f5e-4574-b415-d21bb454b9d2", "name": "network-vif-unplugged", "status": "completed", "tag": "133fb10c-c93f-49e6-9134-3165e0e34866"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:41.512981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-760b237e-e482-4767-9472-2259023b05f3 req-e0a5c2e2-4134-4092-a89c-08ed97605de7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:41.518491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-760b237e-e482-4767-9472-2259023b05f3 req-e0a5c2e2-4134-4092-a89c-08ed97605de7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:41.586338 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-760b237e-e482-4767-9472-2259023b05f3 req-e0a5c2e2-4134-4092-a89c-08ed97605de7 service nova] Creating event network-vif-unplugged:133fb10c-c93f-49e6-9134-3165e0e34866 for instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 on n-h2-833090-9 Jul 26 14:09:41.609695 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-760b237e-e482-4767-9472-2259023b05f3 req-e0a5c2e2-4134-4092-a89c-08ed97605de7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142507 Jul 26 14:09:41.610339 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 707/1341] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:41.637122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a39d0f8a-f862-4b5f-b31c-37cb49ab4eb8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:41.637875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a39d0f8a-f862-4b5f-b31c-37cb49ab4eb8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:41.666990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a39d0f8a-f862-4b5f-b31c-37cb49ab4eb8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:41.667826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a39d0f8a-f862-4b5f-b31c-37cb49ab4eb8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:41.669053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a39d0f8a-f862-4b5f-b31c-37cb49ab4eb8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:41.669709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a39d0f8a-f862-4b5f-b31c-37cb49ab4eb8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:42.085388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a39d0f8a-f862-4b5f-b31c-37cb49ab4eb8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:42.102438 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a39d0f8a-f862-4b5f-b31c-37cb49ab4eb8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1318 microversion: 2.1 time: 0.477830 Jul 26 14:09:42.103860 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 708/1342] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:41 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:42.116930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a2acdea8-a445-44c5-9eae-b0dbf256eb76 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:42.119932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a2acdea8-a445-44c5-9eae-b0dbf256eb76 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:42.134300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a2acdea8-a445-44c5-9eae-b0dbf256eb76 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:42.136965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a2acdea8-a445-44c5-9eae-b0dbf256eb76 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:42.141021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a2acdea8-a445-44c5-9eae-b0dbf256eb76 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:42.143229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a2acdea8-a445-44c5-9eae-b0dbf256eb76 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:42.293308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a2acdea8-a445-44c5-9eae-b0dbf256eb76 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:42.338833 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a2acdea8-a445-44c5-9eae-b0dbf256eb76 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1279 microversion: 2.1 time: 0.216663 Jul 26 14:09:42.341169 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 709/1343] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:42 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:42.365341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c141b6e2-8b47-4437-a7bb-f72e65449c8d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787c14700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:42.492458 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c141b6e2-8b47-4437-a7bb-f72e65449c8d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.148588 Jul 26 14:09:42.493053 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 710/1344] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:42 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:42.546428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-14f54ef8-e498-4fa1-b214-1313dd8e67fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:42.547541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-14f54ef8-e498-4fa1-b214-1313dd8e67fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:42.563295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14f54ef8-e498-4fa1-b214-1313dd8e67fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:42.564222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14f54ef8-e498-4fa1-b214-1313dd8e67fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:42.565743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14f54ef8-e498-4fa1-b214-1313dd8e67fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:42.566471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14f54ef8-e498-4fa1-b214-1313dd8e67fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:43.821788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-14f54ef8-e498-4fa1-b214-1313dd8e67fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:43.829733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:43.835613 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-14f54ef8-e498-4fa1-b214-1313dd8e67fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1508 microversion: 2.1 time: 1.329833 Jul 26 14:09:43.839654 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 711/1345] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:42 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1508 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:43.845639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-90eb074c-f120-4edc-a641-70bc0f0b3ce6 req-91d6258a-cc8d-48f7-bf71-1e8aa72d25a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8beadb53-ad09-4a21-a4b8-1a8d1e561129", "name": "network-vif-deleted", "tag": "81fe2ba7-46e4-409a-8bd8-03c67c1e0702"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:43.878059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-90eb074c-f120-4edc-a641-70bc0f0b3ce6 req-91d6258a-cc8d-48f7-bf71-1e8aa72d25a2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:43.880637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-90eb074c-f120-4edc-a641-70bc0f0b3ce6 req-91d6258a-cc8d-48f7-bf71-1e8aa72d25a2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:43.911030 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-90eb074c-f120-4edc-a641-70bc0f0b3ce6 req-91d6258a-cc8d-48f7-bf71-1e8aa72d25a2 service nova] Creating event network-vif-deleted:81fe2ba7-46e4-409a-8bd8-03c67c1e0702 for instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 on n-h1-833090-9 Jul 26 14:09:43.928494 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-90eb074c-f120-4edc-a641-70bc0f0b3ce6 req-91d6258a-cc8d-48f7-bf71-1e8aa72d25a2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085170 Jul 26 14:09:43.934341 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 712/1346] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:43.948600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ea19bc6-5a2b-41ca-ad29-589600b6440c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:43.949608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1ea19bc6-5a2b-41ca-ad29-589600b6440c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:43.969196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ea19bc6-5a2b-41ca-ad29-589600b6440c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:43.969670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ea19bc6-5a2b-41ca-ad29-589600b6440c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:43.970489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ea19bc6-5a2b-41ca-ad29-589600b6440c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:43.970967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ea19bc6-5a2b-41ca-ad29-589600b6440c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:44.614545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ea19bc6-5a2b-41ca-ad29-589600b6440c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e385295d84f494986de9861dbc068da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bcf05a19b54acbb86a46e6d8e8962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:44.628743 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ea19bc6-5a2b-41ca-ad29-589600b6440c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 200 len: 1540 microversion: 2.1 time: 0.692163 Jul 26 14:09:44.631660 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 713/1347] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:43 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 1540 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:44.644131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e75b737e-bc78-4cbc-b006-e8172a8f6c34 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:44.645099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e75b737e-bc78-4cbc-b006-e8172a8f6c34 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 8beadb53-ad09-4a21-a4b8-1a8d1e561129] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:44.663148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e75b737e-bc78-4cbc-b006-e8172a8f6c34 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:44.667683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e75b737e-bc78-4cbc-b006-e8172a8f6c34 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:44.674287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e75b737e-bc78-4cbc-b006-e8172a8f6c34 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:44.676962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e75b737e-bc78-4cbc-b006-e8172a8f6c34 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:44.716921 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e75b737e-bc78-4cbc-b006-e8172a8f6c34 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] HTTP exception thrown: Instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 could not be found. Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e75b737e-bc78-4cbc-b006-e8172a8f6c34 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Request method failure captured: Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 HTTP/1.1 Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Qadeh2JypA-_GCSSC7jYfT1ihNtPypHRx0Pi6pHfrkoa4dF5igpQ-K-lEtgIlY_TKqEUxapFCVnwM2l3F2774XuQcBSfdcD5jQ8FrywWwKDv2-9ncrTqnmXWBlnC4ufl5vmuXFr4AeTAaGyUI3nN2GBLtc2AU-x9fA4hQi76dISLk Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: d2c43d5f86804cc181b575525a402873 Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-MigrationsAdminTest-1611382758 Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2c43d5f86804cc181b575525a402873"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2c43d5f86804cc181b575525a402873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2c43d5f86804cc181b575525a402873", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2c43d5f86804cc181b575525a402873"}]}] Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-MigrationsAdminTest-1611382758 Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: d2c43d5f86804cc181b575525a402873 Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-MigrationsAdminTest-1611382758 Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-MigrationsAdminTest-1611382758-project Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 753d20ca575a4270b73b1c686bf657dd Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-MigrationsAdminTest-1611382758-project Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 could not be found. Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '8beadb53-ad09-4a21-a4b8-1a8d1e561129'} Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 could not be found. Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 could not be found. Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:44.728252 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:09:44.738919 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:44.738919 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:44.738919 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:44.738919 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:09:44.738919 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:09:44.738919 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 could not be found. Jul 26 14:09:44.738919 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:09:44.738919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e75b737e-bc78-4cbc-b006-e8172a8f6c34 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Returning 404 to user: Instance 8beadb53-ad09-4a21-a4b8-1a8d1e561129 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:09:44.738919 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e75b737e-bc78-4cbc-b006-e8172a8f6c34 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129" status: 404 len: 111 microversion: 2.1 time: 0.097871 Jul 26 14:09:44.738919 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 714/1348] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:44 2022] GET /compute/v2.1/servers/8beadb53-ad09-4a21-a4b8-1a8d1e561129 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:09:44.751607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a430a46b-5def-4507-8339-73bdd7887c2f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:44.753111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a430a46b-5def-4507-8339-73bdd7887c2f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:44.769719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a430a46b-5def-4507-8339-73bdd7887c2f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:44.770201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a430a46b-5def-4507-8339-73bdd7887c2f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:44.771058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a430a46b-5def-4507-8339-73bdd7887c2f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:44.771527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a430a46b-5def-4507-8339-73bdd7887c2f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:45.059556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a430a46b-5def-4507-8339-73bdd7887c2f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:45.070393 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a430a46b-5def-4507-8339-73bdd7887c2f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1318 microversion: 2.1 time: 0.337919 Jul 26 14:09:45.081412 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 715/1349] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:44 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:45.088128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c74b76ff-d443-4fa7-86e7-3f58273327a0 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:45.090016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c74b76ff-d443-4fa7-86e7-3f58273327a0 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:45.107286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c74b76ff-d443-4fa7-86e7-3f58273327a0 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:45.108143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c74b76ff-d443-4fa7-86e7-3f58273327a0 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:45.116644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c74b76ff-d443-4fa7-86e7-3f58273327a0 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:45.117826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c74b76ff-d443-4fa7-86e7-3f58273327a0 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:45.124355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:45.193936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=28 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:45.256848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c74b76ff-d443-4fa7-86e7-3f58273327a0 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:45.284709 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c74b76ff-d443-4fa7-86e7-3f58273327a0 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1279 microversion: 2.1 time: 0.193344 Jul 26 14:09:45.285869 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 716/1350] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:45 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:45.300876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d717436-359e-4a74-b938-7ccb81934ead tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787c08310>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:45.407639 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d717436-359e-4a74-b938-7ccb81934ead tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.119533 Jul 26 14:09:45.412151 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 717/1351] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:45 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:45.420359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c168065a-874c-4e32-a964-d913e1bff386 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:45.421350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c168065a-874c-4e32-a964-d913e1bff386 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:45.435371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c168065a-874c-4e32-a964-d913e1bff386 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:45.436588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c168065a-874c-4e32-a964-d913e1bff386 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:45.438517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c168065a-874c-4e32-a964-d913e1bff386 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:45.439506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c168065a-874c-4e32-a964-d913e1bff386 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:45.820577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c168065a-874c-4e32-a964-d913e1bff386 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:45.838525 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c168065a-874c-4e32-a964-d913e1bff386 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 200 len: 1508 microversion: 2.1 time: 0.427259 Jul 26 14:09:45.839546 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 718/1352] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:45 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 1508 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:45.879704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-93fdd90b-976c-4b72-86ea-40c41af9f971 req-af6f1634-aa75-4c39-8d1f-da3f7f23b547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fb392e-344d-42d1-8c5e-dae768cff51b", "tag": "cf694648-c6fd-4128-9b72-65d87c20b088"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:45.896359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-93fdd90b-976c-4b72-86ea-40c41af9f971 req-af6f1634-aa75-4c39-8d1f-da3f7f23b547 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:45.899158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-93fdd90b-976c-4b72-86ea-40c41af9f971 req-af6f1634-aa75-4c39-8d1f-da3f7f23b547 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:45.941893 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-93fdd90b-976c-4b72-86ea-40c41af9f971 req-af6f1634-aa75-4c39-8d1f-da3f7f23b547 service nova] Creating event network-changed:cf694648-c6fd-4128-9b72-65d87c20b088 for instance 31fb392e-344d-42d1-8c5e-dae768cff51b on n-h2-833090-9 Jul 26 14:09:45.961173 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-93fdd90b-976c-4b72-86ea-40c41af9f971 req-af6f1634-aa75-4c39-8d1f-da3f7f23b547 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094058 Jul 26 14:09:45.962472 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 719/1353] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:45.973167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d021cdcc-5d78-4381-882a-efc6029f1dcc tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:45.991630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d021cdcc-5d78-4381-882a-efc6029f1dcc tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:46.028629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d021cdcc-5d78-4381-882a-efc6029f1dcc tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:46.029585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d021cdcc-5d78-4381-882a-efc6029f1dcc tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:46.031482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d021cdcc-5d78-4381-882a-efc6029f1dcc tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:46.032251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d021cdcc-5d78-4381-882a-efc6029f1dcc tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:46.247903 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d021cdcc-5d78-4381-882a-efc6029f1dcc tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283767 Jul 26 14:09:46.248599 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 720/1354] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:09:45 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0/os-interface => generated 284 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:46.259200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df63a808-2270-4b5f-a692-4cf8b5267629 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:46.259200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df63a808-2270-4b5f-a692-4cf8b5267629 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:46.292155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df63a808-2270-4b5f-a692-4cf8b5267629 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:46.296689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df63a808-2270-4b5f-a692-4cf8b5267629 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:46.298015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df63a808-2270-4b5f-a692-4cf8b5267629 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:46.298587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df63a808-2270-4b5f-a692-4cf8b5267629 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:46.462716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df63a808-2270-4b5f-a692-4cf8b5267629 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:09:46.569054 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-538cded5-fd19-49af-a063-e81093cef016 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/action" status: 202 len: 0 microversion: 2.25 time: 7.320214 Jul 26 14:09:46.571344 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 635/1355] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:09:39 2022] POST /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/action => generated 0 bytes in 7323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:09:46.579168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-6dacabf6-7edf-4816-a154-64a42565fb59 req-e82c3592-49da-4cb0-8117-968cb40e447f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e080b-51bc-48e9-9b38-a4c49734b15d", "name": "network-vif-plugged", "status": "completed", "tag": "54d86a16-b218-474f-8fa1-ab8322e59564"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:46.631095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6dacabf6-7edf-4816-a154-64a42565fb59 req-e82c3592-49da-4cb0-8117-968cb40e447f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:46.632511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6dacabf6-7edf-4816-a154-64a42565fb59 req-e82c3592-49da-4cb0-8117-968cb40e447f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:46.681871 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-6dacabf6-7edf-4816-a154-64a42565fb59 req-e82c3592-49da-4cb0-8117-968cb40e447f service nova] Creating event network-vif-plugged:54d86a16-b218-474f-8fa1-ab8322e59564 for instance 807e080b-51bc-48e9-9b38-a4c49734b15d on n-h2-833090-9 Jul 26 14:09:46.706756 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-6dacabf6-7edf-4816-a154-64a42565fb59 req-e82c3592-49da-4cb0-8117-968cb40e447f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132825 Jul 26 14:09:46.708449 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 636/1356] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:46.720567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8a120508-4e01-45e0-8997-25ffa9434abd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:46.726610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8a120508-4e01-45e0-8997-25ffa9434abd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:46.746607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a120508-4e01-45e0-8997-25ffa9434abd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:46.747268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a120508-4e01-45e0-8997-25ffa9434abd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:46.748384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a120508-4e01-45e0-8997-25ffa9434abd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:46.755003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a120508-4e01-45e0-8997-25ffa9434abd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:46.832514 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df63a808-2270-4b5f-a692-4cf8b5267629 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 204 len: 0 microversion: 2.1 time: 0.581353 Jul 26 14:09:46.837488 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 721/1357] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:09:46 2022] DELETE /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:09:46.846697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-995cd19b-4905-4767-8e6c-b0eb42041bda req-4fdec42e-72e4-4b5c-bb5d-25d472ceb4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7477433-f6e2-49bd-b9c1-ca75b172181c", "tag": "6f69add5-9cb3-4555-bcb4-7f721255b9ca"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:46.858248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8a120508-4e01-45e0-8997-25ffa9434abd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:09:46.871876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-995cd19b-4905-4767-8e6c-b0eb42041bda req-4fdec42e-72e4-4b5c-bb5d-25d472ceb4cb service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:46.872502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-995cd19b-4905-4767-8e6c-b0eb42041bda req-4fdec42e-72e4-4b5c-bb5d-25d472ceb4cb service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:46.911256 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-995cd19b-4905-4767-8e6c-b0eb42041bda req-4fdec42e-72e4-4b5c-bb5d-25d472ceb4cb service nova] Creating event network-changed:6f69add5-9cb3-4555-bcb4-7f721255b9ca for instance c7477433-f6e2-49bd-b9c1-ca75b172181c on n-h2-833090-9 Jul 26 14:09:46.943271 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-995cd19b-4905-4767-8e6c-b0eb42041bda req-4fdec42e-72e4-4b5c-bb5d-25d472ceb4cb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103194 Jul 26 14:09:46.959850 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 722/1358] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:46.975932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3d0540b8-1634-40f6-b753-a67581a96242 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:46.976833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3d0540b8-1634-40f6-b753-a67581a96242 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:46.993101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d0540b8-1634-40f6-b753-a67581a96242 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:46.993566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d0540b8-1634-40f6-b753-a67581a96242 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:46.995662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d0540b8-1634-40f6-b753-a67581a96242 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:46.996174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d0540b8-1634-40f6-b753-a67581a96242 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:47.063587 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8a120508-4e01-45e0-8997-25ffa9434abd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 204 len: 0 microversion: 2.1 time: 0.350467 Jul 26 14:09:47.070101 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 637/1359] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:09:46 2022] DELETE /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:09:47.084652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3b1065f-9c5f-4e42-bd33-1e0b72a1b805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:47.085826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f3b1065f-9c5f-4e42-bd33-1e0b72a1b805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:47.126173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3b1065f-9c5f-4e42-bd33-1e0b72a1b805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:47.133284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3b1065f-9c5f-4e42-bd33-1e0b72a1b805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:47.134771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3b1065f-9c5f-4e42-bd33-1e0b72a1b805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:47.135487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3b1065f-9c5f-4e42-bd33-1e0b72a1b805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:47.204470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:47.852244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f3b1065f-9c5f-4e42-bd33-1e0b72a1b805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:47.865548 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f3b1065f-9c5f-4e42-bd33-1e0b72a1b805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1321 microversion: 2.1 time: 0.788289 Jul 26 14:09:47.885833 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 638/1360] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:47 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1321 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:47.909512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad834ad4-4212-4fff-822b-37bf459b9a65 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787d07ca0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:48.033992 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad834ad4-4212-4fff-822b-37bf459b9a65 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.145733 Jul 26 14:09:48.034529 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 639/1361] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:47 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:48.044652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-794b6f9c-e39e-42f8-977f-4e5cad83b933 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:48.045748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-794b6f9c-e39e-42f8-977f-4e5cad83b933 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:48.065197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-794b6f9c-e39e-42f8-977f-4e5cad83b933 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:48.066096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-794b6f9c-e39e-42f8-977f-4e5cad83b933 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:48.074475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-794b6f9c-e39e-42f8-977f-4e5cad83b933 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:48.075340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-794b6f9c-e39e-42f8-977f-4e5cad83b933 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:48.716041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:48.784928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:48.959410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3d0540b8-1634-40f6-b753-a67581a96242 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:48.968384 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3d0540b8-1634-40f6-b753-a67581a96242 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1318 microversion: 2.1 time: 2.005137 Jul 26 14:09:48.977669 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 723/1362] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:46 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1318 bytes in 2017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:48.982889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8fae5441-e991-4ae3-b409-458830d0c08e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:48.984688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8fae5441-e991-4ae3-b409-458830d0c08e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:48.997408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:49.001653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fae5441-e991-4ae3-b409-458830d0c08e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:49.002488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fae5441-e991-4ae3-b409-458830d0c08e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:49.005387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fae5441-e991-4ae3-b409-458830d0c08e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:49.007238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fae5441-e991-4ae3-b409-458830d0c08e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:49.195983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-794b6f9c-e39e-42f8-977f-4e5cad83b933 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:49.240671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-794b6f9c-e39e-42f8-977f-4e5cad83b933 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:49.267673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-794b6f9c-e39e-42f8-977f-4e5cad83b933 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:49.270545 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-794b6f9c-e39e-42f8-977f-4e5cad83b933 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.234329 Jul 26 14:09:49.304948 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 640/1363] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:09:48 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:09:49.332651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-92295693", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "a25f5344-bc1c-4e07-a47f-5585d3cd8924"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:49.439792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] validate_networks() for [('a25f5344-bc1c-4e07-a47f-5585d3cd8924', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:09:50.104832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8fae5441-e991-4ae3-b409-458830d0c08e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:50.132013 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8fae5441-e991-4ae3-b409-458830d0c08e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1535 microversion: 2.1 time: 1.145310 Jul 26 14:09:50.134139 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 724/1364] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:48 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1535 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:50.156303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-c407dccc-2d2b-435f-9e2e-d830237f1cdb req-2b2b00e8-c814-49aa-8fe2-d3c37325db94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8513d5ff-fd14-449d-abf4-8ac5ae461cb9", "tag": "972fbf32-4822-4220-ae24-7f06a9deba56"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:50.335398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c407dccc-2d2b-435f-9e2e-d830237f1cdb req-2b2b00e8-c814-49aa-8fe2-d3c37325db94 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:50.351519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c407dccc-2d2b-435f-9e2e-d830237f1cdb req-2b2b00e8-c814-49aa-8fe2-d3c37325db94 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.140s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:50.405002 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-c407dccc-2d2b-435f-9e2e-d830237f1cdb req-2b2b00e8-c814-49aa-8fe2-d3c37325db94 service nova] Creating event network-changed:972fbf32-4822-4220-ae24-7f06a9deba56 for instance 8513d5ff-fd14-449d-abf4-8ac5ae461cb9 on n-h1-833090-9 Jul 26 14:09:50.433684 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-c407dccc-2d2b-435f-9e2e-d830237f1cdb req-2b2b00e8-c814-49aa-8fe2-d3c37325db94 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292610 Jul 26 14:09:50.443453 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 725/1365] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:50.459048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0801cbd-08fe-4297-97e6-0acff1f0c449 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:50.461229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0801cbd-08fe-4297-97e6-0acff1f0c449 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:50.475565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0801cbd-08fe-4297-97e6-0acff1f0c449 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:50.481295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0801cbd-08fe-4297-97e6-0acff1f0c449 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:50.482603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0801cbd-08fe-4297-97e6-0acff1f0c449 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:50.483400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0801cbd-08fe-4297-97e6-0acff1f0c449 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:52.649832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0801cbd-08fe-4297-97e6-0acff1f0c449 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:52.691423 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0801cbd-08fe-4297-97e6-0acff1f0c449 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1321 microversion: 2.1 time: 2.245698 Jul 26 14:09:52.693629 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 726/1366] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:50 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1321 bytes in 2248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:52.704421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b06e9ab1-2e98-4c9a-aac6-8a6e39bbecf1 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787bccf70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:52.803478 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b06e9ab1-2e98-4c9a-aac6-8a6e39bbecf1 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.107845 Jul 26 14:09:52.804941 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 727/1367] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:52 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:52.814987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0988e3e1-0db0-4b8c-85cb-e1aa350f209e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:52.816076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0988e3e1-0db0-4b8c-85cb-e1aa350f209e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:52.824111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0988e3e1-0db0-4b8c-85cb-e1aa350f209e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:52.825268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0988e3e1-0db0-4b8c-85cb-e1aa350f209e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:52.827529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0988e3e1-0db0-4b8c-85cb-e1aa350f209e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:52.829118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0988e3e1-0db0-4b8c-85cb-e1aa350f209e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:53.510842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:09:53.512110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:09:53.512813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:09:53.513564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:09:53.514349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:09:53.581199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:53.581790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:53.582712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:53.587601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:53.665406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Getting quotas for project 46f25f5febd140a69cc213cb54ecdf5f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:09:53.675974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Getting quotas for user 7b8a1556b59644acbe6edf7c64fa76f5 and project 46f25f5febd140a69cc213cb54ecdf5f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:09:53.694771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:09:53.698785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:09:53.809084 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-01b6c5e3-6c2d-4066-9b46-4c26bb94c189 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.501087 Jul 26 14:09:53.810918 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 641/1368] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:09:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:09:53.823781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f4ba50e7-a32d-412d-8940-139202325ace tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:53.824736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f4ba50e7-a32d-412d-8940-139202325ace tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:53.834383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4ba50e7-a32d-412d-8940-139202325ace tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:53.835152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4ba50e7-a32d-412d-8940-139202325ace tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:53.836743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4ba50e7-a32d-412d-8940-139202325ace tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:53.837624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4ba50e7-a32d-412d-8940-139202325ace tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:55.159331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0988e3e1-0db0-4b8c-85cb-e1aa350f209e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:55.175156 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0988e3e1-0db0-4b8c-85cb-e1aa350f209e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1318 microversion: 2.1 time: 2.366308 Jul 26 14:09:55.194938 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 728/1369] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:52 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1318 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:55.209835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:55.210470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:55.237048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:55.237423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:55.238230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:55.238678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:55.322904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4ba50e7-a32d-412d-8940-139202325ace tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:55.335439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:55.336472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:55.337918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lazy-loading 'fault' on Instance uuid b122f14c-3b42-4a25-9908-f4b9fb64a2f2 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:09:55.342211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4ba50e7-a32d-412d-8940-139202325ace tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:55.359064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4ba50e7-a32d-412d-8940-139202325ace tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:55.361352 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f4ba50e7-a32d-412d-8940-139202325ace tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.548565 Jul 26 14:09:55.369003 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 642/1370] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:09:53 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:09:55.382643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-48581ed8-3aac-4a58-b529-141be2e2d30d req-3b1ed26f-326b-49cc-b356-74fd2349e420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a4f989-1f14-4e89-a1cc-b8fa616342f0", "tag": "3ad3111b-d40f-408c-9aa3-7d8b42f8319d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:55.475142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-48581ed8-3aac-4a58-b529-141be2e2d30d req-3b1ed26f-326b-49cc-b356-74fd2349e420 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:55.480498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-48581ed8-3aac-4a58-b529-141be2e2d30d req-3b1ed26f-326b-49cc-b356-74fd2349e420 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:55.554574 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-48581ed8-3aac-4a58-b529-141be2e2d30d req-3b1ed26f-326b-49cc-b356-74fd2349e420 service nova] Creating event network-changed:3ad3111b-d40f-408c-9aa3-7d8b42f8319d for instance 15a4f989-1f14-4e89-a1cc-b8fa616342f0 on n-h1-833090-9 Jul 26 14:09:55.572358 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-48581ed8-3aac-4a58-b529-141be2e2d30d req-3b1ed26f-326b-49cc-b356-74fd2349e420 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199364 Jul 26 14:09:55.577384 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 643/1371] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:55.599754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a972e335-d1ec-47df-8bfd-44cc363a43ef req-baeef3c2-4b2a-49c4-a4d6-47e448fdfad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54be76f6-dd14-406f-8f42-ed989a168646", "tag": "02020283-6f6d-4844-b9f2-c0fbdd431fce"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:55.644998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a972e335-d1ec-47df-8bfd-44cc363a43ef req-baeef3c2-4b2a-49c4-a4d6-47e448fdfad1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:55.645945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a972e335-d1ec-47df-8bfd-44cc363a43ef req-baeef3c2-4b2a-49c4-a4d6-47e448fdfad1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:55.698866 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a972e335-d1ec-47df-8bfd-44cc363a43ef req-baeef3c2-4b2a-49c4-a4d6-47e448fdfad1 service nova] Creating event network-changed:02020283-6f6d-4844-b9f2-c0fbdd431fce for instance 54be76f6-dd14-406f-8f42-ed989a168646 on n-h1-833090-9 Jul 26 14:09:55.720297 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a972e335-d1ec-47df-8bfd-44cc363a43ef req-baeef3c2-4b2a-49c4-a4d6-47e448fdfad1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139715 Jul 26 14:09:55.742755 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 644/1372] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:55.744386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:55.768763 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2de05778-e884-400b-a01a-fd8bcfc4d62d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 200 len: 1369 microversion: 2.1 time: 0.560207 Jul 26 14:09:55.769652 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 729/1373] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:55 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 1369 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:55.773254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-39a90661-6357-4296-b9b6-fe0255dc69b2 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:55.775497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-39a90661-6357-4296-b9b6-fe0255dc69b2 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:55.779374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ef14928d-19c1-4e65-9e4f-1b761227938a tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787c14a60>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:55.802035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39a90661-6357-4296-b9b6-fe0255dc69b2 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:55.802557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39a90661-6357-4296-b9b6-fe0255dc69b2 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:55.804691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39a90661-6357-4296-b9b6-fe0255dc69b2 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:55.805151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39a90661-6357-4296-b9b6-fe0255dc69b2 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:55.933681 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ef14928d-19c1-4e65-9e4f-1b761227938a tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.157483 Jul 26 14:09:55.933681 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 730/1374] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:55 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:55.956747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d128a743-fc3b-45dd-ac5b-74ec25a09560 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:55.964956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d128a743-fc3b-45dd-ac5b-74ec25a09560 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:56.000363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d128a743-fc3b-45dd-ac5b-74ec25a09560 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:56.001154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d128a743-fc3b-45dd-ac5b-74ec25a09560 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:56.002582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d128a743-fc3b-45dd-ac5b-74ec25a09560 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:56.003022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d128a743-fc3b-45dd-ac5b-74ec25a09560 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:56.404763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d128a743-fc3b-45dd-ac5b-74ec25a09560 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:56.416358 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d128a743-fc3b-45dd-ac5b-74ec25a09560 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1212 microversion: 2.1 time: 0.482221 Jul 26 14:09:56.421107 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 731/1375] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:55 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1212 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:56.436412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-de9dec19-1cb8-4126-ab70-c6ea44cc77bc req-9da72e4f-2075-4149-9888-f328a12d1125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7477433-f6e2-49bd-b9c1-ca75b172181c", "name": "network-vif-plugged", "status": "completed", "tag": "6f69add5-9cb3-4555-bcb4-7f721255b9ca"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:56.470195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-de9dec19-1cb8-4126-ab70-c6ea44cc77bc req-9da72e4f-2075-4149-9888-f328a12d1125 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:56.471824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-de9dec19-1cb8-4126-ab70-c6ea44cc77bc req-9da72e4f-2075-4149-9888-f328a12d1125 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:56.516776 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-de9dec19-1cb8-4126-ab70-c6ea44cc77bc req-9da72e4f-2075-4149-9888-f328a12d1125 service nova] Creating event network-vif-plugged:6f69add5-9cb3-4555-bcb4-7f721255b9ca for instance c7477433-f6e2-49bd-b9c1-ca75b172181c on n-h2-833090-9 Jul 26 14:09:56.534242 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-de9dec19-1cb8-4126-ab70-c6ea44cc77bc req-9da72e4f-2075-4149-9888-f328a12d1125 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109663 Jul 26 14:09:56.538239 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 732/1376] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:56.574391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ab9cf67f-0a1a-444d-9813-d28073dec950 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:56.575280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ab9cf67f-0a1a-444d-9813-d28073dec950 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:56.606393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab9cf67f-0a1a-444d-9813-d28073dec950 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:56.607046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab9cf67f-0a1a-444d-9813-d28073dec950 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:56.608111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab9cf67f-0a1a-444d-9813-d28073dec950 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:56.609388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab9cf67f-0a1a-444d-9813-d28073dec950 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:56.688367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-39a90661-6357-4296-b9b6-fe0255dc69b2 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:56.708856 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-39a90661-6357-4296-b9b6-fe0255dc69b2 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1321 microversion: 2.1 time: 0.958462 Jul 26 14:09:56.721202 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 645/1377] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:55 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1321 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:56.738373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d83edb8-5e89-41e9-b428-1ae0512dac75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:56.753484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d83edb8-5e89-41e9-b428-1ae0512dac75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:56.776645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d83edb8-5e89-41e9-b428-1ae0512dac75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:56.780397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d83edb8-5e89-41e9-b428-1ae0512dac75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:56.782701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d83edb8-5e89-41e9-b428-1ae0512dac75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:56.787858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d83edb8-5e89-41e9-b428-1ae0512dac75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:58.261016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ab9cf67f-0a1a-444d-9813-d28073dec950 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:58.265327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:09:58.277575 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ab9cf67f-0a1a-444d-9813-d28073dec950 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1318 microversion: 2.1 time: 1.734127 Jul 26 14:09:58.278194 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 733/1378] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:56 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1318 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:58.295173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-335e1496-c3dc-47ae-bac3-1c601041ab10 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:58.300804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-335e1496-c3dc-47ae-bac3-1c601041ab10 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: b122f14c-3b42-4a25-9908-f4b9fb64a2f2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:58.323823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335e1496-c3dc-47ae-bac3-1c601041ab10 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:58.336962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335e1496-c3dc-47ae-bac3-1c601041ab10 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:58.338774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335e1496-c3dc-47ae-bac3-1c601041ab10 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:58.339850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335e1496-c3dc-47ae-bac3-1c601041ab10 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:58.375600 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-335e1496-c3dc-47ae-bac3-1c601041ab10 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] HTTP exception thrown: Instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 could not be found. Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-335e1496-c3dc-47ae-bac3-1c601041ab10 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Request method failure captured: Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 HTTP/1.1 Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Qadeh2JypA-_GCSSC7jYfT1ihNtPypHRx0Pi6pHfrkoa4dF5igpQ-K-lEtgIlY_TKqEUxapFCVnwM2l3F2774XuQcBSfdcD5jQ8FrywWwKDv2-9ncrTqnmXWBlnC4ufl5vmuXFr4AeTAaGyUI3nN2GBLtc2AU-x9fA4hQi76dISLk Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: d2c43d5f86804cc181b575525a402873 Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-MigrationsAdminTest-1611382758 Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2c43d5f86804cc181b575525a402873"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2c43d5f86804cc181b575525a402873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2c43d5f86804cc181b575525a402873", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2c43d5f86804cc181b575525a402873"}]}] Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-MigrationsAdminTest-1611382758 Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: d2c43d5f86804cc181b575525a402873 Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-MigrationsAdminTest-1611382758 Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-MigrationsAdminTest-1611382758-project Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 753d20ca575a4270b73b1c686bf657dd Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-MigrationsAdminTest-1611382758-project Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 could not be found. Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'b122f14c-3b42-4a25-9908-f4b9fb64a2f2'} Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 could not be found. Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 could not be found. Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:09:58.380571 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:09:58.385384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:09:58.385384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:09:58.385384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:09:58.385384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:09:58.385384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:09:58.385384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 could not be found. Jul 26 14:09:58.385384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:09:58.391146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-335e1496-c3dc-47ae-bac3-1c601041ab10 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Returning 404 to user: Instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:09:58.395285 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-335e1496-c3dc-47ae-bac3-1c601041ab10 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2" status: 404 len: 111 microversion: 2.1 time: 0.103886 Jul 26 14:09:58.398965 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 734/1379] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:58 2022] GET /compute/v2.1/servers/b122f14c-3b42-4a25-9908-f4b9fb64a2f2 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:09:58.404218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d45672a1-a60b-449d-aeb6-bde5ef3929df tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787c65310>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:58.448070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0d83edb8-5e89-41e9-b428-1ae0512dac75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:58.472996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0d83edb8-5e89-41e9-b428-1ae0512dac75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:58.483041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0d83edb8-5e89-41e9-b428-1ae0512dac75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:58.498126 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d83edb8-5e89-41e9-b428-1ae0512dac75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.771111 Jul 26 14:09:58.532206 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 646/1380] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:09:56 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:09:58.549057 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d45672a1-a60b-449d-aeb6-bde5ef3929df tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.148617 Jul 26 14:09:58.556458 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 735/1381] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:09:58 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:58.566222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b3e1f33e-7f58-47a5-87b7-4f2498cf3992 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:58.567357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b3e1f33e-7f58-47a5-87b7-4f2498cf3992 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:58.581451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f8b9bac9-9fb6-4c07-9d2a-af25e63e678f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:58.582592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f8b9bac9-9fb6-4c07-9d2a-af25e63e678f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:58.591436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3e1f33e-7f58-47a5-87b7-4f2498cf3992 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:58.609482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3e1f33e-7f58-47a5-87b7-4f2498cf3992 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:58.611208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3e1f33e-7f58-47a5-87b7-4f2498cf3992 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:58.612061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3e1f33e-7f58-47a5-87b7-4f2498cf3992 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:58.620167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8b9bac9-9fb6-4c07-9d2a-af25e63e678f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:58.620955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8b9bac9-9fb6-4c07-9d2a-af25e63e678f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:58.631919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8b9bac9-9fb6-4c07-9d2a-af25e63e678f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:58.632871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8b9bac9-9fb6-4c07-9d2a-af25e63e678f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:58.848348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b3e1f33e-7f58-47a5-87b7-4f2498cf3992 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:58.862451 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b3e1f33e-7f58-47a5-87b7-4f2498cf3992 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1274 microversion: 2.1 time: 0.328278 Jul 26 14:09:58.876973 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 647/1382] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:58 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1274 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:58.892077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-497c3945-302b-4dc2-81d5-ba17d41bdbde req-f7b4ddcc-8f9d-4030-b471-f0c59fcc99fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b122f14c-3b42-4a25-9908-f4b9fb64a2f2", "name": "network-vif-deleted", "tag": "26dcbb26-ecb6-4dc2-8c29-abb0b023eb10"}, {"server_uuid": "2c2ebb15-8fe0-418b-9bff-62df9ad91d33", "name": "network-vif-deleted", "tag": "be2577e0-b145-4d72-a27c-d8bc65019933"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:58.941795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-497c3945-302b-4dc2-81d5-ba17d41bdbde req-f7b4ddcc-8f9d-4030-b471-f0c59fcc99fd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:58.944878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-497c3945-302b-4dc2-81d5-ba17d41bdbde req-f7b4ddcc-8f9d-4030-b471-f0c59fcc99fd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:58.990030 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-497c3945-302b-4dc2-81d5-ba17d41bdbde req-f7b4ddcc-8f9d-4030-b471-f0c59fcc99fd service nova] Creating event network-vif-deleted:26dcbb26-ecb6-4dc2-8c29-abb0b023eb10 for instance b122f14c-3b42-4a25-9908-f4b9fb64a2f2 on n-h1-833090-9 Jul 26 14:09:58.993609 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-497c3945-302b-4dc2-81d5-ba17d41bdbde req-f7b4ddcc-8f9d-4030-b471-f0c59fcc99fd service nova] Creating event network-vif-deleted:be2577e0-b145-4d72-a27c-d8bc65019933 for instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 on n-h2-833090-9 Jul 26 14:09:59.024719 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-497c3945-302b-4dc2-81d5-ba17d41bdbde req-f7b4ddcc-8f9d-4030-b471-f0c59fcc99fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.142145 Jul 26 14:09:59.025861 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 648/1383] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:59.052127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-16ea6906-04b3-4680-aa7c-b7d75f4b8135 req-5e53723d-23e2-44bd-b1d7-8a254d9a2716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ca67a8-07b3-4fe6-bd12-767b7985ab61", "tag": "d9efcf68-41d1-4102-bda5-1ba36b09586b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:59.100361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-16ea6906-04b3-4680-aa7c-b7d75f4b8135 req-5e53723d-23e2-44bd-b1d7-8a254d9a2716 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:59.101188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-16ea6906-04b3-4680-aa7c-b7d75f4b8135 req-5e53723d-23e2-44bd-b1d7-8a254d9a2716 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:59.163465 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-16ea6906-04b3-4680-aa7c-b7d75f4b8135 req-5e53723d-23e2-44bd-b1d7-8a254d9a2716 service nova] Creating event network-changed:d9efcf68-41d1-4102-bda5-1ba36b09586b for instance c9ca67a8-07b3-4fe6-bd12-767b7985ab61 on n-h2-833090-9 Jul 26 14:09:59.187727 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-16ea6906-04b3-4680-aa7c-b7d75f4b8135 req-5e53723d-23e2-44bd-b1d7-8a254d9a2716 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153355 Jul 26 14:09:59.189916 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 649/1384] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:59.215579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64ab62e1-e139-4901-ab42-748bc87a14c4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '.version_select at 0x7f8787d07dc0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:59.282920 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64ab62e1-e139-4901-ab42-748bc87a14c4 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655734378" status: 202 len: 0 microversion: 2.1 time: 0.087624 Jul 26 14:09:59.286780 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 650/1385] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:09:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655734378 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:09:59.295906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e91df21b-0f05-4041-8ef2-b1d7de46dbd1 req-25707940-0bec-4697-a532-3242d93ba3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fb392e-344d-42d1-8c5e-dae768cff51b", "name": "network-vif-plugged", "status": "completed", "tag": "cf694648-c6fd-4128-9b72-65d87c20b088"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:09:59.336995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e91df21b-0f05-4041-8ef2-b1d7de46dbd1 req-25707940-0bec-4697-a532-3242d93ba3b4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:59.338316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e91df21b-0f05-4041-8ef2-b1d7de46dbd1 req-25707940-0bec-4697-a532-3242d93ba3b4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:59.361628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f8b9bac9-9fb6-4c07-9d2a-af25e63e678f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:09:59.371774 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e91df21b-0f05-4041-8ef2-b1d7de46dbd1 req-25707940-0bec-4697-a532-3242d93ba3b4 service nova] Creating event network-vif-plugged:cf694648-c6fd-4128-9b72-65d87c20b088 for instance 31fb392e-344d-42d1-8c5e-dae768cff51b on n-h2-833090-9 Jul 26 14:09:59.377136 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f8b9bac9-9fb6-4c07-9d2a-af25e63e678f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1321 microversion: 2.1 time: 0.817879 Jul 26 14:09:59.380031 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 736/1386] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:58 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1321 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:09:59.384148 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e91df21b-0f05-4041-8ef2-b1d7de46dbd1 req-25707940-0bec-4697-a532-3242d93ba3b4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095817 Jul 26 14:09:59.387688 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 651/1387] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:09:59.399644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21fa3062-4037-4402-a922-67d0a839fbe6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:59.402713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-21fa3062-4037-4402-a922-67d0a839fbe6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:59.421968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21fa3062-4037-4402-a922-67d0a839fbe6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:59.422781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21fa3062-4037-4402-a922-67d0a839fbe6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:59.424578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21fa3062-4037-4402-a922-67d0a839fbe6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:59.426215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21fa3062-4037-4402-a922-67d0a839fbe6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:59.553535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8acd8532-dec9-44fb-ab92-c4813ce712c8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:09:59.554053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8acd8532-dec9-44fb-ab92-c4813ce712c8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:09:59.583600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acd8532-dec9-44fb-ab92-c4813ce712c8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:59.585995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acd8532-dec9-44fb-ab92-c4813ce712c8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:09:59.588270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acd8532-dec9-44fb-ab92-c4813ce712c8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:09:59.589910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8acd8532-dec9-44fb-ab92-c4813ce712c8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:01.802812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8acd8532-dec9-44fb-ab92-c4813ce712c8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:01.852440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8acd8532-dec9-44fb-ab92-c4813ce712c8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:01.865571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8acd8532-dec9-44fb-ab92-c4813ce712c8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:01.870428 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8acd8532-dec9-44fb-ab92-c4813ce712c8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 2.324273 Jul 26 14:10:01.876667 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 652/1388] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:09:59 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:01.885720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-27156145-6eaf-4bb3-a239-a6b2517544f5 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787eee430>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:01.938367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-21fa3062-4037-4402-a922-67d0a839fbe6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:01.980083 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-27156145-6eaf-4bb3-a239-a6b2517544f5 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.101572 Jul 26 14:10:01.981075 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 653/1389] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:01 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:01.984511 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-21fa3062-4037-4402-a922-67d0a839fbe6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1318 microversion: 2.1 time: 2.602138 Jul 26 14:10:01.994811 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 737/1390] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:09:59 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1318 bytes in 2614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:02.028956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-67408a2e-7170-426b-bd21-c1e179460a3d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:02.030743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-67408a2e-7170-426b-bd21-c1e179460a3d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:02.033912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3914e4d6-26a5-42dd-b332-f648a249b405 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:02.036050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3914e4d6-26a5-42dd-b332-f648a249b405 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:02.045949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67408a2e-7170-426b-bd21-c1e179460a3d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:02.049497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67408a2e-7170-426b-bd21-c1e179460a3d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:02.051140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67408a2e-7170-426b-bd21-c1e179460a3d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:02.055902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67408a2e-7170-426b-bd21-c1e179460a3d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:02.068208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3914e4d6-26a5-42dd-b332-f648a249b405 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:02.072922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3914e4d6-26a5-42dd-b332-f648a249b405 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:02.074735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3914e4d6-26a5-42dd-b332-f648a249b405 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:02.076774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3914e4d6-26a5-42dd-b332-f648a249b405 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:02.611597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3914e4d6-26a5-42dd-b332-f648a249b405 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:02.634754 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3914e4d6-26a5-42dd-b332-f648a249b405 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1321 microversion: 2.1 time: 0.627260 Jul 26 14:10:02.654035 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 654/1391] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:02 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1321 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:02.675994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3fa5e1b1-82a7-4a33-9e88-47ca1df4fe2b req-bfb16c7b-fd4d-4d6c-b59f-d8d407bf104a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8513d5ff-fd14-449d-abf4-8ac5ae461cb9", "name": "network-vif-plugged", "status": "completed", "tag": "972fbf32-4822-4220-ae24-7f06a9deba56"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:02.697222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3fa5e1b1-82a7-4a33-9e88-47ca1df4fe2b req-bfb16c7b-fd4d-4d6c-b59f-d8d407bf104a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:02.704352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3fa5e1b1-82a7-4a33-9e88-47ca1df4fe2b req-bfb16c7b-fd4d-4d6c-b59f-d8d407bf104a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:02.729439 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3fa5e1b1-82a7-4a33-9e88-47ca1df4fe2b req-bfb16c7b-fd4d-4d6c-b59f-d8d407bf104a service nova] Creating event network-vif-plugged:972fbf32-4822-4220-ae24-7f06a9deba56 for instance 8513d5ff-fd14-449d-abf4-8ac5ae461cb9 on n-h1-833090-9 Jul 26 14:10:02.746619 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3fa5e1b1-82a7-4a33-9e88-47ca1df4fe2b req-bfb16c7b-fd4d-4d6c-b59f-d8d407bf104a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084761 Jul 26 14:10:02.748601 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 655/1392] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:02.761405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-67408a2e-7170-426b-bd21-c1e179460a3d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:02.779120 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-67408a2e-7170-426b-bd21-c1e179460a3d tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1316 microversion: 2.1 time: 0.775768 Jul 26 14:10:02.782664 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 738/1393] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:01 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1316 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:02.915516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f00be522-37e5-498e-b466-4dd1a1b1f1c4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:02.917360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f00be522-37e5-498e-b466-4dd1a1b1f1c4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:02.936290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f00be522-37e5-498e-b466-4dd1a1b1f1c4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:02.939828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f00be522-37e5-498e-b466-4dd1a1b1f1c4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:02.942181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f00be522-37e5-498e-b466-4dd1a1b1f1c4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:02.945441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f00be522-37e5-498e-b466-4dd1a1b1f1c4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:03.004779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-62c01864-6aec-42dd-a47b-c780870c4cc5 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787c14940>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:03.182466 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-62c01864-6aec-42dd-a47b-c780870c4cc5 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.186086 Jul 26 14:10:03.184501 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 739/1394] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:02 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:03.208656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c83adbeb-fff9-4b2e-8188-e1e3b25cf131 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:03.209703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c83adbeb-fff9-4b2e-8188-e1e3b25cf131 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:03.224175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c83adbeb-fff9-4b2e-8188-e1e3b25cf131 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:03.225649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c83adbeb-fff9-4b2e-8188-e1e3b25cf131 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:03.229812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c83adbeb-fff9-4b2e-8188-e1e3b25cf131 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:03.230953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c83adbeb-fff9-4b2e-8188-e1e3b25cf131 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:03.633864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:03.686092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:03.714297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f00be522-37e5-498e-b466-4dd1a1b1f1c4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:03.748212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f00be522-37e5-498e-b466-4dd1a1b1f1c4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:03.750548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f00be522-37e5-498e-b466-4dd1a1b1f1c4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:03.752138 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f00be522-37e5-498e-b466-4dd1a1b1f1c4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 0.842155 Jul 26 14:10:03.752704 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 656/1395] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:02 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:03.805265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7f3db9c-2b74-4607-b55a-96448c248dac tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:03.821271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f7f3db9c-2b74-4607-b55a-96448c248dac tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:03.856642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7f3db9c-2b74-4607-b55a-96448c248dac tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:03.860666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7f3db9c-2b74-4607-b55a-96448c248dac tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:03.864503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7f3db9c-2b74-4607-b55a-96448c248dac tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:03.865213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7f3db9c-2b74-4607-b55a-96448c248dac tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:04.008239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c83adbeb-fff9-4b2e-8188-e1e3b25cf131 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:04.042219 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c83adbeb-fff9-4b2e-8188-e1e3b25cf131 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1318 microversion: 2.1 time: 0.852924 Jul 26 14:10:04.044002 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 740/1396] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:03 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1318 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:04.056497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-920d39ef-acac-46ba-8336-ba2e6c1c796a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:04.059056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-920d39ef-acac-46ba-8336-ba2e6c1c796a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:04.086210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-920d39ef-acac-46ba-8336-ba2e6c1c796a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:04.088307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-920d39ef-acac-46ba-8336-ba2e6c1c796a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:04.091555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-920d39ef-acac-46ba-8336-ba2e6c1c796a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:04.094670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-920d39ef-acac-46ba-8336-ba2e6c1c796a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:05.487787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f7f3db9c-2b74-4607-b55a-96448c248dac tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:05.511821 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7f3db9c-2b74-4607-b55a-96448c248dac tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1321 microversion: 2.1 time: 1.757699 Jul 26 14:10:05.514062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-920d39ef-acac-46ba-8336-ba2e6c1c796a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:05.525936 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 657/1397] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:03 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1321 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:05.544994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f2c36922-be01-429e-b153-0a509a03ef72 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787e4eee0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:05.597264 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-920d39ef-acac-46ba-8336-ba2e6c1c796a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1316 microversion: 2.1 time: 1.545444 Jul 26 14:10:05.599223 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 741/1398] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:04 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1316 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:05.624450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a862aeaf-58c6-4f3c-92a6-7e58fdcdb2dc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:05.626187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a862aeaf-58c6-4f3c-92a6-7e58fdcdb2dc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:05.718151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a862aeaf-58c6-4f3c-92a6-7e58fdcdb2dc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:05.723208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a862aeaf-58c6-4f3c-92a6-7e58fdcdb2dc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:05.730584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a862aeaf-58c6-4f3c-92a6-7e58fdcdb2dc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:05.761960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a862aeaf-58c6-4f3c-92a6-7e58fdcdb2dc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:05.819842 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f2c36922-be01-429e-b153-0a509a03ef72 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.292177 Jul 26 14:10:05.820805 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 658/1399] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:05 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:05.831607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-21be25e6-a0c2-48fa-9f0f-79d49805eadc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:05.835431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-21be25e6-a0c2-48fa-9f0f-79d49805eadc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:05.857732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21be25e6-a0c2-48fa-9f0f-79d49805eadc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:05.866036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21be25e6-a0c2-48fa-9f0f-79d49805eadc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:05.867349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21be25e6-a0c2-48fa-9f0f-79d49805eadc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:05.868031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21be25e6-a0c2-48fa-9f0f-79d49805eadc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:05.907375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a862aeaf-58c6-4f3c-92a6-7e58fdcdb2dc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:10:06.117102 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a862aeaf-58c6-4f3c-92a6-7e58fdcdb2dc tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "DELETE /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 204 len: 0 microversion: 2.1 time: 0.509554 Jul 26 14:10:06.127399 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 742/1400] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:10:05 2022] DELETE /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:10:06.146593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-0b535b28-8fed-4958-857d-5684467549dd req-2b7431a9-47a6-472f-a5bc-c97afbd42ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54be76f6-dd14-406f-8f42-ed989a168646", "name": "network-vif-plugged", "status": "completed", "tag": "02020283-6f6d-4844-b9f2-c0fbdd431fce"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:06.169726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0b535b28-8fed-4958-857d-5684467549dd req-2b7431a9-47a6-472f-a5bc-c97afbd42ccd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:06.171170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0b535b28-8fed-4958-857d-5684467549dd req-2b7431a9-47a6-472f-a5bc-c97afbd42ccd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:06.217336 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-0b535b28-8fed-4958-857d-5684467549dd req-2b7431a9-47a6-472f-a5bc-c97afbd42ccd service nova] Creating event network-vif-plugged:02020283-6f6d-4844-b9f2-c0fbdd431fce for instance 54be76f6-dd14-406f-8f42-ed989a168646 on n-h1-833090-9 Jul 26 14:10:06.257155 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-0b535b28-8fed-4958-857d-5684467549dd req-2b7431a9-47a6-472f-a5bc-c97afbd42ccd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126071 Jul 26 14:10:06.269246 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 743/1401] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:06.297050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9721dd7d-1a8f-4d62-92b7-d92bf91a7fe9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:06.298788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9721dd7d-1a8f-4d62-92b7-d92bf91a7fe9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:06.340021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9721dd7d-1a8f-4d62-92b7-d92bf91a7fe9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:06.345452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9721dd7d-1a8f-4d62-92b7-d92bf91a7fe9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:06.348070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9721dd7d-1a8f-4d62-92b7-d92bf91a7fe9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:06.349292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9721dd7d-1a8f-4d62-92b7-d92bf91a7fe9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:07.382500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-21be25e6-a0c2-48fa-9f0f-79d49805eadc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:07.469571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-21be25e6-a0c2-48fa-9f0f-79d49805eadc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:07.472717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-21be25e6-a0c2-48fa-9f0f-79d49805eadc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:07.486562 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-21be25e6-a0c2-48fa-9f0f-79d49805eadc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.659876 Jul 26 14:10:07.487633 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 659/1402] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:05 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:07.544410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9721dd7d-1a8f-4d62-92b7-d92bf91a7fe9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:07.552543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-df8f7a2d-7195-4f83-9b39-577884ef506d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:07.554239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-df8f7a2d-7195-4f83-9b39-577884ef506d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:07.559585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:07.560005 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9721dd7d-1a8f-4d62-92b7-d92bf91a7fe9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1468 microversion: 2.1 time: 1.288294 Jul 26 14:10:07.561318 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 744/1403] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:06 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1468 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:07.571778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-87746879-d8f2-4cb7-80fe-1b6018e18550 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:07.573860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-87746879-d8f2-4cb7-80fe-1b6018e18550 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:07.587133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-87746879-d8f2-4cb7-80fe-1b6018e18550 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:07.594224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-87746879-d8f2-4cb7-80fe-1b6018e18550 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:07.596703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-87746879-d8f2-4cb7-80fe-1b6018e18550 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:07.598211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-87746879-d8f2-4cb7-80fe-1b6018e18550 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:07.609869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df8f7a2d-7195-4f83-9b39-577884ef506d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:07.612535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df8f7a2d-7195-4f83-9b39-577884ef506d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:07.618247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df8f7a2d-7195-4f83-9b39-577884ef506d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:07.625132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df8f7a2d-7195-4f83-9b39-577884ef506d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:08.244659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-df8f7a2d-7195-4f83-9b39-577884ef506d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:08.274734 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-df8f7a2d-7195-4f83-9b39-577884ef506d tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1467 microversion: 2.1 time: 0.741434 Jul 26 14:10:08.277791 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 660/1404] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:07 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1467 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:08.302471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55747e2b-d83c-4ece-8ae4-3fdd5b518975 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:08.309304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-55747e2b-d83c-4ece-8ae4-3fdd5b518975 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:08.337610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55747e2b-d83c-4ece-8ae4-3fdd5b518975 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:08.338307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55747e2b-d83c-4ece-8ae4-3fdd5b518975 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:08.351343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55747e2b-d83c-4ece-8ae4-3fdd5b518975 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:08.352759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55747e2b-d83c-4ece-8ae4-3fdd5b518975 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:08.627498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-87746879-d8f2-4cb7-80fe-1b6018e18550 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:08.635597 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-87746879-d8f2-4cb7-80fe-1b6018e18550 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1321 microversion: 2.1 time: 1.071844 Jul 26 14:10:08.636314 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 745/1405] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:07 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1321 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:08.654275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a7c97b85-ce84-434a-ae4b-a3364041fdec req-d5a3d21d-079e-439a-89fe-463202086dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2d1d90-5bc8-458d-b336-97b257732f89", "tag": "d781d91d-4c50-4ce1-8f4a-91816a69dd86"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:08.679411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a7c97b85-ce84-434a-ae4b-a3364041fdec req-d5a3d21d-079e-439a-89fe-463202086dfe service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:08.680203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a7c97b85-ce84-434a-ae4b-a3364041fdec req-d5a3d21d-079e-439a-89fe-463202086dfe service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:08.735547 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a7c97b85-ce84-434a-ae4b-a3364041fdec req-d5a3d21d-079e-439a-89fe-463202086dfe service nova] Creating event network-changed:d781d91d-4c50-4ce1-8f4a-91816a69dd86 for instance de2d1d90-5bc8-458d-b336-97b257732f89 on n-h1-833090-9 Jul 26 14:10:08.746723 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a7c97b85-ce84-434a-ae4b-a3364041fdec req-d5a3d21d-079e-439a-89fe-463202086dfe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107289 Jul 26 14:10:08.748336 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 746/1406] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:08.759819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d3df7ee1-e617-4e43-8bce-09651da1d1fa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8794279040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:08.904025 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d3df7ee1-e617-4e43-8bce-09651da1d1fa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.152023 Jul 26 14:10:08.905618 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 747/1407] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:08 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:08.917150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-55747e2b-d83c-4ece-8ae4-3fdd5b518975 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:08.918877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e22b1e10-f328-4647-a0dd-2dd429285b4d tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Action: 'create', calling method: .version_select at 0x7f8787bccaf0>, body: {"keypair": {"name": "tempest-keypair-713665900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmeENzV2ynfM0GtBbwrBvQTtjFGd6CQgfRNesJUjx9u/6oqZMvxRDIHP7S8m07LEl2D4bJOCXgPzcBe+O1F+7SG3mSHqjRfBfKbXtmmkWYchworqI6ftZpoRUJPTuzh1w=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:08.939030 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-55747e2b-d83c-4ece-8ae4-3fdd5b518975 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1316 microversion: 2.1 time: 0.655954 Jul 26 14:10:08.940422 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 661/1408] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:08 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:08.945882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-34a6981c-7fa9-485c-b1f4-e15b0892aa99 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:08.946568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-34a6981c-7fa9-485c-b1f4-e15b0892aa99 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: c7477433-f6e2-49bd-b9c1-ca75b172181c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:08.964491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e22b1e10-f328-4647-a0dd-2dd429285b4d tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Getting quotas for project b2bbec12160842eab535494da3e993aa. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:10:08.985394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e22b1e10-f328-4647-a0dd-2dd429285b4d tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Getting quotas for user 8ad8834232064fa7bb2164d542d29e32 and project b2bbec12160842eab535494da3e993aa. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:10:09.025664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34a6981c-7fa9-485c-b1f4-e15b0892aa99 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:09.026261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34a6981c-7fa9-485c-b1f4-e15b0892aa99 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:09.027859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34a6981c-7fa9-485c-b1f4-e15b0892aa99 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:09.029122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34a6981c-7fa9-485c-b1f4-e15b0892aa99 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:09.036717 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e22b1e10-f328-4647-a0dd-2dd429285b4d tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.129037 Jul 26 14:10:09.037962 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 748/1409] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Jul 26 14:10:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 14:10:09.061311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e19a8025-4c30-43de-b4c4-a716ed285a20 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:09.066986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e19a8025-4c30-43de-b4c4-a716ed285a20 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:09.119672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e19a8025-4c30-43de-b4c4-a716ed285a20 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:09.120715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e19a8025-4c30-43de-b4c4-a716ed285a20 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:09.122063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e19a8025-4c30-43de-b4c4-a716ed285a20 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:09.135221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e19a8025-4c30-43de-b4c4-a716ed285a20 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:10.289387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e19a8025-4c30-43de-b4c4-a716ed285a20 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:10.328268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e19a8025-4c30-43de-b4c4-a716ed285a20 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:10.335157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e19a8025-4c30-43de-b4c4-a716ed285a20 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:10.352229 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e19a8025-4c30-43de-b4c4-a716ed285a20 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.296122 Jul 26 14:10:10.356083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-34a6981c-7fa9-485c-b1f4-e15b0892aa99 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:10.356688 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 749/1410] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:09 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:10.368154 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-34a6981c-7fa9-485c-b1f4-e15b0892aa99 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c" status: 200 len: 1467 microversion: 2.1 time: 1.426598 Jul 26 14:10:10.372777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ee33e65f-d0f5-4598-8439-73ea2ef8a342 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:10.379789 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 662/1411] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:08 2022] GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c => generated 1467 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:10.382168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ee33e65f-d0f5-4598-8439-73ea2ef8a342 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:10.387385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-1725193e-b580-4a17-824e-9564ec9227bd req-fc2fe344-2bef-455b-bdeb-287fa9582f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ca67a8-07b3-4fe6-bd12-767b7985ab61", "name": "network-vif-plugged", "status": "completed", "tag": "d9efcf68-41d1-4102-bda5-1ba36b09586b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:10.411856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee33e65f-d0f5-4598-8439-73ea2ef8a342 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:10.418840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee33e65f-d0f5-4598-8439-73ea2ef8a342 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:10.422935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee33e65f-d0f5-4598-8439-73ea2ef8a342 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:10.434093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee33e65f-d0f5-4598-8439-73ea2ef8a342 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:10.439612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1725193e-b580-4a17-824e-9564ec9227bd req-fc2fe344-2bef-455b-bdeb-287fa9582f33 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:10.448262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1725193e-b580-4a17-824e-9564ec9227bd req-fc2fe344-2bef-455b-bdeb-287fa9582f33 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:10.501184 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-1725193e-b580-4a17-824e-9564ec9227bd req-fc2fe344-2bef-455b-bdeb-287fa9582f33 service nova] Creating event network-vif-plugged:d9efcf68-41d1-4102-bda5-1ba36b09586b for instance c9ca67a8-07b3-4fe6-bd12-767b7985ab61 on n-h2-833090-9 Jul 26 14:10:10.539845 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-1725193e-b580-4a17-824e-9564ec9227bd req-fc2fe344-2bef-455b-bdeb-287fa9582f33 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155293 Jul 26 14:10:10.543017 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 663/1412] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:10.561071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce124736-be8a-4bee-85f8-4a1d51802a69 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:10.563161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce124736-be8a-4bee-85f8-4a1d51802a69 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:10.585182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce124736-be8a-4bee-85f8-4a1d51802a69 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:10.586129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce124736-be8a-4bee-85f8-4a1d51802a69 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:10.589609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce124736-be8a-4bee-85f8-4a1d51802a69 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:10.591747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce124736-be8a-4bee-85f8-4a1d51802a69 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:10.637567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:10.959442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ee33e65f-d0f5-4598-8439-73ea2ef8a342 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:11.015378 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ee33e65f-d0f5-4598-8439-73ea2ef8a342 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 200 len: 1425 microversion: 2.1 time: 0.656788 Jul 26 14:10:11.023577 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 750/1413] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:10 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 1425 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:11.059549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3d635cc-b6a3-4e4e-bdbc-c0508e69daaa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787d7a310>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:11.160052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ce124736-be8a-4bee-85f8-4a1d51802a69 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:11.177675 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce124736-be8a-4bee-85f8-4a1d51802a69 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1321 microversion: 2.1 time: 0.628982 Jul 26 14:10:11.189307 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 664/1414] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:10 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1321 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:11.198305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44b70bf0-caa0-48cf-b7f6-879aba788f05 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:11.199098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44b70bf0-caa0-48cf-b7f6-879aba788f05 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:11.238657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44b70bf0-caa0-48cf-b7f6-879aba788f05 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:11.248176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44b70bf0-caa0-48cf-b7f6-879aba788f05 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:11.249996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44b70bf0-caa0-48cf-b7f6-879aba788f05 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:11.252636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44b70bf0-caa0-48cf-b7f6-879aba788f05 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:11.282060 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a3d635cc-b6a3-4e4e-bdbc-c0508e69daaa tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.256662 Jul 26 14:10:11.285547 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 751/1415] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:11 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:11.301490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:11.314604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:11.330787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Searching by: {'reservation_id': 'r-szkdu2uj', 'deleted': False, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:11.366516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:11.371657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:11.380328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:11.384093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:11.679807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:10:11.887820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:11.901958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:11.902733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:12.410878 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9ad9f088-5e4f-4723-8c51-d086c8454b30 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?reservation_id=r-szkdu2uj" status: 200 len: 2928 microversion: 2.1 time: 1.123551 Jul 26 14:10:12.411908 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 752/1416] 10.222.0.70 () {58 vars in 1197 bytes} [Tue Jul 26 14:10:11 2022] GET /compute/v2.1/servers/detail?reservation_id=r-szkdu2uj => generated 2928 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:12.417443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9e38321f-7711-4efb-b63a-1dbf37d2fbc3 req-549276f8-751e-4f7c-8fb7-90ace44a62c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9a10de-f7c8-4e73-8803-471376cb000a", "name": "network-vif-deleted", "tag": "6728d156-9e70-4308-aeaa-e54d42714d76"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:12.448872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9e38321f-7711-4efb-b63a-1dbf37d2fbc3 req-549276f8-751e-4f7c-8fb7-90ace44a62c9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:12.449333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9e38321f-7711-4efb-b63a-1dbf37d2fbc3 req-549276f8-751e-4f7c-8fb7-90ace44a62c9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:12.468361 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9e38321f-7711-4efb-b63a-1dbf37d2fbc3 req-549276f8-751e-4f7c-8fb7-90ace44a62c9 service nova] Creating event network-vif-deleted:6728d156-9e70-4308-aeaa-e54d42714d76 for instance af9a10de-f7c8-4e73-8803-471376cb000a on n-h2-833090-9 Jul 26 14:10:12.474533 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9e38321f-7711-4efb-b63a-1dbf37d2fbc3 req-549276f8-751e-4f7c-8fb7-90ace44a62c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060916 Jul 26 14:10:12.476481 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 753/1417] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:12.487315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-75683bb1-1ee0-4fa9-8a96-8a31956c813a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:12.490849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-75683bb1-1ee0-4fa9-8a96-8a31956c813a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:12.498833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75683bb1-1ee0-4fa9-8a96-8a31956c813a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:12.499305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75683bb1-1ee0-4fa9-8a96-8a31956c813a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:12.500946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75683bb1-1ee0-4fa9-8a96-8a31956c813a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:12.501404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75683bb1-1ee0-4fa9-8a96-8a31956c813a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:12.541550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-44b70bf0-caa0-48cf-b7f6-879aba788f05 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:12.554035 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-44b70bf0-caa0-48cf-b7f6-879aba788f05 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1316 microversion: 2.1 time: 1.363424 Jul 26 14:10:12.568398 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 665/1418] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:11 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1316 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:12.578922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22186fdd-7aee-439a-84f9-30f295ae9edb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:12.580384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22186fdd-7aee-439a-84f9-30f295ae9edb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: af9a10de-f7c8-4e73-8803-471376cb000a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:12.587502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22186fdd-7aee-439a-84f9-30f295ae9edb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:12.588364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22186fdd-7aee-439a-84f9-30f295ae9edb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:12.589681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22186fdd-7aee-439a-84f9-30f295ae9edb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:12.590350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22186fdd-7aee-439a-84f9-30f295ae9edb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:12.606410 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-22186fdd-7aee-439a-84f9-30f295ae9edb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] HTTP exception thrown: Instance af9a10de-f7c8-4e73-8803-471376cb000a could not be found. Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22186fdd-7aee-439a-84f9-30f295ae9edb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Request method failure captured: Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a HTTP/1.1 Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_Qadeh2JypA-_GCSSC7jYfT1ihNtPypHRx0Pi6pHfrkoa4dF5igpQ-K-lEtgIlY_TKqEUxapFCVnwM2l3F2774XuQcBSfdcD5jQ8FrywWwKDv2-9ncrTqnmXWBlnC4ufl5vmuXFr4AeTAaGyUI3nN2GBLtc2AU-x9fA4hQi76dISLk Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: d2c43d5f86804cc181b575525a402873 Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-MigrationsAdminTest-1611382758 Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2c43d5f86804cc181b575525a402873"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2c43d5f86804cc181b575525a402873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2c43d5f86804cc181b575525a402873", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2c43d5f86804cc181b575525a402873"}]}] Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-MigrationsAdminTest-1611382758 Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: d2c43d5f86804cc181b575525a402873 Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-MigrationsAdminTest-1611382758 Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-MigrationsAdminTest-1611382758-project Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 753d20ca575a4270b73b1c686bf657dd Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-MigrationsAdminTest-1611382758-project Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance af9a10de-f7c8-4e73-8803-471376cb000a could not be found. Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'af9a10de-f7c8-4e73-8803-471376cb000a'} Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9a10de-f7c8-4e73-8803-471376cb000a could not be found. Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9a10de-f7c8-4e73-8803-471376cb000a could not be found. Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:10:12.608518 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:10:12.614529 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:12.614529 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:10:12.614529 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:10:12.614529 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:10:12.614529 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:10:12.614529 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9a10de-f7c8-4e73-8803-471376cb000a could not be found. Jul 26 14:10:12.614529 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:10:12.617914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22186fdd-7aee-439a-84f9-30f295ae9edb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Returning 404 to user: Instance af9a10de-f7c8-4e73-8803-471376cb000a could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:10:12.619274 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22186fdd-7aee-439a-84f9-30f295ae9edb tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a" status: 404 len: 111 microversion: 2.1 time: 0.049356 Jul 26 14:10:12.624735 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 666/1419] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:12 2022] GET /compute/v2.1/servers/af9a10de-f7c8-4e73-8803-471376cb000a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:10:12.630848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f6351f56-fb74-4223-8299-1d90fa934cc8 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:12.631882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f6351f56-fb74-4223-8299-1d90fa934cc8 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:12.639371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6351f56-fb74-4223-8299-1d90fa934cc8 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:12.641270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6351f56-fb74-4223-8299-1d90fa934cc8 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:12.643212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6351f56-fb74-4223-8299-1d90fa934cc8 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:12.644441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6351f56-fb74-4223-8299-1d90fa934cc8 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:13.184280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-75683bb1-1ee0-4fa9-8a96-8a31956c813a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:13.203794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-75683bb1-1ee0-4fa9-8a96-8a31956c813a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:13.206829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-75683bb1-1ee0-4fa9-8a96-8a31956c813a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:13.208996 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-75683bb1-1ee0-4fa9-8a96-8a31956c813a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 0.730860 Jul 26 14:10:13.209966 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 754/1420] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:12 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:13.237644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-330e111a-d4f4-4fd5-beff-7a85cddc68dc tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787d0d430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:13.257745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f6351f56-fb74-4223-8299-1d90fa934cc8 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:13.273773 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f6351f56-fb74-4223-8299-1d90fa934cc8 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1321 microversion: 2.1 time: 0.646750 Jul 26 14:10:13.275075 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 667/1421] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:12 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1321 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:13.293953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4492f4f2-56b0-4b0f-8c96-d514ff75d34b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:13.319462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.compute.server_groups [None req-4492f4f2-56b0-4b0f-8c96-d514ff75d34b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Querying cell b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) for 2 instances {{(pid=119478) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 14:10:13.320667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4492f4f2-56b0-4b0f-8c96-d514ff75d34b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:13.321309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4492f4f2-56b0-4b0f-8c96-d514ff75d34b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:13.340772 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-330e111a-d4f4-4fd5-beff-7a85cddc68dc tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1454 microversion: 2.1 time: 0.114437 Jul 26 14:10:13.343024 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 755/1422] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:13 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:13.351715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d65acc3-d570-4dbb-a780-acfc8a0b804a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:13.353500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4d65acc3-d570-4dbb-a780-acfc8a0b804a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:13.365290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d65acc3-d570-4dbb-a780-acfc8a0b804a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:13.366052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d65acc3-d570-4dbb-a780-acfc8a0b804a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:13.367560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d65acc3-d570-4dbb-a780-acfc8a0b804a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:13.368264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d65acc3-d570-4dbb-a780-acfc8a0b804a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:13.381100 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4492f4f2-56b0-4b0f-8c96-d514ff75d34b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/1a6cd7d7-0cdf-486c-bdb0-d97f6ac8c236" status: 200 len: 270 microversion: 2.1 time: 0.103839 Jul 26 14:10:13.382334 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 668/1423] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:10:13 2022] GET /compute/v2.1/os-server-groups/1a6cd7d7-0cdf-486c-bdb0-d97f6ac8c236 => generated 270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:13.392129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-985417923", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dee291b4-380e-4ae3-8468-7b1d47e62966"}, {"port": "995b58f3-2d21-4838-b5f8-d2d38a7e67b6", "tag": "port-1"}, {"port": "3669b3fd-06c9-4344-9f7e-41276ab83aa8", "tag": "port-2"}, {"uuid": "e8d9bf46-3ae1-467a-a923-1910f13059a3", "tag": "net-1"}, {"uuid": "e8d9bf46-3ae1-467a-a923-1910f13059a3"}, {"uuid": "004a7aa0-befa-46d8-8a2d-d0187ba34a8c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "004a7aa0-befa-46d8-8a2d-d0187ba34a8c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "104b4a1a-973b-4b6c-aadb-d7d935095358", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fe8bf23b-c1f0-4dac-b740-e7920d0d1357", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b18c2ea3-7d50-42ca-b35d-305c1c9f908b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1101841376"}], "key_name": "tempest-keypair-713665900", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:13.477615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4d65acc3-d570-4dbb-a780-acfc8a0b804a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:10:13.490185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:13.602822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] validate_networks() for [('dee291b4-380e-4ae3-8468-7b1d47e62966', None, None, None, None, None), (None, None, '995b58f3-2d21-4838-b5f8-d2d38a7e67b6', None, None, None), (None, None, '3669b3fd-06c9-4344-9f7e-41276ab83aa8', None, None, None), ('e8d9bf46-3ae1-467a-a923-1910f13059a3', None, None, None, None, None), ('e8d9bf46-3ae1-467a-a923-1910f13059a3', None, None, None, None, None), ('004a7aa0-befa-46d8-8a2d-d0187ba34a8c', '10.2.2.100', None, None, None, None), ('004a7aa0-befa-46d8-8a2d-d0187ba34a8c', '10.2.2.200', None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:10:13.685310 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d65acc3-d570-4dbb-a780-acfc8a0b804a tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 204 len: 0 microversion: 2.1 time: 0.341055 Jul 26 14:10:13.691007 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 756/1424] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:10:13 2022] DELETE /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:10:13.696430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e1dd39e4-1863-45c9-966f-f879c8e26ec4 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:13.697149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e1dd39e4-1863-45c9-966f-f879c8e26ec4 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:13.704571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1dd39e4-1863-45c9-966f-f879c8e26ec4 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:13.705792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1dd39e4-1863-45c9-966f-f879c8e26ec4 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:13.706583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1dd39e4-1863-45c9-966f-f879c8e26ec4 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:13.706922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1dd39e4-1863-45c9-966f-f879c8e26ec4 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:14.178012 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e1dd39e4-1863-45c9-966f-f879c8e26ec4 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 200 len: 1619 microversion: 2.1 time: 0.487851 Jul 26 14:10:14.193104 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 757/1425] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:13 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 1619 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:14.210010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-79cf5ecf-9a80-4d4f-a71b-af701cd82206 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:14.210945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79cf5ecf-9a80-4d4f-a71b-af701cd82206 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:14.245634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79cf5ecf-9a80-4d4f-a71b-af701cd82206 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:14.248337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79cf5ecf-9a80-4d4f-a71b-af701cd82206 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:14.264760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79cf5ecf-9a80-4d4f-a71b-af701cd82206 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:14.266355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79cf5ecf-9a80-4d4f-a71b-af701cd82206 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:14.725010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-79cf5ecf-9a80-4d4f-a71b-af701cd82206 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:14.740090 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-79cf5ecf-9a80-4d4f-a71b-af701cd82206 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1316 microversion: 2.1 time: 0.544013 Jul 26 14:10:14.753603 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 758/1426] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:14 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:14.753603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-02a67281-670e-413f-943c-8a8ecd316dc2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:14.753603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-02a67281-670e-413f-943c-8a8ecd316dc2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:14.760892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02a67281-670e-413f-943c-8a8ecd316dc2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:14.761879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02a67281-670e-413f-943c-8a8ecd316dc2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:14.763199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02a67281-670e-413f-943c-8a8ecd316dc2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:14.764216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02a67281-670e-413f-943c-8a8ecd316dc2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:15.169358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-02a67281-670e-413f-943c-8a8ecd316dc2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753d20ca575a4270b73b1c686bf657dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c43d5f86804cc181b575525a402873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:15.177666 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-02a67281-670e-413f-943c-8a8ecd316dc2 tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 200 len: 1468 microversion: 2.1 time: 0.435362 Jul 26 14:10:15.178258 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 759/1427] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:14 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 1468 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:15.182784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-88e09e9d-6899-42dd-975c-b5282dc4d793 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:15.183408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-88e09e9d-6899-42dd-975c-b5282dc4d793 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] [instance: c7477433-f6e2-49bd-b9c1-ca75b172181c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:15.191897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88e09e9d-6899-42dd-975c-b5282dc4d793 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:15.191897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88e09e9d-6899-42dd-975c-b5282dc4d793 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:15.193693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88e09e9d-6899-42dd-975c-b5282dc4d793 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:15.194199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88e09e9d-6899-42dd-975c-b5282dc4d793 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:15.629100 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-88e09e9d-6899-42dd-975c-b5282dc4d793 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c" status: 200 len: 1618 microversion: 2.1 time: 0.449423 Jul 26 14:10:15.630676 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 760/1428] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:15 2022] GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c => generated 1618 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:15.639210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b7cf586-df79-44cf-a40f-1eea5f480c1f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:15.641112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7b7cf586-df79-44cf-a40f-1eea5f480c1f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:15.651174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b7cf586-df79-44cf-a40f-1eea5f480c1f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:15.652330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b7cf586-df79-44cf-a40f-1eea5f480c1f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:15.653662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b7cf586-df79-44cf-a40f-1eea5f480c1f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:15.654602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b7cf586-df79-44cf-a40f-1eea5f480c1f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:15.979679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b7cf586-df79-44cf-a40f-1eea5f480c1f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:15.999789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b7cf586-df79-44cf-a40f-1eea5f480c1f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:16.003034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b7cf586-df79-44cf-a40f-1eea5f480c1f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:16.005153 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b7cf586-df79-44cf-a40f-1eea5f480c1f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 0.372601 Jul 26 14:10:16.006354 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 761/1429] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:15 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:16.016373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8bf744bf-db07-4702-bdbe-7e030fb132b3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:16.017116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8bf744bf-db07-4702-bdbe-7e030fb132b3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:16.028052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8bf744bf-db07-4702-bdbe-7e030fb132b3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:16.028780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8bf744bf-db07-4702-bdbe-7e030fb132b3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:16.030092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8bf744bf-db07-4702-bdbe-7e030fb132b3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:16.031472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8bf744bf-db07-4702-bdbe-7e030fb132b3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:16.371161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8bf744bf-db07-4702-bdbe-7e030fb132b3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:16.394499 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8bf744bf-db07-4702-bdbe-7e030fb132b3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1511 microversion: 2.1 time: 0.386225 Jul 26 14:10:16.395923 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 762/1430] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:16 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1511 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:16.433142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-02afc22c-4052-4b1c-b3dc-76dc460d2c8e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787ec0310>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:16.518001 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-02afc22c-4052-4b1c-b3dc-76dc460d2c8e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1463 microversion: 2.1 time: 0.099787 Jul 26 14:10:16.519227 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 763/1431] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:16 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1463 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:16.527505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-abd5f53a-22b1-49f5-b184-23bb5bf51d5d req-28e40689-9d78-49d6-af60-e053aa1bee6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4414ffa1-1053-4d24-864e-d1a943883be3", "name": "network-vif-deleted", "tag": "a8df3bca-8031-4c87-b071-df70fe2e1de9"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:16.545394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-abd5f53a-22b1-49f5-b184-23bb5bf51d5d req-28e40689-9d78-49d6-af60-e053aa1bee6e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:16.546311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-abd5f53a-22b1-49f5-b184-23bb5bf51d5d req-28e40689-9d78-49d6-af60-e053aa1bee6e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:16.581806 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-abd5f53a-22b1-49f5-b184-23bb5bf51d5d req-28e40689-9d78-49d6-af60-e053aa1bee6e service nova] Creating event network-vif-deleted:a8df3bca-8031-4c87-b071-df70fe2e1de9 for instance 4414ffa1-1053-4d24-864e-d1a943883be3 on n-h1-833090-9 Jul 26 14:10:16.593263 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-abd5f53a-22b1-49f5-b184-23bb5bf51d5d req-28e40689-9d78-49d6-af60-e053aa1bee6e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071899 Jul 26 14:10:16.595287 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 764/1432] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:16.605685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-18728174", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "34089008-8d17-4f4a-a989-57f47959ae93"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:16.687135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:10:17.239221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:10:17.240366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:10:17.240845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:10:17.241568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:10:17.242298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:10:17.259313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:17.260124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:17.261508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:17.262275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:17.294464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:10:17.301158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:10:17.304101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:17.324222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:10:17.326932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:10:17.407020 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-348cf1ad-5259-4ef9-afba-f4ade52e2465 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.808644 Jul 26 14:10:17.408642 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 765/1433] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:10:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:10:17.420484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c6472b1e-ddc5-4b15-afb4-44d642c003d7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:17.422309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c6472b1e-ddc5-4b15-afb4-44d642c003d7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:17.435812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6472b1e-ddc5-4b15-afb4-44d642c003d7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:17.436708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6472b1e-ddc5-4b15-afb4-44d642c003d7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:17.439030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6472b1e-ddc5-4b15-afb4-44d642c003d7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:17.440407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6472b1e-ddc5-4b15-afb4-44d642c003d7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:17.851068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c6472b1e-ddc5-4b15-afb4-44d642c003d7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:17.864861 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c6472b1e-ddc5-4b15-afb4-44d642c003d7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1316 microversion: 2.1 time: 0.452276 Jul 26 14:10:17.870687 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 766/1434] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:17 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:17.875507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d875cc7-b92f-4c09-9e39-628f09321d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:17.876603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2d875cc7-b92f-4c09-9e39-628f09321d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] [instance: 4414ffa1-1053-4d24-864e-d1a943883be3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:17.888506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d875cc7-b92f-4c09-9e39-628f09321d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:17.889654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d875cc7-b92f-4c09-9e39-628f09321d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:17.891834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d875cc7-b92f-4c09-9e39-628f09321d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:17.892885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d875cc7-b92f-4c09-9e39-628f09321d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:17.928613 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-2d875cc7-b92f-4c09-9e39-628f09321d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] HTTP exception thrown: Instance 4414ffa1-1053-4d24-864e-d1a943883be3 could not be found. Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d875cc7-b92f-4c09-9e39-628f09321d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Request method failure captured: Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 HTTP/1.1 Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Qadeh2JypA-_GCSSC7jYfT1ihNtPypHRx0Pi6pHfrkoa4dF5igpQ-K-lEtgIlY_TKqEUxapFCVnwM2l3F2774XuQcBSfdcD5jQ8FrywWwKDv2-9ncrTqnmXWBlnC4ufl5vmuXFr4AeTAaGyUI3nN2GBLtc2AU-x9fA4hQi76dISLk Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: d2c43d5f86804cc181b575525a402873 Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-MigrationsAdminTest-1611382758 Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2c43d5f86804cc181b575525a402873"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2c43d5f86804cc181b575525a402873"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2c43d5f86804cc181b575525a402873", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2c43d5f86804cc181b575525a402873"}]}] Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-MigrationsAdminTest-1611382758 Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: d2c43d5f86804cc181b575525a402873 Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-MigrationsAdminTest-1611382758 Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-MigrationsAdminTest-1611382758-project Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 753d20ca575a4270b73b1c686bf657dd Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-MigrationsAdminTest-1611382758-project Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 4414ffa1-1053-4d24-864e-d1a943883be3 could not be found. Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4414ffa1-1053-4d24-864e-d1a943883be3'} Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4414ffa1-1053-4d24-864e-d1a943883be3 could not be found. Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4414ffa1-1053-4d24-864e-d1a943883be3 could not be found. Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:10:17.932813 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:17.943281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:17.943281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:10:17.943281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:10:17.943281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:10:17.943281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:10:17.943281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4414ffa1-1053-4d24-864e-d1a943883be3 could not be found. Jul 26 14:10:17.943281 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:17.948639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d875cc7-b92f-4c09-9e39-628f09321d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] Returning 404 to user: Instance 4414ffa1-1053-4d24-864e-d1a943883be3 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:10:17.948639 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d875cc7-b92f-4c09-9e39-628f09321d4e tempest-MigrationsAdminTest-1611382758 tempest-MigrationsAdminTest-1611382758-project] 10.222.0.70 "GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3" status: 404 len: 111 microversion: 2.1 time: 0.079209 Jul 26 14:10:17.950107 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 767/1435] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:17 2022] GET /compute/v2.1/servers/4414ffa1-1053-4d24-864e-d1a943883be3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:10:17.959703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fd0721f8-ae2f-4c3c-8e61-8edb903e5aa9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:17.960876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fd0721f8-ae2f-4c3c-8e61-8edb903e5aa9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:17.974236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd0721f8-ae2f-4c3c-8e61-8edb903e5aa9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:17.975125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd0721f8-ae2f-4c3c-8e61-8edb903e5aa9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:17.976601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd0721f8-ae2f-4c3c-8e61-8edb903e5aa9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:17.977413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd0721f8-ae2f-4c3c-8e61-8edb903e5aa9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:18.520979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fd0721f8-ae2f-4c3c-8e61-8edb903e5aa9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:18.551710 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fd0721f8-ae2f-4c3c-8e61-8edb903e5aa9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1511 microversion: 2.1 time: 0.598100 Jul 26 14:10:18.569500 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 768/1436] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:17 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1511 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:18.587340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5476d50a-77df-42be-83c7-549a2efdcdeb tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787dfc040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:18.700396 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5476d50a-77df-42be-83c7-549a2efdcdeb tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 200 len: 1463 microversion: 2.1 time: 0.127710 Jul 26 14:10:18.701359 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 769/1437] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:18 2022] GET /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 1463 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:18.710984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a6e1f973-7bfe-41a1-9fa1-a0d27bcb3cb1 req-46301b1b-f752-484d-89ce-79e8eb419c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2d1d90-5bc8-458d-b336-97b257732f89", "name": "network-vif-plugged", "status": "completed", "tag": "d781d91d-4c50-4ce1-8f4a-91816a69dd86"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:18.729284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a6e1f973-7bfe-41a1-9fa1-a0d27bcb3cb1 req-46301b1b-f752-484d-89ce-79e8eb419c83 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:18.730148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a6e1f973-7bfe-41a1-9fa1-a0d27bcb3cb1 req-46301b1b-f752-484d-89ce-79e8eb419c83 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:18.750495 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a6e1f973-7bfe-41a1-9fa1-a0d27bcb3cb1 req-46301b1b-f752-484d-89ce-79e8eb419c83 service nova] Creating event network-vif-plugged:d781d91d-4c50-4ce1-8f4a-91816a69dd86 for instance de2d1d90-5bc8-458d-b336-97b257732f89 on n-h1-833090-9 Jul 26 14:10:18.761411 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a6e1f973-7bfe-41a1-9fa1-a0d27bcb3cb1 req-46301b1b-f752-484d-89ce-79e8eb419c83 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055384 Jul 26 14:10:18.761411 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 770/1438] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:18.773856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9b0d75f9-09b5-4f3d-989b-fe5fa9ed2902 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:18.775130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9b0d75f9-09b5-4f3d-989b-fe5fa9ed2902 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:18.798349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b0d75f9-09b5-4f3d-989b-fe5fa9ed2902 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:18.798349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b0d75f9-09b5-4f3d-989b-fe5fa9ed2902 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:18.800473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b0d75f9-09b5-4f3d-989b-fe5fa9ed2902 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:18.801605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b0d75f9-09b5-4f3d-989b-fe5fa9ed2902 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:19.615270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:10:19.617876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:10:19.618882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:10:19.620419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:10:19.621322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:10:19.649397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:19.650684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:19.652777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:19.654123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:19.710484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Getting quotas for project b2bbec12160842eab535494da3e993aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:10:19.722111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Getting quotas for user 8ad8834232064fa7bb2164d542d29e32 and project b2bbec12160842eab535494da3e993aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:10:20.065074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9b0d75f9-09b5-4f3d-989b-fe5fa9ed2902 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:20.086902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9b0d75f9-09b5-4f3d-989b-fe5fa9ed2902 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:20.092521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9b0d75f9-09b5-4f3d-989b-fe5fa9ed2902 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:20.094976 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9b0d75f9-09b5-4f3d-989b-fe5fa9ed2902 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.332223 Jul 26 14:10:20.106153 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 771/1439] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:18 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:20.119688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7abacc54-0667-4ad2-96af-ff35d0dc4447 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:20.122098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7abacc54-0667-4ad2-96af-ff35d0dc4447 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:20.137867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:10:20.143476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='104b4a1a-973b-4b6c-aadb-d7d935095358',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fe8bf23b-c1f0-4dac-b740-e7920d0d1357',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b18c2ea3-7d50-42ca-b35d-305c1c9f908b',volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:10:20.150456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7abacc54-0667-4ad2-96af-ff35d0dc4447 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:20.151736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7abacc54-0667-4ad2-96af-ff35d0dc4447 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:20.159751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7abacc54-0667-4ad2-96af-ff35d0dc4447 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:20.160842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7abacc54-0667-4ad2-96af-ff35d0dc4447 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:20.503377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7abacc54-0667-4ad2-96af-ff35d0dc4447 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:20.532554 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7abacc54-0667-4ad2-96af-ff35d0dc4447 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1273 microversion: 2.1 time: 0.419919 Jul 26 14:10:20.535420 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 772/1440] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:20 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1273 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:20.557391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-536b7de0-9a17-4f4e-8d94-19b34e00f613 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:20.567753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-536b7de0-9a17-4f4e-8d94-19b34e00f613 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 54be76f6-dd14-406f-8f42-ed989a168646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:20.585560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-536b7de0-9a17-4f4e-8d94-19b34e00f613 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:20.586729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-536b7de0-9a17-4f4e-8d94-19b34e00f613 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:20.588776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-536b7de0-9a17-4f4e-8d94-19b34e00f613 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:20.589822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-536b7de0-9a17-4f4e-8d94-19b34e00f613 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:20.888680 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-58f7e8a7-31fa-4f21-8b7f-b4791c286b8f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.503659 Jul 26 14:10:20.890901 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 669/1441] 10.222.0.70 () {62 vars in 1189 bytes} [Tue Jul 26 14:10:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 7507 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:10:20.907719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ffcd92c6-dffa-4ab7-adb8-32d48141f7c7 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:20.913433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ffcd92c6-dffa-4ab7-adb8-32d48141f7c7 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:20.932519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ffcd92c6-dffa-4ab7-adb8-32d48141f7c7 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:20.933730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ffcd92c6-dffa-4ab7-adb8-32d48141f7c7 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:20.935442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ffcd92c6-dffa-4ab7-adb8-32d48141f7c7 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:20.936526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ffcd92c6-dffa-4ab7-adb8-32d48141f7c7 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:21.200253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-536b7de0-9a17-4f4e-8d94-19b34e00f613 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:21.215045 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-536b7de0-9a17-4f4e-8d94-19b34e00f613 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646" status: 200 len: 1512 microversion: 2.1 time: 0.674365 Jul 26 14:10:21.236510 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 773/1442] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:20 2022] GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646 => generated 1512 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:21.255528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-13141ee3-dacc-4180-a36f-5fce8ad3f5fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:21.257105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-13141ee3-dacc-4180-a36f-5fce8ad3f5fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:21.288167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13141ee3-dacc-4180-a36f-5fce8ad3f5fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:21.288873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13141ee3-dacc-4180-a36f-5fce8ad3f5fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:21.290353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13141ee3-dacc-4180-a36f-5fce8ad3f5fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:21.291276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13141ee3-dacc-4180-a36f-5fce8ad3f5fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:21.726700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ffcd92c6-dffa-4ab7-adb8-32d48141f7c7 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:21.757901 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ffcd92c6-dffa-4ab7-adb8-32d48141f7c7 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1467 microversion: 2.1 time: 0.861067 Jul 26 14:10:21.760332 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 670/1443] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:20 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1467 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:21.782769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e050a933-715d-46dd-9e23-40aa4f64ba19 req-b48aa853-1082-4582-817d-79a2332dda6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cbff42-6659-4317-bf61-7f5f2aaaa942", "name": "network-vif-unplugged", "status": "completed", "tag": "a17e340d-a5eb-45cb-9fb6-171e51e54f5b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:21.830157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e050a933-715d-46dd-9e23-40aa4f64ba19 req-b48aa853-1082-4582-817d-79a2332dda6c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:21.831136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e050a933-715d-46dd-9e23-40aa4f64ba19 req-b48aa853-1082-4582-817d-79a2332dda6c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:21.863395 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e050a933-715d-46dd-9e23-40aa4f64ba19 req-b48aa853-1082-4582-817d-79a2332dda6c service nova] Creating event network-vif-unplugged:a17e340d-a5eb-45cb-9fb6-171e51e54f5b for instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 on n-h1-833090-9 Jul 26 14:10:21.886699 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e050a933-715d-46dd-9e23-40aa4f64ba19 req-b48aa853-1082-4582-817d-79a2332dda6c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112281 Jul 26 14:10:21.887690 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 671/1444] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:21.898400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-87d15bdd-3bb9-4f2d-8747-4bbb35f2b578 req-3b36a32b-b043-4baa-9b77-464fe0dc3819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e080b-51bc-48e9-9b38-a4c49734b15d", "name": "network-vif-unplugged", "status": "completed", "tag": "54d86a16-b218-474f-8fa1-ab8322e59564"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:21.926739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-87d15bdd-3bb9-4f2d-8747-4bbb35f2b578 req-3b36a32b-b043-4baa-9b77-464fe0dc3819 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:21.927826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-87d15bdd-3bb9-4f2d-8747-4bbb35f2b578 req-3b36a32b-b043-4baa-9b77-464fe0dc3819 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:21.955798 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-87d15bdd-3bb9-4f2d-8747-4bbb35f2b578 req-3b36a32b-b043-4baa-9b77-464fe0dc3819 service nova] Creating event network-vif-unplugged:54d86a16-b218-474f-8fa1-ab8322e59564 for instance 807e080b-51bc-48e9-9b38-a4c49734b15d on n-h2-833090-9 Jul 26 14:10:21.965920 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-87d15bdd-3bb9-4f2d-8747-4bbb35f2b578 req-3b36a32b-b043-4baa-9b77-464fe0dc3819 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075339 Jul 26 14:10:21.967249 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 672/1445] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:21.997954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87b12cfe-9a91-4958-be54-07e8f043f433 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:21.999522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-87b12cfe-9a91-4958-be54-07e8f043f433 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:22.203526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-87b12cfe-9a91-4958-be54-07e8f043f433 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:22.235123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-13141ee3-dacc-4180-a36f-5fce8ad3f5fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:22.242369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-87b12cfe-9a91-4958-be54-07e8f043f433 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:22.248573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-87b12cfe-9a91-4958-be54-07e8f043f433 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:22.252537 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-87b12cfe-9a91-4958-be54-07e8f043f433 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1284 microversion: 2.42 time: 0.270387 Jul 26 14:10:22.280077 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-13141ee3-dacc-4180-a36f-5fce8ad3f5fc tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1316 microversion: 2.1 time: 1.030771 Jul 26 14:10:22.280077 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 774/1446] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:21 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1316 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:22.280768 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 673/1447] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:21 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:22.295100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-25f8c8fb-e0f5-4ed5-a084-446f99151fab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:22.305982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-25f8c8fb-e0f5-4ed5-a084-446f99151fab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:22.306414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:22.318983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25f8c8fb-e0f5-4ed5-a084-446f99151fab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:22.320256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25f8c8fb-e0f5-4ed5-a084-446f99151fab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:22.320584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:22.322013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:22.322922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25f8c8fb-e0f5-4ed5-a084-446f99151fab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:22.324349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25f8c8fb-e0f5-4ed5-a084-446f99151fab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:22.361412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:22.362108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:22.363369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:22.364110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:22.690143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:10:22.928119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:22.949838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:22.950642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:23.171288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25f8c8fb-e0f5-4ed5-a084-446f99151fab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:23.208092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25f8c8fb-e0f5-4ed5-a084-446f99151fab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:23.220639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25f8c8fb-e0f5-4ed5-a084-446f99151fab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:23.224078 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-25f8c8fb-e0f5-4ed5-a084-446f99151fab tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 0.945229 Jul 26 14:10:23.226162 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 775/1448] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:22 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:23.235053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4715dd01-9870-4799-a46a-6af89b416ae5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:23.236132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4715dd01-9870-4799-a46a-6af89b416ae5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:23.253432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4715dd01-9870-4799-a46a-6af89b416ae5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:23.254536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4715dd01-9870-4799-a46a-6af89b416ae5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:23.256365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4715dd01-9870-4799-a46a-6af89b416ae5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:23.257919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4715dd01-9870-4799-a46a-6af89b416ae5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:23.307887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:23.515873 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-17e4c0c9-e358-4e9a-8642-8826b05822bd tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.228374 Jul 26 14:10:23.519065 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 674/1449] 10.222.0.70 () {58 vars in 1167 bytes} [Tue Jul 26 14:10:22 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:23.530665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-06bf7300-c39a-4338-a6c0-ca511e9acb90 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-938848778"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:23.558937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-06bf7300-c39a-4338-a6c0-ca511e9acb90 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:23.603018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06bf7300-c39a-4338-a6c0-ca511e9acb90 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:23.612249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06bf7300-c39a-4338-a6c0-ca511e9acb90 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:23.615445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06bf7300-c39a-4338-a6c0-ca511e9acb90 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:23.628315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06bf7300-c39a-4338-a6c0-ca511e9acb90 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:24.067217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4715dd01-9870-4799-a46a-6af89b416ae5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:24.085101 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4715dd01-9870-4799-a46a-6af89b416ae5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1315 microversion: 2.1 time: 0.856563 Jul 26 14:10:24.102048 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 776/1450] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:23 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1315 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:24.123214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7e318442-5c51-4b24-b42a-4fc712e11768 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:24.124736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e318442-5c51-4b24-b42a-4fc712e11768 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:24.137470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e318442-5c51-4b24-b42a-4fc712e11768 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:24.138555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e318442-5c51-4b24-b42a-4fc712e11768 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:24.140457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e318442-5c51-4b24-b42a-4fc712e11768 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:24.142897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e318442-5c51-4b24-b42a-4fc712e11768 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:24.354332 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-06bf7300-c39a-4338-a6c0-ca511e9acb90 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "POST /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2/action" status: 202 len: 0 microversion: 2.1 time: 0.832242 Jul 26 14:10:24.355319 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 675/1451] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:10:23 2022] POST /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2/action => generated 0 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 14:10:24.397526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f2c31e1d-7fb8-44e1-b817-dac08efeef5a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:24.400484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f2c31e1d-7fb8-44e1-b817-dac08efeef5a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:24.420827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2c31e1d-7fb8-44e1-b817-dac08efeef5a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:24.421575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2c31e1d-7fb8-44e1-b817-dac08efeef5a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:24.423190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2c31e1d-7fb8-44e1-b817-dac08efeef5a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:24.424741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2c31e1d-7fb8-44e1-b817-dac08efeef5a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:24.974923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7e318442-5c51-4b24-b42a-4fc712e11768 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:25.012786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7e318442-5c51-4b24-b42a-4fc712e11768 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:25.021685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7e318442-5c51-4b24-b42a-4fc712e11768 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:25.026982 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7e318442-5c51-4b24-b42a-4fc712e11768 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1592 microversion: 2.42 time: 0.912619 Jul 26 14:10:25.030373 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 777/1452] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:24 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1592 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:25.044100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:25.059185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:25.062027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1069138422', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:25.075037 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:25.076961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:25.082157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:25.083420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:25.279627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:10:25.448813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f2c31e1d-7fb8-44e1-b817-dac08efeef5a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:25.461298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:25.477700 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f2c31e1d-7fb8-44e1-b817-dac08efeef5a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1506 microversion: 2.1 time: 1.101545 Jul 26 14:10:25.486543 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 676/1453] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:24 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1506 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:25.487806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:25.489114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:25.503163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-9acb2202-8691-410a-a6b8-c630376db3bb req-c454eb47-f810-41ad-86e8-6a5e177f62f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cbff42-6659-4317-bf61-7f5f2aaaa942", "tag": "a17e340d-a5eb-45cb-9fb6-171e51e54f5b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:25.538661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9acb2202-8691-410a-a6b8-c630376db3bb req-c454eb47-f810-41ad-86e8-6a5e177f62f6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:25.539670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9acb2202-8691-410a-a6b8-c630376db3bb req-c454eb47-f810-41ad-86e8-6a5e177f62f6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:25.560683 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-9acb2202-8691-410a-a6b8-c630376db3bb req-c454eb47-f810-41ad-86e8-6a5e177f62f6 service nova] Creating event network-changed:a17e340d-a5eb-45cb-9fb6-171e51e54f5b for instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 on n-h1-833090-9 Jul 26 14:10:25.570753 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-9acb2202-8691-410a-a6b8-c630376db3bb req-c454eb47-f810-41ad-86e8-6a5e177f62f6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081685 Jul 26 14:10:25.572327 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 677/1454] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:25.582493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9ba745fe-b9c4-4cbb-ba74-ce38aa27f077 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:25.583782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9ba745fe-b9c4-4cbb-ba74-ce38aa27f077 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:25.596255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ba745fe-b9c4-4cbb-ba74-ce38aa27f077 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:25.597465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ba745fe-b9c4-4cbb-ba74-ce38aa27f077 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:25.599233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ba745fe-b9c4-4cbb-ba74-ce38aa27f077 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:25.600357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ba745fe-b9c4-4cbb-ba74-ce38aa27f077 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:26.210580 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e27af2ee-e241-435b-8ac3-78db946c6485 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1069138422" status: 200 len: 1514 microversion: 2.1 time: 1.175894 Jul 26 14:10:26.212877 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 778/1455] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:10:25 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1069138422 => generated 1514 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:26.223076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7fedd9e8-c86b-4760-a6e4-1ba7de764b29 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787f76040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:26.358537 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7fedd9e8-c86b-4760-a6e4-1ba7de764b29 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.143582 Jul 26 14:10:26.377423 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 779/1456] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:26 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:26.493413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ba745fe-b9c4-4cbb-ba74-ce38aa27f077 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:26.523436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ba745fe-b9c4-4cbb-ba74-ce38aa27f077 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:26.529705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ba745fe-b9c4-4cbb-ba74-ce38aa27f077 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:26.533312 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9ba745fe-b9c4-4cbb-ba74-ce38aa27f077 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 0.958765 Jul 26 14:10:26.538678 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 678/1457] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:25 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:26.559511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9ed11657-0362-4931-b7f1-b47e98c19cf5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:26.568592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9ed11657-0362-4931-b7f1-b47e98c19cf5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:26.592588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ed11657-0362-4931-b7f1-b47e98c19cf5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:26.593507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ed11657-0362-4931-b7f1-b47e98c19cf5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:26.596049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ed11657-0362-4931-b7f1-b47e98c19cf5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:26.599291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ed11657-0362-4931-b7f1-b47e98c19cf5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:26.653394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ec3d143d-ca7d-488f-8157-66411b39559e tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Action: 'update', calling method: .version_select at 0x7f8787bcc9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:26.796367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec3d143d-ca7d-488f-8157-66411b39559e tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:26.797240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec3d143d-ca7d-488f-8157-66411b39559e tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:26.798913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec3d143d-ca7d-488f-8157-66411b39559e tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:26.800341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec3d143d-ca7d-488f-8157-66411b39559e tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:26.939494 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ec3d143d-ca7d-488f-8157-66411b39559e tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/8d19799c25b34f6da58be820de0c1b8b" status: 200 len: 240 microversion: 2.36 time: 0.558731 Jul 26 14:10:26.941952 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 780/1458] 10.222.0.70 () {62 vars in 1303 bytes} [Tue Jul 26 14:10:26 2022] PUT /compute/v2.1/os-quota-sets/8d19799c25b34f6da58be820de0c1b8b => generated 240 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:10:26.953334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f293b653-bf43-4ac2-b9c8-cbb85b359b0c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:26.955072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f293b653-bf43-4ac2-b9c8-cbb85b359b0c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:26.969429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f293b653-bf43-4ac2-b9c8-cbb85b359b0c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:26.970515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f293b653-bf43-4ac2-b9c8-cbb85b359b0c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:26.975844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f293b653-bf43-4ac2-b9c8-cbb85b359b0c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:26.976891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f293b653-bf43-4ac2-b9c8-cbb85b359b0c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:27.046686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f293b653-bf43-4ac2-b9c8-cbb85b359b0c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:10:27.258882 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f293b653-bf43-4ac2-b9c8-cbb85b359b0c tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "DELETE /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 204 len: 0 microversion: 2.1 time: 0.314383 Jul 26 14:10:27.260244 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 781/1459] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:10:26 2022] DELETE /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:10:27.267096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5c68457-6f40-47e1-a1ec-7c6fa7eda986 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:27.269033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a5c68457-6f40-47e1-a1ec-7c6fa7eda986 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:27.290910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5c68457-6f40-47e1-a1ec-7c6fa7eda986 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:27.291354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5c68457-6f40-47e1-a1ec-7c6fa7eda986 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:27.293667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5c68457-6f40-47e1-a1ec-7c6fa7eda986 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:27.294677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5c68457-6f40-47e1-a1ec-7c6fa7eda986 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:27.988569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ed11657-0362-4931-b7f1-b47e98c19cf5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:28.004029 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9ed11657-0362-4931-b7f1-b47e98c19cf5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1315 microversion: 2.1 time: 1.461769 Jul 26 14:10:28.006206 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 679/1460] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:26 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1315 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:28.026633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a5c68457-6f40-47e1-a1ec-7c6fa7eda986 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:28.035900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6ce2a626-71cb-444f-a27c-54fc0aae54c1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:28.038333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6ce2a626-71cb-444f-a27c-54fc0aae54c1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:28.052184 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a5c68457-6f40-47e1-a1ec-7c6fa7eda986 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1506 microversion: 2.1 time: 0.789950 Jul 26 14:10:28.053942 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 782/1461] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:27 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1506 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:28.057395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ce2a626-71cb-444f-a27c-54fc0aae54c1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:28.058053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ce2a626-71cb-444f-a27c-54fc0aae54c1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:28.059490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ce2a626-71cb-444f-a27c-54fc0aae54c1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:28.060122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ce2a626-71cb-444f-a27c-54fc0aae54c1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:28.089914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:28.103346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:28.105489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:28.118537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:28.119395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:28.124142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:28.128422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:28.481657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:10:28.548109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6ce2a626-71cb-444f-a27c-54fc0aae54c1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:28.568374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6ce2a626-71cb-444f-a27c-54fc0aae54c1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:28.571736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6ce2a626-71cb-444f-a27c-54fc0aae54c1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:28.574245 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6ce2a626-71cb-444f-a27c-54fc0aae54c1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1592 microversion: 2.42 time: 0.560584 Jul 26 14:10:28.577103 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 680/1462] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:28 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1592 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:28.587911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-09f7a329-1412-46eb-8a2f-43dfe5e836f1 tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Calling method '.version_select at 0x7f8787e8fe50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:28.671730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:28.691496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:28.700620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:28.763398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09f7a329-1412-46eb-8a2f-43dfe5e836f1 tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:28.766188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09f7a329-1412-46eb-8a2f-43dfe5e836f1 tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:28.768638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09f7a329-1412-46eb-8a2f-43dfe5e836f1 tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:28.769899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09f7a329-1412-46eb-8a2f-43dfe5e836f1 tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:28.826086 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-09f7a329-1412-46eb-8a2f-43dfe5e836f1 tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/8d19799c25b34f6da58be820de0c1b8b/detail" status: 200 len: 672 microversion: 2.36 time: 0.241044 Jul 26 14:10:28.826086 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 681/1463] 10.222.0.70 () {60 vars in 1304 bytes} [Tue Jul 26 14:10:28 2022] GET /compute/v2.1/os-quota-sets/8d19799c25b34f6da58be820de0c1b8b/detail => generated 672 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:10:28.832240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-575e82ad-46e9-4a60-9f3b-06da97c8a6a6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:28.834218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-575e82ad-46e9-4a60-9f3b-06da97c8a6a6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:28.855876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-575e82ad-46e9-4a60-9f3b-06da97c8a6a6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:28.856967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-575e82ad-46e9-4a60-9f3b-06da97c8a6a6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:28.863306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-575e82ad-46e9-4a60-9f3b-06da97c8a6a6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:28.863306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-575e82ad-46e9-4a60-9f3b-06da97c8a6a6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:29.725227 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56d26646-2169-44fc-b607-e0bc7eecf531 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 1.649136 Jul 26 14:10:29.740783 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 783/1464] 10.222.0.70 () {58 vars in 1173 bytes} [Tue Jul 26 14:10:28 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:29.757201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6a070b5c-99b6-4667-a68e-c8ed2953020e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787bcc160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:29.857634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6a070b5c-99b6-4667-a68e-c8ed2953020e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.114208 Jul 26 14:10:29.859059 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 784/1465] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:29 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:29.953971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-575e82ad-46e9-4a60-9f3b-06da97c8a6a6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e385295d84f494986de9861dbc068da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81bcf05a19b54acbb86a46e6d8e8962e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:29.970948 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-575e82ad-46e9-4a60-9f3b-06da97c8a6a6 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 200 len: 1665 microversion: 2.1 time: 1.147054 Jul 26 14:10:29.972859 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 682/1466] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:28 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 1665 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:29.981445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6bb7a2ca-53f0-4f39-976d-4399ca998698 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:29.986279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6bb7a2ca-53f0-4f39-976d-4399ca998698 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:29.997984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6bb7a2ca-53f0-4f39-976d-4399ca998698 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:29.999103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6bb7a2ca-53f0-4f39-976d-4399ca998698 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:30.002445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6bb7a2ca-53f0-4f39-976d-4399ca998698 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:30.003611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6bb7a2ca-53f0-4f39-976d-4399ca998698 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:30.128348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:30.140764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d1cc4e8-138e-49e1-809e-c49d28a70884 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:30.145802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0d1cc4e8-138e-49e1-809e-c49d28a70884 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:30.159933 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6bb7a2ca-53f0-4f39-976d-4399ca998698 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "PUT /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1078 microversion: 2.1 time: 0.185041 Jul 26 14:10:30.176038 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 683/1467] 10.222.0.70 () {60 vars in 1256 bytes} [Tue Jul 26 14:10:29 2022] PUT /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1078 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:30.176392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d1cc4e8-138e-49e1-809e-c49d28a70884 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:30.176392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d1cc4e8-138e-49e1-809e-c49d28a70884 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:30.176392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d1cc4e8-138e-49e1-809e-c49d28a70884 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:30.176867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c698de07-b671-4516-8d6e-389566717fe6 req-93bd853f-b7b7-4acc-94e5-650d46462cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb3e73a-a58f-462d-8da3-f196fc8a17d9", "tag": "266572ab-e529-4406-b7d4-2e1229ce826e"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:30.181933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d1cc4e8-138e-49e1-809e-c49d28a70884 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:30.210916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c698de07-b671-4516-8d6e-389566717fe6 req-93bd853f-b7b7-4acc-94e5-650d46462cc8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:30.211757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c698de07-b671-4516-8d6e-389566717fe6 req-93bd853f-b7b7-4acc-94e5-650d46462cc8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:30.256741 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c698de07-b671-4516-8d6e-389566717fe6 req-93bd853f-b7b7-4acc-94e5-650d46462cc8 service nova] Creating event network-changed:266572ab-e529-4406-b7d4-2e1229ce826e for instance 3eb3e73a-a58f-462d-8da3-f196fc8a17d9 on n-h1-833090-9 Jul 26 14:10:30.279357 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c698de07-b671-4516-8d6e-389566717fe6 req-93bd853f-b7b7-4acc-94e5-650d46462cc8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115506 Jul 26 14:10:30.282123 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 684/1468] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:30.303936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1768b8d8-d253-4fa3-9e12-b378740d4add tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:30.306884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1768b8d8-d253-4fa3-9e12-b378740d4add tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:30.325493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1768b8d8-d253-4fa3-9e12-b378740d4add tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:30.326215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1768b8d8-d253-4fa3-9e12-b378740d4add tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:30.331250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1768b8d8-d253-4fa3-9e12-b378740d4add tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:30.334096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1768b8d8-d253-4fa3-9e12-b378740d4add tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:31.330432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0d1cc4e8-138e-49e1-809e-c49d28a70884 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:31.363256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0d1cc4e8-138e-49e1-809e-c49d28a70884 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:31.393545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0d1cc4e8-138e-49e1-809e-c49d28a70884 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:31.412943 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0d1cc4e8-138e-49e1-809e-c49d28a70884 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.550846 Jul 26 14:10:31.413325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1768b8d8-d253-4fa3-9e12-b378740d4add tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:31.422637 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 785/1469] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:29 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:31.450180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e21e850d-e289-464a-bd7d-dc307562913d tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Action: 'update', calling method: .version_select at 0x7f8787bcc430>, body: {"quota_set": {"ram": "2048"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:31.463366 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1768b8d8-d253-4fa3-9e12-b378740d4add tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1315 microversion: 2.1 time: 1.179126 Jul 26 14:10:31.468172 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 685/1470] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:30 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1315 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:31.497259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-650a7057-d508-4e48-a07f-f4dec8c644a9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:31.498229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-650a7057-d508-4e48-a07f-f4dec8c644a9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:31.524750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-650a7057-d508-4e48-a07f-f4dec8c644a9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:31.525994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-650a7057-d508-4e48-a07f-f4dec8c644a9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:31.527754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-650a7057-d508-4e48-a07f-f4dec8c644a9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:31.528698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-650a7057-d508-4e48-a07f-f4dec8c644a9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:31.702171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e21e850d-e289-464a-bd7d-dc307562913d tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:31.703145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e21e850d-e289-464a-bd7d-dc307562913d tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:31.705194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e21e850d-e289-464a-bd7d-dc307562913d tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:31.706352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e21e850d-e289-464a-bd7d-dc307562913d tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:31.847861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e21e850d-e289-464a-bd7d-dc307562913d tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:31.852849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e21e850d-e289-464a-bd7d-dc307562913d tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:31.869703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e21e850d-e289-464a-bd7d-dc307562913d tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:31.872222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e21e850d-e289-464a-bd7d-dc307562913d tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:32.132621 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e21e850d-e289-464a-bd7d-dc307562913d tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/8d19799c25b34f6da58be820de0c1b8b?user_id=69ccc80e51c645af876e2ce3cc47539a" status: 200 len: 240 microversion: 2.36 time: 0.708568 Jul 26 14:10:32.137141 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 786/1471] 10.222.0.70 () {62 vars in 1384 bytes} [Tue Jul 26 14:10:31 2022] PUT /compute/v2.1/os-quota-sets/8d19799c25b34f6da58be820de0c1b8b?user_id=69ccc80e51c645af876e2ce3cc47539a => generated 240 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:10:32.145394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:32.159031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:32.160757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.servers [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Removing options 'limit' from query {{(pid=119479) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 14:10:32.163049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:32.176458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:32.176458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:32.181789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:32.185231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:32.295579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:32.327742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:32.328606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:32.549553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-650a7057-d508-4e48-a07f-f4dec8c644a9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:32.576832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-650a7057-d508-4e48-a07f-f4dec8c644a9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:32.579805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-650a7057-d508-4e48-a07f-f4dec8c644a9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:32.585100 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-650a7057-d508-4e48-a07f-f4dec8c644a9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1660 microversion: 2.42 time: 1.109813 Jul 26 14:10:32.586086 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 686/1472] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:31 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1660 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:32.614621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-155136b0-4292-4aa2-83c5-4a5a31e631ac tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:32.617310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-155136b0-4292-4aa2-83c5-4a5a31e631ac tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:32.637202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-155136b0-4292-4aa2-83c5-4a5a31e631ac tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:32.643846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-155136b0-4292-4aa2-83c5-4a5a31e631ac tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:32.645576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-155136b0-4292-4aa2-83c5-4a5a31e631ac tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:32.646533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-155136b0-4292-4aa2-83c5-4a5a31e631ac tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:33.492735 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d057f932-7121-42f9-a765-ae7076493c31 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 1.356325 Jul 26 14:10:33.493686 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 787/1473] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 14:10:32 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:33.525136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b377fb1b-88d0-402a-9d5a-58357cb257ff tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787fe2dc0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:33.645931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-155136b0-4292-4aa2-83c5-4a5a31e631ac tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:33.682750 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-155136b0-4292-4aa2-83c5-4a5a31e631ac tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1504 microversion: 2.1 time: 1.092975 Jul 26 14:10:33.698809 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b377fb1b-88d0-402a-9d5a-58357cb257ff tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.196267 Jul 26 14:10:33.699736 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 788/1474] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:33 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:33.712047 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 687/1475] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:32 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1504 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:33.738145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0cdd5c31-d802-4f41-9f57-289cfb29c8f1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:33.739149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0cdd5c31-d802-4f41-9f57-289cfb29c8f1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] [instance: 15a4f989-1f14-4e89-a1cc-b8fa616342f0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:33.741029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-6dec0f69-3440-4f38-9dfc-cd6741ae627e req-88baf100-00b9-439c-b267-5354898fbc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a4f989-1f14-4e89-a1cc-b8fa616342f0", "name": "network-vif-deleted", "tag": "3ad3111b-d40f-408c-9aa3-7d8b42f8319d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:33.776220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cdd5c31-d802-4f41-9f57-289cfb29c8f1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:33.778081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6dec0f69-3440-4f38-9dfc-cd6741ae627e req-88baf100-00b9-439c-b267-5354898fbc75 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:33.778307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cdd5c31-d802-4f41-9f57-289cfb29c8f1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:33.781860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cdd5c31-d802-4f41-9f57-289cfb29c8f1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:33.782743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6dec0f69-3440-4f38-9dfc-cd6741ae627e req-88baf100-00b9-439c-b267-5354898fbc75 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:33.784434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cdd5c31-d802-4f41-9f57-289cfb29c8f1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:33.815346 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-6dec0f69-3440-4f38-9dfc-cd6741ae627e req-88baf100-00b9-439c-b267-5354898fbc75 service nova] Creating event network-vif-deleted:3ad3111b-d40f-408c-9aa3-7d8b42f8319d for instance 15a4f989-1f14-4e89-a1cc-b8fa616342f0 on n-h1-833090-9 Jul 26 14:10:33.846383 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-6dec0f69-3440-4f38-9dfc-cd6741ae627e req-88baf100-00b9-439c-b267-5354898fbc75 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132046 Jul 26 14:10:33.847596 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 688/1476] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:33.855984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-78591e94-147d-431e-8d14-ca41e2a4c2b5 tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] Calling method '.version_select at 0x7f8787d79550>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:33.860349 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-0cdd5c31-d802-4f41-9f57-289cfb29c8f1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] HTTP exception thrown: Instance 15a4f989-1f14-4e89-a1cc-b8fa616342f0 could not be found. Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0cdd5c31-d802-4f41-9f57-289cfb29c8f1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Request method failure captured: Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 HTTP/1.1 Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_V1Qs1hzOeKAMHijUY0mR0L_kK3DdTwBDuTLDitUPGsVK8C2tlZzNz9LinMuMD91NqiNzOjYFfuPMh3fg5kkcNrFiw2-l6dP302RR6pEH2FpiqrlrDlgCEzuvM8zZvhnAVWOFu3pY7D8emOMSc1Unht8TMrRAKg4BTCvhPKZAgYKlo Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 81bcf05a19b54acbb86a46e6d8e8962e Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestFqdnHostnames-1802581235 Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81bcf05a19b54acbb86a46e6d8e8962e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81bcf05a19b54acbb86a46e6d8e8962e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81bcf05a19b54acbb86a46e6d8e8962e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81bcf05a19b54acbb86a46e6d8e8962e"}]}] Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestFqdnHostnames-1802581235 Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 81bcf05a19b54acbb86a46e6d8e8962e Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1802581235 Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestFqdnHostnames-1802581235-project Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 4e385295d84f494986de9861dbc068da Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestFqdnHostnames-1802581235-project Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 15a4f989-1f14-4e89-a1cc-b8fa616342f0 could not be found. Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '15a4f989-1f14-4e89-a1cc-b8fa616342f0'} Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a4f989-1f14-4e89-a1cc-b8fa616342f0 could not be found. Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a4f989-1f14-4e89-a1cc-b8fa616342f0 could not be found. Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:10:33.871559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:33.883534 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:33.883534 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:10:33.883534 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:10:33.883534 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:10:33.883534 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:10:33.883534 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a4f989-1f14-4e89-a1cc-b8fa616342f0 could not be found. Jul 26 14:10:33.883534 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:33.884930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0cdd5c31-d802-4f41-9f57-289cfb29c8f1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Returning 404 to user: Instance 15a4f989-1f14-4e89-a1cc-b8fa616342f0 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:10:33.886922 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0cdd5c31-d802-4f41-9f57-289cfb29c8f1 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0" status: 404 len: 111 microversion: 2.1 time: 0.163050 Jul 26 14:10:33.888262 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 789/1477] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:33 2022] GET /compute/v2.1/servers/15a4f989-1f14-4e89-a1cc-b8fa616342f0 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:10:33.906983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-54b4e5da-c8fb-4532-b614-9101f797d887 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:33.908555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-54b4e5da-c8fb-4532-b614-9101f797d887 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:33.921219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54b4e5da-c8fb-4532-b614-9101f797d887 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:33.922498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54b4e5da-c8fb-4532-b614-9101f797d887 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:33.924227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54b4e5da-c8fb-4532-b614-9101f797d887 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:33.925206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54b4e5da-c8fb-4532-b614-9101f797d887 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:34.126862 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-78591e94-147d-431e-8d14-ca41e2a4c2b5 tempest-QuotasAdminTestV236-434745948 tempest-QuotasAdminTestV236-434745948-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/8d19799c25b34f6da58be820de0c1b8b?user_id=69ccc80e51c645af876e2ce3cc47539a" status: 200 len: 282 microversion: 2.36 time: 0.277119 Jul 26 14:10:34.137129 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 689/1478] 10.222.0.70 () {60 vars in 1364 bytes} [Tue Jul 26 14:10:33 2022] GET /compute/v2.1/os-quota-sets/8d19799c25b34f6da58be820de0c1b8b?user_id=69ccc80e51c645af876e2ce3cc47539a => generated 282 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:10:34.153177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4e9b72ba-6fad-4430-9b2f-4149a4033157 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:34.154509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4e9b72ba-6fad-4430-9b2f-4149a4033157 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:34.179154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e9b72ba-6fad-4430-9b2f-4149a4033157 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:34.179972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e9b72ba-6fad-4430-9b2f-4149a4033157 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:34.181397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e9b72ba-6fad-4430-9b2f-4149a4033157 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:34.182148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e9b72ba-6fad-4430-9b2f-4149a4033157 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:35.060968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-54b4e5da-c8fb-4532-b614-9101f797d887 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:35.093468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-54b4e5da-c8fb-4532-b614-9101f797d887 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:35.103107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-54b4e5da-c8fb-4532-b614-9101f797d887 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:35.105179 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-54b4e5da-c8fb-4532-b614-9101f797d887 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.207714 Jul 26 14:10:35.147423 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 790/1479] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:33 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:35.176465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dad7f67a-7c48-4776-ba4d-0c400c4cb1e5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:35.197482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dad7f67a-7c48-4776-ba4d-0c400c4cb1e5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:35.213904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dad7f67a-7c48-4776-ba4d-0c400c4cb1e5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:35.252393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dad7f67a-7c48-4776-ba4d-0c400c4cb1e5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:35.253172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dad7f67a-7c48-4776-ba4d-0c400c4cb1e5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:35.264093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dad7f67a-7c48-4776-ba4d-0c400c4cb1e5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:35.274847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dad7f67a-7c48-4776-ba4d-0c400c4cb1e5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:35.413152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-dad7f67a-7c48-4776-ba4d-0c400c4cb1e5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:10:35.583309 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dad7f67a-7c48-4776-ba4d-0c400c4cb1e5 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.434049 Jul 26 14:10:35.584074 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 791/1480] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:10:35 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:35.614954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-344c744b-fde1-42fc-a778-2a32e7fe74d5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:35.623015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-344c744b-fde1-42fc-a778-2a32e7fe74d5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:35.651675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-344c744b-fde1-42fc-a778-2a32e7fe74d5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:35.652440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-344c744b-fde1-42fc-a778-2a32e7fe74d5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:35.664823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-344c744b-fde1-42fc-a778-2a32e7fe74d5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:35.668387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-344c744b-fde1-42fc-a778-2a32e7fe74d5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:35.743437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4e9b72ba-6fad-4430-9b2f-4149a4033157 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:35.781057 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4e9b72ba-6fad-4430-9b2f-4149a4033157 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1315 microversion: 2.1 time: 1.650506 Jul 26 14:10:35.795788 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 690/1481] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:34 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1315 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:35.838153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c3e9007e-0f85-46a0-afa4-093ee0615cfd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:35.853749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c3e9007e-0f85-46a0-afa4-093ee0615cfd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:35.895185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3e9007e-0f85-46a0-afa4-093ee0615cfd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:35.895654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3e9007e-0f85-46a0-afa4-093ee0615cfd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:35.896509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3e9007e-0f85-46a0-afa4-093ee0615cfd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:35.902020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3e9007e-0f85-46a0-afa4-093ee0615cfd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:36.883218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-344c744b-fde1-42fc-a778-2a32e7fe74d5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:36.899601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-344c744b-fde1-42fc-a778-2a32e7fe74d5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:36.915561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-344c744b-fde1-42fc-a778-2a32e7fe74d5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:36.917193 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-344c744b-fde1-42fc-a778-2a32e7fe74d5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1707 microversion: 2.42 time: 1.323679 Jul 26 14:10:36.917943 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 792/1482] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:35 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1707 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:36.923643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-575474e2-adea-49cf-8c6c-d6f30bfd687d req-bf5c2780-7ce1-4d46-ab10-3b4151991aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d38f13-5f5e-4574-b415-d21bb454b9d2", "name": "network-vif-plugged", "status": "completed", "tag": "133fb10c-c93f-49e6-9134-3165e0e34866"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:36.950195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-575474e2-adea-49cf-8c6c-d6f30bfd687d req-bf5c2780-7ce1-4d46-ab10-3b4151991aef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:36.954982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c3e9007e-0f85-46a0-afa4-093ee0615cfd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:36.970144 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c3e9007e-0f85-46a0-afa4-093ee0615cfd tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1504 microversion: 2.1 time: 1.172657 Jul 26 14:10:36.971308 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 691/1483] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:35 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1504 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:36.976241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-575474e2-adea-49cf-8c6c-d6f30bfd687d req-bf5c2780-7ce1-4d46-ab10-3b4151991aef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:37.004210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a68e9162-7dc4-4c98-9b24-002628749d48 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] Calling method '.version_select at 0x7f8787bed3a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:37.051046 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-575474e2-adea-49cf-8c6c-d6f30bfd687d req-bf5c2780-7ce1-4d46-ab10-3b4151991aef service nova] Creating event network-vif-plugged:133fb10c-c93f-49e6-9134-3165e0e34866 for instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 on n-h2-833090-9 Jul 26 14:10:37.071898 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-575474e2-adea-49cf-8c6c-d6f30bfd687d req-bf5c2780-7ce1-4d46-ab10-3b4151991aef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151908 Jul 26 14:10:37.081661 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 793/1484] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:37.110758 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a68e9162-7dc4-4c98-9b24-002628749d48 tempest-ServersTestFqdnHostnames-1802581235 tempest-ServersTestFqdnHostnames-1802581235-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202666309" status: 202 len: 0 microversion: 2.1 time: 0.136172 Jul 26 14:10:37.114598 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 692/1485] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Jul 26 14:10:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202666309 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:10:37.118195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6812fe66-ec46-4303-a5c9-8778de6497a3 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787fcb430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:37.135014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e7d0905f-a5ea-4ff6-84b3-1651e51cd63f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:37.169119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e7d0905f-a5ea-4ff6-84b3-1651e51cd63f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:37.170415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.compute.servers [None req-e7d0905f-a5ea-4ff6-84b3-1651e51cd63f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Removing options 'limit' from query {{(pid=119478) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 14:10:37.173158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e7d0905f-a5ea-4ff6-84b3-1651e51cd63f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:37.198261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:37.225749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7d0905f-a5ea-4ff6-84b3-1651e51cd63f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:37.229354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7d0905f-a5ea-4ff6-84b3-1651e51cd63f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:37.233502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7d0905f-a5ea-4ff6-84b3-1651e51cd63f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:37.235289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7d0905f-a5ea-4ff6-84b3-1651e51cd63f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:37.254679 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6812fe66-ec46-4303-a5c9-8778de6497a3 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.167583 Jul 26 14:10:37.272365 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 794/1486] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:37 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:37.296266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8239e2f6-c08a-40a8-a51f-bd4f007ce87d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:37.298889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8239e2f6-c08a-40a8-a51f-bd4f007ce87d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:37.310050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:37.342114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8239e2f6-c08a-40a8-a51f-bd4f007ce87d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:37.346432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8239e2f6-c08a-40a8-a51f-bd4f007ce87d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:37.349548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8239e2f6-c08a-40a8-a51f-bd4f007ce87d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:37.356720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8239e2f6-c08a-40a8-a51f-bd4f007ce87d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:37.388658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-e7d0905f-a5ea-4ff6-84b3-1651e51cd63f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:10:37.537660 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e7d0905f-a5ea-4ff6-84b3-1651e51cd63f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.421069 Jul 26 14:10:37.549821 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 693/1487] 10.222.0.70 () {58 vars in 1150 bytes} [Tue Jul 26 14:10:37 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:37.562820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea0a587d-f5ed-4e89-a4fb-040ba32697c8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:37.566352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ea0a587d-f5ed-4e89-a4fb-040ba32697c8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:37.590316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea0a587d-f5ed-4e89-a4fb-040ba32697c8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:37.591148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea0a587d-f5ed-4e89-a4fb-040ba32697c8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:37.598064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea0a587d-f5ed-4e89-a4fb-040ba32697c8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:37.598824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea0a587d-f5ed-4e89-a4fb-040ba32697c8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:38.755372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ea0a587d-f5ed-4e89-a4fb-040ba32697c8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:38.789230 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ea0a587d-f5ed-4e89-a4fb-040ba32697c8 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1315 microversion: 2.1 time: 1.243814 Jul 26 14:10:38.804190 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 694/1488] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:37 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1315 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:38.806714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8239e2f6-c08a-40a8-a51f-bd4f007ce87d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:38.832626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a8e4f24-2663-434c-a75e-d78c97526683 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:38.845624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4a8e4f24-2663-434c-a75e-d78c97526683 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:38.867313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8239e2f6-c08a-40a8-a51f-bd4f007ce87d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:38.870909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8239e2f6-c08a-40a8-a51f-bd4f007ce87d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:38.873398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a8e4f24-2663-434c-a75e-d78c97526683 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:38.874789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a8e4f24-2663-434c-a75e-d78c97526683 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:38.877118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a8e4f24-2663-434c-a75e-d78c97526683 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:38.878455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a8e4f24-2663-434c-a75e-d78c97526683 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:38.880900 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8239e2f6-c08a-40a8-a51f-bd4f007ce87d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.603779 Jul 26 14:10:38.896810 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 795/1489] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:37 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:38.917886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a4ebeca-f635-4091-a4a5-7c34b948201e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:38.934971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a4ebeca-f635-4091-a4a5-7c34b948201e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:38.940745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a4ebeca-f635-4091-a4a5-7c34b948201e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:38.968283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a4ebeca-f635-4091-a4a5-7c34b948201e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:38.970207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a4ebeca-f635-4091-a4a5-7c34b948201e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:38.972006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a4ebeca-f635-4091-a4a5-7c34b948201e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:38.973135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a4ebeca-f635-4091-a4a5-7c34b948201e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:38.993054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=20 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:39.014912 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4a8e4f24-2663-434c-a75e-d78c97526683 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "PUT /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1080 microversion: 2.1 time: 0.205024 Jul 26 14:10:39.024789 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 695/1490] 10.222.0.70 () {60 vars in 1256 bytes} [Tue Jul 26 14:10:38 2022] PUT /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1080 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:39.044352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8eefda69-4fc5-42d5-bab3-80d3227af605 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:39.044352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8eefda69-4fc5-42d5-bab3-80d3227af605 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:39.053573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:39.062155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8eefda69-4fc5-42d5-bab3-80d3227af605 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:39.073341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8eefda69-4fc5-42d5-bab3-80d3227af605 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:39.079265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8eefda69-4fc5-42d5-bab3-80d3227af605 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:39.080660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8eefda69-4fc5-42d5-bab3-80d3227af605 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:39.084322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-2a4ebeca-f635-4091-a4a5-7c34b948201e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:10:39.179858 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a4ebeca-f635-4091-a4a5-7c34b948201e tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.280847 Jul 26 14:10:39.181113 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 796/1491] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:10:38 2022] GET /compute/v2.1/servers => generated 1012 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:39.197660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-06d06e2d-0255-41be-b680-a05903a13826 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87943d8f70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:39.356006 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-06d06e2d-0255-41be-b680-a05903a13826 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.163700 Jul 26 14:10:39.367984 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 797/1492] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:39 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:39.388025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f55ad042-0c39-42c0-83d0-8d3d5ab2b99b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:39.390157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f55ad042-0c39-42c0-83d0-8d3d5ab2b99b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:39.415750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f55ad042-0c39-42c0-83d0-8d3d5ab2b99b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:39.417081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f55ad042-0c39-42c0-83d0-8d3d5ab2b99b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:39.418771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f55ad042-0c39-42c0-83d0-8d3d5ab2b99b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:39.424762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f55ad042-0c39-42c0-83d0-8d3d5ab2b99b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:39.839583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8eefda69-4fc5-42d5-bab3-80d3227af605 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:39.878167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8eefda69-4fc5-42d5-bab3-80d3227af605 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:39.892933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8eefda69-4fc5-42d5-bab3-80d3227af605 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:39.898123 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8eefda69-4fc5-42d5-bab3-80d3227af605 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1754 microversion: 2.42 time: 0.866780 Jul 26 14:10:39.901144 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 696/1493] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:39 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1754 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:39.931389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-62bb13af-4929-4698-8e6e-1dec65223091 req-4f1446b6-9cc4-45f8-976f-70c81bcb53da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cbff42-6659-4317-bf61-7f5f2aaaa942", "name": "network-vif-unplugged", "status": "completed", "tag": "a17e340d-a5eb-45cb-9fb6-171e51e54f5b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:39.953266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-62bb13af-4929-4698-8e6e-1dec65223091 req-4f1446b6-9cc4-45f8-976f-70c81bcb53da service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:39.954431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-62bb13af-4929-4698-8e6e-1dec65223091 req-4f1446b6-9cc4-45f8-976f-70c81bcb53da service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:39.990062 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-62bb13af-4929-4698-8e6e-1dec65223091 req-4f1446b6-9cc4-45f8-976f-70c81bcb53da service nova] Creating event network-vif-unplugged:a17e340d-a5eb-45cb-9fb6-171e51e54f5b for instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 on n-h1-833090-9 Jul 26 14:10:40.010991 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-62bb13af-4929-4698-8e6e-1dec65223091 req-4f1446b6-9cc4-45f8-976f-70c81bcb53da service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101137 Jul 26 14:10:40.013022 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 697/1494] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:40.033477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-36b6f7ee-397e-421c-8b15-7ed29a349ef3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:40.051393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-36b6f7ee-397e-421c-8b15-7ed29a349ef3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:40.068064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-36b6f7ee-397e-421c-8b15-7ed29a349ef3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:40.124231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36b6f7ee-397e-421c-8b15-7ed29a349ef3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:40.126261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36b6f7ee-397e-421c-8b15-7ed29a349ef3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:40.130493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36b6f7ee-397e-421c-8b15-7ed29a349ef3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:40.133765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36b6f7ee-397e-421c-8b15-7ed29a349ef3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:40.374643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f55ad042-0c39-42c0-83d0-8d3d5ab2b99b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:40.396346 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f55ad042-0c39-42c0-83d0-8d3d5ab2b99b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1506 microversion: 2.1 time: 1.036946 Jul 26 14:10:40.400970 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 798/1495] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:39 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1506 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:40.414650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90c0b888-a366-41ff-bb21-7d785025a79d tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:40.419686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-90c0b888-a366-41ff-bb21-7d785025a79d tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:40.443654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90c0b888-a366-41ff-bb21-7d785025a79d tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:40.444876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90c0b888-a366-41ff-bb21-7d785025a79d tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:40.446266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90c0b888-a366-41ff-bb21-7d785025a79d tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:40.447015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90c0b888-a366-41ff-bb21-7d785025a79d tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:40.641387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-36b6f7ee-397e-421c-8b15-7ed29a349ef3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:10:40.905154 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-36b6f7ee-397e-421c-8b15-7ed29a349ef3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.886910 Jul 26 14:10:40.922873 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 698/1496] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:10:40 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:40.935666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5cbb6784-de41-4b6a-b341-cad5ddff48a3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:40.937928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5cbb6784-de41-4b6a-b341-cad5ddff48a3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:40.952155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5cbb6784-de41-4b6a-b341-cad5ddff48a3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:40.954431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5cbb6784-de41-4b6a-b341-cad5ddff48a3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:40.960348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5cbb6784-de41-4b6a-b341-cad5ddff48a3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:40.962003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5cbb6784-de41-4b6a-b341-cad5ddff48a3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:41.776992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90c0b888-a366-41ff-bb21-7d785025a79d tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:41.795920 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90c0b888-a366-41ff-bb21-7d785025a79d tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1315 microversion: 2.1 time: 1.392833 Jul 26 14:10:41.802763 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 799/1497] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:40 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1315 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:41.823307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0e29af9-b242-4ed6-a8f3-8d6c37aaa380 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8794346dc0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:41.963141 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0e29af9-b242-4ed6-a8f3-8d6c37aaa380 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.152928 Jul 26 14:10:41.986514 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 800/1498] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:41 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:41.992278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cdfa2854-fa6a-47b7-9721-e5a09051bf40 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:41.997625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cdfa2854-fa6a-47b7-9721-e5a09051bf40 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:42.023446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdfa2854-fa6a-47b7-9721-e5a09051bf40 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:42.025597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdfa2854-fa6a-47b7-9721-e5a09051bf40 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:42.027516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdfa2854-fa6a-47b7-9721-e5a09051bf40 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:42.032225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdfa2854-fa6a-47b7-9721-e5a09051bf40 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:42.286511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=38 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:43.312560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cdfa2854-fa6a-47b7-9721-e5a09051bf40 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:43.345282 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cdfa2854-fa6a-47b7-9721-e5a09051bf40 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1506 microversion: 2.1 time: 1.345875 Jul 26 14:10:43.346451 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 801/1499] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:41 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1506 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:43.354216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4c3b74e0-e462-4814-8260-bb80fa258af7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:43.362818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4c3b74e0-e462-4814-8260-bb80fa258af7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:43.375127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.servers [None req-4c3b74e0-e462-4814-8260-bb80fa258af7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Removing options 'limit' from query {{(pid=119479) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 14:10:43.385807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4c3b74e0-e462-4814-8260-bb80fa258af7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:43.393647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5cbb6784-de41-4b6a-b341-cad5ddff48a3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:43.394853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c3b74e0-e462-4814-8260-bb80fa258af7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:43.395861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c3b74e0-e462-4814-8260-bb80fa258af7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:43.397598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c3b74e0-e462-4814-8260-bb80fa258af7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:43.398804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c3b74e0-e462-4814-8260-bb80fa258af7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:43.433159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5cbb6784-de41-4b6a-b341-cad5ddff48a3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:43.451526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5cbb6784-de41-4b6a-b341-cad5ddff48a3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:43.457017 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4c3b74e0-e462-4814-8260-bb80fa258af7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.108521 Jul 26 14:10:43.459795 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5cbb6784-de41-4b6a-b341-cad5ddff48a3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 2.534663 Jul 26 14:10:43.460983 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 699/1500] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:40 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 2537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:43.484612 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 802/1501] 10.222.0.70 () {58 vars in 1140 bytes} [Tue Jul 26 14:10:43 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:43.494855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fa87577c-0dc3-4c52-b454-af8a272014ad tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:43.497471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fa87577c-0dc3-4c52-b454-af8a272014ad tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:43.498639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d679462e-43fc-42ae-8753-6be6d86d5e36 req-7bf039e7-20ec-409d-bd92-008ecfe9428a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb3e73a-a58f-462d-8da3-f196fc8a17d9", "name": "network-vif-plugged", "status": "completed", "tag": "266572ab-e529-4406-b7d4-2e1229ce826e"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:43.520642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa87577c-0dc3-4c52-b454-af8a272014ad tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:43.525190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa87577c-0dc3-4c52-b454-af8a272014ad tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:43.526856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa87577c-0dc3-4c52-b454-af8a272014ad tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:43.529525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa87577c-0dc3-4c52-b454-af8a272014ad tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:43.535260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d679462e-43fc-42ae-8753-6be6d86d5e36 req-7bf039e7-20ec-409d-bd92-008ecfe9428a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:43.536436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d679462e-43fc-42ae-8753-6be6d86d5e36 req-7bf039e7-20ec-409d-bd92-008ecfe9428a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:43.579177 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d679462e-43fc-42ae-8753-6be6d86d5e36 req-7bf039e7-20ec-409d-bd92-008ecfe9428a service nova] Creating event network-vif-plugged:266572ab-e529-4406-b7d4-2e1229ce826e for instance 3eb3e73a-a58f-462d-8da3-f196fc8a17d9 on n-h1-833090-9 Jul 26 14:10:43.606692 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d679462e-43fc-42ae-8753-6be6d86d5e36 req-7bf039e7-20ec-409d-bd92-008ecfe9428a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119394 Jul 26 14:10:43.608790 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 803/1502] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:43.662149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f4354c6c-5ec6-443a-b4dd-ffa5dcdaa0eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:43.663819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f4354c6c-5ec6-443a-b4dd-ffa5dcdaa0eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:43.675788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4354c6c-5ec6-443a-b4dd-ffa5dcdaa0eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:43.677988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4354c6c-5ec6-443a-b4dd-ffa5dcdaa0eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:43.679838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4354c6c-5ec6-443a-b4dd-ffa5dcdaa0eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:43.680965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4354c6c-5ec6-443a-b4dd-ffa5dcdaa0eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:44.107056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=16 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:45.321198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fa87577c-0dc3-4c52-b454-af8a272014ad tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:45.349998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f4354c6c-5ec6-443a-b4dd-ffa5dcdaa0eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:45.378435 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f4354c6c-5ec6-443a-b4dd-ffa5dcdaa0eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1315 microversion: 2.1 time: 1.763948 Jul 26 14:10:45.382673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fa87577c-0dc3-4c52-b454-af8a272014ad tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:45.396509 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 804/1503] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:43 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1315 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:45.398204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fa87577c-0dc3-4c52-b454-af8a272014ad tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:45.408307 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fa87577c-0dc3-4c52-b454-af8a272014ad tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1754 microversion: 2.42 time: 1.939342 Jul 26 14:10:45.424200 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 700/1504] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:43 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1754 bytes in 1962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:45.445796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9323f547-7fc0-434a-8574-68c3793add4a tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87943464c0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:45.457970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4000475e-1cb6-4db9-9a9d-3788e60985cb tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:45.458942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4000475e-1cb6-4db9-9a9d-3788e60985cb tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:45.538258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4000475e-1cb6-4db9-9a9d-3788e60985cb tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:45.539009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4000475e-1cb6-4db9-9a9d-3788e60985cb tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:45.555886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4000475e-1cb6-4db9-9a9d-3788e60985cb tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:45.557912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4000475e-1cb6-4db9-9a9d-3788e60985cb tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:45.699221 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9323f547-7fc0-434a-8574-68c3793add4a tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.300720 Jul 26 14:10:45.729072 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 805/1505] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:45 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:45.767535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-830a2fb6-5f04-4ef9-b6c1-3fe2505bef3f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:45.792837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4000475e-1cb6-4db9-9a9d-3788e60985cb tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:10:45.805040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-830a2fb6-5f04-4ef9-b6c1-3fe2505bef3f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:45.806402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-830a2fb6-5f04-4ef9-b6c1-3fe2505bef3f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1069138422', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:10:45.881300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-830a2fb6-5f04-4ef9-b6c1-3fe2505bef3f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:45.882031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-830a2fb6-5f04-4ef9-b6c1-3fe2505bef3f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:45.883574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-830a2fb6-5f04-4ef9-b6c1-3fe2505bef3f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:45.892624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-830a2fb6-5f04-4ef9-b6c1-3fe2505bef3f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:46.260518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:46.639109 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4000475e-1cb6-4db9-9a9d-3788e60985cb tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "DELETE /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 204 len: 0 microversion: 2.1 time: 1.211651 Jul 26 14:10:46.644222 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 701/1506] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:10:45 2022] DELETE /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 0 bytes in 1219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:10:46.676025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2ddd02f6-fd56-47b5-baab-f3e94a2120f9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:46.679492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2ddd02f6-fd56-47b5-baab-f3e94a2120f9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:46.708380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ddd02f6-fd56-47b5-baab-f3e94a2120f9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:46.723908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ddd02f6-fd56-47b5-baab-f3e94a2120f9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:46.725311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ddd02f6-fd56-47b5-baab-f3e94a2120f9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:46.741954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ddd02f6-fd56-47b5-baab-f3e94a2120f9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:46.767389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-830a2fb6-5f04-4ef9-b6c1-3fe2505bef3f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:10:47.124361 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-830a2fb6-5f04-4ef9-b6c1-3fe2505bef3f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1069138422" status: 200 len: 346 microversion: 2.1 time: 1.391807 Jul 26 14:10:47.132316 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 806/1507] 10.222.0.70 () {58 vars in 1242 bytes} [Tue Jul 26 14:10:45 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1069138422 => generated 346 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:47.163719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8f6a6daf-7995-437d-9d05-10f3a61d7774 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:47.174591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8f6a6daf-7995-437d-9d05-10f3a61d7774 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:47.227749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f6a6daf-7995-437d-9d05-10f3a61d7774 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:47.228859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f6a6daf-7995-437d-9d05-10f3a61d7774 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:47.239759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f6a6daf-7995-437d-9d05-10f3a61d7774 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:47.243274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f6a6daf-7995-437d-9d05-10f3a61d7774 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:48.591199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2ddd02f6-fd56-47b5-baab-f3e94a2120f9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:48.624573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2ddd02f6-fd56-47b5-baab-f3e94a2120f9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:48.635926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2ddd02f6-fd56-47b5-baab-f3e94a2120f9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:48.645276 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2ddd02f6-fd56-47b5-baab-f3e94a2120f9 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.994507 Jul 26 14:10:48.695267 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 702/1508] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:46 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 2050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:48.708633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7539b7c0-4f59-4b7a-894c-4b467155a7b6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:48.714350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7539b7c0-4f59-4b7a-894c-4b467155a7b6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:48.755529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7539b7c0-4f59-4b7a-894c-4b467155a7b6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:48.756973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7539b7c0-4f59-4b7a-894c-4b467155a7b6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:48.764772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7539b7c0-4f59-4b7a-894c-4b467155a7b6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:48.769198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7539b7c0-4f59-4b7a-894c-4b467155a7b6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:48.873725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8f6a6daf-7995-437d-9d05-10f3a61d7774 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:48.927467 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8f6a6daf-7995-437d-9d05-10f3a61d7774 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1465 microversion: 2.1 time: 1.785190 Jul 26 14:10:48.935211 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 807/1509] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:47 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1465 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:48.980309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f2b9f2cf-ed71-49ff-bdf8-169d84f13aa7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:48.981478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f2b9f2cf-ed71-49ff-bdf8-169d84f13aa7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:48.994864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2b9f2cf-ed71-49ff-bdf8-169d84f13aa7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:48.997143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2b9f2cf-ed71-49ff-bdf8-169d84f13aa7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:48.999281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2b9f2cf-ed71-49ff-bdf8-169d84f13aa7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:49.000625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2b9f2cf-ed71-49ff-bdf8-169d84f13aa7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:49.114030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f2b9f2cf-ed71-49ff-bdf8-169d84f13aa7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:10:49.346676 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.compute.api [None req-f2b9f2cf-ed71-49ff-bdf8-169d84f13aa7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Instance is already in deleting state, ignoring this request Jul 26 14:10:49.350764 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f2b9f2cf-ed71-49ff-bdf8-169d84f13aa7 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "DELETE /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 204 len: 0 microversion: 2.1 time: 0.386935 Jul 26 14:10:49.369141 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 808/1510] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:10:48 2022] DELETE /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:10:49.410547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b8e5de9c-5d32-4f34-a83b-b33c9e480201 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87942a25e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:49.618061 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b8e5de9c-5d32-4f34-a83b-b33c9e480201 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.246620 Jul 26 14:10:49.632455 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 809/1511] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:49 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:49.646333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9412ecd0-e5f4-468d-bc42-d0cc7bbd6d9b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:49.715827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9412ecd0-e5f4-468d-bc42-d0cc7bbd6d9b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:49.716913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9412ecd0-e5f4-468d-bc42-d0cc7bbd6d9b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:49.964732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9412ecd0-e5f4-468d-bc42-d0cc7bbd6d9b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Going to try to stop instance {{(pid=119479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:10:50.106792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7539b7c0-4f59-4b7a-894c-4b467155a7b6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:50.135569 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9412ecd0-e5f4-468d-bc42-d0cc7bbd6d9b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "POST /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b/action" status: 202 len: 0 microversion: 2.1 time: 0.489702 Jul 26 14:10:50.159771 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 810/1512] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:10:49 2022] POST /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:10:50.160713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7539b7c0-4f59-4b7a-894c-4b467155a7b6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:50.166052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7539b7c0-4f59-4b7a-894c-4b467155a7b6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:50.167790 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7539b7c0-4f59-4b7a-894c-4b467155a7b6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1801 microversion: 2.42 time: 1.470089 Jul 26 14:10:50.177251 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 703/1513] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:48 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1801 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:50.195135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8cf72a46-b97d-4625-a111-25572bb87686 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:50.196013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8cf72a46-b97d-4625-a111-25572bb87686 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:50.216707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bd146270-5aa3-46a1-a316-0dea8c78fc9f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:50.221050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bd146270-5aa3-46a1-a316-0dea8c78fc9f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:50.252804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd146270-5aa3-46a1-a316-0dea8c78fc9f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:50.256873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd146270-5aa3-46a1-a316-0dea8c78fc9f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:50.259330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cf72a46-b97d-4625-a111-25572bb87686 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:50.262793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd146270-5aa3-46a1-a316-0dea8c78fc9f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:50.263414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cf72a46-b97d-4625-a111-25572bb87686 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:50.264859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd146270-5aa3-46a1-a316-0dea8c78fc9f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:50.271927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cf72a46-b97d-4625-a111-25572bb87686 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:50.271927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cf72a46-b97d-4625-a111-25572bb87686 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:50.336857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:53.157463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bd146270-5aa3-46a1-a316-0dea8c78fc9f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:53.183684 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bd146270-5aa3-46a1-a316-0dea8c78fc9f tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1512 microversion: 2.1 time: 2.999585 Jul 26 14:10:53.205242 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 704/1514] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:50 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1512 bytes in 3023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:53.223627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b20906c-178d-486e-81b8-42bf71235fce tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:53.224631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b20906c-178d-486e-81b8-42bf71235fce tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:53.240310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b20906c-178d-486e-81b8-42bf71235fce tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:53.242231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b20906c-178d-486e-81b8-42bf71235fce tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:53.244412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b20906c-178d-486e-81b8-42bf71235fce tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:53.245767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b20906c-178d-486e-81b8-42bf71235fce tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:53.922314 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8cf72a46-b97d-4625-a111-25572bb87686 tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1616 microversion: 2.1 time: 3.764941 Jul 26 14:10:53.954479 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 811/1515] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:50 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1616 bytes in 3799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:53.991632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c6bb25a-0e64-4c82-bab9-b960fe18e99d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:54.004400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8c6bb25a-0e64-4c82-bab9-b960fe18e99d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:54.037501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c6bb25a-0e64-4c82-bab9-b960fe18e99d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:54.042128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c6bb25a-0e64-4c82-bab9-b960fe18e99d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:54.043936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c6bb25a-0e64-4c82-bab9-b960fe18e99d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:54.046488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c6bb25a-0e64-4c82-bab9-b960fe18e99d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:54.578973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b20906c-178d-486e-81b8-42bf71235fce tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:54.635354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b20906c-178d-486e-81b8-42bf71235fce tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:54.642998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b20906c-178d-486e-81b8-42bf71235fce tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:54.646256 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b20906c-178d-486e-81b8-42bf71235fce tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.439253 Jul 26 14:10:54.668432 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 705/1516] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:53 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:54.709628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8c6bb25a-0e64-4c82-bab9-b960fe18e99d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:54.710242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-15d75825-0323-4bdd-ace4-9b867074a481 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787b8ae50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:54.741383 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8c6bb25a-0e64-4c82-bab9-b960fe18e99d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1521 microversion: 2.1 time: 0.774835 Jul 26 14:10:54.743638 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 812/1517] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:53 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1521 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:54.762614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fab9bc24-3792-426d-ae16-b1f6cf20ad4c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:54.763665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fab9bc24-3792-426d-ae16-b1f6cf20ad4c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:54.792225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fab9bc24-3792-426d-ae16-b1f6cf20ad4c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:54.793413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fab9bc24-3792-426d-ae16-b1f6cf20ad4c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:54.794763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fab9bc24-3792-426d-ae16-b1f6cf20ad4c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:54.795471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fab9bc24-3792-426d-ae16-b1f6cf20ad4c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:54.882342 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-15d75825-0323-4bdd-ace4-9b867074a481 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.205621 Jul 26 14:10:54.884583 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 706/1518] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:54 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:55.606419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ec4b30f4-3250-4039-9d73-c8657a7a59aa tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:55.622102 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:10:55.622102 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:10:55.631045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ec4b30f4-3250-4039-9d73-c8657a7a59aa tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:55.633907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ec4b30f4-3250-4039-9d73-c8657a7a59aa tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:55.638922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ec4b30f4-3250-4039-9d73-c8657a7a59aa tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:55.640330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ec4b30f4-3250-4039-9d73-c8657a7a59aa tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:55.746014 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ec4b30f4-3250-4039-9d73-c8657a7a59aa tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.858650 Jul 26 14:10:55.761656 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 707/1519] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:10:54 2022] GET /compute/v2.1/os-services => generated 944 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:55.777353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3fe6b086-2d03-427f-b7d2-526cbcd40440 req-7b48ef39-3a7b-41b6-ac6d-7f7567b54018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2d1d90-5bc8-458d-b336-97b257732f89", "name": "network-vif-unplugged", "status": "completed", "tag": "d781d91d-4c50-4ce1-8f4a-91816a69dd86"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:55.817642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3fe6b086-2d03-427f-b7d2-526cbcd40440 req-7b48ef39-3a7b-41b6-ac6d-7f7567b54018 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:55.824908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3fe6b086-2d03-427f-b7d2-526cbcd40440 req-7b48ef39-3a7b-41b6-ac6d-7f7567b54018 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:55.872856 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3fe6b086-2d03-427f-b7d2-526cbcd40440 req-7b48ef39-3a7b-41b6-ac6d-7f7567b54018 service nova] Creating event network-vif-unplugged:d781d91d-4c50-4ce1-8f4a-91816a69dd86 for instance de2d1d90-5bc8-458d-b336-97b257732f89 on n-h1-833090-9 Jul 26 14:10:55.891510 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3fe6b086-2d03-427f-b7d2-526cbcd40440 req-7b48ef39-3a7b-41b6-ac6d-7f7567b54018 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126307 Jul 26 14:10:55.898409 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 708/1520] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:55.922626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:55.930020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:55.950685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:55.956288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:55.959596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:55.962985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:56.055272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:56.056390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:56.057414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lazy-loading 'fault' on Instance uuid de2d1d90-5bc8-458d-b336-97b257732f89 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:10:56.350391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=5 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:56.477744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8a1556b59644acbe6edf7c64fa76f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f25f5febd140a69cc213cb54ecdf5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:56.502828 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7ff49cb7-9b23-4665-8045-558d1847ff8a tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 200 len: 1306 microversion: 2.1 time: 0.600522 Jul 26 14:10:56.531101 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 709/1521] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:55 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 1306 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:56.550171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1871827775", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["34089008-8d17-4f4a-a989-57f47959ae93"]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:56.676290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fab9bc24-3792-426d-ae16-b1f6cf20ad4c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:56.713552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:10:56.723389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fab9bc24-3792-426d-ae16-b1f6cf20ad4c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:56.737466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fab9bc24-3792-426d-ae16-b1f6cf20ad4c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:56.742381 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fab9bc24-3792-426d-ae16-b1f6cf20ad4c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1848 microversion: 2.42 time: 1.997000 Jul 26 14:10:56.746756 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 813/1522] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:54 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1848 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:56.763171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-946282f0-71a5-4d37-864c-587906d38228 req-2090fd0e-8063-454b-acf3-5b47dd702814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2d1d90-5bc8-458d-b336-97b257732f89", "name": "network-vif-deleted", "tag": "d781d91d-4c50-4ce1-8f4a-91816a69dd86"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:10:56.804401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-946282f0-71a5-4d37-864c-587906d38228 req-2090fd0e-8063-454b-acf3-5b47dd702814 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:56.805478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-946282f0-71a5-4d37-864c-587906d38228 req-2090fd0e-8063-454b-acf3-5b47dd702814 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:56.829394 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-946282f0-71a5-4d37-864c-587906d38228 req-2090fd0e-8063-454b-acf3-5b47dd702814 service nova] Creating event network-vif-deleted:d781d91d-4c50-4ce1-8f4a-91816a69dd86 for instance de2d1d90-5bc8-458d-b336-97b257732f89 on n-h1-833090-9 Jul 26 14:10:56.840634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-946282f0-71a5-4d37-864c-587906d38228 req-2090fd0e-8063-454b-acf3-5b47dd702814 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091230 Jul 26 14:10:56.847187 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 814/1523] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:56.864994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d3502e2-11a6-45de-aef3-43e4db8fdb8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:56.866560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4d3502e2-11a6-45de-aef3-43e4db8fdb8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:56.893979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d3502e2-11a6-45de-aef3-43e4db8fdb8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:56.894737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d3502e2-11a6-45de-aef3-43e4db8fdb8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:56.896083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d3502e2-11a6-45de-aef3-43e4db8fdb8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:56.896774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d3502e2-11a6-45de-aef3-43e4db8fdb8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:57.478414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:10:57.479518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:10:57.481477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:10:57.482395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:10:57.483782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:10:57.525147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:57.526256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:57.527898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:57.529314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:57.621686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:10:57.651831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:10:57.716489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:10:57.724914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:10:57.906869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4d3502e2-11a6-45de-aef3-43e4db8fdb8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:57.910536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:10:57.950868 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5fc85bca-5a28-4e07-81c8-de2c5de097be tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.412240 Jul 26 14:10:57.954544 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 710/1524] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:10:57.973833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4d3502e2-11a6-45de-aef3-43e4db8fdb8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:57.987670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4d3502e2-11a6-45de-aef3-43e4db8fdb8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:57.990692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1e7a2060-9705-4179-9235-0ebbe0c4b9f2 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:57.992909 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d3502e2-11a6-45de-aef3-43e4db8fdb8a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1812 microversion: 2.25 time: 1.141290 Jul 26 14:10:57.994634 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 815/1525] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:56 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1812 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:58.002593 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:10:58.002593 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:10:58.015040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e7a2060-9705-4179-9235-0ebbe0c4b9f2 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:58.016506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e7a2060-9705-4179-9235-0ebbe0c4b9f2 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:58.021259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e7a2060-9705-4179-9235-0ebbe0c4b9f2 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:58.022338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca62cc23-28d0-4d43-a9c5-a82cd607fcf7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:58.033349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e7a2060-9705-4179-9235-0ebbe0c4b9f2 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:58.044458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ca62cc23-28d0-4d43-a9c5-a82cd607fcf7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:58.085308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca62cc23-28d0-4d43-a9c5-a82cd607fcf7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:58.097009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca62cc23-28d0-4d43-a9c5-a82cd607fcf7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:58.098461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca62cc23-28d0-4d43-a9c5-a82cd607fcf7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:58.099258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca62cc23-28d0-4d43-a9c5-a82cd607fcf7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:58.164577 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1e7a2060-9705-4179-9235-0ebbe0c4b9f2 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-833090-9" status: 200 len: 578 microversion: 2.1 time: 0.205797 Jul 26 14:10:58.193627 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 711/1526] 10.222.0.70 () {58 vars in 1172 bytes} [Tue Jul 26 14:10:57 2022] GET /compute/v2.1/os-services?host=n-d-833090-9 => generated 578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:58.209393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6dd728d5-67f8-4ce3-b66a-678f28bcb1d6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787bff8b0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:58.367984 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6dd728d5-67f8-4ce3-b66a-678f28bcb1d6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.170819 Jul 26 14:10:58.371169 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 712/1527] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:58 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:58.380954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cd6f68d2-c213-45ab-ac1b-b0f92e12aace tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:58.385075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cd6f68d2-c213-45ab-ac1b-b0f92e12aace tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: de2d1d90-5bc8-458d-b336-97b257732f89] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:58.441380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd6f68d2-c213-45ab-ac1b-b0f92e12aace tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:58.441966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd6f68d2-c213-45ab-ac1b-b0f92e12aace tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:58.443137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd6f68d2-c213-45ab-ac1b-b0f92e12aace tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:58.443872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd6f68d2-c213-45ab-ac1b-b0f92e12aace tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:58.528595 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-cd6f68d2-c213-45ab-ac1b-b0f92e12aace tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] HTTP exception thrown: Instance de2d1d90-5bc8-458d-b336-97b257732f89 could not be found. Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cd6f68d2-c213-45ab-ac1b-b0f92e12aace tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Request method failure captured: Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 HTTP/1.1 Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_UANI5__UQM7cw0RJ__NGf6r0S5vIGHdw93V7SraIf3dWejRMiw9Q0Dcibf95UsSx7HXMwqI-H-jl5I63pz0lHB4iIJrwxnm87oJirXPvzgHW74lxc_GJh4r31IgvKFeRt89mYDLQZ07oBDeaqJDaChcgtAYg-CGekGymnwVnCMKSo Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 46f25f5febd140a69cc213cb54ecdf5f Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46f25f5febd140a69cc213cb54ecdf5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46f25f5febd140a69cc213cb54ecdf5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46f25f5febd140a69cc213cb54ecdf5f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46f25f5febd140a69cc213cb54ecdf5f"}]}] Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 46f25f5febd140a69cc213cb54ecdf5f Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerDiskConfigTestJSON-822169109-project Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7b8a1556b59644acbe6edf7c64fa76f5 Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerDiskConfigTestJSON-822169109-project Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance de2d1d90-5bc8-458d-b336-97b257732f89 could not be found. Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'de2d1d90-5bc8-458d-b336-97b257732f89'} Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2d1d90-5bc8-458d-b336-97b257732f89 could not be found. Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2d1d90-5bc8-458d-b336-97b257732f89 could not be found. Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:10:58.533447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:10:58.542047 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:58.542047 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:10:58.542047 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:10:58.542047 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:10:58.542047 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:10:58.542047 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2d1d90-5bc8-458d-b336-97b257732f89 could not be found. Jul 26 14:10:58.542047 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:10:58.547799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cd6f68d2-c213-45ab-ac1b-b0f92e12aace tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Returning 404 to user: Instance de2d1d90-5bc8-458d-b336-97b257732f89 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:10:58.551844 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cd6f68d2-c213-45ab-ac1b-b0f92e12aace tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89" status: 404 len: 111 microversion: 2.1 time: 0.178375 Jul 26 14:10:58.555754 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 713/1528] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:58 2022] GET /compute/v2.1/servers/de2d1d90-5bc8-458d-b336-97b257732f89 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:10:58.568460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f8bb84d8-00b4-451a-9e6e-7d4f0f43fd66 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:58.580492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f8bb84d8-00b4-451a-9e6e-7d4f0f43fd66 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:58.601982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8bb84d8-00b4-451a-9e6e-7d4f0f43fd66 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:58.602815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8bb84d8-00b4-451a-9e6e-7d4f0f43fd66 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:58.612736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8bb84d8-00b4-451a-9e6e-7d4f0f43fd66 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:58.612736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8bb84d8-00b4-451a-9e6e-7d4f0f43fd66 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:59.204101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ca62cc23-28d0-4d43-a9c5-a82cd607fcf7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:59.228518 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca62cc23-28d0-4d43-a9c5-a82cd607fcf7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1521 microversion: 2.1 time: 1.229909 Jul 26 14:10:59.233178 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 816/1529] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:57 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1521 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:59.256756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ff8e721-c7fd-4dc4-b92b-9c974630cfc5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:59.257837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4ff8e721-c7fd-4dc4-b92b-9c974630cfc5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:59.582988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f8bb84d8-00b4-451a-9e6e-7d4f0f43fd66 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:59.635739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f8bb84d8-00b4-451a-9e6e-7d4f0f43fd66 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:59.648817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f8bb84d8-00b4-451a-9e6e-7d4f0f43fd66 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:59.667175 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f8bb84d8-00b4-451a-9e6e-7d4f0f43fd66 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1848 microversion: 2.42 time: 1.095837 Jul 26 14:10:59.674091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4ff8e721-c7fd-4dc4-b92b-9c974630cfc5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:10:59.675878 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 714/1530] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:58 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1848 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:10:59.703382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eac12e69-cc21-4da8-b537-69e4cc869c81 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:59.711872 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4ff8e721-c7fd-4dc4-b92b-9c974630cfc5 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1217 microversion: 2.1 time: 0.466294 Jul 26 14:10:59.714467 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:10:59.714467 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:10:59.715800 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 817/1531] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:10:59 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1217 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:10:59.722332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eac12e69-cc21-4da8-b537-69e4cc869c81 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:59.723324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eac12e69-cc21-4da8-b537-69e4cc869c81 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:59.727235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eac12e69-cc21-4da8-b537-69e4cc869c81 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:59.732781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eac12e69-cc21-4da8-b537-69e4cc869c81 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:59.759364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-333cf3ae-c237-4ca4-b268-af7369aa3549 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:59.765319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-333cf3ae-c237-4ca4-b268-af7369aa3549 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:59.796935 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eac12e69-cc21-4da8-b537-69e4cc869c81 tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.109777 Jul 26 14:10:59.797588 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 715/1532] 10.222.0.70 () {58 vars in 1176 bytes} [Tue Jul 26 14:10:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:10:59.811317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-333cf3ae-c237-4ca4-b268-af7369aa3549 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:59.816170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-333cf3ae-c237-4ca4-b268-af7369aa3549 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:59.818479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f39ac882-283f-4457-9cf2-53970df00691 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:10:59.819094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f39ac882-283f-4457-9cf2-53970df00691 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:10:59.820284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-333cf3ae-c237-4ca4-b268-af7369aa3549 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:59.831305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-333cf3ae-c237-4ca4-b268-af7369aa3549 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:59.845685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f39ac882-283f-4457-9cf2-53970df00691 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:59.846479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f39ac882-283f-4457-9cf2-53970df00691 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:59.847488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f39ac882-283f-4457-9cf2-53970df00691 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:10:59.848093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f39ac882-283f-4457-9cf2-53970df00691 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:10:59.920598 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-333cf3ae-c237-4ca4-b268-af7369aa3549 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] HTTP exception thrown: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-333cf3ae-c237-4ca4-b268-af7369aa3549 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Request method failure captured: Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 HTTP/1.1 Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_UANI5__UQM7cw0RJ__NGf6r0S5vIGHdw93V7SraIf3dWejRMiw9Q0Dcibf95UsSx7HXMwqI-H-jl5I63pz0lHB4iIJrwxnm87oJirXPvzgHW74lxc_GJh4r31IgvKFeRt89mYDLQZ07oBDeaqJDaChcgtAYg-CGekGymnwVnCMKSo Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 46f25f5febd140a69cc213cb54ecdf5f Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46f25f5febd140a69cc213cb54ecdf5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46f25f5febd140a69cc213cb54ecdf5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46f25f5febd140a69cc213cb54ecdf5f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46f25f5febd140a69cc213cb54ecdf5f"}]}] Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 46f25f5febd140a69cc213cb54ecdf5f Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerDiskConfigTestJSON-822169109-project Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7b8a1556b59644acbe6edf7c64fa76f5 Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerDiskConfigTestJSON-822169109-project Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '2c2ebb15-8fe0-418b-9bff-62df9ad91d33'} Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:10:59.932108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:10:59.940229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-333cf3ae-c237-4ca4-b268-af7369aa3549 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Returning 404 to user: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:10:59.943314 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-333cf3ae-c237-4ca4-b268-af7369aa3549 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 404 len: 111 microversion: 2.1 time: 0.221740 Jul 26 14:10:59.948818 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 818/1533] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:10:59 2022] DELETE /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:10:59.990590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8e1cab8a-a476-424e-bece-b4872eb51fbb tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787f46310>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:00.187217 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8e1cab8a-a476-424e-bece-b4872eb51fbb tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.236482 Jul 26 14:11:00.209419 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 819/1534] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:10:59 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:00.217871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ab46781b-7c44-48e7-ac9e-a0245559c0a9 req-2ddc18c8-2203-415e-816c-5042518032ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "tag": "672376f8-b9e7-4c34-b66d-00f8e644af8a"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:00.241168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ab46781b-7c44-48e7-ac9e-a0245559c0a9 req-2ddc18c8-2203-415e-816c-5042518032ca service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:00.242085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ab46781b-7c44-48e7-ac9e-a0245559c0a9 req-2ddc18c8-2203-415e-816c-5042518032ca service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:00.271223 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ab46781b-7c44-48e7-ac9e-a0245559c0a9 req-2ddc18c8-2203-415e-816c-5042518032ca service nova] Creating event network-changed:672376f8-b9e7-4c34-b66d-00f8e644af8a for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:11:00.281225 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ab46781b-7c44-48e7-ac9e-a0245559c0a9 req-2ddc18c8-2203-415e-816c-5042518032ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081099 Jul 26 14:11:00.282308 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 820/1535] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:00.318917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-826b66b0-73b6-417e-b8d6-a2212dc86cec tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:00.330875 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:00.330875 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:11:00.335527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-826b66b0-73b6-417e-b8d6-a2212dc86cec tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:00.337173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-826b66b0-73b6-417e-b8d6-a2212dc86cec tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:00.350350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-826b66b0-73b6-417e-b8d6-a2212dc86cec tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:00.351717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-826b66b0-73b6-417e-b8d6-a2212dc86cec tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:00.428107 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-826b66b0-73b6-417e-b8d6-a2212dc86cec tempest-ServicesAdminTestJSON-849723615 tempest-ServicesAdminTestJSON-849723615-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.126607 Jul 26 14:11:00.430144 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 821/1536] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:11:00 2022] GET /compute/v2.1/os-services => generated 944 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:00.472096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1b3b6b56-f63b-4fd2-8eb0-4a9b1600f1df tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:00.475119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1b3b6b56-f63b-4fd2-8eb0-4a9b1600f1df tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 2c2ebb15-8fe0-418b-9bff-62df9ad91d33] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:00.543524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b3b6b56-f63b-4fd2-8eb0-4a9b1600f1df tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:00.547587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b3b6b56-f63b-4fd2-8eb0-4a9b1600f1df tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:00.551567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b3b6b56-f63b-4fd2-8eb0-4a9b1600f1df tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:00.553745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b3b6b56-f63b-4fd2-8eb0-4a9b1600f1df tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:00.624002 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-1b3b6b56-f63b-4fd2-8eb0-4a9b1600f1df tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] HTTP exception thrown: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1b3b6b56-f63b-4fd2-8eb0-4a9b1600f1df tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Request method failure captured: Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 HTTP/1.1 Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_UANI5__UQM7cw0RJ__NGf6r0S5vIGHdw93V7SraIf3dWejRMiw9Q0Dcibf95UsSx7HXMwqI-H-jl5I63pz0lHB4iIJrwxnm87oJirXPvzgHW74lxc_GJh4r31IgvKFeRt89mYDLQZ07oBDeaqJDaChcgtAYg-CGekGymnwVnCMKSo Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 46f25f5febd140a69cc213cb54ecdf5f Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46f25f5febd140a69cc213cb54ecdf5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46f25f5febd140a69cc213cb54ecdf5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46f25f5febd140a69cc213cb54ecdf5f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46f25f5febd140a69cc213cb54ecdf5f"}]}] Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 46f25f5febd140a69cc213cb54ecdf5f Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerDiskConfigTestJSON-822169109-project Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7b8a1556b59644acbe6edf7c64fa76f5 Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerDiskConfigTestJSON-822169109-project Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '2c2ebb15-8fe0-418b-9bff-62df9ad91d33'} Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:00.633090 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:00.645749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:00.645749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:00.645749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:00.645749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:11:00.645749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:11:00.645749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. Jul 26 14:11:00.645749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:00.645749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1b3b6b56-f63b-4fd2-8eb0-4a9b1600f1df tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Returning 404 to user: Instance 2c2ebb15-8fe0-418b-9bff-62df9ad91d33 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:11:00.645749 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1b3b6b56-f63b-4fd2-8eb0-4a9b1600f1df tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33" status: 404 len: 111 microversion: 2.1 time: 0.206507 Jul 26 14:11:00.645749 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 822/1537] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:00 2022] GET /compute/v2.1/servers/2c2ebb15-8fe0-418b-9bff-62df9ad91d33 => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:11:00.668520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-417beeed-8e95-483a-bb85-bee4a2e0f9a9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:00.670578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-417beeed-8e95-483a-bb85-bee4a2e0f9a9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:00.698032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-417beeed-8e95-483a-bb85-bee4a2e0f9a9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:00.700458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-417beeed-8e95-483a-bb85-bee4a2e0f9a9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:00.704738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-417beeed-8e95-483a-bb85-bee4a2e0f9a9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:00.709110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-417beeed-8e95-483a-bb85-bee4a2e0f9a9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:01.354218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f39ac882-283f-4457-9cf2-53970df00691 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:01.390807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f39ac882-283f-4457-9cf2-53970df00691 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:01.399163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f39ac882-283f-4457-9cf2-53970df00691 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:01.407494 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f39ac882-283f-4457-9cf2-53970df00691 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1802 microversion: 2.25 time: 1.605015 Jul 26 14:11:01.412042 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 716/1538] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:10:59 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1802 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:01.439712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55c114e8-ebca-497f-a60e-d2ca867e6cd5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:01.440933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-55c114e8-ebca-497f-a60e-d2ca867e6cd5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:01.475354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c114e8-ebca-497f-a60e-d2ca867e6cd5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:01.477356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c114e8-ebca-497f-a60e-d2ca867e6cd5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:01.486220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c114e8-ebca-497f-a60e-d2ca867e6cd5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:01.486918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c114e8-ebca-497f-a60e-d2ca867e6cd5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:01.555224 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-55c114e8-ebca-497f-a60e-d2ca867e6cd5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] HTTP exception thrown: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55c114e8-ebca-497f-a60e-d2ca867e6cd5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Request method failure captured: Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a HTTP/1.1 Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_UANI5__UQM7cw0RJ__NGf6r0S5vIGHdw93V7SraIf3dWejRMiw9Q0Dcibf95UsSx7HXMwqI-H-jl5I63pz0lHB4iIJrwxnm87oJirXPvzgHW74lxc_GJh4r31IgvKFeRt89mYDLQZ07oBDeaqJDaChcgtAYg-CGekGymnwVnCMKSo Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 46f25f5febd140a69cc213cb54ecdf5f Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46f25f5febd140a69cc213cb54ecdf5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46f25f5febd140a69cc213cb54ecdf5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46f25f5febd140a69cc213cb54ecdf5f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46f25f5febd140a69cc213cb54ecdf5f"}]}] Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 46f25f5febd140a69cc213cb54ecdf5f Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerDiskConfigTestJSON-822169109-project Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7b8a1556b59644acbe6edf7c64fa76f5 Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerDiskConfigTestJSON-822169109-project Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4c8fb600-30dc-4acb-819a-c6bd8059035a'} Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:11:01.567328 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55c114e8-ebca-497f-a60e-d2ca867e6cd5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Returning 404 to user: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:11:01.576967 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-55c114e8-ebca-497f-a60e-d2ca867e6cd5 tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 404 len: 111 microversion: 2.1 time: 0.155971 Jul 26 14:11:01.588679 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 717/1539] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:11:01 2022] DELETE /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:11:01.611286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9a896666-83a7-4682-bc55-1cd6301a5f3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:01.612440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9a896666-83a7-4682-bc55-1cd6301a5f3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:01.667283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a896666-83a7-4682-bc55-1cd6301a5f3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:01.667283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a896666-83a7-4682-bc55-1cd6301a5f3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:01.672566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a896666-83a7-4682-bc55-1cd6301a5f3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:01.673161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a896666-83a7-4682-bc55-1cd6301a5f3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:01.939323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-417beeed-8e95-483a-bb85-bee4a2e0f9a9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:01.985524 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-417beeed-8e95-483a-bb85-bee4a2e0f9a9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1521 microversion: 2.1 time: 1.339589 Jul 26 14:11:01.986631 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 823/1540] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:00 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1521 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:02.028928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3122bb15-46c5-48c9-a2a1-91b2f3496c68 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:02.030063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3122bb15-46c5-48c9-a2a1-91b2f3496c68 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:02.054516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3122bb15-46c5-48c9-a2a1-91b2f3496c68 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:02.056993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3122bb15-46c5-48c9-a2a1-91b2f3496c68 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:02.058764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3122bb15-46c5-48c9-a2a1-91b2f3496c68 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:02.064531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3122bb15-46c5-48c9-a2a1-91b2f3496c68 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:02.535410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3122bb15-46c5-48c9-a2a1-91b2f3496c68 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:02.562915 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3122bb15-46c5-48c9-a2a1-91b2f3496c68 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1269 microversion: 2.1 time: 0.559719 Jul 26 14:11:02.564735 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 824/1541] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:01 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1269 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:02.583288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e53c022c-d18c-4629-9226-c22af2145d2e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87942a2700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:02.755541 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e53c022c-d18c-4629-9226-c22af2145d2e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.185363 Jul 26 14:11:02.762476 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 825/1542] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:11:02 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:02.803028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a896666-83a7-4682-bc55-1cd6301a5f3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:02.817437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7d654f04-3d56-4583-9ac1-4d127b04839b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '.version_select at 0x7f879437b040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:02.835388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d654f04-3d56-4583-9ac1-4d127b04839b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:02.839405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d654f04-3d56-4583-9ac1-4d127b04839b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:02.867600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a896666-83a7-4682-bc55-1cd6301a5f3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:02.877499 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7d654f04-3d56-4583-9ac1-4d127b04839b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1276 microversion: 2.25 time: 0.107886 Jul 26 14:11:02.877849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a896666-83a7-4682-bc55-1cd6301a5f3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:02.883346 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 826/1543] 10.222.0.70 () {60 vars in 1184 bytes} [Tue Jul 26 14:11:02 2022] GET /compute/v2.1/os-migrations => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:02.884587 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9a896666-83a7-4682-bc55-1cd6301a5f3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1848 microversion: 2.42 time: 1.292433 Jul 26 14:11:02.889200 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 718/1544] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:01 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1848 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:02.910298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c2b0a324-bbe8-4f0b-809c-a9f7ad0c26a7 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:02.915349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c2b0a324-bbe8-4f0b-809c-a9f7ad0c26a7 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:02.938271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b99b475a-71c0-47d8-88bc-be2bedd2624b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:02.939924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c2b0a324-bbe8-4f0b-809c-a9f7ad0c26a7 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:02.941048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c2b0a324-bbe8-4f0b-809c-a9f7ad0c26a7 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:02.942716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c2b0a324-bbe8-4f0b-809c-a9f7ad0c26a7 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:02.944268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c2b0a324-bbe8-4f0b-809c-a9f7ad0c26a7 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:02.947610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b99b475a-71c0-47d8-88bc-be2bedd2624b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] [instance: 4c8fb600-30dc-4acb-819a-c6bd8059035a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:02.976701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b99b475a-71c0-47d8-88bc-be2bedd2624b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:02.978800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b99b475a-71c0-47d8-88bc-be2bedd2624b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:02.984039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b99b475a-71c0-47d8-88bc-be2bedd2624b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:02.986952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b99b475a-71c0-47d8-88bc-be2bedd2624b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:03.040415 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-b99b475a-71c0-47d8-88bc-be2bedd2624b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] HTTP exception thrown: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b99b475a-71c0-47d8-88bc-be2bedd2624b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Request method failure captured: Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a HTTP/1.1 Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_UANI5__UQM7cw0RJ__NGf6r0S5vIGHdw93V7SraIf3dWejRMiw9Q0Dcibf95UsSx7HXMwqI-H-jl5I63pz0lHB4iIJrwxnm87oJirXPvzgHW74lxc_GJh4r31IgvKFeRt89mYDLQZ07oBDeaqJDaChcgtAYg-CGekGymnwVnCMKSo Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 46f25f5febd140a69cc213cb54ecdf5f Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46f25f5febd140a69cc213cb54ecdf5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46f25f5febd140a69cc213cb54ecdf5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46f25f5febd140a69cc213cb54ecdf5f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46f25f5febd140a69cc213cb54ecdf5f"}]}] Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 46f25f5febd140a69cc213cb54ecdf5f Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-822169109 Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerDiskConfigTestJSON-822169109-project Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7b8a1556b59644acbe6edf7c64fa76f5 Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerDiskConfigTestJSON-822169109-project Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4c8fb600-30dc-4acb-819a-c6bd8059035a'} Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:03.049580 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:03.062977 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:03.062977 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:03.062977 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:03.062977 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:11:03.062977 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:11:03.062977 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. Jul 26 14:11:03.062977 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:03.066296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b99b475a-71c0-47d8-88bc-be2bedd2624b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] Returning 404 to user: Instance 4c8fb600-30dc-4acb-819a-c6bd8059035a could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:11:03.068396 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b99b475a-71c0-47d8-88bc-be2bedd2624b tempest-ServerDiskConfigTestJSON-822169109 tempest-ServerDiskConfigTestJSON-822169109-project] 10.222.0.70 "GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a" status: 404 len: 111 microversion: 2.1 time: 0.182497 Jul 26 14:11:03.070193 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 827/1545] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:02 2022] GET /compute/v2.1/servers/4c8fb600-30dc-4acb-819a-c6bd8059035a => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:11:03.080378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8069c114-fd12-4b90-8a19-73eb0b6fedd9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:03.081862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8069c114-fd12-4b90-8a19-73eb0b6fedd9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:03.093318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8069c114-fd12-4b90-8a19-73eb0b6fedd9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:03.094578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8069c114-fd12-4b90-8a19-73eb0b6fedd9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:03.096615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8069c114-fd12-4b90-8a19-73eb0b6fedd9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:03.098336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8069c114-fd12-4b90-8a19-73eb0b6fedd9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:03.672759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8069c114-fd12-4b90-8a19-73eb0b6fedd9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:03.697064 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8069c114-fd12-4b90-8a19-73eb0b6fedd9 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1498 microversion: 2.1 time: 0.624635 Jul 26 14:11:03.702695 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 828/1546] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:03 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1498 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:03.727606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bce5f5aa-7af2-4704-a65b-9cf4828e4dd9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:03.729265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bce5f5aa-7af2-4704-a65b-9cf4828e4dd9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:03.736258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-c2b0a324-bbe8-4f0b-809c-a9f7ad0c26a7 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 38cbff42-6659-4317-bf61-7f5f2aaaa942 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:11:03.741760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bce5f5aa-7af2-4704-a65b-9cf4828e4dd9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:03.749557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bce5f5aa-7af2-4704-a65b-9cf4828e4dd9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:03.753725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bce5f5aa-7af2-4704-a65b-9cf4828e4dd9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:03.757381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bce5f5aa-7af2-4704-a65b-9cf4828e4dd9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:03.816065 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c2b0a324-bbe8-4f0b-809c-a9f7ad0c26a7 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 2420 microversion: 2.25 time: 0.916047 Jul 26 14:11:03.819773 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 719/1547] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:02 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 2420 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:03.830344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af0b3edd-f7ef-4d3d-9e51-4495393ad805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:03.866467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-af0b3edd-f7ef-4d3d-9e51-4495393ad805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:03.870427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-af0b3edd-f7ef-4d3d-9e51-4495393ad805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:11:03.914770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af0b3edd-f7ef-4d3d-9e51-4495393ad805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:03.916080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af0b3edd-f7ef-4d3d-9e51-4495393ad805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:03.917219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af0b3edd-f7ef-4d3d-9e51-4495393ad805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:03.917859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af0b3edd-f7ef-4d3d-9e51-4495393ad805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:04.093355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bce5f5aa-7af2-4704-a65b-9cf4828e4dd9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:04.112275 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bce5f5aa-7af2-4704-a65b-9cf4828e4dd9 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1275 microversion: 2.1 time: 0.407167 Jul 26 14:11:04.118800 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 829/1548] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:03 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1275 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:04.155751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a6c9a2f9-8e6b-4a2b-8d89-388bf0dbead5 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8794373af0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:04.264070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-af0b3edd-f7ef-4d3d-9e51-4495393ad805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:11:04.378917 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a6c9a2f9-8e6b-4a2b-8d89-388bf0dbead5 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.252853 Jul 26 14:11:04.384006 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 830/1549] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:11:04 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:04.417648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3ccd3009-0fd7-4c98-a61c-a3e17a18d5ac tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:04.421052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3ccd3009-0fd7-4c98-a61c-a3e17a18d5ac tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:04.437371 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af0b3edd-f7ef-4d3d-9e51-4495393ad805 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.615978 Jul 26 14:11:04.439197 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 720/1550] 10.222.0.70 () {58 vars in 1154 bytes} [Tue Jul 26 14:11:03 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:04.445364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c69f11b6-6a4f-46fd-bc58-4c482a9e1938 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:04.446416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c69f11b6-6a4f-46fd-bc58-4c482a9e1938 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:04.457270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c69f11b6-6a4f-46fd-bc58-4c482a9e1938 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:04.458516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c69f11b6-6a4f-46fd-bc58-4c482a9e1938 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:04.475685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c69f11b6-6a4f-46fd-bc58-4c482a9e1938 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:04.476968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c69f11b6-6a4f-46fd-bc58-4c482a9e1938 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:04.515428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ccd3009-0fd7-4c98-a61c-a3e17a18d5ac tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:04.516786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ccd3009-0fd7-4c98-a61c-a3e17a18d5ac tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:04.522942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ccd3009-0fd7-4c98-a61c-a3e17a18d5ac tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:04.523814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ccd3009-0fd7-4c98-a61c-a3e17a18d5ac tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:05.481186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-3ccd3009-0fd7-4c98-a61c-a3e17a18d5ac tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid 38cbff42-6659-4317-bf61-7f5f2aaaa942 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:11:05.548671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3ccd3009-0fd7-4c98-a61c-a3e17a18d5ac tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 2420 microversion: 2.25 time: 1.154332 Jul 26 14:11:05.549357 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 831/1551] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:04 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 2420 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:05.568965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-318e9e67-05e0-4f86-a289-78bde3a7702e req-9a63eaea-71c3-47c7-b0a3-7f466fb718ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "tag": "995b58f3-2d21-4838-b5f8-d2d38a7e67b6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:05.605023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-318e9e67-05e0-4f86-a289-78bde3a7702e req-9a63eaea-71c3-47c7-b0a3-7f466fb718ab service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:05.605835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-318e9e67-05e0-4f86-a289-78bde3a7702e req-9a63eaea-71c3-47c7-b0a3-7f466fb718ab service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:05.679544 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-318e9e67-05e0-4f86-a289-78bde3a7702e req-9a63eaea-71c3-47c7-b0a3-7f466fb718ab service nova] Creating event network-changed:995b58f3-2d21-4838-b5f8-d2d38a7e67b6 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:11:05.714885 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-318e9e67-05e0-4f86-a289-78bde3a7702e req-9a63eaea-71c3-47c7-b0a3-7f466fb718ab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154674 Jul 26 14:11:05.717432 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 832/1552] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:05.750721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-67a27911-68d2-474c-bde8-76f1ddf10a7c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:05.789535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67a27911-68d2-474c-bde8-76f1ddf10a7c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:05.790584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67a27911-68d2-474c-bde8-76f1ddf10a7c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:05.847690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-67a27911-68d2-474c-bde8-76f1ddf10a7c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Going to try to start instance {{(pid=119479) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 14:11:05.952473 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-67a27911-68d2-474c-bde8-76f1ddf10a7c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "POST /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b/action" status: 202 len: 0 microversion: 2.1 time: 0.232078 Jul 26 14:11:05.962071 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 833/1553] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:11:05 2022] POST /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:11:05.979676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cd435ef9-e182-4ede-b164-0b12b95596ca tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:05.982603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cd435ef9-e182-4ede-b164-0b12b95596ca tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:06.004803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd435ef9-e182-4ede-b164-0b12b95596ca tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:06.006285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd435ef9-e182-4ede-b164-0b12b95596ca tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:06.008219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd435ef9-e182-4ede-b164-0b12b95596ca tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:06.009303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd435ef9-e182-4ede-b164-0b12b95596ca tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:06.041246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c69f11b6-6a4f-46fd-bc58-4c482a9e1938 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:06.125788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c69f11b6-6a4f-46fd-bc58-4c482a9e1938 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:06.155348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c69f11b6-6a4f-46fd-bc58-4c482a9e1938 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:06.161740 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c69f11b6-6a4f-46fd-bc58-4c482a9e1938 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1869 microversion: 2.42 time: 1.718302 Jul 26 14:11:06.205845 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 721/1554] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:04 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1869 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:06.237385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0ff95277-05bf-4adc-8cfd-32f209c86194 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787bedc10>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:06.423788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cd435ef9-e182-4ede-b164-0b12b95596ca tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:06.435979 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0ff95277-05bf-4adc-8cfd-32f209c86194 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.225797 Jul 26 14:11:06.452487 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 722/1555] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:11:06 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:06.472184 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cd435ef9-e182-4ede-b164-0b12b95596ca tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1275 microversion: 2.1 time: 0.503868 Jul 26 14:11:06.472787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-318253a9-f4b6-4179-be45-145752ca70eb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:06.487766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-318253a9-f4b6-4179-be45-145752ca70eb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:06.488713 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 834/1556] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:05 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1275 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:06.522407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ff4d63ae-ab9c-4755-91e6-f4c0fff3897c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:06.524235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ff4d63ae-ab9c-4755-91e6-f4c0fff3897c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:06.525110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-318253a9-f4b6-4179-be45-145752ca70eb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:06.525804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-318253a9-f4b6-4179-be45-145752ca70eb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:06.527029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-318253a9-f4b6-4179-be45-145752ca70eb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:06.527859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-318253a9-f4b6-4179-be45-145752ca70eb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:06.547051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff4d63ae-ab9c-4755-91e6-f4c0fff3897c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:06.547726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff4d63ae-ab9c-4755-91e6-f4c0fff3897c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:06.549241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff4d63ae-ab9c-4755-91e6-f4c0fff3897c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:06.550038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff4d63ae-ab9c-4755-91e6-f4c0fff3897c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:07.027340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-318253a9-f4b6-4179-be45-145752ca70eb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lazy-loading 'services' on Instance uuid 38cbff42-6659-4317-bf61-7f5f2aaaa942 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:11:07.407543 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-318253a9-f4b6-4179-be45-145752ca70eb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments/f0d85cd5-c448-4735-becc-d3a1bddda949" status: 202 len: 0 microversion: 2.25 time: 0.949766 Jul 26 14:11:07.413113 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 723/1557] 10.222.0.70 () {60 vars in 1457 bytes} [Tue Jul 26 14:11:06 2022] DELETE /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments/f0d85cd5-c448-4735-becc-d3a1bddda949 => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:11:07.428648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-53b455e2-b50d-4e9b-8427-4e7aa499e824 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:07.429790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-53b455e2-b50d-4e9b-8427-4e7aa499e824 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:07.452701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:07.461884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53b455e2-b50d-4e9b-8427-4e7aa499e824 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:07.462919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53b455e2-b50d-4e9b-8427-4e7aa499e824 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:07.471001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53b455e2-b50d-4e9b-8427-4e7aa499e824 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:07.472218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53b455e2-b50d-4e9b-8427-4e7aa499e824 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:07.588891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:07.690874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:08.379144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ff4d63ae-ab9c-4755-91e6-f4c0fff3897c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:08.429487 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ff4d63ae-ab9c-4755-91e6-f4c0fff3897c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1507 microversion: 2.1 time: 1.938603 Jul 26 14:11:08.430419 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 835/1558] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:06 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1507 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:08.443253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9e12c11-3788-493e-9ed6-86ab09e79f6f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:08.452511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b9e12c11-3788-493e-9ed6-86ab09e79f6f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:08.458192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=70 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:08.475756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9e12c11-3788-493e-9ed6-86ab09e79f6f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:08.485080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9e12c11-3788-493e-9ed6-86ab09e79f6f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:08.489230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9e12c11-3788-493e-9ed6-86ab09e79f6f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:08.490222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9e12c11-3788-493e-9ed6-86ab09e79f6f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:08.659430 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b9e12c11-3788-493e-9ed6-86ab09e79f6f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.227095 Jul 26 14:11:08.670757 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 836/1559] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:11:08 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:11:08.680088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-597f8907-9fc5-417d-9976-f77618d00b9d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8796a15d30>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:08.801896 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-597f8907-9fc5-417d-9976-f77618d00b9d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.125373 Jul 26 14:11:08.805941 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 837/1560] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:11:08 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:08.821742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2355cef1-bf69-4b0e-acb1-423fd4c7d1fa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:08.827442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2355cef1-bf69-4b0e-acb1-423fd4c7d1fa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:08.843546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2355cef1-bf69-4b0e-acb1-423fd4c7d1fa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:08.847292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2355cef1-bf69-4b0e-acb1-423fd4c7d1fa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:08.848731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2355cef1-bf69-4b0e-acb1-423fd4c7d1fa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:08.857586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2355cef1-bf69-4b0e-acb1-423fd4c7d1fa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:09.481794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-53b455e2-b50d-4e9b-8427-4e7aa499e824 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:09.516841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-53b455e2-b50d-4e9b-8427-4e7aa499e824 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:09.527350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-53b455e2-b50d-4e9b-8427-4e7aa499e824 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:09.534992 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-53b455e2-b50d-4e9b-8427-4e7aa499e824 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1890 microversion: 2.42 time: 2.119793 Jul 26 14:11:09.540419 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 724/1561] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:07 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1890 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:09.556754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-46e93534-ccd6-46bf-b9e0-6bde3de0c710 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:09.562163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-46e93534-ccd6-46bf-b9e0-6bde3de0c710 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:09.585462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46e93534-ccd6-46bf-b9e0-6bde3de0c710 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:09.588762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46e93534-ccd6-46bf-b9e0-6bde3de0c710 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:09.591870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46e93534-ccd6-46bf-b9e0-6bde3de0c710 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:09.593946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46e93534-ccd6-46bf-b9e0-6bde3de0c710 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:09.701300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:10.378915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:11.286102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2355cef1-bf69-4b0e-acb1-423fd4c7d1fa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:11.330250 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2355cef1-bf69-4b0e-acb1-423fd4c7d1fa tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1317 microversion: 2.1 time: 2.522125 Jul 26 14:11:11.359602 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 838/1562] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:08 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1317 bytes in 2552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:11.381786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-660face6-6964-42f7-996d-173268007082 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:11.395877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-660face6-6964-42f7-996d-173268007082 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:11.424785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-660face6-6964-42f7-996d-173268007082 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:11.425630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-660face6-6964-42f7-996d-173268007082 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:11.426677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-660face6-6964-42f7-996d-173268007082 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:11.427391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-660face6-6964-42f7-996d-173268007082 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:11.601450 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-660face6-6964-42f7-996d-173268007082 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.239332 Jul 26 14:11:11.614768 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 839/1563] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:11:11 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:11:11.632371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-722dc8e6-b311-400f-9786-2324f19cb64c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87946e8430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:11.770211 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-722dc8e6-b311-400f-9786-2324f19cb64c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.153687 Jul 26 14:11:11.780331 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 840/1564] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:11:11 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:11.788619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95cd5875-4056-4f0a-a069-9f870e0d7fde tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:11.797293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95cd5875-4056-4f0a-a069-9f870e0d7fde tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:11.819502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95cd5875-4056-4f0a-a069-9f870e0d7fde tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:11.834181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95cd5875-4056-4f0a-a069-9f870e0d7fde tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:11.836251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95cd5875-4056-4f0a-a069-9f870e0d7fde tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:11.837346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95cd5875-4056-4f0a-a069-9f870e0d7fde tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:13.446325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-46e93534-ccd6-46bf-b9e0-6bde3de0c710 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:13.473932 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-46e93534-ccd6-46bf-b9e0-6bde3de0c710 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1507 microversion: 2.1 time: 3.930349 Jul 26 14:11:13.476594 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 725/1565] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:09 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1507 bytes in 3935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:13.493590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b8eaa73c-4b33-4f95-a088-32599518328e req-d31b3cfc-1d57-44e8-b658-df1e492d1f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "tag": "3669b3fd-06c9-4344-9f7e-41276ab83aa8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:13.536810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b8eaa73c-4b33-4f95-a088-32599518328e req-d31b3cfc-1d57-44e8-b658-df1e492d1f25 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:13.540343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b8eaa73c-4b33-4f95-a088-32599518328e req-d31b3cfc-1d57-44e8-b658-df1e492d1f25 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:13.655868 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b8eaa73c-4b33-4f95-a088-32599518328e req-d31b3cfc-1d57-44e8-b658-df1e492d1f25 service nova] Creating event network-changed:3669b3fd-06c9-4344-9f7e-41276ab83aa8 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:11:13.721554 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b8eaa73c-4b33-4f95-a088-32599518328e req-d31b3cfc-1d57-44e8-b658-df1e492d1f25 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235291 Jul 26 14:11:13.726455 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 726/1566] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:13.853357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1528a8a7-770f-4682-877a-b485b8cd8e57 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:13.863651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1528a8a7-770f-4682-877a-b485b8cd8e57 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:13.948590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1528a8a7-770f-4682-877a-b485b8cd8e57 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:13.949071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1528a8a7-770f-4682-877a-b485b8cd8e57 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:13.960831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1528a8a7-770f-4682-877a-b485b8cd8e57 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:13.971231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1528a8a7-770f-4682-877a-b485b8cd8e57 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:14.078881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:16.110175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-95cd5875-4056-4f0a-a069-9f870e0d7fde tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:16.124254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:16.221717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-95cd5875-4056-4f0a-a069-9f870e0d7fde tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:16.281736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-95cd5875-4056-4f0a-a069-9f870e0d7fde tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:16.286349 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95cd5875-4056-4f0a-a069-9f870e0d7fde tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1890 microversion: 2.42 time: 4.503268 Jul 26 14:11:16.299203 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 841/1567] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:11 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1890 bytes in 4518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:16.342046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e20db515-40c8-4314-a469-be62a830db7c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:16.347993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e20db515-40c8-4314-a469-be62a830db7c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:16.414349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e20db515-40c8-4314-a469-be62a830db7c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:16.420333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e20db515-40c8-4314-a469-be62a830db7c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:16.422217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e20db515-40c8-4314-a469-be62a830db7c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:16.423293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e20db515-40c8-4314-a469-be62a830db7c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:16.681778 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e20db515-40c8-4314-a469-be62a830db7c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.378638 Jul 26 14:11:16.683674 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 842/1568] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:11:16 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments => generated 197 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:11:16.714645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-833a1f09-9983-4485-a975-5ca49b51fae4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f879437b0d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:16.920472 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-833a1f09-9983-4485-a975-5ca49b51fae4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1454 microversion: 2.1 time: 0.235141 Jul 26 14:11:16.924778 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 843/1569] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:11:16 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1454 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:16.953425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f11ad649-dae1-43ba-af30-0a1ffb7083bf tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:16.954577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f11ad649-dae1-43ba-af30-0a1ffb7083bf tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:16.987738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f11ad649-dae1-43ba-af30-0a1ffb7083bf tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:16.993844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f11ad649-dae1-43ba-af30-0a1ffb7083bf tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:16.995722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f11ad649-dae1-43ba-af30-0a1ffb7083bf tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:17.008654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f11ad649-dae1-43ba-af30-0a1ffb7083bf tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:18.741320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1528a8a7-770f-4682-877a-b485b8cd8e57 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:18.765672 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1528a8a7-770f-4682-877a-b485b8cd8e57 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1317 microversion: 2.1 time: 5.037236 Jul 26 14:11:18.777544 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 727/1570] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:13 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1317 bytes in 5051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:18.784683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3174bdc8-6f3d-4ddf-875e-1859d25d7c05 req-ad6fbf67-750b-4dcb-91dc-c4c961ef2ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c22c8fd-b9fb-4fff-9571-4f3013ea9114", "tag": "1b25f608-868a-4c1e-92e5-13cdf2d63821"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:18.814254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3174bdc8-6f3d-4ddf-875e-1859d25d7c05 req-ad6fbf67-750b-4dcb-91dc-c4c961ef2ac9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:18.814795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3174bdc8-6f3d-4ddf-875e-1859d25d7c05 req-ad6fbf67-750b-4dcb-91dc-c4c961ef2ac9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:18.855939 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3174bdc8-6f3d-4ddf-875e-1859d25d7c05 req-ad6fbf67-750b-4dcb-91dc-c4c961ef2ac9 service nova] Creating event network-changed:1b25f608-868a-4c1e-92e5-13cdf2d63821 for instance 2c22c8fd-b9fb-4fff-9571-4f3013ea9114 on n-h1-833090-9 Jul 26 14:11:18.876787 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3174bdc8-6f3d-4ddf-875e-1859d25d7c05 req-ad6fbf67-750b-4dcb-91dc-c4c961ef2ac9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097121 Jul 26 14:11:18.878096 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 728/1571] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:18.886459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d7afaeb-a54e-4f3b-bb80-d951c0db6bfc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:18.887417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6d7afaeb-a54e-4f3b-bb80-d951c0db6bfc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:18.924107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d7afaeb-a54e-4f3b-bb80-d951c0db6bfc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:18.928401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d7afaeb-a54e-4f3b-bb80-d951c0db6bfc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:18.930299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d7afaeb-a54e-4f3b-bb80-d951c0db6bfc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:18.934288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d7afaeb-a54e-4f3b-bb80-d951c0db6bfc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:19.883713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f11ad649-dae1-43ba-af30-0a1ffb7083bf tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:19.930540 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f11ad649-dae1-43ba-af30-0a1ffb7083bf tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1511 microversion: 2.1 time: 2.994588 Jul 26 14:11:19.932574 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 844/1572] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:16 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1511 bytes in 3001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:19.968811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-985667bc-41aa-40fa-b3af-2868dfd21db1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:19.980398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-985667bc-41aa-40fa-b3af-2868dfd21db1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:20.018891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-985667bc-41aa-40fa-b3af-2868dfd21db1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:20.025758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-985667bc-41aa-40fa-b3af-2868dfd21db1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:20.028062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-985667bc-41aa-40fa-b3af-2868dfd21db1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:20.029136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-985667bc-41aa-40fa-b3af-2868dfd21db1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:20.136708 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-985667bc-41aa-40fa-b3af-2868dfd21db1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.195473 Jul 26 14:11:20.138753 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 845/1573] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:11:19 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:11:20.145594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-68a9a612-0088-4d59-90a1-b1498cd062b0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8794627040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:20.235699 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-68a9a612-0088-4d59-90a1-b1498cd062b0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1463 microversion: 2.1 time: 0.094188 Jul 26 14:11:20.244508 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 846/1574] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:11:20 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1463 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:20.641856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d7afaeb-a54e-4f3b-bb80-d951c0db6bfc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:20.682565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d7afaeb-a54e-4f3b-bb80-d951c0db6bfc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:20.694079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d7afaeb-a54e-4f3b-bb80-d951c0db6bfc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:20.702341 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6d7afaeb-a54e-4f3b-bb80-d951c0db6bfc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.816498 Jul 26 14:11:20.703499 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 729/1575] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:18 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:20.734664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6755b24f-3c2b-44b9-aa20-943862c88922 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:20.745104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6755b24f-3c2b-44b9-aa20-943862c88922 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:20.772105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6755b24f-3c2b-44b9-aa20-943862c88922 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:20.778870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6755b24f-3c2b-44b9-aa20-943862c88922 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:20.785664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6755b24f-3c2b-44b9-aa20-943862c88922 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:20.786552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6755b24f-3c2b-44b9-aa20-943862c88922 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:20.803475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-125afe33-2dc9-443b-9da4-2fbe09419a59 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Action: 'update', calling method: .version_select at 0x7f8787bf1dc0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:20.807010 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:20.807010 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:11:20.815997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-125afe33-2dc9-443b-9da4-2fbe09419a59 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:20.817009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-125afe33-2dc9-443b-9da4-2fbe09419a59 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:20.834090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-125afe33-2dc9-443b-9da4-2fbe09419a59 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:20.835628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-125afe33-2dc9-443b-9da4-2fbe09419a59 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:20.853894 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-125afe33-2dc9-443b-9da4-2fbe09419a59 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] HTTP exception thrown: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-125afe33-2dc9-443b-9da4-2fbe09419a59 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Request method failure captured: Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/os-services/277d747f-9934-414f-bdbb-b9f50413a34d HTTP/1.1 Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 56 Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_YGcXZBhGqIX51pB-8jof1Xq8muU1e7uwhD7j8jrywvkMIvZUgniu-UDqVVPmKL6SllobD9hC4B3A4oakABxV4p3essDwBLZ1Adw0eDCYQtZa1rZE2lYIfsr334kua7dp30ciW6wEkYCy1dMOIg_cFx2xM1FbQK7b5teIo8lnndb6A Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 32d31c3d2b474d0c9440a55b76e2e897 Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-455412497 Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/32d31c3d2b474d0c9440a55b76e2e897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/32d31c3d2b474d0c9440a55b76e2e897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_32d31c3d2b474d0c9440a55b76e2e897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/32d31c3d2b474d0c9440a55b76e2e897"}]}] Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-455412497 Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 32d31c3d2b474d0c9440a55b76e2e897 Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-455412497 Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 153a8aefffbc4bf6a336f98754410e3c Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: exception: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '277d747f-9934-414f-bdbb-b9f50413a34d', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:11:20.860899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-125afe33-2dc9-443b-9da4-2fbe09419a59 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Returning 404 to user: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:11:20.866627 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-125afe33-2dc9-443b-9da4-2fbe09419a59 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/277d747f-9934-414f-bdbb-b9f50413a34d" status: 404 len: 110 microversion: 2.53 time: 0.619343 Jul 26 14:11:20.876271 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 847/1576] 10.222.0.70 () {62 vars in 1309 bytes} [Tue Jul 26 14:11:20 2022] PUT /compute/v2.1/os-services/277d747f-9934-414f-bdbb-b9f50413a34d => generated 110 bytes in 630 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:11:20.893699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b38eade-ac81-4f91-a4a1-9ca55ef015a6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:20.899803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4b38eade-ac81-4f91-a4a1-9ca55ef015a6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:20.907543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.servers [None req-4b38eade-ac81-4f91-a4a1-9ca55ef015a6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Removing options 'limit' from query {{(pid=119479) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 14:11:20.908668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4b38eade-ac81-4f91-a4a1-9ca55ef015a6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:11:20.910696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b38eade-ac81-4f91-a4a1-9ca55ef015a6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:20.914436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b38eade-ac81-4f91-a4a1-9ca55ef015a6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:20.916715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b38eade-ac81-4f91-a4a1-9ca55ef015a6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:20.917394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b38eade-ac81-4f91-a4a1-9ca55ef015a6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:20.920142 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4b38eade-ac81-4f91-a4a1-9ca55ef015a6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.042026 Jul 26 14:11:20.923309 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 848/1577] 10.222.0.70 () {58 vars in 1140 bytes} [Tue Jul 26 14:11:20 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:11:20.940045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5e4dc120-bc3e-4605-8b3d-0f6643aea23e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787fcbdc0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:21.055005 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5e4dc120-bc3e-4605-8b3d-0f6643aea23e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 200 len: 1463 microversion: 2.1 time: 0.127304 Jul 26 14:11:21.069556 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 849/1578] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:11:20 2022] GET /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 1463 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:21.092399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-92269b2d-d688-4d9b-b19e-18e9bb6abdd0 req-d068ce1b-6b47-4609-8920-3502a6a0153f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "tag": "db84c629-f002-4e47-a54a-944c2e55a5d7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:21.134492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-92269b2d-d688-4d9b-b19e-18e9bb6abdd0 req-d068ce1b-6b47-4609-8920-3502a6a0153f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:21.138251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-92269b2d-d688-4d9b-b19e-18e9bb6abdd0 req-d068ce1b-6b47-4609-8920-3502a6a0153f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:21.206789 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-92269b2d-d688-4d9b-b19e-18e9bb6abdd0 req-d068ce1b-6b47-4609-8920-3502a6a0153f service nova] Creating event network-changed:db84c629-f002-4e47-a54a-944c2e55a5d7 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:11:21.222689 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-92269b2d-d688-4d9b-b19e-18e9bb6abdd0 req-d068ce1b-6b47-4609-8920-3502a6a0153f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157916 Jul 26 14:11:21.223359 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 850/1579] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:21.238614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d87d226-95b0-4dcc-a3b2-693efd407438 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Action: 'update', calling method: .version_select at 0x7f879437b9d0>, body: {"status": "disabled"} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:21.268087 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:21.268087 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:11:21.276350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d87d226-95b0-4dcc-a3b2-693efd407438 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:21.277311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d87d226-95b0-4dcc-a3b2-693efd407438 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:21.303971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d87d226-95b0-4dcc-a3b2-693efd407438 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:21.305193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d87d226-95b0-4dcc-a3b2-693efd407438 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:21.319672 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-4d87d226-95b0-4dcc-a3b2-693efd407438 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] HTTP exception thrown: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d87d226-95b0-4dcc-a3b2-693efd407438 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Request method failure captured: Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/os-services/277d747f-9934-414f-bdbb-b9f50413a34d HTTP/1.1 Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 22 Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_YGcXZBhGqIX51pB-8jof1Xq8muU1e7uwhD7j8jrywvkMIvZUgniu-UDqVVPmKL6SllobD9hC4B3A4oakABxV4p3essDwBLZ1Adw0eDCYQtZa1rZE2lYIfsr334kua7dp30ciW6wEkYCy1dMOIg_cFx2xM1FbQK7b5teIo8lnndb6A Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 32d31c3d2b474d0c9440a55b76e2e897 Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-455412497 Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/32d31c3d2b474d0c9440a55b76e2e897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/32d31c3d2b474d0c9440a55b76e2e897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_32d31c3d2b474d0c9440a55b76e2e897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/32d31c3d2b474d0c9440a55b76e2e897"}]}] Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-455412497 Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 32d31c3d2b474d0c9440a55b76e2e897 Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-455412497 Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 153a8aefffbc4bf6a336f98754410e3c Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: {"status": "disabled"} Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: exception: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '277d747f-9934-414f-bdbb-b9f50413a34d', 'body': {'status': 'disabled'}} Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:11:21.324671 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:21.335587 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:11:21.339916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d87d226-95b0-4dcc-a3b2-693efd407438 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Returning 404 to user: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:11:21.341749 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d87d226-95b0-4dcc-a3b2-693efd407438 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/277d747f-9934-414f-bdbb-b9f50413a34d" status: 404 len: 110 microversion: 2.53 time: 0.116288 Jul 26 14:11:21.343447 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 851/1580] 10.222.0.70 () {62 vars in 1309 bytes} [Tue Jul 26 14:11:21 2022] PUT /compute/v2.1/os-services/277d747f-9934-414f-bdbb-b9f50413a34d => generated 110 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:11:21.364867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-232cd7ba-d407-4d23-a44b-0b7838b83ee3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:21.367797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-232cd7ba-d407-4d23-a44b-0b7838b83ee3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:21.399811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-232cd7ba-d407-4d23-a44b-0b7838b83ee3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:21.400991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-232cd7ba-d407-4d23-a44b-0b7838b83ee3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:21.405248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-232cd7ba-d407-4d23-a44b-0b7838b83ee3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:21.405804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-232cd7ba-d407-4d23-a44b-0b7838b83ee3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:22.216148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-232cd7ba-d407-4d23-a44b-0b7838b83ee3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:22.227247 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-232cd7ba-d407-4d23-a44b-0b7838b83ee3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1511 microversion: 2.1 time: 0.881828 Jul 26 14:11:22.234910 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 852/1581] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:21 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1511 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:22.253738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-65df5d23-ed80-43ed-b178-069e2c940dc4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:22.254761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-65df5d23-ed80-43ed-b178-069e2c940dc4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:22.264023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65df5d23-ed80-43ed-b178-069e2c940dc4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:22.265428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65df5d23-ed80-43ed-b178-069e2c940dc4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:22.267075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65df5d23-ed80-43ed-b178-069e2c940dc4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:22.267887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65df5d23-ed80-43ed-b178-069e2c940dc4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:22.344155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6755b24f-3c2b-44b9-aa20-943862c88922 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:22.365054 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6755b24f-3c2b-44b9-aa20-943862c88922 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1317 microversion: 2.1 time: 1.655596 Jul 26 14:11:22.381326 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 730/1582] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:20 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1317 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:22.394256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05572647-ee33-4939-a2b6-64c7ccf97095 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:22.397844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05572647-ee33-4939-a2b6-64c7ccf97095 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:22.413513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05572647-ee33-4939-a2b6-64c7ccf97095 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:22.414535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05572647-ee33-4939-a2b6-64c7ccf97095 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:22.416405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05572647-ee33-4939-a2b6-64c7ccf97095 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:22.417299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05572647-ee33-4939-a2b6-64c7ccf97095 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:22.535901 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05572647-ee33-4939-a2b6-64c7ccf97095 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.153203 Jul 26 14:11:22.536879 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 731/1583] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:11:22 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:11:22.551071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-285d40ef-589f-4dc8-a99e-9710633e1f6a tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Action: 'update', calling method: .version_select at 0x7f8787c1e280>, body: {"status": "enabled"} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:22.556031 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:22.556031 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:11:22.559814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-285d40ef-589f-4dc8-a99e-9710633e1f6a tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:22.561763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-285d40ef-589f-4dc8-a99e-9710633e1f6a tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:22.577712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-285d40ef-589f-4dc8-a99e-9710633e1f6a tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:22.578592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-285d40ef-589f-4dc8-a99e-9710633e1f6a tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:22.596060 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-285d40ef-589f-4dc8-a99e-9710633e1f6a tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] HTTP exception thrown: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-285d40ef-589f-4dc8-a99e-9710633e1f6a tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Request method failure captured: Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: request: PUT /compute/v2.1/os-services/277d747f-9934-414f-bdbb-b9f50413a34d HTTP/1.1 Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 21 Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_YGcXZBhGqIX51pB-8jof1Xq8muU1e7uwhD7j8jrywvkMIvZUgniu-UDqVVPmKL6SllobD9hC4B3A4oakABxV4p3essDwBLZ1Adw0eDCYQtZa1rZE2lYIfsr334kua7dp30ciW6wEkYCy1dMOIg_cFx2xM1FbQK7b5teIo8lnndb6A Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 32d31c3d2b474d0c9440a55b76e2e897 Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-455412497 Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/32d31c3d2b474d0c9440a55b76e2e897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/32d31c3d2b474d0c9440a55b76e2e897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_32d31c3d2b474d0c9440a55b76e2e897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/32d31c3d2b474d0c9440a55b76e2e897"}]}] Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-455412497 Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 32d31c3d2b474d0c9440a55b76e2e897 Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-455412497 Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 153a8aefffbc4bf6a336f98754410e3c Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: {"status": "enabled"} Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: exception: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '277d747f-9934-414f-bdbb-b9f50413a34d', 'body': {'status': 'enabled'}} Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:11:22.599638 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:22.607052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-285d40ef-589f-4dc8-a99e-9710633e1f6a tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Returning 404 to user: Service 277d747f-9934-414f-bdbb-b9f50413a34d could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:11:22.610250 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-285d40ef-589f-4dc8-a99e-9710633e1f6a tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/277d747f-9934-414f-bdbb-b9f50413a34d" status: 404 len: 110 microversion: 2.53 time: 0.067902 Jul 26 14:11:22.611771 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 732/1584] 10.222.0.70 () {62 vars in 1309 bytes} [Tue Jul 26 14:11:22 2022] PUT /compute/v2.1/os-services/277d747f-9934-414f-bdbb-b9f50413a34d => generated 110 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:11:22.620832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c9e0c27-0e9f-42eb-b440-995333c0f3fc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:22.622285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c9e0c27-0e9f-42eb-b440-995333c0f3fc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:22.633225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c9e0c27-0e9f-42eb-b440-995333c0f3fc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:22.635733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c9e0c27-0e9f-42eb-b440-995333c0f3fc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:22.637903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c9e0c27-0e9f-42eb-b440-995333c0f3fc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:22.638881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c9e0c27-0e9f-42eb-b440-995333c0f3fc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:23.418066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-65df5d23-ed80-43ed-b178-069e2c940dc4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:23.437123 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-65df5d23-ed80-43ed-b178-069e2c940dc4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2" status: 200 len: 1468 microversion: 2.1 time: 1.199693 Jul 26 14:11:23.440948 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 853/1585] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:22 2022] GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2 => generated 1468 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:23.455553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d0b673b-af4e-4cb3-903e-bf2251a99166 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:23.466055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2d0b673b-af4e-4cb3-903e-bf2251a99166 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 54be76f6-dd14-406f-8f42-ed989a168646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:23.474621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d0b673b-af4e-4cb3-903e-bf2251a99166 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:23.475685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d0b673b-af4e-4cb3-903e-bf2251a99166 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:23.476690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d0b673b-af4e-4cb3-903e-bf2251a99166 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:23.477300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d0b673b-af4e-4cb3-903e-bf2251a99166 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:23.784595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c9e0c27-0e9f-42eb-b440-995333c0f3fc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:23.814635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c9e0c27-0e9f-42eb-b440-995333c0f3fc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:23.816324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c9e0c27-0e9f-42eb-b440-995333c0f3fc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:23.817542 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2c9e0c27-0e9f-42eb-b440-995333c0f3fc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.204117 Jul 26 14:11:23.818089 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 733/1586] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:22 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:23.828938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b008ac58-c486-4b07-8112-bc03de7f1ecf tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:23.831492 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:23.831492 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:11:23.842990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b008ac58-c486-4b07-8112-bc03de7f1ecf tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:23.846095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b008ac58-c486-4b07-8112-bc03de7f1ecf tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:23.847651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b008ac58-c486-4b07-8112-bc03de7f1ecf tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:23.850179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b008ac58-c486-4b07-8112-bc03de7f1ecf tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:23.922282 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b008ac58-c486-4b07-8112-bc03de7f1ecf tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.100642 Jul 26 14:11:23.923290 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 734/1587] 10.222.0.70 () {60 vars in 1178 bytes} [Tue Jul 26 14:11:23 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:23.935263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f38ba320-26ed-446b-9c84-fb05d77d6c5f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:23.936233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f38ba320-26ed-446b-9c84-fb05d77d6c5f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:23.944014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f38ba320-26ed-446b-9c84-fb05d77d6c5f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:23.944711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f38ba320-26ed-446b-9c84-fb05d77d6c5f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:23.945810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f38ba320-26ed-446b-9c84-fb05d77d6c5f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:23.947018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f38ba320-26ed-446b-9c84-fb05d77d6c5f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:24.144717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2d0b673b-af4e-4cb3-903e-bf2251a99166 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:24.161266 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d0b673b-af4e-4cb3-903e-bf2251a99166 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646" status: 200 len: 1512 microversion: 2.1 time: 0.711844 Jul 26 14:11:24.161865 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 854/1588] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:23 2022] GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646 => generated 1512 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:24.168692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ef5efdf-1c53-4072-925f-b737549efa3f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8794373a60>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:24.339828 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ef5efdf-1c53-4072-925f-b737549efa3f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images?changes-since=2022-07-26T14%3A08%3A32Z" status: 200 len: 1900 microversion: 2.1 time: 0.176678 Jul 26 14:11:24.341108 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 855/1589] 10.222.0.70 () {58 vars in 1199 bytes} [Tue Jul 26 14:11:24 2022] GET /compute/v2.1/images?changes-since=2022-07-26T14%3A08%3A32Z => generated 1900 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:24.348169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32f3ecda-77d2-4c44-9282-b5243ff4a94f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:24.366132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32f3ecda-77d2-4c44-9282-b5243ff4a94f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:24.377738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32f3ecda-77d2-4c44-9282-b5243ff4a94f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:24.378740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32f3ecda-77d2-4c44-9282-b5243ff4a94f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:24.380069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32f3ecda-77d2-4c44-9282-b5243ff4a94f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:24.381787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32f3ecda-77d2-4c44-9282-b5243ff4a94f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:24.454160 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-32f3ecda-77d2-4c44-9282-b5243ff4a94f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.102212 Jul 26 14:11:24.457621 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 856/1590] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:11:24 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:24.474835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2ef82129-7b32-484d-af3b-429b8c7f70d3 req-7d5bc7e7-d7ef-4fa2-9072-f7f846adbaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d38f13-5f5e-4574-b415-d21bb454b9d2", "name": "network-vif-unplugged", "status": "completed", "tag": "133fb10c-c93f-49e6-9134-3165e0e34866"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:24.486710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2ef82129-7b32-484d-af3b-429b8c7f70d3 req-7d5bc7e7-d7ef-4fa2-9072-f7f846adbaf9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:24.488508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2ef82129-7b32-484d-af3b-429b8c7f70d3 req-7d5bc7e7-d7ef-4fa2-9072-f7f846adbaf9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:24.506985 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2ef82129-7b32-484d-af3b-429b8c7f70d3 req-7d5bc7e7-d7ef-4fa2-9072-f7f846adbaf9 service nova] Creating event network-vif-unplugged:133fb10c-c93f-49e6-9134-3165e0e34866 for instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 on n-h2-833090-9 Jul 26 14:11:24.513969 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2ef82129-7b32-484d-af3b-429b8c7f70d3 req-7d5bc7e7-d7ef-4fa2-9072-f7f846adbaf9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054842 Jul 26 14:11:24.514763 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 857/1591] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:24.523445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0816a281-1442-4d81-a523-171862d5db4c tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:24.528816 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:24.528816 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:11:24.531565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0816a281-1442-4d81-a523-171862d5db4c tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:24.532730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0816a281-1442-4d81-a523-171862d5db4c tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:24.534475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0816a281-1442-4d81-a523-171862d5db4c tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:24.535872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0816a281-1442-4d81-a523-171862d5db4c tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:24.564906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f38ba320-26ed-446b-9c84-fb05d77d6c5f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:24.596106 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f38ba320-26ed-446b-9c84-fb05d77d6c5f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1317 microversion: 2.1 time: 0.662311 Jul 26 14:11:24.597682 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 735/1592] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:23 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:24.605224 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0816a281-1442-4d81-a523-171862d5db4c tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.088419 Jul 26 14:11:24.619765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b84a19d2-96cc-42d5-b436-03627c93bdb7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:24.621455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b84a19d2-96cc-42d5-b436-03627c93bdb7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:24.640720 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 858/1593] 10.222.0.70 () {60 vars in 1211 bytes} [Tue Jul 26 14:11:24 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:24.641774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84a19d2-96cc-42d5-b436-03627c93bdb7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:24.643266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84a19d2-96cc-42d5-b436-03627c93bdb7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:24.645110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84a19d2-96cc-42d5-b436-03627c93bdb7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:24.647057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84a19d2-96cc-42d5-b436-03627c93bdb7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:24.650215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6f676821-29cf-46e0-922a-ba6b5310136b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87946191f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:24.755865 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6f676821-29cf-46e0-922a-ba6b5310136b tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-564025625" status: 200 len: 484 microversion: 2.1 time: 0.113240 Jul 26 14:11:24.757259 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 859/1594] 10.222.0.70 () {58 vars in 1229 bytes} [Tue Jul 26 14:11:24 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-564025625 => generated 484 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:24.764472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1085ae4a-05be-485c-8de7-fc6b35f4cca7 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:24.767132 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:24.767132 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:11:24.768677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1085ae4a-05be-485c-8de7-fc6b35f4cca7 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:24.769341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1085ae4a-05be-485c-8de7-fc6b35f4cca7 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:24.770322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1085ae4a-05be-485c-8de7-fc6b35f4cca7 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:24.770936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1085ae4a-05be-485c-8de7-fc6b35f4cca7 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:24.807713 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1085ae4a-05be-485c-8de7-fc6b35f4cca7 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.048418 Jul 26 14:11:24.821076 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 860/1595] 10.222.0.70 () {60 vars in 1178 bytes} [Tue Jul 26 14:11:24 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:24.846466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6e2c2ca9-9a21-4927-b9b1-3a8fe7f688c9 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787bd61f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:25.030825 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6e2c2ca9-9a21-4927-b9b1-3a8fe7f688c9 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images?server=b3d38f13-5f5e-4574-b415-d21bb454b9d2" status: 200 len: 957 microversion: 2.1 time: 0.193582 Jul 26 14:11:25.042809 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 861/1596] 10.222.0.70 () {58 vars in 1209 bytes} [Tue Jul 26 14:11:24 2022] GET /compute/v2.1/images?server=b3d38f13-5f5e-4574-b415-d21bb454b9d2 => generated 957 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:25.049876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-001d0d1d-f963-439c-9d19-46a0dbd93eb6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:25.053393 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:25.053393 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:11:25.056548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-001d0d1d-f963-439c-9d19-46a0dbd93eb6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:25.057585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-001d0d1d-f963-439c-9d19-46a0dbd93eb6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:25.059654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-001d0d1d-f963-439c-9d19-46a0dbd93eb6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:25.060353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-001d0d1d-f963-439c-9d19-46a0dbd93eb6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:25.093832 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-001d0d1d-f963-439c-9d19-46a0dbd93eb6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-833090-9&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.048898 Jul 26 14:11:25.095705 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 862/1597] 10.222.0.70 () {60 vars in 1235 bytes} [Tue Jul 26 14:11:25 2022] GET /compute/v2.1/os-services?host=n-d-833090-9&binary=xxx => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:25.101791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-efd38a96-e6c4-46bf-96d5-4d42318d17ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:25.103306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-efd38a96-e6c4-46bf-96d5-4d42318d17ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:25.116925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efd38a96-e6c4-46bf-96d5-4d42318d17ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:25.118763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efd38a96-e6c4-46bf-96d5-4d42318d17ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:25.119887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efd38a96-e6c4-46bf-96d5-4d42318d17ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:25.120615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efd38a96-e6c4-46bf-96d5-4d42318d17ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:25.240093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b84a19d2-96cc-42d5-b436-03627c93bdb7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:25.253020 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b84a19d2-96cc-42d5-b436-03627c93bdb7 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1511 microversion: 2.1 time: 0.653083 Jul 26 14:11:25.268494 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 736/1598] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:24 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1511 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:25.275433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9d2798d-942a-4d2a-9863-94acaee7d5fb tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f878799e700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:25.460632 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d9d2798d-942a-4d2a-9863-94acaee7d5fb tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2F807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 484 microversion: 2.1 time: 0.190499 Jul 26 14:11:25.461442 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 737/1599] 10.222.0.70 () {58 vars in 1317 bytes} [Tue Jul 26 14:11:25 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2F807e080b-51bc-48e9-9b38-a4c49734b15d => generated 484 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:25.475113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-51800c83-42f6-43d3-82ab-948a3d482c10 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:25.489442 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:25.489442 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:11:25.495510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51800c83-42f6-43d3-82ab-948a3d482c10 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:25.495986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51800c83-42f6-43d3-82ab-948a3d482c10 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:25.496819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51800c83-42f6-43d3-82ab-948a3d482c10 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:25.497259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51800c83-42f6-43d3-82ab-948a3d482c10 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:25.565519 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-51800c83-42f6-43d3-82ab-948a3d482c10 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.095975 Jul 26 14:11:25.566410 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 738/1600] 10.222.0.70 () {60 vars in 1178 bytes} [Tue Jul 26 14:11:25 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:25.577251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e3aac206-1193-4d0c-ba41-ffc81b01d624 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:25.598750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e3aac206-1193-4d0c-ba41-ffc81b01d624 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:25.607602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e3aac206-1193-4d0c-ba41-ffc81b01d624 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:11:25.973953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3aac206-1193-4d0c-ba41-ffc81b01d624 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:25.974421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3aac206-1193-4d0c-ba41-ffc81b01d624 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:25.975238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3aac206-1193-4d0c-ba41-ffc81b01d624 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:25.975687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3aac206-1193-4d0c-ba41-ffc81b01d624 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:26.040505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-efd38a96-e6c4-46bf-96d5-4d42318d17ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:26.061800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-efd38a96-e6c4-46bf-96d5-4d42318d17ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:26.064806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-efd38a96-e6c4-46bf-96d5-4d42318d17ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:26.071698 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-efd38a96-e6c4-46bf-96d5-4d42318d17ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.972131 Jul 26 14:11:26.074235 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 863/1601] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:25 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:26.092459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d46dd741-b052-4c20-bec2-9dd94c316a7d req-6738ea20-8633-4e86-b864-be8d8c608b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "tag": "8440feb4-5af7-47f7-93be-a1f774aeb7ab"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:26.132255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d46dd741-b052-4c20-bec2-9dd94c316a7d req-6738ea20-8633-4e86-b864-be8d8c608b3d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:26.135288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d46dd741-b052-4c20-bec2-9dd94c316a7d req-6738ea20-8633-4e86-b864-be8d8c608b3d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:26.170192 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d46dd741-b052-4c20-bec2-9dd94c316a7d req-6738ea20-8633-4e86-b864-be8d8c608b3d service nova] Creating event network-changed:8440feb4-5af7-47f7-93be-a1f774aeb7ab for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:11:26.187157 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d46dd741-b052-4c20-bec2-9dd94c316a7d req-6738ea20-8633-4e86-b864-be8d8c608b3d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107503 Jul 26 14:11:26.190232 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 864/1602] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:26.219816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b927e881-730c-42a2-bc23-53ce335448ae tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787bf1dc0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:26.296683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-e3aac206-1193-4d0c-ba41-ffc81b01d624 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:11:26.416915 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b927e881-730c-42a2-bc23-53ce335448ae tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2F807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 484 microversion: 2.1 time: 0.225079 Jul 26 14:11:26.434040 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 865/1603] 10.222.0.70 () {58 vars in 1303 bytes} [Tue Jul 26 14:11:26 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2F807e080b-51bc-48e9-9b38-a4c49734b15d => generated 484 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:26.442900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5b27e6ca-c3de-4cd4-9098-e4af138808e6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:26.447320 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:26.447320 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:11:26.449599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5b27e6ca-c3de-4cd4-9098-e4af138808e6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:26.450641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5b27e6ca-c3de-4cd4-9098-e4af138808e6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:26.452214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5b27e6ca-c3de-4cd4-9098-e4af138808e6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:26.453010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5b27e6ca-c3de-4cd4-9098-e4af138808e6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:26.493561 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5b27e6ca-c3de-4cd4-9098-e4af138808e6 tempest-ServicesAdminNegativeV253TestJSON-455412497 tempest-ServicesAdminNegativeV253TestJSON-455412497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.057275 Jul 26 14:11:26.494771 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 866/1604] 10.222.0.70 () {60 vars in 1239 bytes} [Tue Jul 26 14:11:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:26.501461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8cb442e4-10ea-4621-a60a-419886b7042a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:26.502675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8cb442e4-10ea-4621-a60a-419886b7042a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:26.512586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cb442e4-10ea-4621-a60a-419886b7042a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:26.513878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cb442e4-10ea-4621-a60a-419886b7042a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:26.515012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cb442e4-10ea-4621-a60a-419886b7042a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:26.515685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cb442e4-10ea-4621-a60a-419886b7042a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:26.584607 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e3aac206-1193-4d0c-ba41-ffc81b01d624 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 346 microversion: 2.1 time: 1.010421 Jul 26 14:11:26.601525 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 739/1605] 10.222.0.70 () {58 vars in 1154 bytes} [Tue Jul 26 14:11:25 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 346 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:26.610863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-569693bd-8a99-478c-a613-de225dd10015 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787acd310>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:26.986339 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-569693bd-8a99-478c-a613-de225dd10015 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3277 microversion: 2.1 time: 0.382150 Jul 26 14:11:26.987834 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 740/1606] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Jul 26 14:11:26 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3277 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:27.602876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8cb442e4-10ea-4621-a60a-419886b7042a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:27.620722 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8cb442e4-10ea-4621-a60a-419886b7042a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1317 microversion: 2.1 time: 1.124413 Jul 26 14:11:27.649740 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 867/1607] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:26 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1317 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:27.667476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-26cb876f-c1c1-4d8e-bf59-009a11efc249 req-53350340-c21e-4843-acf8-1b0ffb6cb099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c22c8fd-b9fb-4fff-9571-4f3013ea9114", "name": "network-vif-plugged", "status": "completed", "tag": "1b25f608-868a-4c1e-92e5-13cdf2d63821"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:27.700051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-26cb876f-c1c1-4d8e-bf59-009a11efc249 req-53350340-c21e-4843-acf8-1b0ffb6cb099 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:27.700890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-26cb876f-c1c1-4d8e-bf59-009a11efc249 req-53350340-c21e-4843-acf8-1b0ffb6cb099 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:27.729182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ecf32063-a7c9-49fa-a5cf-46ac81bd9244 tempest-ServicesAdminNegativeV253TestJSON-1848952950 tempest-ServicesAdminNegativeV253TestJSON-1848952950-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:27.732611 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:11:27.732611 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:11:27.736902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ecf32063-a7c9-49fa-a5cf-46ac81bd9244 tempest-ServicesAdminNegativeV253TestJSON-1848952950 tempest-ServicesAdminNegativeV253TestJSON-1848952950-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1448ec523cab46418a2a6859865ac898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944a044091b24752b69c07079a604339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:27.738332 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-26cb876f-c1c1-4d8e-bf59-009a11efc249 req-53350340-c21e-4843-acf8-1b0ffb6cb099 service nova] Creating event network-vif-plugged:1b25f608-868a-4c1e-92e5-13cdf2d63821 for instance 2c22c8fd-b9fb-4fff-9571-4f3013ea9114 on n-h1-833090-9 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ecf32063-a7c9-49fa-a5cf-46ac81bd9244 tempest-ServicesAdminNegativeV253TestJSON-1848952950 tempest-ServicesAdminNegativeV253TestJSON-1848952950-project] Request method failure captured: Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_YD5FycIla-XL7Gt2EIfC4x-slPsfGBCsPuL3dYUIqqqfFpZOajrbypAaCq5KReLsGid78U0bsorLTDoHsS5GkyqWmDj9BujkGqn51nBOJ5EEk1bxjge1tibXjd6CfCtAi-r0twxLlkS2tJ3BuTI3qOstH7x4a6n7hbgM0UcwSzQ7I Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.53 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 944a044091b24752b69c07079a604339 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1848952950 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/944a044091b24752b69c07079a604339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/944a044091b24752b69c07079a604339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_944a044091b24752b69c07079a604339", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/944a044091b24752b69c07079a604339"}]}] Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1848952950 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 944a044091b24752b69c07079a604339 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1848952950 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1848952950-project Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 1448ec523cab46418a2a6859865ac898 Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1848952950-project Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: action_args: {} Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise self.value Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 14:11:27.739385 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:27.745258 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:27.745258 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:27.745258 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:27.745258 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:27.745258 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:27.745258 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 26 14:11:27.745258 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 26 14:11:27.745258 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 26 14:11:27.745258 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:27.747674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ecf32063-a7c9-49fa-a5cf-46ac81bd9244 tempest-ServicesAdminNegativeV253TestJSON-1848952950 tempest-ServicesAdminNegativeV253TestJSON-1848952950-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:11:27.751251 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ecf32063-a7c9-49fa-a5cf-46ac81bd9244 tempest-ServicesAdminNegativeV253TestJSON-1848952950 tempest-ServicesAdminNegativeV253TestJSON-1848952950-project] 10.222.0.70 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.761893 Jul 26 14:11:27.753937 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-26cb876f-c1c1-4d8e-bf59-009a11efc249 req-53350340-c21e-4843-acf8-1b0ffb6cb099 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098889 Jul 26 14:11:27.754560 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 868/1608] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:27.760795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1b13b869-2c9d-468a-a069-df3e2e69015b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:27.761518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1b13b869-2c9d-468a-a069-df3e2e69015b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:27.762925 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 741/1609] 10.222.0.70 () {60 vars in 1178 bytes} [Tue Jul 26 14:11:26 2022] GET /compute/v2.1/os-services => generated 112 bytes in 775 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:11:27.778485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b13b869-2c9d-468a-a069-df3e2e69015b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:27.779851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b13b869-2c9d-468a-a069-df3e2e69015b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:27.780706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b13b869-2c9d-468a-a069-df3e2e69015b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:27.781162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b13b869-2c9d-468a-a069-df3e2e69015b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:27.799897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff8f4453-f1e3-47b5-9a54-165a71c44e6e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87879bfa60>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:28.122944 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff8f4453-f1e3-47b5-9a54-165a71c44e6e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.357270 Jul 26 14:11:28.130554 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 742/1610] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Jul 26 14:11:27 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:28.151249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ba4c3e81-775e-4553-b87f-1f1207541703 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:28.155158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ba4c3e81-775e-4553-b87f-1f1207541703 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:28.189483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba4c3e81-775e-4553-b87f-1f1207541703 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:28.200993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba4c3e81-775e-4553-b87f-1f1207541703 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:28.206983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba4c3e81-775e-4553-b87f-1f1207541703 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:28.209300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba4c3e81-775e-4553-b87f-1f1207541703 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:28.708190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1b13b869-2c9d-468a-a069-df3e2e69015b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:28.722382 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1b13b869-2c9d-468a-a069-df3e2e69015b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1511 microversion: 2.1 time: 0.966584 Jul 26 14:11:28.723296 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 869/1611] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:27 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1511 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:28.741099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ad4eb54-3d05-418a-ac6d-53f6db774740 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87948c1a60>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:28.762338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ba4c3e81-775e-4553-b87f-1f1207541703 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:28.786283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ba4c3e81-775e-4553-b87f-1f1207541703 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:28.790143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ba4c3e81-775e-4553-b87f-1f1207541703 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:28.801156 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ba4c3e81-775e-4553-b87f-1f1207541703 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.659380 Jul 26 14:11:28.832841 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 743/1612] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:28 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:28.866885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1cf2f147-eabd-4cb8-a22a-4abc6c1249ac tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:28.878451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1cf2f147-eabd-4cb8-a22a-4abc6c1249ac tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:28.890275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cf2f147-eabd-4cb8-a22a-4abc6c1249ac tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:28.890886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cf2f147-eabd-4cb8-a22a-4abc6c1249ac tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:28.891718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cf2f147-eabd-4cb8-a22a-4abc6c1249ac tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:28.892197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cf2f147-eabd-4cb8-a22a-4abc6c1249ac tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:28.908792 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ad4eb54-3d05-418a-ac6d-53f6db774740 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.184276 Jul 26 14:11:28.919234 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 870/1613] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:11:28 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:28.938527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f78a3d88-72ad-413a-a1b7-73bab892eafa tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:28.940204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f78a3d88-72ad-413a-a1b7-73bab892eafa tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 54be76f6-dd14-406f-8f42-ed989a168646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:28.959113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f78a3d88-72ad-413a-a1b7-73bab892eafa tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:28.969471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f78a3d88-72ad-413a-a1b7-73bab892eafa tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:28.971257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f78a3d88-72ad-413a-a1b7-73bab892eafa tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:28.971902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f78a3d88-72ad-413a-a1b7-73bab892eafa tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:29.738887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1cf2f147-eabd-4cb8-a22a-4abc6c1249ac tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:29.753371 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1cf2f147-eabd-4cb8-a22a-4abc6c1249ac tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1317 microversion: 2.1 time: 0.919281 Jul 26 14:11:29.757645 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 744/1614] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:28 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1317 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:29.766216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b55a36a-3e17-4673-9f4f-27c418a490da tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f878799e430>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:29.820112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f78a3d88-72ad-413a-a1b7-73bab892eafa tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:29.869333 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f78a3d88-72ad-413a-a1b7-73bab892eafa tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646" status: 200 len: 1512 microversion: 2.1 time: 0.946059 Jul 26 14:11:29.876555 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 871/1615] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:28 2022] GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646 => generated 1512 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:29.895887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9a63bea8-2362-4c65-ba09-b7c3c8027780 req-9d3cc61f-fdfe-4bc5-8551-8838df55283b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "tag": "989be3eb-05ab-401f-a4a3-8eb746b5d1b3"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:29.942493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9a63bea8-2362-4c65-ba09-b7c3c8027780 req-9d3cc61f-fdfe-4bc5-8551-8838df55283b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:29.947087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9a63bea8-2362-4c65-ba09-b7c3c8027780 req-9d3cc61f-fdfe-4bc5-8551-8838df55283b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:30.006171 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9a63bea8-2362-4c65-ba09-b7c3c8027780 req-9d3cc61f-fdfe-4bc5-8551-8838df55283b service nova] Creating event network-changed:989be3eb-05ab-401f-a4a3-8eb746b5d1b3 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:11:30.019120 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9a63bea8-2362-4c65-ba09-b7c3c8027780 req-9d3cc61f-fdfe-4bc5-8551-8838df55283b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137544 Jul 26 14:11:30.020350 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 872/1616] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:30.031942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d881b809-692e-4f97-90f4-6459c3691551 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:30.033108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d881b809-692e-4f97-90f4-6459c3691551 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:30.048618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d881b809-692e-4f97-90f4-6459c3691551 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:30.049428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d881b809-692e-4f97-90f4-6459c3691551 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:30.051488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d881b809-692e-4f97-90f4-6459c3691551 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:30.052314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d881b809-692e-4f97-90f4-6459c3691551 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:30.292660 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b55a36a-3e17-4673-9f4f-27c418a490da tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/detail?changes-since=2022-07-26T14%3A08%3A26Z" status: 200 len: 6330 microversion: 2.1 time: 0.506686 Jul 26 14:11:30.294073 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 745/1617] 10.222.0.70 () {58 vars in 1220 bytes} [Tue Jul 26 14:11:29 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-26T14%3A08%3A26Z => generated 6330 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:30.325729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-230a7a4b-9279-4de4-8978-c30be8086f4f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:30.328198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-230a7a4b-9279-4de4-8978-c30be8086f4f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:30.344786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-230a7a4b-9279-4de4-8978-c30be8086f4f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:30.349242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-230a7a4b-9279-4de4-8978-c30be8086f4f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:30.350365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-230a7a4b-9279-4de4-8978-c30be8086f4f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:30.350986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-230a7a4b-9279-4de4-8978-c30be8086f4f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:31.147513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-230a7a4b-9279-4de4-8978-c30be8086f4f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:31.162936 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-230a7a4b-9279-4de4-8978-c30be8086f4f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1511 microversion: 2.1 time: 0.866764 Jul 26 14:11:31.166253 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 746/1618] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:30 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1511 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:31.204504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7defb5ca-d326-428f-b692-19430f9446e8 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787906d30>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:31.412432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d881b809-692e-4f97-90f4-6459c3691551 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:31.438316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d881b809-692e-4f97-90f4-6459c3691551 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:31.448085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d881b809-692e-4f97-90f4-6459c3691551 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:31.452156 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d881b809-692e-4f97-90f4-6459c3691551 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.425710 Jul 26 14:11:31.479782 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 873/1619] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:30 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:31.508834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5c1e9942-2510-4c75-a951-d57b2fbff139 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:31.510304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5c1e9942-2510-4c75-a951-d57b2fbff139 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:31.521254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c1e9942-2510-4c75-a951-d57b2fbff139 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:31.522102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c1e9942-2510-4c75-a951-d57b2fbff139 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:31.523738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c1e9942-2510-4c75-a951-d57b2fbff139 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:31.524634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c1e9942-2510-4c75-a951-d57b2fbff139 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:31.603247 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7defb5ca-d326-428f-b692-19430f9446e8 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-564025625" status: 200 len: 664 microversion: 2.1 time: 0.433902 Jul 26 14:11:31.605907 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 747/1620] 10.222.0.70 () {58 vars in 1250 bytes} [Tue Jul 26 14:11:31 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-564025625 => generated 664 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:31.620108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:31.645778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:31.647618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:11:31.691765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:31.692649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:31.695510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:31.697454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:31.773908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:11:31.825441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:31.849238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:31.853426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:32.312089 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ee1078a-3694-4108-86ff-665e5416b3fc tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.702409 Jul 26 14:11:32.313452 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 748/1621] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:11:31 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:32.319023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64eef9ed-3a6f-4d0c-82e3-cf90f363775c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87879bfe50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:32.357988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5c1e9942-2510-4c75-a951-d57b2fbff139 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:32.381621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:32.392864 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5c1e9942-2510-4c75-a951-d57b2fbff139 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1467 microversion: 2.1 time: 0.907324 Jul 26 14:11:32.394609 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 874/1622] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:31 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1467 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:32.420131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9b895c7-5fc0-42c9-a690-78d7235e0384 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:32.441543 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64eef9ed-3a6f-4d0c-82e3-cf90f363775c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2F807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1466 microversion: 2.1 time: 0.127422 Jul 26 14:11:32.442261 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 749/1623] 10.222.0.70 () {58 vars in 1338 bytes} [Tue Jul 26 14:11:32 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2F807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1466 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:32.452302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b9b895c7-5fc0-42c9-a690-78d7235e0384 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:32.458862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b9b895c7-5fc0-42c9-a690-78d7235e0384 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:11:32.471182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8e63649c-ed35-439c-a011-b905616b0bfd tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:32.483171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8e63649c-ed35-439c-a011-b905616b0bfd tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:32.493583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e63649c-ed35-439c-a011-b905616b0bfd tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:32.504820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e63649c-ed35-439c-a011-b905616b0bfd tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:32.506872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e63649c-ed35-439c-a011-b905616b0bfd tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:32.508364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e63649c-ed35-439c-a011-b905616b0bfd tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:32.556174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:33.105694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9b895c7-5fc0-42c9-a690-78d7235e0384 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:33.106154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9b895c7-5fc0-42c9-a690-78d7235e0384 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:33.106968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9b895c7-5fc0-42c9-a690-78d7235e0384 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:33.107395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9b895c7-5fc0-42c9-a690-78d7235e0384 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:33.400361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-b9b895c7-5fc0-42c9-a690-78d7235e0384 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:11:33.426984 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8e63649c-ed35-439c-a011-b905616b0bfd tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1618 microversion: 2.1 time: 0.963148 Jul 26 14:11:33.427583 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 750/1624] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:32 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1618 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:33.451579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b5d28ae3-039b-4d11-aad1-050b6dfe7db6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87878b09d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:33.547723 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b5d28ae3-039b-4d11-aad1-050b6dfe7db6 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2F807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1466 microversion: 2.1 time: 0.106858 Jul 26 14:11:33.549316 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 751/1625] 10.222.0.70 () {58 vars in 1324 bytes} [Tue Jul 26 14:11:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2F807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1466 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:33.560981 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b9b895c7-5fc0-42c9-a690-78d7235e0384 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 1.154712 Jul 26 14:11:33.560981 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 875/1626] 10.222.0.70 () {58 vars in 1150 bytes} [Tue Jul 26 14:11:32 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:33.569389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ab9bfbd3-4b9f-4573-bcce-0a540f92b339 req-0553d7e5-5efc-4d80-9f1b-0754ddd6d0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "tag": "b923158a-9822-423c-abbf-187f52ae32d2"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:33.574722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c4407338-26ba-4ad9-af18-f1165085488c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:33.580913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c4407338-26ba-4ad9-af18-f1165085488c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:33.601366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4407338-26ba-4ad9-af18-f1165085488c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:33.603060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4407338-26ba-4ad9-af18-f1165085488c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:33.604227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ab9bfbd3-4b9f-4573-bcce-0a540f92b339 req-0553d7e5-5efc-4d80-9f1b-0754ddd6d0f9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:33.607614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4407338-26ba-4ad9-af18-f1165085488c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:33.608211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4407338-26ba-4ad9-af18-f1165085488c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:33.608560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ab9bfbd3-4b9f-4573-bcce-0a540f92b339 req-0553d7e5-5efc-4d80-9f1b-0754ddd6d0f9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:33.642650 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ab9bfbd3-4b9f-4573-bcce-0a540f92b339 req-0553d7e5-5efc-4d80-9f1b-0754ddd6d0f9 service nova] Creating event network-changed:b923158a-9822-423c-abbf-187f52ae32d2 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:11:33.670422 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ab9bfbd3-4b9f-4573-bcce-0a540f92b339 req-0553d7e5-5efc-4d80-9f1b-0754ddd6d0f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105136 Jul 26 14:11:33.672161 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 752/1627] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:33.688402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12e31a79-2bed-40db-934b-5637fb1c21e1 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87878b09d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:33.838547 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-12e31a79-2bed-40db-934b-5637fb1c21e1 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7105 microversion: 2.1 time: 0.164662 Jul 26 14:11:33.844663 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 753/1628] 10.222.0.70 () {58 vars in 1170 bytes} [Tue Jul 26 14:11:33 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7105 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:33.854985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-568796a9-9a0a-4b75-b933-9f2cdbf99d13 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:33.874007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-568796a9-9a0a-4b75-b933-9f2cdbf99d13 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:33.880212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-568796a9-9a0a-4b75-b933-9f2cdbf99d13 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:11:33.894959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-568796a9-9a0a-4b75-b933-9f2cdbf99d13 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:33.896807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-568796a9-9a0a-4b75-b933-9f2cdbf99d13 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:33.898940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-568796a9-9a0a-4b75-b933-9f2cdbf99d13 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:33.901386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-568796a9-9a0a-4b75-b933-9f2cdbf99d13 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:34.075082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-568796a9-9a0a-4b75-b933-9f2cdbf99d13 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:11:34.237482 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-568796a9-9a0a-4b75-b933-9f2cdbf99d13 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.383773 Jul 26 14:11:34.239390 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 754/1629] 10.222.0.70 () {58 vars in 1212 bytes} [Tue Jul 26 14:11:33 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:34.258165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-716292850", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "34089008-8d17-4f4a-a989-57f47959ae93"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:34.357081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c4407338-26ba-4ad9-af18-f1165085488c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:34.382600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c4407338-26ba-4ad9-af18-f1165085488c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:34.385430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c4407338-26ba-4ad9-af18-f1165085488c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:34.390921 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c4407338-26ba-4ad9-af18-f1165085488c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.828761 Jul 26 14:11:34.392435 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 876/1630] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:33 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:34.397634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3fdd8bef-157a-48d1-be1c-3783c60f685c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787d6cf70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:34.417903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:11:34.715036 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3fdd8bef-157a-48d1-be1c-3783c60f685c tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.321208 Jul 26 14:11:34.715674 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 877/1631] 10.222.0.70 () {58 vars in 1170 bytes} [Tue Jul 26 14:11:34 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:34.732369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0ee4cef9-7e97-4096-8a3a-c193693d2075 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:34.754250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ee4cef9-7e97-4096-8a3a-c193693d2075 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:34.754986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0ee4cef9-7e97-4096-8a3a-c193693d2075 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:11:34.777908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ee4cef9-7e97-4096-8a3a-c193693d2075 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:34.784927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ee4cef9-7e97-4096-8a3a-c193693d2075 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:34.785941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ee4cef9-7e97-4096-8a3a-c193693d2075 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:34.793613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ee4cef9-7e97-4096-8a3a-c193693d2075 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:35.015499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-0ee4cef9-7e97-4096-8a3a-c193693d2075 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:11:35.220499 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0ee4cef9-7e97-4096-8a3a-c193693d2075 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.503618 Jul 26 14:11:35.234621 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 878/1632] 10.222.0.70 () {58 vars in 1196 bytes} [Tue Jul 26 14:11:34 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:35.252649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4786547c-d17b-45da-9953-b1a090183ae3 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787bf1940>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:35.359540 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4786547c-d17b-45da-9953-b1a090183ae3 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/5fc64a26-e870-4f37-8cf2-dd18e171162e" status: 200 len: 784 microversion: 2.1 time: 0.129877 Jul 26 14:11:35.360186 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 879/1633] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:11:35 2022] GET /compute/v2.1/images/5fc64a26-e870-4f37-8cf2-dd18e171162e => generated 784 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:35.375263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-13722641-e37e-4ac7-8630-a373dabd83f3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:35.389877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-13722641-e37e-4ac7-8630-a373dabd83f3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:35.395937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-13722641-e37e-4ac7-8630-a373dabd83f3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'name': '1069138422', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:11:35.436045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13722641-e37e-4ac7-8630-a373dabd83f3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:35.436959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13722641-e37e-4ac7-8630-a373dabd83f3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:35.440757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13722641-e37e-4ac7-8630-a373dabd83f3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:35.442309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13722641-e37e-4ac7-8630-a373dabd83f3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:35.789539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-13722641-e37e-4ac7-8630-a373dabd83f3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:11:35.889591 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-13722641-e37e-4ac7-8630-a373dabd83f3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?name=1069138422" status: 200 len: 346 microversion: 2.1 time: 0.523608 Jul 26 14:11:35.890987 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 880/1634] 10.222.0.70 () {58 vars in 1156 bytes} [Tue Jul 26 14:11:35 2022] GET /compute/v2.1/servers?name=1069138422 => generated 346 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:35.903341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1266c829-7948-4c64-90af-e9c703359a3f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87945409d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:36.105957 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1266c829-7948-4c64-90af-e9c703359a3f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.213601 Jul 26 14:11:36.120127 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 881/1635] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:11:35 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:36.149005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b4aa0453-9a25-4cff-a5aa-da7a4fa58e80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:36.152564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b4aa0453-9a25-4cff-a5aa-da7a4fa58e80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:36.172219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4aa0453-9a25-4cff-a5aa-da7a4fa58e80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:36.172520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4aa0453-9a25-4cff-a5aa-da7a4fa58e80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:36.174520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4aa0453-9a25-4cff-a5aa-da7a4fa58e80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:36.175813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4aa0453-9a25-4cff-a5aa-da7a4fa58e80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:36.216992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:11:36.217912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:11:36.217912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:11:36.218446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:11:36.218687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:11:36.239721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:36.242240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:36.244594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:36.245236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:36.304932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:11:36.325615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Getting quotas for user 595ebbd7d38049268b2bba22fee81f14 and project 3982eb0d2c734ff3bd9a13a61d1214a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:11:36.363299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:11:36.370364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:11:36.513814 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-69409754-4ed1-4024-8a54-f33be995ef4c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.269529 Jul 26 14:11:36.524776 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 755/1636] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:11:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:11:36.555780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-07399ec7-6d63-4e98-81a4-229a113059f4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:36.580749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-07399ec7-6d63-4e98-81a4-229a113059f4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:36.582005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-07399ec7-6d63-4e98-81a4-229a113059f4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:11:36.598754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07399ec7-6d63-4e98-81a4-229a113059f4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:36.602625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07399ec7-6d63-4e98-81a4-229a113059f4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:36.604175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07399ec7-6d63-4e98-81a4-229a113059f4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:36.605007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07399ec7-6d63-4e98-81a4-229a113059f4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:36.747144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-07399ec7-6d63-4e98-81a4-229a113059f4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:11:36.891974 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-07399ec7-6d63-4e98-81a4-229a113059f4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.359348 Jul 26 14:11:36.908391 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 756/1637] 10.222.0.70 () {58 vars in 1154 bytes} [Tue Jul 26 14:11:36 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:36.908391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-226b7602-0811-4263-93cf-94be4ea14574 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787c1e550>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:37.174359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b4aa0453-9a25-4cff-a5aa-da7a4fa58e80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:37.238595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b4aa0453-9a25-4cff-a5aa-da7a4fa58e80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:37.247257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b4aa0453-9a25-4cff-a5aa-da7a4fa58e80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:37.251634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b4aa0453-9a25-4cff-a5aa-da7a4fa58e80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.142401 Jul 26 14:11:37.302448 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 882/1638] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:36 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:37.882283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-402a730c-7fc7-4002-b4c5-48fc30e1dcd3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Action: 'create', calling method: .version_select at 0x7f87876d4af0>, body: {"keypair": {"name": "tempest-keypair-575127407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACAG8WPhjraYpl5Bp/B9EnWNVuzHI8DoehuqlUk71SCUa50NJ/8DsSf9Arb9WbiDmSVSGZP5tX8KwWYqvA77VGnbOPdQeLoQrUzjaTGxLB9CnFNCAoJylGFg9zE/jGs6w=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:38.015492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-402a730c-7fc7-4002-b4c5-48fc30e1dcd3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Getting quotas for project 6d3d4870c41848059f09cb025a2251f4. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:11:38.061632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-402a730c-7fc7-4002-b4c5-48fc30e1dcd3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Getting quotas for user addd82517c33447caa2d0dcbb0379baf and project 6d3d4870c41848059f09cb025a2251f4. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:11:38.204515 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-402a730c-7fc7-4002-b4c5-48fc30e1dcd3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.898647 Jul 26 14:11:38.205500 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 883/1639] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:11:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:38.245648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-68cc2492-9cd5-4211-a7bc-cc2094719d56 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:38.248139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-68cc2492-9cd5-4211-a7bc-cc2094719d56 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:38.289558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68cc2492-9cd5-4211-a7bc-cc2094719d56 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:38.290415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68cc2492-9cd5-4211-a7bc-cc2094719d56 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:38.291836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68cc2492-9cd5-4211-a7bc-cc2094719d56 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:38.292840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68cc2492-9cd5-4211-a7bc-cc2094719d56 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:39.000303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-68cc2492-9cd5-4211-a7bc-cc2094719d56 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:39.033521 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-68cc2492-9cd5-4211-a7bc-cc2094719d56 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1220 microversion: 2.1 time: 0.814271 Jul 26 14:11:39.045134 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-226b7602-0811-4263-93cf-94be4ea14574 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "DELETE /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71" status: 204 len: 0 microversion: 2.1 time: 2.142041 Jul 26 14:11:39.050405 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 757/1640] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:36 2022] DELETE /compute/v2.1/images/df1548e5-fcf5-404a-9700-c0d919589a71 => generated 0 bytes in 2148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:11:39.058003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f75790c8-3213-4c9b-823b-0d3a3d7de32a tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:39.068621 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 884/1641] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:38 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1220 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:39.080716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f75790c8-3213-4c9b-823b-0d3a3d7de32a tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:39.082167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed5fbbaf-41cd-4060-b417-f5a836f6b568 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:39.083771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ed5fbbaf-41cd-4060-b417-f5a836f6b568 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:39.086633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f75790c8-3213-4c9b-823b-0d3a3d7de32a tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-106913842', 'deleted': False, 'project_id': 'a1df297aa8b6421da531e980c89c7051'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:11:39.088548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:39.091162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:39.110278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed5fbbaf-41cd-4060-b417-f5a836f6b568 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:39.113444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f75790c8-3213-4c9b-823b-0d3a3d7de32a tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:39.120424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f75790c8-3213-4c9b-823b-0d3a3d7de32a tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:39.123847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f75790c8-3213-4c9b-823b-0d3a3d7de32a tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:39.125962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f75790c8-3213-4c9b-823b-0d3a3d7de32a tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:39.129860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed5fbbaf-41cd-4060-b417-f5a836f6b568 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:39.135130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed5fbbaf-41cd-4060-b417-f5a836f6b568 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:39.136542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed5fbbaf-41cd-4060-b417-f5a836f6b568 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:39.487464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-f75790c8-3213-4c9b-823b-0d3a3d7de32a tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:11:39.656355 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f75790c8-3213-4c9b-823b-0d3a3d7de32a tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-106913842" status: 200 len: 346 microversion: 2.1 time: 0.608460 Jul 26 14:11:39.669353 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 758/1642] 10.222.0.70 () {58 vars in 1228 bytes} [Tue Jul 26 14:11:39 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-106913842 => generated 346 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:39.685043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3aa7c55a-c248-4f35-9e06-40fb9b7f1157 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87878578b0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:40.407175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ed5fbbaf-41cd-4060-b417-f5a836f6b568 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:40.440413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ed5fbbaf-41cd-4060-b417-f5a836f6b568 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:40.445146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ed5fbbaf-41cd-4060-b417-f5a836f6b568 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:40.451166 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed5fbbaf-41cd-4060-b417-f5a836f6b568 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.379886 Jul 26 14:11:40.453201 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 885/1643] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:39 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:40.860588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1001117928", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:41.440891 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3aa7c55a-c248-4f35-9e06-40fb9b7f1157 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "DELETE /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6" status: 204 len: 0 microversion: 2.1 time: 1.769936 Jul 26 14:11:41.444315 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 759/1644] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:39 2022] DELETE /compute/v2.1/images/af20f45a-3c53-427e-b915-047fc3aebbe6 => generated 0 bytes in 1774 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:11:41.481924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c20a146-cccd-442f-8b00-8a177651eac6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:41.484923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c20a146-cccd-442f-8b00-8a177651eac6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:41.535661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c20a146-cccd-442f-8b00-8a177651eac6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:41.537934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c20a146-cccd-442f-8b00-8a177651eac6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:41.562331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c20a146-cccd-442f-8b00-8a177651eac6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:41.563276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c20a146-cccd-442f-8b00-8a177651eac6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:41.642113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c20a146-cccd-442f-8b00-8a177651eac6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:11:41.661555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:11:41.848942 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2c20a146-cccd-442f-8b00-8a177651eac6 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 204 len: 0 microversion: 2.1 time: 0.385301 Jul 26 14:11:41.853947 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 760/1645] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:11:41 2022] DELETE /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:11:41.864793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1341ed8c-8911-4496-9d15-9a3f391ad826 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:41.866492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1341ed8c-8911-4496-9d15-9a3f391ad826 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:41.876582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1341ed8c-8911-4496-9d15-9a3f391ad826 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:41.877333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1341ed8c-8911-4496-9d15-9a3f391ad826 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:41.878615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1341ed8c-8911-4496-9d15-9a3f391ad826 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:41.879416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1341ed8c-8911-4496-9d15-9a3f391ad826 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:42.227567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1341ed8c-8911-4496-9d15-9a3f391ad826 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:42.245190 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1341ed8c-8911-4496-9d15-9a3f391ad826 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1274 microversion: 2.1 time: 0.388561 Jul 26 14:11:42.258691 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 761/1646] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:41 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1274 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:42.258691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fc979a98-6143-485a-9799-9cf5cb4f3815 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87877158b0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:42.859437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:11:42.860785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:11:42.861536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:11:42.862162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:11:42.862777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:11:42.905555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:42.910211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:42.911994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:42.913635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:42.978784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Getting quotas for project 3a8d5031d9064b94a6455e3c1dfcf9e9. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:11:43.022606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Getting quotas for user d41d238b43c541029fc35e90604a0a96 and project 3a8d5031d9064b94a6455e3c1dfcf9e9. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:11:43.090023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:11:43.095139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:11:43.244013 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4e6647ec-4bb4-427e-b827-5be5bcbc1f0e tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.782806 Jul 26 14:11:43.253483 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 886/1647] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:11:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:11:43.269854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a256c5a-e199-4351-bf58-75146e6b8739 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:43.273285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a256c5a-e199-4351-bf58-75146e6b8739 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:43.310696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a256c5a-e199-4351-bf58-75146e6b8739 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:43.311556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a256c5a-e199-4351-bf58-75146e6b8739 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:43.313671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a256c5a-e199-4351-bf58-75146e6b8739 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:43.315022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a256c5a-e199-4351-bf58-75146e6b8739 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:43.403375 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fc979a98-6143-485a-9799-9cf5cb4f3815 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "DELETE /compute/v2.1/images/9f99d468-f75d-4b06-85e6-e18a9c2ae40c" status: 204 len: 0 microversion: 2.1 time: 1.155235 Jul 26 14:11:43.407977 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 762/1648] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:42 2022] DELETE /compute/v2.1/images/9f99d468-f75d-4b06-85e6-e18a9c2ae40c => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:11:43.672461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1535134413", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "f30b7968-c3ae-449b-ac67-b8df080b0dd1"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:43.843455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] validate_networks() for [('f30b7968-c3ae-449b-ac67-b8df080b0dd1', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:11:44.494084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a256c5a-e199-4351-bf58-75146e6b8739 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:44.548781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a256c5a-e199-4351-bf58-75146e6b8739 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:44.561788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a256c5a-e199-4351-bf58-75146e6b8739 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:44.567350 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a256c5a-e199-4351-bf58-75146e6b8739 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.311595 Jul 26 14:11:44.575331 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 887/1649] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:43 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:44.590152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1085dd02-0762-4ebf-9f7d-36e835294046 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:44.591479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1085dd02-0762-4ebf-9f7d-36e835294046 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:44.618041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1085dd02-0762-4ebf-9f7d-36e835294046 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:44.621988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1085dd02-0762-4ebf-9f7d-36e835294046 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:44.627888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1085dd02-0762-4ebf-9f7d-36e835294046 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:44.631290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1085dd02-0762-4ebf-9f7d-36e835294046 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:46.347994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:46.441547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1085dd02-0762-4ebf-9f7d-36e835294046 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:46.456261 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1085dd02-0762-4ebf-9f7d-36e835294046 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1517 microversion: 2.1 time: 1.879352 Jul 26 14:11:46.457807 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 888/1650] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:44 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1517 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:46.477702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-def90cb3-32dd-44f5-b706-c3e78ac9d5ca tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:46.479029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-def90cb3-32dd-44f5-b706-c3e78ac9d5ca tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:46.496243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-def90cb3-32dd-44f5-b706-c3e78ac9d5ca tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:46.498104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-def90cb3-32dd-44f5-b706-c3e78ac9d5ca tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:46.498951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-def90cb3-32dd-44f5-b706-c3e78ac9d5ca tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:46.503912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-def90cb3-32dd-44f5-b706-c3e78ac9d5ca tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:46.716637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:11:46.717190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:11:46.717820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:11:46.719012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:11:46.719580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:11:46.744968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:46.746368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:46.747199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:46.747637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:46.775540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=19 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:46.825798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-def90cb3-32dd-44f5-b706-c3e78ac9d5ca tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41d238b43c541029fc35e90604a0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8d5031d9064b94a6455e3c1dfcf9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:46.862637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Getting quotas for project 8a2b6af31f6944a0b722252236ab369f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:11:46.887929 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-def90cb3-32dd-44f5-b706-c3e78ac9d5ca tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 200 len: 1272 microversion: 2.1 time: 0.427593 Jul 26 14:11:46.896212 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 889/1651] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:46 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 1272 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:46.900637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Getting quotas for user 88df654a9ef0445792b02c8939fe4787 and project 8a2b6af31f6944a0b722252236ab369f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:11:46.923407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-acbed97b-92da-42fe-8150-929b235968a0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:46.928006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-acbed97b-92da-42fe-8150-929b235968a0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:46.948912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acbed97b-92da-42fe-8150-929b235968a0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:46.949612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acbed97b-92da-42fe-8150-929b235968a0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:46.952471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acbed97b-92da-42fe-8150-929b235968a0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:46.955028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acbed97b-92da-42fe-8150-929b235968a0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:46.959857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:11:46.969488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:11:47.194989 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-70b43255-1914-4c23-b009-81364e708ea4 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.788891 Jul 26 14:11:47.220227 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 763/1652] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:11:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:11:47.234712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dca8dea9-bf45-4f65-a0b3-0e1e0acafae4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:47.236052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dca8dea9-bf45-4f65-a0b3-0e1e0acafae4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:47.250823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dca8dea9-bf45-4f65-a0b3-0e1e0acafae4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:47.259823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dca8dea9-bf45-4f65-a0b3-0e1e0acafae4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:47.261976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dca8dea9-bf45-4f65-a0b3-0e1e0acafae4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:47.263275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dca8dea9-bf45-4f65-a0b3-0e1e0acafae4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:47.308589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dca8dea9-bf45-4f65-a0b3-0e1e0acafae4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:11:47.525359 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dca8dea9-bf45-4f65-a0b3-0e1e0acafae4 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "DELETE /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 204 len: 0 microversion: 2.1 time: 0.302239 Jul 26 14:11:47.528323 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 764/1653] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:11:47 2022] DELETE /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:11:47.550515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f9d36aa5-83b2-4d4b-95bc-d9823c5a8e06 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:47.554178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f9d36aa5-83b2-4d4b-95bc-d9823c5a8e06 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:47.586041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9d36aa5-83b2-4d4b-95bc-d9823c5a8e06 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:47.588083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9d36aa5-83b2-4d4b-95bc-d9823c5a8e06 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:47.590287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9d36aa5-83b2-4d4b-95bc-d9823c5a8e06 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:47.595353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9d36aa5-83b2-4d4b-95bc-d9823c5a8e06 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:48.500634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f9d36aa5-83b2-4d4b-95bc-d9823c5a8e06 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:48.541776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f9d36aa5-83b2-4d4b-95bc-d9823c5a8e06 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:48.554750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f9d36aa5-83b2-4d4b-95bc-d9823c5a8e06 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:48.559887 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f9d36aa5-83b2-4d4b-95bc-d9823c5a8e06 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.029129 Jul 26 14:11:48.566489 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 765/1654] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:47 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:48.609379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca11d09f-2fd6-4513-951a-fe2b967ef875 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:48.612448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ca11d09f-2fd6-4513-951a-fe2b967ef875 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:48.652415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-acbed97b-92da-42fe-8150-929b235968a0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:48.691217 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-acbed97b-92da-42fe-8150-929b235968a0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1316 microversion: 2.1 time: 1.790306 Jul 26 14:11:48.694234 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 890/1655] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:46 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1316 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:48.707596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a896a92-b119-4783-8d25-d08fca59183b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:48.711625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9a896a92-b119-4783-8d25-d08fca59183b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:48.738761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a896a92-b119-4783-8d25-d08fca59183b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:48.744324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a896a92-b119-4783-8d25-d08fca59183b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:48.748269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a896a92-b119-4783-8d25-d08fca59183b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:48.749648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a896a92-b119-4783-8d25-d08fca59183b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:48.981122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ca11d09f-2fd6-4513-951a-fe2b967ef875 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:49.017772 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ca11d09f-2fd6-4513-951a-fe2b967ef875 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1225 microversion: 2.1 time: 0.419045 Jul 26 14:11:49.019752 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 766/1656] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:48 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1225 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:49.050108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-04be2b63-c307-46a2-9687-9872f11521fd tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:49.062572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-04be2b63-c307-46a2-9687-9872f11521fd tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:49.118664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04be2b63-c307-46a2-9687-9872f11521fd tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:49.120002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04be2b63-c307-46a2-9687-9872f11521fd tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:49.128707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04be2b63-c307-46a2-9687-9872f11521fd tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:49.129956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04be2b63-c307-46a2-9687-9872f11521fd tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:49.199509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9a896a92-b119-4783-8d25-d08fca59183b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:49.248241 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9a896a92-b119-4783-8d25-d08fca59183b tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 200 len: 1475 microversion: 2.1 time: 0.550698 Jul 26 14:11:49.249295 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 891/1657] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:48 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 1475 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:49.296226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a69bd5d9-06b6-4986-a144-de36d4dea271 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:49.303228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a69bd5d9-06b6-4986-a144-de36d4dea271 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:49.371710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a69bd5d9-06b6-4986-a144-de36d4dea271 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:49.375650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a69bd5d9-06b6-4986-a144-de36d4dea271 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:49.393010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a69bd5d9-06b6-4986-a144-de36d4dea271 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:49.393802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a69bd5d9-06b6-4986-a144-de36d4dea271 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:49.857903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a69bd5d9-06b6-4986-a144-de36d4dea271 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41d238b43c541029fc35e90604a0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8d5031d9064b94a6455e3c1dfcf9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:49.894734 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a69bd5d9-06b6-4986-a144-de36d4dea271 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 200 len: 1272 microversion: 2.1 time: 0.643577 Jul 26 14:11:49.904280 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 892/1658] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:49 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 1272 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:49.939278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1275375002", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "83c7273c-aafc-4ef1-9242-4a04f5076ae9"}], "security_groups": [{"name": "tempest-securitygroup--1385557317"}], "key_name": "tempest-keypair-575127407", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:50.153888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-04be2b63-c307-46a2-9687-9872f11521fd tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:50.182085 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-04be2b63-c307-46a2-9687-9872f11521fd tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 200 len: 1473 microversion: 2.1 time: 1.157487 Jul 26 14:11:50.183352 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 767/1659] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:49 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 1473 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:50.191144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c2847807-783c-4376-b71c-654402820941 req-a911508a-1d3f-49cc-8132-c773e99291e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ca67a8-07b3-4fe6-bd12-767b7985ab61", "name": "network-vif-deleted", "tag": "d9efcf68-41d1-4102-bda5-1ba36b09586b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:50.227293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c2847807-783c-4376-b71c-654402820941 req-a911508a-1d3f-49cc-8132-c773e99291e7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:50.230170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c2847807-783c-4376-b71c-654402820941 req-a911508a-1d3f-49cc-8132-c773e99291e7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:50.274929 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c2847807-783c-4376-b71c-654402820941 req-a911508a-1d3f-49cc-8132-c773e99291e7 service nova] Creating event network-vif-deleted:d9efcf68-41d1-4102-bda5-1ba36b09586b for instance c9ca67a8-07b3-4fe6-bd12-767b7985ab61 on n-h2-833090-9 Jul 26 14:11:50.306714 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c2847807-783c-4376-b71c-654402820941 req-a911508a-1d3f-49cc-8132-c773e99291e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121317 Jul 26 14:11:50.307731 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 768/1660] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:50.318090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7dd1cef9-e80c-4b3a-89fd-856b6a1bbb36 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:50.319893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7dd1cef9-e80c-4b3a-89fd-856b6a1bbb36 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:50.336606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7dd1cef9-e80c-4b3a-89fd-856b6a1bbb36 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:50.338001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7dd1cef9-e80c-4b3a-89fd-856b6a1bbb36 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:50.340241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7dd1cef9-e80c-4b3a-89fd-856b6a1bbb36 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:50.347353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7dd1cef9-e80c-4b3a-89fd-856b6a1bbb36 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:51.217364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] validate_networks() for [('83c7273c-aafc-4ef1-9242-4a04f5076ae9', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:11:52.231882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7dd1cef9-e80c-4b3a-89fd-856b6a1bbb36 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:52.272143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7dd1cef9-e80c-4b3a-89fd-856b6a1bbb36 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:52.276500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7dd1cef9-e80c-4b3a-89fd-856b6a1bbb36 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:52.280281 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7dd1cef9-e80c-4b3a-89fd-856b6a1bbb36 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.969739 Jul 26 14:11:52.296538 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 769/1661] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:50 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:52.327168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-48c1d026-e4a6-4474-ad25-7e4b27938bd7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:52.328282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-48c1d026-e4a6-4474-ad25-7e4b27938bd7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:52.354445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48c1d026-e4a6-4474-ad25-7e4b27938bd7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:52.355209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48c1d026-e4a6-4474-ad25-7e4b27938bd7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:52.358014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48c1d026-e4a6-4474-ad25-7e4b27938bd7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:52.358885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48c1d026-e4a6-4474-ad25-7e4b27938bd7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:52.954188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=20 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:53.066882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=10 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:53.430682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-48c1d026-e4a6-4474-ad25-7e4b27938bd7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:53.440945 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-48c1d026-e4a6-4474-ad25-7e4b27938bd7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1316 microversion: 2.1 time: 1.132099 Jul 26 14:11:53.443160 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 770/1662] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:52 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1316 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:53.449340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7193952e-b293-4eb3-8337-9b19802e3dba tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:53.457748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7193952e-b293-4eb3-8337-9b19802e3dba tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:53.482044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7193952e-b293-4eb3-8337-9b19802e3dba tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:53.482656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7193952e-b293-4eb3-8337-9b19802e3dba tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:53.483579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7193952e-b293-4eb3-8337-9b19802e3dba tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:53.484482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7193952e-b293-4eb3-8337-9b19802e3dba tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:53.492112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:53.871017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7193952e-b293-4eb3-8337-9b19802e3dba tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:53.889874 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7193952e-b293-4eb3-8337-9b19802e3dba tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1283 microversion: 2.1 time: 0.445074 Jul 26 14:11:53.896219 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 771/1663] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:53 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1283 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:53.908165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71bd6259-2df1-4b91-b00f-585b7afdf0c3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:53.909031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-71bd6259-2df1-4b91-b00f-585b7afdf0c3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: c9ca67a8-07b3-4fe6-bd12-767b7985ab61] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:53.927921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71bd6259-2df1-4b91-b00f-585b7afdf0c3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:53.930444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71bd6259-2df1-4b91-b00f-585b7afdf0c3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:53.933434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71bd6259-2df1-4b91-b00f-585b7afdf0c3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:53.934263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71bd6259-2df1-4b91-b00f-585b7afdf0c3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:53.961695 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-71bd6259-2df1-4b91-b00f-585b7afdf0c3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] HTTP exception thrown: Instance c9ca67a8-07b3-4fe6-bd12-767b7985ab61 could not be found. Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71bd6259-2df1-4b91-b00f-585b7afdf0c3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Request method failure captured: Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 HTTP/1.1 Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_WLr5RUVX50xkUt6oVZ8BTuE5TrJa7nGDguGxZhT36eU4IVCLTxd0UCOVa_kRoiTe4CSAfuon4J2KJI455hr3qBzWStBBFF1n6V4tVCtIijRdxkXUlDrpsTjVrvGFyVqLlsR1WbAoz4waJfMoUH14_KlL9hDJQ8G61M6sPeL-4Xl1Q Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a1df297aa8b6421da531e980c89c7051 Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ListServerFiltersTestJSON-1694090546 Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a1df297aa8b6421da531e980c89c7051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a1df297aa8b6421da531e980c89c7051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a1df297aa8b6421da531e980c89c7051", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a1df297aa8b6421da531e980c89c7051"}]}] Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ListServerFiltersTestJSON-1694090546 Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a1df297aa8b6421da531e980c89c7051 Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1694090546 Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ListServerFiltersTestJSON-1694090546-project Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f31a364ff6c247a4a9fcb9f4d99c3464 Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ListServerFiltersTestJSON-1694090546-project Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance c9ca67a8-07b3-4fe6-bd12-767b7985ab61 could not be found. Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c9ca67a8-07b3-4fe6-bd12-767b7985ab61'} Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9ca67a8-07b3-4fe6-bd12-767b7985ab61 could not be found. Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9ca67a8-07b3-4fe6-bd12-767b7985ab61 could not be found. Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:53.965654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:53.971831 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:53.971831 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:53.971831 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:53.971831 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:11:53.971831 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:11:53.971831 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9ca67a8-07b3-4fe6-bd12-767b7985ab61 could not be found. Jul 26 14:11:53.971831 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:53.971831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71bd6259-2df1-4b91-b00f-585b7afdf0c3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Returning 404 to user: Instance c9ca67a8-07b3-4fe6-bd12-767b7985ab61 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:11:53.971831 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-71bd6259-2df1-4b91-b00f-585b7afdf0c3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61" status: 404 len: 111 microversion: 2.1 time: 0.069678 Jul 26 14:11:53.976045 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 772/1664] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:53 2022] GET /compute/v2.1/servers/c9ca67a8-07b3-4fe6-bd12-767b7985ab61 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:11:53.988033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e4b277bd-f889-4efb-88a8-72b4456359d7 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:53.988795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e4b277bd-f889-4efb-88a8-72b4456359d7 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:54.012145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4b277bd-f889-4efb-88a8-72b4456359d7 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:54.012707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4b277bd-f889-4efb-88a8-72b4456359d7 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:54.013716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4b277bd-f889-4efb-88a8-72b4456359d7 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:54.014235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4b277bd-f889-4efb-88a8-72b4456359d7 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:54.842585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e4b277bd-f889-4efb-88a8-72b4456359d7 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41d238b43c541029fc35e90604a0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8d5031d9064b94a6455e3c1dfcf9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:54.854125 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e4b277bd-f889-4efb-88a8-72b4456359d7 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 200 len: 1314 microversion: 2.1 time: 0.875602 Jul 26 14:11:54.860247 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 773/1665] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:53 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:54.866591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3d61434-2696-4547-a7c9-bf1d28412306 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:54.867278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f3d61434-2696-4547-a7c9-bf1d28412306 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: 807e080b-51bc-48e9-9b38-a4c49734b15d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:54.875084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3d61434-2696-4547-a7c9-bf1d28412306 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:54.875540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3d61434-2696-4547-a7c9-bf1d28412306 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:54.876608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3d61434-2696-4547-a7c9-bf1d28412306 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:54.877243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3d61434-2696-4547-a7c9-bf1d28412306 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:54.896718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Getting quotas for project 6d3d4870c41848059f09cb025a2251f4. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:11:54.908771 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-f3d61434-2696-4547-a7c9-bf1d28412306 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] HTTP exception thrown: Instance 807e080b-51bc-48e9-9b38-a4c49734b15d could not be found. Jul 26 14:11:54.909987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Getting quotas for user addd82517c33447caa2d0dcbb0379baf and project 6d3d4870c41848059f09cb025a2251f4. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3d61434-2696-4547-a7c9-bf1d28412306 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Request method failure captured: Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d HTTP/1.1 Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VZSf-g9xJyBEV0pI7LgKDY3vpvqbGcZ_pIaLfe0pNx05-K67L3t_GY3v_XliGDBc2OPPYZlHq2XfXmKoMZd88H9rGqqeTkXLx_y-oLq7YKgNtWFCSQHMk_j0Klmuqt4a56zm7kc_xD-OUYhqndlZnVUCGvmxL4n3ikupwLaXtKhLs Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 808a7de5ab4d4088be3f5ea8e46c89c0 Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ListImageFiltersTestJSON-1434129766 Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/808a7de5ab4d4088be3f5ea8e46c89c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/808a7de5ab4d4088be3f5ea8e46c89c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_808a7de5ab4d4088be3f5ea8e46c89c0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/808a7de5ab4d4088be3f5ea8e46c89c0"}]}] Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ListImageFiltersTestJSON-1434129766 Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 808a7de5ab4d4088be3f5ea8e46c89c0 Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1434129766 Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ListImageFiltersTestJSON-1434129766-project Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 0ee81280d69849688f68653a7a985805 Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ListImageFiltersTestJSON-1434129766-project Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 807e080b-51bc-48e9-9b38-a4c49734b15d could not be found. Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '807e080b-51bc-48e9-9b38-a4c49734b15d'} Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807e080b-51bc-48e9-9b38-a4c49734b15d could not be found. Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807e080b-51bc-48e9-9b38-a4c49734b15d could not be found. Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:11:54.910801 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807e080b-51bc-48e9-9b38-a4c49734b15d could not be found. Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3d61434-2696-4547-a7c9-bf1d28412306 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Returning 404 to user: Instance 807e080b-51bc-48e9-9b38-a4c49734b15d could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f3d61434-2696-4547-a7c9-bf1d28412306 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d" status: 404 len: 111 microversion: 2.1 time: 0.056167 Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 774/1666] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:54 2022] GET /compute/v2.1/servers/807e080b-51bc-48e9-9b38-a4c49734b15d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:11:54.927114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-28abf8ed-cfbd-41d3-8e07-eb97e7d74177 req-75b50dc9-3880-4a81-bc53-0d88b8fd70f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e080b-51bc-48e9-9b38-a4c49734b15d", "name": "network-vif-deleted", "tag": "54d86a16-b218-474f-8fa1-ab8322e59564"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:54.934456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-28abf8ed-cfbd-41d3-8e07-eb97e7d74177 req-75b50dc9-3880-4a81-bc53-0d88b8fd70f9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:54.934907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-28abf8ed-cfbd-41d3-8e07-eb97e7d74177 req-75b50dc9-3880-4a81-bc53-0d88b8fd70f9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:54.960169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:11:54.962420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:11:54.964203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:11:54.964437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:11:54.965396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:11:54.975623 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-28abf8ed-cfbd-41d3-8e07-eb97e7d74177 req-75b50dc9-3880-4a81-bc53-0d88b8fd70f9 service nova] Creating event network-vif-deleted:54d86a16-b218-474f-8fa1-ab8322e59564 for instance 807e080b-51bc-48e9-9b38-a4c49734b15d on n-h2-833090-9 Jul 26 14:11:54.989759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:54.991505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:54.992483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:54.992927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:54.994564 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-28abf8ed-cfbd-41d3-8e07-eb97e7d74177 req-75b50dc9-3880-4a81-bc53-0d88b8fd70f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077518 Jul 26 14:11:55.003091 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 775/1667] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:55.013881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d321236f-1624-49d6-8304-15319522e87f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:55.015261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d321236f-1624-49d6-8304-15319522e87f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:55.016134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Getting quotas for project 6d3d4870c41848059f09cb025a2251f4. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:11:55.026639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d321236f-1624-49d6-8304-15319522e87f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:55.027764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d321236f-1624-49d6-8304-15319522e87f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:55.029345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d321236f-1624-49d6-8304-15319522e87f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:55.030339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d321236f-1624-49d6-8304-15319522e87f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:55.036437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Getting quotas for user addd82517c33447caa2d0dcbb0379baf and project 6d3d4870c41848059f09cb025a2251f4. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:11:55.071548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:11:55.081383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:11:55.192059 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ee878ae8-14e3-4a9e-8227-aff45384a78f tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.274678 Jul 26 14:11:55.193632 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 893/1668] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:11:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 5288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:11:55.201316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-260639f4-32fa-4af9-a3a9-6adc47fdf31f req-83152228-9100-41c1-b95b-f9aede1af416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "722480e6-d20a-4961-8c4b-a2e5f3a3964d", "tag": "d700de43-19cd-4880-91fd-ae3d7ba0c8bb"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:55.219153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-260639f4-32fa-4af9-a3a9-6adc47fdf31f req-83152228-9100-41c1-b95b-f9aede1af416 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:55.220277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-260639f4-32fa-4af9-a3a9-6adc47fdf31f req-83152228-9100-41c1-b95b-f9aede1af416 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:55.236850 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-260639f4-32fa-4af9-a3a9-6adc47fdf31f req-83152228-9100-41c1-b95b-f9aede1af416 service nova] Creating event network-changed:d700de43-19cd-4880-91fd-ae3d7ba0c8bb for instance 722480e6-d20a-4961-8c4b-a2e5f3a3964d on n-h2-833090-9 Jul 26 14:11:55.246984 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-260639f4-32fa-4af9-a3a9-6adc47fdf31f req-83152228-9100-41c1-b95b-f9aede1af416 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049400 Jul 26 14:11:55.248462 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 894/1669] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:55.275658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-79b82df4-d909-4794-98a4-908242b0164f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:55.281292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79b82df4-d909-4794-98a4-908242b0164f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 54be76f6-dd14-406f-8f42-ed989a168646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:55.291352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79b82df4-d909-4794-98a4-908242b0164f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:55.292463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79b82df4-d909-4794-98a4-908242b0164f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:55.293552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79b82df4-d909-4794-98a4-908242b0164f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:55.294228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79b82df4-d909-4794-98a4-908242b0164f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:55.367205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79b82df4-d909-4794-98a4-908242b0164f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 54be76f6-dd14-406f-8f42-ed989a168646] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:11:55.445598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:55.511048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d321236f-1624-49d6-8304-15319522e87f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:55.534101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d321236f-1624-49d6-8304-15319522e87f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:55.538199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d321236f-1624-49d6-8304-15319522e87f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:55.540353 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d321236f-1624-49d6-8304-15319522e87f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.534016 Jul 26 14:11:55.546293 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-79b82df4-d909-4794-98a4-908242b0164f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "DELETE /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646" status: 204 len: 0 microversion: 2.1 time: 0.289343 Jul 26 14:11:55.548977 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 776/1670] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:55 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:55.552837 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 895/1671] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:11:55 2022] DELETE /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:11:55.560687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3630c3c3-6451-40a3-984d-401c34051b27 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:55.562453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3630c3c3-6451-40a3-984d-401c34051b27 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:55.572237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fedf9c29-5a6a-4ac6-8ef7-eb4992d9f9b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:55.573033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3630c3c3-6451-40a3-984d-401c34051b27 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:55.573557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fedf9c29-5a6a-4ac6-8ef7-eb4992d9f9b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:55.573804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3630c3c3-6451-40a3-984d-401c34051b27 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:55.575223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3630c3c3-6451-40a3-984d-401c34051b27 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:55.576031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3630c3c3-6451-40a3-984d-401c34051b27 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:55.598196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fedf9c29-5a6a-4ac6-8ef7-eb4992d9f9b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:55.599117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fedf9c29-5a6a-4ac6-8ef7-eb4992d9f9b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:55.600011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fedf9c29-5a6a-4ac6-8ef7-eb4992d9f9b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:55.600464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fedf9c29-5a6a-4ac6-8ef7-eb4992d9f9b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:56.087131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3630c3c3-6451-40a3-984d-401c34051b27 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:56.096884 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3630c3c3-6451-40a3-984d-401c34051b27 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1325 microversion: 2.1 time: 0.542956 Jul 26 14:11:56.097641 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 896/1672] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:55 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1325 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:56.103686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-047568a2-00b6-422b-810b-a6e9587bee49 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:56.104540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-047568a2-00b6-422b-810b-a6e9587bee49 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:56.112237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-047568a2-00b6-422b-810b-a6e9587bee49 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:56.112914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-047568a2-00b6-422b-810b-a6e9587bee49 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:56.113813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-047568a2-00b6-422b-810b-a6e9587bee49 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:56.114374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-047568a2-00b6-422b-810b-a6e9587bee49 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:56.140951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fedf9c29-5a6a-4ac6-8ef7-eb4992d9f9b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:56.163310 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fedf9c29-5a6a-4ac6-8ef7-eb4992d9f9b4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1316 microversion: 2.1 time: 0.610154 Jul 26 14:11:56.167217 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 777/1673] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:55 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1316 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:56.185239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-047568a2-00b6-422b-810b-a6e9587bee49 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:11:56.190665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f981eb6d-41f1-480f-bb34-f2e90c1dd7a3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:56.194808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f981eb6d-41f1-480f-bb34-f2e90c1dd7a3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:56.209749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f981eb6d-41f1-480f-bb34-f2e90c1dd7a3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:56.210129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f981eb6d-41f1-480f-bb34-f2e90c1dd7a3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:56.210931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f981eb6d-41f1-480f-bb34-f2e90c1dd7a3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:56.211567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f981eb6d-41f1-480f-bb34-f2e90c1dd7a3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:56.324007 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-047568a2-00b6-422b-810b-a6e9587bee49 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2" status: 204 len: 0 microversion: 2.1 time: 0.221674 Jul 26 14:11:56.324007 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 897/1674] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:11:56 2022] DELETE /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:11:56.329738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d2eec158-8c63-4e43-b916-e1d08ff7a51d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:56.330549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d2eec158-8c63-4e43-b916-e1d08ff7a51d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 54be76f6-dd14-406f-8f42-ed989a168646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:56.338883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2eec158-8c63-4e43-b916-e1d08ff7a51d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:56.339823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2eec158-8c63-4e43-b916-e1d08ff7a51d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:56.340724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2eec158-8c63-4e43-b916-e1d08ff7a51d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:56.341279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2eec158-8c63-4e43-b916-e1d08ff7a51d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:56.608203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f981eb6d-41f1-480f-bb34-f2e90c1dd7a3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:56.623543 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f981eb6d-41f1-480f-bb34-f2e90c1dd7a3 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1281 microversion: 2.1 time: 0.440750 Jul 26 14:11:56.625947 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 778/1675] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:56 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1281 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:56.640425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1733862e-7bac-4280-b4f6-393bc8738228 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:56.642409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1733862e-7bac-4280-b4f6-393bc8738228 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:56.659437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1733862e-7bac-4280-b4f6-393bc8738228 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:56.660492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1733862e-7bac-4280-b4f6-393bc8738228 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:56.661757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1733862e-7bac-4280-b4f6-393bc8738228 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:56.662587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1733862e-7bac-4280-b4f6-393bc8738228 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:56.789662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:56.864324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d2eec158-8c63-4e43-b916-e1d08ff7a51d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:56.883610 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d2eec158-8c63-4e43-b916-e1d08ff7a51d tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646" status: 200 len: 1518 microversion: 2.1 time: 0.559118 Jul 26 14:11:56.896674 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 898/1676] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:56 2022] GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646 => generated 1518 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:56.913846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3a32c3db-da5a-4c66-8768-0f4874555ef0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:56.915258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3a32c3db-da5a-4c66-8768-0f4874555ef0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:56.922286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a32c3db-da5a-4c66-8768-0f4874555ef0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:56.923200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a32c3db-da5a-4c66-8768-0f4874555ef0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:56.924311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a32c3db-da5a-4c66-8768-0f4874555ef0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:56.925866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a32c3db-da5a-4c66-8768-0f4874555ef0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:57.061789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1733862e-7bac-4280-b4f6-393bc8738228 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41d238b43c541029fc35e90604a0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8d5031d9064b94a6455e3c1dfcf9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:57.077376 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1733862e-7bac-4280-b4f6-393bc8738228 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 200 len: 1314 microversion: 2.1 time: 0.446832 Jul 26 14:11:57.078173 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 779/1677] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:56 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:57.087462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cbaae9c2-4a55-4b05-a34e-47e613912322 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:57.090475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cbaae9c2-4a55-4b05-a34e-47e613912322 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:57.115184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbaae9c2-4a55-4b05-a34e-47e613912322 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:57.115646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbaae9c2-4a55-4b05-a34e-47e613912322 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:57.116490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbaae9c2-4a55-4b05-a34e-47e613912322 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:57.116934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbaae9c2-4a55-4b05-a34e-47e613912322 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:57.279169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3a32c3db-da5a-4c66-8768-0f4874555ef0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:57.312222 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3a32c3db-da5a-4c66-8768-0f4874555ef0 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2" status: 200 len: 1474 microversion: 2.1 time: 0.413810 Jul 26 14:11:57.313561 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 899/1678] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:56 2022] GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2 => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:57.320996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-043a4059-ba07-4c77-aef2-f6445013d194 req-a37dd98e-ee8e-4278-a5e1-e37761545b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22136b43-c874-45fe-9260-c2dfc8ab92d3", "tag": "2f932df7-b17d-4486-8f3c-29667f0b4f87"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:11:57.333364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-043a4059-ba07-4c77-aef2-f6445013d194 req-a37dd98e-ee8e-4278-a5e1-e37761545b63 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:57.335395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-043a4059-ba07-4c77-aef2-f6445013d194 req-a37dd98e-ee8e-4278-a5e1-e37761545b63 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:57.354379 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-043a4059-ba07-4c77-aef2-f6445013d194 req-a37dd98e-ee8e-4278-a5e1-e37761545b63 service nova] Creating event network-changed:2f932df7-b17d-4486-8f3c-29667f0b4f87 for instance 22136b43-c874-45fe-9260-c2dfc8ab92d3 on n-h1-833090-9 Jul 26 14:11:57.364815 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-043a4059-ba07-4c77-aef2-f6445013d194 req-a37dd98e-ee8e-4278-a5e1-e37761545b63 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047472 Jul 26 14:11:57.367183 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 900/1679] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:11:57.374009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed308b13-b71f-46a3-921a-87531089ecd5 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:57.374950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ed308b13-b71f-46a3-921a-87531089ecd5 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:57.387999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed308b13-b71f-46a3-921a-87531089ecd5 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:57.388740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed308b13-b71f-46a3-921a-87531089ecd5 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:57.390058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed308b13-b71f-46a3-921a-87531089ecd5 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:57.390790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed308b13-b71f-46a3-921a-87531089ecd5 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:57.683865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cbaae9c2-4a55-4b05-a34e-47e613912322 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:57.758483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cbaae9c2-4a55-4b05-a34e-47e613912322 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:57.762142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cbaae9c2-4a55-4b05-a34e-47e613912322 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:57.770041 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cbaae9c2-4a55-4b05-a34e-47e613912322 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.689714 Jul 26 14:11:57.788739 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 780/1680] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:11:57 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:11:57.811821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-debebab6-1476-44de-a9d2-35c5e4632503 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:57.813804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-debebab6-1476-44de-a9d2-35c5e4632503 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:57.835152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-debebab6-1476-44de-a9d2-35c5e4632503 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:57.839187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-debebab6-1476-44de-a9d2-35c5e4632503 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:57.840401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-debebab6-1476-44de-a9d2-35c5e4632503 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:57.849509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-debebab6-1476-44de-a9d2-35c5e4632503 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:58.137990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ed308b13-b71f-46a3-921a-87531089ecd5 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:58.168494 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed308b13-b71f-46a3-921a-87531089ecd5 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1325 microversion: 2.1 time: 0.798757 Jul 26 14:11:58.184655 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 901/1681] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:57 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1325 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:58.206651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-40d4a8fe-e4f4-4e4a-9360-a7002537200c tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:58.208157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-40d4a8fe-e4f4-4e4a-9360-a7002537200c tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:58.223257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40d4a8fe-e4f4-4e4a-9360-a7002537200c tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:58.224441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40d4a8fe-e4f4-4e4a-9360-a7002537200c tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:58.226218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40d4a8fe-e4f4-4e4a-9360-a7002537200c tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:58.227324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40d4a8fe-e4f4-4e4a-9360-a7002537200c tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:58.476611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-40d4a8fe-e4f4-4e4a-9360-a7002537200c tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:58.493618 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-40d4a8fe-e4f4-4e4a-9360-a7002537200c tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1337 microversion: 2.1 time: 0.306597 Jul 26 14:11:58.505096 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 902/1682] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:58 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1337 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:58.514256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6e1bfdab-f0a5-46c8-876d-a9699b03f433 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:58.537478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6e1bfdab-f0a5-46c8-876d-a9699b03f433 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 54be76f6-dd14-406f-8f42-ed989a168646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:58.559669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e1bfdab-f0a5-46c8-876d-a9699b03f433 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:58.561094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e1bfdab-f0a5-46c8-876d-a9699b03f433 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:58.562649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e1bfdab-f0a5-46c8-876d-a9699b03f433 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:58.563696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e1bfdab-f0a5-46c8-876d-a9699b03f433 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:58.991468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:11:59.006638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6e1bfdab-f0a5-46c8-876d-a9699b03f433 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:59.035025 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6e1bfdab-f0a5-46c8-876d-a9699b03f433 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646" status: 200 len: 1518 microversion: 2.1 time: 0.522224 Jul 26 14:11:59.047996 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 903/1683] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:58 2022] GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646 => generated 1518 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:59.055996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-842937d4-4e9c-4836-b496-7089d5d10606 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:59.055996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-842937d4-4e9c-4836-b496-7089d5d10606 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:59.076249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-842937d4-4e9c-4836-b496-7089d5d10606 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:59.076716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-842937d4-4e9c-4836-b496-7089d5d10606 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:59.077527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-842937d4-4e9c-4836-b496-7089d5d10606 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:59.086313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-842937d4-4e9c-4836-b496-7089d5d10606 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:59.309445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-debebab6-1476-44de-a9d2-35c5e4632503 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:11:59.334436 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-debebab6-1476-44de-a9d2-35c5e4632503 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1316 microversion: 2.1 time: 1.540376 Jul 26 14:11:59.337697 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 781/1684] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:57 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1316 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:11:59.382452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ed83acc1-6b12-4edf-8dd8-6cb7e2a50381 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:11:59.386068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ed83acc1-6b12-4edf-8dd8-6cb7e2a50381 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:11:59.413704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed83acc1-6b12-4edf-8dd8-6cb7e2a50381 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:59.416481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed83acc1-6b12-4edf-8dd8-6cb7e2a50381 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:11:59.425277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed83acc1-6b12-4edf-8dd8-6cb7e2a50381 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:11:59.429679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed83acc1-6b12-4edf-8dd8-6cb7e2a50381 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:00.094105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-842937d4-4e9c-4836-b496-7089d5d10606 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41d238b43c541029fc35e90604a0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8d5031d9064b94a6455e3c1dfcf9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:00.108185 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-842937d4-4e9c-4836-b496-7089d5d10606 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 200 len: 1314 microversion: 2.1 time: 1.067046 Jul 26 14:12:00.110394 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 904/1685] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:59 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 1314 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:00.121734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-80e7247e-c603-4de0-9e4c-75a9269fe351 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:00.123903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-80e7247e-c603-4de0-9e4c-75a9269fe351 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:00.143636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80e7247e-c603-4de0-9e4c-75a9269fe351 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:00.145545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80e7247e-c603-4de0-9e4c-75a9269fe351 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:00.147346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80e7247e-c603-4de0-9e4c-75a9269fe351 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:00.148312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80e7247e-c603-4de0-9e4c-75a9269fe351 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:00.364454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ed83acc1-6b12-4edf-8dd8-6cb7e2a50381 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:00.387196 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ed83acc1-6b12-4edf-8dd8-6cb7e2a50381 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2" status: 200 len: 1474 microversion: 2.1 time: 1.016178 Jul 26 14:12:00.409155 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 782/1686] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:11:59 2022] GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2 => generated 1474 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:00.418527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e7cd2ac3-d657-40a5-8df3-d37afa374089 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:00.420195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e7cd2ac3-d657-40a5-8df3-d37afa374089 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:00.445657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7cd2ac3-d657-40a5-8df3-d37afa374089 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:00.446997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7cd2ac3-d657-40a5-8df3-d37afa374089 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:00.448834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7cd2ac3-d657-40a5-8df3-d37afa374089 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:00.449973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7cd2ac3-d657-40a5-8df3-d37afa374089 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:01.164950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-80e7247e-c603-4de0-9e4c-75a9269fe351 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:01.200398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-80e7247e-c603-4de0-9e4c-75a9269fe351 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:01.207930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-80e7247e-c603-4de0-9e4c-75a9269fe351 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:01.210222 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-80e7247e-c603-4de0-9e4c-75a9269fe351 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.098257 Jul 26 14:12:01.213348 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 905/1687] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:00 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:01.219908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9a96b6e7-7c6d-40d7-bf4c-5c6e312e6a01 req-2787a069-56cc-4cc4-8908-553d6c25026e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54be76f6-dd14-406f-8f42-ed989a168646", "name": "network-vif-deleted", "tag": "02020283-6f6d-4844-b9f2-c0fbdd431fce"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:01.235271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9a96b6e7-7c6d-40d7-bf4c-5c6e312e6a01 req-2787a069-56cc-4cc4-8908-553d6c25026e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:01.236136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9a96b6e7-7c6d-40d7-bf4c-5c6e312e6a01 req-2787a069-56cc-4cc4-8908-553d6c25026e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:01.271319 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9a96b6e7-7c6d-40d7-bf4c-5c6e312e6a01 req-2787a069-56cc-4cc4-8908-553d6c25026e service nova] Creating event network-vif-deleted:02020283-6f6d-4844-b9f2-c0fbdd431fce for instance 54be76f6-dd14-406f-8f42-ed989a168646 on n-h1-833090-9 Jul 26 14:12:01.282973 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9a96b6e7-7c6d-40d7-bf4c-5c6e312e6a01 req-2787a069-56cc-4cc4-8908-553d6c25026e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067923 Jul 26 14:12:01.283609 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 906/1688] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:01.297867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0ec90ba8-10c4-4b6e-b2ba-ae857dfd03fe tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:01.299053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0ec90ba8-10c4-4b6e-b2ba-ae857dfd03fe tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:01.348322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ec90ba8-10c4-4b6e-b2ba-ae857dfd03fe tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:01.351419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ec90ba8-10c4-4b6e-b2ba-ae857dfd03fe tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:01.355594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ec90ba8-10c4-4b6e-b2ba-ae857dfd03fe tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:01.357431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ec90ba8-10c4-4b6e-b2ba-ae857dfd03fe tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:01.683541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e7cd2ac3-d657-40a5-8df3-d37afa374089 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:01.697112 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e7cd2ac3-d657-40a5-8df3-d37afa374089 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1325 microversion: 2.1 time: 1.285861 Jul 26 14:12:01.699043 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 783/1689] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:00 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1325 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:01.718451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3e1addcc-ba21-4a16-aa2c-6d6d0447f5e2 req-50b40b43-5db3-4ad9-987e-eb528539f3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a089b93c-78b2-42bd-8381-e81d17ca5d8b", "tag": "d31bb287-ed78-423c-9ebb-7e057c85ea9b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:01.746304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3e1addcc-ba21-4a16-aa2c-6d6d0447f5e2 req-50b40b43-5db3-4ad9-987e-eb528539f3f2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:01.747177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3e1addcc-ba21-4a16-aa2c-6d6d0447f5e2 req-50b40b43-5db3-4ad9-987e-eb528539f3f2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:01.804582 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3e1addcc-ba21-4a16-aa2c-6d6d0447f5e2 req-50b40b43-5db3-4ad9-987e-eb528539f3f2 service nova] Creating event network-changed:d31bb287-ed78-423c-9ebb-7e057c85ea9b for instance a089b93c-78b2-42bd-8381-e81d17ca5d8b on n-h1-833090-9 Jul 26 14:12:01.824083 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3e1addcc-ba21-4a16-aa2c-6d6d0447f5e2 req-50b40b43-5db3-4ad9-987e-eb528539f3f2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116548 Jul 26 14:12:01.832041 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 784/1690] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:01.853202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b221a028-b580-45a8-8aac-cdd8cdbf87e3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:01.854441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b221a028-b580-45a8-8aac-cdd8cdbf87e3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 54be76f6-dd14-406f-8f42-ed989a168646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:01.864391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b221a028-b580-45a8-8aac-cdd8cdbf87e3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:01.865146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b221a028-b580-45a8-8aac-cdd8cdbf87e3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:01.866180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b221a028-b580-45a8-8aac-cdd8cdbf87e3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:01.866860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b221a028-b580-45a8-8aac-cdd8cdbf87e3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:01.894882 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b221a028-b580-45a8-8aac-cdd8cdbf87e3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] HTTP exception thrown: Instance 54be76f6-dd14-406f-8f42-ed989a168646 could not be found. Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b221a028-b580-45a8-8aac-cdd8cdbf87e3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Request method failure captured: Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646 HTTP/1.1 Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_WLr5RUVX50xkUt6oVZ8BTuE5TrJa7nGDguGxZhT36eU4IVCLTxd0UCOVa_kRoiTe4CSAfuon4J2KJI455hr3qBzWStBBFF1n6V4tVCtIijRdxkXUlDrpsTjVrvGFyVqLlsR1WbAoz4waJfMoUH14_KlL9hDJQ8G61M6sPeL-4Xl1Q Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a1df297aa8b6421da531e980c89c7051 Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ListServerFiltersTestJSON-1694090546 Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a1df297aa8b6421da531e980c89c7051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a1df297aa8b6421da531e980c89c7051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a1df297aa8b6421da531e980c89c7051", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a1df297aa8b6421da531e980c89c7051"}]}] Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ListServerFiltersTestJSON-1694090546 Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a1df297aa8b6421da531e980c89c7051 Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1694090546 Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ListServerFiltersTestJSON-1694090546-project Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f31a364ff6c247a4a9fcb9f4d99c3464 Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ListServerFiltersTestJSON-1694090546-project Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 54be76f6-dd14-406f-8f42-ed989a168646 could not be found. Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '54be76f6-dd14-406f-8f42-ed989a168646'} Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54be76f6-dd14-406f-8f42-ed989a168646 could not be found. Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54be76f6-dd14-406f-8f42-ed989a168646 could not be found. Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:01.897076 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:01.903318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:01.903318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:01.903318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:01.903318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:01.903318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:01.903318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54be76f6-dd14-406f-8f42-ed989a168646 could not be found. Jul 26 14:12:01.903318 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:01.905583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b221a028-b580-45a8-8aac-cdd8cdbf87e3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Returning 404 to user: Instance 54be76f6-dd14-406f-8f42-ed989a168646 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:01.906749 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b221a028-b580-45a8-8aac-cdd8cdbf87e3 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646" status: 404 len: 111 microversion: 2.1 time: 0.070571 Jul 26 14:12:01.908327 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 785/1691] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:01 2022] GET /compute/v2.1/servers/54be76f6-dd14-406f-8f42-ed989a168646 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:01.914618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c951ddc-b719-4210-b80d-cfd2807498d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:01.915641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c951ddc-b719-4210-b80d-cfd2807498d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:01.923718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c951ddc-b719-4210-b80d-cfd2807498d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:01.925566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c951ddc-b719-4210-b80d-cfd2807498d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:01.927231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c951ddc-b719-4210-b80d-cfd2807498d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:01.928103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c951ddc-b719-4210-b80d-cfd2807498d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.060150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ec90ba8-10c4-4b6e-b2ba-ae857dfd03fe tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:02.072613 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0ec90ba8-10c4-4b6e-b2ba-ae857dfd03fe tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1403 microversion: 2.1 time: 0.783983 Jul 26 14:12:02.074119 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 907/1692] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:01 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1403 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:02.078919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2e5d82bc-3d5a-469b-be1d-c6ffda6a0612 req-bb54a786-3d28-45c7-b09d-5194bc3deba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22136b43-c874-45fe-9260-c2dfc8ab92d3", "name": "network-vif-plugged", "status": "completed", "tag": "2f932df7-b17d-4486-8f3c-29667f0b4f87"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:02.108105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2e5d82bc-3d5a-469b-be1d-c6ffda6a0612 req-bb54a786-3d28-45c7-b09d-5194bc3deba8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.108906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2e5d82bc-3d5a-469b-be1d-c6ffda6a0612 req-bb54a786-3d28-45c7-b09d-5194bc3deba8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.124251 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2e5d82bc-3d5a-469b-be1d-c6ffda6a0612 req-bb54a786-3d28-45c7-b09d-5194bc3deba8 service nova] Creating event network-vif-plugged:2f932df7-b17d-4486-8f3c-29667f0b4f87 for instance 22136b43-c874-45fe-9260-c2dfc8ab92d3 on n-h1-833090-9 Jul 26 14:12:02.132987 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2e5d82bc-3d5a-469b-be1d-c6ffda6a0612 req-bb54a786-3d28-45c7-b09d-5194bc3deba8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057309 Jul 26 14:12:02.134233 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 908/1693] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:02.144020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f8155f37-e984-4e50-b2ee-f1e7e241209a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:02.144974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f8155f37-e984-4e50-b2ee-f1e7e241209a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:02.153798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8155f37-e984-4e50-b2ee-f1e7e241209a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.154430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8155f37-e984-4e50-b2ee-f1e7e241209a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.155772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8155f37-e984-4e50-b2ee-f1e7e241209a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.156427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8155f37-e984-4e50-b2ee-f1e7e241209a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.559988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c951ddc-b719-4210-b80d-cfd2807498d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:02.569750 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2c951ddc-b719-4210-b80d-cfd2807498d6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1316 microversion: 2.1 time: 0.659451 Jul 26 14:12:02.570332 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 786/1694] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:01 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:02.592815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bccfc62c-990f-4ead-bd04-bae388485215 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:02.594771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bccfc62c-990f-4ead-bd04-bae388485215 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:02.607914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bccfc62c-990f-4ead-bd04-bae388485215 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.612110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bccfc62c-990f-4ead-bd04-bae388485215 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.614875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bccfc62c-990f-4ead-bd04-bae388485215 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.619098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bccfc62c-990f-4ead-bd04-bae388485215 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.677682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f8155f37-e984-4e50-b2ee-f1e7e241209a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41d238b43c541029fc35e90604a0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8d5031d9064b94a6455e3c1dfcf9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:02.692526 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f8155f37-e984-4e50-b2ee-f1e7e241209a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 200 len: 1314 microversion: 2.1 time: 0.556722 Jul 26 14:12:02.704973 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 909/1695] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:02 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:02.710786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cdc6ae8e-0107-4b45-89eb-b6cd8b500723 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:02.711562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cdc6ae8e-0107-4b45-89eb-b6cd8b500723 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:02.731019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:02.732722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdc6ae8e-0107-4b45-89eb-b6cd8b500723 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.733225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdc6ae8e-0107-4b45-89eb-b6cd8b500723 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.734287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdc6ae8e-0107-4b45-89eb-b6cd8b500723 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.734788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdc6ae8e-0107-4b45-89eb-b6cd8b500723 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.776090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cdc6ae8e-0107-4b45-89eb-b6cd8b500723 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:02.841877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:02.857707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bccfc62c-990f-4ead-bd04-bae388485215 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:02.868477 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bccfc62c-990f-4ead-bd04-bae388485215 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2" status: 200 len: 1303 microversion: 2.1 time: 0.293152 Jul 26 14:12:02.869088 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 787/1696] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:02 2022] GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2 => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:02.888901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1dab8817-5d16-4404-8d70-bc86d29aab85 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:02.889898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1dab8817-5d16-4404-8d70-bc86d29aab85 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:02.897924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dab8817-5d16-4404-8d70-bc86d29aab85 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.898378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dab8817-5d16-4404-8d70-bc86d29aab85 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.899434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dab8817-5d16-4404-8d70-bc86d29aab85 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.901043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dab8817-5d16-4404-8d70-bc86d29aab85 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.940949 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cdc6ae8e-0107-4b45-89eb-b6cd8b500723 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "DELETE /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 204 len: 0 microversion: 2.1 time: 0.231978 Jul 26 14:12:02.942076 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 910/1697] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:02 2022] DELETE /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:02.956006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fdf8dd69-d802-47d2-9156-306f151fa94c tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:02.957075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fdf8dd69-d802-47d2-9156-306f151fa94c tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:02.973482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdf8dd69-d802-47d2-9156-306f151fa94c tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.974382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdf8dd69-d802-47d2-9156-306f151fa94c tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:02.975517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdf8dd69-d802-47d2-9156-306f151fa94c tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:02.976298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdf8dd69-d802-47d2-9156-306f151fa94c tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:03.339607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1dab8817-5d16-4404-8d70-bc86d29aab85 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:03.351668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1dab8817-5d16-4404-8d70-bc86d29aab85 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:03.353574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1dab8817-5d16-4404-8d70-bc86d29aab85 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:03.355442 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1dab8817-5d16-4404-8d70-bc86d29aab85 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.470814 Jul 26 14:12:03.355664 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 788/1698] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:02 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:03.362961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3b00c10c-e0b1-4424-a7e0-3b562ccf127c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:03.362961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3b00c10c-e0b1-4424-a7e0-3b562ccf127c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:03.370399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b00c10c-e0b1-4424-a7e0-3b562ccf127c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:03.371090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b00c10c-e0b1-4424-a7e0-3b562ccf127c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:03.372107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b00c10c-e0b1-4424-a7e0-3b562ccf127c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:03.372705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b00c10c-e0b1-4424-a7e0-3b562ccf127c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:03.387492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fdf8dd69-d802-47d2-9156-306f151fa94c tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:03.396628 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fdf8dd69-d802-47d2-9156-306f151fa94c tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1325 microversion: 2.1 time: 0.452268 Jul 26 14:12:03.397270 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 911/1699] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:02 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1325 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:03.402658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-60e79be6-991b-4676-b33e-bbd9637903cf tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:03.403552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-60e79be6-991b-4676-b33e-bbd9637903cf tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:03.418411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60e79be6-991b-4676-b33e-bbd9637903cf tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:03.419349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60e79be6-991b-4676-b33e-bbd9637903cf tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:03.421031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60e79be6-991b-4676-b33e-bbd9637903cf tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:03.421773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60e79be6-991b-4676-b33e-bbd9637903cf tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:03.694480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3b00c10c-e0b1-4424-a7e0-3b562ccf127c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:03.703312 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3b00c10c-e0b1-4424-a7e0-3b562ccf127c tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1517 microversion: 2.1 time: 0.346491 Jul 26 14:12:03.715840 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 789/1700] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:03 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1517 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:03.720944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c44dde3d-2df6-45e4-b9f7-da7f84767978 req-e2404d38-f110-4b8d-8ce0-6a5283abf83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d38f13-5f5e-4574-b415-d21bb454b9d2", "name": "network-vif-deleted", "tag": "133fb10c-c93f-49e6-9134-3165e0e34866"}, {"name": "network-changed", "server_uuid": "15942639-9b2d-4a9b-a09f-2040d775466f", "tag": "9cfd3f06-7413-4c82-a6b1-861310d05144"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:03.724187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-60e79be6-991b-4676-b33e-bbd9637903cf tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:03.732179 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-60e79be6-991b-4676-b33e-bbd9637903cf tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1403 microversion: 2.1 time: 0.333624 Jul 26 14:12:03.733068 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 912/1701] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:03 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1403 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:03.740783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b746671c-6cd6-4c93-92f8-82cb3cfd809c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:03.741827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b746671c-6cd6-4c93-92f8-82cb3cfd809c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:03.745859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c44dde3d-2df6-45e4-b9f7-da7f84767978 req-e2404d38-f110-4b8d-8ce0-6a5283abf83c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:03.746155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c44dde3d-2df6-45e4-b9f7-da7f84767978 req-e2404d38-f110-4b8d-8ce0-6a5283abf83c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:03.749580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b746671c-6cd6-4c93-92f8-82cb3cfd809c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:03.750156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b746671c-6cd6-4c93-92f8-82cb3cfd809c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:03.751016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b746671c-6cd6-4c93-92f8-82cb3cfd809c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:03.751551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b746671c-6cd6-4c93-92f8-82cb3cfd809c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:03.769762 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c44dde3d-2df6-45e4-b9f7-da7f84767978 req-e2404d38-f110-4b8d-8ce0-6a5283abf83c service nova] Creating event network-vif-deleted:133fb10c-c93f-49e6-9134-3165e0e34866 for instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 on n-h2-833090-9 Jul 26 14:12:03.770293 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c44dde3d-2df6-45e4-b9f7-da7f84767978 req-e2404d38-f110-4b8d-8ce0-6a5283abf83c service nova] Creating event network-changed:9cfd3f06-7413-4c82-a6b1-861310d05144 for instance 15942639-9b2d-4a9b-a09f-2040d775466f on n-h1-833090-9 Jul 26 14:12:03.778848 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c44dde3d-2df6-45e4-b9f7-da7f84767978 req-e2404d38-f110-4b8d-8ce0-6a5283abf83c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061601 Jul 26 14:12:03.779723 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 790/1702] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:03.786650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d6d72f95-4e38-4383-9c86-a6e58986fb4a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:03.787896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d6d72f95-4e38-4383-9c86-a6e58986fb4a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:03.797040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6d72f95-4e38-4383-9c86-a6e58986fb4a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:03.797412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6d72f95-4e38-4383-9c86-a6e58986fb4a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:03.798210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6d72f95-4e38-4383-9c86-a6e58986fb4a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:03.798648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6d72f95-4e38-4383-9c86-a6e58986fb4a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:04.092784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b746671c-6cd6-4c93-92f8-82cb3cfd809c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:04.108061 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b746671c-6cd6-4c93-92f8-82cb3cfd809c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1316 microversion: 2.1 time: 0.372866 Jul 26 14:12:04.109134 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 913/1703] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:03 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:04.118228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:04.119158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:04.128343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:04.129314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:04.130920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:04.131903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:04.135376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d6d72f95-4e38-4383-9c86-a6e58986fb4a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41d238b43c541029fc35e90604a0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8d5031d9064b94a6455e3c1dfcf9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:04.140309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:04.152014 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d6d72f95-4e38-4383-9c86-a6e58986fb4a tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 200 len: 1314 microversion: 2.1 time: 0.369479 Jul 26 14:12:04.153100 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 791/1704] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:03 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:04.163688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-762749898", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "5ef2cecf-6342-4020-8ce3-eff3cab2d670"}], "block_device_mapping_v2": [{"uuid": "3fb0a7f9-3f51-4a5b-be7f-01df40fd1c5f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:04.177541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:04.178559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:04.179093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lazy-loading 'fault' on Instance uuid b3d38f13-5f5e-4574-b415-d21bb454b9d2 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:12:04.238787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee81280d69849688f68653a7a985805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808a7de5ab4d4088be3f5ea8e46c89c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:04.247379 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-48d80f5f-1925-42e7-9c14-da441c22af4e tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2" status: 200 len: 1308 microversion: 2.1 time: 0.136741 Jul 26 14:12:04.248009 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 914/1705] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:04 2022] GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2 => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:04.260516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] validate_networks() for [('5ef2cecf-6342-4020-8ce3-eff3cab2d670', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:12:04.391355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-68c30381-ac9d-404a-bdfd-78239ed5c2bb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:04.392449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-68c30381-ac9d-404a-bdfd-78239ed5c2bb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:04.407016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68c30381-ac9d-404a-bdfd-78239ed5c2bb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:04.407468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68c30381-ac9d-404a-bdfd-78239ed5c2bb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:04.408964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68c30381-ac9d-404a-bdfd-78239ed5c2bb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:04.409956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68c30381-ac9d-404a-bdfd-78239ed5c2bb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:04.976228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-68c30381-ac9d-404a-bdfd-78239ed5c2bb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:05.003918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-68c30381-ac9d-404a-bdfd-78239ed5c2bb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:05.006343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-68c30381-ac9d-404a-bdfd-78239ed5c2bb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:05.007857 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-68c30381-ac9d-404a-bdfd-78239ed5c2bb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.622683 Jul 26 14:12:05.009086 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 915/1706] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:04 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:05.014263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-812be676-7c67-4b50-bee8-5c99291cf052 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:05.015341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-812be676-7c67-4b50-bee8-5c99291cf052 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:05.018985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:05.024093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-812be676-7c67-4b50-bee8-5c99291cf052 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:05.024933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-812be676-7c67-4b50-bee8-5c99291cf052 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:05.026500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-812be676-7c67-4b50-bee8-5c99291cf052 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:05.027219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-812be676-7c67-4b50-bee8-5c99291cf052 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:05.058068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=10 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:05.244040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:12:05.244643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:12:05.245063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:12:05.245586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:12:05.246006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:12:05.256274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:05.256724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:05.257531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:05.257972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:05.281988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Getting quotas for project 3c83e50f8be04fb9b086a046f5b7eb00. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:05.288312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Getting quotas for user 4a31af687dca4bea97ad5cb0459f0dbd and project 3c83e50f8be04fb9b086a046f5b7eb00. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:05.291162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:05.358625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:12:05.360888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3fb0a7f9-3f51-4a5b-be7f-01df40fd1c5f',volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:12:05.363523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-812be676-7c67-4b50-bee8-5c99291cf052 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:05.372253 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-812be676-7c67-4b50-bee8-5c99291cf052 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1325 microversion: 2.1 time: 0.361585 Jul 26 14:12:05.389018 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 916/1707] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:05 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1325 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:05.395138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a8280aba-d1c5-4c54-bbe7-bcecf46b711f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:05.397830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a8280aba-d1c5-4c54-bbe7-bcecf46b711f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:05.418513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8280aba-d1c5-4c54-bbe7-bcecf46b711f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:05.420654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8280aba-d1c5-4c54-bbe7-bcecf46b711f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:05.422284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8280aba-d1c5-4c54-bbe7-bcecf46b711f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:05.422927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8280aba-d1c5-4c54-bbe7-bcecf46b711f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:05.553208 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-46307b15-2bc5-4933-9811-90b5461615e1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.397979 Jul 26 14:12:05.553874 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 792/1708] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:12:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:12:05.565051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-621168e7-e1a9-4274-8b88-051b4d08e29e tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:05.566160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-621168e7-e1a9-4274-8b88-051b4d08e29e tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:05.575103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-621168e7-e1a9-4274-8b88-051b4d08e29e tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:05.575666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-621168e7-e1a9-4274-8b88-051b4d08e29e tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:05.576968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-621168e7-e1a9-4274-8b88-051b4d08e29e tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:05.577501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-621168e7-e1a9-4274-8b88-051b4d08e29e tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:05.998004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a8280aba-d1c5-4c54-bbe7-bcecf46b711f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.007437 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a8280aba-d1c5-4c54-bbe7-bcecf46b711f tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1517 microversion: 2.1 time: 0.617049 Jul 26 14:12:06.015394 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 917/1709] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:05 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1517 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:06.024177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92c86922-8bb9-462e-afa2-4bcb27617ab7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:06.024424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-621168e7-e1a9-4274-8b88-051b4d08e29e tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.025629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-92c86922-8bb9-462e-afa2-4bcb27617ab7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:06.035014 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-621168e7-e1a9-4274-8b88-051b4d08e29e tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1403 microversion: 2.1 time: 0.476035 Jul 26 14:12:06.038964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92c86922-8bb9-462e-afa2-4bcb27617ab7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.040272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92c86922-8bb9-462e-afa2-4bcb27617ab7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.042455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92c86922-8bb9-462e-afa2-4bcb27617ab7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.043128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92c86922-8bb9-462e-afa2-4bcb27617ab7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.052366 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 793/1710] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:05 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1403 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:06.059188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6a1dd8c3-6b79-4858-b49c-23b81c9e5bd3 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:06.059810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6a1dd8c3-6b79-4858-b49c-23b81c9e5bd3 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:06.069147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a1dd8c3-6b79-4858-b49c-23b81c9e5bd3 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.069884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a1dd8c3-6b79-4858-b49c-23b81c9e5bd3 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.071207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a1dd8c3-6b79-4858-b49c-23b81c9e5bd3 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.071830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a1dd8c3-6b79-4858-b49c-23b81c9e5bd3 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.334455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-92c86922-8bb9-462e-afa2-4bcb27617ab7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.348177 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-92c86922-8bb9-462e-afa2-4bcb27617ab7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1316 microversion: 2.1 time: 0.330622 Jul 26 14:12:06.349169 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 918/1711] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:06 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:06.367282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ebad14c-ec52-410f-b9fa-29984114c85f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:06.368090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2ebad14c-ec52-410f-b9fa-29984114c85f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] [instance: b3d38f13-5f5e-4574-b415-d21bb454b9d2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:06.372835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6a1dd8c3-6b79-4858-b49c-23b81c9e5bd3 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41d238b43c541029fc35e90604a0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8d5031d9064b94a6455e3c1dfcf9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.375745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ebad14c-ec52-410f-b9fa-29984114c85f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.376876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ebad14c-ec52-410f-b9fa-29984114c85f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.378459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ebad14c-ec52-410f-b9fa-29984114c85f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.379734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ebad14c-ec52-410f-b9fa-29984114c85f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.381102 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6a1dd8c3-6b79-4858-b49c-23b81c9e5bd3 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 200 len: 1463 microversion: 2.1 time: 0.327113 Jul 26 14:12:06.398975 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 794/1712] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:06 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 1463 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:06.410585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-db80510a-46dd-4358-ab4e-ab5dd9f43640 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:06.411479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-db80510a-46dd-4358-ab4e-ab5dd9f43640 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:06.415784 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-2ebad14c-ec52-410f-b9fa-29984114c85f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] HTTP exception thrown: Instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 could not be found. Jul 26 14:12:06.419576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db80510a-46dd-4358-ab4e-ab5dd9f43640 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ebad14c-ec52-410f-b9fa-29984114c85f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Request method failure captured: Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2 HTTP/1.1 Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VZSf-g9xJyBEV0pI7LgKDY3vpvqbGcZ_pIaLfe0pNx05-K67L3t_GY3v_XliGDBc2OPPYZlHq2XfXmKoMZd88H9rGqqeTkXLx_y-oLq7YKgNtWFCSQHMk_j0Klmuqt4a56zm7kc_xD-OUYhqndlZnVUCGvmxL4n3ikupwLaXtKhLs Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 808a7de5ab4d4088be3f5ea8e46c89c0 Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ListImageFiltersTestJSON-1434129766 Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/808a7de5ab4d4088be3f5ea8e46c89c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/808a7de5ab4d4088be3f5ea8e46c89c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_808a7de5ab4d4088be3f5ea8e46c89c0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/808a7de5ab4d4088be3f5ea8e46c89c0"}]}] Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ListImageFiltersTestJSON-1434129766 Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 808a7de5ab4d4088be3f5ea8e46c89c0 Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1434129766 Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ListImageFiltersTestJSON-1434129766-project Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 0ee81280d69849688f68653a7a985805 Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ListImageFiltersTestJSON-1434129766-project Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 could not be found. Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'b3d38f13-5f5e-4574-b415-d21bb454b9d2'} Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 could not be found. Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 could not be found. Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:06.420812 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:06.426369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:06.426369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:06.426369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:06.426369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:06.426369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:06.426369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 could not be found. Jul 26 14:12:06.426369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:06.426369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ebad14c-ec52-410f-b9fa-29984114c85f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Returning 404 to user: Instance b3d38f13-5f5e-4574-b415-d21bb454b9d2 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:06.426369 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ebad14c-ec52-410f-b9fa-29984114c85f tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2" status: 404 len: 111 microversion: 2.1 time: 0.073445 Jul 26 14:12:06.427667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db80510a-46dd-4358-ab4e-ab5dd9f43640 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.429071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db80510a-46dd-4358-ab4e-ab5dd9f43640 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.430096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db80510a-46dd-4358-ab4e-ab5dd9f43640 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.430736 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 919/1713] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:06 2022] GET /compute/v2.1/servers/b3d38f13-5f5e-4574-b415-d21bb454b9d2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:06.440928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-cbd120fb-c642-450e-9da7-6821f59fe4e0 req-82a143c9-fa5a-450a-a36a-f21e75eb9782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722480e6-d20a-4961-8c4b-a2e5f3a3964d", "name": "network-vif-plugged", "status": "completed", "tag": "d700de43-19cd-4880-91fd-ae3d7ba0c8bb"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:06.463089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-cbd120fb-c642-450e-9da7-6821f59fe4e0 req-82a143c9-fa5a-450a-a36a-f21e75eb9782 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.463859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-cbd120fb-c642-450e-9da7-6821f59fe4e0 req-82a143c9-fa5a-450a-a36a-f21e75eb9782 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.482559 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-cbd120fb-c642-450e-9da7-6821f59fe4e0 req-82a143c9-fa5a-450a-a36a-f21e75eb9782 service nova] Creating event network-vif-plugged:d700de43-19cd-4880-91fd-ae3d7ba0c8bb for instance 722480e6-d20a-4961-8c4b-a2e5f3a3964d on n-h2-833090-9 Jul 26 14:12:06.488644 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-cbd120fb-c642-450e-9da7-6821f59fe4e0 req-82a143c9-fa5a-450a-a36a-f21e75eb9782 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056199 Jul 26 14:12:06.490272 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 920/1714] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:06.497515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c3ffc9db-38e1-44a4-adb7-5fd9993ba053 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:06.498253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c3ffc9db-38e1-44a4-adb7-5fd9993ba053 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:06.507388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3ffc9db-38e1-44a4-adb7-5fd9993ba053 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.508076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3ffc9db-38e1-44a4-adb7-5fd9993ba053 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.509279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3ffc9db-38e1-44a4-adb7-5fd9993ba053 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.509874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3ffc9db-38e1-44a4-adb7-5fd9993ba053 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.538019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-db80510a-46dd-4358-ab4e-ab5dd9f43640 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.550142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-db80510a-46dd-4358-ab4e-ab5dd9f43640 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.552472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-db80510a-46dd-4358-ab4e-ab5dd9f43640 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.553921 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-db80510a-46dd-4358-ab4e-ab5dd9f43640 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1232 microversion: 2.25 time: 0.153498 Jul 26 14:12:06.554892 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 795/1715] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:06 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1232 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:06.569775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7273d049-55c2-49f6-9e1a-b713546dcb68 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:06.570842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7273d049-55c2-49f6-9e1a-b713546dcb68 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:06.584333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7273d049-55c2-49f6-9e1a-b713546dcb68 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.584802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7273d049-55c2-49f6-9e1a-b713546dcb68 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.586127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7273d049-55c2-49f6-9e1a-b713546dcb68 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.586787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7273d049-55c2-49f6-9e1a-b713546dcb68 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:06.900936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c3ffc9db-38e1-44a4-adb7-5fd9993ba053 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.911292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c3ffc9db-38e1-44a4-adb7-5fd9993ba053 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.912865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c3ffc9db-38e1-44a4-adb7-5fd9993ba053 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.914054 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c3ffc9db-38e1-44a4-adb7-5fd9993ba053 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.422657 Jul 26 14:12:06.914666 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 921/1716] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:06 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:06.975839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7273d049-55c2-49f6-9e1a-b713546dcb68 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:06.981131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-152be2a8-3547-4a38-a57a-44dae27fee3d tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] Calling method '.version_select at 0x7f8794540550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:06.983980 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7273d049-55c2-49f6-9e1a-b713546dcb68 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1325 microversion: 2.1 time: 0.427767 Jul 26 14:12:06.988979 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 796/1717] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:06 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1325 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:06.990092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2b52f409-5fc3-427e-8e31-aca45c94b71d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87875daee0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:06.994604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-152be2a8-3547-4a38-a57a-44dae27fee3d tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:06.995189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-152be2a8-3547-4a38-a57a-44dae27fee3d tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.015902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-152be2a8-3547-4a38-a57a-44dae27fee3d tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.016546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-152be2a8-3547-4a38-a57a-44dae27fee3d tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.041821 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-152be2a8-3547-4a38-a57a-44dae27fee3d tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/3a8d5031d9064b94a6455e3c1dfcf9e9?start=2022-07-25T14%3A12%3A06.400653&end=2022-07-27T14%3A12%3A06.400653" status: 200 len: 695 microversion: 2.1 time: 0.126106 Jul 26 14:12:07.042850 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 922/1718] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jul 26 14:12:06 2022] GET /compute/v2.1/os-simple-tenant-usage/3a8d5031d9064b94a6455e3c1dfcf9e9?start=2022-07-25T14%3A12%3A06.400653&end=2022-07-27T14%3A12%3A06.400653 => generated 695 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:07.051941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2ee22879-d8e1-4a60-9217-627bbd9472ec req-58a4667c-81a9-4a25-a27c-025a2a30e1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fb392e-344d-42d1-8c5e-dae768cff51b", "name": "network-vif-deleted", "tag": "cf694648-c6fd-4128-9b72-65d87c20b088"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:07.062978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2ee22879-d8e1-4a60-9217-627bbd9472ec req-58a4667c-81a9-4a25-a27c-025a2a30e1ef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.063491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2ee22879-d8e1-4a60-9217-627bbd9472ec req-58a4667c-81a9-4a25-a27c-025a2a30e1ef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.081659 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2ee22879-d8e1-4a60-9217-627bbd9472ec req-58a4667c-81a9-4a25-a27c-025a2a30e1ef service nova] Creating event network-vif-deleted:cf694648-c6fd-4128-9b72-65d87c20b088 for instance 31fb392e-344d-42d1-8c5e-dae768cff51b on n-h2-833090-9 Jul 26 14:12:07.088146 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2ee22879-d8e1-4a60-9217-627bbd9472ec req-58a4667c-81a9-4a25-a27c-025a2a30e1ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042644 Jul 26 14:12:07.089327 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 923/1719] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:07.097101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a73bc2aa-3949-416e-a8be-5dcb8dc7e2c4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:07.098481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a73bc2aa-3949-416e-a8be-5dcb8dc7e2c4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:07.107100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a73bc2aa-3949-416e-a8be-5dcb8dc7e2c4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.107850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a73bc2aa-3949-416e-a8be-5dcb8dc7e2c4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.108859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a73bc2aa-3949-416e-a8be-5dcb8dc7e2c4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.110229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a73bc2aa-3949-416e-a8be-5dcb8dc7e2c4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.291208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a73bc2aa-3949-416e-a8be-5dcb8dc7e2c4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f31a364ff6c247a4a9fcb9f4d99c3464', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1df297aa8b6421da531e980c89c7051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:07.307986 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a73bc2aa-3949-416e-a8be-5dcb8dc7e2c4 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 200 len: 1306 microversion: 2.1 time: 0.213518 Jul 26 14:12:07.309606 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 924/1720] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:07 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 1306 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:07.310366 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2b52f409-5fc3-427e-8e31-aca45c94b71d tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "DELETE /compute/v2.1/images/7fb8374a-0e04-4130-919c-418f0eb010b7" status: 204 len: 0 microversion: 2.1 time: 0.324582 Jul 26 14:12:07.312673 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 797/1721] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:06 2022] DELETE /compute/v2.1/images/7fb8374a-0e04-4130-919c-418f0eb010b7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:07.319149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-21349eeb-a395-49cb-a7aa-a1d43995bc83 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:07.319783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-21349eeb-a395-49cb-a7aa-a1d43995bc83 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:07.322438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-135e3246-01a8-4dca-94d7-1de991687444 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '.version_select at 0x7f87876d43a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:07.336483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21349eeb-a395-49cb-a7aa-a1d43995bc83 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.337161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21349eeb-a395-49cb-a7aa-a1d43995bc83 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.338168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21349eeb-a395-49cb-a7aa-a1d43995bc83 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.338609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21349eeb-a395-49cb-a7aa-a1d43995bc83 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.342514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-135e3246-01a8-4dca-94d7-1de991687444 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.343284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-135e3246-01a8-4dca-94d7-1de991687444 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.354199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-135e3246-01a8-4dca-94d7-1de991687444 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.354799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-135e3246-01a8-4dca-94d7-1de991687444 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.372070 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-135e3246-01a8-4dca-94d7-1de991687444 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/3a8d5031d9064b94a6455e3c1dfcf9e9?start=2022-07-25T14%3A12%3A06.400653&end=2022-07-27T14%3A12%3A06.400653" status: 200 len: 695 microversion: 2.1 time: 0.060428 Jul 26 14:12:07.377836 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 925/1722] 10.222.0.70 () {58 vars in 1412 bytes} [Tue Jul 26 14:12:07 2022] GET /compute/v2.1/os-simple-tenant-usage/3a8d5031d9064b94a6455e3c1dfcf9e9?start=2022-07-25T14%3A12%3A06.400653&end=2022-07-27T14%3A12%3A06.400653 => generated 695 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:07.380570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5e0846a5-64b8-41bd-a2a2-d120bc8c84e8 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f87876da430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:07.659118 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5e0846a5-64b8-41bd-a2a2-d120bc8c84e8 tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "DELETE /compute/v2.1/images/9d5cdc96-366f-4d0d-b009-7ef2fb5172dc" status: 204 len: 0 microversion: 2.1 time: 0.284189 Jul 26 14:12:07.659853 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 926/1723] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:07 2022] DELETE /compute/v2.1/images/9d5cdc96-366f-4d0d-b009-7ef2fb5172dc => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:07.667410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2c11282b-deb0-49cc-8ca8-9c5754785d95 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:07.668409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2c11282b-deb0-49cc-8ca8-9c5754785d95 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:07.676958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c11282b-deb0-49cc-8ca8-9c5754785d95 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.677490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c11282b-deb0-49cc-8ca8-9c5754785d95 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.678362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c11282b-deb0-49cc-8ca8-9c5754785d95 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.678889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c11282b-deb0-49cc-8ca8-9c5754785d95 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.687248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-21349eeb-a395-49cb-a7aa-a1d43995bc83 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:07.697747 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-21349eeb-a395-49cb-a7aa-a1d43995bc83 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1403 microversion: 2.1 time: 0.383406 Jul 26 14:12:07.712319 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 798/1724] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:07 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1403 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:07.718644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55b8668d-e3ee-4ffb-8407-ca56579336fc tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] Calling method '.version_select at 0x7f8787678dc0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:07.729835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55b8668d-e3ee-4ffb-8407-ca56579336fc tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.730285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55b8668d-e3ee-4ffb-8407-ca56579336fc tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.758768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55b8668d-e3ee-4ffb-8407-ca56579336fc tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.759224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55b8668d-e3ee-4ffb-8407-ca56579336fc tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.843840 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-55b8668d-e3ee-4ffb-8407-ca56579336fc tempest-TenantUsagesTestJSON-2067015880 tempest-TenantUsagesTestJSON-2067015880-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T14%3A12%3A06.400653&end=2022-07-27T14%3A12%3A06.400653&detailed=1" status: 200 len: 21038 microversion: 2.1 time: 0.129732 Jul 26 14:12:07.844606 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 799/1725] 10.222.0.70 () {58 vars in 1335 bytes} [Tue Jul 26 14:12:07 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-25T14%3A12%3A06.400653&end=2022-07-27T14%3A12%3A06.400653&detailed=1 => generated 21038 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:12:07.857365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e0391d68-fb6b-4e4e-91b8-4147d0149182 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:07.858466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e0391d68-fb6b-4e4e-91b8-4147d0149182 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:07.872290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e0391d68-fb6b-4e4e-91b8-4147d0149182 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.873183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e0391d68-fb6b-4e4e-91b8-4147d0149182 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.874174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e0391d68-fb6b-4e4e-91b8-4147d0149182 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:07.874938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e0391d68-fb6b-4e4e-91b8-4147d0149182 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:07.996533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e0391d68-fb6b-4e4e-91b8-4147d0149182 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:08.006893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e0391d68-fb6b-4e4e-91b8-4147d0149182 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:08.010677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2c11282b-deb0-49cc-8ca8-9c5754785d95 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:08.013656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e0391d68-fb6b-4e4e-91b8-4147d0149182 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:08.015045 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e0391d68-fb6b-4e4e-91b8-4147d0149182 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1250 microversion: 2.25 time: 0.165895 Jul 26 14:12:08.016312 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 800/1726] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:07 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1250 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:08.023042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-65eb65ec-f512-419c-aed9-73dece1254ea tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] Calling method '.version_select at 0x7f8787715ee0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:08.044505 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2c11282b-deb0-49cc-8ca8-9c5754785d95 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1316 microversion: 2.1 time: 0.382967 Jul 26 14:12:08.045721 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 927/1727] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:07 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:08.052830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3d775fe-4015-4810-86ac-0a241e740c5b tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:08.053340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3d775fe-4015-4810-86ac-0a241e740c5b tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:08.061182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3d775fe-4015-4810-86ac-0a241e740c5b tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:08.061726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3d775fe-4015-4810-86ac-0a241e740c5b tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:08.062663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3d775fe-4015-4810-86ac-0a241e740c5b tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:08.063863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3d775fe-4015-4810-86ac-0a241e740c5b tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:08.105854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3d775fe-4015-4810-86ac-0a241e740c5b tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:08.255101 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a3d775fe-4015-4810-86ac-0a241e740c5b tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "DELETE /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 204 len: 0 microversion: 2.1 time: 0.207260 Jul 26 14:12:08.257812 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 928/1728] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:08 2022] DELETE /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:08.269327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c7d14590-7d8a-47de-a986-00a7192ad0eb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:08.270657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c7d14590-7d8a-47de-a986-00a7192ad0eb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:08.278708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7d14590-7d8a-47de-a986-00a7192ad0eb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:08.279709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7d14590-7d8a-47de-a986-00a7192ad0eb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:08.280859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7d14590-7d8a-47de-a986-00a7192ad0eb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:08.281382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7d14590-7d8a-47de-a986-00a7192ad0eb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:08.285051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:08.468287 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-65eb65ec-f512-419c-aed9-73dece1254ea tempest-ListImageFiltersTestJSON-1434129766 tempest-ListImageFiltersTestJSON-1434129766-project] 10.222.0.70 "DELETE /compute/v2.1/images/d15a4749-f78a-45eb-876f-267a338ef6e3" status: 204 len: 0 microversion: 2.1 time: 0.450610 Jul 26 14:12:08.469574 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 801/1729] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:08 2022] DELETE /compute/v2.1/images/d15a4749-f78a-45eb-876f-267a338ef6e3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:08.477326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2474d03a-d47e-40f5-a625-5a815009ce31 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:08.478699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2474d03a-d47e-40f5-a625-5a815009ce31 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:08.488544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2474d03a-d47e-40f5-a625-5a815009ce31 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:08.489720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2474d03a-d47e-40f5-a625-5a815009ce31 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:08.490801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2474d03a-d47e-40f5-a625-5a815009ce31 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:08.491453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2474d03a-d47e-40f5-a625-5a815009ce31 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:08.741086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c7d14590-7d8a-47de-a986-00a7192ad0eb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:08.765955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c7d14590-7d8a-47de-a986-00a7192ad0eb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:08.768076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c7d14590-7d8a-47de-a986-00a7192ad0eb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:08.769294 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c7d14590-7d8a-47de-a986-00a7192ad0eb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.509571 Jul 26 14:12:08.769854 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 929/1730] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:08 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:08.784755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ef21acd-4d0a-49d3-b40c-8649d2f0d79f tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:08.785716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ef21acd-4d0a-49d3-b40c-8649d2f0d79f tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:08.804729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ef21acd-4d0a-49d3-b40c-8649d2f0d79f tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:08.807743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ef21acd-4d0a-49d3-b40c-8649d2f0d79f tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:08.810474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ef21acd-4d0a-49d3-b40c-8649d2f0d79f tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:08.812590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ef21acd-4d0a-49d3-b40c-8649d2f0d79f tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:08.969878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2474d03a-d47e-40f5-a625-5a815009ce31 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:08.984496 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2474d03a-d47e-40f5-a625-5a815009ce31 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1325 microversion: 2.1 time: 0.513423 Jul 26 14:12:08.985090 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 802/1731] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:08 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:08.995841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87e26f8c-8ebb-4f7a-bc53-4173c5b89509 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:08.996743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-87e26f8c-8ebb-4f7a-bc53-4173c5b89509 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] [instance: 31fb392e-344d-42d1-8c5e-dae768cff51b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:09.012793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87e26f8c-8ebb-4f7a-bc53-4173c5b89509 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.013260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87e26f8c-8ebb-4f7a-bc53-4173c5b89509 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:09.014187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87e26f8c-8ebb-4f7a-bc53-4173c5b89509 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.014642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87e26f8c-8ebb-4f7a-bc53-4173c5b89509 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:09.037610 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-87e26f8c-8ebb-4f7a-bc53-4173c5b89509 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] HTTP exception thrown: Instance 31fb392e-344d-42d1-8c5e-dae768cff51b could not be found. Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87e26f8c-8ebb-4f7a-bc53-4173c5b89509 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Request method failure captured: Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b HTTP/1.1 Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_WLr5RUVX50xkUt6oVZ8BTuE5TrJa7nGDguGxZhT36eU4IVCLTxd0UCOVa_kRoiTe4CSAfuon4J2KJI455hr3qBzWStBBFF1n6V4tVCtIijRdxkXUlDrpsTjVrvGFyVqLlsR1WbAoz4waJfMoUH14_KlL9hDJQ8G61M6sPeL-4Xl1Q Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a1df297aa8b6421da531e980c89c7051 Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ListServerFiltersTestJSON-1694090546 Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a1df297aa8b6421da531e980c89c7051"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a1df297aa8b6421da531e980c89c7051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a1df297aa8b6421da531e980c89c7051", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a1df297aa8b6421da531e980c89c7051"}]}] Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ListServerFiltersTestJSON-1694090546 Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a1df297aa8b6421da531e980c89c7051 Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1694090546 Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ListServerFiltersTestJSON-1694090546-project Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f31a364ff6c247a4a9fcb9f4d99c3464 Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ListServerFiltersTestJSON-1694090546-project Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 31fb392e-344d-42d1-8c5e-dae768cff51b could not be found. Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '31fb392e-344d-42d1-8c5e-dae768cff51b'} Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31fb392e-344d-42d1-8c5e-dae768cff51b could not be found. Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31fb392e-344d-42d1-8c5e-dae768cff51b could not be found. Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:09.045489 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:09.051107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:09.051107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:09.051107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:09.051107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:09.051107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:09.051107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31fb392e-344d-42d1-8c5e-dae768cff51b could not be found. Jul 26 14:12:09.051107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:09.051107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87e26f8c-8ebb-4f7a-bc53-4173c5b89509 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] Returning 404 to user: Instance 31fb392e-344d-42d1-8c5e-dae768cff51b could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:09.051107 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-87e26f8c-8ebb-4f7a-bc53-4173c5b89509 tempest-ListServerFiltersTestJSON-1694090546 tempest-ListServerFiltersTestJSON-1694090546-project] 10.222.0.70 "GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b" status: 404 len: 111 microversion: 2.1 time: 0.061731 Jul 26 14:12:09.051107 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 803/1732] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:08 2022] GET /compute/v2.1/servers/31fb392e-344d-42d1-8c5e-dae768cff51b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:09.063539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-cf98cb9d-a4d8-4e63-8a96-e9740f59484f req-7f050527-f01b-49ab-ae99-feeaa82da678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a089b93c-78b2-42bd-8381-e81d17ca5d8b", "name": "network-vif-plugged", "status": "completed", "tag": "d31bb287-ed78-423c-9ebb-7e057c85ea9b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:09.076415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cf98cb9d-a4d8-4e63-8a96-e9740f59484f req-7f050527-f01b-49ab-ae99-feeaa82da678 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.076989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cf98cb9d-a4d8-4e63-8a96-e9740f59484f req-7f050527-f01b-49ab-ae99-feeaa82da678 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:09.092786 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-cf98cb9d-a4d8-4e63-8a96-e9740f59484f req-7f050527-f01b-49ab-ae99-feeaa82da678 service nova] Creating event network-vif-plugged:d31bb287-ed78-423c-9ebb-7e057c85ea9b for instance a089b93c-78b2-42bd-8381-e81d17ca5d8b on n-h1-833090-9 Jul 26 14:12:09.100589 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-cf98cb9d-a4d8-4e63-8a96-e9740f59484f req-7f050527-f01b-49ab-ae99-feeaa82da678 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048347 Jul 26 14:12:09.101655 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 804/1733] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:09.107432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7124ae37-0a89-4b0e-b8b9-d8a8072cc92b tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:09.108138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7124ae37-0a89-4b0e-b8b9-d8a8072cc92b tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:09.116382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7124ae37-0a89-4b0e-b8b9-d8a8072cc92b tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.116885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7124ae37-0a89-4b0e-b8b9-d8a8072cc92b tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:09.117685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7124ae37-0a89-4b0e-b8b9-d8a8072cc92b tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.118463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7124ae37-0a89-4b0e-b8b9-d8a8072cc92b tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:09.355798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7ef21acd-4d0a-49d3-b40c-8649d2f0d79f tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41d238b43c541029fc35e90604a0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8d5031d9064b94a6455e3c1dfcf9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:09.379076 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ef21acd-4d0a-49d3-b40c-8649d2f0d79f tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 200 len: 1469 microversion: 2.1 time: 0.598423 Jul 26 14:12:09.379997 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 930/1734] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:08 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 1469 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:09.399294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fdd750bc-f9b4-40cd-9be1-1b2f084f3528 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:09.400356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fdd750bc-f9b4-40cd-9be1-1b2f084f3528 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:09.407632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdd750bc-f9b4-40cd-9be1-1b2f084f3528 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.408502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdd750bc-f9b4-40cd-9be1-1b2f084f3528 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:09.409578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdd750bc-f9b4-40cd-9be1-1b2f084f3528 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.410274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdd750bc-f9b4-40cd-9be1-1b2f084f3528 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:09.542639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7124ae37-0a89-4b0e-b8b9-d8a8072cc92b tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:09.559117 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7124ae37-0a89-4b0e-b8b9-d8a8072cc92b tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1403 microversion: 2.1 time: 0.455847 Jul 26 14:12:09.560511 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 805/1735] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:09 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1403 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:09.592542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-70500dc3-b775-4138-afac-5054edc22b11 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:09.594824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-70500dc3-b775-4138-afac-5054edc22b11 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:09.629134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70500dc3-b775-4138-afac-5054edc22b11 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.629589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70500dc3-b775-4138-afac-5054edc22b11 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:09.631634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70500dc3-b775-4138-afac-5054edc22b11 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.632308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70500dc3-b775-4138-afac-5054edc22b11 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:09.823980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fdd750bc-f9b4-40cd-9be1-1b2f084f3528 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:09.842667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fdd750bc-f9b4-40cd-9be1-1b2f084f3528 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:09.846083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fdd750bc-f9b4-40cd-9be1-1b2f084f3528 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:09.849123 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fdd750bc-f9b4-40cd-9be1-1b2f084f3528 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1292 microversion: 2.25 time: 0.454427 Jul 26 14:12:09.892643 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 931/1736] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:09 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1292 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:09.901387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-376f6672-6e1c-4405-a7ca-9383b617e275 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:09.902578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-376f6672-6e1c-4405-a7ca-9383b617e275 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:09.920145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-376f6672-6e1c-4405-a7ca-9383b617e275 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.920612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-376f6672-6e1c-4405-a7ca-9383b617e275 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:09.921414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-376f6672-6e1c-4405-a7ca-9383b617e275 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:09.922059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-376f6672-6e1c-4405-a7ca-9383b617e275 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:10.479573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-70500dc3-b775-4138-afac-5054edc22b11 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:10.496005 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-70500dc3-b775-4138-afac-5054edc22b11 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1465 microversion: 2.1 time: 0.934172 Jul 26 14:12:10.502368 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 806/1737] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:09 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1465 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:10.522990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8f1f7944-5569-4864-b2c1-b00ab3205584 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:10.525720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8f1f7944-5569-4864-b2c1-b00ab3205584 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:10.555509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1f7944-5569-4864-b2c1-b00ab3205584 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:10.559260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1f7944-5569-4864-b2c1-b00ab3205584 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:10.561758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1f7944-5569-4864-b2c1-b00ab3205584 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:10.567235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1f7944-5569-4864-b2c1-b00ab3205584 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:10.965223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-376f6672-6e1c-4405-a7ca-9383b617e275 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:10.980568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-376f6672-6e1c-4405-a7ca-9383b617e275 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:10.982754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-376f6672-6e1c-4405-a7ca-9383b617e275 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:10.988083 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-376f6672-6e1c-4405-a7ca-9383b617e275 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.093786 Jul 26 14:12:10.989081 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 932/1738] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:09 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:11.002578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-54ded126-af16-483e-9826-a0b2c3bace77 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:11.003661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-54ded126-af16-483e-9826-a0b2c3bace77 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:11.010234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54ded126-af16-483e-9826-a0b2c3bace77 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:11.011443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54ded126-af16-483e-9826-a0b2c3bace77 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:11.012433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54ded126-af16-483e-9826-a0b2c3bace77 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:11.013042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54ded126-af16-483e-9826-a0b2c3bace77 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:11.275725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8f1f7944-5569-4864-b2c1-b00ab3205584 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:11.298299 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8f1f7944-5569-4864-b2c1-b00ab3205584 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1325 microversion: 2.1 time: 0.778920 Jul 26 14:12:11.304108 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 807/1739] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:10 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1325 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:11.304622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da4ad7d7-7758-48c5-a487-e20876ab492b tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:11.305271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-da4ad7d7-7758-48c5-a487-e20876ab492b tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:11.324379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da4ad7d7-7758-48c5-a487-e20876ab492b tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:11.324918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da4ad7d7-7758-48c5-a487-e20876ab492b tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:11.325731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da4ad7d7-7758-48c5-a487-e20876ab492b tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:11.326167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da4ad7d7-7758-48c5-a487-e20876ab492b tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:11.415901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-54ded126-af16-483e-9826-a0b2c3bace77 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41d238b43c541029fc35e90604a0a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8d5031d9064b94a6455e3c1dfcf9e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:11.429803 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-54ded126-af16-483e-9826-a0b2c3bace77 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 200 len: 1469 microversion: 2.1 time: 0.439343 Jul 26 14:12:11.445125 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 933/1740] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:10 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 1469 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:11.465957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-80e35745-2af9-4cfe-98b2-308a78321985 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:11.466474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-80e35745-2af9-4cfe-98b2-308a78321985 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:11.492706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80e35745-2af9-4cfe-98b2-308a78321985 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:11.493172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80e35745-2af9-4cfe-98b2-308a78321985 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:11.496369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80e35745-2af9-4cfe-98b2-308a78321985 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:11.499740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80e35745-2af9-4cfe-98b2-308a78321985 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:11.974509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-80e35745-2af9-4cfe-98b2-308a78321985 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:11.982672 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-80e35745-2af9-4cfe-98b2-308a78321985 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1403 microversion: 2.1 time: 0.528479 Jul 26 14:12:11.989123 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 934/1741] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:11 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1403 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:11.999901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-19a927d2-c431-4183-a77b-449255a4df61 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:12.001237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-19a927d2-c431-4183-a77b-449255a4df61 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:12.021183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19a927d2-c431-4183-a77b-449255a4df61 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:12.022434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19a927d2-c431-4183-a77b-449255a4df61 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:12.025502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19a927d2-c431-4183-a77b-449255a4df61 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:12.026322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19a927d2-c431-4183-a77b-449255a4df61 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:12.062243 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-da4ad7d7-7758-48c5-a487-e20876ab492b tempest-ServersOnMultiNodesTest-158624764 tempest-ServersOnMultiNodesTest-158624764-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1616 microversion: 2.1 time: 0.761708 Jul 26 14:12:12.082691 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 808/1742] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:11 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1616 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:12.089099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2f7fa822-790c-47c4-b253-38a7f440d182 req-dc87a78a-f698-4320-800b-6497f1881e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15942639-9b2d-4a9b-a09f-2040d775466f", "name": "network-vif-plugged", "status": "completed", "tag": "9cfd3f06-7413-4c82-a6b1-861310d05144"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:12.112451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2f7fa822-790c-47c4-b253-38a7f440d182 req-dc87a78a-f698-4320-800b-6497f1881e97 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:12.114357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2f7fa822-790c-47c4-b253-38a7f440d182 req-dc87a78a-f698-4320-800b-6497f1881e97 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:12.303566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-19a927d2-c431-4183-a77b-449255a4df61 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:12.343393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-19a927d2-c431-4183-a77b-449255a4df61 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:12.352071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-19a927d2-c431-4183-a77b-449255a4df61 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:12.357683 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-19a927d2-c431-4183-a77b-449255a4df61 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1292 microversion: 2.25 time: 0.365245 Jul 26 14:12:12.363724 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 935/1743] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:11 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1292 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:12.380751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-dabb607d-0b42-43cb-b794-b42dd766adf6 req-c19eab9c-413e-40ff-83b6-210dd4a08b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22136b43-c874-45fe-9260-c2dfc8ab92d3", "name": "network-vif-deleted", "tag": "2f932df7-b17d-4486-8f3c-29667f0b4f87"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:12.433666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-dabb607d-0b42-43cb-b794-b42dd766adf6 req-c19eab9c-413e-40ff-83b6-210dd4a08b6f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:12.436733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-dabb607d-0b42-43cb-b794-b42dd766adf6 req-c19eab9c-413e-40ff-83b6-210dd4a08b6f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:12.480155 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-dabb607d-0b42-43cb-b794-b42dd766adf6 req-c19eab9c-413e-40ff-83b6-210dd4a08b6f service nova] Creating event network-vif-deleted:2f932df7-b17d-4486-8f3c-29667f0b4f87 for instance 22136b43-c874-45fe-9260-c2dfc8ab92d3 on n-h1-833090-9 Jul 26 14:12:12.496925 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-dabb607d-0b42-43cb-b794-b42dd766adf6 req-c19eab9c-413e-40ff-83b6-210dd4a08b6f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125897 Jul 26 14:12:12.510538 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 936/1744] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:12.551851 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2f7fa822-790c-47c4-b253-38a7f440d182 req-dc87a78a-f698-4320-800b-6497f1881e97 service nova] Creating event network-vif-plugged:9cfd3f06-7413-4c82-a6b1-861310d05144 for instance 15942639-9b2d-4a9b-a09f-2040d775466f on n-h1-833090-9 Jul 26 14:12:12.560955 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2f7fa822-790c-47c4-b253-38a7f440d182 req-dc87a78a-f698-4320-800b-6497f1881e97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.476321 Jul 26 14:12:12.572186 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 809/1745] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:12.577709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af8d2a8c-c3dc-4476-9da8-0def16225c80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:12.578428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-af8d2a8c-c3dc-4476-9da8-0def16225c80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:12.596240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af8d2a8c-c3dc-4476-9da8-0def16225c80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:12.596700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af8d2a8c-c3dc-4476-9da8-0def16225c80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:12.597494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af8d2a8c-c3dc-4476-9da8-0def16225c80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:12.597943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af8d2a8c-c3dc-4476-9da8-0def16225c80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.037815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-af8d2a8c-c3dc-4476-9da8-0def16225c80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:13.049943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-af8d2a8c-c3dc-4476-9da8-0def16225c80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:13.051939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-af8d2a8c-c3dc-4476-9da8-0def16225c80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:13.055647 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af8d2a8c-c3dc-4476-9da8-0def16225c80 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.481415 Jul 26 14:12:13.057637 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 810/1746] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:12 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:13.067600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-839ea693-ee24-48dc-a2d4-766392705ce7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:13.068405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-839ea693-ee24-48dc-a2d4-766392705ce7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:13.078989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-839ea693-ee24-48dc-a2d4-766392705ce7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.079830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-839ea693-ee24-48dc-a2d4-766392705ce7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.084301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-839ea693-ee24-48dc-a2d4-766392705ce7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.086033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-839ea693-ee24-48dc-a2d4-766392705ce7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.126746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-839ea693-ee24-48dc-a2d4-766392705ce7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:13.227521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3cd80975-74f0-45fe-8e22-034718f55467 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Action: 'create', calling method: .version_select at 0x7f87876dad30>, body: {"keypair": {"name": "tempest-keypair-1180583251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIWbir1T/Fcnah9AYCOAadI4vOCTw/CU9ORZkDH/Djf/7If9km4v5tdKaw2zO/u7/O3yR1tSy8Joo+81iEpUzWc45+iB8vkUOEvvh9VzHw0clT5kWNhX1PTCNSKJY8Gjg=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:13.240787 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-839ea693-ee24-48dc-a2d4-766392705ce7 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 204 len: 0 microversion: 2.1 time: 0.180798 Jul 26 14:12:13.242210 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 811/1747] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:13 2022] DELETE /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:13.249607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bce280ee-0a28-47ff-a2d2-a0a6660fde4f tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:13.252381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bce280ee-0a28-47ff-a2d2-a0a6660fde4f tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:13.271053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-3cd80975-74f0-45fe-8e22-034718f55467 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:13.277516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bce280ee-0a28-47ff-a2d2-a0a6660fde4f tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.277982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bce280ee-0a28-47ff-a2d2-a0a6660fde4f tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.279043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bce280ee-0a28-47ff-a2d2-a0a6660fde4f tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.279482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bce280ee-0a28-47ff-a2d2-a0a6660fde4f tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.281515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-3cd80975-74f0-45fe-8e22-034718f55467 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for user b0bd30e3d0cf46fc95abd0116574b61e and project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:13.285841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:13.325289 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3cd80975-74f0-45fe-8e22-034718f55467 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.809785 Jul 26 14:12:13.333761 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 937/1748] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:12:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:13.337828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-190968a3-d7c5-4fba-a60d-b7209976e013 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:13.339519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-190968a3-d7c5-4fba-a60d-b7209976e013 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] [instance: 22136b43-c874-45fe-9260-c2dfc8ab92d3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:13.349973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-190968a3-d7c5-4fba-a60d-b7209976e013 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.350659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-190968a3-d7c5-4fba-a60d-b7209976e013 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.351589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-190968a3-d7c5-4fba-a60d-b7209976e013 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.352170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-190968a3-d7c5-4fba-a60d-b7209976e013 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.373669 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-190968a3-d7c5-4fba-a60d-b7209976e013 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] HTTP exception thrown: Instance 22136b43-c874-45fe-9260-c2dfc8ab92d3 could not be found. Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-190968a3-d7c5-4fba-a60d-b7209976e013 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Request method failure captured: Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 HTTP/1.1 Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_YYtfzAwUO3J1HUkGKJACR7RriHSZjYvGI8N1IhNpsh1WeuzRehTxIqVG-w6eydqivwZsc23wpldsjqjGLvKYAybkQ4UtgV6J2wZ1e9Xn1UVuqHdqLSHjnKh8ygvVN80XTFL7bD0Nf8aCVBKbKRTGbv07K2U9wcYq_2wi9Us35KIfs Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 3a8d5031d9064b94a6455e3c1dfcf9e9 Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TenantUsagesTestJSON-51438538 Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a8d5031d9064b94a6455e3c1dfcf9e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a8d5031d9064b94a6455e3c1dfcf9e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a8d5031d9064b94a6455e3c1dfcf9e9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a8d5031d9064b94a6455e3c1dfcf9e9"}]}] Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TenantUsagesTestJSON-51438538 Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 3a8d5031d9064b94a6455e3c1dfcf9e9 Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TenantUsagesTestJSON-51438538 Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TenantUsagesTestJSON-51438538-project Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: d41d238b43c541029fc35e90604a0a96 Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TenantUsagesTestJSON-51438538-project Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 22136b43-c874-45fe-9260-c2dfc8ab92d3 could not be found. Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '22136b43-c874-45fe-9260-c2dfc8ab92d3'} Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22136b43-c874-45fe-9260-c2dfc8ab92d3 could not be found. Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22136b43-c874-45fe-9260-c2dfc8ab92d3 could not be found. Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:13.376336 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:13.383267 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:13.383267 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:13.383267 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:13.383267 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:13.383267 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:13.383267 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22136b43-c874-45fe-9260-c2dfc8ab92d3 could not be found. Jul 26 14:12:13.383267 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:13.383267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-190968a3-d7c5-4fba-a60d-b7209976e013 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] Returning 404 to user: Instance 22136b43-c874-45fe-9260-c2dfc8ab92d3 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:13.383267 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-190968a3-d7c5-4fba-a60d-b7209976e013 tempest-TenantUsagesTestJSON-51438538 tempest-TenantUsagesTestJSON-51438538-project] 10.222.0.70 "GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3" status: 404 len: 111 microversion: 2.1 time: 0.051755 Jul 26 14:12:13.385225 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 938/1749] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:13 2022] GET /compute/v2.1/servers/22136b43-c874-45fe-9260-c2dfc8ab92d3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:13.392928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-808da57e-7ee8-4065-8d0b-de06e170e27d req-0c4f5f2d-193b-4ce9-97db-cc727449b782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e53966-8644-4b0b-9429-dd23222bb79e", "tag": "d89bd279-7459-4603-9b92-9e0b93981d08"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:13.405858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-808da57e-7ee8-4065-8d0b-de06e170e27d req-0c4f5f2d-193b-4ce9-97db-cc727449b782 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.409280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-808da57e-7ee8-4065-8d0b-de06e170e27d req-0c4f5f2d-193b-4ce9-97db-cc727449b782 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.423707 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-808da57e-7ee8-4065-8d0b-de06e170e27d req-0c4f5f2d-193b-4ce9-97db-cc727449b782 service nova] Creating event network-changed:d89bd279-7459-4603-9b92-9e0b93981d08 for instance c6e53966-8644-4b0b-9429-dd23222bb79e on n-h2-833090-9 Jul 26 14:12:13.429451 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-808da57e-7ee8-4065-8d0b-de06e170e27d req-0c4f5f2d-193b-4ce9-97db-cc727449b782 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041939 Jul 26 14:12:13.430721 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 939/1750] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:13.439315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-446f6947-4a7a-41e9-8f99-3ce22ebb8ba6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:13.440308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-446f6947-4a7a-41e9-8f99-3ce22ebb8ba6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:13.447512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-446f6947-4a7a-41e9-8f99-3ce22ebb8ba6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.448226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-446f6947-4a7a-41e9-8f99-3ce22ebb8ba6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.449165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-446f6947-4a7a-41e9-8f99-3ce22ebb8ba6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.449676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-446f6947-4a7a-41e9-8f99-3ce22ebb8ba6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.543640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bce280ee-0a28-47ff-a2d2-a0a6660fde4f tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:13.555832 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bce280ee-0a28-47ff-a2d2-a0a6660fde4f tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1520 microversion: 2.1 time: 0.311991 Jul 26 14:12:13.567983 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 812/1751] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:13 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:13.567983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cba59d79-3c2b-4f97-8875-aac2e32252b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:13.567983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cba59d79-3c2b-4f97-8875-aac2e32252b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:13.577565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cba59d79-3c2b-4f97-8875-aac2e32252b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.577565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cba59d79-3c2b-4f97-8875-aac2e32252b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.577565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cba59d79-3c2b-4f97-8875-aac2e32252b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:13.577565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cba59d79-3c2b-4f97-8875-aac2e32252b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:13.965467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-446f6947-4a7a-41e9-8f99-3ce22ebb8ba6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:13.992188 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-446f6947-4a7a-41e9-8f99-3ce22ebb8ba6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1403 microversion: 2.1 time: 0.557791 Jul 26 14:12:13.999505 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 940/1752] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:13 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1403 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:14.004166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b789e90d-6e65-4b53-9590-075a6e448e80 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Calling method '.version_select at 0x7f87876bb040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:14.017098 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b789e90d-6e65-4b53-9590-075a6e448e80 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-1180583251" status: 200 len: 498 microversion: 2.1 time: 0.022150 Jul 26 14:12:14.018033 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 941/1753] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Jul 26 14:12:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1180583251 => generated 498 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:14.021766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cba59d79-3c2b-4f97-8875-aac2e32252b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:14.037415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8b2f7de9-a9dc-4149-9cdc-6ac6aa182d5e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:14.038577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8b2f7de9-a9dc-4149-9cdc-6ac6aa182d5e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:14.040529 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cba59d79-3c2b-4f97-8875-aac2e32252b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1471 microversion: 2.1 time: 0.481820 Jul 26 14:12:14.041632 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 813/1754] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:13 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1471 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:14.048172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a3a7dda3-6fba-4e8c-82d3-8e712c18b973 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:14.049326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a3a7dda3-6fba-4e8c-82d3-8e712c18b973 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:14.051616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b2f7de9-a9dc-4149-9cdc-6ac6aa182d5e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:14.052354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b2f7de9-a9dc-4149-9cdc-6ac6aa182d5e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:14.054260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b2f7de9-a9dc-4149-9cdc-6ac6aa182d5e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:14.055160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b2f7de9-a9dc-4149-9cdc-6ac6aa182d5e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:14.058902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a7dda3-6fba-4e8c-82d3-8e712c18b973 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:14.060024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a7dda3-6fba-4e8c-82d3-8e712c18b973 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:14.061267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a7dda3-6fba-4e8c-82d3-8e712c18b973 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:14.062518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a7dda3-6fba-4e8c-82d3-8e712c18b973 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:14.111672 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-a3a7dda3-6fba-4e8c-82d3-8e712c18b973 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] HTTP exception thrown: Action 999 not found Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a3a7dda3-6fba-4e8c-82d3-8e712c18b973 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Request method failure captured: Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b/os-instance-actions/999 HTTP/1.1 Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_Ydmn1QVUItIQEdGrq0woO57odvg2Klhe9QshzjvQGEOZn2wad2KiHHeJCFmrd4YnV8SyyGtj8-i_G_La7jF0bqWWGQX8yWnPqlO1vmlzLtw5qaapiVicqg-13V0YoSaV0gLdT6jQHy797Bt7FQeG9kew1mpUqg9ObozgVoTpZIOos Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8a2b6af31f6944a0b722252236ab369f Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-610982589 Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8a2b6af31f6944a0b722252236ab369f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8a2b6af31f6944a0b722252236ab369f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8a2b6af31f6944a0b722252236ab369f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8a2b6af31f6944a0b722252236ab369f"}]}] Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-610982589 Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8a2b6af31f6944a0b722252236ab369f Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-610982589 Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-InstanceActionsNegativeTestJSON-610982589-project Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 88df654a9ef0445792b02c8939fe4787 Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-610982589-project Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: exception: Action 999 not found Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': 'a089b93c-78b2-42bd-8381-e81d17ca5d8b', 'id': '999'} Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 26 14:12:14.129717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:14.160618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a3a7dda3-6fba-4e8c-82d3-8e712c18b973 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Returning 404 to user: Action 999 not found {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:14.165763 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a3a7dda3-6fba-4e8c-82d3-8e712c18b973 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.121185 Jul 26 14:12:14.175803 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 814/1755] 10.222.0.70 () {58 vars in 1308 bytes} [Tue Jul 26 14:12:14 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b/os-instance-actions/999 => generated 66 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:12:14.195382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad4e8fe1-5c5e-4ba6-90de-bab39a34c97f tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Calling method '.version_select at 0x7f87875daee0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:14.252570 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad4e8fe1-5c5e-4ba6-90de-bab39a34c97f tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180583251" status: 202 len: 0 microversion: 2.1 time: 0.070907 Jul 26 14:12:14.264842 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 815/1756] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:12:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180583251 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:12:14.279538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c8c49e6-7214-4081-8a31-26b113769d15 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:14.287747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c8c49e6-7214-4081-8a31-26b113769d15 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:14.305056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c8c49e6-7214-4081-8a31-26b113769d15 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:14.305770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c8c49e6-7214-4081-8a31-26b113769d15 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:14.305934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c8c49e6-7214-4081-8a31-26b113769d15 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:14.309356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c8c49e6-7214-4081-8a31-26b113769d15 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:14.363010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8b2f7de9-a9dc-4149-9cdc-6ac6aa182d5e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:14.375016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8b2f7de9-a9dc-4149-9cdc-6ac6aa182d5e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:14.379409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8b2f7de9-a9dc-4149-9cdc-6ac6aa182d5e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:14.381394 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8b2f7de9-a9dc-4149-9cdc-6ac6aa182d5e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1292 microversion: 2.25 time: 0.352025 Jul 26 14:12:14.382614 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 942/1757] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:14 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1292 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:14.391548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d4428a8d-7a80-4883-9c6b-b63ab9a7e987 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '.version_select at 0x7f8787604160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:14.393695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d4428a8d-7a80-4883-9c6b-b63ab9a7e987 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: b67891e5-6022-450b-80b7-e257a70e775f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:14.402782 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d4428a8d-7a80-4883-9c6b-b63ab9a7e987 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] HTTP exception thrown: Instance b67891e5-6022-450b-80b7-e257a70e775f could not be found. Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d4428a8d-7a80-4883-9c6b-b63ab9a7e987 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Request method failure captured: Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/b67891e5-6022-450b-80b7-e257a70e775f/os-instance-actions HTTP/1.1 Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Ydmn1QVUItIQEdGrq0woO57odvg2Klhe9QshzjvQGEOZn2wad2KiHHeJCFmrd4YnV8SyyGtj8-i_G_La7jF0bqWWGQX8yWnPqlO1vmlzLtw5qaapiVicqg-13V0YoSaV0gLdT6jQHy797Bt7FQeG9kew1mpUqg9ObozgVoTpZIOos Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8a2b6af31f6944a0b722252236ab369f Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-610982589 Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8a2b6af31f6944a0b722252236ab369f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8a2b6af31f6944a0b722252236ab369f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8a2b6af31f6944a0b722252236ab369f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8a2b6af31f6944a0b722252236ab369f"}]}] Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-610982589 Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8a2b6af31f6944a0b722252236ab369f Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-610982589 Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-InstanceActionsNegativeTestJSON-610982589-project Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 88df654a9ef0445792b02c8939fe4787 Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-610982589-project Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance b67891e5-6022-450b-80b7-e257a70e775f could not be found. Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'server_id': 'b67891e5-6022-450b-80b7-e257a70e775f'} Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b67891e5-6022-450b-80b7-e257a70e775f could not be found. Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:14.408522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b67891e5-6022-450b-80b7-e257a70e775f could not be found. Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b67891e5-6022-450b-80b7-e257a70e775f could not be found. Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:14.414358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d4428a8d-7a80-4883-9c6b-b63ab9a7e987 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Returning 404 to user: Instance b67891e5-6022-450b-80b7-e257a70e775f could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:14.415389 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d4428a8d-7a80-4883-9c6b-b63ab9a7e987 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/b67891e5-6022-450b-80b7-e257a70e775f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.030095 Jul 26 14:12:14.415389 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 943/1758] 10.222.0.70 () {58 vars in 1296 bytes} [Tue Jul 26 14:12:14 2022] GET /compute/v2.1/servers/b67891e5-6022-450b-80b7-e257a70e775f/os-instance-actions => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:14.440225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27bcd636-87e2-4514-a48c-20979ba8fb3a tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Action: 'create', calling method: .version_select at 0x7f87876dab80>, body: {"keypair": {"name": "tempest-keypair-1283383120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSnm6A/EbH7IfiD4Gfaac419cAeL+2PVfz4T94W0oZgqwDpqP7L+s3RNn/gA6e1Hs9qx6FqfZBzypHiafGGc0pdCJcBN2VqO6SwPwp0j9m3kLowj5L/PlkK7vszW5cTpw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:14.472826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-27bcd636-87e2-4514-a48c-20979ba8fb3a tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:14.479652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-27bcd636-87e2-4514-a48c-20979ba8fb3a tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for user b0bd30e3d0cf46fc95abd0116574b61e and project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:14.506710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:14.520769 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27bcd636-87e2-4514-a48c-20979ba8fb3a tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104589 Jul 26 14:12:14.526377 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 944/1759] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:12:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:14.533744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-604e217e-18e6-4efd-aed2-35c1b9b0ba5a tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:14.534264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-604e217e-18e6-4efd-aed2-35c1b9b0ba5a tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:14.543141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-604e217e-18e6-4efd-aed2-35c1b9b0ba5a tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:14.543825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-604e217e-18e6-4efd-aed2-35c1b9b0ba5a tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:14.544639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-604e217e-18e6-4efd-aed2-35c1b9b0ba5a tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:14.545078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-604e217e-18e6-4efd-aed2-35c1b9b0ba5a tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:14.646105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-604e217e-18e6-4efd-aed2-35c1b9b0ba5a tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:14.669234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c8c49e6-7214-4081-8a31-26b113769d15 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:14.724907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c8c49e6-7214-4081-8a31-26b113769d15 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:14.730646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c8c49e6-7214-4081-8a31-26b113769d15 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:14.756449 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c8c49e6-7214-4081-8a31-26b113769d15 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.468937 Jul 26 14:12:14.760475 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 816/1760] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:14 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:14.779428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c55374fa-519e-482e-98b2-337074305197 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Calling method '.version_select at 0x7f878764e8b0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:14.834005 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c55374fa-519e-482e-98b2-337074305197 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283383120" status: 202 len: 0 microversion: 2.1 time: 0.070537 Jul 26 14:12:14.848859 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 817/1761] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:12:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283383120 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:12:14.864744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8282dd38-adb2-40ec-8f3e-c83272138f82 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Action: 'create', calling method: .version_select at 0x7f87876109d0>, body: {"keypair": {"name": "tempest-keypair-1648645207", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:14.892605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8282dd38-adb2-40ec-8f3e-c83272138f82 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:14.904244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8282dd38-adb2-40ec-8f3e-c83272138f82 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for user b0bd30e3d0cf46fc95abd0116574b61e and project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:14.906164 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-604e217e-18e6-4efd-aed2-35c1b9b0ba5a tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 204 len: 0 microversion: 2.1 time: 0.378190 Jul 26 14:12:14.907394 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 945/1762] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:14 2022] DELETE /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:14.921084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6bc0eb8c-1902-4122-956e-d1aeb1c54c32 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:14.941719 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8282dd38-adb2-40ec-8f3e-c83272138f82 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.084396 Jul 26 14:12:14.942308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6bc0eb8c-1902-4122-956e-d1aeb1c54c32 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:14.943487 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 818/1763] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:12:14 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:14.958511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-151bf9c8-dae1-43b0-aeaa-748ac6bf9645 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Calling method '.version_select at 0x7f8787588040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:14.968726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bc0eb8c-1902-4122-956e-d1aeb1c54c32 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:14.968726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bc0eb8c-1902-4122-956e-d1aeb1c54c32 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:14.973886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bc0eb8c-1902-4122-956e-d1aeb1c54c32 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:14.974637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bc0eb8c-1902-4122-956e-d1aeb1c54c32 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:15.013684 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-151bf9c8-dae1-43b0-aeaa-748ac6bf9645 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648645207" status: 202 len: 0 microversion: 2.1 time: 0.060702 Jul 26 14:12:15.016814 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 819/1764] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:12:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648645207 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:12:15.038129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-008941c8-ec23-444e-901d-c9324eb1f8cd tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:15.040834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-008941c8-ec23-444e-901d-c9324eb1f8cd tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:15.067013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-008941c8-ec23-444e-901d-c9324eb1f8cd tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:15.068394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-008941c8-ec23-444e-901d-c9324eb1f8cd tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:15.069919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-008941c8-ec23-444e-901d-c9324eb1f8cd tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:15.070633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-008941c8-ec23-444e-901d-c9324eb1f8cd tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:15.416260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6bc0eb8c-1902-4122-956e-d1aeb1c54c32 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:15.445377 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6bc0eb8c-1902-4122-956e-d1aeb1c54c32 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1526 microversion: 2.1 time: 0.526846 Jul 26 14:12:15.449024 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 946/1765] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:14 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1526 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:15.462682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2552249f-902d-428d-9d68-f522a55ff148 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Action: 'create', calling method: .version_select at 0x7f87876a7040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-4831722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhhgM9fG4L6aPDRvI6XLEFHgjd6FeekxcCG/Y453dsRBDoMUGne8aCCF16ZKgJnCnRCVPtqDleN9QybipuT4+efYNWTTtZYUUIJ+qMH3Bzngp9ULOF9SyTkvVZuLoA7Nw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:15.496994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-2552249f-902d-428d-9d68-f522a55ff148 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:15.506827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-2552249f-902d-428d-9d68-f522a55ff148 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for user b0bd30e3d0cf46fc95abd0116574b61e and project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:15.544272 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2552249f-902d-428d-9d68-f522a55ff148 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.093454 Jul 26 14:12:15.559985 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 947/1766] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:12:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:15.568945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-008941c8-ec23-444e-901d-c9324eb1f8cd tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:15.569867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-832ed136-3e95-4532-a216-47cdcdb705ed tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:15.573225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-832ed136-3e95-4532-a216-47cdcdb705ed tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:15.584799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-832ed136-3e95-4532-a216-47cdcdb705ed tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:15.585904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-832ed136-3e95-4532-a216-47cdcdb705ed tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:15.588059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-832ed136-3e95-4532-a216-47cdcdb705ed tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:15.588998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-832ed136-3e95-4532-a216-47cdcdb705ed tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:15.623388 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-008941c8-ec23-444e-901d-c9324eb1f8cd tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1589 microversion: 2.1 time: 0.584128 Jul 26 14:12:15.641000 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 820/1767] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:15 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1589 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:15.658381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64f56cd2-2351-4013-a0db-32a161e176ba tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:15.659018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-64f56cd2-2351-4013-a0db-32a161e176ba tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:15.679396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64f56cd2-2351-4013-a0db-32a161e176ba tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:15.680227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64f56cd2-2351-4013-a0db-32a161e176ba tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:15.683148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64f56cd2-2351-4013-a0db-32a161e176ba tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:15.684096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64f56cd2-2351-4013-a0db-32a161e176ba tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:16.139261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64f56cd2-2351-4013-a0db-32a161e176ba tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:16.157810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64f56cd2-2351-4013-a0db-32a161e176ba tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:16.160185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64f56cd2-2351-4013-a0db-32a161e176ba tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:16.162322 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64f56cd2-2351-4013-a0db-32a161e176ba tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1292 microversion: 2.25 time: 0.529561 Jul 26 14:12:16.163327 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 821/1768] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:15 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1292 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:16.182233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-832ed136-3e95-4532-a216-47cdcdb705ed tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:16.187633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-60bf23b2-235f-448a-bb09-aa9c909d4464 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Action: 'create', calling method: .version_select at 0x7f8787588ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-189706340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzJ2e2/Bm1DDFymv4r9qBepwqs7cJI0DaqKAWkbFPZteEmAe6527jY9OMW6DrYL+5piLOECW/SAiG1mIVLju6Q203wHV1Znf6EbZ264ls4Mmq1x1ZRMZ6Cax/bW/ua3og=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:16.194857 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-832ed136-3e95-4532-a216-47cdcdb705ed tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1471 microversion: 2.1 time: 0.642626 Jul 26 14:12:16.209368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-60bf23b2-235f-448a-bb09-aa9c909d4464 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:16.211788 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 948/1769] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:15 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1471 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:16.217414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-60bf23b2-235f-448a-bb09-aa9c909d4464 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for user b0bd30e3d0cf46fc95abd0116574b61e and project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:16.226472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d87407eb-d583-4137-bb77-0d5165759e31 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:16.227127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d87407eb-d583-4137-bb77-0d5165759e31 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:16.245376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87407eb-d583-4137-bb77-0d5165759e31 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:16.245873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87407eb-d583-4137-bb77-0d5165759e31 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:16.246961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87407eb-d583-4137-bb77-0d5165759e31 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:16.247567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87407eb-d583-4137-bb77-0d5165759e31 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:16.257088 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-60bf23b2-235f-448a-bb09-aa9c909d4464 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.078129 Jul 26 14:12:16.260386 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 822/1770] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:12:16 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:16.275053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cb6031ee-48b2-4e83-9010-1ee16883ec68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:16.276905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cb6031ee-48b2-4e83-9010-1ee16883ec68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:16.300139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb6031ee-48b2-4e83-9010-1ee16883ec68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:16.301854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb6031ee-48b2-4e83-9010-1ee16883ec68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:16.303873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb6031ee-48b2-4e83-9010-1ee16883ec68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:16.305136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb6031ee-48b2-4e83-9010-1ee16883ec68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:16.510743 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d87407eb-d583-4137-bb77-0d5165759e31 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.297261 Jul 26 14:12:16.512647 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 949/1771] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:12:16 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f/os-interface => generated 284 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:16.524775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-839c051a-9a35-4de8-994e-46f52b1519bb tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Action: 'create', calling method: .version_select at 0x7f8794969b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1329772787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJX5eY2odgbEr0KpAbxtI0tchj6f3+3uHxqe2Ituj95c6bcmT4veiy55715Z35oAx2iJtnKZx65/Ya+mnoGsrUzZMbaXuDG6C1I6IZ3WNMIklA265ePfcvOALosRFijoqw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:16.572578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-839c051a-9a35-4de8-994e-46f52b1519bb tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:16.589460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-839c051a-9a35-4de8-994e-46f52b1519bb tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Getting quotas for user b0bd30e3d0cf46fc95abd0116574b61e and project 1d647b88dbbc45aeadd4dfb7aa37ce88. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:16.665354 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-839c051a-9a35-4de8-994e-46f52b1519bb tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.150216 Jul 26 14:12:16.666701 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 950/1772] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:12:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:16.673684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dd28ca42-76b5-4fe2-8516-ad4618c63a00 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:16.675014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dd28ca42-76b5-4fe2-8516-ad4618c63a00 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:16.686873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd28ca42-76b5-4fe2-8516-ad4618c63a00 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:16.687716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd28ca42-76b5-4fe2-8516-ad4618c63a00 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:16.691074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd28ca42-76b5-4fe2-8516-ad4618c63a00 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:16.692105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd28ca42-76b5-4fe2-8516-ad4618c63a00 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:16.893612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb6031ee-48b2-4e83-9010-1ee16883ec68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:16.910632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb6031ee-48b2-4e83-9010-1ee16883ec68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:16.913090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb6031ee-48b2-4e83-9010-1ee16883ec68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:16.915108 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cb6031ee-48b2-4e83-9010-1ee16883ec68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.652135 Jul 26 14:12:16.931982 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 823/1773] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:16 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:16.931982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2cc886b0-4a8a-480e-b8ba-1cf3b8d02303 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Calling method '.version_select at 0x7f8787610af0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:16.931982 n-d-833090-9 devstack@n-api.service[119478]: WARNING oslo_db.sqlalchemy.utils [None req-2cc886b0-4a8a-480e-b8ba-1cf3b8d02303 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 14:12:16.936965 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2cc886b0-4a8a-480e-b8ba-1cf3b8d02303 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1090 microversion: 2.1 time: 0.019463 Jul 26 14:12:16.938383 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 824/1774] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:12:16 2022] GET /compute/v2.1/os-keypairs => generated 1090 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:16.949675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-34d33670-56c2-4a87-b2c5-42544f8f596a tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Calling method '.version_select at 0x7f87879bf790>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:16.963773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:16.980895 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-34d33670-56c2-4a87-b2c5-42544f8f596a tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1329772787" status: 202 len: 0 microversion: 2.1 time: 0.035698 Jul 26 14:12:16.981996 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 825/1775] 10.222.0.70 () {58 vars in 1278 bytes} [Tue Jul 26 14:12:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1329772787 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:12:16.998291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3e8ec71d-a1f7-44be-a71a-e0be98420da6 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Calling method '.version_select at 0x7f87879bfca0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:17.058306 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3e8ec71d-a1f7-44be-a71a-e0be98420da6 tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-189706340" status: 202 len: 0 microversion: 2.1 time: 0.069576 Jul 26 14:12:17.060010 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 826/1776] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:12:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-189706340 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:12:17.069754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cd6d881b-7bc9-422c-bf68-5527451da40d tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] Calling method '.version_select at 0x7f8787610670>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:17.102515 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cd6d881b-7bc9-422c-bf68-5527451da40d tempest-KeyPairsV2TestJSON-1868190711 tempest-KeyPairsV2TestJSON-1868190711-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-4831722" status: 202 len: 0 microversion: 2.1 time: 0.037512 Jul 26 14:12:17.116905 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 827/1777] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:12:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-4831722 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:12:17.193638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-382f67d6-14f2-4945-b3ab-7cbf84fbf0db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:17.194677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-382f67d6-14f2-4945-b3ab-7cbf84fbf0db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:17.215391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-382f67d6-14f2-4945-b3ab-7cbf84fbf0db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:17.217489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-382f67d6-14f2-4945-b3ab-7cbf84fbf0db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:17.220880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-382f67d6-14f2-4945-b3ab-7cbf84fbf0db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:17.221163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dd28ca42-76b5-4fe2-8516-ad4618c63a00 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:17.222448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-382f67d6-14f2-4945-b3ab-7cbf84fbf0db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:17.262801 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dd28ca42-76b5-4fe2-8516-ad4618c63a00 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1526 microversion: 2.1 time: 0.594490 Jul 26 14:12:17.267452 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 951/1778] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:16 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1526 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:17.287916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b56b2ede-e39a-4c80-b9f7-34efc655e572 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:17.298540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b56b2ede-e39a-4c80-b9f7-34efc655e572 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:17.310925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b56b2ede-e39a-4c80-b9f7-34efc655e572 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:17.316828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b56b2ede-e39a-4c80-b9f7-34efc655e572 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:17.318410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b56b2ede-e39a-4c80-b9f7-34efc655e572 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:17.329130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b56b2ede-e39a-4c80-b9f7-34efc655e572 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:17.356928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:17.406498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:17.737881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b56b2ede-e39a-4c80-b9f7-34efc655e572 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:17.742846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:17.754756 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b56b2ede-e39a-4c80-b9f7-34efc655e572 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 200 len: 1429 microversion: 2.1 time: 0.475753 Jul 26 14:12:17.768168 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 952/1779] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:17 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 1429 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:17.945221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-48c84263-d6cc-4061-9366-35a0560bb0ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:17.945843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-48c84263-d6cc-4061-9366-35a0560bb0ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:17.957358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-48c84263-d6cc-4061-9366-35a0560bb0ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:17.957819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-48c84263-d6cc-4061-9366-35a0560bb0ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:17.958630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-48c84263-d6cc-4061-9366-35a0560bb0ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:17.959080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-48c84263-d6cc-4061-9366-35a0560bb0ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:18.641325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-382f67d6-14f2-4945-b3ab-7cbf84fbf0db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:18.675576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-382f67d6-14f2-4945-b3ab-7cbf84fbf0db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:18.678779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-382f67d6-14f2-4945-b3ab-7cbf84fbf0db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:18.687368 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-382f67d6-14f2-4945-b3ab-7cbf84fbf0db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 1.500014 Jul 26 14:12:18.703977 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 828/1780] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:17 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:12:18.713468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-fc68550b-f5e6-4d2c-9d72-5f49863f99bb req-d7dabdf3-2478-47bd-880d-bea196e12599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "722480e6-d20a-4961-8c4b-a2e5f3a3964d", "name": "network-vif-deleted", "tag": "d700de43-19cd-4880-91fd-ae3d7ba0c8bb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:18.748467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fc68550b-f5e6-4d2c-9d72-5f49863f99bb req-d7dabdf3-2478-47bd-880d-bea196e12599 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:18.749289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fc68550b-f5e6-4d2c-9d72-5f49863f99bb req-d7dabdf3-2478-47bd-880d-bea196e12599 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:18.817048 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-fc68550b-f5e6-4d2c-9d72-5f49863f99bb req-d7dabdf3-2478-47bd-880d-bea196e12599 service nova] Creating event network-vif-deleted:d700de43-19cd-4880-91fd-ae3d7ba0c8bb for instance 722480e6-d20a-4961-8c4b-a2e5f3a3964d on n-h2-833090-9 Jul 26 14:12:18.833445 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-fc68550b-f5e6-4d2c-9d72-5f49863f99bb req-d7dabdf3-2478-47bd-880d-bea196e12599 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139080 Jul 26 14:12:18.838806 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 829/1781] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:18.856013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3ad3144f-5c64-4e51-a7ff-9c3a27a3f3e6 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:18.857562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3ad3144f-5c64-4e51-a7ff-9c3a27a3f3e6 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:18.885436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ad3144f-5c64-4e51-a7ff-9c3a27a3f3e6 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:18.888039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ad3144f-5c64-4e51-a7ff-9c3a27a3f3e6 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:18.890464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ad3144f-5c64-4e51-a7ff-9c3a27a3f3e6 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:18.894174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ad3144f-5c64-4e51-a7ff-9c3a27a3f3e6 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:19.574447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-48c84263-d6cc-4061-9366-35a0560bb0ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:19.595131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-48c84263-d6cc-4061-9366-35a0560bb0ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:19.599702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-48c84263-d6cc-4061-9366-35a0560bb0ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:19.603632 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-48c84263-d6cc-4061-9366-35a0560bb0ab tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.661310 Jul 26 14:12:19.604738 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 953/1782] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:17 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:12:19.647063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83ab4d7d-c6d7-4110-98e7-a4331d267064 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:19.653896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-83ab4d7d-c6d7-4110-98e7-a4331d267064 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 722480e6-d20a-4961-8c4b-a2e5f3a3964d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:19.688759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83ab4d7d-c6d7-4110-98e7-a4331d267064 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:19.689239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83ab4d7d-c6d7-4110-98e7-a4331d267064 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:19.691335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83ab4d7d-c6d7-4110-98e7-a4331d267064 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:19.694680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83ab4d7d-c6d7-4110-98e7-a4331d267064 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:19.757479 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-83ab4d7d-c6d7-4110-98e7-a4331d267064 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] HTTP exception thrown: Instance 722480e6-d20a-4961-8c4b-a2e5f3a3964d could not be found. Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83ab4d7d-c6d7-4110-98e7-a4331d267064 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Request method failure captured: Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d HTTP/1.1 Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VIEyEqsfRNf3q9y7-TCTWGm3iiZpx7sxczOefIdc-aX9pE72j6Y0gQBnBTQMKmdaXUF3Vkgw3pMeCcBOQ364OnMkUEed1O2SJU9yUegYzUVxOIlRBOev7140EQWmbUNr1kGSa4cG7wd0pNLhpDlwn1GEkvKfuvWpaZmxqE9WwUjPg Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3982eb0d2c734ff3bd9a13a61d1214a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}] Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 595ebbd7d38049268b2bba22fee81f14 Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 722480e6-d20a-4961-8c4b-a2e5f3a3964d could not be found. Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '722480e6-d20a-4961-8c4b-a2e5f3a3964d'} Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 722480e6-d20a-4961-8c4b-a2e5f3a3964d could not be found. Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 722480e6-d20a-4961-8c4b-a2e5f3a3964d could not be found. Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:19.760749 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:19.766353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:19.766353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:19.766353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:19.766353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:19.766353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:19.766353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 722480e6-d20a-4961-8c4b-a2e5f3a3964d could not be found. Jul 26 14:12:19.766353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:19.768191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83ab4d7d-c6d7-4110-98e7-a4331d267064 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Returning 404 to user: Instance 722480e6-d20a-4961-8c4b-a2e5f3a3964d could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:19.769343 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-83ab4d7d-c6d7-4110-98e7-a4331d267064 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d" status: 404 len: 111 microversion: 2.1 time: 0.163286 Jul 26 14:12:19.772723 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 954/1783] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:19 2022] GET /compute/v2.1/servers/722480e6-d20a-4961-8c4b-a2e5f3a3964d => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:19.781501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b4b3be16-954e-4f74-aeee-4c99990353bc tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Calling method '.version_select at 0x7f87876d4430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:19.871595 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b4b3be16-954e-4f74-aeee-4c99990353bc tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2" status: 200 len: 637 microversion: 2.1 time: 0.094137 Jul 26 14:12:19.873524 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 955/1784] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:12:19 2022] GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2 => generated 637 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:19.878868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4c079bbb-3727-447e-8b2b-529e417e864c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:19.879861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4c079bbb-3727-447e-8b2b-529e417e864c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:19.888630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c079bbb-3727-447e-8b2b-529e417e864c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:19.892812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c079bbb-3727-447e-8b2b-529e417e864c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:19.894086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c079bbb-3727-447e-8b2b-529e417e864c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:19.894780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c079bbb-3727-447e-8b2b-529e417e864c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:20.042637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3ad3144f-5c64-4e51-a7ff-9c3a27a3f3e6 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88df654a9ef0445792b02c8939fe4787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2b6af31f6944a0b722252236ab369f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:20.057825 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3ad3144f-5c64-4e51-a7ff-9c3a27a3f3e6 tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 200 len: 1526 microversion: 2.1 time: 1.214391 Jul 26 14:12:20.077332 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 830/1785] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:18 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 1526 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:20.092931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7579ebf7-d4dd-409a-918d-7ba776a6cba6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:20.094742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7579ebf7-d4dd-409a-918d-7ba776a6cba6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:20.114027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7579ebf7-d4dd-409a-918d-7ba776a6cba6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:20.114939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7579ebf7-d4dd-409a-918d-7ba776a6cba6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:20.116698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7579ebf7-d4dd-409a-918d-7ba776a6cba6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:20.117674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7579ebf7-d4dd-409a-918d-7ba776a6cba6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:20.183053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7579ebf7-d4dd-409a-918d-7ba776a6cba6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:20.417541 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7579ebf7-d4dd-409a-918d-7ba776a6cba6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 204 len: 0 microversion: 2.1 time: 0.329992 Jul 26 14:12:20.419983 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 831/1786] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:20 2022] DELETE /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:20.434048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87438a7a-cb23-4a97-995e-7764ecbd0389 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Action: 'update_all', calling method: .version_select at 0x7f8787715e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:20.522200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4c079bbb-3727-447e-8b2b-529e417e864c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:20.535067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-87438a7a-cb23-4a97-995e-7764ecbd0389 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:20.541351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4c079bbb-3727-447e-8b2b-529e417e864c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:20.543717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4c079bbb-3727-447e-8b2b-529e417e864c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:20.545062 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4c079bbb-3727-447e-8b2b-529e417e864c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.670187 Jul 26 14:12:20.545835 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 956/1787] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:19 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:20.552471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ddf6a146-5475-45f0-99f8-300b46a8608c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:20.553584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ddf6a146-5475-45f0-99f8-300b46a8608c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:20.564308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-87438a7a-cb23-4a97-995e-7764ecbd0389 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for user 0dba5dde4cfc4ed790c3168261261f0c and project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:20.571133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddf6a146-5475-45f0-99f8-300b46a8608c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:20.571940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddf6a146-5475-45f0-99f8-300b46a8608c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:20.573075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddf6a146-5475-45f0-99f8-300b46a8608c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:20.578757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddf6a146-5475-45f0-99f8-300b46a8608c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:21.309310 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-87438a7a-cb23-4a97-995e-7764ecbd0389 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.885167 Jul 26 14:12:21.310893 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 832/1788] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:12:20 2022] PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 61 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:21.327767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-409e2a51-6066-4b00-95d3-ce85b6e7ce4f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:21.332169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-409e2a51-6066-4b00-95d3-ce85b6e7ce4f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:21.351372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-409e2a51-6066-4b00-95d3-ce85b6e7ce4f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:21.352761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-409e2a51-6066-4b00-95d3-ce85b6e7ce4f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:21.353895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-409e2a51-6066-4b00-95d3-ce85b6e7ce4f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:21.354616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-409e2a51-6066-4b00-95d3-ce85b6e7ce4f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:21.396595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ddf6a146-5475-45f0-99f8-300b46a8608c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:21.412155 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ddf6a146-5475-45f0-99f8-300b46a8608c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1473 microversion: 2.1 time: 0.864472 Jul 26 14:12:21.414134 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 957/1789] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:20 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1473 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:21.427642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-701c5e0b-f359-4b17-8ce0-3769d66746cd tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:21.428818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-701c5e0b-f359-4b17-8ce0-3769d66746cd tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] [instance: a089b93c-78b2-42bd-8381-e81d17ca5d8b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:21.462002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-701c5e0b-f359-4b17-8ce0-3769d66746cd tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:21.462709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-701c5e0b-f359-4b17-8ce0-3769d66746cd tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:21.463751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-701c5e0b-f359-4b17-8ce0-3769d66746cd tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:21.464418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-701c5e0b-f359-4b17-8ce0-3769d66746cd tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:21.514692 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-701c5e0b-f359-4b17-8ce0-3769d66746cd tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] HTTP exception thrown: Instance a089b93c-78b2-42bd-8381-e81d17ca5d8b could not be found. Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-701c5e0b-f359-4b17-8ce0-3769d66746cd tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Request method failure captured: Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b HTTP/1.1 Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_Ydmn1QVUItIQEdGrq0woO57odvg2Klhe9QshzjvQGEOZn2wad2KiHHeJCFmrd4YnV8SyyGtj8-i_G_La7jF0bqWWGQX8yWnPqlO1vmlzLtw5qaapiVicqg-13V0YoSaV0gLdT6jQHy797Bt7FQeG9kew1mpUqg9ObozgVoTpZIOos Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8a2b6af31f6944a0b722252236ab369f Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-610982589 Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8a2b6af31f6944a0b722252236ab369f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8a2b6af31f6944a0b722252236ab369f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8a2b6af31f6944a0b722252236ab369f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8a2b6af31f6944a0b722252236ab369f"}]}] Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-610982589 Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8a2b6af31f6944a0b722252236ab369f Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-610982589 Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-InstanceActionsNegativeTestJSON-610982589-project Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 88df654a9ef0445792b02c8939fe4787 Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-610982589-project Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance a089b93c-78b2-42bd-8381-e81d17ca5d8b could not be found. Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'a089b93c-78b2-42bd-8381-e81d17ca5d8b'} Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a089b93c-78b2-42bd-8381-e81d17ca5d8b could not be found. Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a089b93c-78b2-42bd-8381-e81d17ca5d8b could not be found. Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:21.525318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:21.536385 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:21.536385 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:21.536385 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:21.536385 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:21.536385 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:21.536385 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:21.536385 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a089b93c-78b2-42bd-8381-e81d17ca5d8b could not be found. Jul 26 14:12:21.536385 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:21.536385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-701c5e0b-f359-4b17-8ce0-3769d66746cd tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] Returning 404 to user: Instance a089b93c-78b2-42bd-8381-e81d17ca5d8b could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:21.536385 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-701c5e0b-f359-4b17-8ce0-3769d66746cd tempest-InstanceActionsNegativeTestJSON-610982589 tempest-InstanceActionsNegativeTestJSON-610982589-project] 10.222.0.70 "GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b" status: 404 len: 111 microversion: 2.1 time: 0.116039 Jul 26 14:12:21.540300 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 958/1790] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:21 2022] GET /compute/v2.1/servers/a089b93c-78b2-42bd-8381-e81d17ca5d8b => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:21.558401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9175a22c-99ee-496b-832f-e5937dbb429b req-883cdb6a-f268-40de-9993-b18dc8e4f0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a089b93c-78b2-42bd-8381-e81d17ca5d8b", "name": "network-vif-deleted", "tag": "d31bb287-ed78-423c-9ebb-7e057c85ea9b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:21.578710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9175a22c-99ee-496b-832f-e5937dbb429b req-883cdb6a-f268-40de-9993-b18dc8e4f0ca service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:21.579184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9175a22c-99ee-496b-832f-e5937dbb429b req-883cdb6a-f268-40de-9993-b18dc8e4f0ca service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:21.598491 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9175a22c-99ee-496b-832f-e5937dbb429b req-883cdb6a-f268-40de-9993-b18dc8e4f0ca service nova] Creating event network-vif-deleted:d31bb287-ed78-423c-9ebb-7e057c85ea9b for instance a089b93c-78b2-42bd-8381-e81d17ca5d8b on n-h1-833090-9 Jul 26 14:12:21.605434 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9175a22c-99ee-496b-832f-e5937dbb429b req-883cdb6a-f268-40de-9993-b18dc8e4f0ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063647 Jul 26 14:12:21.607383 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 959/1791] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:21.616255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a7761f03-bc25-4747-a5e5-0d36a212f70c tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Calling method '.version_select at 0x7f87876bb280>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:22.275664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-409e2a51-6066-4b00-95d3-ce85b6e7ce4f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:22.291320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-409e2a51-6066-4b00-95d3-ce85b6e7ce4f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:22.292899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-409e2a51-6066-4b00-95d3-ce85b6e7ce4f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:22.295880 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-409e2a51-6066-4b00-95d3-ce85b6e7ce4f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.977329 Jul 26 14:12:22.295880 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 833/1792] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:21 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:22.329185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7eb7b10b-5906-4f3c-9c2b-1ec28c4510cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:22.330023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7eb7b10b-5906-4f3c-9c2b-1ec28c4510cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:22.350524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eb7b10b-5906-4f3c-9c2b-1ec28c4510cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:22.350971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eb7b10b-5906-4f3c-9c2b-1ec28c4510cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:22.351781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eb7b10b-5906-4f3c-9c2b-1ec28c4510cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:22.352251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eb7b10b-5906-4f3c-9c2b-1ec28c4510cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:22.554435 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a7761f03-bc25-4747-a5e5-0d36a212f70c tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "DELETE /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.944358 Jul 26 14:12:22.555407 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 960/1793] 10.222.0.70 () {58 vars in 1296 bytes} [Tue Jul 26 14:12:21 2022] DELETE /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata/os_version => generated 0 bytes in 947 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:22.562788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0d0459a-9dcd-444a-9c43-da79f8a618da tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:22.571706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0d0459a-9dcd-444a-9c43-da79f8a618da tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:22.588192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d0459a-9dcd-444a-9c43-da79f8a618da tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:22.590237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d0459a-9dcd-444a-9c43-da79f8a618da tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:22.591753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d0459a-9dcd-444a-9c43-da79f8a618da tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:22.596033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d0459a-9dcd-444a-9c43-da79f8a618da tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:22.805093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7eb7b10b-5906-4f3c-9c2b-1ec28c4510cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:22.822162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7eb7b10b-5906-4f3c-9c2b-1ec28c4510cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:22.860431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7eb7b10b-5906-4f3c-9c2b-1ec28c4510cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:22.863004 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7eb7b10b-5906-4f3c-9c2b-1ec28c4510cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.540172 Jul 26 14:12:22.883195 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 834/1794] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:22 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:22.894067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-6576f811-c7d4-47e8-b49d-13578ebc3659 req-f855c523-08a5-43cf-b27a-96dccaa93342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15942639-9b2d-4a9b-a09f-2040d775466f", "tag": "9cfd3f06-7413-4c82-a6b1-861310d05144"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:22.924276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6576f811-c7d4-47e8-b49d-13578ebc3659 req-f855c523-08a5-43cf-b27a-96dccaa93342 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:22.927155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6576f811-c7d4-47e8-b49d-13578ebc3659 req-f855c523-08a5-43cf-b27a-96dccaa93342 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:22.950195 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-6576f811-c7d4-47e8-b49d-13578ebc3659 req-f855c523-08a5-43cf-b27a-96dccaa93342 service nova] Creating event network-changed:9cfd3f06-7413-4c82-a6b1-861310d05144 for instance 15942639-9b2d-4a9b-a09f-2040d775466f on n-h1-833090-9 Jul 26 14:12:22.958502 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-6576f811-c7d4-47e8-b49d-13578ebc3659 req-f855c523-08a5-43cf-b27a-96dccaa93342 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080187 Jul 26 14:12:22.960135 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 835/1795] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:22.993113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fdcd32ef-6b0c-464c-9f85-fb6c5b3f8a6a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:22.995167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fdcd32ef-6b0c-464c-9f85-fb6c5b3f8a6a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:23.005899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdcd32ef-6b0c-464c-9f85-fb6c5b3f8a6a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:23.006782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdcd32ef-6b0c-464c-9f85-fb6c5b3f8a6a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:23.008262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdcd32ef-6b0c-464c-9f85-fb6c5b3f8a6a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:23.016862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdcd32ef-6b0c-464c-9f85-fb6c5b3f8a6a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:23.604931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fdcd32ef-6b0c-464c-9f85-fb6c5b3f8a6a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:23.617416 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fdcd32ef-6b0c-464c-9f85-fb6c5b3f8a6a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1473 microversion: 2.1 time: 0.655656 Jul 26 14:12:23.620942 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 836/1796] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:22 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1473 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:23.629366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6ac25114-568b-453c-8121-201636788d55 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Calling method '.version_select at 0x7f8787610160>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:23.697206 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6ac25114-568b-453c-8121-201636788d55 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 37 microversion: 2.1 time: 0.074982 Jul 26 14:12:23.704577 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 837/1797] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:12:23 2022] GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 37 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:23.735287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0592f7fc-baaa-424d-a7b7-557301f5bda1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:23.736658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0592f7fc-baaa-424d-a7b7-557301f5bda1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:23.750097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0592f7fc-baaa-424d-a7b7-557301f5bda1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:23.750861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0592f7fc-baaa-424d-a7b7-557301f5bda1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:23.752670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0592f7fc-baaa-424d-a7b7-557301f5bda1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:23.753769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0592f7fc-baaa-424d-a7b7-557301f5bda1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:23.845830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0d0459a-9dcd-444a-9c43-da79f8a618da tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:23.862384 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0d0459a-9dcd-444a-9c43-da79f8a618da tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1589 microversion: 2.1 time: 1.305045 Jul 26 14:12:23.863746 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 961/1798] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:22 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1589 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:23.874126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6015a9c7-1dcf-4258-bb0a-1c3274fc0c31 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Action: 'update_all', calling method: .version_select at 0x7f87875c0670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:23.982958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-6015a9c7-1dcf-4258-bb0a-1c3274fc0c31 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:24.004462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-6015a9c7-1dcf-4258-bb0a-1c3274fc0c31 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for user 0dba5dde4cfc4ed790c3168261261f0c and project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:24.366974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0592f7fc-baaa-424d-a7b7-557301f5bda1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:24.379494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0592f7fc-baaa-424d-a7b7-557301f5bda1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:24.381873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0592f7fc-baaa-424d-a7b7-557301f5bda1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:24.385789 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0592f7fc-baaa-424d-a7b7-557301f5bda1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.684276 Jul 26 14:12:24.386607 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 838/1799] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:23 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:24.393442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0743d360-d605-493a-b480-1c06618750e3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:24.394419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0743d360-d605-493a-b480-1c06618750e3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:24.402662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0743d360-d605-493a-b480-1c06618750e3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:24.403452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0743d360-d605-493a-b480-1c06618750e3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:24.404478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0743d360-d605-493a-b480-1c06618750e3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:24.405092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0743d360-d605-493a-b480-1c06618750e3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:24.473001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:24.511700 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6015a9c7-1dcf-4258-bb0a-1c3274fc0c31 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.646542 Jul 26 14:12:24.517511 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 962/1800] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:12:23 2022] PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 61 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:24.522955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9045b44e-20b0-4b4b-bae7-bd4075ad8782 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Calling method '.version_select at 0x7f87876a7c10>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:24.573508 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9045b44e-20b0-4b4b-bae7-bd4075ad8782 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.054435 Jul 26 14:12:24.582370 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 963/1801] 10.222.0.70 () {58 vars in 1290 bytes} [Tue Jul 26 14:12:24 2022] GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata/os_distro => generated 33 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:24.590696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4e174382-07d2-4f82-9284-40c42282e797 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Action: 'update_all', calling method: .version_select at 0x7f87876a7790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:24.664141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-4e174382-07d2-4f82-9284-40c42282e797 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:24.672094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-4e174382-07d2-4f82-9284-40c42282e797 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for user 0dba5dde4cfc4ed790c3168261261f0c and project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:24.882683 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4e174382-07d2-4f82-9284-40c42282e797 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.298352 Jul 26 14:12:24.883286 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 964/1802] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:12:24 2022] PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 61 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:24.892840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9841ef5-6f7a-46c1-95c1-594727e445d3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:24.893469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d9841ef5-6f7a-46c1-95c1-594727e445d3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:24.900851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9841ef5-6f7a-46c1-95c1-594727e445d3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:24.901567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9841ef5-6f7a-46c1-95c1-594727e445d3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:24.902817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9841ef5-6f7a-46c1-95c1-594727e445d3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:24.903571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9841ef5-6f7a-46c1-95c1-594727e445d3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:25.048056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d9841ef5-6f7a-46c1-95c1-594727e445d3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:25.058178 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d9841ef5-6f7a-46c1-95c1-594727e445d3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 200 len: 1431 microversion: 2.1 time: 0.169547 Jul 26 14:12:25.059413 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 965/1803] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:24 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 1431 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:25.086283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-53402b5b-be57-4ed4-a3d3-5b08e52ad472 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Calling method '.version_select at 0x7f87876af1f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:25.165949 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-53402b5b-be57-4ed4-a3d3-5b08e52ad472 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.104794 Jul 26 14:12:25.166613 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 966/1804] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:12:25 2022] GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 61 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:25.178234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ad5501e6-7044-487f-becf-8b4e041b1648 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Action: 'update_all', calling method: .version_select at 0x7f87876bb3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:25.195759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0743d360-d605-493a-b480-1c06618750e3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:25.211314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0743d360-d605-493a-b480-1c06618750e3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:25.213235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0743d360-d605-493a-b480-1c06618750e3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:25.224585 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0743d360-d605-493a-b480-1c06618750e3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.836547 Jul 26 14:12:25.225853 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 839/1805] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:24 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:25.286671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-1997eb1e-0c71-4e7b-aa29-d029b89afaed req-7848e3b8-bf07-4cd8-88fc-bee19aff14c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c22c8fd-b9fb-4fff-9571-4f3013ea9114", "name": "network-vif-deleted", "tag": "1b25f608-868a-4c1e-92e5-13cdf2d63821"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:25.340136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ad5501e6-7044-487f-becf-8b4e041b1648 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:25.341817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1997eb1e-0c71-4e7b-aa29-d029b89afaed req-7848e3b8-bf07-4cd8-88fc-bee19aff14c9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:25.346135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1997eb1e-0c71-4e7b-aa29-d029b89afaed req-7848e3b8-bf07-4cd8-88fc-bee19aff14c9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:25.355401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ad5501e6-7044-487f-becf-8b4e041b1648 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for user 0dba5dde4cfc4ed790c3168261261f0c and project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:25.379984 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-1997eb1e-0c71-4e7b-aa29-d029b89afaed req-7848e3b8-bf07-4cd8-88fc-bee19aff14c9 service nova] Creating event network-vif-deleted:1b25f608-868a-4c1e-92e5-13cdf2d63821 for instance 2c22c8fd-b9fb-4fff-9571-4f3013ea9114 on n-h1-833090-9 Jul 26 14:12:25.388185 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-1997eb1e-0c71-4e7b-aa29-d029b89afaed req-7848e3b8-bf07-4cd8-88fc-bee19aff14c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107878 Jul 26 14:12:25.389587 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 840/1806] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:12:25.419494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dc44b947-7f0b-43b8-af30-22512d8e2e93 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:25.425654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dc44b947-7f0b-43b8-af30-22512d8e2e93 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:25.444147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc44b947-7f0b-43b8-af30-22512d8e2e93 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:25.449541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc44b947-7f0b-43b8-af30-22512d8e2e93 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:25.453573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc44b947-7f0b-43b8-af30-22512d8e2e93 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:25.454654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc44b947-7f0b-43b8-af30-22512d8e2e93 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:25.615289 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ad5501e6-7044-487f-becf-8b4e041b1648 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.441236 Jul 26 14:12:25.616959 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 967/1807] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:12:25 2022] PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 61 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:25.639312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71f6ab8a-ff5f-461b-916c-b878c885516c tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Action: 'update_all', calling method: .version_select at 0x7f87876bb8b0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:25.754189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-71f6ab8a-ff5f-461b-916c-b878c885516c tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:25.767746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-71f6ab8a-ff5f-461b-916c-b878c885516c tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for user 0dba5dde4cfc4ed790c3168261261f0c and project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:26.258037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dc44b947-7f0b-43b8-af30-22512d8e2e93 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:26.274058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dc44b947-7f0b-43b8-af30-22512d8e2e93 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:26.278009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dc44b947-7f0b-43b8-af30-22512d8e2e93 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:26.279762 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dc44b947-7f0b-43b8-af30-22512d8e2e93 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.868162 Jul 26 14:12:26.281251 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 841/1808] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:25 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:26.292428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ccd83f0-9bd1-42f0-936e-4c48a6aec814 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:26.294155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ccd83f0-9bd1-42f0-936e-4c48a6aec814 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 2c22c8fd-b9fb-4fff-9571-4f3013ea9114] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:26.303131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ccd83f0-9bd1-42f0-936e-4c48a6aec814 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:26.303828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ccd83f0-9bd1-42f0-936e-4c48a6aec814 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:26.304993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ccd83f0-9bd1-42f0-936e-4c48a6aec814 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:26.306091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ccd83f0-9bd1-42f0-936e-4c48a6aec814 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:26.331310 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8ccd83f0-9bd1-42f0-936e-4c48a6aec814 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] HTTP exception thrown: Instance 2c22c8fd-b9fb-4fff-9571-4f3013ea9114 could not be found. Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ccd83f0-9bd1-42f0-936e-4c48a6aec814 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Request method failure captured: Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 HTTP/1.1 Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VIEyEqsfRNf3q9y7-TCTWGm3iiZpx7sxczOefIdc-aX9pE72j6Y0gQBnBTQMKmdaXUF3Vkgw3pMeCcBOQ364OnMkUEed1O2SJU9yUegYzUVxOIlRBOev7140EQWmbUNr1kGSa4cG7wd0pNLhpDlwn1GEkvKfuvWpaZmxqE9WwUjPg Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3982eb0d2c734ff3bd9a13a61d1214a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}] Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 595ebbd7d38049268b2bba22fee81f14 Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 2c22c8fd-b9fb-4fff-9571-4f3013ea9114 could not be found. Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '2c22c8fd-b9fb-4fff-9571-4f3013ea9114'} Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c22c8fd-b9fb-4fff-9571-4f3013ea9114 could not be found. Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c22c8fd-b9fb-4fff-9571-4f3013ea9114 could not be found. Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:26.333105 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:26.338797 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:26.338797 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:26.338797 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:26.338797 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:26.338797 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:26.338797 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c22c8fd-b9fb-4fff-9571-4f3013ea9114 could not be found. Jul 26 14:12:26.338797 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:26.338797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ccd83f0-9bd1-42f0-936e-4c48a6aec814 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Returning 404 to user: Instance 2c22c8fd-b9fb-4fff-9571-4f3013ea9114 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:26.338797 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ccd83f0-9bd1-42f0-936e-4c48a6aec814 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114" status: 404 len: 111 microversion: 2.1 time: 0.052115 Jul 26 14:12:26.339636 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71f6ab8a-ff5f-461b-916c-b878c885516c tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 64 microversion: 2.1 time: 0.703459 Jul 26 14:12:26.341178 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 968/1809] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:12:25 2022] PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 64 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:26.344285 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 842/1810] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:26 2022] GET /compute/v2.1/servers/2c22c8fd-b9fb-4fff-9571-4f3013ea9114 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:26.351228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-806d7235-2ed7-4753-b72b-c45656baa5e8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:26.353540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3a0c26ce-c12f-49d1-9126-e37d7651549b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:26.354182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-806d7235-2ed7-4753-b72b-c45656baa5e8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:26.355964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3a0c26ce-c12f-49d1-9126-e37d7651549b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:26.363990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806d7235-2ed7-4753-b72b-c45656baa5e8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:26.365030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806d7235-2ed7-4753-b72b-c45656baa5e8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:26.365684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806d7235-2ed7-4753-b72b-c45656baa5e8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:26.367004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806d7235-2ed7-4753-b72b-c45656baa5e8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:26.368899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a0c26ce-c12f-49d1-9126-e37d7651549b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:26.369364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a0c26ce-c12f-49d1-9126-e37d7651549b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:26.370161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a0c26ce-c12f-49d1-9126-e37d7651549b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:26.371013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a0c26ce-c12f-49d1-9126-e37d7651549b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:26.412129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3a0c26ce-c12f-49d1-9126-e37d7651549b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:26.562918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-806d7235-2ed7-4753-b72b-c45656baa5e8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:26.576568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-806d7235-2ed7-4753-b72b-c45656baa5e8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:26.579433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-806d7235-2ed7-4753-b72b-c45656baa5e8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:26.580963 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-806d7235-2ed7-4753-b72b-c45656baa5e8 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.238271 Jul 26 14:12:26.582027 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 969/1811] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:26 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:26.588197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4de1c350-6109-48ae-b0c3-52315d511529 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Calling method '.version_select at 0x7f87876af1f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:26.604146 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3a0c26ce-c12f-49d1-9126-e37d7651549b tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 204 len: 0 microversion: 2.1 time: 0.257501 Jul 26 14:12:26.609771 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 843/1812] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:26 2022] DELETE /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:26.620841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-83b4d3a2-2a6c-4ab3-9697-f53946e2e511 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:26.621426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-83b4d3a2-2a6c-4ab3-9697-f53946e2e511 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:26.631686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83b4d3a2-2a6c-4ab3-9697-f53946e2e511 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:26.632317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83b4d3a2-2a6c-4ab3-9697-f53946e2e511 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:26.633164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83b4d3a2-2a6c-4ab3-9697-f53946e2e511 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:26.634035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83b4d3a2-2a6c-4ab3-9697-f53946e2e511 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:26.644047 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4de1c350-6109-48ae-b0c3-52315d511529 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 64 microversion: 2.1 time: 0.056432 Jul 26 14:12:26.646801 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 970/1813] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:12:26 2022] GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 64 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:26.663383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-848db009-cb8f-423c-894d-c6127724ddaa tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Action: 'update_all', calling method: .version_select at 0x7f87876f4820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:26.743175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-848db009-cb8f-423c-894d-c6127724ddaa tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:26.751751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-848db009-cb8f-423c-894d-c6127724ddaa tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for user 0dba5dde4cfc4ed790c3168261261f0c and project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:26.769752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:26.862866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-83b4d3a2-2a6c-4ab3-9697-f53946e2e511 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:26.879571 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-83b4d3a2-2a6c-4ab3-9697-f53946e2e511 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1471 microversion: 2.1 time: 0.265218 Jul 26 14:12:26.885188 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 844/1814] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:26 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:12:27.313334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c3cebb8-7e4c-4412-a70b-c78845ad88c9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:27.314136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c3cebb8-7e4c-4412-a70b-c78845ad88c9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:27.325670 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-848db009-cb8f-423c-894d-c6127724ddaa tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.670467 Jul 26 14:12:27.326758 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 971/1815] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:12:26 2022] PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 61 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:27.331521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c3cebb8-7e4c-4412-a70b-c78845ad88c9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:27.332278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c3cebb8-7e4c-4412-a70b-c78845ad88c9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:27.333258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c3cebb8-7e4c-4412-a70b-c78845ad88c9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:27.334032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c3cebb8-7e4c-4412-a70b-c78845ad88c9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:27.346545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57db4872-e66b-4ae6-82e8-c84b9504b6b6 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Action: 'update', calling method: .version_select at 0x7f8787639040>, body: {"meta": {"os_version": "alt"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:27.409543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-57db4872-e66b-4ae6-82e8-c84b9504b6b6 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:27.419032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-57db4872-e66b-4ae6-82e8-c84b9504b6b6 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for user 0dba5dde4cfc4ed790c3168261261f0c and project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:27.840537 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57db4872-e66b-4ae6-82e8-c84b9504b6b6 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.506222 Jul 26 14:12:27.841462 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 972/1816] 10.222.0.70 () {60 vars in 1313 bytes} [Tue Jul 26 14:12:27 2022] PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata/os_version => generated 31 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:27.848920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5fe7aa9c-6cce-4c9a-a213-d2d86b8ea0a1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:27.853296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5fe7aa9c-6cce-4c9a-a213-d2d86b8ea0a1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:27.870316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5fe7aa9c-6cce-4c9a-a213-d2d86b8ea0a1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:27.871848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5fe7aa9c-6cce-4c9a-a213-d2d86b8ea0a1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:27.872569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5fe7aa9c-6cce-4c9a-a213-d2d86b8ea0a1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:27.874426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5fe7aa9c-6cce-4c9a-a213-d2d86b8ea0a1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:28.288202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5fe7aa9c-6cce-4c9a-a213-d2d86b8ea0a1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:28.303115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5fe7aa9c-6cce-4c9a-a213-d2d86b8ea0a1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:28.306118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5fe7aa9c-6cce-4c9a-a213-d2d86b8ea0a1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:28.307751 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5fe7aa9c-6cce-4c9a-a213-d2d86b8ea0a1 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.464859 Jul 26 14:12:28.320248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c3cebb8-7e4c-4412-a70b-c78845ad88c9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:28.329684 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 973/1817] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:27 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:28.335603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-5d411505-f661-478e-9be3-a1c162e44a35 req-f184fb83-f334-4800-be2b-9628951765a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-plugged", "status": "completed", "tag": "b923158a-9822-423c-abbf-187f52ae32d2"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:28.348821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5d411505-f661-478e-9be3-a1c162e44a35 req-f184fb83-f334-4800-be2b-9628951765a7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:28.350425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5d411505-f661-478e-9be3-a1c162e44a35 req-f184fb83-f334-4800-be2b-9628951765a7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:28.360711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c3cebb8-7e4c-4412-a70b-c78845ad88c9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:28.363112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c3cebb8-7e4c-4412-a70b-c78845ad88c9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:28.369190 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c3cebb8-7e4c-4412-a70b-c78845ad88c9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.059010 Jul 26 14:12:28.370362 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 845/1818] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:27 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:12:28.377814 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-5d411505-f661-478e-9be3-a1c162e44a35 req-f184fb83-f334-4800-be2b-9628951765a7 service nova] Creating event network-vif-plugged:b923158a-9822-423c-abbf-187f52ae32d2 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:12:28.386264 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-5d411505-f661-478e-9be3-a1c162e44a35 req-f184fb83-f334-4800-be2b-9628951765a7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052590 Jul 26 14:12:28.387001 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 974/1819] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:28.387644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-06de47a5-fd95-4ca4-b64b-a18945214374 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Calling method '.version_select at 0x7f8787588280>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:28.405378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-649d57c3-faf5-4ebd-81a4-dc858546602f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:28.406177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-649d57c3-faf5-4ebd-81a4-dc858546602f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:28.418891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-649d57c3-faf5-4ebd-81a4-dc858546602f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:28.419363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-649d57c3-faf5-4ebd-81a4-dc858546602f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:28.420208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-649d57c3-faf5-4ebd-81a4-dc858546602f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:28.420698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-649d57c3-faf5-4ebd-81a4-dc858546602f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:28.449093 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-06de47a5-fd95-4ca4-b64b-a18945214374 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 58 microversion: 2.1 time: 0.073586 Jul 26 14:12:28.450165 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 846/1820] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:12:28 2022] GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 58 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:28.725096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1149093928", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:28.736957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-649d57c3-faf5-4ebd-81a4-dc858546602f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:28.747551 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-649d57c3-faf5-4ebd-81a4-dc858546602f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1471 microversion: 2.1 time: 0.354558 Jul 26 14:12:28.753901 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 975/1821] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:28 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1471 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:28.771258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abe4da50-49db-4115-8008-1393a88da481 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Action: 'update_all', calling method: .version_select at 0x7f87876f4ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:28.882459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] validate_networks() for [('dab98a43-b5e8-42ee-ab97-d87aedbae0eb', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:12:28.885432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-abe4da50-49db-4115-8008-1393a88da481 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:28.896607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-abe4da50-49db-4115-8008-1393a88da481 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for user 0dba5dde4cfc4ed790c3168261261f0c and project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:29.305300 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-abe4da50-49db-4115-8008-1393a88da481 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 61 microversion: 2.1 time: 0.548209 Jul 26 14:12:29.306570 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 976/1822] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:12:28 2022] PUT /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 61 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:29.316931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4e56e4a-2be5-4019-8610-33c6dff04875 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Action: 'create', calling method: .version_select at 0x7f87876f4dc0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:29.387760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e4e56e4a-2be5-4019-8610-33c6dff04875 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:29.397740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e4e56e4a-2be5-4019-8610-33c6dff04875 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Getting quotas for user 0dba5dde4cfc4ed790c3168261261f0c and project b72f5d6a7d204ccca7e72d61d01b4bda. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:29.854275 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4e56e4a-2be5-4019-8610-33c6dff04875 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "POST /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 85 microversion: 2.1 time: 0.541105 Jul 26 14:12:29.855515 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 977/1823] 10.222.0.70 () {60 vars in 1281 bytes} [Tue Jul 26 14:12:29 2022] POST /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 85 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:29.863054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5a63b630-3757-4bf8-b194-586731e52011 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:29.866227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5a63b630-3757-4bf8-b194-586731e52011 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:29.885687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5a63b630-3757-4bf8-b194-586731e52011 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:29.886163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5a63b630-3757-4bf8-b194-586731e52011 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:29.895123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5a63b630-3757-4bf8-b194-586731e52011 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:29.895715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5a63b630-3757-4bf8-b194-586731e52011 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:30.400072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5a63b630-3757-4bf8-b194-586731e52011 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:30.415519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5a63b630-3757-4bf8-b194-586731e52011 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:30.417753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5a63b630-3757-4bf8-b194-586731e52011 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:30.419261 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5a63b630-3757-4bf8-b194-586731e52011 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.562665 Jul 26 14:12:30.433247 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 978/1824] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:29 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:30.448520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-214a2304-5464-4f05-9a62-3a3955f445aa tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:30.450081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-214a2304-5464-4f05-9a62-3a3955f445aa tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:30.480730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-214a2304-5464-4f05-9a62-3a3955f445aa tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:30.481567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-214a2304-5464-4f05-9a62-3a3955f445aa tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:30.482715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-214a2304-5464-4f05-9a62-3a3955f445aa tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:30.484173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-214a2304-5464-4f05-9a62-3a3955f445aa tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:30.590615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=18 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:31.550769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-214a2304-5464-4f05-9a62-3a3955f445aa tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:31.563868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-214a2304-5464-4f05-9a62-3a3955f445aa tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:31.574827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-214a2304-5464-4f05-9a62-3a3955f445aa tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:31.575698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:12:31.576806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:12:31.577394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:12:31.578048 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-214a2304-5464-4f05-9a62-3a3955f445aa tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.133505 Jul 26 14:12:31.578199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:12:31.578477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:12:31.581597 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 979/1825] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:30 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:31.587799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6db86d8b-d500-4c2e-8ad7-2305b2ce28de tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:31.609359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6db86d8b-d500-4c2e-8ad7-2305b2ce28de tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:31.621210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6db86d8b-d500-4c2e-8ad7-2305b2ce28de tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:31.621700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6db86d8b-d500-4c2e-8ad7-2305b2ce28de tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:31.622517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6db86d8b-d500-4c2e-8ad7-2305b2ce28de tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:31.623152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6db86d8b-d500-4c2e-8ad7-2305b2ce28de tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:31.674323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:31.675750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:31.678099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:31.679028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:31.715238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Getting quotas for project 14cbcd06677b464ab54dab55a8acd782. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:31.725277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Getting quotas for user 8aa42b309ab240418fa01e6d4e65e19d and project 14cbcd06677b464ab54dab55a8acd782. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:31.760147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:12:31.763586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:12:31.851316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6db86d8b-d500-4c2e-8ad7-2305b2ce28de tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:31.864321 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6db86d8b-d500-4c2e-8ad7-2305b2ce28de tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 200 len: 1300 microversion: 2.1 time: 0.281348 Jul 26 14:12:31.865223 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 980/1826] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:31 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 1300 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:31.883344 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-97bc33e8-a4b9-4303-a8be-563e67f99e87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.431821 Jul 26 14:12:31.884447 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 847/1827] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:12:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:12:31.896074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8f776692-1ba5-4b42-b693-03c494b62c43 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] Calling method '.version_select at 0x7f87878eb700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:31.906007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0bb3d5f4-88e2-4ea0-9107-288f8c82b7d2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:31.907312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0bb3d5f4-88e2-4ea0-9107-288f8c82b7d2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:31.922904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bb3d5f4-88e2-4ea0-9107-288f8c82b7d2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:31.923290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bb3d5f4-88e2-4ea0-9107-288f8c82b7d2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:31.926118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bb3d5f4-88e2-4ea0-9107-288f8c82b7d2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:31.927535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bb3d5f4-88e2-4ea0-9107-288f8c82b7d2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:32.018336 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8f776692-1ba5-4b42-b693-03c494b62c43 tempest-ImagesMetadataTestJSON-1335187046 tempest-ImagesMetadataTestJSON-1335187046-project] 10.222.0.70 "GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata" status: 200 len: 85 microversion: 2.1 time: 0.151405 Jul 26 14:12:32.019119 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 981/1828] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:12:31 2022] GET /compute/v2.1/images/c1cbd266-0100-47b2-8007-77a72d07f5e2/metadata => generated 85 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:12:32.024699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e8b692f8-55ce-440c-829d-9863bac53441 req-70454a30-108d-448f-8dc7-c0dd1fc8af14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb3e73a-a58f-462d-8da3-f196fc8a17d9", "name": "network-vif-deleted", "tag": "266572ab-e529-4406-b7d4-2e1229ce826e"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:32.061148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e8b692f8-55ce-440c-829d-9863bac53441 req-70454a30-108d-448f-8dc7-c0dd1fc8af14 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:32.061599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e8b692f8-55ce-440c-829d-9863bac53441 req-70454a30-108d-448f-8dc7-c0dd1fc8af14 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:32.112381 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e8b692f8-55ce-440c-829d-9863bac53441 req-70454a30-108d-448f-8dc7-c0dd1fc8af14 service nova] Creating event network-vif-deleted:266572ab-e529-4406-b7d4-2e1229ce826e for instance 3eb3e73a-a58f-462d-8da3-f196fc8a17d9 on n-h1-833090-9 Jul 26 14:12:32.146768 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e8b692f8-55ce-440c-829d-9863bac53441 req-70454a30-108d-448f-8dc7-c0dd1fc8af14 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126541 Jul 26 14:12:32.151963 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 982/1829] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:32.177400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-51749f39-5f6e-4103-bf54-0375e090ee21 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:32.178921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-51749f39-5f6e-4103-bf54-0375e090ee21 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:32.477144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-51749f39-5f6e-4103-bf54-0375e090ee21 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:32.498099 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-51749f39-5f6e-4103-bf54-0375e090ee21 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1217 microversion: 2.1 time: 0.344364 Jul 26 14:12:32.499393 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 983/1830] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:32 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1217 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:32.543430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0bb3d5f4-88e2-4ea0-9107-288f8c82b7d2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:32.567360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0bb3d5f4-88e2-4ea0-9107-288f8c82b7d2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:32.570034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0bb3d5f4-88e2-4ea0-9107-288f8c82b7d2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:32.579301 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0bb3d5f4-88e2-4ea0-9107-288f8c82b7d2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.685846 Jul 26 14:12:32.597960 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 848/1831] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:31 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:32.612267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e138cf3e-80b1-49b8-ae1e-4c41027e86c0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:32.612899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e138cf3e-80b1-49b8-ae1e-4c41027e86c0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:32.636002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e138cf3e-80b1-49b8-ae1e-4c41027e86c0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:32.636483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e138cf3e-80b1-49b8-ae1e-4c41027e86c0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:32.637276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e138cf3e-80b1-49b8-ae1e-4c41027e86c0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:32.637728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e138cf3e-80b1-49b8-ae1e-4c41027e86c0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:32.898017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-28469e64-4f92-4320-9859-37e5e23a0434 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:32.900497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-28469e64-4f92-4320-9859-37e5e23a0434 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 3eb3e73a-a58f-462d-8da3-f196fc8a17d9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:32.917389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-28469e64-4f92-4320-9859-37e5e23a0434 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:32.918657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-28469e64-4f92-4320-9859-37e5e23a0434 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:32.924454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-28469e64-4f92-4320-9859-37e5e23a0434 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:32.926701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-28469e64-4f92-4320-9859-37e5e23a0434 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:32.964199 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-28469e64-4f92-4320-9859-37e5e23a0434 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] HTTP exception thrown: Instance 3eb3e73a-a58f-462d-8da3-f196fc8a17d9 could not be found. Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-28469e64-4f92-4320-9859-37e5e23a0434 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Request method failure captured: Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 HTTP/1.1 Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VIEyEqsfRNf3q9y7-TCTWGm3iiZpx7sxczOefIdc-aX9pE72j6Y0gQBnBTQMKmdaXUF3Vkgw3pMeCcBOQ364OnMkUEed1O2SJU9yUegYzUVxOIlRBOev7140EQWmbUNr1kGSa4cG7wd0pNLhpDlwn1GEkvKfuvWpaZmxqE9WwUjPg Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3982eb0d2c734ff3bd9a13a61d1214a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}] Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 595ebbd7d38049268b2bba22fee81f14 Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 3eb3e73a-a58f-462d-8da3-f196fc8a17d9 could not be found. Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '3eb3e73a-a58f-462d-8da3-f196fc8a17d9'} Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb3e73a-a58f-462d-8da3-f196fc8a17d9 could not be found. Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb3e73a-a58f-462d-8da3-f196fc8a17d9 could not be found. Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:32.970840 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:32.976286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:32.976286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:32.976286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:32.976286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:32.976286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:32.976286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb3e73a-a58f-462d-8da3-f196fc8a17d9 could not be found. Jul 26 14:12:32.976286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:32.976286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-28469e64-4f92-4320-9859-37e5e23a0434 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Returning 404 to user: Instance 3eb3e73a-a58f-462d-8da3-f196fc8a17d9 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:32.976286 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-28469e64-4f92-4320-9859-37e5e23a0434 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9" status: 404 len: 111 microversion: 2.1 time: 0.083270 Jul 26 14:12:32.976286 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 849/1832] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:32 2022] GET /compute/v2.1/servers/3eb3e73a-a58f-462d-8da3-f196fc8a17d9 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:32.992906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ab01674c-ba70-414b-8053-897f64e49de0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:32.994478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ab01674c-ba70-414b-8053-897f64e49de0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: c7477433-f6e2-49bd-b9c1-ca75b172181c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:33.024860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab01674c-ba70-414b-8053-897f64e49de0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:33.026643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab01674c-ba70-414b-8053-897f64e49de0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:33.032888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab01674c-ba70-414b-8053-897f64e49de0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:33.033793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab01674c-ba70-414b-8053-897f64e49de0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:33.129353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ab01674c-ba70-414b-8053-897f64e49de0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: c7477433-f6e2-49bd-b9c1-ca75b172181c] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:33.178344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e138cf3e-80b1-49b8-ae1e-4c41027e86c0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:33.191923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e138cf3e-80b1-49b8-ae1e-4c41027e86c0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:33.195089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e138cf3e-80b1-49b8-ae1e-4c41027e86c0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:33.199783 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e138cf3e-80b1-49b8-ae1e-4c41027e86c0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.591913 Jul 26 14:12:33.201853 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 984/1833] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:32 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:33.365410 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ab01674c-ba70-414b-8053-897f64e49de0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c" status: 204 len: 0 microversion: 2.1 time: 0.384671 Jul 26 14:12:33.367368 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 850/1834] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:32 2022] DELETE /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:33.385455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3312782a-3a47-43c3-af11-db9ce6be0966 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:33.385923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3312782a-3a47-43c3-af11-db9ce6be0966 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:33.401268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3312782a-3a47-43c3-af11-db9ce6be0966 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:33.402541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3312782a-3a47-43c3-af11-db9ce6be0966 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:33.403783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3312782a-3a47-43c3-af11-db9ce6be0966 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:33.404625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3312782a-3a47-43c3-af11-db9ce6be0966 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:33.477811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3312782a-3a47-43c3-af11-db9ce6be0966 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:33.523862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8272c8d0-e269-46f8-b880-12543367ef5f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:33.525265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8272c8d0-e269-46f8-b880-12543367ef5f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:33.538970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8272c8d0-e269-46f8-b880-12543367ef5f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:33.539708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8272c8d0-e269-46f8-b880-12543367ef5f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:33.541006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8272c8d0-e269-46f8-b880-12543367ef5f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:33.541874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8272c8d0-e269-46f8-b880-12543367ef5f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:33.581147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:33.667378 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3312782a-3a47-43c3-af11-db9ce6be0966 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 204 len: 0 microversion: 2.1 time: 0.289787 Jul 26 14:12:33.669579 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 985/1835] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:33 2022] DELETE /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:33.705436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8272c8d0-e269-46f8-b880-12543367ef5f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:33.721818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32840fb9-bb88-449f-a732-a26c19f7fdf2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:33.726171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32840fb9-bb88-449f-a732-a26c19f7fdf2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:33.741470 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8272c8d0-e269-46f8-b880-12543367ef5f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1269 microversion: 2.1 time: 0.213045 Jul 26 14:12:33.752119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32840fb9-bb88-449f-a732-a26c19f7fdf2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:33.756356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32840fb9-bb88-449f-a732-a26c19f7fdf2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:33.758243 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 851/1836] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:33 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1269 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:33.761051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32840fb9-bb88-449f-a732-a26c19f7fdf2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:33.762555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32840fb9-bb88-449f-a732-a26c19f7fdf2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:33.784122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c9168cb9-a315-45e7-936a-b384d4736ee3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:33.784766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c9168cb9-a315-45e7-936a-b384d4736ee3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: c7477433-f6e2-49bd-b9c1-ca75b172181c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:33.816212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9168cb9-a315-45e7-936a-b384d4736ee3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:33.817016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9168cb9-a315-45e7-936a-b384d4736ee3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:33.818368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9168cb9-a315-45e7-936a-b384d4736ee3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:33.824691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9168cb9-a315-45e7-936a-b384d4736ee3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:34.255321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c9168cb9-a315-45e7-936a-b384d4736ee3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:34.271389 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c9168cb9-a315-45e7-936a-b384d4736ee3 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c" status: 200 len: 1473 microversion: 2.1 time: 0.511923 Jul 26 14:12:34.272341 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 852/1837] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:33 2022] GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c => generated 1473 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:34.296781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32840fb9-bb88-449f-a732-a26c19f7fdf2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:34.309923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-112ea910-9487-41d8-a3f2-c432c1182fc2 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:34.311399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32840fb9-bb88-449f-a732-a26c19f7fdf2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:34.313988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32840fb9-bb88-449f-a732-a26c19f7fdf2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:34.316577 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-32840fb9-bb88-449f-a732-a26c19f7fdf2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.642699 Jul 26 14:12:34.318702 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 986/1838] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:33 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:34.322586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-112ea910-9487-41d8-a3f2-c432c1182fc2 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:34.338267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-112ea910-9487-41d8-a3f2-c432c1182fc2 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:34.338654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-112ea910-9487-41d8-a3f2-c432c1182fc2 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:34.339697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-112ea910-9487-41d8-a3f2-c432c1182fc2 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:34.340265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-112ea910-9487-41d8-a3f2-c432c1182fc2 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:34.769968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a1725e3c-4e22-4897-8ed4-e98a439f7630 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:34.771004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a1725e3c-4e22-4897-8ed4-e98a439f7630 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:34.791126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1725e3c-4e22-4897-8ed4-e98a439f7630 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:34.792236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1725e3c-4e22-4897-8ed4-e98a439f7630 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:34.798125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1725e3c-4e22-4897-8ed4-e98a439f7630 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:34.799085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1725e3c-4e22-4897-8ed4-e98a439f7630 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:35.007210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a1725e3c-4e22-4897-8ed4-e98a439f7630 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:35.025125 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a1725e3c-4e22-4897-8ed4-e98a439f7630 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1277 microversion: 2.1 time: 0.259958 Jul 26 14:12:35.052604 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 987/1839] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:34 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:12:35.276927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-112ea910-9487-41d8-a3f2-c432c1182fc2 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:35.295846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f973b948-4217-48fc-ae56-60dc529280a6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:35.296964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f973b948-4217-48fc-ae56-60dc529280a6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: c7477433-f6e2-49bd-b9c1-ca75b172181c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:35.304778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-112ea910-9487-41d8-a3f2-c432c1182fc2 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:35.308066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f973b948-4217-48fc-ae56-60dc529280a6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:35.308545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f973b948-4217-48fc-ae56-60dc529280a6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:35.311304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f973b948-4217-48fc-ae56-60dc529280a6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:35.311770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f973b948-4217-48fc-ae56-60dc529280a6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:35.312231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-112ea910-9487-41d8-a3f2-c432c1182fc2 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:35.316069 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-112ea910-9487-41d8-a3f2-c432c1182fc2 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.025954 Jul 26 14:12:35.317014 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 853/1840] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:34 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:35.448498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cb2e8559-677e-46ac-90bd-af75ab85617d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:35.449350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cb2e8559-677e-46ac-90bd-af75ab85617d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:35.468414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb2e8559-677e-46ac-90bd-af75ab85617d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:35.472301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb2e8559-677e-46ac-90bd-af75ab85617d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:35.474133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb2e8559-677e-46ac-90bd-af75ab85617d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:35.475082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb2e8559-677e-46ac-90bd-af75ab85617d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:36.277013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f973b948-4217-48fc-ae56-60dc529280a6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:36.288030 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f973b948-4217-48fc-ae56-60dc529280a6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c" status: 200 len: 1473 microversion: 2.1 time: 0.996446 Jul 26 14:12:36.296850 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 988/1841] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:35 2022] GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c => generated 1473 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:12:36.306223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1c2d417e-6f8c-4df7-8fc1-2a56c5679d5f req-029b3707-0551-43ea-8ecd-c63f367c6f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-plugged", "status": "completed", "tag": "995b58f3-2d21-4838-b5f8-d2d38a7e67b6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:36.350464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1c2d417e-6f8c-4df7-8fc1-2a56c5679d5f req-029b3707-0551-43ea-8ecd-c63f367c6f25 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:36.351202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1c2d417e-6f8c-4df7-8fc1-2a56c5679d5f req-029b3707-0551-43ea-8ecd-c63f367c6f25 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:36.393551 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1c2d417e-6f8c-4df7-8fc1-2a56c5679d5f req-029b3707-0551-43ea-8ecd-c63f367c6f25 service nova] Creating event network-vif-plugged:995b58f3-2d21-4838-b5f8-d2d38a7e67b6 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:12:36.436959 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1c2d417e-6f8c-4df7-8fc1-2a56c5679d5f req-029b3707-0551-43ea-8ecd-c63f367c6f25 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123860 Jul 26 14:12:36.437937 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 989/1842] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:36.444492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6f08b12a-58ba-4c68-9ad4-e37bc15ecd75 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:36.445217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6f08b12a-58ba-4c68-9ad4-e37bc15ecd75 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:36.459540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f08b12a-58ba-4c68-9ad4-e37bc15ecd75 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:36.460053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f08b12a-58ba-4c68-9ad4-e37bc15ecd75 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:36.460894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f08b12a-58ba-4c68-9ad4-e37bc15ecd75 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:36.461361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f08b12a-58ba-4c68-9ad4-e37bc15ecd75 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:36.568400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb2e8559-677e-46ac-90bd-af75ab85617d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:36.578604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb2e8559-677e-46ac-90bd-af75ab85617d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:36.580225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb2e8559-677e-46ac-90bd-af75ab85617d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:36.596311 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cb2e8559-677e-46ac-90bd-af75ab85617d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 1.138878 Jul 26 14:12:36.597318 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 854/1843] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:35 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:36.602897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c88faafa-1136-4102-87b3-af67032e56d0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:36.610829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c88faafa-1136-4102-87b3-af67032e56d0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:36.613534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:36.637455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c88faafa-1136-4102-87b3-af67032e56d0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:36.638817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c88faafa-1136-4102-87b3-af67032e56d0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:36.640466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c88faafa-1136-4102-87b3-af67032e56d0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:36.641120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c88faafa-1136-4102-87b3-af67032e56d0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:37.009026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6f08b12a-58ba-4c68-9ad4-e37bc15ecd75 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:37.029908 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6f08b12a-58ba-4c68-9ad4-e37bc15ecd75 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1275 microversion: 2.1 time: 0.583707 Jul 26 14:12:37.036335 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 990/1844] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:36 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1275 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:37.319318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5be8e9c8-633f-43be-9edd-9cd89566dd36 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:37.320947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5be8e9c8-633f-43be-9edd-9cd89566dd36 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: c7477433-f6e2-49bd-b9c1-ca75b172181c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:37.335015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5be8e9c8-633f-43be-9edd-9cd89566dd36 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:37.336068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5be8e9c8-633f-43be-9edd-9cd89566dd36 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:37.337221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5be8e9c8-633f-43be-9edd-9cd89566dd36 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:37.338600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5be8e9c8-633f-43be-9edd-9cd89566dd36 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:37.845451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c88faafa-1136-4102-87b3-af67032e56d0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:37.877494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c88faafa-1136-4102-87b3-af67032e56d0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:37.890391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c88faafa-1136-4102-87b3-af67032e56d0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:37.892778 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c88faafa-1136-4102-87b3-af67032e56d0 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.294234 Jul 26 14:12:37.893814 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 855/1845] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:36 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:37.909227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-bad22a23-3f9a-4d19-b987-d1615fcee1db req-30b1b451-26fb-4500-bba4-d53a42e8aea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8513d5ff-fd14-449d-abf4-8ac5ae461cb9", "name": "network-vif-deleted", "tag": "972fbf32-4822-4220-ae24-7f06a9deba56"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:37.923027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5be8e9c8-633f-43be-9edd-9cd89566dd36 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:37.945351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bad22a23-3f9a-4d19-b987-d1615fcee1db req-30b1b451-26fb-4500-bba4-d53a42e8aea4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:37.946356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bad22a23-3f9a-4d19-b987-d1615fcee1db req-30b1b451-26fb-4500-bba4-d53a42e8aea4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:37.949375 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5be8e9c8-633f-43be-9edd-9cd89566dd36 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c" status: 200 len: 1473 microversion: 2.1 time: 0.626208 Jul 26 14:12:37.950800 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 991/1846] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:37 2022] GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c => generated 1473 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:12:37.964417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba677101-4d8b-4a6d-b8cd-bc561f475f25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:37.964417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba677101-4d8b-4a6d-b8cd-bc561f475f25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:37.989384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba677101-4d8b-4a6d-b8cd-bc561f475f25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:37.989851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba677101-4d8b-4a6d-b8cd-bc561f475f25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:37.990991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba677101-4d8b-4a6d-b8cd-bc561f475f25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:37.991638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba677101-4d8b-4a6d-b8cd-bc561f475f25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:38.002611 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-bad22a23-3f9a-4d19-b987-d1615fcee1db req-30b1b451-26fb-4500-bba4-d53a42e8aea4 service nova] Creating event network-vif-deleted:972fbf32-4822-4220-ae24-7f06a9deba56 for instance 8513d5ff-fd14-449d-abf4-8ac5ae461cb9 on n-h1-833090-9 Jul 26 14:12:38.035615 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-bad22a23-3f9a-4d19-b987-d1615fcee1db req-30b1b451-26fb-4500-bba4-d53a42e8aea4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139761 Jul 26 14:12:38.036510 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 856/1847] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:38.079333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7964041-7294-4578-ab4c-9ae59ea43b3a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:38.086399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f7964041-7294-4578-ab4c-9ae59ea43b3a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:38.114472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7964041-7294-4578-ab4c-9ae59ea43b3a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:38.117047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7964041-7294-4578-ab4c-9ae59ea43b3a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:38.120668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7964041-7294-4578-ab4c-9ae59ea43b3a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:38.124514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7964041-7294-4578-ab4c-9ae59ea43b3a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:38.234755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:38.439833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f7964041-7294-4578-ab4c-9ae59ea43b3a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:38.448616 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7964041-7294-4578-ab4c-9ae59ea43b3a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1275 microversion: 2.1 time: 0.379167 Jul 26 14:12:38.452344 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 857/1848] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:38 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1275 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:12:38.634787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba677101-4d8b-4a6d-b8cd-bc561f475f25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:38.645720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba677101-4d8b-4a6d-b8cd-bc561f475f25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:38.652175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba677101-4d8b-4a6d-b8cd-bc561f475f25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:38.656727 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba677101-4d8b-4a6d-b8cd-bc561f475f25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.703791 Jul 26 14:12:38.657736 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 992/1849] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:37 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:38.773839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-1b62fbee-51fd-499c-a311-98748e72351d req-db4eebfa-2f16-401e-9501-1bcb54b2bbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-plugged", "status": "completed", "tag": "db84c629-f002-4e47-a54a-944c2e55a5d7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:38.817078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1b62fbee-51fd-499c-a311-98748e72351d req-db4eebfa-2f16-401e-9501-1bcb54b2bbf1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:38.817763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1b62fbee-51fd-499c-a311-98748e72351d req-db4eebfa-2f16-401e-9501-1bcb54b2bbf1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:38.851142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f92657a7-81b9-48ac-b998-4b82db3b246c req-75e8379a-abb0-477e-b132-7105553b0797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7477433-f6e2-49bd-b9c1-ca75b172181c", "name": "network-vif-deleted", "tag": "6f69add5-9cb3-4555-bcb4-7f721255b9ca"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:38.855338 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-1b62fbee-51fd-499c-a311-98748e72351d req-db4eebfa-2f16-401e-9501-1bcb54b2bbf1 service nova] Creating event network-vif-plugged:db84c629-f002-4e47-a54a-944c2e55a5d7 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:12:38.862677 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-1b62fbee-51fd-499c-a311-98748e72351d req-db4eebfa-2f16-401e-9501-1bcb54b2bbf1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092501 Jul 26 14:12:38.864294 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 858/1850] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:38.881097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f92657a7-81b9-48ac-b998-4b82db3b246c req-75e8379a-abb0-477e-b132-7105553b0797 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:38.881747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f92657a7-81b9-48ac-b998-4b82db3b246c req-75e8379a-abb0-477e-b132-7105553b0797 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:38.913044 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f92657a7-81b9-48ac-b998-4b82db3b246c req-75e8379a-abb0-477e-b132-7105553b0797 service nova] Creating event network-vif-deleted:6f69add5-9cb3-4555-bcb4-7f721255b9ca for instance c7477433-f6e2-49bd-b9c1-ca75b172181c on n-h2-833090-9 Jul 26 14:12:38.926223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dbfd99c1-fc33-4dbc-91d4-b0ded991c108 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:38.926543 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f92657a7-81b9-48ac-b998-4b82db3b246c req-75e8379a-abb0-477e-b132-7105553b0797 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081380 Jul 26 14:12:38.927658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dbfd99c1-fc33-4dbc-91d4-b0ded991c108 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:38.932274 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 993/1851] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:12:38.948115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbfd99c1-fc33-4dbc-91d4-b0ded991c108 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:38.949222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbfd99c1-fc33-4dbc-91d4-b0ded991c108 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:38.953925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbfd99c1-fc33-4dbc-91d4-b0ded991c108 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:38.955032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbfd99c1-fc33-4dbc-91d4-b0ded991c108 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:38.975655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:38.977438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: c7477433-f6e2-49bd-b9c1-ca75b172181c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:38.992042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:38.996466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:38.997458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:38.997926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:39.127371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:39.128198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:39.130375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lazy-loading 'fault' on Instance uuid c7477433-f6e2-49bd-b9c1-ca75b172181c {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:12:39.270698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:39.285947 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-51809cbb-1d9f-47f5-bf82-a442c59213b0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c" status: 200 len: 1308 microversion: 2.1 time: 0.316372 Jul 26 14:12:39.301815 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 994/1852] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:38 2022] GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c => generated 1308 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:12:39.478067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0df36d3-2be6-4115-8d74-2b7449ee582b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:39.479562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0df36d3-2be6-4115-8d74-2b7449ee582b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:39.492767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0df36d3-2be6-4115-8d74-2b7449ee582b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:39.493834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0df36d3-2be6-4115-8d74-2b7449ee582b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:39.495621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0df36d3-2be6-4115-8d74-2b7449ee582b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:39.498953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0df36d3-2be6-4115-8d74-2b7449ee582b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:39.896671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dbfd99c1-fc33-4dbc-91d4-b0ded991c108 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:39.914160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dbfd99c1-fc33-4dbc-91d4-b0ded991c108 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:39.916220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dbfd99c1-fc33-4dbc-91d4-b0ded991c108 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:39.917728 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dbfd99c1-fc33-4dbc-91d4-b0ded991c108 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.998564 Jul 26 14:12:39.919507 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 859/1853] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:38 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:12:39.924778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef3f2526-7c3d-4402-9331-ad7868ab7414 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:39.925732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ef3f2526-7c3d-4402-9331-ad7868ab7414 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:39.933400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef3f2526-7c3d-4402-9331-ad7868ab7414 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:39.934277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef3f2526-7c3d-4402-9331-ad7868ab7414 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:39.936313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef3f2526-7c3d-4402-9331-ad7868ab7414 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:39.937037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef3f2526-7c3d-4402-9331-ad7868ab7414 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:40.078331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0df36d3-2be6-4115-8d74-2b7449ee582b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:40.098689 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0df36d3-2be6-4115-8d74-2b7449ee582b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1275 microversion: 2.1 time: 0.629765 Jul 26 14:12:40.100315 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 995/1854] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:39 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1275 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:40.315488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-37f54a92-e799-4fe4-9108-69e14298f1c6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:40.316290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-37f54a92-e799-4fe4-9108-69e14298f1c6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: c7477433-f6e2-49bd-b9c1-ca75b172181c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:40.334415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37f54a92-e799-4fe4-9108-69e14298f1c6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:40.335321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37f54a92-e799-4fe4-9108-69e14298f1c6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:40.336696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37f54a92-e799-4fe4-9108-69e14298f1c6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:40.337374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37f54a92-e799-4fe4-9108-69e14298f1c6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:40.366998 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-37f54a92-e799-4fe4-9108-69e14298f1c6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] HTTP exception thrown: Instance c7477433-f6e2-49bd-b9c1-ca75b172181c could not be found. Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-37f54a92-e799-4fe4-9108-69e14298f1c6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Request method failure captured: Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c HTTP/1.1 Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VIEyEqsfRNf3q9y7-TCTWGm3iiZpx7sxczOefIdc-aX9pE72j6Y0gQBnBTQMKmdaXUF3Vkgw3pMeCcBOQ364OnMkUEed1O2SJU9yUegYzUVxOIlRBOev7140EQWmbUNr1kGSa4cG7wd0pNLhpDlwn1GEkvKfuvWpaZmxqE9WwUjPg Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3982eb0d2c734ff3bd9a13a61d1214a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}] Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 595ebbd7d38049268b2bba22fee81f14 Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c7477433-f6e2-49bd-b9c1-ca75b172181c could not be found. Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c7477433-f6e2-49bd-b9c1-ca75b172181c'} Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7477433-f6e2-49bd-b9c1-ca75b172181c could not be found. Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7477433-f6e2-49bd-b9c1-ca75b172181c could not be found. Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:40.368931 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:40.375469 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:40.375469 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:40.375469 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:40.375469 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:40.375469 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:40.375469 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7477433-f6e2-49bd-b9c1-ca75b172181c could not be found. Jul 26 14:12:40.375469 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:40.380944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-37f54a92-e799-4fe4-9108-69e14298f1c6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Returning 404 to user: Instance c7477433-f6e2-49bd-b9c1-ca75b172181c could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:40.383714 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-37f54a92-e799-4fe4-9108-69e14298f1c6 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c" status: 404 len: 111 microversion: 2.1 time: 0.072244 Jul 26 14:12:40.384847 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 996/1855] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:40 2022] GET /compute/v2.1/servers/c7477433-f6e2-49bd-b9c1-ca75b172181c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:12:40.394831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-72d73449-f557-46e3-9e66-7aca114b35df tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:40.395737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-72d73449-f557-46e3-9e66-7aca114b35df tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 8513d5ff-fd14-449d-abf4-8ac5ae461cb9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:40.404496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-72d73449-f557-46e3-9e66-7aca114b35df tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:40.405345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-72d73449-f557-46e3-9e66-7aca114b35df tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:40.406668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-72d73449-f557-46e3-9e66-7aca114b35df tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:40.407348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-72d73449-f557-46e3-9e66-7aca114b35df tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:40.432570 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-72d73449-f557-46e3-9e66-7aca114b35df tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] HTTP exception thrown: Instance 8513d5ff-fd14-449d-abf4-8ac5ae461cb9 could not be found. Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-72d73449-f557-46e3-9e66-7aca114b35df tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Request method failure captured: Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 HTTP/1.1 Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VIEyEqsfRNf3q9y7-TCTWGm3iiZpx7sxczOefIdc-aX9pE72j6Y0gQBnBTQMKmdaXUF3Vkgw3pMeCcBOQ364OnMkUEed1O2SJU9yUegYzUVxOIlRBOev7140EQWmbUNr1kGSa4cG7wd0pNLhpDlwn1GEkvKfuvWpaZmxqE9WwUjPg Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3982eb0d2c734ff3bd9a13a61d1214a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}] Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 595ebbd7d38049268b2bba22fee81f14 Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 8513d5ff-fd14-449d-abf4-8ac5ae461cb9 could not be found. Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '8513d5ff-fd14-449d-abf4-8ac5ae461cb9'} Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8513d5ff-fd14-449d-abf4-8ac5ae461cb9 could not be found. Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8513d5ff-fd14-449d-abf4-8ac5ae461cb9 could not be found. Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:40.435700 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:40.440641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:40.440641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:40.440641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:40.440641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:40.440641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:40.440641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8513d5ff-fd14-449d-abf4-8ac5ae461cb9 could not be found. Jul 26 14:12:40.440641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:40.446247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-72d73449-f557-46e3-9e66-7aca114b35df tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Returning 404 to user: Instance 8513d5ff-fd14-449d-abf4-8ac5ae461cb9 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:40.447782 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-72d73449-f557-46e3-9e66-7aca114b35df tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9" status: 404 len: 111 microversion: 2.1 time: 0.057788 Jul 26 14:12:40.448964 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 997/1856] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:40 2022] GET /compute/v2.1/servers/8513d5ff-fd14-449d-abf4-8ac5ae461cb9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:40.460830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bad4d915-5771-4533-809e-333365328657 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:40.520042 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bad4d915-5771-4533-809e-333365328657 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/1a6cd7d7-0cdf-486c-bdb0-d97f6ac8c236" status: 204 len: 0 microversion: 2.1 time: 0.064648 Jul 26 14:12:40.521125 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 998/1857] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:12:40 2022] DELETE /compute/v2.1/os-server-groups/1a6cd7d7-0cdf-486c-bdb0-d97f6ac8c236 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:40.536581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d319f9d8-50e3-415e-ae22-2324113bb5eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:40.538163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d319f9d8-50e3-415e-ae22-2324113bb5eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: d1c18346-82e5-42e8-82cc-b82ac00dea9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:40.538441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ef3f2526-7c3d-4402-9331-ad7868ab7414 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:40.552330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d319f9d8-50e3-415e-ae22-2324113bb5eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:40.553122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d319f9d8-50e3-415e-ae22-2324113bb5eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:40.554570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d319f9d8-50e3-415e-ae22-2324113bb5eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:40.555385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d319f9d8-50e3-415e-ae22-2324113bb5eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:40.555626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ef3f2526-7c3d-4402-9331-ad7868ab7414 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:40.557840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ef3f2526-7c3d-4402-9331-ad7868ab7414 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:40.559033 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ef3f2526-7c3d-4402-9331-ad7868ab7414 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.638010 Jul 26 14:12:40.563430 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 860/1858] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:39 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:40.613486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d319f9d8-50e3-415e-ae22-2324113bb5eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: d1c18346-82e5-42e8-82cc-b82ac00dea9c] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:40.813666 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d319f9d8-50e3-415e-ae22-2324113bb5eb tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c" status: 204 len: 0 microversion: 2.1 time: 0.283839 Jul 26 14:12:40.815633 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 999/1859] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:40 2022] DELETE /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:40.823980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3f0e4a05-e779-49c0-98a1-0f163d460fc4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:40.824768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3f0e4a05-e779-49c0-98a1-0f163d460fc4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:40.835129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f0e4a05-e779-49c0-98a1-0f163d460fc4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:40.835588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f0e4a05-e779-49c0-98a1-0f163d460fc4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:40.836430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f0e4a05-e779-49c0-98a1-0f163d460fc4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:40.837149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f0e4a05-e779-49c0-98a1-0f163d460fc4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:40.867986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3f0e4a05-e779-49c0-98a1-0f163d460fc4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:40.953135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1552827f-cd37-4add-bfd6-948380a2612c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:40.953956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1552827f-cd37-4add-bfd6-948380a2612c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:40.963707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1552827f-cd37-4add-bfd6-948380a2612c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:40.967745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1552827f-cd37-4add-bfd6-948380a2612c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:40.970174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1552827f-cd37-4add-bfd6-948380a2612c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:40.970662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1552827f-cd37-4add-bfd6-948380a2612c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:41.002513 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3f0e4a05-e779-49c0-98a1-0f163d460fc4 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 204 len: 0 microversion: 2.1 time: 0.182010 Jul 26 14:12:41.006186 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 861/1860] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:40 2022] DELETE /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:41.025546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3428f88d-c4ae-49f4-934d-aa451a3fd8b9 req-8ba74988-01f1-46f9-9c3d-368e1bc6d5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-plugged", "status": "completed", "tag": "3669b3fd-06c9-4344-9f7e-41276ab83aa8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:41.057685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3428f88d-c4ae-49f4-934d-aa451a3fd8b9 req-8ba74988-01f1-46f9-9c3d-368e1bc6d5e6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:41.058455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3428f88d-c4ae-49f4-934d-aa451a3fd8b9 req-8ba74988-01f1-46f9-9c3d-368e1bc6d5e6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:41.078886 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3428f88d-c4ae-49f4-934d-aa451a3fd8b9 req-8ba74988-01f1-46f9-9c3d-368e1bc6d5e6 service nova] Creating event network-vif-plugged:3669b3fd-06c9-4344-9f7e-41276ab83aa8 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:12:41.085381 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3428f88d-c4ae-49f4-934d-aa451a3fd8b9 req-8ba74988-01f1-46f9-9c3d-368e1bc6d5e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076311 Jul 26 14:12:41.086384 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 862/1861] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:41.093338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca012338-3e53-4128-b28a-d1f9599774f0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:41.094500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ca012338-3e53-4128-b28a-d1f9599774f0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: d1c18346-82e5-42e8-82cc-b82ac00dea9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:41.111779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca012338-3e53-4128-b28a-d1f9599774f0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:41.112538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca012338-3e53-4128-b28a-d1f9599774f0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:41.113634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca012338-3e53-4128-b28a-d1f9599774f0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:41.114432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca012338-3e53-4128-b28a-d1f9599774f0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:41.696768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:41.752587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:41.780867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ca012338-3e53-4128-b28a-d1f9599774f0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:41.791135 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ca012338-3e53-4128-b28a-d1f9599774f0 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c" status: 200 len: 1474 microversion: 2.1 time: 0.703201 Jul 26 14:12:41.792190 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 863/1862] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:41 2022] GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c => generated 1474 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:41.812716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9972af50-3d15-4208-be82-7c040def69a1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:41.814522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9972af50-3d15-4208-be82-7c040def69a1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:41.833525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9972af50-3d15-4208-be82-7c040def69a1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:41.833757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1552827f-cd37-4add-bfd6-948380a2612c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:41.834239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9972af50-3d15-4208-be82-7c040def69a1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:41.834874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9972af50-3d15-4208-be82-7c040def69a1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:41.835320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9972af50-3d15-4208-be82-7c040def69a1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:41.845712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1552827f-cd37-4add-bfd6-948380a2612c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:41.849104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1552827f-cd37-4add-bfd6-948380a2612c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:41.850355 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1552827f-cd37-4add-bfd6-948380a2612c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.907292 Jul 26 14:12:41.856465 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1000/1863] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:40 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:41.858165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0e9f1560-704d-4ee3-9652-f9b82bb16eee tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:41.858814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0e9f1560-704d-4ee3-9652-f9b82bb16eee tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:41.869525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0e9f1560-704d-4ee3-9652-f9b82bb16eee tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:41.869998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0e9f1560-704d-4ee3-9652-f9b82bb16eee tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:41.870800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0e9f1560-704d-4ee3-9652-f9b82bb16eee tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:41.872235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0e9f1560-704d-4ee3-9652-f9b82bb16eee tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:42.449803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0e9f1560-704d-4ee3-9652-f9b82bb16eee tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:42.465552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0e9f1560-704d-4ee3-9652-f9b82bb16eee tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:42.467302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0e9f1560-704d-4ee3-9652-f9b82bb16eee tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:42.468492 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0e9f1560-704d-4ee3-9652-f9b82bb16eee tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.614995 Jul 26 14:12:42.469055 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1001/1864] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:41 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:42.486814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9972af50-3d15-4208-be82-7c040def69a1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:42.507798 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9972af50-3d15-4208-be82-7c040def69a1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1317 microversion: 2.1 time: 0.701134 Jul 26 14:12:42.509592 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 864/1865] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:41 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:42.842496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76791335-d332-4a6c-9472-ecc940f1be1c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:42.843777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-76791335-d332-4a6c-9472-ecc940f1be1c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: d1c18346-82e5-42e8-82cc-b82ac00dea9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:42.847854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=50 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:42.853587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:42.866839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76791335-d332-4a6c-9472-ecc940f1be1c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:42.870011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76791335-d332-4a6c-9472-ecc940f1be1c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:42.871421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76791335-d332-4a6c-9472-ecc940f1be1c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:42.873198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76791335-d332-4a6c-9472-ecc940f1be1c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:42.877950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6ad890b-be47-4257-bea0-224939f88536 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:42.879516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e6ad890b-be47-4257-bea0-224939f88536 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:42.906049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6ad890b-be47-4257-bea0-224939f88536 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:42.906511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6ad890b-be47-4257-bea0-224939f88536 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:42.907303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6ad890b-be47-4257-bea0-224939f88536 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:42.907789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6ad890b-be47-4257-bea0-224939f88536 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:43.653941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-76791335-d332-4a6c-9472-ecc940f1be1c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:43.666252 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76791335-d332-4a6c-9472-ecc940f1be1c tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c" status: 200 len: 1474 microversion: 2.1 time: 0.847897 Jul 26 14:12:43.667095 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1002/1866] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:42 2022] GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c => generated 1474 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:43.673114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-17933640-7a05-4253-a75c-8bc18dda27df req-60716e12-17db-4495-aee5-d33fe8941704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b94307-dd41-4f71-b529-c6cbb944c27f", "tag": "5c60dac8-f587-41cf-8357-66980afb2e01"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:43.688107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-17933640-7a05-4253-a75c-8bc18dda27df req-60716e12-17db-4495-aee5-d33fe8941704 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:43.689880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-17933640-7a05-4253-a75c-8bc18dda27df req-60716e12-17db-4495-aee5-d33fe8941704 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:43.711164 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-17933640-7a05-4253-a75c-8bc18dda27df req-60716e12-17db-4495-aee5-d33fe8941704 service nova] Creating event network-changed:5c60dac8-f587-41cf-8357-66980afb2e01 for instance e6b94307-dd41-4f71-b529-c6cbb944c27f on n-h1-833090-9 Jul 26 14:12:43.720699 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-17933640-7a05-4253-a75c-8bc18dda27df req-60716e12-17db-4495-aee5-d33fe8941704 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051659 Jul 26 14:12:43.725179 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1003/1867] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:43.735831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d4a972a7-234e-4439-9e5c-b4dfdd662f07 req-41cf8d26-2c3d-4546-9058-371b8b501d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-plugged", "status": "completed", "tag": "989be3eb-05ab-401f-a4a3-8eb746b5d1b3"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:43.757992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d4a972a7-234e-4439-9e5c-b4dfdd662f07 req-41cf8d26-2c3d-4546-9058-371b8b501d13 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:43.758721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d4a972a7-234e-4439-9e5c-b4dfdd662f07 req-41cf8d26-2c3d-4546-9058-371b8b501d13 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:43.772302 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d4a972a7-234e-4439-9e5c-b4dfdd662f07 req-41cf8d26-2c3d-4546-9058-371b8b501d13 service nova] Creating event network-vif-plugged:989be3eb-05ab-401f-a4a3-8eb746b5d1b3 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:12:43.779450 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d4a972a7-234e-4439-9e5c-b4dfdd662f07 req-41cf8d26-2c3d-4546-9058-371b8b501d13 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052388 Jul 26 14:12:43.786802 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1004/1868] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:43.792622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fbe98c88-915a-4767-bf2e-e64cef21c48d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:43.800753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fbe98c88-915a-4767-bf2e-e64cef21c48d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:43.809854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbe98c88-915a-4767-bf2e-e64cef21c48d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:43.810996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbe98c88-915a-4767-bf2e-e64cef21c48d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:43.812106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbe98c88-915a-4767-bf2e-e64cef21c48d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:43.813341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbe98c88-915a-4767-bf2e-e64cef21c48d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:43.837897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:44.537785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6ad890b-be47-4257-bea0-224939f88536 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:44.559805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6ad890b-be47-4257-bea0-224939f88536 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:44.562388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6ad890b-be47-4257-bea0-224939f88536 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:44.573950 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6ad890b-be47-4257-bea0-224939f88536 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.697648 Jul 26 14:12:44.575172 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 865/1869] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:42 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:44.593471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-592eb56a-a7f3-464f-b7b2-6c7c69dfeddf tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:44.600320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-592eb56a-a7f3-464f-b7b2-6c7c69dfeddf tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:44.612325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-592eb56a-a7f3-464f-b7b2-6c7c69dfeddf tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:44.613856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-592eb56a-a7f3-464f-b7b2-6c7c69dfeddf tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:44.614897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-592eb56a-a7f3-464f-b7b2-6c7c69dfeddf tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:44.615724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-592eb56a-a7f3-464f-b7b2-6c7c69dfeddf tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:44.794217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fbe98c88-915a-4767-bf2e-e64cef21c48d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:44.809990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fbe98c88-915a-4767-bf2e-e64cef21c48d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:44.818366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fbe98c88-915a-4767-bf2e-e64cef21c48d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:44.820579 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fbe98c88-915a-4767-bf2e-e64cef21c48d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 1.031887 Jul 26 14:12:44.821562 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1005/1870] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:43 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:44.854747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-548904563", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "b2c3a64c-9614-4264-89ea-311357c87b23"}, {"uuid": "0341a52a-629c-47b3-a07e-4e664a4dab61"}, {"uuid": "b2c3a64c-9614-4264-89ea-311357c87b23"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:45.066531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] validate_networks() for [('b2c3a64c-9614-4264-89ea-311357c87b23', None, None, None, None, None), ('0341a52a-629c-47b3-a07e-4e664a4dab61', None, None, None, None, None), ('b2c3a64c-9614-4264-89ea-311357c87b23', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:12:45.858497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-592eb56a-a7f3-464f-b7b2-6c7c69dfeddf tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:45.874056 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-592eb56a-a7f3-464f-b7b2-6c7c69dfeddf tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1317 microversion: 2.1 time: 1.297516 Jul 26 14:12:45.874660 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 866/1871] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:44 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1317 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:45.886624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c743b22a-d84b-4baf-81f5-5ec552afa8b1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:45.887913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c743b22a-d84b-4baf-81f5-5ec552afa8b1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: d1c18346-82e5-42e8-82cc-b82ac00dea9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:45.900221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c743b22a-d84b-4baf-81f5-5ec552afa8b1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:45.900697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c743b22a-d84b-4baf-81f5-5ec552afa8b1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:45.901508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c743b22a-d84b-4baf-81f5-5ec552afa8b1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:45.901950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c743b22a-d84b-4baf-81f5-5ec552afa8b1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:45.943278 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c743b22a-d84b-4baf-81f5-5ec552afa8b1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] HTTP exception thrown: Instance d1c18346-82e5-42e8-82cc-b82ac00dea9c could not be found. Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c743b22a-d84b-4baf-81f5-5ec552afa8b1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Request method failure captured: Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c HTTP/1.1 Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VIEyEqsfRNf3q9y7-TCTWGm3iiZpx7sxczOefIdc-aX9pE72j6Y0gQBnBTQMKmdaXUF3Vkgw3pMeCcBOQ364OnMkUEed1O2SJU9yUegYzUVxOIlRBOev7140EQWmbUNr1kGSa4cG7wd0pNLhpDlwn1GEkvKfuvWpaZmxqE9WwUjPg Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3982eb0d2c734ff3bd9a13a61d1214a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}] Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 595ebbd7d38049268b2bba22fee81f14 Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance d1c18346-82e5-42e8-82cc-b82ac00dea9c could not be found. Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd1c18346-82e5-42e8-82cc-b82ac00dea9c'} Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c18346-82e5-42e8-82cc-b82ac00dea9c could not be found. Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c18346-82e5-42e8-82cc-b82ac00dea9c could not be found. Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:45.947620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:45.953873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:45.953873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:45.953873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:45.953873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:45.953873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:45.953873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c18346-82e5-42e8-82cc-b82ac00dea9c could not be found. Jul 26 14:12:45.953873 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:12:45.958140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c743b22a-d84b-4baf-81f5-5ec552afa8b1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Returning 404 to user: Instance d1c18346-82e5-42e8-82cc-b82ac00dea9c could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:45.961432 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c743b22a-d84b-4baf-81f5-5ec552afa8b1 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c" status: 404 len: 111 microversion: 2.1 time: 0.083621 Jul 26 14:12:45.962566 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 867/1872] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:45 2022] GET /compute/v2.1/servers/d1c18346-82e5-42e8-82cc-b82ac00dea9c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:45.992005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7f695fb0-f38d-4e86-9953-81e3fc7b1db4 req-2b0ce180-fbf1-41f2-bab7-d5c95666ffd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1c18346-82e5-42e8-82cc-b82ac00dea9c", "name": "network-vif-deleted", "tag": "f4041f43-d3c2-4b8a-a23e-9a236c0ded93"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:46.057115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7f695fb0-f38d-4e86-9953-81e3fc7b1db4 req-2b0ce180-fbf1-41f2-bab7-d5c95666ffd7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:46.057984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7f695fb0-f38d-4e86-9953-81e3fc7b1db4 req-2b0ce180-fbf1-41f2-bab7-d5c95666ffd7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:46.114367 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7f695fb0-f38d-4e86-9953-81e3fc7b1db4 req-2b0ce180-fbf1-41f2-bab7-d5c95666ffd7 service nova] Creating event network-vif-deleted:f4041f43-d3c2-4b8a-a23e-9a236c0ded93 for instance d1c18346-82e5-42e8-82cc-b82ac00dea9c on n-h1-833090-9 Jul 26 14:12:46.129794 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7f695fb0-f38d-4e86-9953-81e3fc7b1db4 req-2b0ce180-fbf1-41f2-bab7-d5c95666ffd7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165475 Jul 26 14:12:46.132228 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 868/1873] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:46.147934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-264675c2-962f-419c-b6d0-621a3206da9f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:46.149692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-264675c2-962f-419c-b6d0-621a3206da9f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:46.171005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-264675c2-962f-419c-b6d0-621a3206da9f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:46.172300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-264675c2-962f-419c-b6d0-621a3206da9f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:46.177533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-264675c2-962f-419c-b6d0-621a3206da9f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:46.178270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-264675c2-962f-419c-b6d0-621a3206da9f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:47.782469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-264675c2-962f-419c-b6d0-621a3206da9f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:47.799245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-264675c2-962f-419c-b6d0-621a3206da9f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:47.818194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-264675c2-962f-419c-b6d0-621a3206da9f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:47.819598 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-264675c2-962f-419c-b6d0-621a3206da9f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.685064 Jul 26 14:12:47.820225 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 869/1874] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:46 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:47.835721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ddf9f86a-1b10-4a8f-a4ee-2bd50be6c2cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:47.837533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ddf9f86a-1b10-4a8f-a4ee-2bd50be6c2cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:47.855663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddf9f86a-1b10-4a8f-a4ee-2bd50be6c2cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:47.856387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddf9f86a-1b10-4a8f-a4ee-2bd50be6c2cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:47.857471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddf9f86a-1b10-4a8f-a4ee-2bd50be6c2cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:47.858201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddf9f86a-1b10-4a8f-a4ee-2bd50be6c2cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:48.219842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ddf9f86a-1b10-4a8f-a4ee-2bd50be6c2cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:48.264187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ddf9f86a-1b10-4a8f-a4ee-2bd50be6c2cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:48.271115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ddf9f86a-1b10-4a8f-a4ee-2bd50be6c2cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:48.276488 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ddf9f86a-1b10-4a8f-a4ee-2bd50be6c2cf tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.454046 Jul 26 14:12:48.278232 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 870/1875] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:47 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:48.284758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f522b13b-de0d-4b7e-9b72-446913d4e052 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:48.285776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f522b13b-de0d-4b7e-9b72-446913d4e052 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:48.309997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f522b13b-de0d-4b7e-9b72-446913d4e052 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:48.310867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f522b13b-de0d-4b7e-9b72-446913d4e052 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:48.312169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f522b13b-de0d-4b7e-9b72-446913d4e052 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:48.313616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f522b13b-de0d-4b7e-9b72-446913d4e052 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:48.619253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f522b13b-de0d-4b7e-9b72-446913d4e052 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:48.634412 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f522b13b-de0d-4b7e-9b72-446913d4e052 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 200 len: 1431 microversion: 2.1 time: 0.350767 Jul 26 14:12:48.635100 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 871/1876] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:48 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 1431 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:48.691851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-babda464-7635-4ecf-a5aa-dbefb938ae83 req-80723e7c-ff41-4f97-b829-08eed7e29ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-plugged", "status": "completed", "tag": "8440feb4-5af7-47f7-93be-a1f774aeb7ab"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:48.728196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-babda464-7635-4ecf-a5aa-dbefb938ae83 req-80723e7c-ff41-4f97-b829-08eed7e29ede service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:48.731017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-babda464-7635-4ecf-a5aa-dbefb938ae83 req-80723e7c-ff41-4f97-b829-08eed7e29ede service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:48.765309 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-babda464-7635-4ecf-a5aa-dbefb938ae83 req-80723e7c-ff41-4f97-b829-08eed7e29ede service nova] Creating event network-vif-plugged:8440feb4-5af7-47f7-93be-a1f774aeb7ab for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:12:48.785013 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-babda464-7635-4ecf-a5aa-dbefb938ae83 req-80723e7c-ff41-4f97-b829-08eed7e29ede service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129180 Jul 26 14:12:48.786959 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 872/1877] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:48.799455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-256615b0-f826-4cc0-b606-342971cd1bfd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:48.800711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-256615b0-f826-4cc0-b606-342971cd1bfd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:48.812435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-256615b0-f826-4cc0-b606-342971cd1bfd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:48.813220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-256615b0-f826-4cc0-b606-342971cd1bfd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:48.814207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-256615b0-f826-4cc0-b606-342971cd1bfd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:48.815067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-256615b0-f826-4cc0-b606-342971cd1bfd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:49.464507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-256615b0-f826-4cc0-b606-342971cd1bfd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:49.478079 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-256615b0-f826-4cc0-b606-342971cd1bfd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1317 microversion: 2.1 time: 0.689106 Jul 26 14:12:49.481817 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 873/1878] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:48 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:49.769992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-942586876", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:49.878547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] validate_networks() for [('41f3a613-d66a-4287-9d9a-ba4316a2487f', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:12:49.938011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:12:49.938980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:12:49.939633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:12:49.940415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:12:49.941356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:12:49.958574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:49.959323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:49.960380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:49.961134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:50.011008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Getting quotas for project 0daac0aaada2453f84fdb257106f12ae. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:50.018372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Getting quotas for user cf1430124f9f4c099944aad81234f6de and project 0daac0aaada2453f84fdb257106f12ae. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:50.036724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:12:50.039494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:12:50.127250 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c872a490-45a6-4df5-8d0e-4efb42e3101d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.293827 Jul 26 14:12:50.135412 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1006/1879] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:12:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 5298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:12:50.147869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2cc770d5-ea7d-4735-9c30-6c1b336113d3 req-ffcfffb1-cfb5-4b2f-9fdf-06d842e4b1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a345c969-f3a8-466b-9909-8fea3469456b", "name": "network-vif-deleted", "tag": "3d1684cb-2ff6-4116-a7f5-540e7296d1f3"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:50.164197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2cc770d5-ea7d-4735-9c30-6c1b336113d3 req-ffcfffb1-cfb5-4b2f-9fdf-06d842e4b1c3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:50.164937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2cc770d5-ea7d-4735-9c30-6c1b336113d3 req-ffcfffb1-cfb5-4b2f-9fdf-06d842e4b1c3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:50.186430 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2cc770d5-ea7d-4735-9c30-6c1b336113d3 req-ffcfffb1-cfb5-4b2f-9fdf-06d842e4b1c3 service nova] Creating event network-vif-deleted:3d1684cb-2ff6-4116-a7f5-540e7296d1f3 for instance a345c969-f3a8-466b-9909-8fea3469456b on n-h1-833090-9 Jul 26 14:12:50.198686 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2cc770d5-ea7d-4735-9c30-6c1b336113d3 req-ffcfffb1-cfb5-4b2f-9fdf-06d842e4b1c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059396 Jul 26 14:12:50.201297 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1007/1880] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:50.208330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0790b6bd-5267-4fb7-b58a-4932913b8f68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:50.209313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0790b6bd-5267-4fb7-b58a-4932913b8f68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:50.219577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0790b6bd-5267-4fb7-b58a-4932913b8f68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:50.220390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0790b6bd-5267-4fb7-b58a-4932913b8f68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:50.221475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0790b6bd-5267-4fb7-b58a-4932913b8f68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:50.222162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0790b6bd-5267-4fb7-b58a-4932913b8f68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:50.788554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0790b6bd-5267-4fb7-b58a-4932913b8f68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:50.821472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0790b6bd-5267-4fb7-b58a-4932913b8f68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:50.836123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0790b6bd-5267-4fb7-b58a-4932913b8f68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:50.843186 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0790b6bd-5267-4fb7-b58a-4932913b8f68 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.640395 Jul 26 14:12:50.845774 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1008/1881] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:50 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:50.861958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9538195-b0a1-4eea-89bc-3c91e85b0f75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:50.862850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d9538195-b0a1-4eea-89bc-3c91e85b0f75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:50.881084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9538195-b0a1-4eea-89bc-3c91e85b0f75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:50.882237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9538195-b0a1-4eea-89bc-3c91e85b0f75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:50.883462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9538195-b0a1-4eea-89bc-3c91e85b0f75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:50.884309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9538195-b0a1-4eea-89bc-3c91e85b0f75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:51.268628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:12:51.269223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:12:51.269544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:12:51.269997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:12:51.270364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:12:51.290679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d9538195-b0a1-4eea-89bc-3c91e85b0f75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:51.303312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:51.307140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:51.312527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:51.313362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:51.320469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d9538195-b0a1-4eea-89bc-3c91e85b0f75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:51.326865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d9538195-b0a1-4eea-89bc-3c91e85b0f75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:51.334617 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d9538195-b0a1-4eea-89bc-3c91e85b0f75 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.484263 Jul 26 14:12:51.337130 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1009/1882] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:50 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:51.360833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09b278aa-45b6-4e1f-aa54-3c966917d48a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:51.362580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-09b278aa-45b6-4e1f-aa54-3c966917d48a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: a345c969-f3a8-466b-9909-8fea3469456b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:51.373979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Getting quotas for project 2cce280cfb40401581a18078069bb592. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:51.379106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09b278aa-45b6-4e1f-aa54-3c966917d48a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:51.380928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09b278aa-45b6-4e1f-aa54-3c966917d48a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:51.383395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Getting quotas for user 58bff9719b9e4d9995199bd43fa118fd and project 2cce280cfb40401581a18078069bb592. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:51.384759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09b278aa-45b6-4e1f-aa54-3c966917d48a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:51.385296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09b278aa-45b6-4e1f-aa54-3c966917d48a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:51.429695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:12:51.432333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:12:51.439261 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-09b278aa-45b6-4e1f-aa54-3c966917d48a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] HTTP exception thrown: Instance a345c969-f3a8-466b-9909-8fea3469456b could not be found. Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09b278aa-45b6-4e1f-aa54-3c966917d48a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Request method failure captured: Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b HTTP/1.1 Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VIEyEqsfRNf3q9y7-TCTWGm3iiZpx7sxczOefIdc-aX9pE72j6Y0gQBnBTQMKmdaXUF3Vkgw3pMeCcBOQ364OnMkUEed1O2SJU9yUegYzUVxOIlRBOev7140EQWmbUNr1kGSa4cG7wd0pNLhpDlwn1GEkvKfuvWpaZmxqE9WwUjPg Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3982eb0d2c734ff3bd9a13a61d1214a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}] Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 595ebbd7d38049268b2bba22fee81f14 Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance a345c969-f3a8-466b-9909-8fea3469456b could not be found. Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'a345c969-f3a8-466b-9909-8fea3469456b'} Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a345c969-f3a8-466b-9909-8fea3469456b could not be found. Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a345c969-f3a8-466b-9909-8fea3469456b could not be found. Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:12:51.441566 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:51.446450 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:12:51.446450 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:12:51.446450 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:12:51.446450 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:12:51.446450 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:12:51.446450 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a345c969-f3a8-466b-9909-8fea3469456b could not be found. Jul 26 14:12:51.446450 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:12:51.446450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09b278aa-45b6-4e1f-aa54-3c966917d48a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Returning 404 to user: Instance a345c969-f3a8-466b-9909-8fea3469456b could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:12:51.446450 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-09b278aa-45b6-4e1f-aa54-3c966917d48a tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b" status: 404 len: 111 microversion: 2.1 time: 0.098404 Jul 26 14:12:51.447242 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1010/1883] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:51 2022] GET /compute/v2.1/servers/a345c969-f3a8-466b-9909-8fea3469456b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:12:51.458205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-128a98a9-5f1c-480a-91b6-8e5cc23df793 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:51.463613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-128a98a9-5f1c-480a-91b6-8e5cc23df793 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:51.475405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-128a98a9-5f1c-480a-91b6-8e5cc23df793 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:51.475866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-128a98a9-5f1c-480a-91b6-8e5cc23df793 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:51.476909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-128a98a9-5f1c-480a-91b6-8e5cc23df793 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:51.477526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-128a98a9-5f1c-480a-91b6-8e5cc23df793 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:51.570797 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-80f42252-f9ac-4aea-876c-25d6cd70aa0f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.087097 Jul 26 14:12:51.572135 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 874/1884] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:12:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:12:51.582942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8f1767e7-267b-4dd3-8f7a-847516a43483 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:51.584179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8f1767e7-267b-4dd3-8f7a-847516a43483 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:51.600708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1767e7-267b-4dd3-8f7a-847516a43483 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:51.606851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1767e7-267b-4dd3-8f7a-847516a43483 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:51.607511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1767e7-267b-4dd3-8f7a-847516a43483 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:51.607989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1767e7-267b-4dd3-8f7a-847516a43483 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:52.234315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-128a98a9-5f1c-480a-91b6-8e5cc23df793 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:52.252614 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-128a98a9-5f1c-480a-91b6-8e5cc23df793 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1264 microversion: 2.1 time: 0.804789 Jul 26 14:12:52.257891 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1011/1885] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:51 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1264 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:52.278604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-5614d906-f8ce-495b-84b7-d8aac435d88f req-b5ba4c1d-fa3d-4606-9d69-dca0219c0115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-plugged", "status": "completed", "tag": "672376f8-b9e7-4c34-b66d-00f8e644af8a"}, {"server_uuid": "c6e53966-8644-4b0b-9429-dd23222bb79e", "name": "network-vif-plugged", "status": "completed", "tag": "d89bd279-7459-4603-9b92-9e0b93981d08"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:52.321021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5614d906-f8ce-495b-84b7-d8aac435d88f req-b5ba4c1d-fa3d-4606-9d69-dca0219c0115 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:52.323192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5614d906-f8ce-495b-84b7-d8aac435d88f req-b5ba4c1d-fa3d-4606-9d69-dca0219c0115 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:52.366514 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-5614d906-f8ce-495b-84b7-d8aac435d88f req-b5ba4c1d-fa3d-4606-9d69-dca0219c0115 service nova] Creating event network-vif-plugged:672376f8-b9e7-4c34-b66d-00f8e644af8a for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:12:52.367637 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-5614d906-f8ce-495b-84b7-d8aac435d88f req-b5ba4c1d-fa3d-4606-9d69-dca0219c0115 service nova] Creating event network-vif-plugged:d89bd279-7459-4603-9b92-9e0b93981d08 for instance c6e53966-8644-4b0b-9429-dd23222bb79e on n-h2-833090-9 Jul 26 14:12:52.397125 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-5614d906-f8ce-495b-84b7-d8aac435d88f req-b5ba4c1d-fa3d-4606-9d69-dca0219c0115 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.135765 Jul 26 14:12:52.398183 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1012/1886] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:52.404316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ebb375b0-56aa-4029-8007-271f59262d12 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:52.440027 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ebb375b0-56aa-4029-8007-271f59262d12 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/f6dd8340-f728-4215-9479-c6bcde1c3831" status: 204 len: 0 microversion: 2.1 time: 0.039798 Jul 26 14:12:52.441120 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1013/1887] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:12:52 2022] DELETE /compute/v2.1/os-server-groups/f6dd8340-f728-4215-9479-c6bcde1c3831 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:52.446852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aafc7929-5e18-4226-978a-125ab52b3176 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:52.448178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aafc7929-5e18-4226-978a-125ab52b3176 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:52.477396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8f1767e7-267b-4dd3-8f7a-847516a43483 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:52.489113 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8f1767e7-267b-4dd3-8f7a-847516a43483 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1317 microversion: 2.1 time: 0.915627 Jul 26 14:12:52.489717 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 875/1888] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:51 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1317 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:52.525798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e5fde200-4846-457d-a119-63335f0c7edc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:52.539532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e5fde200-4846-457d-a119-63335f0c7edc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:52.571587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5fde200-4846-457d-a119-63335f0c7edc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:52.575461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5fde200-4846-457d-a119-63335f0c7edc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:52.576870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5fde200-4846-457d-a119-63335f0c7edc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:52.582206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5fde200-4846-457d-a119-63335f0c7edc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:52.598531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:12:52.922403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aafc7929-5e18-4226-978a-125ab52b3176 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:52.937470 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aafc7929-5e18-4226-978a-125ab52b3176 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1213 microversion: 2.1 time: 0.495177 Jul 26 14:12:52.954618 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1014/1889] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:52 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1213 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:52.961777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e1bb21c9-4aa1-4032-ae0e-29815aaafbf3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:52.965723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e1bb21c9-4aa1-4032-ae0e-29815aaafbf3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:52.978658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1bb21c9-4aa1-4032-ae0e-29815aaafbf3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:52.986095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1bb21c9-4aa1-4032-ae0e-29815aaafbf3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:52.988571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1bb21c9-4aa1-4032-ae0e-29815aaafbf3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:52.989046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1bb21c9-4aa1-4032-ae0e-29815aaafbf3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:53.421884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e5fde200-4846-457d-a119-63335f0c7edc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:53.434314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e5fde200-4846-457d-a119-63335f0c7edc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:53.435861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e5fde200-4846-457d-a119-63335f0c7edc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:53.437145 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e5fde200-4846-457d-a119-63335f0c7edc tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 0.922242 Jul 26 14:12:53.437890 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 876/1890] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:52 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:53.453633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-211e9521-989a-4e46-8a49-277ac5a17c4f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:53.454152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-211e9521-989a-4e46-8a49-277ac5a17c4f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:53.473269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-211e9521-989a-4e46-8a49-277ac5a17c4f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:53.473735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-211e9521-989a-4e46-8a49-277ac5a17c4f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:53.474546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-211e9521-989a-4e46-8a49-277ac5a17c4f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:53.474992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-211e9521-989a-4e46-8a49-277ac5a17c4f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:53.510389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-211e9521-989a-4e46-8a49-277ac5a17c4f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:12:53.561215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e1bb21c9-4aa1-4032-ae0e-29815aaafbf3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:53.578146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e1bb21c9-4aa1-4032-ae0e-29815aaafbf3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:53.584115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e1bb21c9-4aa1-4032-ae0e-29815aaafbf3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:53.585533 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e1bb21c9-4aa1-4032-ae0e-29815aaafbf3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1280 microversion: 2.25 time: 0.629928 Jul 26 14:12:53.590373 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1015/1891] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:52 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1280 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:53.634784 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-211e9521-989a-4e46-8a49-277ac5a17c4f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 204 len: 0 microversion: 2.1 time: 0.195744 Jul 26 14:12:53.639102 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 877/1892] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:12:53 2022] DELETE /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:12:53.643359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-76f20bc5-726b-4097-a6d6-92622aba4b75 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:53.644125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76f20bc5-726b-4097-a6d6-92622aba4b75 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:53.655849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76f20bc5-726b-4097-a6d6-92622aba4b75 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:53.656486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76f20bc5-726b-4097-a6d6-92622aba4b75 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:53.657337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76f20bc5-726b-4097-a6d6-92622aba4b75 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:53.657841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76f20bc5-726b-4097-a6d6-92622aba4b75 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:53.738155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-746007064", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "08dc4566-921c-4f62-8f9a-1a9e3f005bb9"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:53.869113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] validate_networks() for [('08dc4566-921c-4f62-8f9a-1a9e3f005bb9', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:12:54.251445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-76f20bc5-726b-4097-a6d6-92622aba4b75 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:54.260163 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-76f20bc5-726b-4097-a6d6-92622aba4b75 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1270 microversion: 2.1 time: 0.622584 Jul 26 14:12:54.260595 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 878/1893] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:53 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1270 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:54.276714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-90b14d77-d383-4df8-ba6e-1de38f116231 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:54.277500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-90b14d77-d383-4df8-ba6e-1de38f116231 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:54.290525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90b14d77-d383-4df8-ba6e-1de38f116231 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:54.293868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90b14d77-d383-4df8-ba6e-1de38f116231 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:54.295803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90b14d77-d383-4df8-ba6e-1de38f116231 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:54.296365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90b14d77-d383-4df8-ba6e-1de38f116231 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:54.922983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-90b14d77-d383-4df8-ba6e-1de38f116231 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:54.938063 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-90b14d77-d383-4df8-ba6e-1de38f116231 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1317 microversion: 2.1 time: 0.672134 Jul 26 14:12:54.939203 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 879/1894] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:54 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:54.944934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-998abfce-debc-4591-84ec-d93e85fa486f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:54.946040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-998abfce-debc-4591-84ec-d93e85fa486f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:54.963399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-998abfce-debc-4591-84ec-d93e85fa486f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:54.965774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-998abfce-debc-4591-84ec-d93e85fa486f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:54.966918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-998abfce-debc-4591-84ec-d93e85fa486f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:54.967554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-998abfce-debc-4591-84ec-d93e85fa486f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:55.825183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:12:55.825988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:12:55.827451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:12:55.828850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:12:55.830249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:12:55.842627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:55.843457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:55.844579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:55.845332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:55.872806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Getting quotas for project af3d0a242a34482d8737db7862279e87. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:12:55.873598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-998abfce-debc-4591-84ec-d93e85fa486f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:55.881024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Getting quotas for user f94de8d57f854570b3ceda6ae5e7b9ae and project af3d0a242a34482d8737db7862279e87. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:12:55.905165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:12:55.909712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:12:55.916520 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-998abfce-debc-4591-84ec-d93e85fa486f tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 200 len: 1473 microversion: 2.1 time: 0.976006 Jul 26 14:12:55.922004 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 880/1895] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:54 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 1473 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:55.950379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2a633743-0ff6-4c52-9654-59a604291224 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:55.951257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2a633743-0ff6-4c52-9654-59a604291224 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:55.977659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a633743-0ff6-4c52-9654-59a604291224 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:55.978136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a633743-0ff6-4c52-9654-59a604291224 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:55.978939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a633743-0ff6-4c52-9654-59a604291224 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:55.979942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a633743-0ff6-4c52-9654-59a604291224 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:56.013383 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-00e6fea0-9d9c-47bd-a179-931304581270 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.420377 Jul 26 14:12:56.027320 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1016/1896] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:12:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:12:56.033253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d899a713-233d-435a-8fa3-1dc181f424e5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:56.034578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d899a713-233d-435a-8fa3-1dc181f424e5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:56.045110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d899a713-233d-435a-8fa3-1dc181f424e5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:56.062002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d899a713-233d-435a-8fa3-1dc181f424e5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:56.066253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d899a713-233d-435a-8fa3-1dc181f424e5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:56.070528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d899a713-233d-435a-8fa3-1dc181f424e5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:56.304276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2a633743-0ff6-4c52-9654-59a604291224 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:56.330241 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2a633743-0ff6-4c52-9654-59a604291224 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1271 microversion: 2.1 time: 0.399036 Jul 26 14:12:56.341213 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 881/1897] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:55 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1271 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:56.350268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-384820a1-2e70-49ec-816c-22f04c253845 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:56.351373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-384820a1-2e70-49ec-816c-22f04c253845 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:56.381111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-384820a1-2e70-49ec-816c-22f04c253845 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:56.381909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-384820a1-2e70-49ec-816c-22f04c253845 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:56.383023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-384820a1-2e70-49ec-816c-22f04c253845 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:56.383710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-384820a1-2e70-49ec-816c-22f04c253845 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:57.266169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-384820a1-2e70-49ec-816c-22f04c253845 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:57.277283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-384820a1-2e70-49ec-816c-22f04c253845 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:57.285305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-384820a1-2e70-49ec-816c-22f04c253845 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:57.287325 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-384820a1-2e70-49ec-816c-22f04c253845 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1476 microversion: 2.25 time: 0.944325 Jul 26 14:12:57.294889 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 882/1898] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:56 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1476 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:57.300612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-100e3244-f61c-4fd3-8184-d674f8e88926 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:57.301484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-100e3244-f61c-4fd3-8184-d674f8e88926 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:57.309468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-100e3244-f61c-4fd3-8184-d674f8e88926 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:57.310332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-100e3244-f61c-4fd3-8184-d674f8e88926 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:57.311414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-100e3244-f61c-4fd3-8184-d674f8e88926 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:57.312144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-100e3244-f61c-4fd3-8184-d674f8e88926 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:57.664824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d899a713-233d-435a-8fa3-1dc181f424e5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:57.686878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d899a713-233d-435a-8fa3-1dc181f424e5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:57.688891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d899a713-233d-435a-8fa3-1dc181f424e5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:57.690307 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d899a713-233d-435a-8fa3-1dc181f424e5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1878 microversion: 2.42 time: 1.661198 Jul 26 14:12:57.690902 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1017/1899] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:56 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1878 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:57.712128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7fb1b757-5141-438a-a5ee-335194fa56f9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:57.712805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7fb1b757-5141-438a-a5ee-335194fa56f9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:57.732223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fb1b757-5141-438a-a5ee-335194fa56f9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:57.733114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fb1b757-5141-438a-a5ee-335194fa56f9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:57.735004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fb1b757-5141-438a-a5ee-335194fa56f9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:57.736633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fb1b757-5141-438a-a5ee-335194fa56f9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:58.593438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-100e3244-f61c-4fd3-8184-d674f8e88926 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:58.619087 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-100e3244-f61c-4fd3-8184-d674f8e88926 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1312 microversion: 2.1 time: 1.322331 Jul 26 14:12:58.621140 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 883/1900] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:57 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1312 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:58.626862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4e91337f-3e37-44cc-b265-49ecb30b9bbf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:58.627890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4e91337f-3e37-44cc-b265-49ecb30b9bbf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:58.636207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e91337f-3e37-44cc-b265-49ecb30b9bbf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:58.636942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e91337f-3e37-44cc-b265-49ecb30b9bbf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:58.637758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e91337f-3e37-44cc-b265-49ecb30b9bbf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:58.638208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e91337f-3e37-44cc-b265-49ecb30b9bbf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:58.829422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7fb1b757-5141-438a-a5ee-335194fa56f9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:58.843622 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7fb1b757-5141-438a-a5ee-335194fa56f9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1317 microversion: 2.1 time: 1.142140 Jul 26 14:12:58.844044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1018/1901] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:57 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1317 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:58.868175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5c4e912-e39e-41ef-89e7-6b7aa7a4b559 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:58.875860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d5c4e912-e39e-41ef-89e7-6b7aa7a4b559 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:58.876917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d5c4e912-e39e-41ef-89e7-6b7aa7a4b559 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Searching by: {'deleted': False, 'project_id': '6d3d4870c41848059f09cb025a2251f4'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:12:58.889409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5c4e912-e39e-41ef-89e7-6b7aa7a4b559 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:58.889867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5c4e912-e39e-41ef-89e7-6b7aa7a4b559 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:58.890676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5c4e912-e39e-41ef-89e7-6b7aa7a4b559 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:58.893844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5c4e912-e39e-41ef-89e7-6b7aa7a4b559 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:58.933945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-d5c4e912-e39e-41ef-89e7-6b7aa7a4b559 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:12:58.975710 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5c4e912-e39e-41ef-89e7-6b7aa7a4b559 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.113990 Jul 26 14:12:58.976912 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1019/1902] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:12:58 2022] GET /compute/v2.1/servers => generated 340 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:58.986894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-25d0e5b0-054d-4ca5-8c07-4b29d17a88ad req-4bbf5c41-f751-45e4-8e20-6289701ca573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b94307-dd41-4f71-b529-c6cbb944c27f", "name": "network-vif-plugged", "status": "completed", "tag": "5c60dac8-f587-41cf-8357-66980afb2e01"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:12:59.004142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-25d0e5b0-054d-4ca5-8c07-4b29d17a88ad req-4bbf5c41-f751-45e4-8e20-6289701ca573 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.006062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-25d0e5b0-054d-4ca5-8c07-4b29d17a88ad req-4bbf5c41-f751-45e4-8e20-6289701ca573 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:59.022050 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-25d0e5b0-054d-4ca5-8c07-4b29d17a88ad req-4bbf5c41-f751-45e4-8e20-6289701ca573 service nova] Creating event network-vif-plugged:5c60dac8-f587-41cf-8357-66980afb2e01 for instance e6b94307-dd41-4f71-b529-c6cbb944c27f on n-h1-833090-9 Jul 26 14:12:59.032415 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-25d0e5b0-054d-4ca5-8c07-4b29d17a88ad req-4bbf5c41-f751-45e4-8e20-6289701ca573 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052999 Jul 26 14:12:59.033939 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1020/1903] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:12:59.042475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ffbfe06f-ba2e-414e-a587-fcf3f2645281 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:59.043815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ffbfe06f-ba2e-414e-a587-fcf3f2645281 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:59.061054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffbfe06f-ba2e-414e-a587-fcf3f2645281 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.062910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffbfe06f-ba2e-414e-a587-fcf3f2645281 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:59.064812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffbfe06f-ba2e-414e-a587-fcf3f2645281 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.065524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffbfe06f-ba2e-414e-a587-fcf3f2645281 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:59.221115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4e91337f-3e37-44cc-b265-49ecb30b9bbf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:59.233847 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4e91337f-3e37-44cc-b265-49ecb30b9bbf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1265 microversion: 2.1 time: 0.610928 Jul 26 14:12:59.235361 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 884/1904] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:58 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1265 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:59.240637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bf6846dc-dc9e-42dc-b104-c719bc80ef39 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:59.241842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bf6846dc-dc9e-42dc-b104-c719bc80ef39 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:59.260580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf6846dc-dc9e-42dc-b104-c719bc80ef39 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.261299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf6846dc-dc9e-42dc-b104-c719bc80ef39 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:59.262308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf6846dc-dc9e-42dc-b104-c719bc80ef39 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.263022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf6846dc-dc9e-42dc-b104-c719bc80ef39 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:59.305856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ffbfe06f-ba2e-414e-a587-fcf3f2645281 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595ebbd7d38049268b2bba22fee81f14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3982eb0d2c734ff3bd9a13a61d1214a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:59.336799 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ffbfe06f-ba2e-414e-a587-fcf3f2645281 tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 200 len: 1431 microversion: 2.1 time: 0.300915 Jul 26 14:12:59.338325 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1021/1905] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:59 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 1431 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:59.345804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b8a1bea-3cdb-46bf-8049-93ba3038ec06 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:59.346675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4b8a1bea-3cdb-46bf-8049-93ba3038ec06 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:59.353310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b8a1bea-3cdb-46bf-8049-93ba3038ec06 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.354757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b8a1bea-3cdb-46bf-8049-93ba3038ec06 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:59.355836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b8a1bea-3cdb-46bf-8049-93ba3038ec06 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.356523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b8a1bea-3cdb-46bf-8049-93ba3038ec06 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:59.858504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4b8a1bea-3cdb-46bf-8049-93ba3038ec06 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:59.873857 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4b8a1bea-3cdb-46bf-8049-93ba3038ec06 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1313 microversion: 2.1 time: 0.533714 Jul 26 14:12:59.875444 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1022/1906] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:12:59 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:12:59.882161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ccbc93ee-e7a9-46de-879d-152eb43ff0c6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:59.883843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ccbc93ee-e7a9-46de-879d-152eb43ff0c6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:12:59.888625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-bf6846dc-dc9e-42dc-b104-c719bc80ef39 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid c6e53966-8644-4b0b-9429-dd23222bb79e {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:12:59.897002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccbc93ee-e7a9-46de-879d-152eb43ff0c6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.897933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccbc93ee-e7a9-46de-879d-152eb43ff0c6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:59.899219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccbc93ee-e7a9-46de-879d-152eb43ff0c6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.899867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccbc93ee-e7a9-46de-879d-152eb43ff0c6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:59.930941 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bf6846dc-dc9e-42dc-b104-c719bc80ef39 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1968 microversion: 2.25 time: 0.694142 Jul 26 14:12:59.932146 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 885/1907] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:59 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1968 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:12:59.942460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:12:59.954850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:12:59.955998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Searching by: {'deleted': False, 'project_id': '6d3d4870c41848059f09cb025a2251f4'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:12:59.964890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.965830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:12:59.969349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:12:59.969890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:00.021831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:13:00.105076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:00.134677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:00.136022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:00.921741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ccbc93ee-e7a9-46de-879d-152eb43ff0c6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:00.937474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ccbc93ee-e7a9-46de-879d-152eb43ff0c6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:00.939552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ccbc93ee-e7a9-46de-879d-152eb43ff0c6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:00.940946 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7de8b763-bc2e-4559-9b80-e58c13a6549d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 1.006939 Jul 26 14:13:00.941617 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 886/1908] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:12:59 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:00.952136 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ccbc93ee-e7a9-46de-879d-152eb43ff0c6 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2836 microversion: 2.42 time: 1.064440 Jul 26 14:13:00.952136 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1023/1909] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:12:59 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2836 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:00.952136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-16732321-e5d0-4563-8a82-b31e767a3220 req-6a768d0d-a874-4cc3-adfc-21a69ffac248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34089008-8d17-4f4a-a989-57f47959ae93", "name": "network-vif-deleted", "tag": "4b363e20-4144-4452-a88b-446bd69f43ec"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:00.960332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2a994b64-0dfa-4798-b350-8164b5c235e5 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:00.960332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2a994b64-0dfa-4798-b350-8164b5c235e5 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:00.967894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-16732321-e5d0-4563-8a82-b31e767a3220 req-6a768d0d-a874-4cc3-adfc-21a69ffac248 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:00.970806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-16732321-e5d0-4563-8a82-b31e767a3220 req-6a768d0d-a874-4cc3-adfc-21a69ffac248 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:00.973954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a994b64-0dfa-4798-b350-8164b5c235e5 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:00.974415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a994b64-0dfa-4798-b350-8164b5c235e5 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:00.975207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a994b64-0dfa-4798-b350-8164b5c235e5 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:00.975680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a994b64-0dfa-4798-b350-8164b5c235e5 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:00.991934 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-16732321-e5d0-4563-8a82-b31e767a3220 req-6a768d0d-a874-4cc3-adfc-21a69ffac248 service nova] Creating event network-vif-deleted:4b363e20-4144-4452-a88b-446bd69f43ec for instance 34089008-8d17-4f4a-a989-57f47959ae93 on n-h2-833090-9 Jul 26 14:13:00.997088 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-16732321-e5d0-4563-8a82-b31e767a3220 req-6a768d0d-a874-4cc3-adfc-21a69ffac248 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053251 Jul 26 14:13:00.998121 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1024/1910] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:01.003611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fa9eb0db-3a0a-45ca-a4bd-6f92e73369bc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:01.004442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fa9eb0db-3a0a-45ca-a4bd-6f92e73369bc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:01.013922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa9eb0db-3a0a-45ca-a4bd-6f92e73369bc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:01.014386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa9eb0db-3a0a-45ca-a4bd-6f92e73369bc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:01.015174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa9eb0db-3a0a-45ca-a4bd-6f92e73369bc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:01.015855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa9eb0db-3a0a-45ca-a4bd-6f92e73369bc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:01.549434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2a994b64-0dfa-4798-b350-8164b5c235e5 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:01.559973 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2a994b64-0dfa-4798-b350-8164b5c235e5 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1333 microversion: 2.1 time: 0.609782 Jul 26 14:13:01.560873 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 887/1911] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:00 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1333 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:01.567926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d60fad57-1cea-4462-8747-e8b57032d831 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:01.568909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d60fad57-1cea-4462-8747-e8b57032d831 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:01.581281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d60fad57-1cea-4462-8747-e8b57032d831 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:01.581902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d60fad57-1cea-4462-8747-e8b57032d831 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:01.582517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d60fad57-1cea-4462-8747-e8b57032d831 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:01.582956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d60fad57-1cea-4462-8747-e8b57032d831 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:01.595159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fa9eb0db-3a0a-45ca-a4bd-6f92e73369bc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:01.607843 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fa9eb0db-3a0a-45ca-a4bd-6f92e73369bc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.608029 Jul 26 14:13:01.610063 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1025/1912] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:00 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:01.615446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-caeec5e3-df45-4a55-a562-629dd61a639a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:01.616089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-caeec5e3-df45-4a55-a562-629dd61a639a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:01.623132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-caeec5e3-df45-4a55-a562-629dd61a639a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:01.623595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-caeec5e3-df45-4a55-a562-629dd61a639a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:01.624457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-caeec5e3-df45-4a55-a562-629dd61a639a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:01.624903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-caeec5e3-df45-4a55-a562-629dd61a639a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:01.767582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-caeec5e3-df45-4a55-a562-629dd61a639a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:01.777895 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-caeec5e3-df45-4a55-a562-629dd61a639a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1265 microversion: 2.1 time: 0.166485 Jul 26 14:13:01.778481 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1026/1913] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:01 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:01.783850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64d55675-02e1-4a0c-8ada-58996ee5626e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:01.784745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-64d55675-02e1-4a0c-8ada-58996ee5626e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] [instance: 34089008-8d17-4f4a-a989-57f47959ae93] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:01.797810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64d55675-02e1-4a0c-8ada-58996ee5626e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:01.798890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64d55675-02e1-4a0c-8ada-58996ee5626e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:01.800601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64d55675-02e1-4a0c-8ada-58996ee5626e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:01.801447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64d55675-02e1-4a0c-8ada-58996ee5626e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:01.819645 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-64d55675-02e1-4a0c-8ada-58996ee5626e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] HTTP exception thrown: Instance 34089008-8d17-4f4a-a989-57f47959ae93 could not be found. Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64d55675-02e1-4a0c-8ada-58996ee5626e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Request method failure captured: Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 HTTP/1.1 Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_VIEyEqsfRNf3q9y7-TCTWGm3iiZpx7sxczOefIdc-aX9pE72j6Y0gQBnBTQMKmdaXUF3Vkgw3pMeCcBOQ364OnMkUEed1O2SJU9yUegYzUVxOIlRBOev7140EQWmbUNr1kGSa4cG7wd0pNLhpDlwn1GEkvKfuvWpaZmxqE9WwUjPg Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3982eb0d2c734ff3bd9a13a61d1214a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3982eb0d2c734ff3bd9a13a61d1214a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3982eb0d2c734ff3bd9a13a61d1214a9"}]}] Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 3982eb0d2c734ff3bd9a13a61d1214a9 Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1867065173 Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 595ebbd7d38049268b2bba22fee81f14 Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersOnMultiNodesTest-1867065173-project Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 34089008-8d17-4f4a-a989-57f47959ae93 could not be found. Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '34089008-8d17-4f4a-a989-57f47959ae93'} Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34089008-8d17-4f4a-a989-57f47959ae93 could not be found. Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34089008-8d17-4f4a-a989-57f47959ae93 could not be found. Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:01.821980 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:01.828596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:01.828596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:01.828596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:01.828596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:13:01.828596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:13:01.828596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34089008-8d17-4f4a-a989-57f47959ae93 could not be found. Jul 26 14:13:01.828596 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:01.828596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64d55675-02e1-4a0c-8ada-58996ee5626e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] Returning 404 to user: Instance 34089008-8d17-4f4a-a989-57f47959ae93 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:01.828596 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-64d55675-02e1-4a0c-8ada-58996ee5626e tempest-ServersOnMultiNodesTest-1867065173 tempest-ServersOnMultiNodesTest-1867065173-project] 10.222.0.70 "GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93" status: 404 len: 111 microversion: 2.1 time: 0.044942 Jul 26 14:13:01.828596 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1027/1914] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:01 2022] GET /compute/v2.1/servers/34089008-8d17-4f4a-a989-57f47959ae93 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:13:01.833584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fd943601-82fa-4755-a572-7b6e71fac121 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:01.835058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fd943601-82fa-4755-a572-7b6e71fac121 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:01.846197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd943601-82fa-4755-a572-7b6e71fac121 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:01.847012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd943601-82fa-4755-a572-7b6e71fac121 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:01.848920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd943601-82fa-4755-a572-7b6e71fac121 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:01.849603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd943601-82fa-4755-a572-7b6e71fac121 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:02.194720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-d60fad57-1cea-4462-8747-e8b57032d831 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid c6e53966-8644-4b0b-9429-dd23222bb79e {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:13:02.231505 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d60fad57-1cea-4462-8747-e8b57032d831 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1968 microversion: 2.25 time: 0.669444 Jul 26 14:13:02.237616 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 888/1915] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:01 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1968 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:02.246108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bd9fe94d-9df8-4955-afe0-84a21118a353 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:02.267152 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bd9fe94d-9df8-4955-afe0-84a21118a353 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028387 Jul 26 14:13:02.283474 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 889/1916] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:13:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:02.291346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce75987c-dea2-4dee-80e9-bbb7fb51d6be tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:02.298849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce75987c-dea2-4dee-80e9-bbb7fb51d6be tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:02.317399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce75987c-dea2-4dee-80e9-bbb7fb51d6be tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:02.317861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce75987c-dea2-4dee-80e9-bbb7fb51d6be tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:02.318898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce75987c-dea2-4dee-80e9-bbb7fb51d6be tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:02.319527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce75987c-dea2-4dee-80e9-bbb7fb51d6be tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:02.611841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fd943601-82fa-4755-a572-7b6e71fac121 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:02.623143 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fd943601-82fa-4755-a572-7b6e71fac121 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1313 microversion: 2.1 time: 0.795203 Jul 26 14:13:02.637251 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1028/1917] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:01 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1313 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:02.645296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1374069810", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:02.708433 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce75987c-dea2-4dee-80e9-bbb7fb51d6be tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.423376 Jul 26 14:13:02.709917 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 890/1918] 10.222.0.70 () {60 vars in 1316 bytes} [Tue Jul 26 14:13:02 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b/os-interface => generated 1831 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:02.715786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a75bbc8-61f9-4fa3-a638-8bcda91b4913 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:02.746271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] validate_networks() for [('dab98a43-b5e8-42ee-ab97-d87aedbae0eb', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:13:02.750250 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:13:02.750250 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:13:02.752623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a75bbc8-61f9-4fa3-a638-8bcda91b4913 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:02.754262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a75bbc8-61f9-4fa3-a638-8bcda91b4913 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:02.757357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a75bbc8-61f9-4fa3-a638-8bcda91b4913 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:02.758000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a75bbc8-61f9-4fa3-a638-8bcda91b4913 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:02.790795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:02.805093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:02.851229 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4a75bbc8-61f9-4fa3-a638-8bcda91b4913 tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.139697 Jul 26 14:13:02.856574 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 891/1919] 10.222.0.70 () {60 vars in 1217 bytes} [Tue Jul 26 14:13:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:13:02.870144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ec1a9a26-b980-45f7-9d42-4c654234bf12 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:02.871110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ec1a9a26-b980-45f7-9d42-4c654234bf12 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:02.894445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ec1a9a26-b980-45f7-9d42-4c654234bf12 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:02.895184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ec1a9a26-b980-45f7-9d42-4c654234bf12 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:02.896247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ec1a9a26-b980-45f7-9d42-4c654234bf12 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:02.896875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ec1a9a26-b980-45f7-9d42-4c654234bf12 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:04.067128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ec1a9a26-b980-45f7-9d42-4c654234bf12 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:04.084888 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ec1a9a26-b980-45f7-9d42-4c654234bf12 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1333 microversion: 2.1 time: 1.226513 Jul 26 14:13:04.086704 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 892/1920] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:02 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1333 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:04.094135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f115b783-a277-4dab-8cd3-7f6d56227cd8 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:04.104920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f115b783-a277-4dab-8cd3-7f6d56227cd8 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:04.114939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f115b783-a277-4dab-8cd3-7f6d56227cd8 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:04.115679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f115b783-a277-4dab-8cd3-7f6d56227cd8 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:04.116803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f115b783-a277-4dab-8cd3-7f6d56227cd8 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:04.119441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f115b783-a277-4dab-8cd3-7f6d56227cd8 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:04.226379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f115b783-a277-4dab-8cd3-7f6d56227cd8 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:13:04.472439 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f115b783-a277-4dab-8cd3-7f6d56227cd8 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "DELETE /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 204 len: 0 microversion: 2.1 time: 0.384010 Jul 26 14:13:04.473707 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 893/1921] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:13:04 2022] DELETE /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:13:04.482020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7db975dc-1ff3-473c-85c8-db931c6df598 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:04.484876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7db975dc-1ff3-473c-85c8-db931c6df598 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:04.509218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7db975dc-1ff3-473c-85c8-db931c6df598 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:04.510954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7db975dc-1ff3-473c-85c8-db931c6df598 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:04.511994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7db975dc-1ff3-473c-85c8-db931c6df598 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:04.516425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7db975dc-1ff3-473c-85c8-db931c6df598 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:05.227328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7db975dc-1ff3-473c-85c8-db931c6df598 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:05.241974 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7db975dc-1ff3-473c-85c8-db931c6df598 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1307 microversion: 2.1 time: 0.767024 Jul 26 14:13:05.257629 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 894/1922] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:04 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1307 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:05.268739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02a4ffee-a44e-47db-97b0-f3eb093ab62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-9", "block_migration": "auto"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:05.271999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-02a4ffee-a44e-47db-97b0-f3eb093ab62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:05.280358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02a4ffee-a44e-47db-97b0-f3eb093ab62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:05.281326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02a4ffee-a44e-47db-97b0-f3eb093ab62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:05.283359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02a4ffee-a44e-47db-97b0-f3eb093ab62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:05.284100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02a4ffee-a44e-47db-97b0-f3eb093ab62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:05.330942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-02a4ffee-a44e-47db-97b0-f3eb093ab62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'flavor' on Instance uuid c6e53966-8644-4b0b-9429-dd23222bb79e {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:13:05.345516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-02a4ffee-a44e-47db-97b0-f3eb093ab62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Going to try to live migrate instance to n-h1-833090-9 {{(pid=119478) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 14:13:05.643368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:13:05.644596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:13:05.645313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:13:05.646386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:13:05.647433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:13:05.688137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:05.689543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:05.689543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:05.700580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:05.700580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:05.722108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Getting quotas for project 14cbcd06677b464ab54dab55a8acd782. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:13:05.735004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Getting quotas for user 8aa42b309ab240418fa01e6d4e65e19d and project 14cbcd06677b464ab54dab55a8acd782. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:13:05.750688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:05.752626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:13:05.756554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:13:05.825619 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c0d38af2-122d-48db-8592-714061ab0159 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.184731 Jul 26 14:13:05.828226 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1029/1923] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:13:05.844086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6aa7eb81-8c99-4a23-b8c3-c8e264816116 req-b1162510-7e72-4900-9709-3e75b0639148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b84552b-8ea2-4d88-b72d-8f8547cd9f9c", "tag": "643af9ca-999a-4ed7-8769-8e923e01a843"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:05.872408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6aa7eb81-8c99-4a23-b8c3-c8e264816116 req-b1162510-7e72-4900-9709-3e75b0639148 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:05.873855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6aa7eb81-8c99-4a23-b8c3-c8e264816116 req-b1162510-7e72-4900-9709-3e75b0639148 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:05.898891 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6aa7eb81-8c99-4a23-b8c3-c8e264816116 req-b1162510-7e72-4900-9709-3e75b0639148 service nova] Creating event network-changed:643af9ca-999a-4ed7-8769-8e923e01a843 for instance 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c on n-h1-833090-9 Jul 26 14:13:05.907058 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6aa7eb81-8c99-4a23-b8c3-c8e264816116 req-b1162510-7e72-4900-9709-3e75b0639148 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076002 Jul 26 14:13:05.910729 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1030/1924] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:05.928185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b73ca1b1-4d91-4bc4-847a-cfbd002c7f9e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:05.929112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b73ca1b1-4d91-4bc4-847a-cfbd002c7f9e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:05.938794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b73ca1b1-4d91-4bc4-847a-cfbd002c7f9e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:05.939472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b73ca1b1-4d91-4bc4-847a-cfbd002c7f9e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:05.940758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b73ca1b1-4d91-4bc4-847a-cfbd002c7f9e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:05.941649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b73ca1b1-4d91-4bc4-847a-cfbd002c7f9e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:06.847978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b73ca1b1-4d91-4bc4-847a-cfbd002c7f9e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:06.868627 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b73ca1b1-4d91-4bc4-847a-cfbd002c7f9e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1313 microversion: 2.1 time: 0.954360 Jul 26 14:13:06.893212 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1031/1925] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:05 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1313 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:06.904788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-17df2e98-f7a0-45d6-b349-57450a2aadc6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:06.905947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-17df2e98-f7a0-45d6-b349-57450a2aadc6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:06.916308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17df2e98-f7a0-45d6-b349-57450a2aadc6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:06.917233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17df2e98-f7a0-45d6-b349-57450a2aadc6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:06.918290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17df2e98-f7a0-45d6-b349-57450a2aadc6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:06.918909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17df2e98-f7a0-45d6-b349-57450a2aadc6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:07.716365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-17df2e98-f7a0-45d6-b349-57450a2aadc6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:07.738122 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-17df2e98-f7a0-45d6-b349-57450a2aadc6 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1713 microversion: 2.1 time: 0.841630 Jul 26 14:13:07.742374 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1032/1926] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:06 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1713 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:07.762837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-57f5263f-4065-4664-8d7d-d46aeee14a39 req-5048f8ca-552a-459f-98c9-322a7cb0a8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "tag": "672376f8-b9e7-4c34-b66d-00f8e644af8a"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:07.782427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-57f5263f-4065-4664-8d7d-d46aeee14a39 req-5048f8ca-552a-459f-98c9-322a7cb0a8d0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:07.784239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-57f5263f-4065-4664-8d7d-d46aeee14a39 req-5048f8ca-552a-459f-98c9-322a7cb0a8d0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:07.808539 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-57f5263f-4065-4664-8d7d-d46aeee14a39 req-5048f8ca-552a-459f-98c9-322a7cb0a8d0 service nova] Creating event network-changed:672376f8-b9e7-4c34-b66d-00f8e644af8a for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:13:07.817315 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-57f5263f-4065-4664-8d7d-d46aeee14a39 req-5048f8ca-552a-459f-98c9-322a7cb0a8d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073152 Jul 26 14:13:07.819126 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1033/1927] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:07.828559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3e04d57f-16b5-4fcd-b82b-49410e94f6d3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:07.829896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3e04d57f-16b5-4fcd-b82b-49410e94f6d3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:07.845588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e04d57f-16b5-4fcd-b82b-49410e94f6d3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:07.847078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e04d57f-16b5-4fcd-b82b-49410e94f6d3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:07.848491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e04d57f-16b5-4fcd-b82b-49410e94f6d3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:07.849904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e04d57f-16b5-4fcd-b82b-49410e94f6d3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:08.842730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3e04d57f-16b5-4fcd-b82b-49410e94f6d3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:08.860030 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3e04d57f-16b5-4fcd-b82b-49410e94f6d3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 1.036078 Jul 26 14:13:08.885592 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1034/1928] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:07 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:08.892936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dcebb634-dadc-4a57-853b-30ad7a2ad40b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:08.894322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dcebb634-dadc-4a57-853b-30ad7a2ad40b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:08.918090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcebb634-dadc-4a57-853b-30ad7a2ad40b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:08.945823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcebb634-dadc-4a57-853b-30ad7a2ad40b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:08.947341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcebb634-dadc-4a57-853b-30ad7a2ad40b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:08.947830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcebb634-dadc-4a57-853b-30ad7a2ad40b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:09.170056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dcebb634-dadc-4a57-853b-30ad7a2ad40b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:09.184436 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dcebb634-dadc-4a57-853b-30ad7a2ad40b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1275 microversion: 2.1 time: 0.296410 Jul 26 14:13:09.199473 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1035/1929] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:08 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:09.205618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32a4ca41-73d5-4eb5-815e-2b80c4900123 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:09.207231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32a4ca41-73d5-4eb5-815e-2b80c4900123 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:09.219360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32a4ca41-73d5-4eb5-815e-2b80c4900123 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:09.220113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32a4ca41-73d5-4eb5-815e-2b80c4900123 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:09.221140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32a4ca41-73d5-4eb5-815e-2b80c4900123 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:09.221686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32a4ca41-73d5-4eb5-815e-2b80c4900123 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:09.587565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32a4ca41-73d5-4eb5-815e-2b80c4900123 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:09.600213 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-32a4ca41-73d5-4eb5-815e-2b80c4900123 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1307 microversion: 2.1 time: 0.406071 Jul 26 14:13:09.600928 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1036/1930] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:09 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1307 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:09.609982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca72fd8e-162b-410a-b90e-c89ae2e1f3ec tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:09.611548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ca72fd8e-162b-410a-b90e-c89ae2e1f3ec tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:09.621442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca72fd8e-162b-410a-b90e-c89ae2e1f3ec tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:09.624271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca72fd8e-162b-410a-b90e-c89ae2e1f3ec tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:09.625598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca72fd8e-162b-410a-b90e-c89ae2e1f3ec tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:09.626312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca72fd8e-162b-410a-b90e-c89ae2e1f3ec tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:09.936609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ca72fd8e-162b-410a-b90e-c89ae2e1f3ec tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:09.956462 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca72fd8e-162b-410a-b90e-c89ae2e1f3ec tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1313 microversion: 2.1 time: 0.354177 Jul 26 14:13:09.957705 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1037/1931] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:09 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:09.966594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ff3a9312-771c-49a0-8dd4-e30a82c5ac84 req-09bb4b55-296e-4715-b9eb-45981a6541fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d63bc9c-464d-40bc-84f1-ffc106ed6cb7", "tag": "67ed775a-ab8d-4693-bb98-f833fe4899fa"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:09.982272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ff3a9312-771c-49a0-8dd4-e30a82c5ac84 req-09bb4b55-296e-4715-b9eb-45981a6541fa service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:09.983232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ff3a9312-771c-49a0-8dd4-e30a82c5ac84 req-09bb4b55-296e-4715-b9eb-45981a6541fa service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:10.015880 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ff3a9312-771c-49a0-8dd4-e30a82c5ac84 req-09bb4b55-296e-4715-b9eb-45981a6541fa service nova] Creating event network-changed:67ed775a-ab8d-4693-bb98-f833fe4899fa for instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 on n-h2-833090-9 Jul 26 14:13:10.024296 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ff3a9312-771c-49a0-8dd4-e30a82c5ac84 req-09bb4b55-296e-4715-b9eb-45981a6541fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063379 Jul 26 14:13:10.024296 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1038/1932] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:10.038987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-420e188e-cf1c-412f-ab12-0957894c8825 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:10.041490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-420e188e-cf1c-412f-ab12-0957894c8825 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:10.049370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-420e188e-cf1c-412f-ab12-0957894c8825 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:10.049981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-420e188e-cf1c-412f-ab12-0957894c8825 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:10.051533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-420e188e-cf1c-412f-ab12-0957894c8825 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:10.051846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-420e188e-cf1c-412f-ab12-0957894c8825 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:10.106906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:10.380691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-420e188e-cf1c-412f-ab12-0957894c8825 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'addd82517c33447caa2d0dcbb0379baf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d3d4870c41848059f09cb025a2251f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:10.389372 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-420e188e-cf1c-412f-ab12-0957894c8825 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 200 len: 1645 microversion: 2.1 time: 0.364467 Jul 26 14:13:10.407986 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1039/1933] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:10 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 1645 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:10.407986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fa191b0c-46b8-44a7-b3cc-72fb0be94a91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:10.407986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fa191b0c-46b8-44a7-b3cc-72fb0be94a91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:10.424015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa191b0c-46b8-44a7-b3cc-72fb0be94a91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:10.424859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa191b0c-46b8-44a7-b3cc-72fb0be94a91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:10.425901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa191b0c-46b8-44a7-b3cc-72fb0be94a91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:10.426576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa191b0c-46b8-44a7-b3cc-72fb0be94a91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:11.096506 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-02a4ffee-a44e-47db-97b0-f3eb093ab62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e/action" status: 202 len: 0 microversion: 2.25 time: 5.838276 Jul 26 14:13:11.098251 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 895/1934] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:13:05 2022] POST /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e/action => generated 0 bytes in 5841 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:13:11.123301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-122ff3fc-2ab1-48f8-ad07-bedac21e8bb2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:11.130017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-122ff3fc-2ab1-48f8-ad07-bedac21e8bb2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:11.169763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-122ff3fc-2ab1-48f8-ad07-bedac21e8bb2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:11.170072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-122ff3fc-2ab1-48f8-ad07-bedac21e8bb2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:11.177592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-122ff3fc-2ab1-48f8-ad07-bedac21e8bb2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:11.184318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-122ff3fc-2ab1-48f8-ad07-bedac21e8bb2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:11.774570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fa191b0c-46b8-44a7-b3cc-72fb0be94a91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:11.785119 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fa191b0c-46b8-44a7-b3cc-72fb0be94a91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 1.388799 Jul 26 14:13:11.786338 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1040/1935] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:10 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:11.809509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-573e964a-e7af-44cc-b60d-00948548aa35 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:11.810572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-573e964a-e7af-44cc-b60d-00948548aa35 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:11.826403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573e964a-e7af-44cc-b60d-00948548aa35 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:11.827359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573e964a-e7af-44cc-b60d-00948548aa35 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:11.829637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573e964a-e7af-44cc-b60d-00948548aa35 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:11.830457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573e964a-e7af-44cc-b60d-00948548aa35 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:11.852169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-122ff3fc-2ab1-48f8-ad07-bedac21e8bb2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:11.878489 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-122ff3fc-2ab1-48f8-ad07-bedac21e8bb2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1275 microversion: 2.1 time: 0.778217 Jul 26 14:13:11.881763 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 896/1936] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:11 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1275 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:11.896263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2d331db9-c6ff-4093-84b8-91d30ad8594a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:11.903084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2d331db9-c6ff-4093-84b8-91d30ad8594a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:11.930236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d331db9-c6ff-4093-84b8-91d30ad8594a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:11.931073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d331db9-c6ff-4093-84b8-91d30ad8594a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:11.938083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d331db9-c6ff-4093-84b8-91d30ad8594a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:11.938772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d331db9-c6ff-4093-84b8-91d30ad8594a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:12.778566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:12.933217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-573e964a-e7af-44cc-b60d-00948548aa35 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:12.955422 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-573e964a-e7af-44cc-b60d-00948548aa35 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1307 microversion: 2.1 time: 1.167448 Jul 26 14:13:12.956041 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1041/1937] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:11 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1307 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:12.993956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf06c06b-e604-4037-820c-c2c1e3282763 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:13.001473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bf06c06b-e604-4037-820c-c2c1e3282763 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:13.025918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf06c06b-e604-4037-820c-c2c1e3282763 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:13.027650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf06c06b-e604-4037-820c-c2c1e3282763 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:13.033276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf06c06b-e604-4037-820c-c2c1e3282763 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:13.034280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf06c06b-e604-4037-820c-c2c1e3282763 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:13.170551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2d331db9-c6ff-4093-84b8-91d30ad8594a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:13.189955 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2d331db9-c6ff-4093-84b8-91d30ad8594a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1313 microversion: 2.1 time: 1.306438 Jul 26 14:13:13.204611 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 897/1938] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:11 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1313 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:13.210007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3b73249a-4879-4de5-885c-f5c87a2030c7 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:13.210637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3b73249a-4879-4de5-885c-f5c87a2030c7 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] [instance: 15942639-9b2d-4a9b-a09f-2040d775466f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:13.223414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b73249a-4879-4de5-885c-f5c87a2030c7 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:13.224205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b73249a-4879-4de5-885c-f5c87a2030c7 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:13.225324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b73249a-4879-4de5-885c-f5c87a2030c7 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:13.225959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b73249a-4879-4de5-885c-f5c87a2030c7 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:13.260042 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-3b73249a-4879-4de5-885c-f5c87a2030c7 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] HTTP exception thrown: Instance 15942639-9b2d-4a9b-a09f-2040d775466f could not be found. Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3b73249a-4879-4de5-885c-f5c87a2030c7 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Request method failure captured: Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f HTTP/1.1 Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_YX6UGI1-iHCXHXSAhCgvpYDpUvwABwsUKJt-biFZsAFFsZipcmIkU21mGdb-qEwMYIfiFO_79d-kxD4Ok3leoUQiMaYNaHAq5ii5v6ObT-DVkSbTat6PtgPIayhKbLNngFczP85SrhkVjKcWkGDluqOLbdGyBtEJfXqsC9qgtjweg Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 6d3d4870c41848059f09cb025a2251f4 Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestManualDisk-260183642 Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6d3d4870c41848059f09cb025a2251f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6d3d4870c41848059f09cb025a2251f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6d3d4870c41848059f09cb025a2251f4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6d3d4870c41848059f09cb025a2251f4"}]}] Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestManualDisk-260183642 Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 6d3d4870c41848059f09cb025a2251f4 Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestManualDisk-260183642 Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestManualDisk-260183642-project Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: addd82517c33447caa2d0dcbb0379baf Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestManualDisk-260183642-project Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 15942639-9b2d-4a9b-a09f-2040d775466f could not be found. Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '15942639-9b2d-4a9b-a09f-2040d775466f'} Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15942639-9b2d-4a9b-a09f-2040d775466f could not be found. Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15942639-9b2d-4a9b-a09f-2040d775466f could not be found. Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:13.262052 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:13.268046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:13.268046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:13.268046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:13.268046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:13:13.268046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:13:13.268046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15942639-9b2d-4a9b-a09f-2040d775466f could not be found. Jul 26 14:13:13.268046 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:13.272258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3b73249a-4879-4de5-885c-f5c87a2030c7 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Returning 404 to user: Instance 15942639-9b2d-4a9b-a09f-2040d775466f could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:13.272684 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3b73249a-4879-4de5-885c-f5c87a2030c7 tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f" status: 404 len: 111 microversion: 2.1 time: 0.066316 Jul 26 14:13:13.277812 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 898/1939] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:13 2022] GET /compute/v2.1/servers/15942639-9b2d-4a9b-a09f-2040d775466f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:13:13.379119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d756130c-7681-4903-b5d3-ce353a4c2c0e req-ac3b3476-b7e7-4be3-b2b5-2dbf6437acb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15942639-9b2d-4a9b-a09f-2040d775466f", "name": "network-vif-deleted", "tag": "9cfd3f06-7413-4c82-a6b1-861310d05144"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:13.401763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d756130c-7681-4903-b5d3-ce353a4c2c0e req-ac3b3476-b7e7-4be3-b2b5-2dbf6437acb5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:13.403176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d756130c-7681-4903-b5d3-ce353a4c2c0e req-ac3b3476-b7e7-4be3-b2b5-2dbf6437acb5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:13.436933 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d756130c-7681-4903-b5d3-ce353a4c2c0e req-ac3b3476-b7e7-4be3-b2b5-2dbf6437acb5 service nova] Creating event network-vif-deleted:9cfd3f06-7413-4c82-a6b1-861310d05144 for instance 15942639-9b2d-4a9b-a09f-2040d775466f on n-h1-833090-9 Jul 26 14:13:13.444479 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d756130c-7681-4903-b5d3-ce353a4c2c0e req-ac3b3476-b7e7-4be3-b2b5-2dbf6437acb5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165248 Jul 26 14:13:13.445609 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 899/1940] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:13.461317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3cd06ec4-4afb-4c2e-a609-bbc3bac4b8cd req-d699d884-3419-43ed-817a-83d7ac2d1105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "tag": "1b9b8b4a-4059-4dc5-8338-240b5735b517"}, {"name": "network-changed", "server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "tag": "03fd6db5-e279-44da-b87e-1092a3814c97"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:13.481101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3cd06ec4-4afb-4c2e-a609-bbc3bac4b8cd req-d699d884-3419-43ed-817a-83d7ac2d1105 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:13.482652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3cd06ec4-4afb-4c2e-a609-bbc3bac4b8cd req-d699d884-3419-43ed-817a-83d7ac2d1105 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:13.502867 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3cd06ec4-4afb-4c2e-a609-bbc3bac4b8cd req-d699d884-3419-43ed-817a-83d7ac2d1105 service nova] Creating event network-changed:1b9b8b4a-4059-4dc5-8338-240b5735b517 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:13:13.504161 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3cd06ec4-4afb-4c2e-a609-bbc3bac4b8cd req-d699d884-3419-43ed-817a-83d7ac2d1105 service nova] Creating event network-changed:03fd6db5-e279-44da-b87e-1092a3814c97 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:13:13.512901 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3cd06ec4-4afb-4c2e-a609-bbc3bac4b8cd req-d699d884-3419-43ed-817a-83d7ac2d1105 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.064153 Jul 26 14:13:13.514456 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 900/1941] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:13.521256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-26f11028-78c8-4851-a28a-21ea68db671a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:13.522667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-26f11028-78c8-4851-a28a-21ea68db671a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:13.552679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26f11028-78c8-4851-a28a-21ea68db671a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:13.554445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26f11028-78c8-4851-a28a-21ea68db671a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:13.556508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26f11028-78c8-4851-a28a-21ea68db671a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:13.557108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26f11028-78c8-4851-a28a-21ea68db671a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:13.869534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bf06c06b-e604-4037-820c-c2c1e3282763 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:13.882898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bf06c06b-e604-4037-820c-c2c1e3282763 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:13.888256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bf06c06b-e604-4037-820c-c2c1e3282763 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:13.891441 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bf06c06b-e604-4037-820c-c2c1e3282763 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.913241 Jul 26 14:13:13.893045 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1042/1942] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:12 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:13.913907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73800181-bdf0-4954-b25c-2d8f3e4240ae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:13.915756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-73800181-bdf0-4954-b25c-2d8f3e4240ae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:13.939568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73800181-bdf0-4954-b25c-2d8f3e4240ae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:13.944993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73800181-bdf0-4954-b25c-2d8f3e4240ae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:13.946816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73800181-bdf0-4954-b25c-2d8f3e4240ae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:13.948296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73800181-bdf0-4954-b25c-2d8f3e4240ae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:14.173824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-26f11028-78c8-4851-a28a-21ea68db671a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:14.223044 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-26f11028-78c8-4851-a28a-21ea68db671a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.706357 Jul 26 14:13:14.224110 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 901/1943] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:13 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:14.235245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-17b230ee-4b18-40f9-a683-e73b8358f17d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] Calling method '.version_select at 0x7f8787c170d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:14.266843 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-17b230ee-4b18-40f9-a683-e73b8358f17d tempest-ServersTestManualDisk-260183642 tempest-ServersTestManualDisk-260183642-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575127407" status: 202 len: 0 microversion: 2.1 time: 0.039688 Jul 26 14:13:14.267907 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 902/1944] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Jul 26 14:13:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575127407 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:13:14.274363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-66822ea4-dd5c-46d7-801c-6cdefa9a441f req-7f28484d-8ea5-4184-ba69-bafbe5ff1ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b84552b-8ea2-4d88-b72d-8f8547cd9f9c", "name": "network-vif-plugged", "status": "completed", "tag": "643af9ca-999a-4ed7-8769-8e923e01a843"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:14.286639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-66822ea4-dd5c-46d7-801c-6cdefa9a441f req-7f28484d-8ea5-4184-ba69-bafbe5ff1ef9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:14.287426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-66822ea4-dd5c-46d7-801c-6cdefa9a441f req-7f28484d-8ea5-4184-ba69-bafbe5ff1ef9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:14.305195 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-66822ea4-dd5c-46d7-801c-6cdefa9a441f req-7f28484d-8ea5-4184-ba69-bafbe5ff1ef9 service nova] Creating event network-vif-plugged:643af9ca-999a-4ed7-8769-8e923e01a843 for instance 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c on n-h1-833090-9 Jul 26 14:13:14.313675 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-66822ea4-dd5c-46d7-801c-6cdefa9a441f req-7f28484d-8ea5-4184-ba69-bafbe5ff1ef9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043806 Jul 26 14:13:14.314604 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 903/1945] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:14.325843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dcb7252c-827e-4548-b878-8d7927266bc2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:14.327100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dcb7252c-827e-4548-b878-8d7927266bc2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:14.337645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcb7252c-827e-4548-b878-8d7927266bc2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:14.338595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcb7252c-827e-4548-b878-8d7927266bc2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:14.340669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcb7252c-827e-4548-b878-8d7927266bc2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:14.341678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcb7252c-827e-4548-b878-8d7927266bc2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:14.509167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-73800181-bdf0-4954-b25c-2d8f3e4240ae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:14.522972 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-73800181-bdf0-4954-b25c-2d8f3e4240ae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1317 microversion: 2.1 time: 0.627065 Jul 26 14:13:14.528386 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1043/1946] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:13 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:14.542640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb54216c-d27d-4492-8dd8-cf447961315b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:14.552503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cb54216c-d27d-4492-8dd8-cf447961315b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:14.564660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb54216c-d27d-4492-8dd8-cf447961315b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:14.565583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb54216c-d27d-4492-8dd8-cf447961315b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:14.566633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb54216c-d27d-4492-8dd8-cf447961315b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:14.567507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb54216c-d27d-4492-8dd8-cf447961315b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:15.235697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cb54216c-d27d-4492-8dd8-cf447961315b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:15.259907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dcb7252c-827e-4548-b878-8d7927266bc2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:15.274424 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cb54216c-d27d-4492-8dd8-cf447961315b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1313 microversion: 2.1 time: 0.738007 Jul 26 14:13:15.282203 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1044/1947] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:14 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1313 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:15.288360 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dcb7252c-827e-4548-b878-8d7927266bc2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1307 microversion: 2.1 time: 0.972039 Jul 26 14:13:15.300401 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 904/1948] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:14 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1307 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:15.307048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32eccc91-67d3-41ea-94b9-0cdf07736718 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:15.309003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32eccc91-67d3-41ea-94b9-0cdf07736718 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:15.315154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71c66e0a-7fb2-4a69-83ee-a259d3c723c4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:15.329362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-71c66e0a-7fb2-4a69-83ee-a259d3c723c4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:15.349553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32eccc91-67d3-41ea-94b9-0cdf07736718 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:15.350951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32eccc91-67d3-41ea-94b9-0cdf07736718 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:15.356155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32eccc91-67d3-41ea-94b9-0cdf07736718 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:15.357580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32eccc91-67d3-41ea-94b9-0cdf07736718 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:15.370555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71c66e0a-7fb2-4a69-83ee-a259d3c723c4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:15.371338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71c66e0a-7fb2-4a69-83ee-a259d3c723c4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:15.372762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71c66e0a-7fb2-4a69-83ee-a259d3c723c4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:15.373522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71c66e0a-7fb2-4a69-83ee-a259d3c723c4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:15.700723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:15.746431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=20 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:16.065727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-71c66e0a-7fb2-4a69-83ee-a259d3c723c4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:16.081906 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-71c66e0a-7fb2-4a69-83ee-a259d3c723c4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.779532 Jul 26 14:13:16.088099 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 905/1949] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:15 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:16.098654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-531b0013-36f8-42cd-816c-efa061aa2d0e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:16.099831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-531b0013-36f8-42cd-816c-efa061aa2d0e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:16.125517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-531b0013-36f8-42cd-816c-efa061aa2d0e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:16.129449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-531b0013-36f8-42cd-816c-efa061aa2d0e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:16.130981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-531b0013-36f8-42cd-816c-efa061aa2d0e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:16.132630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-531b0013-36f8-42cd-816c-efa061aa2d0e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:16.239143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32eccc91-67d3-41ea-94b9-0cdf07736718 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:16.269271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32eccc91-67d3-41ea-94b9-0cdf07736718 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:16.282283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32eccc91-67d3-41ea-94b9-0cdf07736718 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:16.286432 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-32eccc91-67d3-41ea-94b9-0cdf07736718 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 1.002011 Jul 26 14:13:16.329250 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1045/1950] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:15 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:16.348219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-643c988d-6cf1-4417-b62e-efb9adaa7839 req-c389b728-4ce9-4682-813d-ca3e4c99e88d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "tag": "f0e1d62c-bfec-42d3-88e2-91a796c3c780"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:16.392837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-643c988d-6cf1-4417-b62e-efb9adaa7839 req-c389b728-4ce9-4682-813d-ca3e4c99e88d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:16.394213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-643c988d-6cf1-4417-b62e-efb9adaa7839 req-c389b728-4ce9-4682-813d-ca3e4c99e88d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:16.438007 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-643c988d-6cf1-4417-b62e-efb9adaa7839 req-c389b728-4ce9-4682-813d-ca3e4c99e88d service nova] Creating event network-changed:f0e1d62c-bfec-42d3-88e2-91a796c3c780 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:13:16.458775 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-643c988d-6cf1-4417-b62e-efb9adaa7839 req-c389b728-4ce9-4682-813d-ca3e4c99e88d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125596 Jul 26 14:13:16.460945 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1046/1951] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:16.477990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5dfe1129-22be-4fb9-87e2-06f12b5da85d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:16.500203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5dfe1129-22be-4fb9-87e2-06f12b5da85d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:16.534717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5dfe1129-22be-4fb9-87e2-06f12b5da85d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:16.535982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5dfe1129-22be-4fb9-87e2-06f12b5da85d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:16.538491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5dfe1129-22be-4fb9-87e2-06f12b5da85d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:16.544207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5dfe1129-22be-4fb9-87e2-06f12b5da85d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:16.605496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-531b0013-36f8-42cd-816c-efa061aa2d0e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:16.653316 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-531b0013-36f8-42cd-816c-efa061aa2d0e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1317 microversion: 2.1 time: 0.563510 Jul 26 14:13:16.660679 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 906/1952] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:16 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:16.696420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-405761a6-a63d-4ab4-9c79-f14567fc3450 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:16.697365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-405761a6-a63d-4ab4-9c79-f14567fc3450 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:16.714436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-405761a6-a63d-4ab4-9c79-f14567fc3450 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:16.715022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-405761a6-a63d-4ab4-9c79-f14567fc3450 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:16.715928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-405761a6-a63d-4ab4-9c79-f14567fc3450 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:16.716525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-405761a6-a63d-4ab4-9c79-f14567fc3450 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:16.971580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5dfe1129-22be-4fb9-87e2-06f12b5da85d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:17.006675 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5dfe1129-22be-4fb9-87e2-06f12b5da85d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1498 microversion: 2.1 time: 0.543223 Jul 26 14:13:17.007410 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1047/1953] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:16 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1498 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:17.016527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-405761a6-a63d-4ab4-9c79-f14567fc3450 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:17.028324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1be2cc20-defb-4075-859a-71ecd5b90acc req-32520215-03a8-466a-bfbe-4c0678c63a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d63bc9c-464d-40bc-84f1-ffc106ed6cb7", "name": "network-vif-plugged", "status": "completed", "tag": "67ed775a-ab8d-4693-bb98-f833fe4899fa"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:17.036563 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-405761a6-a63d-4ab4-9c79-f14567fc3450 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1307 microversion: 2.1 time: 0.374079 Jul 26 14:13:17.037424 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 907/1954] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:16 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:17.067476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-676264f6-d546-4a66-8aa5-60d25c07d887 req-352708b6-895b-4db6-8741-d7625bfff9ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e40948-c72a-4e90-9db3-6302b9e8379e", "tag": "41c76448-f119-45e8-8ebf-cadbcb9e78c6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:17.081268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1be2cc20-defb-4075-859a-71ecd5b90acc req-32520215-03a8-466a-bfbe-4c0678c63a90 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:17.082529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1be2cc20-defb-4075-859a-71ecd5b90acc req-32520215-03a8-466a-bfbe-4c0678c63a90 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:17.099027 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1be2cc20-defb-4075-859a-71ecd5b90acc req-32520215-03a8-466a-bfbe-4c0678c63a90 service nova] Creating event network-vif-plugged:67ed775a-ab8d-4693-bb98-f833fe4899fa for instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 on n-h2-833090-9 Jul 26 14:13:17.104236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-676264f6-d546-4a66-8aa5-60d25c07d887 req-352708b6-895b-4db6-8741-d7625bfff9ac service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:17.104749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-676264f6-d546-4a66-8aa5-60d25c07d887 req-352708b6-895b-4db6-8741-d7625bfff9ac service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:17.110402 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1be2cc20-defb-4075-859a-71ecd5b90acc req-32520215-03a8-466a-bfbe-4c0678c63a90 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096625 Jul 26 14:13:17.112336 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1048/1955] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:17.120964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-471e180c-6241-4413-9bad-6d133c56ebd8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:17.127531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-471e180c-6241-4413-9bad-6d133c56ebd8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:17.136290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-471e180c-6241-4413-9bad-6d133c56ebd8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:17.138015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-471e180c-6241-4413-9bad-6d133c56ebd8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:17.139010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-471e180c-6241-4413-9bad-6d133c56ebd8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:17.139638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-471e180c-6241-4413-9bad-6d133c56ebd8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:17.144845 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-676264f6-d546-4a66-8aa5-60d25c07d887 req-352708b6-895b-4db6-8741-d7625bfff9ac service nova] Creating event network-changed:41c76448-f119-45e8-8ebf-cadbcb9e78c6 for instance 02e40948-c72a-4e90-9db3-6302b9e8379e on n-h1-833090-9 Jul 26 14:13:17.167415 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-676264f6-d546-4a66-8aa5-60d25c07d887 req-352708b6-895b-4db6-8741-d7625bfff9ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110167 Jul 26 14:13:17.169355 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 908/1956] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:17.200309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e31d9404-403b-4200-ba2a-dd4cecd53cd8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:17.201790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e31d9404-403b-4200-ba2a-dd4cecd53cd8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:17.216327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31d9404-403b-4200-ba2a-dd4cecd53cd8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:17.218441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31d9404-403b-4200-ba2a-dd4cecd53cd8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:17.219507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31d9404-403b-4200-ba2a-dd4cecd53cd8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:17.220180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31d9404-403b-4200-ba2a-dd4cecd53cd8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:17.229997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-471e180c-6241-4413-9bad-6d133c56ebd8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lazy-loading 'flavor' on Instance uuid 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:13:17.247223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:17.322907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:17.503148 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-471e180c-6241-4413-9bad-6d133c56ebd8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "POST /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c/action" status: 200 len: 32 microversion: 2.1 time: 0.388776 Jul 26 14:13:17.504737 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1049/1957] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:13:17 2022] POST /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c/action => generated 32 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:13:17.520801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-68e2ccbb-8489-4563-9fdd-5226309130db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:17.522661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-68e2ccbb-8489-4563-9fdd-5226309130db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:17.535205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68e2ccbb-8489-4563-9fdd-5226309130db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:17.537846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68e2ccbb-8489-4563-9fdd-5226309130db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:17.539552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68e2ccbb-8489-4563-9fdd-5226309130db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:17.541853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68e2ccbb-8489-4563-9fdd-5226309130db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:18.143717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e31d9404-403b-4200-ba2a-dd4cecd53cd8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:18.160967 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e31d9404-403b-4200-ba2a-dd4cecd53cd8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.990103 Jul 26 14:13:18.162213 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 909/1958] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:17 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:18.169877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d01f9209-5d7d-484e-87a4-ebf67fbf2f9c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:18.173448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d01f9209-5d7d-484e-87a4-ebf67fbf2f9c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:18.188819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d01f9209-5d7d-484e-87a4-ebf67fbf2f9c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:18.189575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d01f9209-5d7d-484e-87a4-ebf67fbf2f9c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:18.190579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d01f9209-5d7d-484e-87a4-ebf67fbf2f9c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:18.191191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d01f9209-5d7d-484e-87a4-ebf67fbf2f9c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:18.344702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-68e2ccbb-8489-4563-9fdd-5226309130db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:18.356379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-68e2ccbb-8489-4563-9fdd-5226309130db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:18.361000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-68e2ccbb-8489-4563-9fdd-5226309130db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:18.363298 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-68e2ccbb-8489-4563-9fdd-5226309130db tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.848323 Jul 26 14:13:18.365011 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1050/1959] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:17 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:18.372414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae30173d-5ea9-442b-96bb-1c03e8f837d5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:18.375063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ae30173d-5ea9-442b-96bb-1c03e8f837d5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:18.384369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae30173d-5ea9-442b-96bb-1c03e8f837d5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:18.384929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae30173d-5ea9-442b-96bb-1c03e8f837d5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:18.385817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae30173d-5ea9-442b-96bb-1c03e8f837d5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:18.386405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae30173d-5ea9-442b-96bb-1c03e8f837d5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:18.727232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ae30173d-5ea9-442b-96bb-1c03e8f837d5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:18.749842 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ae30173d-5ea9-442b-96bb-1c03e8f837d5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1317 microversion: 2.1 time: 0.379648 Jul 26 14:13:18.750992 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1051/1960] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:18 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:18.767067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8cc45582-d49c-480c-9da3-9e7dc7999b7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:18.778518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8cc45582-d49c-480c-9da3-9e7dc7999b7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:18.788271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cc45582-d49c-480c-9da3-9e7dc7999b7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:18.789250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cc45582-d49c-480c-9da3-9e7dc7999b7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:18.790961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cc45582-d49c-480c-9da3-9e7dc7999b7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:18.792128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cc45582-d49c-480c-9da3-9e7dc7999b7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:19.114284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d01f9209-5d7d-484e-87a4-ebf67fbf2f9c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:19.130478 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d01f9209-5d7d-484e-87a4-ebf67fbf2f9c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.966715 Jul 26 14:13:19.148990 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 910/1961] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:18 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:19.192678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f07e6ba8-0881-4ad6-8946-f28487299c05 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:19.201346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f07e6ba8-0881-4ad6-8946-f28487299c05 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:19.216734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f07e6ba8-0881-4ad6-8946-f28487299c05 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:19.217481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f07e6ba8-0881-4ad6-8946-f28487299c05 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:19.218511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f07e6ba8-0881-4ad6-8946-f28487299c05 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:19.225259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f07e6ba8-0881-4ad6-8946-f28487299c05 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:19.348948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8cc45582-d49c-480c-9da3-9e7dc7999b7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:19.363932 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8cc45582-d49c-480c-9da3-9e7dc7999b7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1307 microversion: 2.1 time: 0.604499 Jul 26 14:13:19.393478 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1052/1962] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:18 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1307 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:19.408112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d7479fd1-13f2-46e0-833d-3761df1c4ab7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:19.409099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d7479fd1-13f2-46e0-833d-3761df1c4ab7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:19.416269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7479fd1-13f2-46e0-833d-3761df1c4ab7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:19.417092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7479fd1-13f2-46e0-833d-3761df1c4ab7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:19.418131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7479fd1-13f2-46e0-833d-3761df1c4ab7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:19.418790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7479fd1-13f2-46e0-833d-3761df1c4ab7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:19.599384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f07e6ba8-0881-4ad6-8946-f28487299c05 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:19.609275 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f07e6ba8-0881-4ad6-8946-f28487299c05 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.426013 Jul 26 14:13:19.620964 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 911/1963] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:19 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:19.698169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d7479fd1-13f2-46e0-833d-3761df1c4ab7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:19.709173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d7479fd1-13f2-46e0-833d-3761df1c4ab7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:19.711829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d7479fd1-13f2-46e0-833d-3761df1c4ab7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:19.714253 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d7479fd1-13f2-46e0-833d-3761df1c4ab7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.319535 Jul 26 14:13:19.715437 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1053/1964] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:19 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:19.775878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4c556572-8637-4eba-8327-a3b35e6b02a8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:19.777412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4c556572-8637-4eba-8327-a3b35e6b02a8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:19.784009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c556572-8637-4eba-8327-a3b35e6b02a8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:19.784737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c556572-8637-4eba-8327-a3b35e6b02a8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:19.785929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c556572-8637-4eba-8327-a3b35e6b02a8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:19.786631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c556572-8637-4eba-8327-a3b35e6b02a8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:19.984984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4c556572-8637-4eba-8327-a3b35e6b02a8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:19.996026 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4c556572-8637-4eba-8327-a3b35e6b02a8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1317 microversion: 2.1 time: 0.226551 Jul 26 14:13:19.997270 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 912/1965] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:19 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:20.172279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b75e695d-afd2-47db-ae2a-0e688e579f0e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:20.173144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b75e695d-afd2-47db-ae2a-0e688e579f0e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:20.183447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b75e695d-afd2-47db-ae2a-0e688e579f0e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:20.184515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b75e695d-afd2-47db-ae2a-0e688e579f0e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:20.185793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b75e695d-afd2-47db-ae2a-0e688e579f0e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:20.186338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b75e695d-afd2-47db-ae2a-0e688e579f0e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:20.411133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bf6a143f-a1a4-4e60-ba12-54323d3a8fcb tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:20.414702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bf6a143f-a1a4-4e60-ba12-54323d3a8fcb tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:20.435748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf6a143f-a1a4-4e60-ba12-54323d3a8fcb tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:20.436407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf6a143f-a1a4-4e60-ba12-54323d3a8fcb tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:20.440781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf6a143f-a1a4-4e60-ba12-54323d3a8fcb tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:20.440781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf6a143f-a1a4-4e60-ba12-54323d3a8fcb tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:20.572809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b75e695d-afd2-47db-ae2a-0e688e579f0e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:20.593461 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b75e695d-afd2-47db-ae2a-0e688e579f0e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.422124 Jul 26 14:13:20.594989 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1054/1966] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:20 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:20.634463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6f880d2-c037-4a00-abab-cf266017fec4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:20.635530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e6f880d2-c037-4a00-abab-cf266017fec4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:20.661885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f880d2-c037-4a00-abab-cf266017fec4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:20.684438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f880d2-c037-4a00-abab-cf266017fec4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:20.685976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f880d2-c037-4a00-abab-cf266017fec4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:20.686737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f880d2-c037-4a00-abab-cf266017fec4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:20.985441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bf6a143f-a1a4-4e60-ba12-54323d3a8fcb tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:21.028509 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bf6a143f-a1a4-4e60-ba12-54323d3a8fcb tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1486 microversion: 2.1 time: 0.618474 Jul 26 14:13:21.069055 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 913/1967] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:20 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1486 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:21.085062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1d2fa4b9-4add-416b-a66d-41a05e0449b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:21.088214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1d2fa4b9-4add-416b-a66d-41a05e0449b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:21.104470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d2fa4b9-4add-416b-a66d-41a05e0449b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:21.108716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d2fa4b9-4add-416b-a66d-41a05e0449b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:21.109938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d2fa4b9-4add-416b-a66d-41a05e0449b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:21.113313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d2fa4b9-4add-416b-a66d-41a05e0449b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:21.187824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e6f880d2-c037-4a00-abab-cf266017fec4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:21.227272 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e6f880d2-c037-4a00-abab-cf266017fec4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.597255 Jul 26 14:13:21.229397 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1055/1968] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:20 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:13:21.261492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8cd019ca-b7f8-465b-a2d8-5613cabe21c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:21.263469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8cd019ca-b7f8-465b-a2d8-5613cabe21c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:21.303338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cd019ca-b7f8-465b-a2d8-5613cabe21c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:21.306350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cd019ca-b7f8-465b-a2d8-5613cabe21c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:21.311817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cd019ca-b7f8-465b-a2d8-5613cabe21c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:21.313347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cd019ca-b7f8-465b-a2d8-5613cabe21c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:21.589420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d2fa4b9-4add-416b-a66d-41a05e0449b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:21.602248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d2fa4b9-4add-416b-a66d-41a05e0449b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:21.609293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d2fa4b9-4add-416b-a66d-41a05e0449b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:21.616480 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1d2fa4b9-4add-416b-a66d-41a05e0449b2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.541697 Jul 26 14:13:21.634432 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 914/1969] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:21 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:21.640019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-74125936-ef01-4b0e-84a9-bf2251de0d53 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:21.640902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-74125936-ef01-4b0e-84a9-bf2251de0d53 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:21.654303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74125936-ef01-4b0e-84a9-bf2251de0d53 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:21.655306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74125936-ef01-4b0e-84a9-bf2251de0d53 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:21.657637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74125936-ef01-4b0e-84a9-bf2251de0d53 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:21.659249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74125936-ef01-4b0e-84a9-bf2251de0d53 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:21.780983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8cd019ca-b7f8-465b-a2d8-5613cabe21c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:21.802869 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8cd019ca-b7f8-465b-a2d8-5613cabe21c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1317 microversion: 2.1 time: 0.566724 Jul 26 14:13:21.820993 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1056/1970] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:21 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:21.830535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-28106dd5-fcaa-49c4-af33-cc191bff3ec8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:21.831570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-28106dd5-fcaa-49c4-af33-cc191bff3ec8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:21.839934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28106dd5-fcaa-49c4-af33-cc191bff3ec8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:21.840887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28106dd5-fcaa-49c4-af33-cc191bff3ec8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:21.842267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28106dd5-fcaa-49c4-af33-cc191bff3ec8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:21.843401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28106dd5-fcaa-49c4-af33-cc191bff3ec8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:21.883393 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-74125936-ef01-4b0e-84a9-bf2251de0d53 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7/action" status: 202 len: 0 microversion: 2.1 time: 0.245442 Jul 26 14:13:21.887516 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 915/1971] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:13:21 2022] POST /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:13:21.906551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a309a7ab-76e2-42a7-8ad8-eca897b7dfb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:21.914233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a309a7ab-76e2-42a7-8ad8-eca897b7dfb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:21.939812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a309a7ab-76e2-42a7-8ad8-eca897b7dfb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:21.940769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a309a7ab-76e2-42a7-8ad8-eca897b7dfb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:21.942019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a309a7ab-76e2-42a7-8ad8-eca897b7dfb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:21.943226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a309a7ab-76e2-42a7-8ad8-eca897b7dfb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:22.324304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a309a7ab-76e2-42a7-8ad8-eca897b7dfb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:22.338523 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a309a7ab-76e2-42a7-8ad8-eca897b7dfb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1491 microversion: 2.1 time: 0.444755 Jul 26 14:13:22.370448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-28106dd5-fcaa-49c4-af33-cc191bff3ec8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:22.387727 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-28106dd5-fcaa-49c4-af33-cc191bff3ec8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.564235 Jul 26 14:13:22.389094 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1057/1972] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:21 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:22.391406 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 916/1973] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:21 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1491 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:22.398972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5f8ecdbd-31cf-4448-91d1-4007630b1530 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:22.400114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5f8ecdbd-31cf-4448-91d1-4007630b1530 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:22.408094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f8ecdbd-31cf-4448-91d1-4007630b1530 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:22.409029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f8ecdbd-31cf-4448-91d1-4007630b1530 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:22.410150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f8ecdbd-31cf-4448-91d1-4007630b1530 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:22.412548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f8ecdbd-31cf-4448-91d1-4007630b1530 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:22.649789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b236864-82bb-4657-ae54-22a7285d6730 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:22.653725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b236864-82bb-4657-ae54-22a7285d6730 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:22.667195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5f8ecdbd-31cf-4448-91d1-4007630b1530 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:22.675716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b236864-82bb-4657-ae54-22a7285d6730 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:22.678694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b236864-82bb-4657-ae54-22a7285d6730 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:22.678923 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5f8ecdbd-31cf-4448-91d1-4007630b1530 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.288506 Jul 26 14:13:22.693584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b236864-82bb-4657-ae54-22a7285d6730 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:22.693584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b236864-82bb-4657-ae54-22a7285d6730 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:22.695481 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1058/1974] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:22 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:22.763916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6feefe2f-2332-421f-8bbc-b996330a0895 req-c31655df-047b-4dae-adbe-e72a1d83f61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e40948-c72a-4e90-9db3-6302b9e8379e", "name": "network-vif-plugged", "status": "completed", "tag": "41c76448-f119-45e8-8ebf-cadbcb9e78c6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:22.784562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6feefe2f-2332-421f-8bbc-b996330a0895 req-c31655df-047b-4dae-adbe-e72a1d83f61e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:22.786698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6feefe2f-2332-421f-8bbc-b996330a0895 req-c31655df-047b-4dae-adbe-e72a1d83f61e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:22.816965 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6feefe2f-2332-421f-8bbc-b996330a0895 req-c31655df-047b-4dae-adbe-e72a1d83f61e service nova] Creating event network-vif-plugged:41c76448-f119-45e8-8ebf-cadbcb9e78c6 for instance 02e40948-c72a-4e90-9db3-6302b9e8379e on n-h1-833090-9 Jul 26 14:13:22.827352 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6feefe2f-2332-421f-8bbc-b996330a0895 req-c31655df-047b-4dae-adbe-e72a1d83f61e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068005 Jul 26 14:13:22.841226 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1059/1975] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:22.849017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95e7ff57-776e-483f-a507-c64e79c4b701 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:22.850270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95e7ff57-776e-483f-a507-c64e79c4b701 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:22.858589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e7ff57-776e-483f-a507-c64e79c4b701 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:22.859417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e7ff57-776e-483f-a507-c64e79c4b701 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:22.860653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e7ff57-776e-483f-a507-c64e79c4b701 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:22.861378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e7ff57-776e-483f-a507-c64e79c4b701 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:23.034547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b236864-82bb-4657-ae54-22a7285d6730 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:23.053785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b236864-82bb-4657-ae54-22a7285d6730 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:23.061876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b236864-82bb-4657-ae54-22a7285d6730 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:23.066060 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b236864-82bb-4657-ae54-22a7285d6730 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.426112 Jul 26 14:13:23.088144 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 917/1976] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:22 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:13:23.219657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-95e7ff57-776e-483f-a507-c64e79c4b701 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:23.239565 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95e7ff57-776e-483f-a507-c64e79c4b701 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1317 microversion: 2.1 time: 0.394211 Jul 26 14:13:23.248366 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1060/1977] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:22 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:23.384727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aadbe1f2-2d5e-4da7-ae56-f9cc5ad99661 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:23.386894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aadbe1f2-2d5e-4da7-ae56-f9cc5ad99661 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:23.410598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aadbe1f2-2d5e-4da7-ae56-f9cc5ad99661 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:23.416915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aadbe1f2-2d5e-4da7-ae56-f9cc5ad99661 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:23.420520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1e27237f-7f76-43f6-9466-386be0936bba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:23.421292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1e27237f-7f76-43f6-9466-386be0936bba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:23.421916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aadbe1f2-2d5e-4da7-ae56-f9cc5ad99661 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:23.423393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aadbe1f2-2d5e-4da7-ae56-f9cc5ad99661 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:23.447749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e27237f-7f76-43f6-9466-386be0936bba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:23.448343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e27237f-7f76-43f6-9466-386be0936bba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:23.449518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e27237f-7f76-43f6-9466-386be0936bba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:23.450053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e27237f-7f76-43f6-9466-386be0936bba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:23.819152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aadbe1f2-2d5e-4da7-ae56-f9cc5ad99661 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:23.831172 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aadbe1f2-2d5e-4da7-ae56-f9cc5ad99661 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 200 len: 1471 microversion: 2.1 time: 0.457819 Jul 26 14:13:23.836559 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 918/1978] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:23 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 1471 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:23.841787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7fbb21c5-9d5c-4fa8-a24d-945cb810efcc tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:23.843385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7fbb21c5-9d5c-4fa8-a24d-945cb810efcc tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:23.851733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fbb21c5-9d5c-4fa8-a24d-945cb810efcc tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:23.852512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fbb21c5-9d5c-4fa8-a24d-945cb810efcc tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:23.853933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fbb21c5-9d5c-4fa8-a24d-945cb810efcc tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:23.855345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fbb21c5-9d5c-4fa8-a24d-945cb810efcc tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:23.956058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1e27237f-7f76-43f6-9466-386be0936bba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:23.984905 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1e27237f-7f76-43f6-9466-386be0936bba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.568574 Jul 26 14:13:24.011862 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1061/1979] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:23 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:24.033353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3547b17d-866e-4f66-9579-ca8e035c5e82 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1513489424"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:24.042416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3547b17d-866e-4f66-9579-ca8e035c5e82 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:24.062128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3547b17d-866e-4f66-9579-ca8e035c5e82 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:24.062808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3547b17d-866e-4f66-9579-ca8e035c5e82 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:24.063783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3547b17d-866e-4f66-9579-ca8e035c5e82 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:24.070275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3547b17d-866e-4f66-9579-ca8e035c5e82 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:24.330424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7fbb21c5-9d5c-4fa8-a24d-945cb810efcc tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:24.352799 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7fbb21c5-9d5c-4fa8-a24d-945cb810efcc tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.514347 Jul 26 14:13:24.358946 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 919/1980] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:23 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:24.367644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d07a6a6-491d-4293-a227-f694c2f36c0e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:24.368851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7d07a6a6-491d-4293-a227-f694c2f36c0e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:24.393980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d07a6a6-491d-4293-a227-f694c2f36c0e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:24.394585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d07a6a6-491d-4293-a227-f694c2f36c0e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:24.397465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d07a6a6-491d-4293-a227-f694c2f36c0e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:24.397465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d07a6a6-491d-4293-a227-f694c2f36c0e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:24.597894 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3547b17d-866e-4f66-9579-ca8e035c5e82 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7/action" status: 202 len: 0 microversion: 2.1 time: 0.583221 Jul 26 14:13:24.604755 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1062/1981] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:13:24 2022] POST /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 14:13:24.606938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b64e3ca4-0eef-4434-86b3-0557c6a0d934 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:24.608748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b64e3ca4-0eef-4434-86b3-0557c6a0d934 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:24.617832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b64e3ca4-0eef-4434-86b3-0557c6a0d934 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:24.618953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b64e3ca4-0eef-4434-86b3-0557c6a0d934 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:24.620051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b64e3ca4-0eef-4434-86b3-0557c6a0d934 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:24.620667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b64e3ca4-0eef-4434-86b3-0557c6a0d934 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:25.185296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b64e3ca4-0eef-4434-86b3-0557c6a0d934 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:25.192863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:25.202987 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b64e3ca4-0eef-4434-86b3-0557c6a0d934 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1317 microversion: 2.1 time: 0.599422 Jul 26 14:13:25.204827 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1063/1982] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:24 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:25.220314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d07a6a6-491d-4293-a227-f694c2f36c0e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:25.234564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09d3c8f7-7638-43e0-9ac8-134d72f1888d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8794346a60>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:25.253014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d07a6a6-491d-4293-a227-f694c2f36c0e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:25.263756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d07a6a6-491d-4293-a227-f694c2f36c0e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:25.277178 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7d07a6a6-491d-4293-a227-f694c2f36c0e tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.916740 Jul 26 14:13:25.277792 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 920/1983] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:24 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:25.311205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6dbc2d8b-0248-4766-bd2a-e85ea8ddcb8f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:25.315351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6dbc2d8b-0248-4766-bd2a-e85ea8ddcb8f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:25.340806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dbc2d8b-0248-4766-bd2a-e85ea8ddcb8f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:25.341489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dbc2d8b-0248-4766-bd2a-e85ea8ddcb8f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:25.342827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dbc2d8b-0248-4766-bd2a-e85ea8ddcb8f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:25.343676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dbc2d8b-0248-4766-bd2a-e85ea8ddcb8f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:25.368923 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-09d3c8f7-7638-43e0-9ac8-134d72f1888d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.156221 Jul 26 14:13:25.373208 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1064/1984] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:25 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:25.392628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f8a6b721-ca5f-4b31-8cfe-f5d5bb4ca539 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:25.397350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f8a6b721-ca5f-4b31-8cfe-f5d5bb4ca539 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:25.412968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8a6b721-ca5f-4b31-8cfe-f5d5bb4ca539 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:25.416553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8a6b721-ca5f-4b31-8cfe-f5d5bb4ca539 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:25.419721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8a6b721-ca5f-4b31-8cfe-f5d5bb4ca539 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:25.421217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8a6b721-ca5f-4b31-8cfe-f5d5bb4ca539 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:26.259490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6dbc2d8b-0248-4766-bd2a-e85ea8ddcb8f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:26.284164 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6dbc2d8b-0248-4766-bd2a-e85ea8ddcb8f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.981163 Jul 26 14:13:26.289063 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 921/1985] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:25 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:26.297626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-524dfcdf-8ec4-4d18-b264-44a75168c4f6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:26.299040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-524dfcdf-8ec4-4d18-b264-44a75168c4f6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:26.301597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f8a6b721-ca5f-4b31-8cfe-f5d5bb4ca539 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:26.311618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-524dfcdf-8ec4-4d18-b264-44a75168c4f6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:26.312431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-524dfcdf-8ec4-4d18-b264-44a75168c4f6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:26.313643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-524dfcdf-8ec4-4d18-b264-44a75168c4f6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:26.314395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-524dfcdf-8ec4-4d18-b264-44a75168c4f6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:26.316045 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f8a6b721-ca5f-4b31-8cfe-f5d5bb4ca539 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.933240 Jul 26 14:13:26.320768 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1065/1986] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:25 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:13:26.359260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0b66a5d-8a4d-4ace-9d6d-c3950bd86cda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:26.360884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a0b66a5d-8a4d-4ace-9d6d-c3950bd86cda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:26.390746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0b66a5d-8a4d-4ace-9d6d-c3950bd86cda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:26.391884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0b66a5d-8a4d-4ace-9d6d-c3950bd86cda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:26.394004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0b66a5d-8a4d-4ace-9d6d-c3950bd86cda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:26.394739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0b66a5d-8a4d-4ace-9d6d-c3950bd86cda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:27.363572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-524dfcdf-8ec4-4d18-b264-44a75168c4f6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:27.367105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0b66a5d-8a4d-4ace-9d6d-c3950bd86cda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:27.380608 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-524dfcdf-8ec4-4d18-b264-44a75168c4f6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1506 microversion: 2.1 time: 1.089206 Jul 26 14:13:27.387133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0b66a5d-8a4d-4ace-9d6d-c3950bd86cda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:27.394269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0b66a5d-8a4d-4ace-9d6d-c3950bd86cda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:27.397431 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 922/1987] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:26 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1506 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:27.419777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-667b97dd-213c-4564-9a5f-60fa96fe56ec tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787e8f550>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:27.420854 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a0b66a5d-8a4d-4ace-9d6d-c3950bd86cda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 1.067343 Jul 26 14:13:27.435697 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1066/1988] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:26 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:27.449641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9091973a-111b-41d4-be54-a93e05ac0fb7 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:27.450934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9091973a-111b-41d4-be54-a93e05ac0fb7 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:27.483625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9091973a-111b-41d4-be54-a93e05ac0fb7 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:27.490327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9091973a-111b-41d4-be54-a93e05ac0fb7 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:27.492548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9091973a-111b-41d4-be54-a93e05ac0fb7 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:27.493341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9091973a-111b-41d4-be54-a93e05ac0fb7 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:27.537193 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-667b97dd-213c-4564-9a5f-60fa96fe56ec tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.127154 Jul 26 14:13:27.539779 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 923/1989] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:27 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:27.554412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e8614d26-e33c-414e-b2ba-d31915349ff1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:27.555654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e8614d26-e33c-414e-b2ba-d31915349ff1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:27.575510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8614d26-e33c-414e-b2ba-d31915349ff1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:27.576233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8614d26-e33c-414e-b2ba-d31915349ff1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:27.577569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8614d26-e33c-414e-b2ba-d31915349ff1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:27.578673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8614d26-e33c-414e-b2ba-d31915349ff1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:28.057514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9091973a-111b-41d4-be54-a93e05ac0fb7 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:28.066868 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9091973a-111b-41d4-be54-a93e05ac0fb7 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.627372 Jul 26 14:13:28.073099 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1067/1990] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:27 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:28.087140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2dc41f58-0ee2-4cd6-ab11-bd8e7d1c042a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:28.089831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2dc41f58-0ee2-4cd6-ab11-bd8e7d1c042a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:28.106597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2dc41f58-0ee2-4cd6-ab11-bd8e7d1c042a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:28.109384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2dc41f58-0ee2-4cd6-ab11-bd8e7d1c042a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:28.110397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2dc41f58-0ee2-4cd6-ab11-bd8e7d1c042a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:28.111091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2dc41f58-0ee2-4cd6-ab11-bd8e7d1c042a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:28.141803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e8614d26-e33c-414e-b2ba-d31915349ff1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:28.165168 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e8614d26-e33c-414e-b2ba-d31915349ff1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.623657 Jul 26 14:13:28.168475 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 924/1991] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:27 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:28.203210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2dc41f58-0ee2-4cd6-ab11-bd8e7d1c042a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:13:28.457811 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2dc41f58-0ee2-4cd6-ab11-bd8e7d1c042a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "DELETE /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 204 len: 0 microversion: 2.1 time: 0.375904 Jul 26 14:13:28.463264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64a9f33c-86c9-4ab7-8ace-72a99685e692 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:28.464078 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1068/1992] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:13:28 2022] DELETE /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:13:28.464325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-64a9f33c-86c9-4ab7-8ace-72a99685e692 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:28.478191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64a9f33c-86c9-4ab7-8ace-72a99685e692 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:28.480262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64a9f33c-86c9-4ab7-8ace-72a99685e692 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:28.483803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64a9f33c-86c9-4ab7-8ace-72a99685e692 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:28.484440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64a9f33c-86c9-4ab7-8ace-72a99685e692 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:28.485027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f4550b99-c7be-4304-9d08-7343eafc2fbb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:28.488472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f4550b99-c7be-4304-9d08-7343eafc2fbb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:28.522880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4550b99-c7be-4304-9d08-7343eafc2fbb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:28.523524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4550b99-c7be-4304-9d08-7343eafc2fbb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:28.526817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4550b99-c7be-4304-9d08-7343eafc2fbb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:28.536901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4550b99-c7be-4304-9d08-7343eafc2fbb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:28.999891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64a9f33c-86c9-4ab7-8ace-72a99685e692 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:29.005407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:29.025947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64a9f33c-86c9-4ab7-8ace-72a99685e692 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:29.028236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64a9f33c-86c9-4ab7-8ace-72a99685e692 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:29.032896 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64a9f33c-86c9-4ab7-8ace-72a99685e692 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.574530 Jul 26 14:13:29.041119 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 925/1993] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:28 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:29.046550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e5dd8443-4cbe-45f2-9648-888919db266a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787b8cb80>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:29.146348 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e5dd8443-4cbe-45f2-9648-888919db266a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.103730 Jul 26 14:13:29.146939 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 926/1994] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:29 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:29.156626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c05a3815-3b6d-42bb-ba65-8aae0d8602cc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:29.157698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c05a3815-3b6d-42bb-ba65-8aae0d8602cc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:29.177424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c05a3815-3b6d-42bb-ba65-8aae0d8602cc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:29.179631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c05a3815-3b6d-42bb-ba65-8aae0d8602cc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:29.184829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c05a3815-3b6d-42bb-ba65-8aae0d8602cc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:29.185790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c05a3815-3b6d-42bb-ba65-8aae0d8602cc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:29.246087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f4550b99-c7be-4304-9d08-7343eafc2fbb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:29.259996 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f4550b99-c7be-4304-9d08-7343eafc2fbb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1512 microversion: 2.1 time: 0.790201 Jul 26 14:13:29.260927 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1069/1995] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:28 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1512 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:29.278904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4abd68eb-7258-4fe7-9039-b25ffe8c4aad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:29.279540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4abd68eb-7258-4fe7-9039-b25ffe8c4aad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:29.298705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4abd68eb-7258-4fe7-9039-b25ffe8c4aad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:29.299182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4abd68eb-7258-4fe7-9039-b25ffe8c4aad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:29.305648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4abd68eb-7258-4fe7-9039-b25ffe8c4aad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:29.306205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4abd68eb-7258-4fe7-9039-b25ffe8c4aad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:29.756490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4abd68eb-7258-4fe7-9039-b25ffe8c4aad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:29.770375 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4abd68eb-7258-4fe7-9039-b25ffe8c4aad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.507403 Jul 26 14:13:29.788807 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1070/1996] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:29 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:29.801389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c05a3815-3b6d-42bb-ba65-8aae0d8602cc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:29.823540 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c05a3815-3b6d-42bb-ba65-8aae0d8602cc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.674577 Jul 26 14:13:29.825453 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 927/1997] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:29 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:30.092854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c52b1b31-c51b-4f8e-9f71-e166de847861 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:30.094067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c52b1b31-c51b-4f8e-9f71-e166de847861 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:30.115675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c52b1b31-c51b-4f8e-9f71-e166de847861 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:30.119281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c52b1b31-c51b-4f8e-9f71-e166de847861 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:30.121505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c52b1b31-c51b-4f8e-9f71-e166de847861 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:30.124314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c52b1b31-c51b-4f8e-9f71-e166de847861 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:30.169184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9eadc445-1b9b-4336-b1b1-66cb194fb6d5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787b8a700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:30.282515 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9eadc445-1b9b-4336-b1b1-66cb194fb6d5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.117565 Jul 26 14:13:30.284030 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 928/1998] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:30 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:13:30.294636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-58020d3c-a29c-4cf3-bffb-fb49d44a79c3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:30.298892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-58020d3c-a29c-4cf3-bffb-fb49d44a79c3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:30.323174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58020d3c-a29c-4cf3-bffb-fb49d44a79c3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:30.324195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58020d3c-a29c-4cf3-bffb-fb49d44a79c3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:30.325233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58020d3c-a29c-4cf3-bffb-fb49d44a79c3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:30.325938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58020d3c-a29c-4cf3-bffb-fb49d44a79c3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:30.749591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c52b1b31-c51b-4f8e-9f71-e166de847861 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:30.791386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c52b1b31-c51b-4f8e-9f71-e166de847861 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:30.804242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c52b1b31-c51b-4f8e-9f71-e166de847861 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:30.805965 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c52b1b31-c51b-4f8e-9f71-e166de847861 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.718959 Jul 26 14:13:30.807147 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1071/1999] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:30 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:13:30.812214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1c3443dc-5daf-4b4f-b10f-0530bf9be359 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:30.818775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1c3443dc-5daf-4b4f-b10f-0530bf9be359 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:30.836856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c3443dc-5daf-4b4f-b10f-0530bf9be359 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:30.837702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c3443dc-5daf-4b4f-b10f-0530bf9be359 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:30.839131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c3443dc-5daf-4b4f-b10f-0530bf9be359 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:30.841905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c3443dc-5daf-4b4f-b10f-0530bf9be359 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:30.870169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-58020d3c-a29c-4cf3-bffb-fb49d44a79c3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:30.890279 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-58020d3c-a29c-4cf3-bffb-fb49d44a79c3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1512 microversion: 2.1 time: 0.604839 Jul 26 14:13:30.890969 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 929/2000] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:30 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1512 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:30.907166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7ac0a40-c34e-4e14-a086-e277f9a1069b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:30.907860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f7ac0a40-c34e-4e14-a086-e277f9a1069b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:30.942817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7ac0a40-c34e-4e14-a086-e277f9a1069b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:30.949385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7ac0a40-c34e-4e14-a086-e277f9a1069b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:30.955120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7ac0a40-c34e-4e14-a086-e277f9a1069b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:30.955596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7ac0a40-c34e-4e14-a086-e277f9a1069b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:31.651390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1c3443dc-5daf-4b4f-b10f-0530bf9be359 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:31.685188 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1c3443dc-5daf-4b4f-b10f-0530bf9be359 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.856396 Jul 26 14:13:31.688094 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1072/2001] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:30 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:31.700590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e8e24684-a0f9-44bd-b57d-45bb73e9a732 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787f8c4c0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:31.920083 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e8e24684-a0f9-44bd-b57d-45bb73e9a732 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.230626 Jul 26 14:13:31.933417 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1073/2002] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:31 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:31.953941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ad5c800-3565-4300-a0e1-52449bc04f9f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:31.954572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2ad5c800-3565-4300-a0e1-52449bc04f9f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:31.967348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f7ac0a40-c34e-4e14-a086-e277f9a1069b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:31.983107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ad5c800-3565-4300-a0e1-52449bc04f9f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:31.983574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ad5c800-3565-4300-a0e1-52449bc04f9f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:31.985242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ad5c800-3565-4300-a0e1-52449bc04f9f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:31.988654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ad5c800-3565-4300-a0e1-52449bc04f9f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:32.036869 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7ac0a40-c34e-4e14-a086-e277f9a1069b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 1.136596 Jul 26 14:13:32.057384 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 930/2003] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:30 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:32.110831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7e25382c-f982-4250-abf4-6c3101eebc63 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:32.122690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7e25382c-f982-4250-abf4-6c3101eebc63 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:32.180755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e25382c-f982-4250-abf4-6c3101eebc63 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:32.182325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e25382c-f982-4250-abf4-6c3101eebc63 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:32.183928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e25382c-f982-4250-abf4-6c3101eebc63 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:32.192758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e25382c-f982-4250-abf4-6c3101eebc63 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:32.886658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7e25382c-f982-4250-abf4-6c3101eebc63 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:32.902304 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7e25382c-f982-4250-abf4-6c3101eebc63 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 200 len: 1470 microversion: 2.1 time: 0.841195 Jul 26 14:13:32.931183 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 931/2004] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:32 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 1470 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:32.976829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-1baf822d-647e-4f52-b061-86e878d00b41 req-f28180f7-5fda-4ce5-8ad4-055fa0a4941f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e40948-c72a-4e90-9db3-6302b9e8379e", "name": "network-vif-deleted", "tag": "41c76448-f119-45e8-8ebf-cadbcb9e78c6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:33.030912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:33.042140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1baf822d-647e-4f52-b061-86e878d00b41 req-f28180f7-5fda-4ce5-8ad4-055fa0a4941f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:33.044877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1baf822d-647e-4f52-b061-86e878d00b41 req-f28180f7-5fda-4ce5-8ad4-055fa0a4941f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:33.128045 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-1baf822d-647e-4f52-b061-86e878d00b41 req-f28180f7-5fda-4ce5-8ad4-055fa0a4941f service nova] Creating event network-vif-deleted:41c76448-f119-45e8-8ebf-cadbcb9e78c6 for instance 02e40948-c72a-4e90-9db3-6302b9e8379e on n-h1-833090-9 Jul 26 14:13:33.142742 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-1baf822d-647e-4f52-b061-86e878d00b41 req-f28180f7-5fda-4ce5-8ad4-055fa0a4941f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207901 Jul 26 14:13:33.146077 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 932/2005] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:33.167000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-24477052-9724-4582-b58f-5d08f9047dc9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:33.171642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-24477052-9724-4582-b58f-5d08f9047dc9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:33.189563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24477052-9724-4582-b58f-5d08f9047dc9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:33.190315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24477052-9724-4582-b58f-5d08f9047dc9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:33.194227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24477052-9724-4582-b58f-5d08f9047dc9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:33.201366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24477052-9724-4582-b58f-5d08f9047dc9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:33.717262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2ad5c800-3565-4300-a0e1-52449bc04f9f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:33.734384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2ad5c800-3565-4300-a0e1-52449bc04f9f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:33.745477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2ad5c800-3565-4300-a0e1-52449bc04f9f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:33.749923 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ad5c800-3565-4300-a0e1-52449bc04f9f tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 1.814686 Jul 26 14:13:33.768731 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1074/2006] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:31 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:33.782099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca650821-ebf6-4ec9-8a88-1c6daa425e0c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787f93790>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:33.892390 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca650821-ebf6-4ec9-8a88-1c6daa425e0c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.117196 Jul 26 14:13:33.901480 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1075/2007] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:33 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:34.056935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-24477052-9724-4582-b58f-5d08f9047dc9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:34.082370 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-24477052-9724-4582-b58f-5d08f9047dc9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.925262 Jul 26 14:13:34.084127 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 933/2008] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:33 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:34.097512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-90ab88dd-cced-48e9-8c00-b0f2fbec1b64 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:34.099515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-90ab88dd-cced-48e9-8c00-b0f2fbec1b64 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:34.134690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90ab88dd-cced-48e9-8c00-b0f2fbec1b64 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:34.136623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90ab88dd-cced-48e9-8c00-b0f2fbec1b64 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:34.137731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90ab88dd-cced-48e9-8c00-b0f2fbec1b64 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:34.141401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90ab88dd-cced-48e9-8c00-b0f2fbec1b64 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:34.290560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c47ef585-5527-45b7-b17a-f39add2e2cb1 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-838864342", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:34.294946 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c47ef585-5527-45b7-b17a-f39add2e2cb1 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] HTTP exception thrown: min_count must be <= max_count Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c47ef585-5527-45b7-b17a-f39add2e2cb1 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Request method failure captured: Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 183 Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_aMEXzcaXxd4PF3dkk9u0pn3MsSoNGocpe3CJTmTYfifQ8Jia-iVCgWmWaLP6X6FGkaEau8w87vBJyV2gopOFdQuidz5HLTI4q_ZsVabVQLU22iZ_Z1Sp-oyCAb3pDYf87Ib1H-UF7yaaSeF4un5Uih2Tqzr5Q2YBSFQ5h0OcARy6I Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4f9fec5a28aa459d9c0c140cf82a5958 Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9fec5a28aa459d9c0c140cf82a5958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4f9fec5a28aa459d9c0c140cf82a5958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4f9fec5a28aa459d9c0c140cf82a5958", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9fec5a28aa459d9c0c140cf82a5958"}]}] Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4f9fec5a28aa459d9c0c140cf82a5958 Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-MultipleCreateNegativeTestJSON-1733626612-project Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e5bbbe0d411d4710a619608a1dce3297 Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1733626612-project Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-838864342", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: exception: min_count must be <= max_count Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-838864342', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 26 14:13:34.310565 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.326868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c47ef585-5527-45b7-b17a-f39add2e2cb1 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Returning 400 to user: min_count must be <= max_count {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:34.328181 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c47ef585-5527-45b7-b17a-f39add2e2cb1 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.425244 Jul 26 14:13:34.329863 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1076/2009] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:33 2022] POST /compute/v2.1/servers => generated 74 bytes in 428 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:13:34.357064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f8f316bd-6e47-4e9d-aaf0-7ec4ecb73f1c req-ec76c4a6-dddc-40de-b1b7-0a6059d6a53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e53966-8644-4b0b-9429-dd23222bb79e", "name": "network-vif-unplugged", "status": "completed", "tag": "d89bd279-7459-4603-9b92-9e0b93981d08"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:34.409666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f8f316bd-6e47-4e9d-aaf0-7ec4ecb73f1c req-ec76c4a6-dddc-40de-b1b7-0a6059d6a53a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:34.410131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f8f316bd-6e47-4e9d-aaf0-7ec4ecb73f1c req-ec76c4a6-dddc-40de-b1b7-0a6059d6a53a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:34.453963 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f8f316bd-6e47-4e9d-aaf0-7ec4ecb73f1c req-ec76c4a6-dddc-40de-b1b7-0a6059d6a53a service nova] Creating event network-vif-unplugged:d89bd279-7459-4603-9b92-9e0b93981d08 for instance c6e53966-8644-4b0b-9429-dd23222bb79e on n-h2-833090-9 Jul 26 14:13:34.473456 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f8f316bd-6e47-4e9d-aaf0-7ec4ecb73f1c req-ec76c4a6-dddc-40de-b1b7-0a6059d6a53a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134505 Jul 26 14:13:34.475394 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1077/2010] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:34.484430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3b7458d-e79d-43a5-a0a9-c49a725df740 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:34.489314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3b7458d-e79d-43a5-a0a9-c49a725df740 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:34.504115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:34.509972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3b7458d-e79d-43a5-a0a9-c49a725df740 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:34.512688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3b7458d-e79d-43a5-a0a9-c49a725df740 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:34.514605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3b7458d-e79d-43a5-a0a9-c49a725df740 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:34.518933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3b7458d-e79d-43a5-a0a9-c49a725df740 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:34.574683 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a3b7458d-e79d-43a5-a0a9-c49a725df740 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3b7458d-e79d-43a5-a0a9-c49a725df740 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e HTTP/1.1 Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '02e40948-c72a-4e90-9db3-6302b9e8379e'} Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:34.577766 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.581965 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:34.581965 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:34.581965 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:34.581965 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:13:34.581965 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:13:34.581965 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:13:34.581965 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.586318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3b7458d-e79d-43a5-a0a9-c49a725df740 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:34.587494 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a3b7458d-e79d-43a5-a0a9-c49a725df740 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 404 len: 111 microversion: 2.1 time: 0.110564 Jul 26 14:13:34.590620 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1078/2011] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:34 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:13:34.602228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d1777a4-2b1a-49d4-9781-afa217c7fb6c tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2032922462", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "max_count": 0}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d1777a4-2b1a-49d4-9781-afa217c7fb6c tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Request method failure captured: Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 168 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_aMEXzcaXxd4PF3dkk9u0pn3MsSoNGocpe3CJTmTYfifQ8Jia-iVCgWmWaLP6X6FGkaEau8w87vBJyV2gopOFdQuidz5HLTI4q_ZsVabVQLU22iZ_Z1Sp-oyCAb3pDYf87Ib1H-UF7yaaSeF4un5Uih2Tqzr5Q2YBSFQ5h0OcARy6I Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4f9fec5a28aa459d9c0c140cf82a5958 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9fec5a28aa459d9c0c140cf82a5958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4f9fec5a28aa459d9c0c140cf82a5958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4f9fec5a28aa459d9c0c140cf82a5958", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9fec5a28aa459d9c0c140cf82a5958"}]}] Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4f9fec5a28aa459d9c0c140cf82a5958 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-MultipleCreateNegativeTestJSON-1733626612-project Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e5bbbe0d411d4710a619608a1dce3297 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1733626612-project Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2032922462", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "max_count": 0}} Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2032922462', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'max_count': 0}}} Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 0 Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:13:34.615110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 26 14:13:34.619235 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:34.622334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d1777a4-2b1a-49d4-9781-afa217c7fb6c tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:34.638691 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0d1777a4-2b1a-49d4-9781-afa217c7fb6c tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.031680 Jul 26 14:13:34.640864 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1079/2012] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:34 2022] POST /compute/v2.1/servers => generated 130 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:13:34.690836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-90ab88dd-cced-48e9-8c00-b0f2fbec1b64 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:34.718843 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-90ab88dd-cced-48e9-8c00-b0f2fbec1b64 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.633124 Jul 26 14:13:34.720987 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 934/2013] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:34 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:34.729483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-061b663e-36e7-4fd2-a232-eebafc3105c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:34.730760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-061b663e-36e7-4fd2-a232-eebafc3105c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:34.739783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-061b663e-36e7-4fd2-a232-eebafc3105c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:34.742387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-061b663e-36e7-4fd2-a232-eebafc3105c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:34.743597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-061b663e-36e7-4fd2-a232-eebafc3105c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:34.744661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-061b663e-36e7-4fd2-a232-eebafc3105c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:34.904325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-5ac2dff3-1831-4428-b7d3-503aea161775 req-290f26b0-8594-4e5d-80dc-172eca0e12a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d63bc9c-464d-40bc-84f1-ffc106ed6cb7", "name": "network-vif-plugged", "status": "completed", "tag": "67ed775a-ab8d-4693-bb98-f833fe4899fa"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:34.953110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5ac2dff3-1831-4428-b7d3-503aea161775 req-290f26b0-8594-4e5d-80dc-172eca0e12a3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:34.954070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5ac2dff3-1831-4428-b7d3-503aea161775 req-290f26b0-8594-4e5d-80dc-172eca0e12a3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:34.998268 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-5ac2dff3-1831-4428-b7d3-503aea161775 req-290f26b0-8594-4e5d-80dc-172eca0e12a3 service nova] Creating event network-vif-plugged:67ed775a-ab8d-4693-bb98-f833fe4899fa for instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 on n-h2-833090-9 Jul 26 14:13:35.017352 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-5ac2dff3-1831-4428-b7d3-503aea161775 req-290f26b0-8594-4e5d-80dc-172eca0e12a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.372656 Jul 26 14:13:35.026662 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1080/2014] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:35.046718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-99140834-fc4a-45e7-8d90-e18c8834cec2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:35.047442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-99140834-fc4a-45e7-8d90-e18c8834cec2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:35.087121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99140834-fc4a-45e7-8d90-e18c8834cec2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:35.088079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99140834-fc4a-45e7-8d90-e18c8834cec2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:35.089663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99140834-fc4a-45e7-8d90-e18c8834cec2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:35.090333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99140834-fc4a-45e7-8d90-e18c8834cec2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:35.139513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-061b663e-36e7-4fd2-a232-eebafc3105c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:35.170245 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-061b663e-36e7-4fd2-a232-eebafc3105c9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.447626 Jul 26 14:13:35.171277 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 935/2015] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:34 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:35.182324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12ffca17-904e-4b29-b990-81440802b501 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1543208051", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "max_count": 2.5}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12ffca17-904e-4b29-b990-81440802b501 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Request method failure captured: Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 170 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_aMEXzcaXxd4PF3dkk9u0pn3MsSoNGocpe3CJTmTYfifQ8Jia-iVCgWmWaLP6X6FGkaEau8w87vBJyV2gopOFdQuidz5HLTI4q_ZsVabVQLU22iZ_Z1Sp-oyCAb3pDYf87Ib1H-UF7yaaSeF4un5Uih2Tqzr5Q2YBSFQ5h0OcARy6I Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4f9fec5a28aa459d9c0c140cf82a5958 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9fec5a28aa459d9c0c140cf82a5958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4f9fec5a28aa459d9c0c140cf82a5958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4f9fec5a28aa459d9c0c140cf82a5958", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9fec5a28aa459d9c0c140cf82a5958"}]}] Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4f9fec5a28aa459d9c0c140cf82a5958 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-MultipleCreateNegativeTestJSON-1733626612-project Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: e5bbbe0d411d4710a619608a1dce3297 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1733626612-project Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1543208051", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "max_count": 2.5}} Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1543208051', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'max_count': 2.5}}} Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 2.5 Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:13:35.205654 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.211292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12ffca17-904e-4b29-b990-81440802b501 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:35.215688 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-12ffca17-904e-4b29-b990-81440802b501 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.040109 Jul 26 14:13:35.216785 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 936/2016] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:35 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:13:35.258021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-72a51349-d8ad-4f8c-94ed-ca011e16b952 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8794495ca0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:35.446156 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-72a51349-d8ad-4f8c-94ed-ca011e16b952 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.219268 Jul 26 14:13:35.455849 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 937/2017] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:35 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:35.472476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e13867e5-e0e9-4e34-ba32-f8b5f49846c3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:35.474307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e13867e5-e0e9-4e34-ba32-f8b5f49846c3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:35.492495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e13867e5-e0e9-4e34-ba32-f8b5f49846c3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:35.499082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e13867e5-e0e9-4e34-ba32-f8b5f49846c3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:35.500458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e13867e5-e0e9-4e34-ba32-f8b5f49846c3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:35.502096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e13867e5-e0e9-4e34-ba32-f8b5f49846c3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:35.519788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99140834-fc4a-45e7-8d90-e18c8834cec2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:35.533643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99140834-fc4a-45e7-8d90-e18c8834cec2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:35.538548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99140834-fc4a-45e7-8d90-e18c8834cec2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:35.540413 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-99140834-fc4a-45e7-8d90-e18c8834cec2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.503206 Jul 26 14:13:35.541562 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1081/2018] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:35 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:35.566446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2442774c-89e9-4947-a0e4-c8fa280424a1 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1084153786", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 0}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2442774c-89e9-4947-a0e4-c8fa280424a1 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Request method failure captured: Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 168 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_aMEXzcaXxd4PF3dkk9u0pn3MsSoNGocpe3CJTmTYfifQ8Jia-iVCgWmWaLP6X6FGkaEau8w87vBJyV2gopOFdQuidz5HLTI4q_ZsVabVQLU22iZ_Z1Sp-oyCAb3pDYf87Ib1H-UF7yaaSeF4un5Uih2Tqzr5Q2YBSFQ5h0OcARy6I Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4f9fec5a28aa459d9c0c140cf82a5958 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9fec5a28aa459d9c0c140cf82a5958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4f9fec5a28aa459d9c0c140cf82a5958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4f9fec5a28aa459d9c0c140cf82a5958", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9fec5a28aa459d9c0c140cf82a5958"}]}] Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4f9fec5a28aa459d9c0c140cf82a5958 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-MultipleCreateNegativeTestJSON-1733626612-project Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e5bbbe0d411d4710a619608a1dce3297 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1733626612-project Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1084153786", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 0}} Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1084153786', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'min_count': 0}}} Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 0 Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:13:35.598616 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 26 14:13:35.604630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.608444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2442774c-89e9-4947-a0e4-c8fa280424a1 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:35.609710 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2442774c-89e9-4947-a0e4-c8fa280424a1 tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.066837 Jul 26 14:13:35.610945 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1082/2019] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:35 2022] POST /compute/v2.1/servers => generated 130 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:13:35.618782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-33eb1ab3-8fe1-480c-8e9e-a4821c4b8450 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-33eb1ab3-8fe1-480c-8e9e-a4821c4b8450 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 163 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": 12345, "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 12345 Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:13:35.625123 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 26 14:13:35.629574 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:35.633560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-33eb1ab3-8fe1-480c-8e9e-a4821c4b8450 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:35.634754 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-33eb1ab3-8fe1-480c-8e9e-a4821c4b8450 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.022441 Jul 26 14:13:35.636067 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1083/2020] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:35 2022] POST /compute/v2.1/servers => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:13:35.667771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-28ccb5e1-5203-4c87-9d19-2002c63bd4fa tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:35.669039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-28ccb5e1-5203-4c87-9d19-2002c63bd4fa tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:35.727337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28ccb5e1-5203-4c87-9d19-2002c63bd4fa tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:35.732326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28ccb5e1-5203-4c87-9d19-2002c63bd4fa tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:35.740023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28ccb5e1-5203-4c87-9d19-2002c63bd4fa tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:35.741748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28ccb5e1-5203-4c87-9d19-2002c63bd4fa tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:36.078588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e13867e5-e0e9-4e34-ba32-f8b5f49846c3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:36.097494 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e13867e5-e0e9-4e34-ba32-f8b5f49846c3 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.638951 Jul 26 14:13:36.117411 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 938/2021] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:35 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:36.134878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-28ccb5e1-5203-4c87-9d19-2002c63bd4fa tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:36.153357 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-28ccb5e1-5203-4c87-9d19-2002c63bd4fa tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.497278 Jul 26 14:13:36.157086 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1084/2022] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:35 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:36.157996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c1a81d02-b2ad-4945-b0f8-d58e68258caf tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:36.166490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c1a81d02-b2ad-4945-b0f8-d58e68258caf tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:36.171751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85841291-0f82-4c9e-a985-b8b8e55963fa tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1693910245", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 2.5}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85841291-0f82-4c9e-a985-b8b8e55963fa tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Request method failure captured: Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 170 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_aMEXzcaXxd4PF3dkk9u0pn3MsSoNGocpe3CJTmTYfifQ8Jia-iVCgWmWaLP6X6FGkaEau8w87vBJyV2gopOFdQuidz5HLTI4q_ZsVabVQLU22iZ_Z1Sp-oyCAb3pDYf87Ib1H-UF7yaaSeF4un5Uih2Tqzr5Q2YBSFQ5h0OcARy6I Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4f9fec5a28aa459d9c0c140cf82a5958 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9fec5a28aa459d9c0c140cf82a5958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4f9fec5a28aa459d9c0c140cf82a5958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4f9fec5a28aa459d9c0c140cf82a5958", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4f9fec5a28aa459d9c0c140cf82a5958"}]}] Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4f9fec5a28aa459d9c0c140cf82a5958 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1733626612 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-MultipleCreateNegativeTestJSON-1733626612-project Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e5bbbe0d411d4710a619608a1dce3297 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1733626612-project Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1693910245", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 2.5}} Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1693910245', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'min_count': 2.5}}} Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 2.5 Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:13:36.181248 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 26 14:13:36.184937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:36.191468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85841291-0f82-4c9e-a985-b8b8e55963fa tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:36.192726 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85841291-0f82-4c9e-a985-b8b8e55963fa tempest-MultipleCreateNegativeTestJSON-1733626612 tempest-MultipleCreateNegativeTestJSON-1733626612-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.033047 Jul 26 14:13:36.193622 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1085/2023] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:13:36.205268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1a81d02-b2ad-4945-b0f8-d58e68258caf tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:36.208260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1a81d02-b2ad-4945-b0f8-d58e68258caf tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:36.213242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1a81d02-b2ad-4945-b0f8-d58e68258caf tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:36.215087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7f39b7aa-fde1-4cfe-856f-bbcaa197d21d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:36.215999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7f39b7aa-fde1-4cfe-856f-bbcaa197d21d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:36.220032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1a81d02-b2ad-4945-b0f8-d58e68258caf tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:36.238362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f39b7aa-fde1-4cfe-856f-bbcaa197d21d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:36.244735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f39b7aa-fde1-4cfe-856f-bbcaa197d21d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:36.247693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f39b7aa-fde1-4cfe-856f-bbcaa197d21d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:36.250383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f39b7aa-fde1-4cfe-856f-bbcaa197d21d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:36.895305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c1a81d02-b2ad-4945-b0f8-d58e68258caf tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:36.914442 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c1a81d02-b2ad-4945-b0f8-d58e68258caf tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.786617 Jul 26 14:13:36.915689 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 939/2024] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:36 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:36.936570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f88a7998-34a4-4caa-bf7d-7b1d914faeb5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787add670>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:36.942066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7f39b7aa-fde1-4cfe-856f-bbcaa197d21d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:36.958054 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7f39b7aa-fde1-4cfe-856f-bbcaa197d21d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.761087 Jul 26 14:13:36.961865 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1086/2025] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:36 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:36.995889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71d58151-c777-4d5c-9caf-9bcf5ae6cd25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:36.998670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71d58151-c777-4d5c-9caf-9bcf5ae6cd25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:37.030722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71d58151-c777-4d5c-9caf-9bcf5ae6cd25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:37.033930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71d58151-c777-4d5c-9caf-9bcf5ae6cd25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:37.040695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71d58151-c777-4d5c-9caf-9bcf5ae6cd25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:37.041258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71d58151-c777-4d5c-9caf-9bcf5ae6cd25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:37.085867 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f88a7998-34a4-4caa-bf7d-7b1d914faeb5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.168214 Jul 26 14:13:37.089433 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 940/2026] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:36 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:37.101614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c62fb048-0150-4aa1-9f04-4339ef4d8dec req-39bea407-15a5-4ee7-826b-5e08eae2bf1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e53966-8644-4b0b-9429-dd23222bb79e", "tag": "d89bd279-7459-4603-9b92-9e0b93981d08"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:37.216582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c62fb048-0150-4aa1-9f04-4339ef4d8dec req-39bea407-15a5-4ee7-826b-5e08eae2bf1b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:37.217595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c62fb048-0150-4aa1-9f04-4339ef4d8dec req-39bea407-15a5-4ee7-826b-5e08eae2bf1b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:37.307932 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c62fb048-0150-4aa1-9f04-4339ef4d8dec req-39bea407-15a5-4ee7-826b-5e08eae2bf1b service nova] Creating event network-changed:d89bd279-7459-4603-9b92-9e0b93981d08 for instance c6e53966-8644-4b0b-9429-dd23222bb79e on n-h2-833090-9 Jul 26 14:13:37.339584 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c62fb048-0150-4aa1-9f04-4339ef4d8dec req-39bea407-15a5-4ee7-826b-5e08eae2bf1b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244515 Jul 26 14:13:37.346752 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 941/2027] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:37.384240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b3efed39-56a8-48f6-bef4-1b16b7979a71 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:37.384982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b3efed39-56a8-48f6-bef4-1b16b7979a71 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:37.431708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3efed39-56a8-48f6-bef4-1b16b7979a71 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:37.432311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3efed39-56a8-48f6-bef4-1b16b7979a71 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:37.438429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3efed39-56a8-48f6-bef4-1b16b7979a71 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:37.454202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3efed39-56a8-48f6-bef4-1b16b7979a71 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:38.237704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-71d58151-c777-4d5c-9caf-9bcf5ae6cd25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:38.260043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-71d58151-c777-4d5c-9caf-9bcf5ae6cd25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:38.267011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-71d58151-c777-4d5c-9caf-9bcf5ae6cd25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:38.276176 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71d58151-c777-4d5c-9caf-9bcf5ae6cd25 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 1.307002 Jul 26 14:13:38.299162 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1087/2028] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:36 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:38.326372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95e938d5-bcba-4047-a6fb-3958c42649c3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:38.331054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95e938d5-bcba-4047-a6fb-3958c42649c3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:38.349495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e938d5-bcba-4047-a6fb-3958c42649c3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:38.354328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e938d5-bcba-4047-a6fb-3958c42649c3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:38.358825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e938d5-bcba-4047-a6fb-3958c42649c3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:38.359548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95e938d5-bcba-4047-a6fb-3958c42649c3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:39.030110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b3efed39-56a8-48f6-bef4-1b16b7979a71 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:39.061232 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b3efed39-56a8-48f6-bef4-1b16b7979a71 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 1.693050 Jul 26 14:13:39.064670 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 942/2029] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:37 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:39.098059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d03519fa-864b-4d72-9f23-2678ccf36086 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787c0f1f0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:39.168904 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d03519fa-864b-4d72-9f23-2678ccf36086 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.100740 Jul 26 14:13:39.184340 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 943/2030] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:39 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:39.296294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-95e938d5-bcba-4047-a6fb-3958c42649c3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:39.305571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:39.316638 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95e938d5-bcba-4047-a6fb-3958c42649c3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 1.014973 Jul 26 14:13:39.318135 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1088/2031] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:38 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:39.330488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1432ccb-5fc1-428e-a17a-74af90cd77f5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:39.333714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f1432ccb-5fc1-428e-a17a-74af90cd77f5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:39.364561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1432ccb-5fc1-428e-a17a-74af90cd77f5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:39.373768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1432ccb-5fc1-428e-a17a-74af90cd77f5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:39.374812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1432ccb-5fc1-428e-a17a-74af90cd77f5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:39.375335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1432ccb-5fc1-428e-a17a-74af90cd77f5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:39.731571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0b804f77-cd0f-44fe-a1bc-fcb799582334 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Action: 'create', calling method: .version_select at 0x7f87943ff3a0>, body: {"keypair": {"name": "tempest-keypair-1640826207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFtAJG0G0ILd7qVluZLIgxCARd4CXNwSwe2YILi6OQnERom7/HHxaE9UWqoubsdcWvgNec98K4jyfkYxcr4Zfu531wOS71OHbjUwK3tAC170DN9hjLJD685MDcR5M0CuA=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:39.828689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0b804f77-cd0f-44fe-a1bc-fcb799582334 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Getting quotas for project 98c00816adb64fa4ad579cef5acc13d9. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:13:39.849390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0b804f77-cd0f-44fe-a1bc-fcb799582334 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Getting quotas for user 77c5d610c6134ed28c5747c6ac79ea6d and project 98c00816adb64fa4ad579cef5acc13d9. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:13:39.957949 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0b804f77-cd0f-44fe-a1bc-fcb799582334 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.771870 Jul 26 14:13:39.970015 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 944/2032] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:13:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:39.987157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-403d1cd3-c7e3-4477-be63-77a803475068 req-fd089555-8d95-49f9-a64a-1269fe9de162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "name": "network-vif-plugged", "status": "completed", "tag": "03fd6db5-e279-44da-b87e-1092a3814c97"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:40.015348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-403d1cd3-c7e3-4477-be63-77a803475068 req-fd089555-8d95-49f9-a64a-1269fe9de162 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:40.017125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-403d1cd3-c7e3-4477-be63-77a803475068 req-fd089555-8d95-49f9-a64a-1269fe9de162 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:40.056412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1432ccb-5fc1-428e-a17a-74af90cd77f5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:40.071675 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-403d1cd3-c7e3-4477-be63-77a803475068 req-fd089555-8d95-49f9-a64a-1269fe9de162 service nova] Creating event network-vif-plugged:03fd6db5-e279-44da-b87e-1092a3814c97 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:13:40.089729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1432ccb-5fc1-428e-a17a-74af90cd77f5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:40.108294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1432ccb-5fc1-428e-a17a-74af90cd77f5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:40.109605 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f1432ccb-5fc1-428e-a17a-74af90cd77f5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.789497 Jul 26 14:13:40.110204 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1089/2033] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:39 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:40.127098 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-403d1cd3-c7e3-4477-be63-77a803475068 req-fd089555-8d95-49f9-a64a-1269fe9de162 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134475 Jul 26 14:13:40.127098 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 945/2034] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:40.146948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ac46eba2-40b4-47d2-b6f0-af7c227cd320 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:40.151876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ac46eba2-40b4-47d2-b6f0-af7c227cd320 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:40.187106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1c19db82-4899-4a78-a5bc-9f1b9c997c1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8794c06040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:40.197090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac46eba2-40b4-47d2-b6f0-af7c227cd320 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:40.197642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac46eba2-40b4-47d2-b6f0-af7c227cd320 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:40.206249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac46eba2-40b4-47d2-b6f0-af7c227cd320 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:40.206826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac46eba2-40b4-47d2-b6f0-af7c227cd320 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:40.314303 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1c19db82-4899-4a78-a5bc-9f1b9c997c1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.133348 Jul 26 14:13:40.316818 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 946/2035] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:40 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:13:40.342065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-76c7eb9d-0f0e-4bfd-a5f7-1c58fa8ebd48 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:40.343703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76c7eb9d-0f0e-4bfd-a5f7-1c58fa8ebd48 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:40.381191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76c7eb9d-0f0e-4bfd-a5f7-1c58fa8ebd48 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:40.382365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76c7eb9d-0f0e-4bfd-a5f7-1c58fa8ebd48 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:40.384109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76c7eb9d-0f0e-4bfd-a5f7-1c58fa8ebd48 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:40.385063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76c7eb9d-0f0e-4bfd-a5f7-1c58fa8ebd48 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:41.256343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-76c7eb9d-0f0e-4bfd-a5f7-1c58fa8ebd48 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:41.274948 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-76c7eb9d-0f0e-4bfd-a5f7-1c58fa8ebd48 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.939043 Jul 26 14:13:41.276135 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 947/2036] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:40 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:13:41.282401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2b1e4ee9-e593-4df9-9aa6-df0ee623cd29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:41.283461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2b1e4ee9-e593-4df9-9aa6-df0ee623cd29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:41.290645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b1e4ee9-e593-4df9-9aa6-df0ee623cd29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:41.292225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b1e4ee9-e593-4df9-9aa6-df0ee623cd29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:41.293986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b1e4ee9-e593-4df9-9aa6-df0ee623cd29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:41.294691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b1e4ee9-e593-4df9-9aa6-df0ee623cd29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:41.527588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ac46eba2-40b4-47d2-b6f0-af7c227cd320 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:41.544443 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ac46eba2-40b4-47d2-b6f0-af7c227cd320 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 1.423708 Jul 26 14:13:41.545130 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1090/2037] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:40 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:41.562727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7485ad4f-cbaa-499d-bec6-cb71fd556a32 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-20057717", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ff6673ae-d9b0-4b06-95c7-a4671cb4c63c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:41.792860 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-7485ad4f-cbaa-499d-bec6-cb71fd556a32 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Block Device ff6673ae-d9b0-4b06-95c7-a4671cb4c63c is not bootable. Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7485ad4f-cbaa-499d-bec6-cb71fd556a32 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 356 Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-20057717", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ff6673ae-d9b0-4b06-95c7-a4671cb4c63c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: exception: Block Device ff6673ae-d9b0-4b06-95c7-a4671cb4c63c is not bootable. Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-20057717', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ff6673ae-d9b0-4b06-95c7-a4671cb4c63c'}], 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ff6673ae-d9b0-4b06-95c7-a4671cb4c63c is not bootable. Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:41.801491 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ff6673ae-d9b0-4b06-95c7-a4671cb4c63c is not bootable. Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ff6673ae-d9b0-4b06-95c7-a4671cb4c63c is not bootable. Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:41.806781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7485ad4f-cbaa-499d-bec6-cb71fd556a32 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Block Device ff6673ae-d9b0-4b06-95c7-a4671cb4c63c is not bootable. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:41.809247 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7485ad4f-cbaa-499d-bec6-cb71fd556a32 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.263019 Jul 26 14:13:41.810153 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1091/2038] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:41 2022] POST /compute/v2.1/servers => generated 110 bytes in 264 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:13:41.815411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eac650e1-ba3f-4596-ace1-31111e80629b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787d0d9d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:41.917201 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eac650e1-ba3f-4596-ace1-31111e80629b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.105970 Jul 26 14:13:41.920498 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1092/2039] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:41 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:41.938516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3523ee5a-8670-448c-bf3f-02c0c59cd83e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:41.939472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3523ee5a-8670-448c-bf3f-02c0c59cd83e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:41.956593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3523ee5a-8670-448c-bf3f-02c0c59cd83e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:41.957554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3523ee5a-8670-448c-bf3f-02c0c59cd83e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:41.960499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3523ee5a-8670-448c-bf3f-02c0c59cd83e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:41.961197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3523ee5a-8670-448c-bf3f-02c0c59cd83e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:42.077930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2b1e4ee9-e593-4df9-9aa6-df0ee623cd29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:42.091978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2b1e4ee9-e593-4df9-9aa6-df0ee623cd29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:42.093978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2b1e4ee9-e593-4df9-9aa6-df0ee623cd29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:42.097186 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2b1e4ee9-e593-4df9-9aa6-df0ee623cd29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.819655 Jul 26 14:13:42.099930 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 948/2040] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:41 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:42.184282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3086634c-989b-4dc1-9f30-585b18ea6f5c req-78899b3f-9585-4296-98dd-25df498e4242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "name": "network-vif-plugged", "status": "completed", "tag": "f0e1d62c-bfec-42d3-88e2-91a796c3c780"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:42.216567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3086634c-989b-4dc1-9f30-585b18ea6f5c req-78899b3f-9585-4296-98dd-25df498e4242 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:42.218339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3086634c-989b-4dc1-9f30-585b18ea6f5c req-78899b3f-9585-4296-98dd-25df498e4242 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:42.266623 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3086634c-989b-4dc1-9f30-585b18ea6f5c req-78899b3f-9585-4296-98dd-25df498e4242 service nova] Creating event network-vif-plugged:f0e1d62c-bfec-42d3-88e2-91a796c3c780 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:13:42.286169 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3086634c-989b-4dc1-9f30-585b18ea6f5c req-78899b3f-9585-4296-98dd-25df498e4242 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106153 Jul 26 14:13:42.288715 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 949/2041] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:13:42.301586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2bc86ec6-e8a3-4deb-9b4c-8ab15e8e4fe3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:42.304582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2bc86ec6-e8a3-4deb-9b4c-8ab15e8e4fe3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:42.336637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2bc86ec6-e8a3-4deb-9b4c-8ab15e8e4fe3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:42.337116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2bc86ec6-e8a3-4deb-9b4c-8ab15e8e4fe3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:42.338833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2bc86ec6-e8a3-4deb-9b4c-8ab15e8e4fe3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:42.339217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2bc86ec6-e8a3-4deb-9b4c-8ab15e8e4fe3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:42.732449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3523ee5a-8670-448c-bf3f-02c0c59cd83e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:42.748760 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3523ee5a-8670-448c-bf3f-02c0c59cd83e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.826558 Jul 26 14:13:42.752825 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1093/2042] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:41 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:42.758223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-857bb3aa-af16-42b2-b456-9f3d2f6be1bf tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:42.768363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-857bb3aa-af16-42b2-b456-9f3d2f6be1bf tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:42.786032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-857bb3aa-af16-42b2-b456-9f3d2f6be1bf tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:42.787266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-857bb3aa-af16-42b2-b456-9f3d2f6be1bf tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:42.793448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-857bb3aa-af16-42b2-b456-9f3d2f6be1bf tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:42.794371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-857bb3aa-af16-42b2-b456-9f3d2f6be1bf tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:43.124206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2bc86ec6-e8a3-4deb-9b4c-8ab15e8e4fe3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:43.148115 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2bc86ec6-e8a3-4deb-9b4c-8ab15e8e4fe3 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.852617 Jul 26 14:13:43.148965 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 950/2043] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:42 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:43.175351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ed2431f7-59bc-4538-af54-130985d03d1a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:43.176851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ed2431f7-59bc-4538-af54-130985d03d1a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:43.197620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed2431f7-59bc-4538-af54-130985d03d1a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:43.200516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed2431f7-59bc-4538-af54-130985d03d1a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:43.206049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed2431f7-59bc-4538-af54-130985d03d1a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:43.206849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed2431f7-59bc-4538-af54-130985d03d1a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:43.404748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-857bb3aa-af16-42b2-b456-9f3d2f6be1bf tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:43.421143 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-857bb3aa-af16-42b2-b456-9f3d2f6be1bf tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.666867 Jul 26 14:13:43.421742 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1094/2044] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:42 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:43.436069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca2c4653-a5d5-4b2c-a964-d41c1491cc31 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787d7a5e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:43.645789 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca2c4653-a5d5-4b2c-a964-d41c1491cc31 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.222461 Jul 26 14:13:43.647268 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1095/2045] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:43 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:43.652308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-51dfa55d-1441-44b5-899e-07bf9dd81359 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:43.659057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-51dfa55d-1441-44b5-899e-07bf9dd81359 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:43.673076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51dfa55d-1441-44b5-899e-07bf9dd81359 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:43.684756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51dfa55d-1441-44b5-899e-07bf9dd81359 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:43.685901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51dfa55d-1441-44b5-899e-07bf9dd81359 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:43.686704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51dfa55d-1441-44b5-899e-07bf9dd81359 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:43.892339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ed2431f7-59bc-4538-af54-130985d03d1a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:43.918199 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ed2431f7-59bc-4538-af54-130985d03d1a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.766516 Jul 26 14:13:43.952173 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 951/2046] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:43 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:44.176421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ad9a48a-f238-4ac2-9e37-c60b1cbfae8e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:44.178066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4ad9a48a-f238-4ac2-9e37-c60b1cbfae8e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:44.230499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ad9a48a-f238-4ac2-9e37-c60b1cbfae8e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:44.231286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ad9a48a-f238-4ac2-9e37-c60b1cbfae8e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:44.240682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ad9a48a-f238-4ac2-9e37-c60b1cbfae8e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:44.241815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ad9a48a-f238-4ac2-9e37-c60b1cbfae8e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:44.603875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-51dfa55d-1441-44b5-899e-07bf9dd81359 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:44.618452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-51dfa55d-1441-44b5-899e-07bf9dd81359 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:44.631444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-51dfa55d-1441-44b5-899e-07bf9dd81359 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:44.639806 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-51dfa55d-1441-44b5-899e-07bf9dd81359 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.991167 Jul 26 14:13:44.640860 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1096/2047] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:43 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:44.646609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4483d268-83e6-4c9b-8fca-c3e9f8241623 req-554a49be-ceb8-4ab1-8dd1-8cd32c22e589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e53966-8644-4b0b-9429-dd23222bb79e", "name": "network-vif-unplugged", "status": "completed", "tag": "d89bd279-7459-4603-9b92-9e0b93981d08"}, {"server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "name": "network-vif-plugged", "status": "completed", "tag": "1b9b8b4a-4059-4dc5-8338-240b5735b517"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:44.716999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4483d268-83e6-4c9b-8fca-c3e9f8241623 req-554a49be-ceb8-4ab1-8dd1-8cd32c22e589 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:44.729088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4483d268-83e6-4c9b-8fca-c3e9f8241623 req-554a49be-ceb8-4ab1-8dd1-8cd32c22e589 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:44.766651 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4483d268-83e6-4c9b-8fca-c3e9f8241623 req-554a49be-ceb8-4ab1-8dd1-8cd32c22e589 service nova] Creating event network-vif-unplugged:d89bd279-7459-4603-9b92-9e0b93981d08 for instance c6e53966-8644-4b0b-9429-dd23222bb79e on n-h2-833090-9 Jul 26 14:13:44.767426 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4483d268-83e6-4c9b-8fca-c3e9f8241623 req-554a49be-ceb8-4ab1-8dd1-8cd32c22e589 service nova] Creating event network-vif-plugged:1b9b8b4a-4059-4dc5-8338-240b5735b517 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:13:44.783888 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4483d268-83e6-4c9b-8fca-c3e9f8241623 req-554a49be-ceb8-4ab1-8dd1-8cd32c22e589 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.141408 Jul 26 14:13:44.785256 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1097/2048] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:44.805897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-14f68664-cf2e-42a0-b93a-369d7a3a7d84 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:44.808465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-14f68664-cf2e-42a0-b93a-369d7a3a7d84 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:44.826155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14f68664-cf2e-42a0-b93a-369d7a3a7d84 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:44.827162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14f68664-cf2e-42a0-b93a-369d7a3a7d84 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:44.830237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14f68664-cf2e-42a0-b93a-369d7a3a7d84 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:44.831035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14f68664-cf2e-42a0-b93a-369d7a3a7d84 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:45.602754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ad9a48a-f238-4ac2-9e37-c60b1cbfae8e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:45.636194 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ad9a48a-f238-4ac2-9e37-c60b1cbfae8e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 1.466750 Jul 26 14:13:45.641580 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 952/2049] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:44 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:45.663324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-89b435f1-5d5e-44df-a3ec-d74356a97ece tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787e58ee0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:45.692090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-14f68664-cf2e-42a0-b93a-369d7a3a7d84 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:45.704971 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-14f68664-cf2e-42a0-b93a-369d7a3a7d84 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1354 microversion: 2.1 time: 0.914189 Jul 26 14:13:45.706787 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1098/2050] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:44 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1354 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:45.734574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f527c695-91dc-40eb-a576-37626f78c7a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:45.742803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f527c695-91dc-40eb-a576-37626f78c7a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:45.778635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f527c695-91dc-40eb-a576-37626f78c7a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:45.788692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f527c695-91dc-40eb-a576-37626f78c7a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:45.790173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f527c695-91dc-40eb-a576-37626f78c7a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:45.792030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f527c695-91dc-40eb-a576-37626f78c7a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:45.840403 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-89b435f1-5d5e-44df-a3ec-d74356a97ece tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.196486 Jul 26 14:13:45.841247 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 953/2051] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:45 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:46.081456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1283440424", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "cdba9fba-7f48-4210-9a88-ee2c4219ba59"}], "security_groups": [{"name": "tempest-securitygroup--629303304"}], "key_name": "tempest-keypair-1640826207", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:46.668087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f527c695-91dc-40eb-a576-37626f78c7a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:46.686861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f527c695-91dc-40eb-a576-37626f78c7a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:46.691984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f527c695-91dc-40eb-a576-37626f78c7a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:46.701288 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f527c695-91dc-40eb-a576-37626f78c7a2 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.992768 Jul 26 14:13:46.713702 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1099/2052] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:45 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:46.736096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-30d79af9-8f81-453f-8595-ae6209d30e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:46.744975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-30d79af9-8f81-453f-8595-ae6209d30e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:46.772273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30d79af9-8f81-453f-8595-ae6209d30e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:46.774491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30d79af9-8f81-453f-8595-ae6209d30e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:46.775578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30d79af9-8f81-453f-8595-ae6209d30e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:46.778323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30d79af9-8f81-453f-8595-ae6209d30e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:47.273820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] validate_networks() for [('cdba9fba-7f48-4210-9a88-ee2c4219ba59', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:13:47.656855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-30d79af9-8f81-453f-8595-ae6209d30e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:47.667332 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-30d79af9-8f81-453f-8595-ae6209d30e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.952219 Jul 26 14:13:47.680535 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1100/2053] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:46 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:47.689808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b10add7a-768c-4f07-bccd-fcb98bf02b36 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:47.690462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b10add7a-768c-4f07-bccd-fcb98bf02b36 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:47.721148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b10add7a-768c-4f07-bccd-fcb98bf02b36 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:47.728180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b10add7a-768c-4f07-bccd-fcb98bf02b36 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:47.730928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b10add7a-768c-4f07-bccd-fcb98bf02b36 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:47.731262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b10add7a-768c-4f07-bccd-fcb98bf02b36 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:48.627683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b10add7a-768c-4f07-bccd-fcb98bf02b36 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:48.647411 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b10add7a-768c-4f07-bccd-fcb98bf02b36 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1805 microversion: 2.1 time: 0.965769 Jul 26 14:13:48.648252 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1101/2054] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:47 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1805 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:48.654374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-006b7918-0cad-47af-8a93-80da35560ab3 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787fe2f70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:48.740202 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-006b7918-0cad-47af-8a93-80da35560ab3 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.089555 Jul 26 14:13:48.753466 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1102/2055] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:48 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:48.774316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-25b3a76d-4d72-4dc3-97dc-2eaa71ac5f12 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:48.774962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-25b3a76d-4d72-4dc3-97dc-2eaa71ac5f12 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:48.799739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25b3a76d-4d72-4dc3-97dc-2eaa71ac5f12 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:48.800216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25b3a76d-4d72-4dc3-97dc-2eaa71ac5f12 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:48.801018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25b3a76d-4d72-4dc3-97dc-2eaa71ac5f12 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:48.801543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25b3a76d-4d72-4dc3-97dc-2eaa71ac5f12 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:49.862737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25b3a76d-4d72-4dc3-97dc-2eaa71ac5f12 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:49.897494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:49.920046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25b3a76d-4d72-4dc3-97dc-2eaa71ac5f12 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:49.930985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25b3a76d-4d72-4dc3-97dc-2eaa71ac5f12 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:49.938982 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-25b3a76d-4d72-4dc3-97dc-2eaa71ac5f12 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 1.184173 Jul 26 14:13:49.961920 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1103/2056] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:48 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:49.983369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e9961b84-cf0d-4ecc-ae2c-6645b803a8c6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-83588226", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "destination_type": "local"}, {"source_type": "volume", "uuid": "ad377965-1166-4f47-ba9f-e067265910bb", "destination_type": "invalid"}], "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e9961b84-cf0d-4ecc-ae2c-6645b803a8c6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 493 Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-83588226", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "destination_type": "local"}, {"source_type": "volume", "uuid": "ad377965-1166-4f47-ba9f-e067265910bb", "destination_type": "invalid"}], "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-83588226', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'ad377965-1166-4f47-ba9f-e067265910bb', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:50.004146 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 26 14:13:50.009602 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:13:50.014261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e9961b84-cf0d-4ecc-ae2c-6645b803a8c6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:50.024673 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e9961b84-cf0d-4ecc-ae2c-6645b803a8c6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.055226 Jul 26 14:13:50.028173 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1104/2057] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:49 2022] POST /compute/v2.1/servers => generated 155 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:13:50.048455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b00dc3a6-2e60-430f-bb98-75fe86f1eaad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:50.051808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b00dc3a6-2e60-430f-bb98-75fe86f1eaad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:50.080396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b00dc3a6-2e60-430f-bb98-75fe86f1eaad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:50.082392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b00dc3a6-2e60-430f-bb98-75fe86f1eaad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:50.084649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b00dc3a6-2e60-430f-bb98-75fe86f1eaad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:50.090067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b00dc3a6-2e60-430f-bb98-75fe86f1eaad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:50.152716 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b00dc3a6-2e60-430f-bb98-75fe86f1eaad tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7/ips" status: 200 len: 219 microversion: 2.1 time: 0.122519 Jul 26 14:13:50.164931 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1105/2058] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:13:50 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7/ips => generated 219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:50.170344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d823b584-527b-4085-80ba-edc48113a939 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:50.181053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d823b584-527b-4085-80ba-edc48113a939 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:50.193699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d823b584-527b-4085-80ba-edc48113a939 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:50.194512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d823b584-527b-4085-80ba-edc48113a939 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:50.195629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d823b584-527b-4085-80ba-edc48113a939 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:50.196489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d823b584-527b-4085-80ba-edc48113a939 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:51.391090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d823b584-527b-4085-80ba-edc48113a939 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:51.410580 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d823b584-527b-4085-80ba-edc48113a939 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 1.243318 Jul 26 14:13:51.413288 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1106/2059] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:50 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:51.425235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9d420284-ff4d-472e-9c81-3edf986bdb57 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787fa41f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:51.428820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:13:51.429308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:13:51.429780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:13:51.430200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:13:51.430670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:13:51.460553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:51.461293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:51.464465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:51.465537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:51.487526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:51.492433 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9d420284-ff4d-472e-9c81-3edf986bdb57 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.077127 Jul 26 14:13:51.500932 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1107/2060] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:51 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:51.507021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e8e0fe47-f90d-4301-9774-ff54eefbf7c2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:51.507900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e8e0fe47-f90d-4301-9774-ff54eefbf7c2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:51.523417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8e0fe47-f90d-4301-9774-ff54eefbf7c2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:51.524260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8e0fe47-f90d-4301-9774-ff54eefbf7c2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:51.525314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8e0fe47-f90d-4301-9774-ff54eefbf7c2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:51.525918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8e0fe47-f90d-4301-9774-ff54eefbf7c2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:51.536946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Getting quotas for project 98c00816adb64fa4ad579cef5acc13d9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:13:51.553980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Getting quotas for user 77c5d610c6134ed28c5747c6ac79ea6d and project 98c00816adb64fa4ad579cef5acc13d9. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:13:51.590698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:13:51.594275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:13:51.743725 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-84326e46-7e34-4edc-8199-fb0e46f50c2a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.666467 Jul 26 14:13:51.747636 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 954/2061] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 5672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:13:51.757603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9ce26754-6c25-4733-b21f-afe9c6bfd79b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:51.758714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9ce26754-6c25-4733-b21f-afe9c6bfd79b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:51.797945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ce26754-6c25-4733-b21f-afe9c6bfd79b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:51.798629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ce26754-6c25-4733-b21f-afe9c6bfd79b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:51.799483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ce26754-6c25-4733-b21f-afe9c6bfd79b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:51.800153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ce26754-6c25-4733-b21f-afe9c6bfd79b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:51.815725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e8e0fe47-f90d-4301-9774-ff54eefbf7c2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:51.831284 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e8e0fe47-f90d-4301-9774-ff54eefbf7c2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.325902 Jul 26 14:13:51.831983 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1108/2062] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:51 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:51.870121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-043fd1c9-1762-41a4-a9e6-c663253eb329 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:51.870906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-043fd1c9-1762-41a4-a9e6-c663253eb329 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:51.875585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9ce26754-6c25-4733-b21f-afe9c6bfd79b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:13:51.887784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-043fd1c9-1762-41a4-a9e6-c663253eb329 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:51.890006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-043fd1c9-1762-41a4-a9e6-c663253eb329 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:51.892207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-043fd1c9-1762-41a4-a9e6-c663253eb329 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:51.892669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-043fd1c9-1762-41a4-a9e6-c663253eb329 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:52.147980 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9ce26754-6c25-4733-b21f-afe9c6bfd79b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "DELETE /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 204 len: 0 microversion: 2.1 time: 0.398795 Jul 26 14:13:52.167673 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 955/2063] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:13:51 2022] DELETE /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:13:52.173495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-984fd107-6ab2-481d-b77e-e6c49ca5e65c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:52.174213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-984fd107-6ab2-481d-b77e-e6c49ca5e65c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:52.189184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-043fd1c9-1762-41a4-a9e6-c663253eb329 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:52.206539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-043fd1c9-1762-41a4-a9e6-c663253eb329 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:52.210045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-043fd1c9-1762-41a4-a9e6-c663253eb329 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:52.212181 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-043fd1c9-1762-41a4-a9e6-c663253eb329 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1486 microversion: 2.25 time: 0.358222 Jul 26 14:13:52.213278 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1109/2064] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:51 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1486 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:52.222732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e12f930d-a255-43ee-a6af-b5735b6c1b54 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:52.226296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e12f930d-a255-43ee-a6af-b5735b6c1b54 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:52.242369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e12f930d-a255-43ee-a6af-b5735b6c1b54 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:52.250513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e12f930d-a255-43ee-a6af-b5735b6c1b54 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:52.251981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e12f930d-a255-43ee-a6af-b5735b6c1b54 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:52.252678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e12f930d-a255-43ee-a6af-b5735b6c1b54 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:52.366197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-984fd107-6ab2-481d-b77e-e6c49ca5e65c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:52.376889 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-984fd107-6ab2-481d-b77e-e6c49ca5e65c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1242 microversion: 2.1 time: 0.207403 Jul 26 14:13:52.381265 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 956/2065] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:52 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1242 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:52.389477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-31b2296c-a7a3-4d0a-a310-4c8f7e22c2be tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:52.392386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-31b2296c-a7a3-4d0a-a310-4c8f7e22c2be tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:52.415083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31b2296c-a7a3-4d0a-a310-4c8f7e22c2be tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:52.418149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31b2296c-a7a3-4d0a-a310-4c8f7e22c2be tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:52.419399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31b2296c-a7a3-4d0a-a310-4c8f7e22c2be tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:52.422195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31b2296c-a7a3-4d0a-a310-4c8f7e22c2be tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:52.627110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e12f930d-a255-43ee-a6af-b5735b6c1b54 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:52.641329 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e12f930d-a255-43ee-a6af-b5735b6c1b54 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.424897 Jul 26 14:13:52.656606 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1110/2066] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:52 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:52.674016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-661d69b9-435a-4c98-a11f-3177e20cfbbe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:52.679330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-661d69b9-435a-4c98-a11f-3177e20cfbbe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:52.691017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-661d69b9-435a-4c98-a11f-3177e20cfbbe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:52.704583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-661d69b9-435a-4c98-a11f-3177e20cfbbe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:52.705682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-661d69b9-435a-4c98-a11f-3177e20cfbbe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:52.706268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-661d69b9-435a-4c98-a11f-3177e20cfbbe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:52.772226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31b2296c-a7a3-4d0a-a310-4c8f7e22c2be tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:52.783167 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-31b2296c-a7a3-4d0a-a310-4c8f7e22c2be tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1811 microversion: 2.1 time: 0.400684 Jul 26 14:13:52.802614 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 957/2067] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:52 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1811 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:52.816553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b32f70ac-c2c1-4cad-a36c-48859ef9cdd7 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787d6d700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:52.922673 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b32f70ac-c2c1-4cad-a36c-48859ef9cdd7 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.114034 Jul 26 14:13:52.925130 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 958/2068] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:52 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:52.936373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4d00baf-5e4a-4b22-8efb-c51ef4b34bdb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-363465181", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4d00baf-5e4a-4b22-8efb-c51ef4b34bdb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 491 Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-363465181", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-363465181', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:52.960628 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 26 14:13:52.963754 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:52.966559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4d00baf-5e4a-4b22-8efb-c51ef4b34bdb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:52.977291 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b4d00baf-5e4a-4b22-8efb-c51ef4b34bdb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.050860 Jul 26 14:13:52.977861 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 959/2069] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:52 2022] POST /compute/v2.1/servers => generated 624 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:13:52.986494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4720599a-f3ad-40d6-96d7-685a2c4834f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:52.992496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4720599a-f3ad-40d6-96d7-685a2c4834f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:53.015577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4720599a-f3ad-40d6-96d7-685a2c4834f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:53.024917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4720599a-f3ad-40d6-96d7-685a2c4834f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:53.026016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4720599a-f3ad-40d6-96d7-685a2c4834f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:53.026486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4720599a-f3ad-40d6-96d7-685a2c4834f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:53.111385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-661d69b9-435a-4c98-a11f-3177e20cfbbe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:53.120797 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-661d69b9-435a-4c98-a11f-3177e20cfbbe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1504 microversion: 2.1 time: 0.462841 Jul 26 14:13:53.136332 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1111/2070] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:52 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:53.240389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-49c44b03-0eac-4ee7-bbff-411567edcef3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:53.241270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-49c44b03-0eac-4ee7-bbff-411567edcef3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:53.257854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49c44b03-0eac-4ee7-bbff-411567edcef3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:53.258569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49c44b03-0eac-4ee7-bbff-411567edcef3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:53.259795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49c44b03-0eac-4ee7-bbff-411567edcef3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:53.260506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49c44b03-0eac-4ee7-bbff-411567edcef3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:53.335775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:53.621149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4720599a-f3ad-40d6-96d7-685a2c4834f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:53.636764 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4720599a-f3ad-40d6-96d7-685a2c4834f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.654289 Jul 26 14:13:53.638545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 960/2071] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:52 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:13:53.653006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e388b75c-0b40-4a5f-9a4c-dbb1af948ad7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:53.653886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e388b75c-0b40-4a5f-9a4c-dbb1af948ad7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:53.682230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e388b75c-0b40-4a5f-9a4c-dbb1af948ad7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:53.685414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e388b75c-0b40-4a5f-9a4c-dbb1af948ad7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:53.688387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e388b75c-0b40-4a5f-9a4c-dbb1af948ad7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:53.689197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e388b75c-0b40-4a5f-9a4c-dbb1af948ad7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:53.947392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e388b75c-0b40-4a5f-9a4c-dbb1af948ad7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:53.964510 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e388b75c-0b40-4a5f-9a4c-dbb1af948ad7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1294 microversion: 2.1 time: 0.322447 Jul 26 14:13:53.965943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-49c44b03-0eac-4ee7-bbff-411567edcef3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:53.985085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-49c44b03-0eac-4ee7-bbff-411567edcef3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:53.985695 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 961/2072] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:53 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1294 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:53.987633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-49c44b03-0eac-4ee7-bbff-411567edcef3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:53.990972 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-49c44b03-0eac-4ee7-bbff-411567edcef3 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1476 microversion: 2.25 time: 0.755579 Jul 26 14:13:53.993624 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1112/2073] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:53 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1476 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:13:54.008294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f56af28-487e-49e9-a93d-367c7e280747 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:54.011212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4f56af28-487e-49e9-a93d-367c7e280747 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:54.046995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f56af28-487e-49e9-a93d-367c7e280747 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:54.047700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f56af28-487e-49e9-a93d-367c7e280747 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:54.048780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f56af28-487e-49e9-a93d-367c7e280747 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:54.050629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f56af28-487e-49e9-a93d-367c7e280747 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:54.271120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-feb2af35-8e71-4111-8ffe-fa42b7a5d4fa tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Action: 'create', calling method: .version_select at 0x7f8787f0f5e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1163654626", "policies": ["affinity"]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:54.330424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-feb2af35-8e71-4111-8ffe-fa42b7a5d4fa tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:13:54.373083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-feb2af35-8e71-4111-8ffe-fa42b7a5d4fa tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:13:54.498092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-feb2af35-8e71-4111-8ffe-fa42b7a5d4fa tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:13:54.501863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:54.510456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-feb2af35-8e71-4111-8ffe-fa42b7a5d4fa tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:13:54.534467 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-feb2af35-8e71-4111-8ffe-fa42b7a5d4fa tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.547241 Jul 26 14:13:54.542055 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 962/2074] 10.222.0.70 () {60 vars in 1174 bytes} [Tue Jul 26 14:13:53 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:54.550375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-17029ab8-44b2-4b74-bb29-b78fdceeedfd tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:54.553250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-17029ab8-44b2-4b74-bb29-b78fdceeedfd tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:54.572686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17029ab8-44b2-4b74-bb29-b78fdceeedfd tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:54.574212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17029ab8-44b2-4b74-bb29-b78fdceeedfd tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:54.575324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17029ab8-44b2-4b74-bb29-b78fdceeedfd tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:54.576475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17029ab8-44b2-4b74-bb29-b78fdceeedfd tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:55.413751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-17029ab8-44b2-4b74-bb29-b78fdceeedfd tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:55.439056 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-17029ab8-44b2-4b74-bb29-b78fdceeedfd tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1811 microversion: 2.1 time: 0.895348 Jul 26 14:13:55.443721 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 963/2075] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:54 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1811 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:55.449161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ba9bb1c2-3d90-4e0a-ace6-6c985c45cbd1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787e71160>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:55.469957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4f56af28-487e-49e9-a93d-367c7e280747 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:55.493516 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4f56af28-487e-49e9-a93d-367c7e280747 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 1.497895 Jul 26 14:13:55.501159 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1113/2076] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:53 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:55.509161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e63efa45-4613-4f08-b0ce-0102a79b3f8b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '.version_select at 0x7f8794061c10>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:55.528627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e63efa45-4613-4f08-b0ce-0102a79b3f8b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:55.537099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e63efa45-4613-4f08-b0ce-0102a79b3f8b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:55.557520 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ba9bb1c2-3d90-4e0a-ace6-6c985c45cbd1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1412 microversion: 2.1 time: 0.111640 Jul 26 14:13:55.559696 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 964/2077] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:55 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:55.568515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a4712135-e8c0-483d-ba68-2be43ea5f328 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:55.569675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a4712135-e8c0-483d-ba68-2be43ea5f328 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:55.576655 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e63efa45-4613-4f08-b0ce-0102a79b3f8b tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.074100 Jul 26 14:13:55.583577 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1114/2078] 10.222.0.70 () {60 vars in 1184 bytes} [Tue Jul 26 14:13:55 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:55.595258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ab1bcd0-4294-48d3-930a-e14649269bbf tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Action: 'create', calling method: .version_select at 0x7f8794346700>, body: {"server_group": {"name": "tempest-server-group-1490977768", "policies": ["affinity"]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:55.596820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4712135-e8c0-483d-ba68-2be43ea5f328 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:55.599868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4712135-e8c0-483d-ba68-2be43ea5f328 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:55.604403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4712135-e8c0-483d-ba68-2be43ea5f328 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:55.605107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4712135-e8c0-483d-ba68-2be43ea5f328 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:55.661005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-2ab1bcd0-4294-48d3-930a-e14649269bbf tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:13:55.677512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-2ab1bcd0-4294-48d3-930a-e14649269bbf tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:13:55.814936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-2ab1bcd0-4294-48d3-930a-e14649269bbf tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:13:55.822670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-2ab1bcd0-4294-48d3-930a-e14649269bbf tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:13:55.843907 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ab1bcd0-4294-48d3-930a-e14649269bbf tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.257883 Jul 26 14:13:55.844911 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1115/2079] 10.222.0.70 () {60 vars in 1173 bytes} [Tue Jul 26 14:13:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:55.854000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bd16aa42-cb99-4484-8b42-7d0dd9942f11 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:55.854976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bd16aa42-cb99-4484-8b42-7d0dd9942f11 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:55.866574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd16aa42-cb99-4484-8b42-7d0dd9942f11 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:55.867413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd16aa42-cb99-4484-8b42-7d0dd9942f11 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:55.870648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd16aa42-cb99-4484-8b42-7d0dd9942f11 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:55.871420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd16aa42-cb99-4484-8b42-7d0dd9942f11 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:56.180017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bd16aa42-cb99-4484-8b42-7d0dd9942f11 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:56.200547 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bd16aa42-cb99-4484-8b42-7d0dd9942f11 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1300 microversion: 2.1 time: 0.353701 Jul 26 14:13:56.201418 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1116/2080] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:55 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1300 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:56.211075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43918214-d84c-4432-9198-5883a0f5f62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:56.211875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-43918214-d84c-4432-9198-5883a0f5f62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:56.237997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43918214-d84c-4432-9198-5883a0f5f62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:56.239936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43918214-d84c-4432-9198-5883a0f5f62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:56.241186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43918214-d84c-4432-9198-5883a0f5f62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:56.241885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43918214-d84c-4432-9198-5883a0f5f62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:56.941540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a4712135-e8c0-483d-ba68-2be43ea5f328 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:56.955688 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a4712135-e8c0-483d-ba68-2be43ea5f328 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1484 microversion: 2.1 time: 1.394562 Jul 26 14:13:56.956591 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 965/2081] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:55 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1484 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:56.963451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b34ed497-c782-47a2-baaf-1b109a2c9a20 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b34ed497-c782-47a2-baaf-1b109a2c9a20 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 416 Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:56.969846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:13:56.974419 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:13:56.978638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b34ed497-c782-47a2-baaf-1b109a2c9a20 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:13:56.982966 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b34ed497-c782-47a2-baaf-1b109a2c9a20 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.021921 Jul 26 14:13:56.983419 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 966/2082] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:56 2022] POST /compute/v2.1/servers => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:13:56.993535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb0e0dd5-5355-41e6-b0e8-6ace7cbe6152 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Action: 'create', calling method: .version_select at 0x7f87944c4160>, body: {"server_group": {"name": "tempest-server-group-1490977768", "policies": ["affinity"]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:57.045107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-eb0e0dd5-5355-41e6-b0e8-6ace7cbe6152 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:13:57.063227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-eb0e0dd5-5355-41e6-b0e8-6ace7cbe6152 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:13:57.181106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-eb0e0dd5-5355-41e6-b0e8-6ace7cbe6152 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:13:57.194643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-eb0e0dd5-5355-41e6-b0e8-6ace7cbe6152 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:13:57.215198 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eb0e0dd5-5355-41e6-b0e8-6ace7cbe6152 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.230635 Jul 26 14:13:57.225550 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 967/2083] 10.222.0.70 () {60 vars in 1173 bytes} [Tue Jul 26 14:13:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:57.225550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-564d833f-b239-4e44-b7b2-cd9b91ba839c tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:57.225550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-564d833f-b239-4e44-b7b2-cd9b91ba839c tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:57.237896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-564d833f-b239-4e44-b7b2-cd9b91ba839c tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:57.239081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-564d833f-b239-4e44-b7b2-cd9b91ba839c tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:57.240509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-564d833f-b239-4e44-b7b2-cd9b91ba839c tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:57.240990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-564d833f-b239-4e44-b7b2-cd9b91ba839c tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:57.437660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-43918214-d84c-4432-9198-5883a0f5f62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] Lazy-loading 'services' on Instance uuid c6e53966-8644-4b0b-9429-dd23222bb79e {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:13:57.470235 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43918214-d84c-4432-9198-5883a0f5f62a tempest-LiveAutoBlockMigrationV225Test-872412450 tempest-LiveAutoBlockMigrationV225Test-872412450-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1968 microversion: 2.25 time: 1.266739 Jul 26 14:13:57.487075 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1117/2084] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:56 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1968 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:13:57.514334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9e437986-1aea-4d58-851d-2e90560907a2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f87876bbdc0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:57.588624 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9e437986-1aea-4d58-851d-2e90560907a2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1421 microversion: 2.1 time: 0.093527 Jul 26 14:13:57.597387 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1118/2085] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:57 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1421 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:57.597387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1416b3cf-1bc1-4b5c-878b-f4bd5b73dd4c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:57.597387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1416b3cf-1bc1-4b5c-878b-f4bd5b73dd4c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:57.603512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1416b3cf-1bc1-4b5c-878b-f4bd5b73dd4c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:57.604226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1416b3cf-1bc1-4b5c-878b-f4bd5b73dd4c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:57.605522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1416b3cf-1bc1-4b5c-878b-f4bd5b73dd4c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:57.605978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1416b3cf-1bc1-4b5c-878b-f4bd5b73dd4c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:58.039893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-564d833f-b239-4e44-b7b2-cd9b91ba839c tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:58.049108 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-564d833f-b239-4e44-b7b2-cd9b91ba839c tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1790 microversion: 2.1 time: 0.831850 Jul 26 14:13:58.049503 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 968/2086] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:57 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1790 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:58.055061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1168549784", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:58.115185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] validate_networks() for [('41f3a613-d66a-4287-9d9a-ba4316a2487f', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:13:58.165060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1416b3cf-1bc1-4b5c-878b-f4bd5b73dd4c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:58.174190 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1416b3cf-1bc1-4b5c-878b-f4bd5b73dd4c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.583388 Jul 26 14:13:58.182445 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1119/2087] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:57 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:58.195104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6f2a151d-591a-4321-b98a-00e597a4454a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:58.229024 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6f2a151d-591a-4321-b98a-00e597a4454a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/0bc1f098-9356-4c1e-99b0-f115941761c9" status: 204 len: 0 microversion: 2.1 time: 0.044360 Jul 26 14:13:58.230225 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1120/2088] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:13:58 2022] DELETE /compute/v2.1/os-server-groups/0bc1f098-9356-4c1e-99b0-f115941761c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:13:58.239811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-65634861-adda-4ae1-8dd7-166cd2c0dfb5 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:58.241331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-65634861-adda-4ae1-8dd7-166cd2c0dfb5 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:58.250552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65634861-adda-4ae1-8dd7-166cd2c0dfb5 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:58.251023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65634861-adda-4ae1-8dd7-166cd2c0dfb5 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:58.252320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65634861-adda-4ae1-8dd7-166cd2c0dfb5 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:58.252778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65634861-adda-4ae1-8dd7-166cd2c0dfb5 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:58.396380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-65634861-adda-4ae1-8dd7-166cd2c0dfb5 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:58.418002 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-65634861-adda-4ae1-8dd7-166cd2c0dfb5 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1300 microversion: 2.1 time: 0.184950 Jul 26 14:13:58.418661 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1121/2089] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:58 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1300 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:58.435496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2c77cca3-95a6-43ab-99c2-88507e9a18c0 req-0922cdc3-d59c-492c-954e-fffbd1f5b8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "name": "network-vif-unplugged", "status": "completed", "tag": "03fd6db5-e279-44da-b87e-1092a3814c97"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:58.448772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2c77cca3-95a6-43ab-99c2-88507e9a18c0 req-0922cdc3-d59c-492c-954e-fffbd1f5b8e4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:58.450171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2c77cca3-95a6-43ab-99c2-88507e9a18c0 req-0922cdc3-d59c-492c-954e-fffbd1f5b8e4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:58.466941 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2c77cca3-95a6-43ab-99c2-88507e9a18c0 req-0922cdc3-d59c-492c-954e-fffbd1f5b8e4 service nova] Creating event network-vif-unplugged:03fd6db5-e279-44da-b87e-1092a3814c97 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:13:58.473651 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2c77cca3-95a6-43ab-99c2-88507e9a18c0 req-0922cdc3-d59c-492c-954e-fffbd1f5b8e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051908 Jul 26 14:13:58.474517 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1122/2090] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:58.480234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d781d11-beec-42f9-8b42-da761c40183a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:58.480829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d781d11-beec-42f9-8b42-da761c40183a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:58.484143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:13:58.489313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d781d11-beec-42f9-8b42-da761c40183a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:58.489999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d781d11-beec-42f9-8b42-da761c40183a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:58.490934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d781d11-beec-42f9-8b42-da761c40183a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:58.491556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d781d11-beec-42f9-8b42-da761c40183a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:58.527635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d781d11-beec-42f9-8b42-da761c40183a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:13:58.639566 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d781d11-beec-42f9-8b42-da761c40183a tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 204 len: 0 microversion: 2.25 time: 0.162157 Jul 26 14:13:58.640461 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1123/2091] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:13:58 2022] DELETE /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:13:58.647354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-366a6559-5ae6-4589-8ed1-d16999e3bab1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787bcc670>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:58.700183 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-366a6559-5ae6-4589-8ed1-d16999e3bab1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 200 len: 1421 microversion: 2.1 time: 0.058328 Jul 26 14:13:58.701800 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1124/2092] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:13:58 2022] GET /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 1421 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:58.779739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-75cc2707-2e03-4d0d-b100-5e877eeb2ebf req-5f8760e3-15ec-47b1-9815-7e647398692e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "name": "network-vif-deleted", "tag": "f0e1d62c-bfec-42d3-88e2-91a796c3c780"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:13:58.794799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-75cc2707-2e03-4d0d-b100-5e877eeb2ebf req-5f8760e3-15ec-47b1-9815-7e647398692e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:58.795510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-75cc2707-2e03-4d0d-b100-5e877eeb2ebf req-5f8760e3-15ec-47b1-9815-7e647398692e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:58.812081 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-75cc2707-2e03-4d0d-b100-5e877eeb2ebf req-5f8760e3-15ec-47b1-9815-7e647398692e service nova] Creating event network-vif-deleted:f0e1d62c-bfec-42d3-88e2-91a796c3c780 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:13:58.818932 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-75cc2707-2e03-4d0d-b100-5e877eeb2ebf req-5f8760e3-15ec-47b1-9815-7e647398692e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112384 Jul 26 14:13:58.823254 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1125/2093] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:58.829921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0df5b3c-d955-48f5-9cae-7fabc284c72b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:58.830259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d0df5b3c-d955-48f5-9cae-7fabc284c72b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:58.843316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0df5b3c-d955-48f5-9cae-7fabc284c72b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:58.844836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0df5b3c-d955-48f5-9cae-7fabc284c72b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:58.845811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0df5b3c-d955-48f5-9cae-7fabc284c72b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:58.846453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0df5b3c-d955-48f5-9cae-7fabc284c72b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:59.435923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d0df5b3c-d955-48f5-9cae-7fabc284c72b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:13:59.451750 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d0df5b3c-d955-48f5-9cae-7fabc284c72b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.629113 Jul 26 14:13:59.453901 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1126/2094] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:58 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:13:59.473251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f61e836c-e61d-405d-b634-b49e9819ae8c tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:59.505237 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f61e836c-e61d-405d-b634-b49e9819ae8c tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.049537 Jul 26 14:13:59.506701 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1127/2095] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:13:59 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:13:59.514254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-35543200-4210-4235-9c66-2f8f964cb2fb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:13:59.515357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-35543200-4210-4235-9c66-2f8f964cb2fb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:13:59.527269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35543200-4210-4235-9c66-2f8f964cb2fb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:59.528557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35543200-4210-4235-9c66-2f8f964cb2fb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:59.530151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:13:59.530960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:13:59.531292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:13:59.531519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:13:59.532143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:13:59.532424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35543200-4210-4235-9c66-2f8f964cb2fb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:59.533216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35543200-4210-4235-9c66-2f8f964cb2fb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:59.544730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:59.547618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:59.549941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:13:59.557129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:13:59.604433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Getting quotas for project 2cce280cfb40401581a18078069bb592. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:13:59.615149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Getting quotas for user 58bff9719b9e4d9995199bd43fa118fd and project 2cce280cfb40401581a18078069bb592. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:13:59.639931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:13:59.649764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:13:59.784314 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a527c7c0-e1b9-4952-b438-dc75c33225b4 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.733207 Jul 26 14:13:59.801149 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 969/2096] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:13:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:13:59.810941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a0c85c1c-c087-41ff-b2f9-e07b0fdfd0d4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f87945d9040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:00.727888 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a0c85c1c-c087-41ff-b2f9-e07b0fdfd0d4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 204 len: 0 microversion: 2.1 time: 0.925471 Jul 26 14:14:00.729750 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 970/2097] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:13:59 2022] DELETE /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 0 bytes in 928 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:14:00.738590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-745b6020-ca0b-4899-b9a0-634dd3abb531 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:00.739828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-745b6020-ca0b-4899-b9a0-634dd3abb531 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:00.742027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35543200-4210-4235-9c66-2f8f964cb2fb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:00.750998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-745b6020-ca0b-4899-b9a0-634dd3abb531 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:00.752153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-745b6020-ca0b-4899-b9a0-634dd3abb531 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:00.754558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-745b6020-ca0b-4899-b9a0-634dd3abb531 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:00.758450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35543200-4210-4235-9c66-2f8f964cb2fb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:00.760163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35543200-4210-4235-9c66-2f8f964cb2fb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:00.761372 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-35543200-4210-4235-9c66-2f8f964cb2fb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1482 microversion: 2.25 time: 1.253255 Jul 26 14:14:00.767745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-745b6020-ca0b-4899-b9a0-634dd3abb531 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:00.776584 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1128/2098] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:13:59 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1482 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:00.802631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8df8b9bf-9d39-41ab-9365-50966bd72db8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:00.803280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8df8b9bf-9d39-41ab-9365-50966bd72db8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:00.810279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8df8b9bf-9d39-41ab-9365-50966bd72db8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:00.810750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8df8b9bf-9d39-41ab-9365-50966bd72db8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:00.811557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8df8b9bf-9d39-41ab-9365-50966bd72db8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:00.812224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8df8b9bf-9d39-41ab-9365-50966bd72db8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:01.367475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-745b6020-ca0b-4899-b9a0-634dd3abb531 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:01.373258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8df8b9bf-9d39-41ab-9365-50966bd72db8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:01.391503 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-745b6020-ca0b-4899-b9a0-634dd3abb531 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1654 microversion: 2.1 time: 0.658363 Jul 26 14:14:01.391913 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8df8b9bf-9d39-41ab-9365-50966bd72db8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1367 microversion: 2.1 time: 0.613806 Jul 26 14:14:01.398184 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 971/2099] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:00 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1654 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:01.405990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0ad8a73-80a0-4277-a4a6-0fc072f4ff97 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:01.407892 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1129/2100] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:00 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1367 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:01.416377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56b0dbcf-35fa-415f-a63f-67855820888b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1300049782", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": -1, "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:01.440520 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-56b0dbcf-35fa-415f-a63f-67855820888b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Flavor -1 could not be found. Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56b0dbcf-35fa-415f-a63f-67855820888b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 206 Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1300049782", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": -1, "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: exception: Flavor -1 could not be found. Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1300049782', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': -1, 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:01.446349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 26 14:14:01.450467 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:01.457821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56b0dbcf-35fa-415f-a63f-67855820888b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:01.458932 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56b0dbcf-35fa-415f-a63f-67855820888b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.049824 Jul 26 14:14:01.465694 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1130/2101] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:01 2022] POST /compute/v2.1/servers => generated 73 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:14:01.474663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a587df25-b36a-47b3-9ca6-4870a38e7b74 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:01.478569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a587df25-b36a-47b3-9ca6-4870a38e7b74 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:01.484885 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c0ad8a73-80a0-4277-a4a6-0fc072f4ff97 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/1147f6ab-8034-4af3-b26a-4d5262b666e2" status: 204 len: 0 microversion: 2.1 time: 0.085135 Jul 26 14:14:01.485492 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 972/2102] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:14:01 2022] DELETE /compute/v2.1/os-server-groups/1147f6ab-8034-4af3-b26a-4d5262b666e2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:14:01.499268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-5408c2a3-a22d-4468-99ae-e6ac21827594 req-3be0e815-91c6-42ac-ba11-bc3b3ad6d7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "name": "network-vif-unplugged", "status": "completed", "tag": "1b9b8b4a-4059-4dc5-8338-240b5735b517"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:01.508529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a587df25-b36a-47b3-9ca6-4870a38e7b74 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:01.509060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a587df25-b36a-47b3-9ca6-4870a38e7b74 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:01.509786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a587df25-b36a-47b3-9ca6-4870a38e7b74 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:01.510239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a587df25-b36a-47b3-9ca6-4870a38e7b74 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:01.526394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5408c2a3-a22d-4468-99ae-e6ac21827594 req-3be0e815-91c6-42ac-ba11-bc3b3ad6d7fd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:01.528485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5408c2a3-a22d-4468-99ae-e6ac21827594 req-3be0e815-91c6-42ac-ba11-bc3b3ad6d7fd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:01.560411 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-5408c2a3-a22d-4468-99ae-e6ac21827594 req-3be0e815-91c6-42ac-ba11-bc3b3ad6d7fd service nova] Creating event network-vif-unplugged:1b9b8b4a-4059-4dc5-8338-240b5735b517 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:14:01.570392 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-5408c2a3-a22d-4468-99ae-e6ac21827594 req-3be0e815-91c6-42ac-ba11-bc3b3ad6d7fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077212 Jul 26 14:14:01.574997 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 973/2103] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:01.581229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b55dc2d1-869b-4e36-8959-28209e1f80aa tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:01.586760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b55dc2d1-869b-4e36-8959-28209e1f80aa tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:01.598486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b55dc2d1-869b-4e36-8959-28209e1f80aa tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:01.599623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b55dc2d1-869b-4e36-8959-28209e1f80aa tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:01.600756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b55dc2d1-869b-4e36-8959-28209e1f80aa tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:01.601527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b55dc2d1-869b-4e36-8959-28209e1f80aa tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:01.639505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b55dc2d1-869b-4e36-8959-28209e1f80aa tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:14:01.840841 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b55dc2d1-869b-4e36-8959-28209e1f80aa tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 204 len: 0 microversion: 2.1 time: 0.264045 Jul 26 14:14:01.841580 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 974/2104] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:14:01 2022] DELETE /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:14:01.852276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-87d3d50a-cdb3-405d-a599-dc9e08b9603d req-45ef16aa-a5f9-4917-adff-2134d13b142b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "name": "network-vif-deleted", "tag": "1b9b8b4a-4059-4dc5-8338-240b5735b517"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:01.869660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a587df25-b36a-47b3-9ca6-4870a38e7b74 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:01.885406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-87d3d50a-cdb3-405d-a599-dc9e08b9603d req-45ef16aa-a5f9-4917-adff-2134d13b142b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:01.887764 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a587df25-b36a-47b3-9ca6-4870a38e7b74 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1272 microversion: 2.1 time: 0.419926 Jul 26 14:14:01.891452 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1131/2105] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:01 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1272 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:01.891660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-87d3d50a-cdb3-405d-a599-dc9e08b9603d req-45ef16aa-a5f9-4917-adff-2134d13b142b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:01.908427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-12dbb08f-6db2-4f00-9921-d400630233e3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:01.910863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-12dbb08f-6db2-4f00-9921-d400630233e3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:01.927814 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-87d3d50a-cdb3-405d-a599-dc9e08b9603d req-45ef16aa-a5f9-4917-adff-2134d13b142b service nova] Creating event network-vif-deleted:1b9b8b4a-4059-4dc5-8338-240b5735b517 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:14:01.935886 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-87d3d50a-cdb3-405d-a599-dc9e08b9603d req-45ef16aa-a5f9-4917-adff-2134d13b142b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089370 Jul 26 14:14:01.942160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dbb08f-6db2-4f00-9921-d400630233e3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:01.942726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dbb08f-6db2-4f00-9921-d400630233e3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:01.943874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dbb08f-6db2-4f00-9921-d400630233e3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:01.944252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dbb08f-6db2-4f00-9921-d400630233e3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:01.948257 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 975/2106] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:01.965252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-db60de54-b9cd-42d2-a7ca-360d730479af tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:02.052658 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-db60de54-b9cd-42d2-a7ca-360d730479af tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.098909 Jul 26 14:14:02.053962 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 976/2107] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:14:01 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:02.073217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bc1ca84e-333a-4f12-8c7b-3d5bddafddb5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:02.077243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bc1ca84e-333a-4f12-8c7b-3d5bddafddb5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:02.116461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc1ca84e-333a-4f12-8c7b-3d5bddafddb5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:02.117947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc1ca84e-333a-4f12-8c7b-3d5bddafddb5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:02.118850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc1ca84e-333a-4f12-8c7b-3d5bddafddb5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:02.119591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc1ca84e-333a-4f12-8c7b-3d5bddafddb5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:02.282627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bc1ca84e-333a-4f12-8c7b-3d5bddafddb5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:02.301833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bc1ca84e-333a-4f12-8c7b-3d5bddafddb5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:02.309733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bc1ca84e-333a-4f12-8c7b-3d5bddafddb5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:02.312078 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bc1ca84e-333a-4f12-8c7b-3d5bddafddb5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1440 microversion: 2.25 time: 0.255419 Jul 26 14:14:02.312704 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 977/2108] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:02 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1440 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:02.327119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81042404-3118-40fd-a227-eb6d137002ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Action: 'create', calling method: .version_select at 0x7f8787ed8820>, body: {"server_group": {"name": "tempest-server-group-1801564031", "policies": ["affinity"]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:02.422701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-81042404-3118-40fd-a227-eb6d137002ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:14:02.449969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-81042404-3118-40fd-a227-eb6d137002ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:14:02.528820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:02.539157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-81042404-3118-40fd-a227-eb6d137002ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:14:02.551528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-81042404-3118-40fd-a227-eb6d137002ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:14:02.572614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-12dbb08f-6db2-4f00-9921-d400630233e3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:02.580143 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-81042404-3118-40fd-a227-eb6d137002ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.266270 Jul 26 14:14:02.581384 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 978/2109] 10.222.0.70 () {60 vars in 1173 bytes} [Tue Jul 26 14:14:02 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:02.594909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1224216239", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "08dc4566-921c-4f62-8f9a-1a9e3f005bb9"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:02.596539 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-12dbb08f-6db2-4f00-9921-d400630233e3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.696864 Jul 26 14:14:02.597942 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1132/2110] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:01 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:02.620694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:02.621964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:02.649328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:02.650055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:02.651630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:02.655072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:02.686590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] validate_networks() for [('08dc4566-921c-4f62-8f9a-1a9e3f005bb9', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:14:02.761830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:02.762298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:02.762768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lazy-loading 'fault' on Instance uuid 11b7e47e-554f-413c-8876-e08156867fa7 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:14:03.029735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:03.048751 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23061949-5dd1-4a38-a0fa-ccdd6691b6ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 200 len: 1302 microversion: 2.1 time: 0.448958 Jul 26 14:14:03.056719 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1133/2111] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:02 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 1302 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:03.070926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f37fabe1-d415-4d2a-9e94-6acb26472664 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:03.071564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f37fabe1-d415-4d2a-9e94-6acb26472664 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:03.088504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f37fabe1-d415-4d2a-9e94-6acb26472664 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:03.089017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f37fabe1-d415-4d2a-9e94-6acb26472664 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:03.090225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f37fabe1-d415-4d2a-9e94-6acb26472664 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:03.097922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f37fabe1-d415-4d2a-9e94-6acb26472664 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:03.459926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f37fabe1-d415-4d2a-9e94-6acb26472664 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:03.463176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:03.471169 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f37fabe1-d415-4d2a-9e94-6acb26472664 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1367 microversion: 2.1 time: 0.412764 Jul 26 14:14:03.485656 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1134/2112] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:03 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:03.492866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d81c2d05-daf3-4f2d-af8e-93df58cef0b1 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:03.530617 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d81c2d05-daf3-4f2d-af8e-93df58cef0b1 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/e7dd3dc6-0357-4c05-9661-6b90b33696af" status: 204 len: 0 microversion: 2.1 time: 0.043161 Jul 26 14:14:03.531896 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1135/2113] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:14:03 2022] DELETE /compute/v2.1/os-server-groups/e7dd3dc6-0357-4c05-9661-6b90b33696af => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:14:03.542052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f9cbe2e-51a7-4c09-9f9d-dcd24c0be566 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:03.543352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f9cbe2e-51a7-4c09-9f9d-dcd24c0be566 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:03.552951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f9cbe2e-51a7-4c09-9f9d-dcd24c0be566 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:03.553738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f9cbe2e-51a7-4c09-9f9d-dcd24c0be566 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:03.554806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f9cbe2e-51a7-4c09-9f9d-dcd24c0be566 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:03.555448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f9cbe2e-51a7-4c09-9f9d-dcd24c0be566 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:03.716166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:14:03.716702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:14:03.717158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:14:03.717645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:14:03.718333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:14:03.734209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:03.734843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:03.736567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:03.737093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:03.762976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Getting quotas for project af3d0a242a34482d8737db7862279e87. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:14:03.772725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Getting quotas for user f94de8d57f854570b3ceda6ae5e7b9ae and project af3d0a242a34482d8737db7862279e87. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:14:03.773552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f9cbe2e-51a7-4c09-9f9d-dcd24c0be566 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:03.783515 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f9cbe2e-51a7-4c09-9f9d-dcd24c0be566 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.250014 Jul 26 14:14:03.785552 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1136/2114] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:03 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:03.793849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:14:03.797896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:14:03.801453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9679231-7d27-47b7-881b-f6e81b17327a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:03.802156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b9679231-7d27-47b7-881b-f6e81b17327a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:03.813809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9679231-7d27-47b7-881b-f6e81b17327a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:03.816973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9679231-7d27-47b7-881b-f6e81b17327a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:03.821224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9679231-7d27-47b7-881b-f6e81b17327a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:03.822064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9679231-7d27-47b7-881b-f6e81b17327a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:03.898929 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-82d7df19-7363-463e-90ef-2e365e899ecc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.314709 Jul 26 14:14:03.901802 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 979/2115] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:14:03.915305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-188d521c-df1c-4cf1-9f79-7947e4422ddb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:03.917617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-188d521c-df1c-4cf1-9f79-7947e4422ddb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:03.928842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-188d521c-df1c-4cf1-9f79-7947e4422ddb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:03.929317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-188d521c-df1c-4cf1-9f79-7947e4422ddb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:03.930825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-188d521c-df1c-4cf1-9f79-7947e4422ddb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:03.930825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-188d521c-df1c-4cf1-9f79-7947e4422ddb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:04.069978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-188d521c-df1c-4cf1-9f79-7947e4422ddb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:04.083873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-188d521c-df1c-4cf1-9f79-7947e4422ddb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:04.089813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-188d521c-df1c-4cf1-9f79-7947e4422ddb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:04.091633 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-188d521c-df1c-4cf1-9f79-7947e4422ddb tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1265 microversion: 2.25 time: 0.188166 Jul 26 14:14:04.103981 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 980/2116] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:03 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:04.117377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f04dedce-5137-4d53-86e6-c18eecdf1a1e tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:04.182500 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f04dedce-5137-4d53-86e6-c18eecdf1a1e tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.088180 Jul 26 14:14:04.183334 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 981/2117] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:14:04 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:04.193340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-84c2d168-85f4-4fda-b6cb-270cedd346f2 req-5ab71dde-f224-4a8d-9a32-163bed02ef71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d63bc9c-464d-40bc-84f1-ffc106ed6cb7", "name": "network-vif-unplugged", "status": "completed", "tag": "67ed775a-ab8d-4693-bb98-f833fe4899fa"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:04.204513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b9679231-7d27-47b7-881b-f6e81b17327a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:04.211671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-84c2d168-85f4-4fda-b6cb-270cedd346f2 req-5ab71dde-f224-4a8d-9a32-163bed02ef71 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:04.212167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-84c2d168-85f4-4fda-b6cb-270cedd346f2 req-5ab71dde-f224-4a8d-9a32-163bed02ef71 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:04.216927 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b9679231-7d27-47b7-881b-f6e81b17327a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1314 microversion: 2.1 time: 0.429995 Jul 26 14:14:04.217696 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1137/2118] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:03 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:04.224212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f5388b35-d86a-46d3-a628-96a55b788f47 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:04.225370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f5388b35-d86a-46d3-a628-96a55b788f47 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:04.246731 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-84c2d168-85f4-4fda-b6cb-270cedd346f2 req-5ab71dde-f224-4a8d-9a32-163bed02ef71 service nova] Creating event network-vif-unplugged:67ed775a-ab8d-4693-bb98-f833fe4899fa for instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 on n-h2-833090-9 Jul 26 14:14:04.253706 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-84c2d168-85f4-4fda-b6cb-270cedd346f2 req-5ab71dde-f224-4a8d-9a32-163bed02ef71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067983 Jul 26 14:14:04.258966 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 982/2119] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:04.269297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ffd427c1-0117-4647-9962-42b86e152e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1143957898", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ffd427c1-0117-4647-9962-42b86e152e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 173 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1143957898", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1143957898', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi -1 Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:14:04.273789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 26 14:14:04.278496 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.280385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ffd427c1-0117-4647-9962-42b86e152e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:04.282091 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ffd427c1-0117-4647-9962-42b86e152e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.020646 Jul 26 14:14:04.283769 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 983/2120] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:04 2022] POST /compute/v2.1/servers => generated 145 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:14:04.292853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-31b5769e-e022-4fa8-bce5-cd15f2ad4ca3 req-ff69910c-064b-4802-b90a-a7b02c15b356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b7e47e-554f-413c-8876-e08156867fa7", "name": "network-vif-deleted", "tag": "03fd6db5-e279-44da-b87e-1092a3814c97"}, {"server_uuid": "c6e53966-8644-4b0b-9429-dd23222bb79e", "name": "network-vif-deleted", "tag": "d89bd279-7459-4603-9b92-9e0b93981d08"}, {"name": "network-changed", "server_uuid": "1e90299d-2a73-4c84-95bc-a08fa220c671", "tag": "cbe2651a-3688-408d-8285-f4a58c062b03"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:04.316973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-31b5769e-e022-4fa8-bce5-cd15f2ad4ca3 req-ff69910c-064b-4802-b90a-a7b02c15b356 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:04.318290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-31b5769e-e022-4fa8-bce5-cd15f2ad4ca3 req-ff69910c-064b-4802-b90a-a7b02c15b356 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:04.358474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f5388b35-d86a-46d3-a628-96a55b788f47 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:04.366973 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-31b5769e-e022-4fa8-bce5-cd15f2ad4ca3 req-ff69910c-064b-4802-b90a-a7b02c15b356 service nova] Creating event network-vif-deleted:03fd6db5-e279-44da-b87e-1092a3814c97 for instance 11b7e47e-554f-413c-8876-e08156867fa7 on n-h1-833090-9 Jul 26 14:14:04.370781 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-31b5769e-e022-4fa8-bce5-cd15f2ad4ca3 req-ff69910c-064b-4802-b90a-a7b02c15b356 service nova] Creating event network-vif-deleted:d89bd279-7459-4603-9b92-9e0b93981d08 for instance c6e53966-8644-4b0b-9429-dd23222bb79e on n-h1-833090-9 Jul 26 14:14:04.371443 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-31b5769e-e022-4fa8-bce5-cd15f2ad4ca3 req-ff69910c-064b-4802-b90a-a7b02c15b356 service nova] Creating event network-changed:cbe2651a-3688-408d-8285-f4a58c062b03 for instance 1e90299d-2a73-4c84-95bc-a08fa220c671 on n-h2-833090-9 Jul 26 14:14:04.374661 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f5388b35-d86a-46d3-a628-96a55b788f47 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1208 microversion: 2.1 time: 0.151538 Jul 26 14:14:04.375304 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1138/2121] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:04 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1208 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:04.413542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-31c12921-2d84-46ed-b438-406054a23ad7 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:04.415674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-31c12921-2d84-46ed-b438-406054a23ad7 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:04.431016 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-31b5769e-e022-4fa8-bce5-cd15f2ad4ca3 req-ff69910c-064b-4802-b90a-a7b02c15b356 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.144906 Jul 26 14:14:04.440158 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 984/2122] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:04.459865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31c12921-2d84-46ed-b438-406054a23ad7 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:04.461873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31c12921-2d84-46ed-b438-406054a23ad7 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:04.464959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31c12921-2d84-46ed-b438-406054a23ad7 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:04.469672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31c12921-2d84-46ed-b438-406054a23ad7 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:04.473043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c9a9d280-bf68-4c77-95b8-3914f03ec25e req-97a68b95-cc1c-4a0d-b0f6-f6276d93f83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150082ea-2baf-4ade-bbbf-2a9ad70f7fdd", "tag": "4f0b57e3-5498-4efd-a970-ff5c5608f91f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:04.486069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c9a9d280-bf68-4c77-95b8-3914f03ec25e req-97a68b95-cc1c-4a0d-b0f6-f6276d93f83a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:04.489619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c9a9d280-bf68-4c77-95b8-3914f03ec25e req-97a68b95-cc1c-4a0d-b0f6-f6276d93f83a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:04.494448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:04.504583 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c9a9d280-bf68-4c77-95b8-3914f03ec25e req-97a68b95-cc1c-4a0d-b0f6-f6276d93f83a service nova] Creating event network-changed:4f0b57e3-5498-4efd-a970-ff5c5608f91f for instance 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd on n-h1-833090-9 Jul 26 14:14:04.510741 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c9a9d280-bf68-4c77-95b8-3914f03ec25e req-97a68b95-cc1c-4a0d-b0f6-f6276d93f83a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066304 Jul 26 14:14:04.512076 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 985/2123] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:04.515293 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-31c12921-2d84-46ed-b438-406054a23ad7 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] HTTP exception thrown: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:14:04.519495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0bb0069b-bc31-42cf-81ef-32fc55ab37ab tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Action: 'create', calling method: .version_select at 0x7f879441b280>, body: {"server_group": {"name": "tempest-server-group-1545545111", "policies": ["anti-affinity"]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-31c12921-2d84-46ed-b438-406054a23ad7 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Request method failure captured: Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 HTTP/1.1 Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZWN5DLm4GNqRphjcNaehrdwmm53wyL37lM4DzqyFwM3ll5OQrFVLHHlsCfHiob_s5LZ2unHPn-toKxHKI69t4NQ_2GnjEu5Nwx01soaK6yLzUojrSJ8-_74mArH7vc22ufDRADAp7KWj-UOId_mELW-KxmGOxI4WJLbO2hoLaND5c Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0daac0aaada2453f84fdb257106f12ae", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}] Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestMultiNic-1967819980 Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: cf1430124f9f4c099944aad81234f6de Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '11b7e47e-554f-413c-8876-e08156867fa7'} Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:04.521311 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.525525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:04.525525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:04.525525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:04.525525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:04.525525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:04.525525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:14:04.525525 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:04.532385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-31c12921-2d84-46ed-b438-406054a23ad7 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Returning 404 to user: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:04.537457 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-31c12921-2d84-46ed-b438-406054a23ad7 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 404 len: 111 microversion: 2.1 time: 0.156506 Jul 26 14:14:04.539522 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1139/2124] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:04 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:04.548942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0bb0069b-bc31-42cf-81ef-32fc55ab37ab tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:14:04.554408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d085f0a-afa6-4339-8303-b530e07ac606 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:04.555041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d085f0a-afa6-4339-8303-b530e07ac606 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:04.557765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0bb0069b-bc31-42cf-81ef-32fc55ab37ab tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:14:04.576646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d085f0a-afa6-4339-8303-b530e07ac606 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:04.577666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d085f0a-afa6-4339-8303-b530e07ac606 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:04.580189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d085f0a-afa6-4339-8303-b530e07ac606 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:04.583771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d085f0a-afa6-4339-8303-b530e07ac606 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:04.665618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0bb0069b-bc31-42cf-81ef-32fc55ab37ab tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:14:04.679393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0bb0069b-bc31-42cf-81ef-32fc55ab37ab tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_groups'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:14:04.724180 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0bb0069b-bc31-42cf-81ef-32fc55ab37ab tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.210516 Jul 26 14:14:04.725114 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 986/2125] 10.222.0.70 () {60 vars in 1173 bytes} [Tue Jul 26 14:14:04 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:04.730413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e50281d0-2d66-4069-b74a-be669ad8b193 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:04.731675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e50281d0-2d66-4069-b74a-be669ad8b193 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:04.738552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e50281d0-2d66-4069-b74a-be669ad8b193 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:04.739081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e50281d0-2d66-4069-b74a-be669ad8b193 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:04.740124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e50281d0-2d66-4069-b74a-be669ad8b193 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:04.740502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e50281d0-2d66-4069-b74a-be669ad8b193 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:05.235794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d085f0a-afa6-4339-8303-b530e07ac606 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:05.249115 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d085f0a-afa6-4339-8303-b530e07ac606 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.707930 Jul 26 14:14:05.249616 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1140/2126] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:04 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:05.256465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-14a76ac1-9fa1-4ff9-9da8-e6c85a36f682 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:05.295259 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-14a76ac1-9fa1-4ff9-9da8-e6c85a36f682 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8" status: 204 len: 0 microversion: 2.1 time: 0.043940 Jul 26 14:14:05.296370 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1141/2127] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:14:05 2022] DELETE /compute/v2.1/os-server-groups/b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:14:05.308365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d6649bd8-e071-40f4-a5e1-34753d2e1c81 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:05.308457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d6649bd8-e071-40f4-a5e1-34753d2e1c81 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:05.315540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6649bd8-e071-40f4-a5e1-34753d2e1c81 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:05.317148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6649bd8-e071-40f4-a5e1-34753d2e1c81 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:05.317148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6649bd8-e071-40f4-a5e1-34753d2e1c81 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:05.317676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6649bd8-e071-40f4-a5e1-34753d2e1c81 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:05.344974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e50281d0-2d66-4069-b74a-be669ad8b193 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:05.357929 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e50281d0-2d66-4069-b74a-be669ad8b193 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1367 microversion: 2.1 time: 0.631469 Jul 26 14:14:05.371989 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 987/2128] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:04 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1367 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:05.371989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6199e563-f9a6-4cf9-b401-a9d9a21f25bc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:05.371989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6199e563-f9a6-4cf9-b401-a9d9a21f25bc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:05.377227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6199e563-f9a6-4cf9-b401-a9d9a21f25bc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:05.378254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6199e563-f9a6-4cf9-b401-a9d9a21f25bc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:05.379825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6199e563-f9a6-4cf9-b401-a9d9a21f25bc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:05.380518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6199e563-f9a6-4cf9-b401-a9d9a21f25bc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:05.442315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d6649bd8-e071-40f4-a5e1-34753d2e1c81 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:05.458234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d6649bd8-e071-40f4-a5e1-34753d2e1c81 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:05.459921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d6649bd8-e071-40f4-a5e1-34753d2e1c81 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:05.463762 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d6649bd8-e071-40f4-a5e1-34753d2e1c81 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1265 microversion: 2.25 time: 0.160645 Jul 26 14:14:05.465618 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1142/2129] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:05 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:05.470732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-438bf2d0-07e9-471b-ac5f-55fe4fc46a95 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:05.471558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-438bf2d0-07e9-471b-ac5f-55fe4fc46a95 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:05.482342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-438bf2d0-07e9-471b-ac5f-55fe4fc46a95 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:05.483369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-438bf2d0-07e9-471b-ac5f-55fe4fc46a95 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:05.484644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-438bf2d0-07e9-471b-ac5f-55fe4fc46a95 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:05.485171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-438bf2d0-07e9-471b-ac5f-55fe4fc46a95 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:06.201993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6199e563-f9a6-4cf9-b401-a9d9a21f25bc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:06.226538 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6199e563-f9a6-4cf9-b401-a9d9a21f25bc tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1314 microversion: 2.1 time: 0.865082 Jul 26 14:14:06.227406 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 988/2130] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:05 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:06.242549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20c4facd-1583-43ac-baec-9c9087a71f5b tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:06.258816 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-20c4facd-1583-43ac-baec-9c9087a71f5b tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.023789 Jul 26 14:14:06.260376 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 989/2131] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:14:06 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:06.265715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cf8fcb52-dc93-4abc-b247-31ea04f2b2fd tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:06.266534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cf8fcb52-dc93-4abc-b247-31ea04f2b2fd tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:06.273289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-438bf2d0-07e9-471b-ac5f-55fe4fc46a95 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:06.275203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf8fcb52-dc93-4abc-b247-31ea04f2b2fd tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:06.276968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf8fcb52-dc93-4abc-b247-31ea04f2b2fd tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:06.278220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf8fcb52-dc93-4abc-b247-31ea04f2b2fd tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:06.278661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf8fcb52-dc93-4abc-b247-31ea04f2b2fd tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:06.288293 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-438bf2d0-07e9-471b-ac5f-55fe4fc46a95 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.821234 Jul 26 14:14:06.302616 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1143/2132] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:05 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:06.383855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1096316832", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "53a4c6e4-932e-4e93-98e2-9f5eb52679cb"}]}, "os:scheduler_hints": {"group": "a9b97425-739c-4eda-85e0-d9eb8c104646"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:06.454127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cf8fcb52-dc93-4abc-b247-31ea04f2b2fd tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:06.480655 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cf8fcb52-dc93-4abc-b247-31ea04f2b2fd tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1266 microversion: 2.1 time: 0.218884 Jul 26 14:14:06.481282 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 990/2133] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:06 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:06.491682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b942e6f4-38aa-495c-acd5-c23ccfd1ffbd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:06.494546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b942e6f4-38aa-495c-acd5-c23ccfd1ffbd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:06.505366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] validate_networks() for [('53a4c6e4-932e-4e93-98e2-9f5eb52679cb', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:14:06.512987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b942e6f4-38aa-495c-acd5-c23ccfd1ffbd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:06.515214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b942e6f4-38aa-495c-acd5-c23ccfd1ffbd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:06.516131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b942e6f4-38aa-495c-acd5-c23ccfd1ffbd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:06.516576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b942e6f4-38aa-495c-acd5-c23ccfd1ffbd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:07.092309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b942e6f4-38aa-495c-acd5-c23ccfd1ffbd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:07.105024 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b942e6f4-38aa-495c-acd5-c23ccfd1ffbd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1367 microversion: 2.1 time: 0.622529 Jul 26 14:14:07.115977 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 991/2134] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:06 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1367 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:07.125303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-77b47320-3e6f-4faa-9fbc-652a92058ca3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-592592436", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:07.125834 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-77b47320-3e6f-4faa-9fbc-652a92058ca3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-77b47320-3e6f-4faa-9fbc-652a92058ca3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 215 Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-592592436", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-592592436', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:07.127483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:07.142957 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:07.142957 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:07.142957 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:07.142957 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:07.142957 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:07.142957 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 26 14:14:07.142957 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:07.142957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-77b47320-3e6f-4faa-9fbc-652a92058ca3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:07.142957 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-77b47320-3e6f-4faa-9fbc-652a92058ca3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.021973 Jul 26 14:14:07.142957 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 992/2135] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:07 2022] POST /compute/v2.1/servers => generated 123 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:14:07.157115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a5054f2c-760f-4fd7-9d3c-9b5fe62cb225 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:07.157763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a5054f2c-760f-4fd7-9d3c-9b5fe62cb225 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:07.181566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5054f2c-760f-4fd7-9d3c-9b5fe62cb225 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:07.182026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5054f2c-760f-4fd7-9d3c-9b5fe62cb225 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:07.182834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5054f2c-760f-4fd7-9d3c-9b5fe62cb225 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:07.183282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5054f2c-760f-4fd7-9d3c-9b5fe62cb225 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:07.464737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a5054f2c-760f-4fd7-9d3c-9b5fe62cb225 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:07.477731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a5054f2c-760f-4fd7-9d3c-9b5fe62cb225 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:07.479275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a5054f2c-760f-4fd7-9d3c-9b5fe62cb225 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:07.494469 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a5054f2c-760f-4fd7-9d3c-9b5fe62cb225 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1265 microversion: 2.25 time: 0.356368 Jul 26 14:14:07.495117 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 993/2136] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:07 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1265 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:07.512304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4c40c754-073f-4316-9f9a-b1b877122639 req-46606e14-e456-4c53-87c2-a30a53b630bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d63bc9c-464d-40bc-84f1-ffc106ed6cb7", "name": "network-vif-deleted", "tag": "67ed775a-ab8d-4693-bb98-f833fe4899fa"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:07.554965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4c40c754-073f-4316-9f9a-b1b877122639 req-46606e14-e456-4c53-87c2-a30a53b630bc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:07.569469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4c40c754-073f-4316-9f9a-b1b877122639 req-46606e14-e456-4c53-87c2-a30a53b630bc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:07.607560 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4c40c754-073f-4316-9f9a-b1b877122639 req-46606e14-e456-4c53-87c2-a30a53b630bc service nova] Creating event network-vif-deleted:67ed775a-ab8d-4693-bb98-f833fe4899fa for instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 on n-h2-833090-9 Jul 26 14:14:07.616736 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4c40c754-073f-4316-9f9a-b1b877122639 req-46606e14-e456-4c53-87c2-a30a53b630bc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111917 Jul 26 14:14:07.618656 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 994/2137] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:07.628259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0f700f3d-d55b-4a4e-8718-72ec2a4ee3f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:07.629351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0f700f3d-d55b-4a4e-8718-72ec2a4ee3f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:07.640525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f700f3d-d55b-4a4e-8718-72ec2a4ee3f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:07.641633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f700f3d-d55b-4a4e-8718-72ec2a4ee3f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:07.642731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f700f3d-d55b-4a4e-8718-72ec2a4ee3f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:07.643999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f700f3d-d55b-4a4e-8718-72ec2a4ee3f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:07.970736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0f700f3d-d55b-4a4e-8718-72ec2a4ee3f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:07.982009 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0f700f3d-d55b-4a4e-8718-72ec2a4ee3f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.361544 Jul 26 14:14:08.001196 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 995/2138] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:07 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:08.008016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0819912a-5c4b-4fac-b841-b0c53b6cb21e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:08.015884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0819912a-5c4b-4fac-b841-b0c53b6cb21e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:08.034793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0819912a-5c4b-4fac-b841-b0c53b6cb21e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:08.035493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0819912a-5c4b-4fac-b841-b0c53b6cb21e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:08.036445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0819912a-5c4b-4fac-b841-b0c53b6cb21e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:08.036890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0819912a-5c4b-4fac-b841-b0c53b6cb21e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:08.515821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:14:08.516973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:14:08.519940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:14:08.521139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:14:08.529452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:14:08.560920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:08.561796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:08.562784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:08.563553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:08.602015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:14:08.609852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:14:08.637675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:14:08.640434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:14:08.719669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119479) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 26 14:14:08.767151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_group_members'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:14:08.777166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_group_members'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:14:08.806584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0819912a-5c4b-4fac-b841-b0c53b6cb21e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:08.824521 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0819912a-5c4b-4fac-b841-b0c53b6cb21e tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1314 microversion: 2.1 time: 0.815234 Jul 26 14:14:08.825535 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 996/2139] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:08 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:08.834634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5d0a8e85-7ad5-4821-9c09-494af9258b6e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:08.837495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d0a8e85-7ad5-4821-9c09-494af9258b6e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:08.858363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d0a8e85-7ad5-4821-9c09-494af9258b6e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:08.859462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d0a8e85-7ad5-4821-9c09-494af9258b6e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:08.861654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d0a8e85-7ad5-4821-9c09-494af9258b6e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:08.864935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d0a8e85-7ad5-4821-9c09-494af9258b6e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:08.899021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for project 4ec89602d0304041872e521e0633922d. Resources: {'server_group_members'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:14:08.912591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:08.913776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Getting quotas for user 7c2039c3b11f49cb91c5ebd9319d5758 and project 4ec89602d0304041872e521e0633922d. Resources: {'server_group_members'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:14:08.990872 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-20df32a2-d3bc-4f96-afd7-97ad56e73886 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611110 Jul 26 14:14:08.997665 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1144/2140] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:14:09.014209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0ce9ff20-ec93-44f9-a17c-89d7ae54d1de tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:09.015083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0ce9ff20-ec93-44f9-a17c-89d7ae54d1de tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:09.047482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ce9ff20-ec93-44f9-a17c-89d7ae54d1de tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:09.048363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ce9ff20-ec93-44f9-a17c-89d7ae54d1de tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:09.049716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ce9ff20-ec93-44f9-a17c-89d7ae54d1de tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:09.051132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ce9ff20-ec93-44f9-a17c-89d7ae54d1de tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:09.545049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ce9ff20-ec93-44f9-a17c-89d7ae54d1de tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:09.558173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5d0a8e85-7ad5-4821-9c09-494af9258b6e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:09.574612 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0ce9ff20-ec93-44f9-a17c-89d7ae54d1de tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.579453 Jul 26 14:14:09.576202 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5d0a8e85-7ad5-4821-9c09-494af9258b6e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1308 microversion: 2.1 time: 0.743791 Jul 26 14:14:09.578028 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1145/2141] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:08 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:09.597761 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 997/2142] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:08 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1308 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:09.622379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ddc786a-a9a0-4843-9e4a-84218f991be9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:09.624543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1ddc786a-a9a0-4843-9e4a-84218f991be9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:09.653126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ddc786a-a9a0-4843-9e4a-84218f991be9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:09.656084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ddc786a-a9a0-4843-9e4a-84218f991be9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:09.658086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ddc786a-a9a0-4843-9e4a-84218f991be9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:09.660275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ddc786a-a9a0-4843-9e4a-84218f991be9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:09.873957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02371219-d406-4c02-b310-38c2a981c5e9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:09.876477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-02371219-d406-4c02-b310-38c2a981c5e9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:09.888150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02371219-d406-4c02-b310-38c2a981c5e9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:09.888873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02371219-d406-4c02-b310-38c2a981c5e9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:09.897668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02371219-d406-4c02-b310-38c2a981c5e9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:09.898490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02371219-d406-4c02-b310-38c2a981c5e9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:09.978404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ddc786a-a9a0-4843-9e4a-84218f991be9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:09.992348 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ddc786a-a9a0-4843-9e4a-84218f991be9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1367 microversion: 2.1 time: 0.398054 Jul 26 14:14:09.993393 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1146/2143] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:09 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:09.998685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:09.999518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:10.007238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:10.008027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:10.008974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:10.009605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:10.058319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:10.059340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:10.061988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lazy-loading 'fault' on Instance uuid c6e53966-8644-4b0b-9429-dd23222bb79e {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:14:10.205427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:10.234294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:10.242675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:10.244049 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-854f3dfa-f2ee-4d24-83de-b66813e02d29 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 200 len: 1193 microversion: 2.25 time: 0.249299 Jul 26 14:14:10.249282 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1147/2144] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:09 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 1193 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:10.257602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-00c1a768-ec87-4c22-9e4f-82f51782ed65 req-a3388d90-8f91-41d4-a4ca-5d8f4cdacd7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f930a87-b048-44cc-86eb-7db98aaaff65", "tag": "bc51517b-e7e7-4587-a668-10a85cc83812"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:10.284849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-02371219-d406-4c02-b310-38c2a981c5e9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:10.298365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-00c1a768-ec87-4c22-9e4f-82f51782ed65 req-a3388d90-8f91-41d4-a4ca-5d8f4cdacd7d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:10.298902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-00c1a768-ec87-4c22-9e4f-82f51782ed65 req-a3388d90-8f91-41d4-a4ca-5d8f4cdacd7d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:10.301392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-02371219-d406-4c02-b310-38c2a981c5e9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:10.305527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-02371219-d406-4c02-b310-38c2a981c5e9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:10.306956 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-02371219-d406-4c02-b310-38c2a981c5e9 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2955 microversion: 2.42 time: 0.707897 Jul 26 14:14:10.307537 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 998/2145] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:09 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2955 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:10.325122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87ad646d-4357-4cc5-a703-6f32de313118 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:10.325768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-87ad646d-4357-4cc5-a703-6f32de313118 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:10.339211 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-00c1a768-ec87-4c22-9e4f-82f51782ed65 req-a3388d90-8f91-41d4-a4ca-5d8f4cdacd7d service nova] Creating event network-changed:bc51517b-e7e7-4587-a668-10a85cc83812 for instance 2f930a87-b048-44cc-86eb-7db98aaaff65 on n-h2-833090-9 Jul 26 14:14:10.341115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87ad646d-4357-4cc5-a703-6f32de313118 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:10.344071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87ad646d-4357-4cc5-a703-6f32de313118 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:10.347202 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-00c1a768-ec87-4c22-9e4f-82f51782ed65 req-a3388d90-8f91-41d4-a4ca-5d8f4cdacd7d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095852 Jul 26 14:14:10.348203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87ad646d-4357-4cc5-a703-6f32de313118 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:10.349099 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1148/2146] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:10.352013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87ad646d-4357-4cc5-a703-6f32de313118 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:10.364106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cff78aaf-4e30-418d-a3ba-106b1dc310d0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1983074675", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "key_name": "tempest-key-69172868", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:10.500043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-87ad646d-4357-4cc5-a703-6f32de313118 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2039c3b11f49cb91c5ebd9319d5758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec89602d0304041872e521e0633922d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:10.508590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-cff78aaf-4e30-418d-a3ba-106b1dc310d0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] validate_networks() for [('dab98a43-b5e8-42ee-ab97-d87aedbae0eb', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:14:10.520037 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-87ad646d-4357-4cc5-a703-6f32de313118 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 200 len: 1265 microversion: 2.1 time: 0.211311 Jul 26 14:14:10.522567 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 999/2147] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:10 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:10.532347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-15fe68d5-d919-4c2f-82bf-90b9693b702f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:10.542990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-15fe68d5-d919-4c2f-82bf-90b9693b702f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:10.551834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15fe68d5-d919-4c2f-82bf-90b9693b702f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:10.554788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15fe68d5-d919-4c2f-82bf-90b9693b702f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:10.555650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15fe68d5-d919-4c2f-82bf-90b9693b702f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:10.556162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15fe68d5-d919-4c2f-82bf-90b9693b702f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:11.621935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-15fe68d5-d919-4c2f-82bf-90b9693b702f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:11.633108 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-15fe68d5-d919-4c2f-82bf-90b9693b702f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1314 microversion: 2.1 time: 1.109110 Jul 26 14:14:11.634268 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1000/2148] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:10 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1314 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:11.640076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e062b44b-da7e-49cc-9ddd-d3fb92435261 req-e41de380-5dbe-44af-b07c-9609a338a20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150082ea-2baf-4ade-bbbf-2a9ad70f7fdd", "name": "network-vif-plugged", "status": "completed", "tag": "4f0b57e3-5498-4efd-a970-ff5c5608f91f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:11.653504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e062b44b-da7e-49cc-9ddd-d3fb92435261 req-e41de380-5dbe-44af-b07c-9609a338a20b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:11.654393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e062b44b-da7e-49cc-9ddd-d3fb92435261 req-e41de380-5dbe-44af-b07c-9609a338a20b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:11.696672 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e062b44b-da7e-49cc-9ddd-d3fb92435261 req-e41de380-5dbe-44af-b07c-9609a338a20b service nova] Creating event network-vif-plugged:4f0b57e3-5498-4efd-a970-ff5c5608f91f for instance 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd on n-h1-833090-9 Jul 26 14:14:11.705476 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e062b44b-da7e-49cc-9ddd-d3fb92435261 req-e41de380-5dbe-44af-b07c-9609a338a20b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069270 Jul 26 14:14:11.707730 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1001/2149] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:11.716823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4847767e-b7e6-4e7b-85fa-ed599e365edf tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:11.717972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4847767e-b7e6-4e7b-85fa-ed599e365edf tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:11.729115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4847767e-b7e6-4e7b-85fa-ed599e365edf tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:11.730922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4847767e-b7e6-4e7b-85fa-ed599e365edf tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:11.732271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4847767e-b7e6-4e7b-85fa-ed599e365edf tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:11.733046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4847767e-b7e6-4e7b-85fa-ed599e365edf tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:11.975486 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-cff78aaf-4e30-418d-a3ba-106b1dc310d0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Invalid key_name provided. Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cff78aaf-4e30-418d-a3ba-106b1dc310d0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 245 Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1983074675", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "key_name": "tempest-key-69172868", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid key_name provided. Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1983074675', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'key_name': 'tempest-key-69172868', 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-69172868 not found for user 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:11.978508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cff78aaf-4e30-418d-a3ba-106b1dc310d0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid key_name provided. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cff78aaf-4e30-418d-a3ba-106b1dc310d0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.629354 Jul 26 14:14:11.984464 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1149/2150] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:10 2022] POST /compute/v2.1/servers => generated 70 bytes in 1631 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:14:11.989530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c515ac41-188a-4224-b11f-e53a14b24857 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:11.989530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c515ac41-188a-4224-b11f-e53a14b24857 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:11.997490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c515ac41-188a-4224-b11f-e53a14b24857 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:11.998443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c515ac41-188a-4224-b11f-e53a14b24857 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:12.000264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c515ac41-188a-4224-b11f-e53a14b24857 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:12.000815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c515ac41-188a-4224-b11f-e53a14b24857 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:12.086162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4847767e-b7e6-4e7b-85fa-ed599e365edf tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.376465 Jul 26 14:14:12.086918 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1002/2151] 10.222.0.70 () {60 vars in 1316 bytes} [Tue Jul 26 14:14:11 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b/os-interface => generated 1831 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:12.107620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-82222e1e-24d6-4005-a08b-505e2003d1a1 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:12.110049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-82222e1e-24d6-4005-a08b-505e2003d1a1 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:12.126225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82222e1e-24d6-4005-a08b-505e2003d1a1 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:12.126719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82222e1e-24d6-4005-a08b-505e2003d1a1 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:12.127576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82222e1e-24d6-4005-a08b-505e2003d1a1 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:12.130771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82222e1e-24d6-4005-a08b-505e2003d1a1 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:12.827261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c515ac41-188a-4224-b11f-e53a14b24857 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:12.842795 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c515ac41-188a-4224-b11f-e53a14b24857 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1308 microversion: 2.1 time: 0.861146 Jul 26 14:14:12.843746 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1150/2152] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:11 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1308 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:12.850221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a3a065b-ee09-4525-99b5-6d8e886798d5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:12.857637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1a3a065b-ee09-4525-99b5-6d8e886798d5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: c6e53966-8644-4b0b-9429-dd23222bb79e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:12.875646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a3a065b-ee09-4525-99b5-6d8e886798d5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:12.876316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a3a065b-ee09-4525-99b5-6d8e886798d5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:12.879893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a3a065b-ee09-4525-99b5-6d8e886798d5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:12.880483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a3a065b-ee09-4525-99b5-6d8e886798d5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:12.881351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-82222e1e-24d6-4005-a08b-505e2003d1a1 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:12.890352 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-82222e1e-24d6-4005-a08b-505e2003d1a1 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1367 microversion: 2.1 time: 0.788720 Jul 26 14:14:12.890967 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1003/2153] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:12 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1367 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:12.917116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c333886-9577-4c85-9a30-1182ce4f08a4 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:12.917751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c333886-9577-4c85-9a30-1182ce4f08a4 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:12.940699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c333886-9577-4c85-9a30-1182ce4f08a4 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:12.941160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c333886-9577-4c85-9a30-1182ce4f08a4 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:12.942556 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-1a3a065b-ee09-4525-99b5-6d8e886798d5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] HTTP exception thrown: Instance c6e53966-8644-4b0b-9429-dd23222bb79e could not be found. Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a3a065b-ee09-4525-99b5-6d8e886798d5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Request method failure captured: Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e HTTP/1.1 Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_SOCTqCNznpntgV68EPac8jCUsSVh8KdhztWLFyfgNKskoTyiWkmaUzZuC7Ru6wWOst-pj_n0r8jQT-3d7ijROFdFF8P5ICaU78GTJKAmQw0K6-KLN78CAqihSfElhKCFnXZpVrvZi2Tq2_h6N_5byk3RoKqFP6OAivImvfkWUn_sk Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 3c83e50f8be04fb9b086a046f5b7eb00 Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c83e50f8be04fb9b086a046f5b7eb00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3c83e50f8be04fb9b086a046f5b7eb00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3c83e50f8be04fb9b086a046f5b7eb00", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c83e50f8be04fb9b086a046f5b7eb00"}]}] Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 3c83e50f8be04fb9b086a046f5b7eb00 Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-LiveAutoBlockMigrationV225Test-912704160-project Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 4a31af687dca4bea97ad5cb0459f0dbd Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-912704160-project Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c6e53966-8644-4b0b-9429-dd23222bb79e could not be found. Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c6e53966-8644-4b0b-9429-dd23222bb79e'} Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e53966-8644-4b0b-9429-dd23222bb79e could not be found. Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e53966-8644-4b0b-9429-dd23222bb79e could not be found. Jul 26 14:14:12.947858 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e53966-8644-4b0b-9429-dd23222bb79e could not be found. Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a3a065b-ee09-4525-99b5-6d8e886798d5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Returning 404 to user: Instance c6e53966-8644-4b0b-9429-dd23222bb79e could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:12.956657 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1a3a065b-ee09-4525-99b5-6d8e886798d5 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e" status: 404 len: 111 microversion: 2.25 time: 0.104120 Jul 26 14:14:12.958913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c333886-9577-4c85-9a30-1182ce4f08a4 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:12.958913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c333886-9577-4c85-9a30-1182ce4f08a4 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:12.959308 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1151/2154] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:12 2022] GET /compute/v2.1/servers/c6e53966-8644-4b0b-9429-dd23222bb79e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:14:12.971744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-350bbf99-8f98-4db2-80b8-7af86390d811 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:12.973101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-350bbf99-8f98-4db2-80b8-7af86390d811 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:12.996004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-350bbf99-8f98-4db2-80b8-7af86390d811 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:12.998010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-350bbf99-8f98-4db2-80b8-7af86390d811 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:12.999362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-350bbf99-8f98-4db2-80b8-7af86390d811 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:13.000223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-350bbf99-8f98-4db2-80b8-7af86390d811 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:13.744313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-350bbf99-8f98-4db2-80b8-7af86390d811 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:13.750103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:13.763575 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-350bbf99-8f98-4db2-80b8-7af86390d811 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.805657 Jul 26 14:14:13.764617 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1152/2155] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:12 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:13.775501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-701421ad-60d6-4845-9774-a512a62835c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:13.781313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-701421ad-60d6-4845-9774-a512a62835c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:13.799763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-701421ad-60d6-4845-9774-a512a62835c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:13.800533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-701421ad-60d6-4845-9774-a512a62835c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:13.801688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-701421ad-60d6-4845-9774-a512a62835c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:13.803697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-701421ad-60d6-4845-9774-a512a62835c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:13.925101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c333886-9577-4c85-9a30-1182ce4f08a4 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2039c3b11f49cb91c5ebd9319d5758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec89602d0304041872e521e0633922d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:13.936057 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c333886-9577-4c85-9a30-1182ce4f08a4 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 200 len: 1313 microversion: 2.1 time: 1.034755 Jul 26 14:14:13.941365 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1004/2156] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:12 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 1313 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:13.951660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-82281e3b-9bf9-4416-9c7a-a30f7888bb2e req-9e49a464-cf44-4e0d-9a15-4cf9e90fccf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51cca15-cae3-46e6-a64d-b27c5bd2c654", "tag": "de93625a-5e14-46ed-aa19-4208b02060e4"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:13.965701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-82281e3b-9bf9-4416-9c7a-a30f7888bb2e req-9e49a464-cf44-4e0d-9a15-4cf9e90fccf5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:13.966156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-82281e3b-9bf9-4416-9c7a-a30f7888bb2e req-9e49a464-cf44-4e0d-9a15-4cf9e90fccf5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:13.980644 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-82281e3b-9bf9-4416-9c7a-a30f7888bb2e req-9e49a464-cf44-4e0d-9a15-4cf9e90fccf5 service nova] Creating event network-changed:de93625a-5e14-46ed-aa19-4208b02060e4 for instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 on n-h1-833090-9 Jul 26 14:14:13.986993 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-82281e3b-9bf9-4416-9c7a-a30f7888bb2e req-9e49a464-cf44-4e0d-9a15-4cf9e90fccf5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044155 Jul 26 14:14:13.987977 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1005/2157] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:13.993657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a608e69e-013d-414f-906e-e3c2b820009f req-17af4a0b-dad8-4035-b38b-9ee096117a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e90299d-2a73-4c84-95bc-a08fa220c671", "name": "network-vif-plugged", "status": "completed", "tag": "cbe2651a-3688-408d-8285-f4a58c062b03"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:14.023313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a608e69e-013d-414f-906e-e3c2b820009f req-17af4a0b-dad8-4035-b38b-9ee096117a82 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:14.023777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a608e69e-013d-414f-906e-e3c2b820009f req-17af4a0b-dad8-4035-b38b-9ee096117a82 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:14.056202 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a608e69e-013d-414f-906e-e3c2b820009f req-17af4a0b-dad8-4035-b38b-9ee096117a82 service nova] Creating event network-vif-plugged:cbe2651a-3688-408d-8285-f4a58c062b03 for instance 1e90299d-2a73-4c84-95bc-a08fa220c671 on n-h2-833090-9 Jul 26 14:14:14.074370 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a608e69e-013d-414f-906e-e3c2b820009f req-17af4a0b-dad8-4035-b38b-9ee096117a82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084981 Jul 26 14:14:14.075241 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1006/2158] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:14.087932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b373badb-915c-41c4-9e57-8fabd594a4b5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:14.092602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b373badb-915c-41c4-9e57-8fabd594a4b5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:14.109814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b373badb-915c-41c4-9e57-8fabd594a4b5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:14.110549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b373badb-915c-41c4-9e57-8fabd594a4b5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:14.111743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b373badb-915c-41c4-9e57-8fabd594a4b5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:14.114391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b373badb-915c-41c4-9e57-8fabd594a4b5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:14.552492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-701421ad-60d6-4845-9774-a512a62835c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:14.576530 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-701421ad-60d6-4845-9774-a512a62835c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1314 microversion: 2.1 time: 0.802067 Jul 26 14:14:14.577431 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1153/2159] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:13 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:14.589478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-565cbab2-b03f-43aa-967e-82277f4b9ff2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:14.605070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-565cbab2-b03f-43aa-967e-82277f4b9ff2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:14.623359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-565cbab2-b03f-43aa-967e-82277f4b9ff2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:14.630280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-565cbab2-b03f-43aa-967e-82277f4b9ff2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:14.632920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-565cbab2-b03f-43aa-967e-82277f4b9ff2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:14.634523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-565cbab2-b03f-43aa-967e-82277f4b9ff2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:14.703903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=52 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:14.766870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b373badb-915c-41c4-9e57-8fabd594a4b5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:14.789997 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b373badb-915c-41c4-9e57-8fabd594a4b5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.712927 Jul 26 14:14:14.791852 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1007/2160] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:14 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:14.798328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a849e816-9b24-444b-a245-211a712e1bcd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:14.807386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a849e816-9b24-444b-a245-211a712e1bcd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:14.828682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:14.831675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a849e816-9b24-444b-a245-211a712e1bcd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:14.832668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a849e816-9b24-444b-a245-211a712e1bcd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:14.835571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a849e816-9b24-444b-a245-211a712e1bcd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:14.839767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a849e816-9b24-444b-a245-211a712e1bcd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:14.930320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:14.966833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-565cbab2-b03f-43aa-967e-82277f4b9ff2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:14.980469 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-565cbab2-b03f-43aa-967e-82277f4b9ff2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1308 microversion: 2.1 time: 0.395635 Jul 26 14:14:14.996684 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1154/2161] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:14 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1308 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:15.006254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7384afab-f059-44a8-8320-6e41604151b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1990665477", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:15.191751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a849e816-9b24-444b-a245-211a712e1bcd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:15.218421 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a849e816-9b24-444b-a245-211a712e1bcd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1367 microversion: 2.1 time: 0.421897 Jul 26 14:14:15.223489 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1008/2162] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:14 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:15.224658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-7384afab-f059-44a8-8320-6e41604151b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Neutron security group does_not_exist not found {{(pid=119479) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 26 14:14:15.225721 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-7384afab-f059-44a8-8320-6e41604151b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 26 14:14:15.243011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e762f648-7791-4225-ab60-286ca3a38973 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:15.243910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e762f648-7791-4225-ab60-286ca3a38973 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7384afab-f059-44a8-8320-6e41604151b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 258 Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1990665477", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1990665477', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 26 14:14:15.245129 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:15.248959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7384afab-f059-44a8-8320-6e41604151b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:15.251843 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7384afab-f059-44a8-8320-6e41604151b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.248981 Jul 26 14:14:15.251843 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1155/2163] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:14 2022] POST /compute/v2.1/servers => generated 106 bytes in 250 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:14:15.260082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0a557eb-b9ad-4b79-b8c3-6de595ce751e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:15.260082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d0a557eb-b9ad-4b79-b8c3-6de595ce751e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:15.275326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0a557eb-b9ad-4b79-b8c3-6de595ce751e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:15.275577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e762f648-7791-4225-ab60-286ca3a38973 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:15.276950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0a557eb-b9ad-4b79-b8c3-6de595ce751e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:15.277782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0a557eb-b9ad-4b79-b8c3-6de595ce751e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:15.278237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0a557eb-b9ad-4b79-b8c3-6de595ce751e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:15.278744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e762f648-7791-4225-ab60-286ca3a38973 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:15.281111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e762f648-7791-4225-ab60-286ca3a38973 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:15.282525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e762f648-7791-4225-ab60-286ca3a38973 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:15.653102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d0a557eb-b9ad-4b79-b8c3-6de595ce751e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:15.666462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e762f648-7791-4225-ab60-286ca3a38973 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2039c3b11f49cb91c5ebd9319d5758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec89602d0304041872e521e0633922d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:15.669078 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d0a557eb-b9ad-4b79-b8c3-6de595ce751e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.416894 Jul 26 14:14:15.670188 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1156/2164] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:15 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:15.676894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6aea7253-a666-4c57-83c1-6f60621cbc3d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:15.679145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6aea7253-a666-4c57-83c1-6f60621cbc3d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:15.687434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6aea7253-a666-4c57-83c1-6f60621cbc3d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:15.688336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6aea7253-a666-4c57-83c1-6f60621cbc3d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:15.690505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6aea7253-a666-4c57-83c1-6f60621cbc3d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:15.691342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6aea7253-a666-4c57-83c1-6f60621cbc3d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:15.695301 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e762f648-7791-4225-ab60-286ca3a38973 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 200 len: 1313 microversion: 2.1 time: 0.470060 Jul 26 14:14:15.696160 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1009/2165] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:15 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:15.702508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff175287-c661-4fc1-aa20-dc9caeca1bb3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:15.709321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ff175287-c661-4fc1-aa20-dc9caeca1bb3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:15.734961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff175287-c661-4fc1-aa20-dc9caeca1bb3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:15.739436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff175287-c661-4fc1-aa20-dc9caeca1bb3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:15.749558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff175287-c661-4fc1-aa20-dc9caeca1bb3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:15.750456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff175287-c661-4fc1-aa20-dc9caeca1bb3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:16.059559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6aea7253-a666-4c57-83c1-6f60621cbc3d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:16.072450 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6aea7253-a666-4c57-83c1-6f60621cbc3d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1500 microversion: 2.1 time: 0.400801 Jul 26 14:14:16.073031 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1157/2166] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:15 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1500 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:16.084330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56337bb8-ae07-4832-952d-3b1cfc520d2a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:16.087057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56337bb8-ae07-4832-952d-3b1cfc520d2a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:16.113805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56337bb8-ae07-4832-952d-3b1cfc520d2a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:16.114588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56337bb8-ae07-4832-952d-3b1cfc520d2a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:16.115665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56337bb8-ae07-4832-952d-3b1cfc520d2a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:16.116178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56337bb8-ae07-4832-952d-3b1cfc520d2a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:16.163242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ff175287-c661-4fc1-aa20-dc9caeca1bb3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:16.197819 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff175287-c661-4fc1-aa20-dc9caeca1bb3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.499790 Jul 26 14:14:16.199064 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1010/2167] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:15 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:16.207598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b0f19ef2-fb00-4213-8a68-414b4c7ad3a8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:16.217288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b0f19ef2-fb00-4213-8a68-414b4c7ad3a8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:16.232298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0f19ef2-fb00-4213-8a68-414b4c7ad3a8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:16.232298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0f19ef2-fb00-4213-8a68-414b4c7ad3a8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:16.232889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0f19ef2-fb00-4213-8a68-414b4c7ad3a8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:16.233346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0f19ef2-fb00-4213-8a68-414b4c7ad3a8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:16.310692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-b0f19ef2-fb00-4213-8a68-414b4c7ad3a8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lazy-loading 'flavor' on Instance uuid 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:14:16.457621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56337bb8-ae07-4832-952d-3b1cfc520d2a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:16.466256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:16.476677 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56337bb8-ae07-4832-952d-3b1cfc520d2a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1308 microversion: 2.1 time: 0.397247 Jul 26 14:14:16.483428 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1158/2168] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:16 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:16.496092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4800d0ec-8ec9-4637-a823-093f4a54982c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:16.496795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4800d0ec-8ec9-4637-a823-093f4a54982c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 390a664d-b9c5-401e-afad-a4e328b33886] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:16.525382 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-4800d0ec-8ec9-4637-a823-093f4a54982c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 390a664d-b9c5-401e-afad-a4e328b33886 could not be found. Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4800d0ec-8ec9-4637-a823-093f4a54982c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/390a664d-b9c5-401e-afad-a4e328b33886 HTTP/1.1 Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 390a664d-b9c5-401e-afad-a4e328b33886 could not be found. Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '390a664d-b9c5-401e-afad-a4e328b33886'} Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390a664d-b9c5-401e-afad-a4e328b33886 could not be found. Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390a664d-b9c5-401e-afad-a4e328b33886 could not be found. Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:16.526953 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:16.531413 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:16.531413 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:16.531413 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:16.531413 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:16.531413 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:16.531413 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:16.531413 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390a664d-b9c5-401e-afad-a4e328b33886 could not be found. Jul 26 14:14:16.531413 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:16.531413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4800d0ec-8ec9-4637-a823-093f4a54982c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 390a664d-b9c5-401e-afad-a4e328b33886 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:16.531413 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4800d0ec-8ec9-4637-a823-093f4a54982c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "DELETE /compute/v2.1/servers/390a664d-b9c5-401e-afad-a4e328b33886" status: 404 len: 111 microversion: 2.1 time: 0.040954 Jul 26 14:14:16.536428 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1159/2169] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:14:16 2022] DELETE /compute/v2.1/servers/390a664d-b9c5-401e-afad-a4e328b33886 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:16.547731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d3d859b-c2e6-47cb-b74e-3870f0c135e7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:16.548445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d3d859b-c2e6-47cb-b74e-3870f0c135e7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:16.564458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d3d859b-c2e6-47cb-b74e-3870f0c135e7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:16.566747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d3d859b-c2e6-47cb-b74e-3870f0c135e7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:16.567868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d3d859b-c2e6-47cb-b74e-3870f0c135e7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:16.569714 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b0f19ef2-fb00-4213-8a68-414b4c7ad3a8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "POST /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd/action" status: 200 len: 32 microversion: 2.1 time: 0.368798 Jul 26 14:14:16.570268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d3d859b-c2e6-47cb-b74e-3870f0c135e7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:16.579455 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1011/2170] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:16 2022] POST /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd/action => generated 32 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:14:16.588036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6aba339b-5c25-4367-8f6c-ed1342642c41 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:16.601833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6aba339b-5c25-4367-8f6c-ed1342642c41 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:16.635505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6aba339b-5c25-4367-8f6c-ed1342642c41 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:16.635991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6aba339b-5c25-4367-8f6c-ed1342642c41 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:16.636803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6aba339b-5c25-4367-8f6c-ed1342642c41 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:16.645820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6aba339b-5c25-4367-8f6c-ed1342642c41 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:17.210711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d3d859b-c2e6-47cb-b74e-3870f0c135e7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:17.262629 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d3d859b-c2e6-47cb-b74e-3870f0c135e7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1557 microversion: 2.1 time: 0.724432 Jul 26 14:14:17.290119 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1160/2171] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:16 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1557 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:17.340637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d72ae034-ed40-4542-9ba4-aaa685357aba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:17.346360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d72ae034-ed40-4542-9ba4-aaa685357aba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:17.374638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d72ae034-ed40-4542-9ba4-aaa685357aba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:17.375748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d72ae034-ed40-4542-9ba4-aaa685357aba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:17.391399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d72ae034-ed40-4542-9ba4-aaa685357aba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:17.393444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d72ae034-ed40-4542-9ba4-aaa685357aba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:17.643188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6aba339b-5c25-4367-8f6c-ed1342642c41 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:17.652257 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6aba339b-5c25-4367-8f6c-ed1342642c41 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 1.070585 Jul 26 14:14:17.665106 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1012/2172] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:16 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:17.670995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f11d9e0a-8f91-410a-b59d-66655f8d3264 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:17.671792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f11d9e0a-8f91-410a-b59d-66655f8d3264 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:17.687875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11d9e0a-8f91-410a-b59d-66655f8d3264 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:17.688613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11d9e0a-8f91-410a-b59d-66655f8d3264 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:17.690362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11d9e0a-8f91-410a-b59d-66655f8d3264 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:17.691174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11d9e0a-8f91-410a-b59d-66655f8d3264 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:18.032446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d72ae034-ed40-4542-9ba4-aaa685357aba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:18.043903 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d72ae034-ed40-4542-9ba4-aaa685357aba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.739752 Jul 26 14:14:18.063239 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1161/2173] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:17 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:18.069847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1062973437", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "c5d27149-9dab-4eb1-88d4-8781dc8b4ee7"}, {"uuid": "38d36f78-aec6-456d-afe4-3b7fc23c23fe"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:18.094045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f11d9e0a-8f91-410a-b59d-66655f8d3264 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2039c3b11f49cb91c5ebd9319d5758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec89602d0304041872e521e0633922d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:18.107061 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f11d9e0a-8f91-410a-b59d-66655f8d3264 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 200 len: 1313 microversion: 2.1 time: 0.440310 Jul 26 14:14:18.108088 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1013/2174] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:17 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:18.114160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3da5a88b-ab3d-447f-8c3d-9be1ccc21b60 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:18.117240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3da5a88b-ab3d-447f-8c3d-9be1ccc21b60 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:18.147776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3da5a88b-ab3d-447f-8c3d-9be1ccc21b60 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:18.148976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3da5a88b-ab3d-447f-8c3d-9be1ccc21b60 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:18.150715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3da5a88b-ab3d-447f-8c3d-9be1ccc21b60 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:18.151301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3da5a88b-ab3d-447f-8c3d-9be1ccc21b60 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:18.166386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] validate_networks() for [('c5d27149-9dab-4eb1-88d4-8781dc8b4ee7', None, None, None, None, None), ('38d36f78-aec6-456d-afe4-3b7fc23c23fe', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:14:18.366466 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3da5a88b-ab3d-447f-8c3d-9be1ccc21b60 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257406 Jul 26 14:14:18.367064 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1014/2175] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:14:18 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:18.380266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c978974d-d919-4f48-919a-ba63807d13d0 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:18.380901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c978974d-d919-4f48-919a-ba63807d13d0 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:18.396992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c978974d-d919-4f48-919a-ba63807d13d0 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:18.397454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c978974d-d919-4f48-919a-ba63807d13d0 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:18.398259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c978974d-d919-4f48-919a-ba63807d13d0 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:18.398707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c978974d-d919-4f48-919a-ba63807d13d0 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:18.582896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:18.932914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=24 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:19.180211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c978974d-d919-4f48-919a-ba63807d13d0 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:19.189748 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c978974d-d919-4f48-919a-ba63807d13d0 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1308 microversion: 2.1 time: 0.821318 Jul 26 14:14:19.190359 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1015/2176] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:18 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1308 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:19.197245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b88a1402-1b6b-4703-945c-d0e9fe960824 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:19.198107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b88a1402-1b6b-4703-945c-d0e9fe960824 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:19.213341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b88a1402-1b6b-4703-945c-d0e9fe960824 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:19.219532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b88a1402-1b6b-4703-945c-d0e9fe960824 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:19.221760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b88a1402-1b6b-4703-945c-d0e9fe960824 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:19.227999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b88a1402-1b6b-4703-945c-d0e9fe960824 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:19.717002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b88a1402-1b6b-4703-945c-d0e9fe960824 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:19.732126 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b88a1402-1b6b-4703-945c-d0e9fe960824 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.538339 Jul 26 14:14:19.734022 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1016/2177] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:19 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:19.750075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-5d42bbf1-e427-4120-8aba-0c8459afde22 req-d94052d6-5a48-4e1b-90f3-ddec78c7e0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f930a87-b048-44cc-86eb-7db98aaaff65", "name": "network-vif-plugged", "status": "completed", "tag": "bc51517b-e7e7-4587-a668-10a85cc83812"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:19.781789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5d42bbf1-e427-4120-8aba-0c8459afde22 req-d94052d6-5a48-4e1b-90f3-ddec78c7e0d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:19.784833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5d42bbf1-e427-4120-8aba-0c8459afde22 req-d94052d6-5a48-4e1b-90f3-ddec78c7e0d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:19.832724 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-5d42bbf1-e427-4120-8aba-0c8459afde22 req-d94052d6-5a48-4e1b-90f3-ddec78c7e0d4 service nova] Creating event network-vif-plugged:bc51517b-e7e7-4587-a668-10a85cc83812 for instance 2f930a87-b048-44cc-86eb-7db98aaaff65 on n-h2-833090-9 Jul 26 14:14:19.841578 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-5d42bbf1-e427-4120-8aba-0c8459afde22 req-d94052d6-5a48-4e1b-90f3-ddec78c7e0d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102722 Jul 26 14:14:19.842214 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1017/2178] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:19.883720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e51249a9-d4b1-4ba0-8010-fd7dac44f82c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:19.888433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e51249a9-d4b1-4ba0-8010-fd7dac44f82c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:19.907210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e51249a9-d4b1-4ba0-8010-fd7dac44f82c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:19.908691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e51249a9-d4b1-4ba0-8010-fd7dac44f82c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:19.910906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e51249a9-d4b1-4ba0-8010-fd7dac44f82c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:19.911563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e51249a9-d4b1-4ba0-8010-fd7dac44f82c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:19.955227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e51249a9-d4b1-4ba0-8010-fd7dac44f82c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:14:20.025288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:14:20.027368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:14:20.028089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:14:20.028669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:14:20.029340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:14:20.046941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.052333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:20.054306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.055850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:20.098963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Getting quotas for project 0daac0aaada2453f84fdb257106f12ae. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:14:20.107209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Getting quotas for user cf1430124f9f4c099944aad81234f6de and project 0daac0aaada2453f84fdb257106f12ae. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:14:20.132743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:14:20.137410 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e51249a9-d4b1-4ba0-8010-fd7dac44f82c tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "DELETE /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 204 len: 0 microversion: 2.25 time: 0.292982 Jul 26 14:14:20.138617 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1018/2179] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:14:19 2022] DELETE /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:14:20.139674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:14:20.150909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e69ec395-5bb1-4539-be28-4fc7b80dd840 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:20.152477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e69ec395-5bb1-4539-be28-4fc7b80dd840 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:20.164773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e69ec395-5bb1-4539-be28-4fc7b80dd840 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.165780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e69ec395-5bb1-4539-be28-4fc7b80dd840 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:20.167328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e69ec395-5bb1-4539-be28-4fc7b80dd840 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.168320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e69ec395-5bb1-4539-be28-4fc7b80dd840 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:20.263213 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e2ebc174-4f6c-4575-8d30-09840c02396e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.196989 Jul 26 14:14:20.264367 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1162/2180] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:14:20.273446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ee84417b-8c56-4b2c-808e-5a85501471ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:20.274521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ee84417b-8c56-4b2c-808e-5a85501471ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:20.304376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee84417b-8c56-4b2c-808e-5a85501471ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.305091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee84417b-8c56-4b2c-808e-5a85501471ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:20.331017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee84417b-8c56-4b2c-808e-5a85501471ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.331726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee84417b-8c56-4b2c-808e-5a85501471ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:20.510305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e69ec395-5bb1-4539-be28-4fc7b80dd840 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:20.529028 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e69ec395-5bb1-4539-be28-4fc7b80dd840 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.388147 Jul 26 14:14:20.529528 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1019/2181] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:20 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:20.541164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-554434d7-6277-467f-8192-af2e776032db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:20.541164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-554434d7-6277-467f-8192-af2e776032db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 14:14:20.541680 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-554434d7-6277-467f-8192-af2e776032db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-554434d7-6277-467f-8192-af2e776032db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 9223372036854775808 could not be found. Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '9223372036854775808'} Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:20.543864 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:20.549910 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:20.549910 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:20.549910 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:20.549910 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 26 14:14:20.549910 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:20.549910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-554434d7-6277-467f-8192-af2e776032db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:20.549910 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-554434d7-6277-467f-8192-af2e776032db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014352 Jul 26 14:14:20.549910 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1020/2182] 10.222.0.70 () {58 vars in 1188 bytes} [Tue Jul 26 14:14:20 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:14:20.556262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a4aedc44-797d-4ec5-94b4-01189a928171 req-43942566-d46c-454b-bc90-f660850affa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e90299d-2a73-4c84-95bc-a08fa220c671", "tag": "cbe2651a-3688-408d-8285-f4a58c062b03"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:20.574350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ee84417b-8c56-4b2c-808e-5a85501471ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2039c3b11f49cb91c5ebd9319d5758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec89602d0304041872e521e0633922d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:20.584506 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ee84417b-8c56-4b2c-808e-5a85501471ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 200 len: 1313 microversion: 2.1 time: 0.318728 Jul 26 14:14:20.585128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a4aedc44-797d-4ec5-94b4-01189a928171 req-43942566-d46c-454b-bc90-f660850affa5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.585648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a4aedc44-797d-4ec5-94b4-01189a928171 req-43942566-d46c-454b-bc90-f660850affa5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:20.586231 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1163/2183] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:20 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:20.591323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5202b801-d065-461b-a61d-6a7f8974a9d4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:20.592297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5202b801-d065-461b-a61d-6a7f8974a9d4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:20.604778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5202b801-d065-461b-a61d-6a7f8974a9d4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.605509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5202b801-d065-461b-a61d-6a7f8974a9d4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:20.606471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5202b801-d065-461b-a61d-6a7f8974a9d4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.607154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5202b801-d065-461b-a61d-6a7f8974a9d4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:20.617231 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a4aedc44-797d-4ec5-94b4-01189a928171 req-43942566-d46c-454b-bc90-f660850affa5 service nova] Creating event network-changed:cbe2651a-3688-408d-8285-f4a58c062b03 for instance 1e90299d-2a73-4c84-95bc-a08fa220c671 on n-h2-833090-9 Jul 26 14:14:20.624329 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a4aedc44-797d-4ec5-94b4-01189a928171 req-43942566-d46c-454b-bc90-f660850affa5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075012 Jul 26 14:14:20.625915 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1021/2184] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:20.637020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c676e1f9-3f5d-4b39-9421-fea2d93f5891 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:20.638199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c676e1f9-3f5d-4b39-9421-fea2d93f5891 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:20.646456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c676e1f9-3f5d-4b39-9421-fea2d93f5891 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.647341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c676e1f9-3f5d-4b39-9421-fea2d93f5891 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:20.648422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c676e1f9-3f5d-4b39-9421-fea2d93f5891 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:20.649318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c676e1f9-3f5d-4b39-9421-fea2d93f5891 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:21.099857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5202b801-d065-461b-a61d-6a7f8974a9d4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:21.116989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5202b801-d065-461b-a61d-6a7f8974a9d4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:21.121888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5202b801-d065-461b-a61d-6a7f8974a9d4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:21.126964 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5202b801-d065-461b-a61d-6a7f8974a9d4 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1730 microversion: 2.25 time: 0.538306 Jul 26 14:14:21.128572 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1164/2185] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:20 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1730 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:21.139731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3009fe10-8d40-482c-9687-0ba441f1971e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:21.143651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3009fe10-8d40-482c-9687-0ba441f1971e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:21.145943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c676e1f9-3f5d-4b39-9421-fea2d93f5891 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:21.159921 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c676e1f9-3f5d-4b39-9421-fea2d93f5891 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1308 microversion: 2.1 time: 0.530131 Jul 26 14:14:21.161545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1022/2186] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:20 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:21.178394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0cc7f902-8449-46b4-89bd-d4149ab3950a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:21.178714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3009fe10-8d40-482c-9687-0ba441f1971e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:21.179021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0cc7f902-8449-46b4-89bd-d4149ab3950a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:21.180010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3009fe10-8d40-482c-9687-0ba441f1971e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:21.182626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3009fe10-8d40-482c-9687-0ba441f1971e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:21.183550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3009fe10-8d40-482c-9687-0ba441f1971e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:21.185687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cc7f902-8449-46b4-89bd-d4149ab3950a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:21.186137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cc7f902-8449-46b4-89bd-d4149ab3950a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:21.186936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cc7f902-8449-46b4-89bd-d4149ab3950a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:21.187393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cc7f902-8449-46b4-89bd-d4149ab3950a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:21.324831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3009fe10-8d40-482c-9687-0ba441f1971e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:21.346255 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3009fe10-8d40-482c-9687-0ba441f1971e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1217 microversion: 2.1 time: 0.215704 Jul 26 14:14:21.347171 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1165/2187] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:21 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1217 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:21.430818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0cc7f902-8449-46b4-89bd-d4149ab3950a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:21.462504 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0cc7f902-8449-46b4-89bd-d4149ab3950a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.287746 Jul 26 14:14:21.466335 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1023/2188] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:21 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:21.516767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6245fdc0-68fb-424a-ab18-5145f8169e16 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:21.518843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6245fdc0-68fb-424a-ab18-5145f8169e16 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:21.530850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6245fdc0-68fb-424a-ab18-5145f8169e16 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:21.532010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6245fdc0-68fb-424a-ab18-5145f8169e16 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:21.533767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6245fdc0-68fb-424a-ab18-5145f8169e16 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:21.534678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6245fdc0-68fb-424a-ab18-5145f8169e16 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:21.553700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-360df627-db2c-4843-b30e-dfaba9d254a2 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:21.555318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-360df627-db2c-4843-b30e-dfaba9d254a2 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:21.572199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-360df627-db2c-4843-b30e-dfaba9d254a2 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:21.573165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-360df627-db2c-4843-b30e-dfaba9d254a2 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:21.574522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-360df627-db2c-4843-b30e-dfaba9d254a2 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:21.580838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-360df627-db2c-4843-b30e-dfaba9d254a2 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:21.596105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:22.030761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6245fdc0-68fb-424a-ab18-5145f8169e16 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:22.040783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-360df627-db2c-4843-b30e-dfaba9d254a2 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:22.051237 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6245fdc0-68fb-424a-ab18-5145f8169e16 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.549694 Jul 26 14:14:22.058960 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1166/2189] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:21 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:22.085472 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-360df627-db2c-4843-b30e-dfaba9d254a2 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.538122 Jul 26 14:14:22.085666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43ef3057-a3c1-4eca-8a75-2e4e2cc094ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:22.100059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-43ef3057-a3c1-4eca-8a75-2e4e2cc094ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:22.104030 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1024/2190] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:21 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:22.118156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43ef3057-a3c1-4eca-8a75-2e4e2cc094ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:22.122074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43ef3057-a3c1-4eca-8a75-2e4e2cc094ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:22.126088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-181ee3fd-ae88-48e6-bbe0-9336bce1139b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:22.128056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43ef3057-a3c1-4eca-8a75-2e4e2cc094ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:22.128874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43ef3057-a3c1-4eca-8a75-2e4e2cc094ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:22.129705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-181ee3fd-ae88-48e6-bbe0-9336bce1139b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Failed to fetch instance by id -1 {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 14:14:22.131469 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-181ee3fd-ae88-48e6-bbe0-9336bce1139b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance -1 could not be found. Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-181ee3fd-ae88-48e6-bbe0-9336bce1139b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance -1 could not be found. Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '-1'} Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:22.145860 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:22.149990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:22.149990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:22.149990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 26 14:14:22.149990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:22.149990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-181ee3fd-ae88-48e6-bbe0-9336bce1139b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:22.149990 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-181ee3fd-ae88-48e6-bbe0-9336bce1139b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.042942 Jul 26 14:14:22.154762 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1025/2191] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:14:22 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:14:22.167361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-15589bbf-3332-4f42-bbbc-855c4dc33792 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:22.168069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-15589bbf-3332-4f42-bbbc-855c4dc33792 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:22.191835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15589bbf-3332-4f42-bbbc-855c4dc33792 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:22.194739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15589bbf-3332-4f42-bbbc-855c4dc33792 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:22.195721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15589bbf-3332-4f42-bbbc-855c4dc33792 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:22.196224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15589bbf-3332-4f42-bbbc-855c4dc33792 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.056738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43ef3057-a3c1-4eca-8a75-2e4e2cc094ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2039c3b11f49cb91c5ebd9319d5758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec89602d0304041872e521e0633922d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:23.076246 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43ef3057-a3c1-4eca-8a75-2e4e2cc094ca tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 200 len: 1313 microversion: 2.1 time: 1.014685 Jul 26 14:14:23.078682 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1167/2192] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:22 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 1313 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:23.118533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5c9c4a1f-67f0-4a54-bfef-dfa7b3904999 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:23.121313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5c9c4a1f-67f0-4a54-bfef-dfa7b3904999 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:23.141612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c9c4a1f-67f0-4a54-bfef-dfa7b3904999 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.166395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c9c4a1f-67f0-4a54-bfef-dfa7b3904999 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.171371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c9c4a1f-67f0-4a54-bfef-dfa7b3904999 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.172343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c9c4a1f-67f0-4a54-bfef-dfa7b3904999 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.371799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-15589bbf-3332-4f42-bbbc-855c4dc33792 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:23.394314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-15589bbf-3332-4f42-bbbc-855c4dc33792 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:23.397007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-15589bbf-3332-4f42-bbbc-855c4dc33792 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:23.406297 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-15589bbf-3332-4f42-bbbc-855c4dc33792 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 200 len: 1730 microversion: 2.25 time: 1.239646 Jul 26 14:14:23.408396 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1026/2193] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:22 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 1730 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:23.414857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a388a0cd-eb8f-4fe2-ad42-8cbd88040d7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:23.415802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a388a0cd-eb8f-4fe2-ad42-8cbd88040d7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:23.432440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a388a0cd-eb8f-4fe2-ad42-8cbd88040d7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.433238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a388a0cd-eb8f-4fe2-ad42-8cbd88040d7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.434534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a388a0cd-eb8f-4fe2-ad42-8cbd88040d7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.435319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a388a0cd-eb8f-4fe2-ad42-8cbd88040d7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.591336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5c9c4a1f-67f0-4a54-bfef-dfa7b3904999 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:23.603354 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5c9c4a1f-67f0-4a54-bfef-dfa7b3904999 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.521890 Jul 26 14:14:23.604139 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1168/2194] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:23 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:23.610766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-35c24bca-6cfe-4b06-90d6-f3984139f8e1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:23.612144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-35c24bca-6cfe-4b06-90d6-f3984139f8e1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:23.622456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35c24bca-6cfe-4b06-90d6-f3984139f8e1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.623233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35c24bca-6cfe-4b06-90d6-f3984139f8e1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.624320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35c24bca-6cfe-4b06-90d6-f3984139f8e1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.625341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35c24bca-6cfe-4b06-90d6-f3984139f8e1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.660963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a388a0cd-eb8f-4fe2-ad42-8cbd88040d7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:23.674204 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a388a0cd-eb8f-4fe2-ad42-8cbd88040d7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1487 microversion: 2.1 time: 0.263627 Jul 26 14:14:23.675016 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1027/2195] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:23 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1487 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:23.710803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-eaadfc43-87ac-4304-99ac-5067e37076bf req-e17bb095-503d-4896-9cf4-703e3f276067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51cca15-cae3-46e6-a64d-b27c5bd2c654", "name": "network-vif-plugged", "status": "completed", "tag": "de93625a-5e14-46ed-aa19-4208b02060e4"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:23.712128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35c24bca-6cfe-4b06-90d6-f3984139f8e1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:23.730922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-eaadfc43-87ac-4304-99ac-5067e37076bf req-e17bb095-503d-4896-9cf4-703e3f276067 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.731861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-eaadfc43-87ac-4304-99ac-5067e37076bf req-e17bb095-503d-4896-9cf4-703e3f276067 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.734053 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-35c24bca-6cfe-4b06-90d6-f3984139f8e1 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1271 microversion: 2.1 time: 0.125549 Jul 26 14:14:23.734838 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1169/2196] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:23 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:23.749934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c109fca0-2f0e-4e67-b464-2e9725f3f295 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:23.750903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c109fca0-2f0e-4e67-b464-2e9725f3f295 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:23.769732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c109fca0-2f0e-4e67-b464-2e9725f3f295 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.771081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c109fca0-2f0e-4e67-b464-2e9725f3f295 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.775114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c109fca0-2f0e-4e67-b464-2e9725f3f295 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.775847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c109fca0-2f0e-4e67-b464-2e9725f3f295 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.788591 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-eaadfc43-87ac-4304-99ac-5067e37076bf req-e17bb095-503d-4896-9cf4-703e3f276067 service nova] Creating event network-vif-plugged:de93625a-5e14-46ed-aa19-4208b02060e4 for instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 on n-h1-833090-9 Jul 26 14:14:23.796862 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-eaadfc43-87ac-4304-99ac-5067e37076bf req-e17bb095-503d-4896-9cf4-703e3f276067 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105118 Jul 26 14:14:23.800842 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1028/2197] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:23.813340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e982edb3-b1a5-42d4-8e4f-7781da42b6bb req-d7a60f77-e251-4eed-bce0-02f1448344f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cbff42-6659-4317-bf61-7f5f2aaaa942", "name": "network-vif-deleted", "tag": "a17e340d-a5eb-45cb-9fb6-171e51e54f5b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:23.836414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e982edb3-b1a5-42d4-8e4f-7781da42b6bb req-d7a60f77-e251-4eed-bce0-02f1448344f2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.837676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e982edb3-b1a5-42d4-8e4f-7781da42b6bb req-d7a60f77-e251-4eed-bce0-02f1448344f2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.853300 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e982edb3-b1a5-42d4-8e4f-7781da42b6bb req-d7a60f77-e251-4eed-bce0-02f1448344f2 service nova] Creating event network-vif-deleted:a17e340d-a5eb-45cb-9fb6-171e51e54f5b for instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 on n-h2-833090-9 Jul 26 14:14:23.864236 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e982edb3-b1a5-42d4-8e4f-7781da42b6bb req-d7a60f77-e251-4eed-bce0-02f1448344f2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061679 Jul 26 14:14:23.865077 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1029/2198] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:23.878221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cd5952bd-f0a4-44ef-a3c4-634d49a08e96 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:23.879251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cd5952bd-f0a4-44ef-a3c4-634d49a08e96 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:23.886949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd5952bd-f0a4-44ef-a3c4-634d49a08e96 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.887743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd5952bd-f0a4-44ef-a3c4-634d49a08e96 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:23.889208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd5952bd-f0a4-44ef-a3c4-634d49a08e96 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:23.890667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd5952bd-f0a4-44ef-a3c4-634d49a08e96 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.242826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c109fca0-2f0e-4e67-b464-2e9725f3f295 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:24.253338 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c109fca0-2f0e-4e67-b464-2e9725f3f295 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.515748 Jul 26 14:14:24.262156 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1170/2199] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:23 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:24.262156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bee45da8-bc47-44b3-b3eb-6bf90c4f13b3 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:24.269064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bee45da8-bc47-44b3-b3eb-6bf90c4f13b3 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.269539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bee45da8-bc47-44b3-b3eb-6bf90c4f13b3 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.289171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cd5952bd-f0a4-44ef-a3c4-634d49a08e96 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:24.296868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bee45da8-bc47-44b3-b3eb-6bf90c4f13b3 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Going to try to stop instance {{(pid=119479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:14:24.301022 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cd5952bd-f0a4-44ef-a3c4-634d49a08e96 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.428726 Jul 26 14:14:24.304669 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1030/2200] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:23 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:24.309920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-83ff7bee-dd20-47ef-bb84-fa03684485e0 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:24.310916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-83ff7bee-dd20-47ef-bb84-fa03684485e0 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:24.321449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83ff7bee-dd20-47ef-bb84-fa03684485e0 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.322385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83ff7bee-dd20-47ef-bb84-fa03684485e0 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.323904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83ff7bee-dd20-47ef-bb84-fa03684485e0 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.325610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83ff7bee-dd20-47ef-bb84-fa03684485e0 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.354234 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bee45da8-bc47-44b3-b3eb-6bf90c4f13b3 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65/action" status: 202 len: 0 microversion: 2.1 time: 0.097689 Jul 26 14:14:24.355122 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1171/2201] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:24 2022] POST /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:14:24.364980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8853183c-1bdc-4611-b074-012502d2b502 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:24.365799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8853183c-1bdc-4611-b074-012502d2b502 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 14255773-382d-486b-9db7-e1e22bd7d356] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:24.374478 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-8853183c-1bdc-4611-b074-012502d2b502 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 14255773-382d-486b-9db7-e1e22bd7d356 could not be found. Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8853183c-1bdc-4611-b074-012502d2b502 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/14255773-382d-486b-9db7-e1e22bd7d356/action HTTP/1.1 Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 19 Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: {"forceDelete": {}} Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 14255773-382d-486b-9db7-e1e22bd7d356 could not be found. Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '14255773-382d-486b-9db7-e1e22bd7d356', 'body': {'forceDelete': {}}} Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14255773-382d-486b-9db7-e1e22bd7d356 could not be found. Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14255773-382d-486b-9db7-e1e22bd7d356 could not be found. Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:24.381959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:24.386817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:24.386817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:24.386817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14255773-382d-486b-9db7-e1e22bd7d356 could not be found. Jul 26 14:14:24.386817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:24.386817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8853183c-1bdc-4611-b074-012502d2b502 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 14255773-382d-486b-9db7-e1e22bd7d356 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:24.386817 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8853183c-1bdc-4611-b074-012502d2b502 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/14255773-382d-486b-9db7-e1e22bd7d356/action" status: 404 len: 111 microversion: 2.1 time: 0.025983 Jul 26 14:14:24.386817 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1172/2202] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:24 2022] POST /compute/v2.1/servers/14255773-382d-486b-9db7-e1e22bd7d356/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:24.390658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6f88960-820c-46a3-b6d3-0a9bbfe4e342 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:24.391288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e6f88960-820c-46a3-b6d3-0a9bbfe4e342 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:24.403334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f88960-820c-46a3-b6d3-0a9bbfe4e342 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.404509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f88960-820c-46a3-b6d3-0a9bbfe4e342 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.405401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f88960-820c-46a3-b6d3-0a9bbfe4e342 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.405910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6f88960-820c-46a3-b6d3-0a9bbfe4e342 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.739985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e6f88960-820c-46a3-b6d3-0a9bbfe4e342 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:24.750408 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e6f88960-820c-46a3-b6d3-0a9bbfe4e342 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.364706 Jul 26 14:14:24.752620 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1173/2203] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:24 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:24.757927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6cc9a526-a082-4e66-b9bf-dd1cd3c32fed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:24.758316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-83ff7bee-dd20-47ef-bb84-fa03684485e0 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2039c3b11f49cb91c5ebd9319d5758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec89602d0304041872e521e0633922d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:24.758831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6cc9a526-a082-4e66-b9bf-dd1cd3c32fed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:24.765839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cc9a526-a082-4e66-b9bf-dd1cd3c32fed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.766430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cc9a526-a082-4e66-b9bf-dd1cd3c32fed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.767732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cc9a526-a082-4e66-b9bf-dd1cd3c32fed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.768698 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-83ff7bee-dd20-47ef-bb84-fa03684485e0 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 200 len: 1313 microversion: 2.1 time: 0.462487 Jul 26 14:14:24.768839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cc9a526-a082-4e66-b9bf-dd1cd3c32fed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.769573 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1031/2204] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:24 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:24.778676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02449280-9ca5-43b5-b227-3f71c3c53eb7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:24.779313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-02449280-9ca5-43b5-b227-3f71c3c53eb7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 38cbff42-6659-4317-bf61-7f5f2aaaa942] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:24.786462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02449280-9ca5-43b5-b227-3f71c3c53eb7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.786923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02449280-9ca5-43b5-b227-3f71c3c53eb7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.787708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02449280-9ca5-43b5-b227-3f71c3c53eb7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.788394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02449280-9ca5-43b5-b227-3f71c3c53eb7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.807220 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-02449280-9ca5-43b5-b227-3f71c3c53eb7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] HTTP exception thrown: Instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 could not be found. Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02449280-9ca5-43b5-b227-3f71c3c53eb7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Request method failure captured: Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 HTTP/1.1 Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_SOCTqCNznpntgV68EPac8jCUsSVh8KdhztWLFyfgNKskoTyiWkmaUzZuC7Ru6wWOst-pj_n0r8jQT-3d7ijROFdFF8P5ICaU78GTJKAmQw0K6-KLN78CAqihSfElhKCFnXZpVrvZi2Tq2_h6N_5byk3RoKqFP6OAivImvfkWUn_sk Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3c83e50f8be04fb9b086a046f5b7eb00 Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c83e50f8be04fb9b086a046f5b7eb00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3c83e50f8be04fb9b086a046f5b7eb00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3c83e50f8be04fb9b086a046f5b7eb00", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c83e50f8be04fb9b086a046f5b7eb00"}]}] Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3c83e50f8be04fb9b086a046f5b7eb00 Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-LiveAutoBlockMigrationV225Test-912704160-project Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4a31af687dca4bea97ad5cb0459f0dbd Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-912704160-project Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 could not be found. Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '38cbff42-6659-4317-bf61-7f5f2aaaa942'} Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 could not be found. Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 could not be found. Jul 26 14:14:24.809032 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 could not be found. Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02449280-9ca5-43b5-b227-3f71c3c53eb7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Returning 404 to user: Instance 38cbff42-6659-4317-bf61-7f5f2aaaa942 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-02449280-9ca5-43b5-b227-3f71c3c53eb7 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942" status: 404 len: 111 microversion: 2.25 time: 0.039684 Jul 26 14:14:24.817704 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1032/2205] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:24 2022] GET /compute/v2.1/servers/38cbff42-6659-4317-bf61-7f5f2aaaa942 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:14:24.818554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b720e274-4894-4cbb-9639-e23c7b483f03 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:24.818642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b720e274-4894-4cbb-9639-e23c7b483f03 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:24.826525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b720e274-4894-4cbb-9639-e23c7b483f03 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.827137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b720e274-4894-4cbb-9639-e23c7b483f03 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.827986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b720e274-4894-4cbb-9639-e23c7b483f03 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:24.828425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b720e274-4894-4cbb-9639-e23c7b483f03 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:24.933692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b720e274-4894-4cbb-9639-e23c7b483f03 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:24.950188 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b720e274-4894-4cbb-9639-e23c7b483f03 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1271 microversion: 2.1 time: 0.131407 Jul 26 14:14:24.962090 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1033/2206] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:24 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:24.967163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-942f0d87-89a7-4893-ae4e-a005d51d6644 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '.version_select at 0x7f8787c17b80>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:25.008095 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-942f0d87-89a7-4893-ae4e-a005d51d6644 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-248746982" status: 204 len: 0 microversion: 2.25 time: 0.044260 Jul 26 14:14:25.009284 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1034/2207] 10.222.0.70 () {60 vars in 1259 bytes} [Tue Jul 26 14:14:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-248746982 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:14:25.038864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6cc9a526-a082-4e66-b9bf-dd1cd3c32fed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:25.053499 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6cc9a526-a082-4e66-b9bf-dd1cd3c32fed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.299005 Jul 26 14:14:25.055341 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1174/2208] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:24 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:25.101623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b39f3a1d-e0c1-4e58-9e9c-05941de4d5ce tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:25.103138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b39f3a1d-e0c1-4e58-9e9c-05941de4d5ce tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:25.118669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b39f3a1d-e0c1-4e58-9e9c-05941de4d5ce tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:25.119905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b39f3a1d-e0c1-4e58-9e9c-05941de4d5ce tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:25.121957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b39f3a1d-e0c1-4e58-9e9c-05941de4d5ce tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:25.123019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b39f3a1d-e0c1-4e58-9e9c-05941de4d5ce tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:25.277310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-07c06022-85d2-408d-8864-387469101149 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:25.277946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-07c06022-85d2-408d-8864-387469101149 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:25.285478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07c06022-85d2-408d-8864-387469101149 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:25.285947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07c06022-85d2-408d-8864-387469101149 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:25.286757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07c06022-85d2-408d-8864-387469101149 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:25.287210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07c06022-85d2-408d-8864-387469101149 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:25.494043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b39f3a1d-e0c1-4e58-9e9c-05941de4d5ce tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:25.503155 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b39f3a1d-e0c1-4e58-9e9c-05941de4d5ce tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.412353 Jul 26 14:14:25.516395 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1035/2209] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:25 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:25.525284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-48243178-69ba-435a-8762-c134923a5d49 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:25.527645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-48243178-69ba-435a-8762-c134923a5d49 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 0fcc2fe0-29d7-4a20-835a-e43fa5400ec1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:25.534609 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-48243178-69ba-435a-8762-c134923a5d49 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 0fcc2fe0-29d7-4a20-835a-e43fa5400ec1 could not be found. Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-48243178-69ba-435a-8762-c134923a5d49 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/0fcc2fe0-29d7-4a20-835a-e43fa5400ec1/action HTTP/1.1 Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 39 Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: {"os-getConsoleOutput": {"length": 10}} Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 0fcc2fe0-29d7-4a20-835a-e43fa5400ec1 could not be found. Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '0fcc2fe0-29d7-4a20-835a-e43fa5400ec1', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fcc2fe0-29d7-4a20-835a-e43fa5400ec1 could not be found. Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fcc2fe0-29d7-4a20-835a-e43fa5400ec1 could not be found. Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:25.545115 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:25.550298 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:25.550298 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:25.550298 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:25.550298 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:25.550298 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fcc2fe0-29d7-4a20-835a-e43fa5400ec1 could not be found. Jul 26 14:14:25.550298 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:25.551349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-48243178-69ba-435a-8762-c134923a5d49 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 0fcc2fe0-29d7-4a20-835a-e43fa5400ec1 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:25.552530 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-48243178-69ba-435a-8762-c134923a5d49 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/0fcc2fe0-29d7-4a20-835a-e43fa5400ec1/action" status: 404 len: 111 microversion: 2.1 time: 0.031502 Jul 26 14:14:25.557027 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1036/2210] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:25 2022] POST /compute/v2.1/servers/0fcc2fe0-29d7-4a20-835a-e43fa5400ec1/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:25.563059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32ba44a3-1e75-4fac-b899-557875b0523e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:25.563899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-32ba44a3-1e75-4fac-b899-557875b0523e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:25.572056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32ba44a3-1e75-4fac-b899-557875b0523e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:25.572524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32ba44a3-1e75-4fac-b899-557875b0523e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:25.573327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32ba44a3-1e75-4fac-b899-557875b0523e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:25.573779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32ba44a3-1e75-4fac-b899-557875b0523e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:25.614107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-07c06022-85d2-408d-8864-387469101149 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:25.623794 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-07c06022-85d2-408d-8864-387469101149 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.350846 Jul 26 14:14:25.624417 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1175/2211] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:25 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:25.775930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1f6aed1-a4e9-40a1-9cbc-d288699d5535 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:25.776849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f1f6aed1-a4e9-40a1-9cbc-d288699d5535 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:25.784495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1f6aed1-a4e9-40a1-9cbc-d288699d5535 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:25.785201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1f6aed1-a4e9-40a1-9cbc-d288699d5535 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:25.786550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1f6aed1-a4e9-40a1-9cbc-d288699d5535 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:25.789964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1f6aed1-a4e9-40a1-9cbc-d288699d5535 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:25.810144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-32ba44a3-1e75-4fac-b899-557875b0523e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:25.821456 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32ba44a3-1e75-4fac-b899-557875b0523e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.262691 Jul 26 14:14:25.832901 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1037/2212] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:25 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:25.843408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-47472be8-824e-4ad2-9fcd-ce22d68af23d tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:25.844099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-47472be8-824e-4ad2-9fcd-ce22d68af23d tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:25.853712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47472be8-824e-4ad2-9fcd-ce22d68af23d tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:25.854166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47472be8-824e-4ad2-9fcd-ce22d68af23d tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:25.854955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47472be8-824e-4ad2-9fcd-ce22d68af23d tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:25.855392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47472be8-824e-4ad2-9fcd-ce22d68af23d tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:26.417535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-47472be8-824e-4ad2-9fcd-ce22d68af23d tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2039c3b11f49cb91c5ebd9319d5758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec89602d0304041872e521e0633922d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:26.423040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1f6aed1-a4e9-40a1-9cbc-d288699d5535 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:26.427641 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-47472be8-824e-4ad2-9fcd-ce22d68af23d tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 200 len: 1499 microversion: 2.1 time: 0.593099 Jul 26 14:14:26.433411 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f1f6aed1-a4e9-40a1-9cbc-d288699d5535 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.662757 Jul 26 14:14:26.436872 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1038/2213] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:25 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 1499 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:26.444773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93850e69-0098-4886-86a4-25a2abd16721 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:26.445157 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1176/2214] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:25 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:26.445815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-93850e69-0098-4886-86a4-25a2abd16721 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:26.450239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6e6710d5-fdcd-495f-9def-2e5b1119475e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:26.451008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6e6710d5-fdcd-495f-9def-2e5b1119475e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:26.456108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93850e69-0098-4886-86a4-25a2abd16721 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:26.456796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93850e69-0098-4886-86a4-25a2abd16721 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:26.457372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93850e69-0098-4886-86a4-25a2abd16721 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:26.457819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93850e69-0098-4886-86a4-25a2abd16721 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:26.458653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e6710d5-fdcd-495f-9def-2e5b1119475e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:26.459177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e6710d5-fdcd-495f-9def-2e5b1119475e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:26.460051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e6710d5-fdcd-495f-9def-2e5b1119475e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:26.460552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e6710d5-fdcd-495f-9def-2e5b1119475e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:26.465336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:26.799778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-93850e69-0098-4886-86a4-25a2abd16721 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:26.810810 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-93850e69-0098-4886-86a4-25a2abd16721 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.371983 Jul 26 14:14:26.811734 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1039/2215] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:26 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:26.817796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c7cc8a3-83bb-4674-9f0a-089e3d1eeb77 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:26.818628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c7cc8a3-83bb-4674-9f0a-089e3d1eeb77 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:26.823383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6e6710d5-fdcd-495f-9def-2e5b1119475e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:26.827622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c7cc8a3-83bb-4674-9f0a-089e3d1eeb77 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:26.828167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c7cc8a3-83bb-4674-9f0a-089e3d1eeb77 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:26.828942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c7cc8a3-83bb-4674-9f0a-089e3d1eeb77 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:26.829429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c7cc8a3-83bb-4674-9f0a-089e3d1eeb77 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:26.834083 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6e6710d5-fdcd-495f-9def-2e5b1119475e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.387227 Jul 26 14:14:26.834979 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1177/2216] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:26 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:26.840590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8bbef22e-6d2f-4156-9309-c3af0761e305 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:26.856989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.server_groups [None req-8bbef22e-6d2f-4156-9309-c3af0761e305 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Querying cell b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) for 1 instances {{(pid=119479) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 14:14:26.858024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8bbef22e-6d2f-4156-9309-c3af0761e305 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:26.858635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8bbef22e-6d2f-4156-9309-c3af0761e305 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:26.862664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c7cc8a3-83bb-4674-9f0a-089e3d1eeb77 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:14:26.878850 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8bbef22e-6d2f-4156-9309-c3af0761e305 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/a9b97425-739c-4eda-85e0-d9eb8c104646" status: 200 len: 222 microversion: 2.1 time: 0.042406 Jul 26 14:14:26.888110 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1178/2217] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:14:26 2022] GET /compute/v2.1/os-server-groups/a9b97425-739c-4eda-85e0-d9eb8c104646 => generated 222 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:26.900676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-216e1990-281c-43f9-97dd-5d271239f3b8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:26.901598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-216e1990-281c-43f9-97dd-5d271239f3b8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:26.911645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-216e1990-281c-43f9-97dd-5d271239f3b8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:26.912456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-216e1990-281c-43f9-97dd-5d271239f3b8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:26.913652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-216e1990-281c-43f9-97dd-5d271239f3b8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:26.914315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-216e1990-281c-43f9-97dd-5d271239f3b8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:26.979612 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c7cc8a3-83bb-4674-9f0a-089e3d1eeb77 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 204 len: 0 microversion: 2.25 time: 0.166331 Jul 26 14:14:26.980365 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1040/2218] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:14:26 2022] DELETE /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:14:26.986964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1d1824cf-6481-4ee1-810e-1e01b5c7ab20 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:26.987683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1d1824cf-6481-4ee1-810e-1e01b5c7ab20 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 7b3973b2-d153-48a8-bfea-4dc450b1fa88] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:26.996688 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-1d1824cf-6481-4ee1-810e-1e01b5c7ab20 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 7b3973b2-d153-48a8-bfea-4dc450b1fa88 could not be found. Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1d1824cf-6481-4ee1-810e-1e01b5c7ab20 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/7b3973b2-d153-48a8-bfea-4dc450b1fa88 HTTP/1.1 Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 7b3973b2-d153-48a8-bfea-4dc450b1fa88 could not be found. Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '7b3973b2-d153-48a8-bfea-4dc450b1fa88'} Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3973b2-d153-48a8-bfea-4dc450b1fa88 could not be found. Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3973b2-d153-48a8-bfea-4dc450b1fa88 could not be found. Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:26.998370 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:27.010731 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:27.010731 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:27.010731 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:27.010731 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3973b2-d153-48a8-bfea-4dc450b1fa88 could not be found. Jul 26 14:14:27.010731 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:27.010731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1d1824cf-6481-4ee1-810e-1e01b5c7ab20 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 7b3973b2-d153-48a8-bfea-4dc450b1fa88 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:27.010731 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1d1824cf-6481-4ee1-810e-1e01b5c7ab20 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/7b3973b2-d153-48a8-bfea-4dc450b1fa88" status: 404 len: 111 microversion: 2.1 time: 0.018198 Jul 26 14:14:27.010731 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1041/2219] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:26 2022] GET /compute/v2.1/servers/7b3973b2-d153-48a8-bfea-4dc450b1fa88 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:27.010731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8601bf44-fcf0-4c02-8e5a-a0e87ed9ebe2 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:27.010731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8601bf44-fcf0-4c02-8e5a-a0e87ed9ebe2 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:27.018866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8601bf44-fcf0-4c02-8e5a-a0e87ed9ebe2 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:27.019152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8601bf44-fcf0-4c02-8e5a-a0e87ed9ebe2 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:27.019863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8601bf44-fcf0-4c02-8e5a-a0e87ed9ebe2 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:27.020302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8601bf44-fcf0-4c02-8e5a-a0e87ed9ebe2 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:27.053894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8601bf44-fcf0-4c02-8e5a-a0e87ed9ebe2 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:14:27.201433 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8601bf44-fcf0-4c02-8e5a-a0e87ed9ebe2 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 204 len: 0 microversion: 2.1 time: 0.198842 Jul 26 14:14:27.201941 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1042/2220] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:14:27 2022] DELETE /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:14:27.211352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b9a2d8ed-bbba-4c57-936d-056775cf534d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:27.212096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b9a2d8ed-bbba-4c57-936d-056775cf534d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:27.218498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9a2d8ed-bbba-4c57-936d-056775cf534d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:27.218966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9a2d8ed-bbba-4c57-936d-056775cf534d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:27.219851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9a2d8ed-bbba-4c57-936d-056775cf534d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:27.220434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9a2d8ed-bbba-4c57-936d-056775cf534d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:27.247018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:27.252799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-216e1990-281c-43f9-97dd-5d271239f3b8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:27.261223 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-216e1990-281c-43f9-97dd-5d271239f3b8 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.370975 Jul 26 14:14:27.265028 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1179/2221] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:26 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:27.269492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4571040b-845c-4f23-b91f-9f4a35f40f97 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:27.270328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4571040b-845c-4f23-b91f-9f4a35f40f97 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:27.279443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4571040b-845c-4f23-b91f-9f4a35f40f97 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:27.280323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4571040b-845c-4f23-b91f-9f4a35f40f97 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:27.281744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4571040b-845c-4f23-b91f-9f4a35f40f97 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:27.282624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4571040b-845c-4f23-b91f-9f4a35f40f97 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:27.598626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b9a2d8ed-bbba-4c57-936d-056775cf534d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:27.607482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b9a2d8ed-bbba-4c57-936d-056775cf534d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:27.609016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b9a2d8ed-bbba-4c57-936d-056775cf534d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:27.610196 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b9a2d8ed-bbba-4c57-936d-056775cf534d tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1548 microversion: 2.25 time: 0.403146 Jul 26 14:14:27.611647 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1043/2222] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:27 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1548 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:27.616319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b5c7c8b6-a5be-4db2-8e68-e809ae08b208 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:27.616935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b5c7c8b6-a5be-4db2-8e68-e809ae08b208 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:27.623989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5c7c8b6-a5be-4db2-8e68-e809ae08b208 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:27.624525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5c7c8b6-a5be-4db2-8e68-e809ae08b208 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:27.625316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5c7c8b6-a5be-4db2-8e68-e809ae08b208 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:27.625756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5c7c8b6-a5be-4db2-8e68-e809ae08b208 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:27.637286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4571040b-845c-4f23-b91f-9f4a35f40f97 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:27.652830 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4571040b-845c-4f23-b91f-9f4a35f40f97 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.389599 Jul 26 14:14:27.667305 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1180/2223] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:27 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:27.667305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a61d60f9-f227-4370-93c5-47bfbe0d4cd2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:27.667305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a61d60f9-f227-4370-93c5-47bfbe0d4cd2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:27.670999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a61d60f9-f227-4370-93c5-47bfbe0d4cd2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:27.672051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a61d60f9-f227-4370-93c5-47bfbe0d4cd2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:27.673772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a61d60f9-f227-4370-93c5-47bfbe0d4cd2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:27.674753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a61d60f9-f227-4370-93c5-47bfbe0d4cd2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:28.061931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b5c7c8b6-a5be-4db2-8e68-e809ae08b208 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2039c3b11f49cb91c5ebd9319d5758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec89602d0304041872e521e0633922d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:28.071118 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b5c7c8b6-a5be-4db2-8e68-e809ae08b208 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 200 len: 1505 microversion: 2.1 time: 0.458378 Jul 26 14:14:28.071710 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1044/2224] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:27 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:28.076863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c939ea12-de36-475b-9093-edb720142400 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:28.077773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c939ea12-de36-475b-9093-edb720142400 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:28.085216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c939ea12-de36-475b-9093-edb720142400 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:28.085996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c939ea12-de36-475b-9093-edb720142400 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:28.086978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c939ea12-de36-475b-9093-edb720142400 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:28.087634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c939ea12-de36-475b-9093-edb720142400 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:28.091120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a61d60f9-f227-4370-93c5-47bfbe0d4cd2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:28.103306 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a61d60f9-f227-4370-93c5-47bfbe0d4cd2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.447481 Jul 26 14:14:28.104025 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1181/2225] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:27 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:28.110316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7f859828-c55c-4738-a0d5-55f4233d3341 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:28.111540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7f859828-c55c-4738-a0d5-55f4233d3341 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:28.118567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:28.124932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f859828-c55c-4738-a0d5-55f4233d3341 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:28.128276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f859828-c55c-4738-a0d5-55f4233d3341 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:28.129202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f859828-c55c-4738-a0d5-55f4233d3341 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:28.130427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f859828-c55c-4738-a0d5-55f4233d3341 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:28.516025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c939ea12-de36-475b-9093-edb720142400 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:28.525374 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c939ea12-de36-475b-9093-edb720142400 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.452405 Jul 26 14:14:28.526252 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1045/2226] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:28 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:28.530906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8716deb3-5f0b-47ee-992f-704e06ac7b93 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:28.531718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8716deb3-5f0b-47ee-992f-704e06ac7b93 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:28.538137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8716deb3-5f0b-47ee-992f-704e06ac7b93 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:28.538674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8716deb3-5f0b-47ee-992f-704e06ac7b93 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:28.539528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8716deb3-5f0b-47ee-992f-704e06ac7b93 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:28.540129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8716deb3-5f0b-47ee-992f-704e06ac7b93 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:28.618197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7f859828-c55c-4738-a0d5-55f4233d3341 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:28.627807 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7f859828-c55c-4738-a0d5-55f4233d3341 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.522341 Jul 26 14:14:28.629284 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1182/2227] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:28 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:28.635053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-51a5a610-710f-4626-97ee-cc4281059b79 req-cf1dc3f5-bab9-4e66-848f-82bf035c8009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20e0fbcc-42e6-482f-a696-a2046d4cd25d", "tag": "7ffb9892-e08c-4f21-a2e8-0bdca41dc21b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:28.647332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-51a5a610-710f-4626-97ee-cc4281059b79 req-cf1dc3f5-bab9-4e66-848f-82bf035c8009 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:28.649194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-51a5a610-710f-4626-97ee-cc4281059b79 req-cf1dc3f5-bab9-4e66-848f-82bf035c8009 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:28.682531 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-51a5a610-710f-4626-97ee-cc4281059b79 req-cf1dc3f5-bab9-4e66-848f-82bf035c8009 service nova] Creating event network-changed:7ffb9892-e08c-4f21-a2e8-0bdca41dc21b for instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d on n-h2-833090-9 Jul 26 14:14:28.688819 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-51a5a610-710f-4626-97ee-cc4281059b79 req-cf1dc3f5-bab9-4e66-848f-82bf035c8009 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057039 Jul 26 14:14:28.689922 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1183/2228] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:28.700980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f6a5c307-a4e0-47f2-ab80-65f0d9eabdda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:28.712719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f6a5c307-a4e0-47f2-ab80-65f0d9eabdda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:28.725593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6a5c307-a4e0-47f2-ab80-65f0d9eabdda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:28.726406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6a5c307-a4e0-47f2-ab80-65f0d9eabdda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:28.727447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6a5c307-a4e0-47f2-ab80-65f0d9eabdda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:28.728089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6a5c307-a4e0-47f2-ab80-65f0d9eabdda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:28.945272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f6a5c307-a4e0-47f2-ab80-65f0d9eabdda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:28.960658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f6a5c307-a4e0-47f2-ab80-65f0d9eabdda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:28.962082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f6a5c307-a4e0-47f2-ab80-65f0d9eabdda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:28.963497 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f6a5c307-a4e0-47f2-ab80-65f0d9eabdda tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 200 len: 1506 microversion: 2.25 time: 0.272252 Jul 26 14:14:28.975798 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1184/2229] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:28 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:28.975798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9ae9f7d-7a06-48ff-a825-72d40dcb397d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1111505266", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9ae9f7d-7a06-48ff-a825-72d40dcb397d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 238 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1111505266", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1111505266', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:28.990896 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 26 14:14:28.995310 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:28.998266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9ae9f7d-7a06-48ff-a825-72d40dcb397d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:28.999836 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a9ae9f7d-7a06-48ff-a825-72d40dcb397d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034053 Jul 26 14:14:29.010058 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1185/2230] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:28 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:14:29.019905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8cfc1f3d-03b7-474a-bd4d-f755ba7534f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:29.020812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8cfc1f3d-03b7-474a-bd4d-f755ba7534f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:29.037367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cfc1f3d-03b7-474a-bd4d-f755ba7534f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:29.037840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cfc1f3d-03b7-474a-bd4d-f755ba7534f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:29.038797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cfc1f3d-03b7-474a-bd4d-f755ba7534f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:29.039773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cfc1f3d-03b7-474a-bd4d-f755ba7534f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:29.259566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8716deb3-5f0b-47ee-992f-704e06ac7b93 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:29.270929 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8716deb3-5f0b-47ee-992f-704e06ac7b93 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.743706 Jul 26 14:14:29.274030 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1046/2231] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:28 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:29.281083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a2fe30e2-44a8-46de-8cc2-3104d61cdb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:29.281922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a2fe30e2-44a8-46de-8cc2-3104d61cdb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:29.299386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2fe30e2-44a8-46de-8cc2-3104d61cdb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:29.300573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2fe30e2-44a8-46de-8cc2-3104d61cdb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:29.301547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2fe30e2-44a8-46de-8cc2-3104d61cdb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:29.302099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a2fe30e2-44a8-46de-8cc2-3104d61cdb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:29.812756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8cfc1f3d-03b7-474a-bd4d-f755ba7534f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:29.822264 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8cfc1f3d-03b7-474a-bd4d-f755ba7534f7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.810487 Jul 26 14:14:29.822845 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1186/2232] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:29 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:29.828982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1d95661b-1e3c-4c0d-ad5b-1a3bba75348c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:29.830361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1d95661b-1e3c-4c0d-ad5b-1a3bba75348c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:29.841044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d95661b-1e3c-4c0d-ad5b-1a3bba75348c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:29.841509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d95661b-1e3c-4c0d-ad5b-1a3bba75348c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:29.842702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d95661b-1e3c-4c0d-ad5b-1a3bba75348c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:29.843528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d95661b-1e3c-4c0d-ad5b-1a3bba75348c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.036316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a2fe30e2-44a8-46de-8cc2-3104d61cdb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c2039c3b11f49cb91c5ebd9319d5758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec89602d0304041872e521e0633922d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:30.046467 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a2fe30e2-44a8-46de-8cc2-3104d61cdb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 200 len: 1505 microversion: 2.1 time: 0.773239 Jul 26 14:14:30.047268 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1047/2233] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:29 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 1505 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:30.053924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c29be911-c726-4374-9620-184c05c54771 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:30.056574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c29be911-c726-4374-9620-184c05c54771 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:30.063546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c29be911-c726-4374-9620-184c05c54771 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.064251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c29be911-c726-4374-9620-184c05c54771 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.065307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c29be911-c726-4374-9620-184c05c54771 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.065818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c29be911-c726-4374-9620-184c05c54771 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.089586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:30.117840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:30.283188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1d95661b-1e3c-4c0d-ad5b-1a3bba75348c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:30.291902 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1d95661b-1e3c-4c0d-ad5b-1a3bba75348c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.467575 Jul 26 14:14:30.303347 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1187/2234] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:29 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:30.312262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c67a8bf5-78ff-444d-ad10-c9debb498595 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:30.321297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c67a8bf5-78ff-444d-ad10-c9debb498595 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:30.331607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c67a8bf5-78ff-444d-ad10-c9debb498595 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.332313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c67a8bf5-78ff-444d-ad10-c9debb498595 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.333500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c67a8bf5-78ff-444d-ad10-c9debb498595 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.334247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c67a8bf5-78ff-444d-ad10-c9debb498595 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.486844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c29be911-c726-4374-9620-184c05c54771 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:30.494683 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c29be911-c726-4374-9620-184c05c54771 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.445436 Jul 26 14:14:30.495286 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1048/2235] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:30 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:30.512849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9ecdb78a-8dbf-412f-9746-27261397adb0 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:30.513570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9ecdb78a-8dbf-412f-9746-27261397adb0 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 8f842736-4c37-478b-a26b-94b53377cc43] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:30.520905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ecdb78a-8dbf-412f-9746-27261397adb0 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.521427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ecdb78a-8dbf-412f-9746-27261397adb0 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.522222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ecdb78a-8dbf-412f-9746-27261397adb0 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.522734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ecdb78a-8dbf-412f-9746-27261397adb0 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.538362 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-9ecdb78a-8dbf-412f-9746-27261397adb0 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] HTTP exception thrown: Instance 8f842736-4c37-478b-a26b-94b53377cc43 could not be found. Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9ecdb78a-8dbf-412f-9746-27261397adb0 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Request method failure captured: Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 HTTP/1.1 Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_SOCTqCNznpntgV68EPac8jCUsSVh8KdhztWLFyfgNKskoTyiWkmaUzZuC7Ru6wWOst-pj_n0r8jQT-3d7ijROFdFF8P5ICaU78GTJKAmQw0K6-KLN78CAqihSfElhKCFnXZpVrvZi2Tq2_h6N_5byk3RoKqFP6OAivImvfkWUn_sk Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3c83e50f8be04fb9b086a046f5b7eb00 Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c83e50f8be04fb9b086a046f5b7eb00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3c83e50f8be04fb9b086a046f5b7eb00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3c83e50f8be04fb9b086a046f5b7eb00", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c83e50f8be04fb9b086a046f5b7eb00"}]}] Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3c83e50f8be04fb9b086a046f5b7eb00 Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-LiveAutoBlockMigrationV225Test-912704160-project Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4a31af687dca4bea97ad5cb0459f0dbd Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-912704160-project Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 8f842736-4c37-478b-a26b-94b53377cc43 could not be found. Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '8f842736-4c37-478b-a26b-94b53377cc43'} Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f842736-4c37-478b-a26b-94b53377cc43 could not be found. Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f842736-4c37-478b-a26b-94b53377cc43 could not be found. Jul 26 14:14:30.540183 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f842736-4c37-478b-a26b-94b53377cc43 could not be found. Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9ecdb78a-8dbf-412f-9746-27261397adb0 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Returning 404 to user: Instance 8f842736-4c37-478b-a26b-94b53377cc43 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9ecdb78a-8dbf-412f-9746-27261397adb0 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43" status: 404 len: 111 microversion: 2.25 time: 0.045605 Jul 26 14:14:30.544139 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1049/2236] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:30 2022] GET /compute/v2.1/servers/8f842736-4c37-478b-a26b-94b53377cc43 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:14:30.548790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b804c144-d955-43b8-b29e-ac12d1d747eb tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:30.548790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b804c144-d955-43b8-b29e-ac12d1d747eb tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:30.550800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:30.558725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b804c144-d955-43b8-b29e-ac12d1d747eb tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.559501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b804c144-d955-43b8-b29e-ac12d1d747eb tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.560348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b804c144-d955-43b8-b29e-ac12d1d747eb tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.560852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b804c144-d955-43b8-b29e-ac12d1d747eb tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.725857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c67a8bf5-78ff-444d-ad10-c9debb498595 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:30.734470 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c67a8bf5-78ff-444d-ad10-c9debb498595 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.440261 Jul 26 14:14:30.741512 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1188/2237] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:30 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:30.748760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6f3ccb5f-2487-4616-a156-10dfb37e8250 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:30.749788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6f3ccb5f-2487-4616-a156-10dfb37e8250 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:30.758889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f3ccb5f-2487-4616-a156-10dfb37e8250 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.759777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f3ccb5f-2487-4616-a156-10dfb37e8250 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.761109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f3ccb5f-2487-4616-a156-10dfb37e8250 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.761649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f3ccb5f-2487-4616-a156-10dfb37e8250 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.815804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6f3ccb5f-2487-4616-a156-10dfb37e8250 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:14:30.894983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b804c144-d955-43b8-b29e-ac12d1d747eb tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:30.905521 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b804c144-d955-43b8-b29e-ac12d1d747eb tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.361713 Jul 26 14:14:30.919878 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1050/2238] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:30 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:30.928568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-255c4149-52f9-4120-a45c-f8b9cd626434 req-ac6a570c-0cdb-41e9-9790-4e6a9941f34d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f842736-4c37-478b-a26b-94b53377cc43", "name": "network-vif-deleted", "tag": "f1af542a-ca59-4955-b962-e2934fce33bb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:30.944818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-255c4149-52f9-4120-a45c-f8b9cd626434 req-ac6a570c-0cdb-41e9-9790-4e6a9941f34d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.945645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-255c4149-52f9-4120-a45c-f8b9cd626434 req-ac6a570c-0cdb-41e9-9790-4e6a9941f34d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:30.964633 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6f3ccb5f-2487-4616-a156-10dfb37e8250 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "DELETE /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 204 len: 0 microversion: 2.25 time: 0.220166 Jul 26 14:14:30.965509 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-255c4149-52f9-4120-a45c-f8b9cd626434 req-ac6a570c-0cdb-41e9-9790-4e6a9941f34d service nova] Creating event network-vif-deleted:f1af542a-ca59-4955-b962-e2934fce33bb for instance 8f842736-4c37-478b-a26b-94b53377cc43 on n-h2-833090-9 Jul 26 14:14:30.968317 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1189/2239] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:14:30 2022] DELETE /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:14:30.975448 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-255c4149-52f9-4120-a45c-f8b9cd626434 req-ac6a570c-0cdb-41e9-9790-4e6a9941f34d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052545 Jul 26 14:14:30.976906 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1051/2240] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:30.983366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-81fc8e12-e22f-40ec-be0c-b7d142ee1f78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-639948052", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:30.983800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1f9fc83d-5cc0-49b2-94e8-f9698094a103 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:30.984624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f9fc83d-5cc0-49b2-94e8-f9698094a103 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:30.999246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9fc83d-5cc0-49b2-94e8-f9698094a103 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:30.999679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9fc83d-5cc0-49b2-94e8-f9698094a103 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.000609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9fc83d-5cc0-49b2-94e8-f9698094a103 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.001943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9fc83d-5cc0-49b2-94e8-f9698094a103 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-81fc8e12-e22f-40ec-be0c-b7d142ee1f78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 234 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-639948052", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-639948052', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.003111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-81fc8e12-e22f-40ec-be0c-b7d142ee1f78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:31.006634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-81fc8e12-e22f-40ec-be0c-b7d142ee1f78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.030562 Jul 26 14:14:31.010576 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1190/2241] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:30 2022] POST /compute/v2.1/servers => generated 133 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:14:31.018775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6c3d29af-c511-43e4-9426-f8a309583ca9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:31.020261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6c3d29af-c511-43e4-9426-f8a309583ca9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:31.036956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c3d29af-c511-43e4-9426-f8a309583ca9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.037461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c3d29af-c511-43e4-9426-f8a309583ca9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.039346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c3d29af-c511-43e4-9426-f8a309583ca9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.041312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c3d29af-c511-43e4-9426-f8a309583ca9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.409799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1f9fc83d-5cc0-49b2-94e8-f9698094a103 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:31.410968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6c3d29af-c511-43e4-9426-f8a309583ca9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:31.426386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1f9fc83d-5cc0-49b2-94e8-f9698094a103 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:31.429073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1f9fc83d-5cc0-49b2-94e8-f9698094a103 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:31.431461 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1f9fc83d-5cc0-49b2-94e8-f9698094a103 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1563 microversion: 2.25 time: 0.452849 Jul 26 14:14:31.432554 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1052/2242] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:30 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1563 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:31.441878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8cd97057-16f9-4b4e-8335-71c4ec303e44 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:31.442882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8cd97057-16f9-4b4e-8335-71c4ec303e44 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:31.461629 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6c3d29af-c511-43e4-9426-f8a309583ca9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.448205 Jul 26 14:14:31.461931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8cd97057-16f9-4b4e-8335-71c4ec303e44 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.462594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8cd97057-16f9-4b4e-8335-71c4ec303e44 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.462763 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1191/2243] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:31 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:31.469745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8cd97057-16f9-4b4e-8335-71c4ec303e44 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.471471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d348cbf-06ed-4b17-a70b-7baf43a2b9c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:31.472117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8cd97057-16f9-4b4e-8335-71c4ec303e44 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.472548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4d348cbf-06ed-4b17-a70b-7baf43a2b9c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:31.484142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d348cbf-06ed-4b17-a70b-7baf43a2b9c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.484703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d348cbf-06ed-4b17-a70b-7baf43a2b9c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.486574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d348cbf-06ed-4b17-a70b-7baf43a2b9c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.487225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d348cbf-06ed-4b17-a70b-7baf43a2b9c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.510622 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8cd97057-16f9-4b4e-8335-71c4ec303e44 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] HTTP exception thrown: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8cd97057-16f9-4b4e-8335-71c4ec303e44 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Request method failure captured: Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 HTTP/1.1 Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ahBCO8U1U-OIyraJEQY0kTsppg_m6B1QLFdcOsQCftJCx9KqjCT4CCBUZZ-tTfTJQv0kUus69s5sVPjGxs4sEYIDiQlTuDhiymidnFEquiFtnRqL5MLX7H01HCrsz9vukbVAhe-Lq1PODkGRkyO8-Skdu5TOWC0LktA6vROFL8q0U Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ec89602d0304041872e521e0633922d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ec89602d0304041872e521e0633922d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}] Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7c2039c3b11f49cb91c5ebd9319d5758 Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c51cca15-cae3-46e6-a64d-b27c5bd2c654'} Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:31.513402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.518653 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:31.518653 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:31.518653 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:31.518653 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:31.518653 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:31.518653 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:31.518653 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:31.518653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8cd97057-16f9-4b4e-8335-71c4ec303e44 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Returning 404 to user: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:31.518653 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8cd97057-16f9-4b4e-8335-71c4ec303e44 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 404 len: 111 microversion: 2.1 time: 0.082218 Jul 26 14:14:31.520859 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1053/2244] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:31 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:31.526720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad0e867a-e3a8-4470-b2ac-119b37077ee8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:31.527629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ad0e867a-e3a8-4470-b2ac-119b37077ee8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:31.535808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad0e867a-e3a8-4470-b2ac-119b37077ee8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.536399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad0e867a-e3a8-4470-b2ac-119b37077ee8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.537301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad0e867a-e3a8-4470-b2ac-119b37077ee8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.537815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad0e867a-e3a8-4470-b2ac-119b37077ee8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.895057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4d348cbf-06ed-4b17-a70b-7baf43a2b9c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:31.904265 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d348cbf-06ed-4b17-a70b-7baf43a2b9c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.439984 Jul 26 14:14:31.904863 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1192/2245] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:31 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:31.910073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bc4ef576-f7a9-459e-a517-30e5612cda6d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:31.910690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bc4ef576-f7a9-459e-a517-30e5612cda6d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:31.917052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc4ef576-f7a9-459e-a517-30e5612cda6d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.917517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc4ef576-f7a9-459e-a517-30e5612cda6d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.918297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc4ef576-f7a9-459e-a517-30e5612cda6d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.918747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc4ef576-f7a9-459e-a517-30e5612cda6d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.951453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ad0e867a-e3a8-4470-b2ac-119b37077ee8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:31.963131 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad0e867a-e3a8-4470-b2ac-119b37077ee8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.440889 Jul 26 14:14:31.963716 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1054/2246] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:31 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:31.968240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1f006e3d-5760-4e98-9f18-d006fa2b98e5 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:31.984820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.compute.server_groups [None req-1f006e3d-5760-4e98-9f18-d006fa2b98e5 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Querying cell b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) for 1 instances {{(pid=119478) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 14:14:31.985768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f006e3d-5760-4e98-9f18-d006fa2b98e5 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:31.986217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f006e3d-5760-4e98-9f18-d006fa2b98e5 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:31.997495 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1f006e3d-5760-4e98-9f18-d006fa2b98e5 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.032735 Jul 26 14:14:31.998476 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1055/2247] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:14:31 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:32.004943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e17563a2-acc3-42cf-98c2-890b27215e7f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:32.005537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e17563a2-acc3-42cf-98c2-890b27215e7f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:32.012106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e17563a2-acc3-42cf-98c2-890b27215e7f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.012594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e17563a2-acc3-42cf-98c2-890b27215e7f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.013374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e17563a2-acc3-42cf-98c2-890b27215e7f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.013914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e17563a2-acc3-42cf-98c2-890b27215e7f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.386673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bc4ef576-f7a9-459e-a517-30e5612cda6d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:32.395371 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bc4ef576-f7a9-459e-a517-30e5612cda6d tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.489471 Jul 26 14:14:32.396077 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1193/2248] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:31 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:32.408191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a4aebd90-5124-4b26-b020-451c9553649b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:32.408191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a4aebd90-5124-4b26-b020-451c9553649b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 10883a86-0a2b-48f6-ac69-aa904fb365c4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:32.408671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e17563a2-acc3-42cf-98c2-890b27215e7f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:32.410000 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a4aebd90-5124-4b26-b020-451c9553649b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 10883a86-0a2b-48f6-ac69-aa904fb365c4 could not be found. Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a4aebd90-5124-4b26-b020-451c9553649b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/10883a86-0a2b-48f6-ac69-aa904fb365c4/action HTTP/1.1 Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 13 Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: {"pause": {}} Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 10883a86-0a2b-48f6-ac69-aa904fb365c4 could not be found. Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '10883a86-0a2b-48f6-ac69-aa904fb365c4', 'body': {'pause': {}}} Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10883a86-0a2b-48f6-ac69-aa904fb365c4 could not be found. Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10883a86-0a2b-48f6-ac69-aa904fb365c4 could not be found. Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:32.414433 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:32.427629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:32.427629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:32.427629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10883a86-0a2b-48f6-ac69-aa904fb365c4 could not be found. Jul 26 14:14:32.427629 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.427629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a4aebd90-5124-4b26-b020-451c9553649b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 10883a86-0a2b-48f6-ac69-aa904fb365c4 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:32.427629 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a4aebd90-5124-4b26-b020-451c9553649b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/10883a86-0a2b-48f6-ac69-aa904fb365c4/action" status: 404 len: 111 microversion: 2.1 time: 0.018770 Jul 26 14:14:32.427629 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1194/2249] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:32 2022] POST /compute/v2.1/servers/10883a86-0a2b-48f6-ac69-aa904fb365c4/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:32.428318 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e17563a2-acc3-42cf-98c2-890b27215e7f tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.427624 Jul 26 14:14:32.428843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8153d55d-7ca8-4132-926e-93cc215102ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:32.430990 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1056/2250] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:31 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:32.440677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c5a0a0b9-37dc-4c09-816d-8ea6090d2c00 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:32.441311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c5a0a0b9-37dc-4c09-816d-8ea6090d2c00 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:32.447752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5a0a0b9-37dc-4c09-816d-8ea6090d2c00 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.448140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5a0a0b9-37dc-4c09-816d-8ea6090d2c00 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.449115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5a0a0b9-37dc-4c09-816d-8ea6090d2c00 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.450038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5a0a0b9-37dc-4c09-816d-8ea6090d2c00 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.453663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.server_groups [None req-8153d55d-7ca8-4132-926e-93cc215102ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Querying cell b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) for 1 instances {{(pid=119479) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 26 14:14:32.455013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8153d55d-7ca8-4132-926e-93cc215102ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.455453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8153d55d-7ca8-4132-926e-93cc215102ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.465954 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8153d55d-7ca8-4132-926e-93cc215102ae tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/a9b97425-739c-4eda-85e0-d9eb8c104646" status: 200 len: 184 microversion: 2.1 time: 0.047780 Jul 26 14:14:32.465954 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1195/2251] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:14:32 2022] GET /compute/v2.1/os-server-groups/a9b97425-739c-4eda-85e0-d9eb8c104646 => generated 184 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:32.475203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-969af546-7f4b-424e-af37-dc80d8bff770 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:32.475833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-969af546-7f4b-424e-af37-dc80d8bff770 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:32.482008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-969af546-7f4b-424e-af37-dc80d8bff770 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.482479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-969af546-7f4b-424e-af37-dc80d8bff770 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.483278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-969af546-7f4b-424e-af37-dc80d8bff770 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.483731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-969af546-7f4b-424e-af37-dc80d8bff770 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.836322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c5a0a0b9-37dc-4c09-816d-8ea6090d2c00 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:32.844121 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c5a0a0b9-37dc-4c09-816d-8ea6090d2c00 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.412031 Jul 26 14:14:32.845794 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1057/2252] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:32 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:32.851255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-daf1e3de-78b6-4b8b-94f5-30bf89b72dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:32.851737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-daf1e3de-78b6-4b8b-94f5-30bf89b72dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:32.863108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-969af546-7f4b-424e-af37-dc80d8bff770 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:32.864285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-daf1e3de-78b6-4b8b-94f5-30bf89b72dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.864745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-daf1e3de-78b6-4b8b-94f5-30bf89b72dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.865547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-daf1e3de-78b6-4b8b-94f5-30bf89b72dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.865925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:32.866035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-daf1e3de-78b6-4b8b-94f5-30bf89b72dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.884617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-969af546-7f4b-424e-af37-dc80d8bff770 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:32.886302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-969af546-7f4b-424e-af37-dc80d8bff770 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:32.887256 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-daf1e3de-78b6-4b8b-94f5-30bf89b72dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] HTTP exception thrown: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:32.887515 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-969af546-7f4b-424e-af37-dc80d8bff770 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1563 microversion: 2.25 time: 0.420042 Jul 26 14:14:32.888345 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1196/2253] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:32 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1563 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:32.893004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71116f06-3c46-4d7d-aeee-30629432a0dc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:32.893616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71116f06-3c46-4d7d-aeee-30629432a0dc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:32.901008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71116f06-3c46-4d7d-aeee-30629432a0dc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.901957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71116f06-3c46-4d7d-aeee-30629432a0dc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-daf1e3de-78b6-4b8b-94f5-30bf89b72dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Request method failure captured: Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 HTTP/1.1 Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ahBCO8U1U-OIyraJEQY0kTsppg_m6B1QLFdcOsQCftJCx9KqjCT4CCBUZZ-tTfTJQv0kUus69s5sVPjGxs4sEYIDiQlTuDhiymidnFEquiFtnRqL5MLX7H01HCrsz9vukbVAhe-Lq1PODkGRkyO8-Skdu5TOWC0LktA6vROFL8q0U Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ec89602d0304041872e521e0633922d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ec89602d0304041872e521e0633922d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}] Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7c2039c3b11f49cb91c5ebd9319d5758 Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c51cca15-cae3-46e6-a64d-b27c5bd2c654'} Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:32.902132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:32.915024 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.915024 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:32.915024 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.915024 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:32.915024 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:32.915024 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:32.915024 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:32.915024 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:32.915024 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:32.915024 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.918278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71116f06-3c46-4d7d-aeee-30629432a0dc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.918278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71116f06-3c46-4d7d-aeee-30629432a0dc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.918898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-daf1e3de-78b6-4b8b-94f5-30bf89b72dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Returning 404 to user: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:32.918898 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-daf1e3de-78b6-4b8b-94f5-30bf89b72dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 404 len: 111 microversion: 2.1 time: 0.056792 Jul 26 14:14:32.918898 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1058/2254] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:14:32 2022] DELETE /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:32.918898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b36567cb-b1e1-496f-a0cc-12b01366955a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:32.919677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b36567cb-b1e1-496f-a0cc-12b01366955a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] [instance: c51cca15-cae3-46e6-a64d-b27c5bd2c654] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:32.929963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b36567cb-b1e1-496f-a0cc-12b01366955a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.930575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b36567cb-b1e1-496f-a0cc-12b01366955a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.931628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b36567cb-b1e1-496f-a0cc-12b01366955a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.932374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b36567cb-b1e1-496f-a0cc-12b01366955a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.950609 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b36567cb-b1e1-496f-a0cc-12b01366955a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] HTTP exception thrown: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b36567cb-b1e1-496f-a0cc-12b01366955a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Request method failure captured: Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 HTTP/1.1 Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ahBCO8U1U-OIyraJEQY0kTsppg_m6B1QLFdcOsQCftJCx9KqjCT4CCBUZZ-tTfTJQv0kUus69s5sVPjGxs4sEYIDiQlTuDhiymidnFEquiFtnRqL5MLX7H01HCrsz9vukbVAhe-Lq1PODkGRkyO8-Skdu5TOWC0LktA6vROFL8q0U Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ec89602d0304041872e521e0633922d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ec89602d0304041872e521e0633922d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}] Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7c2039c3b11f49cb91c5ebd9319d5758 Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c51cca15-cae3-46e6-a64d-b27c5bd2c654'} Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:32.952234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.959392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:32.959392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:32.959392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:32.959392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:32.959392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:32.959392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. Jul 26 14:14:32.959392 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:32.959392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b36567cb-b1e1-496f-a0cc-12b01366955a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Returning 404 to user: Instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:32.959392 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b36567cb-b1e1-496f-a0cc-12b01366955a tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654" status: 404 len: 111 microversion: 2.1 time: 0.039382 Jul 26 14:14:32.959392 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1059/2255] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:32 2022] GET /compute/v2.1/servers/c51cca15-cae3-46e6-a64d-b27c5bd2c654 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:32.962619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-91cb3ae6-d703-4e39-b7aa-5989f49964ba tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:32.963598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-91cb3ae6-d703-4e39-b7aa-5989f49964ba tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:32.972514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91cb3ae6-d703-4e39-b7aa-5989f49964ba tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.972979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91cb3ae6-d703-4e39-b7aa-5989f49964ba tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:32.977091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91cb3ae6-d703-4e39-b7aa-5989f49964ba tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:32.978207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91cb3ae6-d703-4e39-b7aa-5989f49964ba tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:33.283918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-71116f06-3c46-4d7d-aeee-30629432a0dc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:33.291930 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71116f06-3c46-4d7d-aeee-30629432a0dc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.402801 Jul 26 14:14:33.292854 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1197/2256] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:32 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:33.294155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-91cb3ae6-d703-4e39-b7aa-5989f49964ba tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:33.306123 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-91cb3ae6-d703-4e39-b7aa-5989f49964ba tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.348095 Jul 26 14:14:33.315820 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1060/2257] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:32 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:33.317953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f73fb1f7-2251-44a4-a81e-7e7c5bbfc6c5 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:33.323080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-35296ebe-bf84-4636-9ac6-b258f42f4098 req-57d24ced-e297-4eee-8de6-4eed3197eb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51cca15-cae3-46e6-a64d-b27c5bd2c654", "name": "network-vif-deleted", "tag": "de93625a-5e14-46ed-aa19-4208b02060e4"}, {"name": "network-changed", "server_uuid": "20e0fbcc-42e6-482f-a696-a2046d4cd25d", "tag": "9e2877ca-ba93-4c4b-aa8c-74fc979033fc"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:33.326393 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-f73fb1f7-2251-44a4-a81e-7e7c5bbfc6c5 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] HTTP exception thrown: Instance group b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8 could not be found. Jul 26 14:14:33.336127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-35296ebe-bf84-4636-9ac6-b258f42f4098 req-57d24ced-e297-4eee-8de6-4eed3197eb23 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f73fb1f7-2251-44a4-a81e-7e7c5bbfc6c5 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Request method failure captured: Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-server-groups/b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8 HTTP/1.1 Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ahBCO8U1U-OIyraJEQY0kTsppg_m6B1QLFdcOsQCftJCx9KqjCT4CCBUZZ-tTfTJQv0kUus69s5sVPjGxs4sEYIDiQlTuDhiymidnFEquiFtnRqL5MLX7H01HCrsz9vukbVAhe-Lq1PODkGRkyO8-Skdu5TOWC0LktA6vROFL8q0U Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ec89602d0304041872e521e0633922d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ec89602d0304041872e521e0633922d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}] Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7c2039c3b11f49cb91c5ebd9319d5758 Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance group b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8 could not be found. Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8'} Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8 could not be found. Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8 could not be found. Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.336368 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.340591 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:33.340591 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:33.340591 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:33.340591 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:33.340591 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8 could not be found. Jul 26 14:14:33.340591 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.341240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-35296ebe-bf84-4636-9ac6-b258f42f4098 req-57d24ced-e297-4eee-8de6-4eed3197eb23 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:33.341333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f73fb1f7-2251-44a4-a81e-7e7c5bbfc6c5 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Returning 404 to user: Instance group b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:33.341333 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f73fb1f7-2251-44a4-a81e-7e7c5bbfc6c5 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8" status: 404 len: 117 microversion: 2.1 time: 0.043825 Jul 26 14:14:33.341333 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1198/2258] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:14:33 2022] DELETE /compute/v2.1/os-server-groups/b4bbe7d2-25b9-4000-a0ba-dab44e9e1dd8 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:33.350466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e74d5bc1-3975-4f9f-a5ca-3f07bc8ca018 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:33.351430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e74d5bc1-3975-4f9f-a5ca-3f07bc8ca018 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:33.361096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e74d5bc1-3975-4f9f-a5ca-3f07bc8ca018 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:33.361564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e74d5bc1-3975-4f9f-a5ca-3f07bc8ca018 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:33.362363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e74d5bc1-3975-4f9f-a5ca-3f07bc8ca018 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:33.362807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e74d5bc1-3975-4f9f-a5ca-3f07bc8ca018 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:33.363641 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-35296ebe-bf84-4636-9ac6-b258f42f4098 req-57d24ced-e297-4eee-8de6-4eed3197eb23 service nova] Creating event network-vif-deleted:de93625a-5e14-46ed-aa19-4208b02060e4 for instance c51cca15-cae3-46e6-a64d-b27c5bd2c654 on n-h1-833090-9 Jul 26 14:14:33.364213 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-35296ebe-bf84-4636-9ac6-b258f42f4098 req-57d24ced-e297-4eee-8de6-4eed3197eb23 service nova] Creating event network-changed:9e2877ca-ba93-4c4b-aa8c-74fc979033fc for instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d on n-h2-833090-9 Jul 26 14:14:33.373020 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-35296ebe-bf84-4636-9ac6-b258f42f4098 req-57d24ced-e297-4eee-8de6-4eed3197eb23 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.054030 Jul 26 14:14:33.373955 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1061/2259] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:33.380644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3da342a5-d182-487d-8963-7a9d1f2b0dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:33.389605 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-3da342a5-d182-487d-8963-7a9d1f2b0dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] HTTP exception thrown: Instance group e7dd3dc6-0357-4c05-9661-6b90b33696af could not be found. Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3da342a5-d182-487d-8963-7a9d1f2b0dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Request method failure captured: Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-server-groups/e7dd3dc6-0357-4c05-9661-6b90b33696af HTTP/1.1 Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ahBCO8U1U-OIyraJEQY0kTsppg_m6B1QLFdcOsQCftJCx9KqjCT4CCBUZZ-tTfTJQv0kUus69s5sVPjGxs4sEYIDiQlTuDhiymidnFEquiFtnRqL5MLX7H01HCrsz9vukbVAhe-Lq1PODkGRkyO8-Skdu5TOWC0LktA6vROFL8q0U Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ec89602d0304041872e521e0633922d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ec89602d0304041872e521e0633922d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}] Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7c2039c3b11f49cb91c5ebd9319d5758 Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance group e7dd3dc6-0357-4c05-9661-6b90b33696af could not be found. Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e7dd3dc6-0357-4c05-9661-6b90b33696af'} Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e7dd3dc6-0357-4c05-9661-6b90b33696af could not be found. Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e7dd3dc6-0357-4c05-9661-6b90b33696af could not be found. Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.392236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.402164 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:33.402164 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:33.402164 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:33.402164 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:33.402164 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e7dd3dc6-0357-4c05-9661-6b90b33696af could not be found. Jul 26 14:14:33.402164 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.402164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3da342a5-d182-487d-8963-7a9d1f2b0dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Returning 404 to user: Instance group e7dd3dc6-0357-4c05-9661-6b90b33696af could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:33.402164 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3da342a5-d182-487d-8963-7a9d1f2b0dac tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/e7dd3dc6-0357-4c05-9661-6b90b33696af" status: 404 len: 117 microversion: 2.1 time: 0.018466 Jul 26 14:14:33.402164 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1062/2260] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:14:33 2022] DELETE /compute/v2.1/os-server-groups/e7dd3dc6-0357-4c05-9661-6b90b33696af => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:33.404868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a811bd70-4f1f-43d5-b59e-a3ea656c13ed tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:33.414786 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-a811bd70-4f1f-43d5-b59e-a3ea656c13ed tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] HTTP exception thrown: Instance group 1147f6ab-8034-4af3-b26a-4d5262b666e2 could not be found. Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a811bd70-4f1f-43d5-b59e-a3ea656c13ed tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Request method failure captured: Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-server-groups/1147f6ab-8034-4af3-b26a-4d5262b666e2 HTTP/1.1 Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ahBCO8U1U-OIyraJEQY0kTsppg_m6B1QLFdcOsQCftJCx9KqjCT4CCBUZZ-tTfTJQv0kUus69s5sVPjGxs4sEYIDiQlTuDhiymidnFEquiFtnRqL5MLX7H01HCrsz9vukbVAhe-Lq1PODkGRkyO8-Skdu5TOWC0LktA6vROFL8q0U Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ec89602d0304041872e521e0633922d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ec89602d0304041872e521e0633922d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}] Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7c2039c3b11f49cb91c5ebd9319d5758 Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance group 1147f6ab-8034-4af3-b26a-4d5262b666e2 could not be found. Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '1147f6ab-8034-4af3-b26a-4d5262b666e2'} Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1147f6ab-8034-4af3-b26a-4d5262b666e2 could not be found. Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1147f6ab-8034-4af3-b26a-4d5262b666e2 could not be found. Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.416437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.420135 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:33.420135 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:33.420135 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:33.420135 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:33.420135 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1147f6ab-8034-4af3-b26a-4d5262b666e2 could not be found. Jul 26 14:14:33.420135 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.420135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a811bd70-4f1f-43d5-b59e-a3ea656c13ed tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Returning 404 to user: Instance group 1147f6ab-8034-4af3-b26a-4d5262b666e2 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:33.420135 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a811bd70-4f1f-43d5-b59e-a3ea656c13ed tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/1147f6ab-8034-4af3-b26a-4d5262b666e2" status: 404 len: 117 microversion: 2.1 time: 0.018803 Jul 26 14:14:33.420135 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1063/2261] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:14:33 2022] DELETE /compute/v2.1/os-server-groups/1147f6ab-8034-4af3-b26a-4d5262b666e2 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:33.428849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1bc4e13-bc21-4ef2-925c-5074526aeb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:33.440932 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b1bc4e13-bc21-4ef2-925c-5074526aeb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] HTTP exception thrown: Instance group 0bc1f098-9356-4c1e-99b0-f115941761c9 could not be found. Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1bc4e13-bc21-4ef2-925c-5074526aeb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Request method failure captured: Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-server-groups/0bc1f098-9356-4c1e-99b0-f115941761c9 HTTP/1.1 Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ahBCO8U1U-OIyraJEQY0kTsppg_m6B1QLFdcOsQCftJCx9KqjCT4CCBUZZ-tTfTJQv0kUus69s5sVPjGxs4sEYIDiQlTuDhiymidnFEquiFtnRqL5MLX7H01HCrsz9vukbVAhe-Lq1PODkGRkyO8-Skdu5TOWC0LktA6vROFL8q0U Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ec89602d0304041872e521e0633922d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ec89602d0304041872e521e0633922d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ec89602d0304041872e521e0633922d"}]}] Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4ec89602d0304041872e521e0633922d Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerGroupTestJSON-878568999 Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7c2039c3b11f49cb91c5ebd9319d5758 Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerGroupTestJSON-878568999-project Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance group 0bc1f098-9356-4c1e-99b0-f115941761c9 could not be found. Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '0bc1f098-9356-4c1e-99b0-f115941761c9'} Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0bc1f098-9356-4c1e-99b0-f115941761c9 could not be found. Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0bc1f098-9356-4c1e-99b0-f115941761c9 could not be found. Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.444296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:33.447594 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:33.447594 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:33.447594 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:33.447594 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:33.447594 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0bc1f098-9356-4c1e-99b0-f115941761c9 could not be found. Jul 26 14:14:33.447594 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:33.447594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1bc4e13-bc21-4ef2-925c-5074526aeb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Returning 404 to user: Instance group 0bc1f098-9356-4c1e-99b0-f115941761c9 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:33.447594 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b1bc4e13-bc21-4ef2-925c-5074526aeb5f tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/0bc1f098-9356-4c1e-99b0-f115941761c9" status: 404 len: 117 microversion: 2.1 time: 0.022865 Jul 26 14:14:33.452781 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1064/2262] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:14:33 2022] DELETE /compute/v2.1/os-server-groups/0bc1f098-9356-4c1e-99b0-f115941761c9 => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:33.458791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86d53d4a-4ae1-4a91-8042-4f40b18419b4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:33.459549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-86d53d4a-4ae1-4a91-8042-4f40b18419b4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:33.467269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86d53d4a-4ae1-4a91-8042-4f40b18419b4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:33.467756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86d53d4a-4ae1-4a91-8042-4f40b18419b4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:33.468589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86d53d4a-4ae1-4a91-8042-4f40b18419b4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:33.469039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86d53d4a-4ae1-4a91-8042-4f40b18419b4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:33.482793 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e74d5bc1-3975-4f9f-a5ca-3f07bc8ca018 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 202 len: 0 microversion: 2.1 time: 0.139151 Jul 26 14:14:33.483491 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1199/2263] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:33 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:14:33.490743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d91e23e3-825e-43cb-93a7-87e7347dacfe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:33.491476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d91e23e3-825e-43cb-93a7-87e7347dacfe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:33.507462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d91e23e3-825e-43cb-93a7-87e7347dacfe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:33.508274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d91e23e3-825e-43cb-93a7-87e7347dacfe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:33.510386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d91e23e3-825e-43cb-93a7-87e7347dacfe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:33.510839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d91e23e3-825e-43cb-93a7-87e7347dacfe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.001267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-86d53d4a-4ae1-4a91-8042-4f40b18419b4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:34.004507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d91e23e3-825e-43cb-93a7-87e7347dacfe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:34.013650 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-86d53d4a-4ae1-4a91-8042-4f40b18419b4 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.559634 Jul 26 14:14:34.014044 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d91e23e3-825e-43cb-93a7-87e7347dacfe tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.528386 Jul 26 14:14:34.014255 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1065/2264] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:33 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:34.016412 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1200/2265] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:33 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:34.023787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c5b21c12-80b9-48bb-b3ee-9e745c117580 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:34.036737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a6ace5fd-1884-4be6-80a4-f5eb4aab6b9d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:34.038119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a6ace5fd-1884-4be6-80a4-f5eb4aab6b9d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:34.044641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ace5fd-1884-4be6-80a4-f5eb4aab6b9d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.046326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ace5fd-1884-4be6-80a4-f5eb4aab6b9d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.046326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ace5fd-1884-4be6-80a4-f5eb4aab6b9d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.046326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ace5fd-1884-4be6-80a4-f5eb4aab6b9d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.058705 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c5b21c12-80b9-48bb-b3ee-9e745c117580 tempest-ServerGroupTestJSON-878568999 tempest-ServerGroupTestJSON-878568999-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/a9b97425-739c-4eda-85e0-d9eb8c104646" status: 204 len: 0 microversion: 2.1 time: 0.043102 Jul 26 14:14:34.064928 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1066/2266] 10.222.0.70 () {58 vars in 1266 bytes} [Tue Jul 26 14:14:34 2022] DELETE /compute/v2.1/os-server-groups/a9b97425-739c-4eda-85e0-d9eb8c104646 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:14:34.075422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:34.076872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:34.085116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.085574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.086647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.087100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.125119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.126040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.126511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lazy-loading 'fault' on Instance uuid 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:14:34.228128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:34.239896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:34.241496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a31af687dca4bea97ad5cb0459f0dbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c83e50f8be04fb9b086a046f5b7eb00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:34.242738 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b2b05e23-31da-481a-9157-a609240e3dfc tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 200 len: 1352 microversion: 2.25 time: 0.173701 Jul 26 14:14:34.243470 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1067/2267] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:34 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 1352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:34.333669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2d6325ea-1187-4475-a538-9f1c59c1fa15 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:34.334956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2d6325ea-1187-4475-a538-9f1c59c1fa15 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:34.342394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d6325ea-1187-4475-a538-9f1c59c1fa15 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.342890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d6325ea-1187-4475-a538-9f1c59c1fa15 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.343728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d6325ea-1187-4475-a538-9f1c59c1fa15 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.344939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d6325ea-1187-4475-a538-9f1c59c1fa15 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.366990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:34.371186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a6ace5fd-1884-4be6-80a4-f5eb4aab6b9d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:34.386102 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a6ace5fd-1884-4be6-80a4-f5eb4aab6b9d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1490 microversion: 2.1 time: 0.369299 Jul 26 14:14:34.386887 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1201/2268] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:34 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1490 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:34.407450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4255b5f-9a3d-435b-977c-57458ffb0387 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:34.408017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e4255b5f-9a3d-435b-977c-57458ffb0387 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:34.414623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4255b5f-9a3d-435b-977c-57458ffb0387 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.415072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4255b5f-9a3d-435b-977c-57458ffb0387 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.415935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4255b5f-9a3d-435b-977c-57458ffb0387 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.416394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4255b5f-9a3d-435b-977c-57458ffb0387 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.443175 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e4255b5f-9a3d-435b-977c-57458ffb0387 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Cannot 'pause' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state paused Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4255b5f-9a3d-435b-977c-57458ffb0387 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action HTTP/1.1 Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 13 Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: {"pause": {}} Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: exception: Cannot 'pause' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state paused Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e6b94307-dd41-4f71-b529-c6cbb944c27f', 'body': {'pause': {}}} Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f in vm_state paused. Cannot pause while the instance is in this state. Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state paused Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:34.444870 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:34.450177 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:34.450177 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:34.450177 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:34.450177 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state paused Jul 26 14:14:34.450177 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:34.450177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4255b5f-9a3d-435b-977c-57458ffb0387 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 409 to user: Cannot 'pause' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state paused {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:34.450177 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4255b5f-9a3d-435b-977c-57458ffb0387 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 409 len: 143 microversion: 2.1 time: 0.043022 Jul 26 14:14:34.450177 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1202/2269] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:34 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 143 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 14:14:34.456882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8b7134cd-51a5-415d-81df-9a91e8715694 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:34.457613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8b7134cd-51a5-415d-81df-9a91e8715694 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:34.464078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b7134cd-51a5-415d-81df-9a91e8715694 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.464537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b7134cd-51a5-415d-81df-9a91e8715694 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.465341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b7134cd-51a5-415d-81df-9a91e8715694 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.465793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b7134cd-51a5-415d-81df-9a91e8715694 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.551907 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8b7134cd-51a5-415d-81df-9a91e8715694 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 202 len: 0 microversion: 2.1 time: 0.099781 Jul 26 14:14:34.552592 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1203/2270] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:34 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:14:34.563633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6807b9d7-e527-4670-b22b-fd823fe69cdc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:34.565699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6807b9d7-e527-4670-b22b-fd823fe69cdc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:34.576587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6807b9d7-e527-4670-b22b-fd823fe69cdc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.577450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6807b9d7-e527-4670-b22b-fd823fe69cdc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.578751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6807b9d7-e527-4670-b22b-fd823fe69cdc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:34.579966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6807b9d7-e527-4670-b22b-fd823fe69cdc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:34.666700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2d6325ea-1187-4475-a538-9f1c59c1fa15 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:34.675520 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2d6325ea-1187-4475-a538-9f1c59c1fa15 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.349503 Jul 26 14:14:34.676149 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1068/2271] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:34 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:34.913208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6807b9d7-e527-4670-b22b-fd823fe69cdc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:34.927702 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6807b9d7-e527-4670-b22b-fd823fe69cdc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1497 microversion: 2.1 time: 0.370207 Jul 26 14:14:34.929854 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1204/2272] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:34 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1497 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:35.041149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-27cae5ca-d56f-41cd-849c-1741a30f3084 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:35.048340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dcc64d38-21f0-4620-8a82-f214dffbeacb tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:35.049116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dcc64d38-21f0-4620-8a82-f214dffbeacb tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:35.049461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-27cae5ca-d56f-41cd-849c-1741a30f3084 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:35.059172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27cae5ca-d56f-41cd-849c-1741a30f3084 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.060071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27cae5ca-d56f-41cd-849c-1741a30f3084 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:35.061070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27cae5ca-d56f-41cd-849c-1741a30f3084 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.061758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27cae5ca-d56f-41cd-849c-1741a30f3084 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:35.066211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcc64d38-21f0-4620-8a82-f214dffbeacb tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.066805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcc64d38-21f0-4620-8a82-f214dffbeacb tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:35.067787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcc64d38-21f0-4620-8a82-f214dffbeacb tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.068489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcc64d38-21f0-4620-8a82-f214dffbeacb tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:35.502681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-27cae5ca-d56f-41cd-849c-1741a30f3084 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:35.511355 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-27cae5ca-d56f-41cd-849c-1741a30f3084 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.475267 Jul 26 14:14:35.511936 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1069/2273] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:35 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:35.516827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de71d59b-1557-413b-bd6c-c5ba37bb2791 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:35.517701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-de71d59b-1557-413b-bd6c-c5ba37bb2791 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] [instance: 50ff036a-5fa7-4b56-af8a-afd163f7c3b5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:35.524056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de71d59b-1557-413b-bd6c-c5ba37bb2791 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.524583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de71d59b-1557-413b-bd6c-c5ba37bb2791 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:35.525551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de71d59b-1557-413b-bd6c-c5ba37bb2791 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.526146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de71d59b-1557-413b-bd6c-c5ba37bb2791 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:35.528640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dcc64d38-21f0-4620-8a82-f214dffbeacb tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:35.540670 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dcc64d38-21f0-4620-8a82-f214dffbeacb tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.497334 Jul 26 14:14:35.541906 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-de71d59b-1557-413b-bd6c-c5ba37bb2791 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] HTTP exception thrown: Instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 could not be found. Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de71d59b-1557-413b-bd6c-c5ba37bb2791 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Request method failure captured: Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 HTTP/1.1 Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_SOCTqCNznpntgV68EPac8jCUsSVh8KdhztWLFyfgNKskoTyiWkmaUzZuC7Ru6wWOst-pj_n0r8jQT-3d7ijROFdFF8P5ICaU78GTJKAmQw0K6-KLN78CAqihSfElhKCFnXZpVrvZi2Tq2_h6N_5byk3RoKqFP6OAivImvfkWUn_sk Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.25 Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3c83e50f8be04fb9b086a046f5b7eb00 Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c83e50f8be04fb9b086a046f5b7eb00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3c83e50f8be04fb9b086a046f5b7eb00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3c83e50f8be04fb9b086a046f5b7eb00", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3c83e50f8be04fb9b086a046f5b7eb00"}]}] Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3c83e50f8be04fb9b086a046f5b7eb00 Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-912704160 Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-LiveAutoBlockMigrationV225Test-912704160-project Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4a31af687dca4bea97ad5cb0459f0dbd Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-912704160-project Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 could not be found. Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '50ff036a-5fa7-4b56-af8a-afd163f7c3b5'} Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 could not be found. Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 could not be found. Jul 26 14:14:35.543540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 could not be found. Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de71d59b-1557-413b-bd6c-c5ba37bb2791 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] Returning 404 to user: Instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-de71d59b-1557-413b-bd6c-c5ba37bb2791 tempest-LiveAutoBlockMigrationV225Test-912704160 tempest-LiveAutoBlockMigrationV225Test-912704160-project] 10.222.0.70 "GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5" status: 404 len: 111 microversion: 2.25 time: 0.032079 Jul 26 14:14:35.552908 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1070/2274] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:35 2022] GET /compute/v2.1/servers/50ff036a-5fa7-4b56-af8a-afd163f7c3b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:14:35.555646 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1205/2275] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:35 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:35.557249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-30399595-4dd6-41e2-8474-570827dd188b req-40f8601b-9abd-4500-b143-0eee15a23621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ff036a-5fa7-4b56-af8a-afd163f7c3b5", "name": "network-vif-deleted", "tag": "191708b4-b957-42c3-a0aa-284ad81e99c7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:35.568336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-30399595-4dd6-41e2-8474-570827dd188b req-40f8601b-9abd-4500-b143-0eee15a23621 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.569413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-30399595-4dd6-41e2-8474-570827dd188b req-40f8601b-9abd-4500-b143-0eee15a23621 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:35.580860 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-30399595-4dd6-41e2-8474-570827dd188b req-40f8601b-9abd-4500-b143-0eee15a23621 service nova] Creating event network-vif-deleted:191708b4-b957-42c3-a0aa-284ad81e99c7 for instance 50ff036a-5fa7-4b56-af8a-afd163f7c3b5 on n-h2-833090-9 Jul 26 14:14:35.586006 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-30399595-4dd6-41e2-8474-570827dd188b req-40f8601b-9abd-4500-b143-0eee15a23621 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034760 Jul 26 14:14:35.587631 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1071/2276] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:35.698657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cc8ea5f5-1b8a-43a1-86a4-044ecf453b13 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:35.699534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cc8ea5f5-1b8a-43a1-86a4-044ecf453b13 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:35.706543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc8ea5f5-1b8a-43a1-86a4-044ecf453b13 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.706993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc8ea5f5-1b8a-43a1-86a4-044ecf453b13 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:35.707770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc8ea5f5-1b8a-43a1-86a4-044ecf453b13 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.708241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc8ea5f5-1b8a-43a1-86a4-044ecf453b13 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:35.957513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dacc7938-afdd-4002-bf27-8bfee308b95d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:35.958222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dacc7938-afdd-4002-bf27-8bfee308b95d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:35.965864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dacc7938-afdd-4002-bf27-8bfee308b95d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.966312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dacc7938-afdd-4002-bf27-8bfee308b95d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:35.967097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dacc7938-afdd-4002-bf27-8bfee308b95d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:35.967535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dacc7938-afdd-4002-bf27-8bfee308b95d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:36.482033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cc8ea5f5-1b8a-43a1-86a4-044ecf453b13 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:36.491502 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cc8ea5f5-1b8a-43a1-86a4-044ecf453b13 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.796820 Jul 26 14:14:36.492322 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1206/2277] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:35 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:36.538964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a54941af-4195-4c30-a429-c9ca30db13ba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:36.539625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a54941af-4195-4c30-a429-c9ca30db13ba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:36.545906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a54941af-4195-4c30-a429-c9ca30db13ba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:36.546373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a54941af-4195-4c30-a429-c9ca30db13ba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:36.547251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a54941af-4195-4c30-a429-c9ca30db13ba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:36.547917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a54941af-4195-4c30-a429-c9ca30db13ba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:36.561999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dacc7938-afdd-4002-bf27-8bfee308b95d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:36.570790 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dacc7938-afdd-4002-bf27-8bfee308b95d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.618462 Jul 26 14:14:36.580334 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1072/2278] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:35 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:36.589614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a078e476-2760-4cde-b4f4-a8f34644f9b9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:36.590917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a078e476-2760-4cde-b4f4-a8f34644f9b9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:36.598228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a078e476-2760-4cde-b4f4-a8f34644f9b9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:36.598681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a078e476-2760-4cde-b4f4-a8f34644f9b9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:36.599460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a078e476-2760-4cde-b4f4-a8f34644f9b9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:36.599903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a078e476-2760-4cde-b4f4-a8f34644f9b9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:36.984771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a54941af-4195-4c30-a429-c9ca30db13ba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:36.996646 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a54941af-4195-4c30-a429-c9ca30db13ba tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.460357 Jul 26 14:14:37.023406 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1207/2279] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:36 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:37.030329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6a6adb41-d00a-4afb-aa79-4351f7348ba7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:37.031037 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6a6adb41-d00a-4afb-aa79-4351f7348ba7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:37.044391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a6adb41-d00a-4afb-aa79-4351f7348ba7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:37.044874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a6adb41-d00a-4afb-aa79-4351f7348ba7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:37.047009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a6adb41-d00a-4afb-aa79-4351f7348ba7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:37.048894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a6adb41-d00a-4afb-aa79-4351f7348ba7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:37.105569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a078e476-2760-4cde-b4f4-a8f34644f9b9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:37.114193 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a078e476-2760-4cde-b4f4-a8f34644f9b9 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.532723 Jul 26 14:14:37.114888 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1073/2280] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:36 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:37.466460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6a6adb41-d00a-4afb-aa79-4351f7348ba7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:37.482302 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6a6adb41-d00a-4afb-aa79-4351f7348ba7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.457027 Jul 26 14:14:37.484101 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1208/2281] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:37 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:37.510983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4fac77f1-56a9-48f4-941b-f6437921424d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:37.513368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4fac77f1-56a9-48f4-941b-f6437921424d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:37.520676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ad198ece-0835-49b0-8d5d-16ab4ce56043 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:37.521465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ad198ece-0835-49b0-8d5d-16ab4ce56043 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:37.521882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4fac77f1-56a9-48f4-941b-f6437921424d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:37.522495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4fac77f1-56a9-48f4-941b-f6437921424d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:37.523437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4fac77f1-56a9-48f4-941b-f6437921424d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:37.524070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4fac77f1-56a9-48f4-941b-f6437921424d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:37.529985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad198ece-0835-49b0-8d5d-16ab4ce56043 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:37.530584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad198ece-0835-49b0-8d5d-16ab4ce56043 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:37.532200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad198ece-0835-49b0-8d5d-16ab4ce56043 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:37.533145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad198ece-0835-49b0-8d5d-16ab4ce56043 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:37.540331 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-4fac77f1-56a9-48f4-941b-f6437921424d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4fac77f1-56a9-48f4-941b-f6437921424d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e/action HTTP/1.1 Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 28 Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: {"reboot": {"type": "SOFT"}} Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '02e40948-c72a-4e90-9db3-6302b9e8379e', 'body': {'reboot': {'type': 'SOFT'}}} Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:37.542305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:14:37.546503 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:37.548701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4fac77f1-56a9-48f4-941b-f6437921424d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:37.549755 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4fac77f1-56a9-48f4-941b-f6437921424d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e/action" status: 404 len: 111 microversion: 2.1 time: 0.043055 Jul 26 14:14:37.550830 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1074/2282] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:37 2022] POST /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:37.559087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e31cc836-9f3f-457f-be7e-d810d3935fa3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:37.559938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e31cc836-9f3f-457f-be7e-d810d3935fa3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:37.567052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31cc836-9f3f-457f-be7e-d810d3935fa3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:37.568361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31cc836-9f3f-457f-be7e-d810d3935fa3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:37.569346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31cc836-9f3f-457f-be7e-d810d3935fa3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:37.569944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31cc836-9f3f-457f-be7e-d810d3935fa3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:37.945468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ad198ece-0835-49b0-8d5d-16ab4ce56043 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:37.954993 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ad198ece-0835-49b0-8d5d-16ab4ce56043 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.440542 Jul 26 14:14:37.955934 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1209/2283] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:37 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:37.988651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e31cc836-9f3f-457f-be7e-d810d3935fa3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:37.996796 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e31cc836-9f3f-457f-be7e-d810d3935fa3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.441756 Jul 26 14:14:37.997405 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1075/2284] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:37 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:38.025021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3d42a353-ae4b-47c8-abfc-228f2ec715ab tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:38.025770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3d42a353-ae4b-47c8-abfc-228f2ec715ab tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:38.030955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-31039329-17a4-42e1-b148-6a770754e46d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:38.032534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-31039329-17a4-42e1-b148-6a770754e46d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:38.032813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d42a353-ae4b-47c8-abfc-228f2ec715ab tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:38.033233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d42a353-ae4b-47c8-abfc-228f2ec715ab tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:38.035542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d42a353-ae4b-47c8-abfc-228f2ec715ab tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:38.035542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d42a353-ae4b-47c8-abfc-228f2ec715ab tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:38.040292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31039329-17a4-42e1-b148-6a770754e46d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:38.040755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31039329-17a4-42e1-b148-6a770754e46d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:38.042421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31039329-17a4-42e1-b148-6a770754e46d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:38.042944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31039329-17a4-42e1-b148-6a770754e46d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:38.686297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31039329-17a4-42e1-b148-6a770754e46d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:38.692711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3d42a353-ae4b-47c8-abfc-228f2ec715ab tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:38.700216 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-31039329-17a4-42e1-b148-6a770754e46d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.672289 Jul 26 14:14:38.710906 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1076/2285] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:38 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:38.710906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de3d4d05-ed4d-4507-9cc7-6c59f3649258 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:38.710906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-de3d4d05-ed4d-4507-9cc7-6c59f3649258 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:38.729080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de3d4d05-ed4d-4507-9cc7-6c59f3649258 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:38.729788 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3d42a353-ae4b-47c8-abfc-228f2ec715ab tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.711350 Jul 26 14:14:38.731009 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1210/2286] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:38 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:38.731694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de3d4d05-ed4d-4507-9cc7-6c59f3649258 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:38.732584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de3d4d05-ed4d-4507-9cc7-6c59f3649258 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:38.733035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de3d4d05-ed4d-4507-9cc7-6c59f3649258 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:38.756226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c9befc2c-581b-439d-93fb-cc25ee0b3dae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:38.759454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c9befc2c-581b-439d-93fb-cc25ee0b3dae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 685c0329-dcfb-4b6e-bc10-eedd2cd32e3c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:38.770745 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c9befc2c-581b-439d-93fb-cc25ee0b3dae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 685c0329-dcfb-4b6e-bc10-eedd2cd32e3c could not be found. Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c9befc2c-581b-439d-93fb-cc25ee0b3dae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/685c0329-dcfb-4b6e-bc10-eedd2cd32e3c/action HTTP/1.1 Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 28 Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: {"reboot": {"type": "SOFT"}} Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 685c0329-dcfb-4b6e-bc10-eedd2cd32e3c could not be found. Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '685c0329-dcfb-4b6e-bc10-eedd2cd32e3c', 'body': {'reboot': {'type': 'SOFT'}}} Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685c0329-dcfb-4b6e-bc10-eedd2cd32e3c could not be found. Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685c0329-dcfb-4b6e-bc10-eedd2cd32e3c could not be found. Jul 26 14:14:38.776163 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:38.782614 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:38.782614 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:38.782614 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:38.782614 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:38.782614 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:38.782614 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:38.782614 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:38.782614 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685c0329-dcfb-4b6e-bc10-eedd2cd32e3c could not be found. Jul 26 14:14:38.782614 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:38.785497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c9befc2c-581b-439d-93fb-cc25ee0b3dae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 685c0329-dcfb-4b6e-bc10-eedd2cd32e3c could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:38.787258 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c9befc2c-581b-439d-93fb-cc25ee0b3dae tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/685c0329-dcfb-4b6e-bc10-eedd2cd32e3c/action" status: 404 len: 111 microversion: 2.1 time: 0.038884 Jul 26 14:14:38.788569 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1211/2287] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:38 2022] POST /compute/v2.1/servers/685c0329-dcfb-4b6e-bc10-eedd2cd32e3c/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:38.796517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6222cd69-bd0b-494f-863d-3c939601b396 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:38.798029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6222cd69-bd0b-494f-863d-3c939601b396 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:38.807805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6222cd69-bd0b-494f-863d-3c939601b396 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:38.808318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6222cd69-bd0b-494f-863d-3c939601b396 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:38.809118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6222cd69-bd0b-494f-863d-3c939601b396 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:38.809560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6222cd69-bd0b-494f-863d-3c939601b396 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:39.213259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6222cd69-bd0b-494f-863d-3c939601b396 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:39.224488 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6222cd69-bd0b-494f-863d-3c939601b396 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.431001 Jul 26 14:14:39.231366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-de3d4d05-ed4d-4507-9cc7-6c59f3649258 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:39.240562 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1212/2288] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:38 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:39.245670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d40481f6-0108-407f-b70d-15e174a439da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:39.246276 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-de3d4d05-ed4d-4507-9cc7-6c59f3649258 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.543735 Jul 26 14:14:39.246401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d40481f6-0108-407f-b70d-15e174a439da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:39.247461 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1077/2289] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:38 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:39.253824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-27904579-b76c-4a3f-a6b8-e0f91aad53c8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:39.254846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-27904579-b76c-4a3f-a6b8-e0f91aad53c8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:39.264789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27904579-b76c-4a3f-a6b8-e0f91aad53c8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:39.265734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27904579-b76c-4a3f-a6b8-e0f91aad53c8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:39.267071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d40481f6-0108-407f-b70d-15e174a439da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:39.267524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d40481f6-0108-407f-b70d-15e174a439da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:39.268021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27904579-b76c-4a3f-a6b8-e0f91aad53c8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:39.268335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d40481f6-0108-407f-b70d-15e174a439da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:39.268777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d40481f6-0108-407f-b70d-15e174a439da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:39.269480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27904579-b76c-4a3f-a6b8-e0f91aad53c8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:39.622628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d40481f6-0108-407f-b70d-15e174a439da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:39.625619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:39.634179 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d40481f6-0108-407f-b70d-15e174a439da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.392299 Jul 26 14:14:39.634772 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1213/2290] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:39 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:39.669849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-27904579-b76c-4a3f-a6b8-e0f91aad53c8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:39.691885 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-27904579-b76c-4a3f-a6b8-e0f91aad53c8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.442755 Jul 26 14:14:39.693484 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1078/2291] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:39 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:39.723840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-284fc1d3-47b7-4570-8372-ef7be2623d3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:39.727219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-284fc1d3-47b7-4570-8372-ef7be2623d3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:39.741267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-284fc1d3-47b7-4570-8372-ef7be2623d3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:39.742257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-284fc1d3-47b7-4570-8372-ef7be2623d3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:39.743869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-284fc1d3-47b7-4570-8372-ef7be2623d3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:39.745132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-284fc1d3-47b7-4570-8372-ef7be2623d3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:39.759322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-53c836ad-ba84-4b8e-9cb6-522ed115a5cd tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:39.760501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-53c836ad-ba84-4b8e-9cb6-522ed115a5cd tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:39.768765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53c836ad-ba84-4b8e-9cb6-522ed115a5cd tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:39.769575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53c836ad-ba84-4b8e-9cb6-522ed115a5cd tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:39.770079 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-284fc1d3-47b7-4570-8372-ef7be2623d3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:14:39.770847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53c836ad-ba84-4b8e-9cb6-522ed115a5cd tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:39.771492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53c836ad-ba84-4b8e-9cb6-522ed115a5cd tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-284fc1d3-47b7-4570-8372-ef7be2623d3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e/action HTTP/1.1 Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 65 Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '02e40948-c72a-4e90-9db3-6302b9e8379e', 'body': {'rebuild': {'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e'}}} Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 26 14:14:39.772029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-284fc1d3-47b7-4570-8372-ef7be2623d3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:39.775487 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-284fc1d3-47b7-4570-8372-ef7be2623d3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e/action" status: 404 len: 111 microversion: 2.1 time: 0.054688 Jul 26 14:14:39.778844 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1214/2292] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:39 2022] POST /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:39.785520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08e6e842-a246-4f59-94a2-bfb37354cf68 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:39.786150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08e6e842-a246-4f59-94a2-bfb37354cf68 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:39.796491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e6e842-a246-4f59-94a2-bfb37354cf68 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:39.797829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e6e842-a246-4f59-94a2-bfb37354cf68 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:39.799170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e6e842-a246-4f59-94a2-bfb37354cf68 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:39.799797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e6e842-a246-4f59-94a2-bfb37354cf68 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:40.183001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-53c836ad-ba84-4b8e-9cb6-522ed115a5cd tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:40.191383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-08e6e842-a246-4f59-94a2-bfb37354cf68 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:40.192369 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-53c836ad-ba84-4b8e-9cb6-522ed115a5cd tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.463535 Jul 26 14:14:40.205431 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1079/2293] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:39 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:40.208413 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08e6e842-a246-4f59-94a2-bfb37354cf68 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.428494 Jul 26 14:14:40.209553 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1215/2294] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:39 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:40.238511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d3d75c3b-5fb0-4083-ab7e-8d1c8c4ddf3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:40.239339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d3d75c3b-5fb0-4083-ab7e-8d1c8c4ddf3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:40.246773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3d75c3b-5fb0-4083-ab7e-8d1c8c4ddf3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:40.247490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3d75c3b-5fb0-4083-ab7e-8d1c8c4ddf3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:40.250991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3d75c3b-5fb0-4083-ab7e-8d1c8c4ddf3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:40.251769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3d75c3b-5fb0-4083-ab7e-8d1c8c4ddf3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:40.273322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fa0b03c8-aa42-4241-a6b1-5ec6744914de tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:40.274338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fa0b03c8-aa42-4241-a6b1-5ec6744914de tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:40.285876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa0b03c8-aa42-4241-a6b1-5ec6744914de tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:40.286976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa0b03c8-aa42-4241-a6b1-5ec6744914de tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:40.290825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa0b03c8-aa42-4241-a6b1-5ec6744914de tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:40.290825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa0b03c8-aa42-4241-a6b1-5ec6744914de tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:40.624337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fa0b03c8-aa42-4241-a6b1-5ec6744914de tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:40.635322 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fa0b03c8-aa42-4241-a6b1-5ec6744914de tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.367179 Jul 26 14:14:40.645060 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1216/2295] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:40 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:40.659915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5e0eeb28-00c9-4e1e-b1f0-ddd050293c20 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:40.660955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5e0eeb28-00c9-4e1e-b1f0-ddd050293c20 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:40.675180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e0eeb28-00c9-4e1e-b1f0-ddd050293c20 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:40.681603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e0eeb28-00c9-4e1e-b1f0-ddd050293c20 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:40.682561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e0eeb28-00c9-4e1e-b1f0-ddd050293c20 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:40.683127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e0eeb28-00c9-4e1e-b1f0-ddd050293c20 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:40.878670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d3d75c3b-5fb0-4083-ab7e-8d1c8c4ddf3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:40.903918 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d3d75c3b-5fb0-4083-ab7e-8d1c8c4ddf3d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.665102 Jul 26 14:14:40.904906 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1080/2296] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:40 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:40.938759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c00613cd-e13e-431e-8d71-16c3b269f36e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:40.942268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c00613cd-e13e-431e-8d71-16c3b269f36e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 829daa6f-29e3-49a7-8220-5d12c714346b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:40.948701 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c00613cd-e13e-431e-8d71-16c3b269f36e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 829daa6f-29e3-49a7-8220-5d12c714346b could not be found. Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c00613cd-e13e-431e-8d71-16c3b269f36e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/829daa6f-29e3-49a7-8220-5d12c714346b/action HTTP/1.1 Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 65 Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 829daa6f-29e3-49a7-8220-5d12c714346b could not be found. Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '829daa6f-29e3-49a7-8220-5d12c714346b', 'body': {'rebuild': {'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e'}}} Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829daa6f-29e3-49a7-8220-5d12c714346b could not be found. Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 26 14:14:40.951262 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829daa6f-29e3-49a7-8220-5d12c714346b could not be found. Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829daa6f-29e3-49a7-8220-5d12c714346b could not be found. Jul 26 14:14:40.955640 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:40.962424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c00613cd-e13e-431e-8d71-16c3b269f36e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 829daa6f-29e3-49a7-8220-5d12c714346b could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:40.964769 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c00613cd-e13e-431e-8d71-16c3b269f36e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/829daa6f-29e3-49a7-8220-5d12c714346b/action" status: 404 len: 111 microversion: 2.1 time: 0.036803 Jul 26 14:14:40.972302 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1081/2297] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:40 2022] POST /compute/v2.1/servers/829daa6f-29e3-49a7-8220-5d12c714346b/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:14:40.979098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05ca2fdd-5209-43b0-b6f4-8b88f0e7b477 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:40.979867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05ca2fdd-5209-43b0-b6f4-8b88f0e7b477 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:41.001859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05ca2fdd-5209-43b0-b6f4-8b88f0e7b477 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:41.004825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05ca2fdd-5209-43b0-b6f4-8b88f0e7b477 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:41.006590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05ca2fdd-5209-43b0-b6f4-8b88f0e7b477 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:41.008190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05ca2fdd-5209-43b0-b6f4-8b88f0e7b477 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:41.258797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5e0eeb28-00c9-4e1e-b1f0-ddd050293c20 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:41.287829 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5e0eeb28-00c9-4e1e-b1f0-ddd050293c20 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.632854 Jul 26 14:14:41.290251 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1217/2298] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:40 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:41.304784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2d21260f-252e-4ee2-a678-70c3bc11bb4b req-4492c9a0-0575-4df3-b8d5-fdae4e782f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e0fbcc-42e6-482f-a696-a2046d4cd25d", "name": "network-vif-plugged", "status": "completed", "tag": "9e2877ca-ba93-4c4b-aa8c-74fc979033fc"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:41.328021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2d21260f-252e-4ee2-a678-70c3bc11bb4b req-4492c9a0-0575-4df3-b8d5-fdae4e782f2a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:41.328436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2d21260f-252e-4ee2-a678-70c3bc11bb4b req-4492c9a0-0575-4df3-b8d5-fdae4e782f2a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:41.374027 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2d21260f-252e-4ee2-a678-70c3bc11bb4b req-4492c9a0-0575-4df3-b8d5-fdae4e782f2a service nova] Creating event network-vif-plugged:9e2877ca-ba93-4c4b-aa8c-74fc979033fc for instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d on n-h2-833090-9 Jul 26 14:14:41.396498 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2d21260f-252e-4ee2-a678-70c3bc11bb4b req-4492c9a0-0575-4df3-b8d5-fdae4e782f2a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098565 Jul 26 14:14:41.397159 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1218/2299] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:41.407403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-082cfcde-b21f-4cbe-8f5c-c21b0b039e05 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:41.408195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-082cfcde-b21f-4cbe-8f5c-c21b0b039e05 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:41.433534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-082cfcde-b21f-4cbe-8f5c-c21b0b039e05 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:41.440842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-082cfcde-b21f-4cbe-8f5c-c21b0b039e05 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:41.442265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-082cfcde-b21f-4cbe-8f5c-c21b0b039e05 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:41.442911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-082cfcde-b21f-4cbe-8f5c-c21b0b039e05 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:41.705386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05ca2fdd-5209-43b0-b6f4-8b88f0e7b477 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:41.726518 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05ca2fdd-5209-43b0-b6f4-8b88f0e7b477 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.752925 Jul 26 14:14:41.729685 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1082/2300] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:40 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:41.735857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f80f6507-923d-4fcc-b7b9-b01e2565bc67 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:41.748431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f80f6507-923d-4fcc-b7b9-b01e2565bc67 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:41.765024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f80f6507-923d-4fcc-b7b9-b01e2565bc67 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:41.766172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f80f6507-923d-4fcc-b7b9-b01e2565bc67 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:41.767433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f80f6507-923d-4fcc-b7b9-b01e2565bc67 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:41.769264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f80f6507-923d-4fcc-b7b9-b01e2565bc67 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:41.943005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-082cfcde-b21f-4cbe-8f5c-c21b0b039e05 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:41.952698 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-082cfcde-b21f-4cbe-8f5c-c21b0b039e05 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.554035 Jul 26 14:14:41.976160 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1219/2301] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:41 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:41.983602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a01f3fa-047f-40c3-b012-18ae4b3102db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:41.985082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a01f3fa-047f-40c3-b012-18ae4b3102db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:41.994767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a01f3fa-047f-40c3-b012-18ae4b3102db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:41.995376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a01f3fa-047f-40c3-b012-18ae4b3102db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:41.996318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a01f3fa-047f-40c3-b012-18ae4b3102db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:41.996859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a01f3fa-047f-40c3-b012-18ae4b3102db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:42.256127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f80f6507-923d-4fcc-b7b9-b01e2565bc67 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:42.271142 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f80f6507-923d-4fcc-b7b9-b01e2565bc67 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.539045 Jul 26 14:14:42.273433 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1083/2302] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:41 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:42.318156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2310291f-296b-44a3-ab25-c093a405e225 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:42.318784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2310291f-296b-44a3-ab25-c093a405e225 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:42.325630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2310291f-296b-44a3-ab25-c093a405e225 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:42.326080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2310291f-296b-44a3-ab25-c093a405e225 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:42.326871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2310291f-296b-44a3-ab25-c093a405e225 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:42.327367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2310291f-296b-44a3-ab25-c093a405e225 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:42.467029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a01f3fa-047f-40c3-b012-18ae4b3102db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:42.486544 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a01f3fa-047f-40c3-b012-18ae4b3102db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.508716 Jul 26 14:14:42.487574 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1220/2303] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:41 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:42.510862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a4a81a51-33b8-429c-a215-9702dd1a7188 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:42.512162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a4a81a51-33b8-429c-a215-9702dd1a7188 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: c483915c-8f52-408c-9388-26daf0f685fb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:42.523627 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a4a81a51-33b8-429c-a215-9702dd1a7188 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance c483915c-8f52-408c-9388-26daf0f685fb could not be found. Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a4a81a51-33b8-429c-a215-9702dd1a7188 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/c483915c-8f52-408c-9388-26daf0f685fb/action HTTP/1.1 Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 15 Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: {"restore": {}} Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c483915c-8f52-408c-9388-26daf0f685fb could not be found. Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c483915c-8f52-408c-9388-26daf0f685fb', 'body': {'restore': {}}} Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c483915c-8f52-408c-9388-26daf0f685fb could not be found. Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c483915c-8f52-408c-9388-26daf0f685fb could not be found. Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:42.525370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:42.529937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:42.529937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:42.529937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c483915c-8f52-408c-9388-26daf0f685fb could not be found. Jul 26 14:14:42.529937 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:42.529937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a4a81a51-33b8-429c-a215-9702dd1a7188 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance c483915c-8f52-408c-9388-26daf0f685fb could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:42.532762 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a4a81a51-33b8-429c-a215-9702dd1a7188 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/c483915c-8f52-408c-9388-26daf0f685fb/action" status: 404 len: 111 microversion: 2.1 time: 0.024836 Jul 26 14:14:42.536145 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1221/2304] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:42 2022] POST /compute/v2.1/servers/c483915c-8f52-408c-9388-26daf0f685fb/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:42.549589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-adf9b27e-558f-4f1c-8d0f-cb40d15782cd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:42.550355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-adf9b27e-558f-4f1c-8d0f-cb40d15782cd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:42.570532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf9b27e-558f-4f1c-8d0f-cb40d15782cd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:42.571004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf9b27e-558f-4f1c-8d0f-cb40d15782cd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:42.575031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf9b27e-558f-4f1c-8d0f-cb40d15782cd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:42.575510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf9b27e-558f-4f1c-8d0f-cb40d15782cd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:42.612379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2310291f-296b-44a3-ab25-c093a405e225 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:42.621976 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2310291f-296b-44a3-ab25-c093a405e225 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.307810 Jul 26 14:14:42.622974 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1084/2305] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:42 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:42.802261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-adf9b27e-558f-4f1c-8d0f-cb40d15782cd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:42.810391 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-adf9b27e-558f-4f1c-8d0f-cb40d15782cd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.270162 Jul 26 14:14:42.810986 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1222/2306] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:42 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:42.835140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1e9b172e-9f68-4b1b-ba20-1dbf4be9c6a4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:42.835706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1e9b172e-9f68-4b1b-ba20-1dbf4be9c6a4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:42.843073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e9b172e-9f68-4b1b-ba20-1dbf4be9c6a4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:42.844065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e9b172e-9f68-4b1b-ba20-1dbf4be9c6a4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:42.845457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e9b172e-9f68-4b1b-ba20-1dbf4be9c6a4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:42.845905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e9b172e-9f68-4b1b-ba20-1dbf4be9c6a4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:42.980408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a10dc8bd-dcde-4273-80c2-47a2d4b359c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:42.981291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a10dc8bd-dcde-4273-80c2-47a2d4b359c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:42.993547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a10dc8bd-dcde-4273-80c2-47a2d4b359c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:42.995414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a10dc8bd-dcde-4273-80c2-47a2d4b359c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:42.996278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a10dc8bd-dcde-4273-80c2-47a2d4b359c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:42.996893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a10dc8bd-dcde-4273-80c2-47a2d4b359c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.072355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1e9b172e-9f68-4b1b-ba20-1dbf4be9c6a4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:43.119614 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1e9b172e-9f68-4b1b-ba20-1dbf4be9c6a4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.287920 Jul 26 14:14:43.139603 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1085/2307] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:42 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:43.172336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d40b0bbf-61b8-43d6-b2bf-054d6e7ace87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:43.181173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d40b0bbf-61b8-43d6-b2bf-054d6e7ace87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:43.189700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d40b0bbf-61b8-43d6-b2bf-054d6e7ace87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.191308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d40b0bbf-61b8-43d6-b2bf-054d6e7ace87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.192406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d40b0bbf-61b8-43d6-b2bf-054d6e7ace87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.193039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d40b0bbf-61b8-43d6-b2bf-054d6e7ace87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.226286 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d40b0bbf-61b8-43d6-b2bf-054d6e7ace87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Cannot 'restore' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d40b0bbf-61b8-43d6-b2bf-054d6e7ace87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action HTTP/1.1 Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 15 Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: {"restore": {}} Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: exception: Cannot 'restore' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e6b94307-dd41-4f71-b529-c6cbb944c27f', 'body': {'restore': {}}} Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f in vm_state active. Cannot restore while the instance is in this state. Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:43.228682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:43.232776 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:43.232776 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:43.232776 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:43.232776 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:14:43.232776 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:43.232776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d40b0bbf-61b8-43d6-b2bf-054d6e7ace87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 409 to user: Cannot 'restore' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:43.232776 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d40b0bbf-61b8-43d6-b2bf-054d6e7ace87 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 409 len: 145 microversion: 2.1 time: 0.064980 Jul 26 14:14:43.232776 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1086/2308] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:43 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 145 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:14:43.241557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c3e11522-a518-4b95-b648-c59de049702a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:43.242503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c3e11522-a518-4b95-b648-c59de049702a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:43.257704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3e11522-a518-4b95-b648-c59de049702a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.259076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3e11522-a518-4b95-b648-c59de049702a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.259691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3e11522-a518-4b95-b648-c59de049702a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.260294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3e11522-a518-4b95-b648-c59de049702a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.295039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a10dc8bd-dcde-4273-80c2-47a2d4b359c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:43.303554 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a10dc8bd-dcde-4273-80c2-47a2d4b359c9 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.330698 Jul 26 14:14:43.304243 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1223/2309] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:42 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:43.320099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63121c96-4ea9-4d38-92ba-74a1aa50046e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:43.320726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63121c96-4ea9-4d38-92ba-74a1aa50046e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:43.334601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63121c96-4ea9-4d38-92ba-74a1aa50046e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.335121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63121c96-4ea9-4d38-92ba-74a1aa50046e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.336054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63121c96-4ea9-4d38-92ba-74a1aa50046e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.336504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63121c96-4ea9-4d38-92ba-74a1aa50046e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.621816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c3e11522-a518-4b95-b648-c59de049702a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:43.634259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63121c96-4ea9-4d38-92ba-74a1aa50046e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:43.644169 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c3e11522-a518-4b95-b648-c59de049702a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.406850 Jul 26 14:14:43.645323 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1087/2310] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:43 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:43.647618 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63121c96-4ea9-4d38-92ba-74a1aa50046e tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.338787 Jul 26 14:14:43.650760 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1224/2311] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:43 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:43.655432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-94043317-27b0-45ed-bae5-e9491966930f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:43.658304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-5bac3f14-3c7c-4783-bcd1-4d8e3067ef3f req-f8984672-e70d-4eee-8855-cdce03ae5362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e0fbcc-42e6-482f-a696-a2046d4cd25d", "name": "network-vif-plugged", "status": "completed", "tag": "7ffb9892-e08c-4f21-a2e8-0bdca41dc21b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:43.660988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-94043317-27b0-45ed-bae5-e9491966930f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:43.675345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5bac3f14-3c7c-4783-bcd1-4d8e3067ef3f req-f8984672-e70d-4eee-8855-cdce03ae5362 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.677162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94043317-27b0-45ed-bae5-e9491966930f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.677849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94043317-27b0-45ed-bae5-e9491966930f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.678819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94043317-27b0-45ed-bae5-e9491966930f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.680210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94043317-27b0-45ed-bae5-e9491966930f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.684851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5bac3f14-3c7c-4783-bcd1-4d8e3067ef3f req-f8984672-e70d-4eee-8855-cdce03ae5362 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.715380 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-5bac3f14-3c7c-4783-bcd1-4d8e3067ef3f req-f8984672-e70d-4eee-8855-cdce03ae5362 service nova] Creating event network-vif-plugged:7ffb9892-e08c-4f21-a2e8-0bdca41dc21b for instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d on n-h2-833090-9 Jul 26 14:14:43.730404 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-5bac3f14-3c7c-4783-bcd1-4d8e3067ef3f req-f8984672-e70d-4eee-8855-cdce03ae5362 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081027 Jul 26 14:14:43.731438 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1088/2312] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:43.744518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-99f79cfc-d9b4-4dfe-acf2-1f5151280b65 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:43.746207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-99f79cfc-d9b4-4dfe-acf2-1f5151280b65 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:43.756428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99f79cfc-d9b4-4dfe-acf2-1f5151280b65 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.757488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99f79cfc-d9b4-4dfe-acf2-1f5151280b65 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.759231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99f79cfc-d9b4-4dfe-acf2-1f5151280b65 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:43.760763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99f79cfc-d9b4-4dfe-acf2-1f5151280b65 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:43.798905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:44.511856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-94043317-27b0-45ed-bae5-e9491966930f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:44.529999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-99f79cfc-d9b4-4dfe-acf2-1f5151280b65 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:44.531889 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-94043317-27b0-45ed-bae5-e9491966930f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.877198 Jul 26 14:14:44.546229 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1225/2313] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:43 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:44.572941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ad919e02-7833-4564-b502-c854164a5ae1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:44.574165 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-99f79cfc-d9b4-4dfe-acf2-1f5151280b65 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.833702 Jul 26 14:14:44.574575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ad919e02-7833-4564-b502-c854164a5ae1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:44.577336 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1089/2314] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:43 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:44.609026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad919e02-7833-4564-b502-c854164a5ae1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:44.610018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad919e02-7833-4564-b502-c854164a5ae1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:44.611074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad919e02-7833-4564-b502-c854164a5ae1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:44.611690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad919e02-7833-4564-b502-c854164a5ae1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:44.612632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-57ecc230-78ff-4e10-a0cc-656cf5d0915d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:44.617278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-57ecc230-78ff-4e10-a0cc-656cf5d0915d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: b40b12ef-8f44-4c61-869f-b1a455670f95] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:44.647047 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-57ecc230-78ff-4e10-a0cc-656cf5d0915d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance b40b12ef-8f44-4c61-869f-b1a455670f95 could not be found. Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-57ecc230-78ff-4e10-a0cc-656cf5d0915d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/b40b12ef-8f44-4c61-869f-b1a455670f95/action HTTP/1.1 Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 14 Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: {"resume": {}} Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance b40b12ef-8f44-4c61-869f-b1a455670f95 could not be found. Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'b40b12ef-8f44-4c61-869f-b1a455670f95', 'body': {'resume': {}}} Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b40b12ef-8f44-4c61-869f-b1a455670f95 could not be found. Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b40b12ef-8f44-4c61-869f-b1a455670f95 could not be found. Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:44.659278 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:44.667524 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:44.667524 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:44.667524 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b40b12ef-8f44-4c61-869f-b1a455670f95 could not be found. Jul 26 14:14:44.667524 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:44.670136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-57ecc230-78ff-4e10-a0cc-656cf5d0915d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance b40b12ef-8f44-4c61-869f-b1a455670f95 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:44.672474 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-57ecc230-78ff-4e10-a0cc-656cf5d0915d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/b40b12ef-8f44-4c61-869f-b1a455670f95/action" status: 404 len: 111 microversion: 2.1 time: 0.067809 Jul 26 14:14:44.673744 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1090/2315] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:44 2022] POST /compute/v2.1/servers/b40b12ef-8f44-4c61-869f-b1a455670f95/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:14:44.696359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-db67ad86-c243-4512-bd83-1e98240a86aa tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:44.697952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-db67ad86-c243-4512-bd83-1e98240a86aa tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:44.729919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db67ad86-c243-4512-bd83-1e98240a86aa tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:44.731043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db67ad86-c243-4512-bd83-1e98240a86aa tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:44.732494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db67ad86-c243-4512-bd83-1e98240a86aa tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:44.733474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db67ad86-c243-4512-bd83-1e98240a86aa tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:44.806987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ad919e02-7833-4564-b502-c854164a5ae1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:44.820439 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ad919e02-7833-4564-b502-c854164a5ae1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.255425 Jul 26 14:14:44.821390 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1226/2316] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:44 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:44.845397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f8397254-fe08-4253-84f4-a75a57ab2e45 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:44.847191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f8397254-fe08-4253-84f4-a75a57ab2e45 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:44.854313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8397254-fe08-4253-84f4-a75a57ab2e45 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:44.855116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8397254-fe08-4253-84f4-a75a57ab2e45 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:44.856326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8397254-fe08-4253-84f4-a75a57ab2e45 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:44.856985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8397254-fe08-4253-84f4-a75a57ab2e45 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.097622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-db67ad86-c243-4512-bd83-1e98240a86aa tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:45.106778 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-db67ad86-c243-4512-bd83-1e98240a86aa tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1334 microversion: 2.1 time: 0.431360 Jul 26 14:14:45.110488 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1091/2317] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:44 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1334 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:45.177063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f8397254-fe08-4253-84f4-a75a57ab2e45 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:45.186450 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f8397254-fe08-4253-84f4-a75a57ab2e45 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.345254 Jul 26 14:14:45.188488 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1227/2318] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:44 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:45.214930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bd52596b-7318-4349-b588-4c340df9ecc6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:45.217817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bd52596b-7318-4349-b588-4c340df9ecc6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:45.244368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd52596b-7318-4349-b588-4c340df9ecc6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.244840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd52596b-7318-4349-b588-4c340df9ecc6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.245647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd52596b-7318-4349-b588-4c340df9ecc6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.246086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd52596b-7318-4349-b588-4c340df9ecc6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.496881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bd52596b-7318-4349-b588-4c340df9ecc6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:45.507092 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bd52596b-7318-4349-b588-4c340df9ecc6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.299115 Jul 26 14:14:45.508506 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1092/2319] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:45 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:45.536517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-881a565b-6179-403a-b8c8-f8aebd07b431 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:45.539566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-881a565b-6179-403a-b8c8-f8aebd07b431 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:45.549290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-881a565b-6179-403a-b8c8-f8aebd07b431 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.550104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-881a565b-6179-403a-b8c8-f8aebd07b431 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.551314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-881a565b-6179-403a-b8c8-f8aebd07b431 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.552019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-881a565b-6179-403a-b8c8-f8aebd07b431 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.573421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4c74b39-444a-4bf4-83d2-47a83c15616f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:45.574203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b4c74b39-444a-4bf4-83d2-47a83c15616f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:45.585616 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-881a565b-6179-403a-b8c8-f8aebd07b431 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Cannot 'resume' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-881a565b-6179-403a-b8c8-f8aebd07b431 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action HTTP/1.1 Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 14 Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: {"resume": {}} Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: exception: Cannot 'resume' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e6b94307-dd41-4f71-b529-c6cbb944c27f', 'body': {'resume': {}}} Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f in vm_state active. Cannot resume while the instance is in this state. Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:45.588158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:45.593080 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:45.593080 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:45.593080 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:45.593080 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:14:45.593080 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:45.593829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4c74b39-444a-4bf4-83d2-47a83c15616f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.593829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4c74b39-444a-4bf4-83d2-47a83c15616f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.594494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4c74b39-444a-4bf4-83d2-47a83c15616f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.595258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4c74b39-444a-4bf4-83d2-47a83c15616f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.595384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-881a565b-6179-403a-b8c8-f8aebd07b431 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 409 to user: Cannot 'resume' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:45.596194 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-881a565b-6179-403a-b8c8-f8aebd07b431 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 409 len: 144 microversion: 2.1 time: 0.065866 Jul 26 14:14:45.597386 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1228/2320] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:45 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 144 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:14:45.610032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1cda1aa2-7dc9-4974-b842-1925604fefc8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:45.611669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1cda1aa2-7dc9-4974-b842-1925604fefc8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:45.621329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1cda1aa2-7dc9-4974-b842-1925604fefc8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.621862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1cda1aa2-7dc9-4974-b842-1925604fefc8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.622788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1cda1aa2-7dc9-4974-b842-1925604fefc8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.623480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1cda1aa2-7dc9-4974-b842-1925604fefc8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.872763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4c74b39-444a-4bf4-83d2-47a83c15616f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:45.884533 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b4c74b39-444a-4bf4-83d2-47a83c15616f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.315395 Jul 26 14:14:45.886029 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1093/2321] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:45 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:45.900224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e2cd7556-2702-4057-9cd0-e718cbde2cf5 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:45.901315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e2cd7556-2702-4057-9cd0-e718cbde2cf5 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:45.912321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1cda1aa2-7dc9-4974-b842-1925604fefc8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:45.919323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2cd7556-2702-4057-9cd0-e718cbde2cf5 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.924205 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1cda1aa2-7dc9-4974-b842-1925604fefc8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.322414 Jul 26 14:14:45.925619 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1229/2322] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:45 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:45.928494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2cd7556-2702-4057-9cd0-e718cbde2cf5 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.930793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2cd7556-2702-4057-9cd0-e718cbde2cf5 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.932297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2cd7556-2702-4057-9cd0-e718cbde2cf5 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.949992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0aa377a-4a1f-4852-b26c-bbb72d64a308 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:45.950977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0aa377a-4a1f-4852-b26c-bbb72d64a308 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:45.954967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:45.959260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0aa377a-4a1f-4852-b26c-bbb72d64a308 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.959783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0aa377a-4a1f-4852-b26c-bbb72d64a308 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:45.960749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0aa377a-4a1f-4852-b26c-bbb72d64a308 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:45.961562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0aa377a-4a1f-4852-b26c-bbb72d64a308 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.254506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e2cd7556-2702-4057-9cd0-e718cbde2cf5 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:46.259511 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e2cd7556-2702-4057-9cd0-e718cbde2cf5 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.371924 Jul 26 14:14:46.260497 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1094/2323] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:45 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:46.282237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-793b652f-93e4-4323-bbb0-d36573f6c47a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:46.282875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-793b652f-93e4-4323-bbb0-d36573f6c47a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:46.293508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:46.299348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0aa377a-4a1f-4852-b26c-bbb72d64a308 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:46.301344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-793b652f-93e4-4323-bbb0-d36573f6c47a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.301819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-793b652f-93e4-4323-bbb0-d36573f6c47a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.303474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-793b652f-93e4-4323-bbb0-d36573f6c47a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.303474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-793b652f-93e4-4323-bbb0-d36573f6c47a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.320792 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0aa377a-4a1f-4852-b26c-bbb72d64a308 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.374858 Jul 26 14:14:46.321665 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1230/2324] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:45 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:46.536566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-793b652f-93e4-4323-bbb0-d36573f6c47a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:46.539206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43fe987c-2b8a-4264-adff-a099cb6b73d7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43fe987c-2b8a-4264-adff-a099cb6b73d7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 160 Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "dab98a43-b5e8-42ee-ab97-d87aedbae0eb"}]}} Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': '', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'networks': [{'uuid': 'dab98a43-b5e8-42ee-ab97-d87aedbae0eb'}]}}} Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi '' Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:14:46.543454 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43fe987c-2b8a-4264-adff-a099cb6b73d7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43fe987c-2b8a-4264-adff-a099cb6b73d7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.009892 Jul 26 14:14:46.547246 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1231/2325] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:14:46 2022] POST /compute/v2.1/servers => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:14:46.555805 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-793b652f-93e4-4323-bbb0-d36573f6c47a tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1669 microversion: 2.1 time: 0.278606 Jul 26 14:14:46.557381 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1095/2326] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:46 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:46.576648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9cb0d781-fbf2-4ac1-8d3b-0cda5c6cc16e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:46.578918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9cb0d781-fbf2-4ac1-8d3b-0cda5c6cc16e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:46.580468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71b02b92-6fa5-4162-a5f0-2204a1820477 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:46.581669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-71b02b92-6fa5-4162-a5f0-2204a1820477 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:46.594924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71b02b92-6fa5-4162-a5f0-2204a1820477 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.595628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71b02b92-6fa5-4162-a5f0-2204a1820477 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.596659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71b02b92-6fa5-4162-a5f0-2204a1820477 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.597262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71b02b92-6fa5-4162-a5f0-2204a1820477 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.606985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cb0d781-fbf2-4ac1-8d3b-0cda5c6cc16e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.607545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cb0d781-fbf2-4ac1-8d3b-0cda5c6cc16e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.608422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cb0d781-fbf2-4ac1-8d3b-0cda5c6cc16e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.608926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cb0d781-fbf2-4ac1-8d3b-0cda5c6cc16e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.633996 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-71b02b92-6fa5-4162-a5f0-2204a1820477 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d/ips" status: 200 len: 179 microversion: 2.1 time: 0.058160 Jul 26 14:14:46.644417 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1096/2327] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:14:46 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d/ips => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:14:46.650766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-881b6ca2-eedb-466d-afaf-045d0ac1a2e8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:46.651683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-881b6ca2-eedb-466d-afaf-045d0ac1a2e8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:46.661477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-881b6ca2-eedb-466d-afaf-045d0ac1a2e8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.662128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-881b6ca2-eedb-466d-afaf-045d0ac1a2e8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.663111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-881b6ca2-eedb-466d-afaf-045d0ac1a2e8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.663769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-881b6ca2-eedb-466d-afaf-045d0ac1a2e8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.711117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-881b6ca2-eedb-466d-afaf-045d0ac1a2e8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:14:46.911079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9cb0d781-fbf2-4ac1-8d3b-0cda5c6cc16e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:46.925372 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-881b6ca2-eedb-466d-afaf-045d0ac1a2e8 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "DELETE /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 204 len: 0 microversion: 2.1 time: 0.278547 Jul 26 14:14:46.927434 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9cb0d781-fbf2-4ac1-8d3b-0cda5c6cc16e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.355957 Jul 26 14:14:46.939991 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1232/2329] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:46 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:46.940263 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1097/2329] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:14:46 2022] DELETE /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:14:46.940409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a0dacf4-a467-4632-82b3-9bac9fd92fd5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:46.950659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1a0dacf4-a467-4632-82b3-9bac9fd92fd5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:46.957129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b6506917-bef6-4181-b67a-c292b40bcc68 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:46.957129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b6506917-bef6-4181-b67a-c292b40bcc68 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:46.962726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a0dacf4-a467-4632-82b3-9bac9fd92fd5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.963682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a0dacf4-a467-4632-82b3-9bac9fd92fd5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.964891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a0dacf4-a467-4632-82b3-9bac9fd92fd5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.968293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a0dacf4-a467-4632-82b3-9bac9fd92fd5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.973186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6506917-bef6-4181-b67a-c292b40bcc68 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.975584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6506917-bef6-4181-b67a-c292b40bcc68 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:46.975584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6506917-bef6-4181-b67a-c292b40bcc68 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:46.976681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6506917-bef6-4181-b67a-c292b40bcc68 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:47.465146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b6506917-bef6-4181-b67a-c292b40bcc68 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:47.480417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1a0dacf4-a467-4632-82b3-9bac9fd92fd5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:47.491579 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b6506917-bef6-4181-b67a-c292b40bcc68 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1675 microversion: 2.1 time: 0.553595 Jul 26 14:14:47.492583 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1098/2330] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:46 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1675 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:47.494378 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1a0dacf4-a467-4632-82b3-9bac9fd92fd5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.562700 Jul 26 14:14:47.510673 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1233/2331] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:46 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:47.520558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6fcb3981-3458-4790-bf51-c3980157d53a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:47.522356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bd11b04c-3094-4d91-98a0-95a08081850d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:47.523071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bd11b04c-3094-4d91-98a0-95a08081850d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:47.525917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6fcb3981-3458-4790-bf51-c3980157d53a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:47.541216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6fcb3981-3458-4790-bf51-c3980157d53a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:47.541617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6fcb3981-3458-4790-bf51-c3980157d53a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:47.542547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6fcb3981-3458-4790-bf51-c3980157d53a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:47.543009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6fcb3981-3458-4790-bf51-c3980157d53a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:47.544549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd11b04c-3094-4d91-98a0-95a08081850d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:47.547475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd11b04c-3094-4d91-98a0-95a08081850d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:47.549716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd11b04c-3094-4d91-98a0-95a08081850d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:47.550846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd11b04c-3094-4d91-98a0-95a08081850d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:47.562751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:47.979249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6fcb3981-3458-4790-bf51-c3980157d53a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:47.997777 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6fcb3981-3458-4790-bf51-c3980157d53a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.488749 Jul 26 14:14:48.007985 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1099/2332] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:47 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:48.025123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d97548d6-19fa-409e-b949-76095f08d5d9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:48.025775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d97548d6-19fa-409e-b949-76095f08d5d9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 888a9c98-16b3-4ab7-8e15-0b7db0a92ef6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:48.038615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bd11b04c-3094-4d91-98a0-95a08081850d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:48.052661 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bd11b04c-3094-4d91-98a0-95a08081850d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1486 microversion: 2.1 time: 0.539515 Jul 26 14:14:48.053992 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d97548d6-19fa-409e-b949-76095f08d5d9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 888a9c98-16b3-4ab7-8e15-0b7db0a92ef6 could not be found. Jul 26 14:14:48.056939 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1234/2333] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:47 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1486 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d97548d6-19fa-409e-b949-76095f08d5d9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/888a9c98-16b3-4ab7-8e15-0b7db0a92ef6/action HTTP/1.1 Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 14 Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: {"shelve": {}} Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 888a9c98-16b3-4ab7-8e15-0b7db0a92ef6 could not be found. Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '888a9c98-16b3-4ab7-8e15-0b7db0a92ef6', 'body': {'shelve': {}}} Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888a9c98-16b3-4ab7-8e15-0b7db0a92ef6 could not be found. Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888a9c98-16b3-4ab7-8e15-0b7db0a92ef6 could not be found. Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:48.073514 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:48.079324 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:48.079324 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:48.079324 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888a9c98-16b3-4ab7-8e15-0b7db0a92ef6 could not be found. Jul 26 14:14:48.079324 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:14:48.083874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d97548d6-19fa-409e-b949-76095f08d5d9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 888a9c98-16b3-4ab7-8e15-0b7db0a92ef6 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:48.089210 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d97548d6-19fa-409e-b949-76095f08d5d9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/888a9c98-16b3-4ab7-8e15-0b7db0a92ef6/action" status: 404 len: 111 microversion: 2.1 time: 0.069767 Jul 26 14:14:48.091076 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1100/2334] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:48 2022] POST /compute/v2.1/servers/888a9c98-16b3-4ab7-8e15-0b7db0a92ef6/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:48.100189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e53e6a71-e57c-4bb6-b8ba-abca85760e32 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:48.101110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e53e6a71-e57c-4bb6-b8ba-abca85760e32 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:48.105328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6998e8b2-b61f-4aaf-9064-fef8c1732e11 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:48.106067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6998e8b2-b61f-4aaf-9064-fef8c1732e11 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:48.117660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e53e6a71-e57c-4bb6-b8ba-abca85760e32 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:48.118748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e53e6a71-e57c-4bb6-b8ba-abca85760e32 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:48.120119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e53e6a71-e57c-4bb6-b8ba-abca85760e32 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:48.122751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6998e8b2-b61f-4aaf-9064-fef8c1732e11 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:48.123246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6998e8b2-b61f-4aaf-9064-fef8c1732e11 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:48.124702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6998e8b2-b61f-4aaf-9064-fef8c1732e11 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:48.125161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6998e8b2-b61f-4aaf-9064-fef8c1732e11 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:48.132752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e53e6a71-e57c-4bb6-b8ba-abca85760e32 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:48.256924 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e53e6a71-e57c-4bb6-b8ba-abca85760e32 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "POST /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd/action" status: 202 len: 0 microversion: 2.1 time: 0.171085 Jul 26 14:14:48.258252 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1235/2335] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:48 2022] POST /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:14:48.289470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56391e77-79d4-4047-b188-e3c6fbcf196d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:48.290464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56391e77-79d4-4047-b188-e3c6fbcf196d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:48.300776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56391e77-79d4-4047-b188-e3c6fbcf196d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:48.301529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56391e77-79d4-4047-b188-e3c6fbcf196d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:48.302594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56391e77-79d4-4047-b188-e3c6fbcf196d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:48.303251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56391e77-79d4-4047-b188-e3c6fbcf196d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:48.633537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6998e8b2-b61f-4aaf-9064-fef8c1732e11 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:48.642377 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6998e8b2-b61f-4aaf-9064-fef8c1732e11 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.546494 Jul 26 14:14:48.664169 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1101/2336] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:48 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:48.669661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bda6c755-2ef5-4eb6-8c38-2dd25bafcc31 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:48.672807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bda6c755-2ef5-4eb6-8c38-2dd25bafcc31 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:48.681647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bda6c755-2ef5-4eb6-8c38-2dd25bafcc31 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:48.682409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bda6c755-2ef5-4eb6-8c38-2dd25bafcc31 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:48.683412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bda6c755-2ef5-4eb6-8c38-2dd25bafcc31 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:48.684064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bda6c755-2ef5-4eb6-8c38-2dd25bafcc31 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:48.966822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56391e77-79d4-4047-b188-e3c6fbcf196d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:48.987195 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56391e77-79d4-4047-b188-e3c6fbcf196d tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1494 microversion: 2.1 time: 0.717145 Jul 26 14:14:48.989941 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1236/2337] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:48 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1494 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:49.010831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-30a2b7d5-07ab-4b16-b602-066be7563f91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:49.016679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-30a2b7d5-07ab-4b16-b602-066be7563f91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:49.025206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30a2b7d5-07ab-4b16-b602-066be7563f91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:49.026039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30a2b7d5-07ab-4b16-b602-066be7563f91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:49.027161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30a2b7d5-07ab-4b16-b602-066be7563f91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:49.027890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30a2b7d5-07ab-4b16-b602-066be7563f91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:49.498114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bda6c755-2ef5-4eb6-8c38-2dd25bafcc31 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:49.516059 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bda6c755-2ef5-4eb6-8c38-2dd25bafcc31 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.849734 Jul 26 14:14:49.517196 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1102/2338] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:48 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:49.536661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-29697e8b-e1b7-489a-bf01-26910b059f0c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:49.537644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-29697e8b-e1b7-489a-bf01-26910b059f0c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:49.548157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29697e8b-e1b7-489a-bf01-26910b059f0c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:49.552794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29697e8b-e1b7-489a-bf01-26910b059f0c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:49.554112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29697e8b-e1b7-489a-bf01-26910b059f0c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:49.555636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29697e8b-e1b7-489a-bf01-26910b059f0c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:50.035851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-30a2b7d5-07ab-4b16-b602-066be7563f91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:50.045179 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-30a2b7d5-07ab-4b16-b602-066be7563f91 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1675 microversion: 2.1 time: 1.053752 Jul 26 14:14:50.047986 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1237/2339] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:48 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1675 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:50.062327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f3ab4799-daf1-4bef-be3d-105d48467e4c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:50.063241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f3ab4799-daf1-4bef-be3d-105d48467e4c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:50.075293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f3ab4799-daf1-4bef-be3d-105d48467e4c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:50.080695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f3ab4799-daf1-4bef-be3d-105d48467e4c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:50.086713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f3ab4799-daf1-4bef-be3d-105d48467e4c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:50.087482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f3ab4799-daf1-4bef-be3d-105d48467e4c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:51.000366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-29697e8b-e1b7-489a-bf01-26910b059f0c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:51.029393 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-29697e8b-e1b7-489a-bf01-26910b059f0c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 1.509545 Jul 26 14:14:51.031718 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1103/2340] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:49 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:51.051705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f3ab4799-daf1-4bef-be3d-105d48467e4c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:51.056887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e3626bc3-1ad8-452e-9b08-810b382262f2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:51.058439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e3626bc3-1ad8-452e-9b08-810b382262f2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:51.067101 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f3ab4799-daf1-4bef-be3d-105d48467e4c tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1494 microversion: 2.1 time: 1.016700 Jul 26 14:14:51.071919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3626bc3-1ad8-452e-9b08-810b382262f2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:51.072783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3626bc3-1ad8-452e-9b08-810b382262f2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:51.073381 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1238/2341] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:50 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1494 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:51.074836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3626bc3-1ad8-452e-9b08-810b382262f2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:51.076937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3626bc3-1ad8-452e-9b08-810b382262f2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:51.081363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e004b2c7-75fa-46e9-a3ca-e7c2ac5c229a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:51.085709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e004b2c7-75fa-46e9-a3ca-e7c2ac5c229a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:51.109297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e004b2c7-75fa-46e9-a3ca-e7c2ac5c229a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:51.110139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e004b2c7-75fa-46e9-a3ca-e7c2ac5c229a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:51.111320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e004b2c7-75fa-46e9-a3ca-e7c2ac5c229a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:51.112172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e004b2c7-75fa-46e9-a3ca-e7c2ac5c229a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:51.166342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-e004b2c7-75fa-46e9-a3ca-e7c2ac5c229a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lazy-loading 'flavor' on Instance uuid e6b94307-dd41-4f71-b529-c6cbb944c27f {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:14:51.439204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e3626bc3-1ad8-452e-9b08-810b382262f2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:51.449520 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e3626bc3-1ad8-452e-9b08-810b382262f2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.416415 Jul 26 14:14:51.467584 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1104/2342] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:51 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:51.477208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a1becdf5-6c9e-4ce6-8918-e3ae3526e03b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:51.481394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a1becdf5-6c9e-4ce6-8918-e3ae3526e03b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:51.499359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1becdf5-6c9e-4ce6-8918-e3ae3526e03b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:51.499932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1becdf5-6c9e-4ce6-8918-e3ae3526e03b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:51.501026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1becdf5-6c9e-4ce6-8918-e3ae3526e03b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:51.504098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1becdf5-6c9e-4ce6-8918-e3ae3526e03b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:51.619031 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e004b2c7-75fa-46e9-a3ca-e7c2ac5c229a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 202 len: 0 microversion: 2.1 time: 0.543841 Jul 26 14:14:51.625403 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1239/2343] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:51 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:14:51.652365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f171388-d894-4696-94e8-b57bb7544776 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:51.654563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4f171388-d894-4696-94e8-b57bb7544776 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:51.697266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f171388-d894-4696-94e8-b57bb7544776 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:51.714939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f171388-d894-4696-94e8-b57bb7544776 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:51.717493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f171388-d894-4696-94e8-b57bb7544776 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:51.718109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f171388-d894-4696-94e8-b57bb7544776 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:52.256292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a1becdf5-6c9e-4ce6-8918-e3ae3526e03b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:52.273087 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a1becdf5-6c9e-4ce6-8918-e3ae3526e03b tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1654 microversion: 2.1 time: 0.803828 Jul 26 14:14:52.274475 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1105/2344] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:51 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1654 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:52.283482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ced06db2-041f-4fcc-a672-56b772b42c9e req-ffeac684-f8ed-4fa5-98a4-732e0241d670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e0fbcc-42e6-482f-a696-a2046d4cd25d", "name": "network-vif-deleted", "tag": "7ffb9892-e08c-4f21-a2e8-0bdca41dc21b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:52.331437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ced06db2-041f-4fcc-a672-56b772b42c9e req-ffeac684-f8ed-4fa5-98a4-732e0241d670 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:52.332235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ced06db2-041f-4fcc-a672-56b772b42c9e req-ffeac684-f8ed-4fa5-98a4-732e0241d670 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:52.332629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4f171388-d894-4696-94e8-b57bb7544776 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:52.355925 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4f171388-d894-4696-94e8-b57bb7544776 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1511 microversion: 2.1 time: 0.727814 Jul 26 14:14:52.388407 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1240/2345] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:51 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1511 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:52.395870 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ced06db2-041f-4fcc-a672-56b772b42c9e req-ffeac684-f8ed-4fa5-98a4-732e0241d670 service nova] Creating event network-vif-deleted:7ffb9892-e08c-4f21-a2e8-0bdca41dc21b for instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d on n-h2-833090-9 Jul 26 14:14:52.396890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0fb02b1-bad3-44df-94a6-c6ca00719160 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:52.398095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a0fb02b1-bad3-44df-94a6-c6ca00719160 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:52.415827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0fb02b1-bad3-44df-94a6-c6ca00719160 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:52.420517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0fb02b1-bad3-44df-94a6-c6ca00719160 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:52.422625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0fb02b1-bad3-44df-94a6-c6ca00719160 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:52.423801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0fb02b1-bad3-44df-94a6-c6ca00719160 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:52.431455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ced06db2-041f-4fcc-a672-56b772b42c9e req-ffeac684-f8ed-4fa5-98a4-732e0241d670 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155039 Jul 26 14:14:52.442807 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1106/2346] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:52.449417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e0dcaf72-3aa6-4d51-9722-7a379ac79cac req-d645a256-9b82-4c61-846a-ee6515a105ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e0fbcc-42e6-482f-a696-a2046d4cd25d", "name": "network-vif-unplugged", "status": "completed", "tag": "9e2877ca-ba93-4c4b-aa8c-74fc979033fc"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:52.494522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e0dcaf72-3aa6-4d51-9722-7a379ac79cac req-d645a256-9b82-4c61-846a-ee6515a105ab service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:52.495427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e0dcaf72-3aa6-4d51-9722-7a379ac79cac req-d645a256-9b82-4c61-846a-ee6515a105ab service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:52.510339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:52.559957 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e0dcaf72-3aa6-4d51-9722-7a379ac79cac req-d645a256-9b82-4c61-846a-ee6515a105ab service nova] Creating event network-vif-unplugged:9e2877ca-ba93-4c4b-aa8c-74fc979033fc for instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d on n-h2-833090-9 Jul 26 14:14:52.585358 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e0dcaf72-3aa6-4d51-9722-7a379ac79cac req-d645a256-9b82-4c61-846a-ee6515a105ab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140277 Jul 26 14:14:52.589478 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1107/2347] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:52.613356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8e8e1591-9dd0-43e9-8fe8-ee0f524a3432 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:52.614627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8e8e1591-9dd0-43e9-8fe8-ee0f524a3432 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:52.654966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e8e1591-9dd0-43e9-8fe8-ee0f524a3432 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:52.657443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e8e1591-9dd0-43e9-8fe8-ee0f524a3432 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:52.659259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e8e1591-9dd0-43e9-8fe8-ee0f524a3432 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:52.662887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e8e1591-9dd0-43e9-8fe8-ee0f524a3432 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:53.031797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0fb02b1-bad3-44df-94a6-c6ca00719160 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:53.046804 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a0fb02b1-bad3-44df-94a6-c6ca00719160 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1494 microversion: 2.1 time: 0.655789 Jul 26 14:14:53.063201 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1241/2348] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:52 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1494 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:53.205710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8e8e1591-9dd0-43e9-8fe8-ee0f524a3432 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:53.218696 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8e8e1591-9dd0-43e9-8fe8-ee0f524a3432 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.624490 Jul 26 14:14:53.235786 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1108/2349] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:52 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:53.305626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2e89aa43-6151-4a9e-a8f2-8c2a2aaf4636 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:53.306253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2e89aa43-6151-4a9e-a8f2-8c2a2aaf4636 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:53.319236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e89aa43-6151-4a9e-a8f2-8c2a2aaf4636 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:53.319719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e89aa43-6151-4a9e-a8f2-8c2a2aaf4636 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:53.320544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e89aa43-6151-4a9e-a8f2-8c2a2aaf4636 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:53.333087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e89aa43-6151-4a9e-a8f2-8c2a2aaf4636 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:53.404126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-394eb79a-c523-43f1-88c2-ff21d071d18d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:53.405639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-394eb79a-c523-43f1-88c2-ff21d071d18d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:53.430321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-394eb79a-c523-43f1-88c2-ff21d071d18d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:53.432526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-394eb79a-c523-43f1-88c2-ff21d071d18d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:53.433699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-394eb79a-c523-43f1-88c2-ff21d071d18d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:53.438163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-394eb79a-c523-43f1-88c2-ff21d071d18d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:53.576031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2e89aa43-6151-4a9e-a8f2-8c2a2aaf4636 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf1430124f9f4c099944aad81234f6de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0daac0aaada2453f84fdb257106f12ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:53.589361 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2e89aa43-6151-4a9e-a8f2-8c2a2aaf4636 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 200 len: 1453 microversion: 2.1 time: 0.288215 Jul 26 14:14:53.590754 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1242/2350] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:53 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 1453 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:53.947916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-394eb79a-c523-43f1-88c2-ff21d071d18d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:54.003170 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-394eb79a-c523-43f1-88c2-ff21d071d18d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1511 microversion: 2.1 time: 0.603364 Jul 26 14:14:54.010151 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1109/2351] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:53 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1511 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:54.071222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b1dc040-7bef-499d-a9ac-3571941f2745 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:54.072035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7b1dc040-7bef-499d-a9ac-3571941f2745 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:54.099059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b1dc040-7bef-499d-a9ac-3571941f2745 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:54.100770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b1dc040-7bef-499d-a9ac-3571941f2745 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:54.102190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b1dc040-7bef-499d-a9ac-3571941f2745 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:54.102887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b1dc040-7bef-499d-a9ac-3571941f2745 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:54.245846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1fbb0981-15b2-4fd5-a796-e7fe69e70ea7 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:54.248152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1fbb0981-15b2-4fd5-a796-e7fe69e70ea7 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:54.259286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1fbb0981-15b2-4fd5-a796-e7fe69e70ea7 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:54.273382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1fbb0981-15b2-4fd5-a796-e7fe69e70ea7 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:54.274974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1fbb0981-15b2-4fd5-a796-e7fe69e70ea7 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:54.277553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1fbb0981-15b2-4fd5-a796-e7fe69e70ea7 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:54.683980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b1dc040-7bef-499d-a9ac-3571941f2745 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:54.692481 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b1dc040-7bef-499d-a9ac-3571941f2745 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1500 microversion: 2.1 time: 0.626283 Jul 26 14:14:54.693492 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1243/2352] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:54 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1500 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:54.698834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7bc93758-56d2-4617-8c8c-209f2031e66c req-60d4da0a-7088-4ee7-bb60-857f6b9f78e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e0fbcc-42e6-482f-a696-a2046d4cd25d", "name": "network-vif-deleted", "tag": "9e2877ca-ba93-4c4b-aa8c-74fc979033fc"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:54.716941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7bc93758-56d2-4617-8c8c-209f2031e66c req-60d4da0a-7088-4ee7-bb60-857f6b9f78e1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:54.717397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7bc93758-56d2-4617-8c8c-209f2031e66c req-60d4da0a-7088-4ee7-bb60-857f6b9f78e1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:54.732892 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7bc93758-56d2-4617-8c8c-209f2031e66c req-60d4da0a-7088-4ee7-bb60-857f6b9f78e1 service nova] Creating event network-vif-deleted:9e2877ca-ba93-4c4b-aa8c-74fc979033fc for instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d on n-h2-833090-9 Jul 26 14:14:54.743554 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7bc93758-56d2-4617-8c8c-209f2031e66c req-60d4da0a-7088-4ee7-bb60-857f6b9f78e1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043643 Jul 26 14:14:54.743554 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1244/2353] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:14:54.745435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da55e087-0582-44b6-95df-c5ab26324d21 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:54.746666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-da55e087-0582-44b6-95df-c5ab26324d21 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:54.753585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da55e087-0582-44b6-95df-c5ab26324d21 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:54.754287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da55e087-0582-44b6-95df-c5ab26324d21 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:54.755264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da55e087-0582-44b6-95df-c5ab26324d21 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:54.757029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da55e087-0582-44b6-95df-c5ab26324d21 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:54.776948 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-da55e087-0582-44b6-95df-c5ab26324d21 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] HTTP exception thrown: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da55e087-0582-44b6-95df-c5ab26324d21 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Request method failure captured: Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d HTTP/1.1 Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZWN5DLm4GNqRphjcNaehrdwmm53wyL37lM4DzqyFwM3ll5OQrFVLHHlsCfHiob_s5LZ2unHPn-toKxHKI69t4NQ_2GnjEu5Nwx01soaK6yLzUojrSJ8-_74mArH7vc22ufDRADAp7KWj-UOId_mELW-KxmGOxI4WJLbO2hoLaND5c Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0daac0aaada2453f84fdb257106f12ae", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}] Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestMultiNic-1967819980 Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: cf1430124f9f4c099944aad81234f6de Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '20e0fbcc-42e6-482f-a696-a2046d4cd25d'} Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:14:54.779136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:54.783725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:14:54.783725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:14:54.783725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:14:54.783725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:14:54.783725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:14:54.783725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:14:54.783725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:14:54.784957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da55e087-0582-44b6-95df-c5ab26324d21 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Returning 404 to user: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:14:54.786002 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-da55e087-0582-44b6-95df-c5ab26324d21 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 404 len: 111 microversion: 2.1 time: 0.045113 Jul 26 14:14:54.787289 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1245/2354] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:54 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:14:54.826339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1fbb0981-15b2-4fd5-a796-e7fe69e70ea7 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:54.840185 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1fbb0981-15b2-4fd5-a796-e7fe69e70ea7 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1497 microversion: 2.1 time: 0.600014 Jul 26 14:14:54.848398 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1110/2355] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:54 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1497 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:54.858279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b15a7792-4eaa-4c5e-95da-17595d3b5471 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:54.858980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b15a7792-4eaa-4c5e-95da-17595d3b5471 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:54.869664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b15a7792-4eaa-4c5e-95da-17595d3b5471 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:54.870411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b15a7792-4eaa-4c5e-95da-17595d3b5471 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:54.871542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b15a7792-4eaa-4c5e-95da-17595d3b5471 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:54.872263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b15a7792-4eaa-4c5e-95da-17595d3b5471 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:54.917205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b15a7792-4eaa-4c5e-95da-17595d3b5471 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:14:55.101165 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b15a7792-4eaa-4c5e-95da-17595d3b5471 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "DELETE /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 204 len: 0 microversion: 2.1 time: 0.249043 Jul 26 14:14:55.109240 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1111/2356] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:14:54 2022] DELETE /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:14:55.123832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d0b39616-95ec-4d3f-8637-5a278dbab15c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:55.126003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d0b39616-95ec-4d3f-8637-5a278dbab15c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:55.142304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0b39616-95ec-4d3f-8637-5a278dbab15c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:55.143424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0b39616-95ec-4d3f-8637-5a278dbab15c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:55.145068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0b39616-95ec-4d3f-8637-5a278dbab15c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:55.146075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0b39616-95ec-4d3f-8637-5a278dbab15c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:55.386304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1039318866", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "dedb03c0-5b34-4979-a77b-fd4f4d962cea"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:55.487162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] validate_networks() for [('dedb03c0-5b34-4979-a77b-fd4f4d962cea', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:14:55.737576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d0b39616-95ec-4d3f-8637-5a278dbab15c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:55.745670 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d0b39616-95ec-4d3f-8637-5a278dbab15c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1511 microversion: 2.1 time: 0.634328 Jul 26 14:14:55.760473 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1112/2357] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:55 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1511 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:55.771056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c70dda59-31c1-4196-8b0c-620de9af1dea tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:55.771922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c70dda59-31c1-4196-8b0c-620de9af1dea tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:55.779457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c70dda59-31c1-4196-8b0c-620de9af1dea tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:55.780956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c70dda59-31c1-4196-8b0c-620de9af1dea tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:55.782224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c70dda59-31c1-4196-8b0c-620de9af1dea tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:55.782848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c70dda59-31c1-4196-8b0c-620de9af1dea tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:56.155217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c70dda59-31c1-4196-8b0c-620de9af1dea tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:56.169648 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c70dda59-31c1-4196-8b0c-620de9af1dea tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.406202 Jul 26 14:14:56.171361 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1113/2358] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:55 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:56.183367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f079d4ec-82db-467d-870e-a1b2753e8126 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:56.185147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f079d4ec-82db-467d-870e-a1b2753e8126 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:56.204177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f079d4ec-82db-467d-870e-a1b2753e8126 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:56.205041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f079d4ec-82db-467d-870e-a1b2753e8126 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:56.206286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f079d4ec-82db-467d-870e-a1b2753e8126 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:56.207746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f079d4ec-82db-467d-870e-a1b2753e8126 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:56.594159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f079d4ec-82db-467d-870e-a1b2753e8126 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:56.609585 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f079d4ec-82db-467d-870e-a1b2753e8126 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 200 len: 1474 microversion: 2.1 time: 0.436315 Jul 26 14:14:56.610423 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1114/2359] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:56 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 1474 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:56.632167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6ef89918-5e8d-430a-b11d-57a6216f5072 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1218358710"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:56.634985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6ef89918-5e8d-430a-b11d-57a6216f5072 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:56.652312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ef89918-5e8d-430a-b11d-57a6216f5072 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:56.652976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ef89918-5e8d-430a-b11d-57a6216f5072 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:56.653963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ef89918-5e8d-430a-b11d-57a6216f5072 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:56.654572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ef89918-5e8d-430a-b11d-57a6216f5072 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:56.744611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:14:56.745171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:14:56.745558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:14:56.746058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:14:56.746947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:14:56.777712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:56.778481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:56.779721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:56.780694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:56.848552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Getting quotas for project 65f93d79a9694a7d9e7d3172f69eb766. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:14:56.857179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Getting quotas for user 535280f0289041f1b483469d057c6aa2 and project 65f93d79a9694a7d9e7d3172f69eb766. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:14:56.896215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:14:56.905775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:14:57.020475 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3d1757e1-2cd2-447f-ae03-800e85b231ad tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.231503 Jul 26 14:14:57.021679 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1246/2360] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:14:57.026750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ce86810d-0beb-40a0-a384-ba0125e38eb9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:57.027594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ce86810d-0beb-40a0-a384-ba0125e38eb9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:57.052613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce86810d-0beb-40a0-a384-ba0125e38eb9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:57.054276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce86810d-0beb-40a0-a384-ba0125e38eb9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:57.061518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce86810d-0beb-40a0-a384-ba0125e38eb9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:57.062712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce86810d-0beb-40a0-a384-ba0125e38eb9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:57.172659 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6ef89918-5e8d-430a-b11d-57a6216f5072 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65/action" status: 202 len: 0 microversion: 2.1 time: 0.544165 Jul 26 14:14:57.179727 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1115/2361] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:14:56 2022] POST /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 26 14:14:57.190911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22c2d8c6-7d28-4328-bb7a-1f45b432d588 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:57.191891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22c2d8c6-7d28-4328-bb7a-1f45b432d588 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:57.450976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22c2d8c6-7d28-4328-bb7a-1f45b432d588 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:57.471494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22c2d8c6-7d28-4328-bb7a-1f45b432d588 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:57.475585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22c2d8c6-7d28-4328-bb7a-1f45b432d588 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:57.490160 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22c2d8c6-7d28-4328-bb7a-1f45b432d588 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1262 microversion: 2.26 time: 0.297549 Jul 26 14:14:57.502876 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1116/2362] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:57 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1262 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:57.503485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-56c1a0fd-ba6f-44ad-b6a6-f3be108584bc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799437940>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:57.603604 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-56c1a0fd-ba6f-44ad-b6a6-f3be108584bc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 200 len: 1412 microversion: 2.1 time: 0.109041 Jul 26 14:14:57.619042 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1117/2363] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:14:57 2022] GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:57.626147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-274661aa-0979-4686-9323-bd2596ef8e53 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:57.627733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-274661aa-0979-4686-9323-bd2596ef8e53 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:57.637957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-274661aa-0979-4686-9323-bd2596ef8e53 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:57.638696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-274661aa-0979-4686-9323-bd2596ef8e53 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:57.639686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-274661aa-0979-4686-9323-bd2596ef8e53 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:57.640326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-274661aa-0979-4686-9323-bd2596ef8e53 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:57.658544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ce86810d-0beb-40a0-a384-ba0125e38eb9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:57.672233 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ce86810d-0beb-40a0-a384-ba0125e38eb9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1511 microversion: 2.1 time: 0.648802 Jul 26 14:14:57.698705 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1247/2364] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:57 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1511 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:58.420946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-274661aa-0979-4686-9323-bd2596ef8e53 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:58.430534 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-274661aa-0979-4686-9323-bd2596ef8e53 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1506 microversion: 2.1 time: 0.810016 Jul 26 14:14:58.435915 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1118/2365] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:57 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1506 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:58.523373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abf8e3bf-1a35-44f7-a07b-dc45ccb1995f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:58.528305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-abf8e3bf-1a35-44f7-a07b-dc45ccb1995f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:58.544681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abf8e3bf-1a35-44f7-a07b-dc45ccb1995f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:58.560325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abf8e3bf-1a35-44f7-a07b-dc45ccb1995f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:58.563638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abf8e3bf-1a35-44f7-a07b-dc45ccb1995f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:58.564404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abf8e3bf-1a35-44f7-a07b-dc45ccb1995f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:58.626319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2a8d4a1a-15bd-4c4b-96c5-277d8f2c1ec8 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799425040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:58.727391 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2a8d4a1a-15bd-4c4b-96c5-277d8f2c1ec8 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 200 len: 1412 microversion: 2.1 time: 0.109428 Jul 26 14:14:58.731068 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1119/2366] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:14:58 2022] GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:58.748071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3a3c38d3-bdda-4022-bad3-8df1373c00ea tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:58.750259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3a3c38d3-bdda-4022-bad3-8df1373c00ea tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:58.767414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a3c38d3-bdda-4022-bad3-8df1373c00ea tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:58.768396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a3c38d3-bdda-4022-bad3-8df1373c00ea tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:58.771114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a3c38d3-bdda-4022-bad3-8df1373c00ea tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:58.771907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a3c38d3-bdda-4022-bad3-8df1373c00ea tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:58.778115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-abf8e3bf-1a35-44f7-a07b-dc45ccb1995f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:58.797103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-abf8e3bf-1a35-44f7-a07b-dc45ccb1995f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:58.798843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-abf8e3bf-1a35-44f7-a07b-dc45ccb1995f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:58.800158 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-abf8e3bf-1a35-44f7-a07b-dc45ccb1995f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1314 microversion: 2.26 time: 0.284394 Jul 26 14:14:58.810719 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1248/2367] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:58 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:14:59.458611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-99df6097-4c79-4add-844f-a8b7f0ea2e58 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:59.459274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-99df6097-4c79-4add-844f-a8b7f0ea2e58 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:59.466180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99df6097-4c79-4add-844f-a8b7f0ea2e58 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:59.466899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99df6097-4c79-4add-844f-a8b7f0ea2e58 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:59.468549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99df6097-4c79-4add-844f-a8b7f0ea2e58 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:59.469158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99df6097-4c79-4add-844f-a8b7f0ea2e58 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:59.671775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99df6097-4c79-4add-844f-a8b7f0ea2e58 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:59.674045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:14:59.688806 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-99df6097-4c79-4add-844f-a8b7f0ea2e58 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 200 len: 1464 microversion: 2.1 time: 0.233764 Jul 26 14:14:59.689755 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1249/2368] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:59 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 1464 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:14:59.746453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-68267b4c-bf07-42c6-b1e6-c6915eedd403 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f87993afb80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:59.837071 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-68267b4c-bf07-42c6-b1e6-c6915eedd403 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 200 len: 1412 microversion: 2.1 time: 0.095368 Jul 26 14:14:59.840405 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1250/2369] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:14:59 2022] GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:59.861433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3a3c38d3-bdda-4022-bad3-8df1373c00ea tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:14:59.862004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af08adc7-88b0-43a7-bd8b-759da93201ae tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:14:59.862154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af08adc7-88b0-43a7-bd8b-759da93201ae tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:14:59.875312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af08adc7-88b0-43a7-bd8b-759da93201ae tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:59.876291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af08adc7-88b0-43a7-bd8b-759da93201ae tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:59.879869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af08adc7-88b0-43a7-bd8b-759da93201ae tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:59.880814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af08adc7-88b0-43a7-bd8b-759da93201ae tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:59.884211 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3a3c38d3-bdda-4022-bad3-8df1373c00ea tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1511 microversion: 2.1 time: 1.151474 Jul 26 14:14:59.904450 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1120/2370] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:14:58 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1511 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:14:59.910629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f5e077c8-836f-4c98-b581-a10b4ef31ab9 req-a1f570aa-4577-410f-b90e-21a56b74db74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150082ea-2baf-4ade-bbbf-2a9ad70f7fdd", "name": "network-vif-deleted", "tag": "4f0b57e3-5498-4efd-a970-ff5c5608f91f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:14:59.945663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f5e077c8-836f-4c98-b581-a10b4ef31ab9 req-a1f570aa-4577-410f-b90e-21a56b74db74 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:14:59.946291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f5e077c8-836f-4c98-b581-a10b4ef31ab9 req-a1f570aa-4577-410f-b90e-21a56b74db74 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:14:59.970902 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f5e077c8-836f-4c98-b581-a10b4ef31ab9 req-a1f570aa-4577-410f-b90e-21a56b74db74 service nova] Creating event network-vif-deleted:4f0b57e3-5498-4efd-a970-ff5c5608f91f for instance 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd on n-h1-833090-9 Jul 26 14:14:59.982290 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f5e077c8-836f-4c98-b581-a10b4ef31ab9 req-a1f570aa-4577-410f-b90e-21a56b74db74 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075617 Jul 26 14:14:59.984865 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1121/2371] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:00.152630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af08adc7-88b0-43a7-bd8b-759da93201ae tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:00.200568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af08adc7-88b0-43a7-bd8b-759da93201ae tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:00.220370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af08adc7-88b0-43a7-bd8b-759da93201ae tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:00.224459 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af08adc7-88b0-43a7-bd8b-759da93201ae tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1320 microversion: 2.26 time: 0.379441 Jul 26 14:15:00.248588 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1251/2372] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:14:59 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1320 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:00.719203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-10ce0340-f73d-4912-b69e-6a07539be8f1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:00.720283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-10ce0340-f73d-4912-b69e-6a07539be8f1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:00.727757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10ce0340-f73d-4912-b69e-6a07539be8f1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:00.728821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10ce0340-f73d-4912-b69e-6a07539be8f1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:00.730209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10ce0340-f73d-4912-b69e-6a07539be8f1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:00.730822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10ce0340-f73d-4912-b69e-6a07539be8f1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:00.756554 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-10ce0340-f73d-4912-b69e-6a07539be8f1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] HTTP exception thrown: Instance 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd could not be found. Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-10ce0340-f73d-4912-b69e-6a07539be8f1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Request method failure captured: Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd HTTP/1.1 Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZeDwOYBLx_vptIaTJpgIFYAKMf3o2HS98hQoZrfSenWuV95YKGjX16RMB_tc1j_ZpWXUljKfIFx8ssQEKB-rHRD7SvKdT3M5LFDhTxOg0TBYAphfpGy8THAr3SNxxPfLRBGOb5zUznuQqkA_D6rDqFgCjHcg7PQ0JduXupnVmf9JE Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2cce280cfb40401581a18078069bb592 Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerRescueTestJSON-596551926 Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2cce280cfb40401581a18078069bb592"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2cce280cfb40401581a18078069bb592"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2cce280cfb40401581a18078069bb592", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2cce280cfb40401581a18078069bb592"}]}] Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerRescueTestJSON-596551926 Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2cce280cfb40401581a18078069bb592 Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerRescueTestJSON-596551926 Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerRescueTestJSON-596551926-project Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 58bff9719b9e4d9995199bd43fa118fd Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerRescueTestJSON-596551926-project Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd could not be found. Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '150082ea-2baf-4ade-bbbf-2a9ad70f7fdd'} Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd could not be found. Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd could not be found. Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:00.758436 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:00.769839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:00.769839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:00.769839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:00.769839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:15:00.769839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:15:00.769839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd could not be found. Jul 26 14:15:00.769839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:00.769839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-10ce0340-f73d-4912-b69e-6a07539be8f1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Returning 404 to user: Instance 150082ea-2baf-4ade-bbbf-2a9ad70f7fdd could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:15:00.780330 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-10ce0340-f73d-4912-b69e-6a07539be8f1 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd" status: 404 len: 111 microversion: 2.1 time: 0.061825 Jul 26 14:15:00.780330 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1122/2373] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:00 2022] GET /compute/v2.1/servers/150082ea-2baf-4ade-bbbf-2a9ad70f7fdd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:15:00.787239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2c60e6aa-4966-480c-809f-517b9b6d7ca6 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:00.787752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2c60e6aa-4966-480c-809f-517b9b6d7ca6 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:00.815153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c60e6aa-4966-480c-809f-517b9b6d7ca6 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:00.815563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b1dc46c-a1e5-4aa5-9cc7-629ba1671209 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:00.816202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b1dc46c-a1e5-4aa5-9cc7-629ba1671209 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:00.819374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c60e6aa-4966-480c-809f-517b9b6d7ca6 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:00.820332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c60e6aa-4966-480c-809f-517b9b6d7ca6 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:00.820797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c60e6aa-4966-480c-809f-517b9b6d7ca6 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:00.826068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b1dc46c-a1e5-4aa5-9cc7-629ba1671209 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:00.826620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b1dc46c-a1e5-4aa5-9cc7-629ba1671209 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:00.832570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b1dc46c-a1e5-4aa5-9cc7-629ba1671209 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:00.833062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b1dc46c-a1e5-4aa5-9cc7-629ba1671209 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:00.861849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2c60e6aa-4966-480c-809f-517b9b6d7ca6 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:15:00.880406 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8b1dc46c-a1e5-4aa5-9cc7-629ba1671209 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] HTTP exception thrown: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b1dc46c-a1e5-4aa5-9cc7-629ba1671209 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Request method failure captured: Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d HTTP/1.1 Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZWN5DLm4GNqRphjcNaehrdwmm53wyL37lM4DzqyFwM3ll5OQrFVLHHlsCfHiob_s5LZ2unHPn-toKxHKI69t4NQ_2GnjEu5Nwx01soaK6yLzUojrSJ8-_74mArH7vc22ufDRADAp7KWj-UOId_mELW-KxmGOxI4WJLbO2hoLaND5c Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0daac0aaada2453f84fdb257106f12ae", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}] Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: cf1430124f9f4c099944aad81234f6de Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '20e0fbcc-42e6-482f-a696-a2046d4cd25d'} Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:15:00.884296 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b1dc46c-a1e5-4aa5-9cc7-629ba1671209 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Returning 404 to user: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:15:00.888437 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b1dc46c-a1e5-4aa5-9cc7-629ba1671209 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "DELETE /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 404 len: 111 microversion: 2.1 time: 0.074759 Jul 26 14:15:00.892775 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1123/2374] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:15:00 2022] DELETE /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:15:00.899245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-14a0f965-b6d2-4456-add1-b96ca0e98a8c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f87994180d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:00.995925 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-14a0f965-b6d2-4456-add1-b96ca0e98a8c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 200 len: 1412 microversion: 2.1 time: 0.099349 Jul 26 14:15:01.002725 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1124/2375] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:15:00 2022] GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:01.010059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-97fcb6e1-8f80-4ad5-9b9b-9ba6682d6171 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:01.011419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-97fcb6e1-8f80-4ad5-9b9b-9ba6682d6171 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 20e0fbcc-42e6-482f-a696-a2046d4cd25d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:01.023397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97fcb6e1-8f80-4ad5-9b9b-9ba6682d6171 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.024349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97fcb6e1-8f80-4ad5-9b9b-9ba6682d6171 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.025451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97fcb6e1-8f80-4ad5-9b9b-9ba6682d6171 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.026301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97fcb6e1-8f80-4ad5-9b9b-9ba6682d6171 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.035775 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2c60e6aa-4966-480c-809f-517b9b6d7ca6 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 204 len: 0 microversion: 2.1 time: 0.252736 Jul 26 14:15:01.037831 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1252/2376] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:15:00 2022] DELETE /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:15:01.049816 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-97fcb6e1-8f80-4ad5-9b9b-9ba6682d6171 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] HTTP exception thrown: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:15:01.051661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-03deaa87-fbc9-4a72-bb34-8c9cca80b5ca tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-97fcb6e1-8f80-4ad5-9b9b-9ba6682d6171 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Request method failure captured: Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d HTTP/1.1 Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZWN5DLm4GNqRphjcNaehrdwmm53wyL37lM4DzqyFwM3ll5OQrFVLHHlsCfHiob_s5LZ2unHPn-toKxHKI69t4NQ_2GnjEu5Nwx01soaK6yLzUojrSJ8-_74mArH7vc22ufDRADAp7KWj-UOId_mELW-KxmGOxI4WJLbO2hoLaND5c Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0daac0aaada2453f84fdb257106f12ae", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}] Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: cf1430124f9f4c099944aad81234f6de Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '20e0fbcc-42e6-482f-a696-a2046d4cd25d'} Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:01.052435 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.058382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:01.058382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:01.058382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:01.058382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:15:01.058382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:15:01.058382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. Jul 26 14:15:01.058382 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.058881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-03deaa87-fbc9-4a72-bb34-8c9cca80b5ca tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:01.060979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-97fcb6e1-8f80-4ad5-9b9b-9ba6682d6171 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Returning 404 to user: Instance 20e0fbcc-42e6-482f-a696-a2046d4cd25d could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:15:01.062955 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-97fcb6e1-8f80-4ad5-9b9b-9ba6682d6171 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d" status: 404 len: 111 microversion: 2.1 time: 0.058198 Jul 26 14:15:01.067247 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1125/2377] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:01 2022] GET /compute/v2.1/servers/20e0fbcc-42e6-482f-a696-a2046d4cd25d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:15:01.072638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03deaa87-fbc9-4a72-bb34-8c9cca80b5ca tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.073111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03deaa87-fbc9-4a72-bb34-8c9cca80b5ca tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.073922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03deaa87-fbc9-4a72-bb34-8c9cca80b5ca tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.074102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fe5dd4db-40ea-4e9d-a1ca-d7b5f6fb8e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:01.074373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03deaa87-fbc9-4a72-bb34-8c9cca80b5ca tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.074779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fe5dd4db-40ea-4e9d-a1ca-d7b5f6fb8e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:01.087575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe5dd4db-40ea-4e9d-a1ca-d7b5f6fb8e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.089626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe5dd4db-40ea-4e9d-a1ca-d7b5f6fb8e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.090961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe5dd4db-40ea-4e9d-a1ca-d7b5f6fb8e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.091495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe5dd4db-40ea-4e9d-a1ca-d7b5f6fb8e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.525729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fe5dd4db-40ea-4e9d-a1ca-d7b5f6fb8e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:01.543187 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fe5dd4db-40ea-4e9d-a1ca-d7b5f6fb8e69 tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1490 microversion: 2.1 time: 0.473745 Jul 26 14:15:01.543783 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1126/2378] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:01 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1490 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:01.554037 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-03deaa87-fbc9-4a72-bb34-8c9cca80b5ca tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:01.566054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1044b163-f1c8-4141-a9c9-50c4a408dc59 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:01.566562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1044b163-f1c8-4141-a9c9-50c4a408dc59 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:01.574710 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-03deaa87-fbc9-4a72-bb34-8c9cca80b5ca tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1511 microversion: 2.1 time: 0.523435 Jul 26 14:15:01.575385 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1253/2379] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:01 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1511 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:01.599541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c7421b12-63ed-4bfb-b309-4fe1ec5b1e76 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:01.600529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c7421b12-63ed-4bfb-b309-4fe1ec5b1e76 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:01.605892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1044b163-f1c8-4141-a9c9-50c4a408dc59 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.606405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1044b163-f1c8-4141-a9c9-50c4a408dc59 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.607308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1044b163-f1c8-4141-a9c9-50c4a408dc59 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.610021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1044b163-f1c8-4141-a9c9-50c4a408dc59 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.622495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7421b12-63ed-4bfb-b309-4fe1ec5b1e76 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.623516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7421b12-63ed-4bfb-b309-4fe1ec5b1e76 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.626039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7421b12-63ed-4bfb-b309-4fe1ec5b1e76 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.626499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7421b12-63ed-4bfb-b309-4fe1ec5b1e76 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.643983 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-1044b163-f1c8-4141-a9c9-50c4a408dc59 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] HTTP exception thrown: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1044b163-f1c8-4141-a9c9-50c4a408dc59 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Request method failure captured: Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 HTTP/1.1 Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZWN5DLm4GNqRphjcNaehrdwmm53wyL37lM4DzqyFwM3ll5OQrFVLHHlsCfHiob_s5LZ2unHPn-toKxHKI69t4NQ_2GnjEu5Nwx01soaK6yLzUojrSJ8-_74mArH7vc22ufDRADAp7KWj-UOId_mELW-KxmGOxI4WJLbO2hoLaND5c Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0daac0aaada2453f84fdb257106f12ae", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}] Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: cf1430124f9f4c099944aad81234f6de Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '11b7e47e-554f-413c-8876-e08156867fa7'} Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:15:01.645648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1044b163-f1c8-4141-a9c9-50c4a408dc59 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Returning 404 to user: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:15:01.650179 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1044b163-f1c8-4141-a9c9-50c4a408dc59 tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "DELETE /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 404 len: 111 microversion: 2.1 time: 0.098457 Jul 26 14:15:01.653219 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1127/2380] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:15:01 2022] DELETE /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:15:01.665763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-387c3ace-3559-46f6-b4a3-1e2482db51ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:01.667134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-387c3ace-3559-46f6-b4a3-1e2482db51ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] [instance: 11b7e47e-554f-413c-8876-e08156867fa7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:01.674991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-387c3ace-3559-46f6-b4a3-1e2482db51ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.675689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-387c3ace-3559-46f6-b4a3-1e2482db51ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.676685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-387c3ace-3559-46f6-b4a3-1e2482db51ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:01.677274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-387c3ace-3559-46f6-b4a3-1e2482db51ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:01.711102 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-387c3ace-3559-46f6-b4a3-1e2482db51ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] HTTP exception thrown: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-387c3ace-3559-46f6-b4a3-1e2482db51ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Request method failure captured: Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 HTTP/1.1 Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZWN5DLm4GNqRphjcNaehrdwmm53wyL37lM4DzqyFwM3ll5OQrFVLHHlsCfHiob_s5LZ2unHPn-toKxHKI69t4NQ_2GnjEu5Nwx01soaK6yLzUojrSJ8-_74mArH7vc22ufDRADAp7KWj-UOId_mELW-KxmGOxI4WJLbO2hoLaND5c Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0daac0aaada2453f84fdb257106f12ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0daac0aaada2453f84fdb257106f12ae", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0daac0aaada2453f84fdb257106f12ae"}]}] Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 0daac0aaada2453f84fdb257106f12ae Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestMultiNic-1967819980 Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: cf1430124f9f4c099944aad81234f6de Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestMultiNic-1967819980-project Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '11b7e47e-554f-413c-8876-e08156867fa7'} Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:01.713125 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.716576 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:01.716576 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:01.716576 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:01.716576 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:15:01.716576 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:15:01.716576 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. Jul 26 14:15:01.716576 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:01.719000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-387c3ace-3559-46f6-b4a3-1e2482db51ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] Returning 404 to user: Instance 11b7e47e-554f-413c-8876-e08156867fa7 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:15:01.720418 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-387c3ace-3559-46f6-b4a3-1e2482db51ae tempest-ServersTestMultiNic-1967819980 tempest-ServersTestMultiNic-1967819980-project] 10.222.0.70 "GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7" status: 404 len: 111 microversion: 2.1 time: 0.066144 Jul 26 14:15:01.739390 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1128/2381] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:01 2022] GET /compute/v2.1/servers/11b7e47e-554f-413c-8876-e08156867fa7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:15:02.000072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c7421b12-63ed-4bfb-b309-4fe1ec5b1e76 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:02.010324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c7421b12-63ed-4bfb-b309-4fe1ec5b1e76 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:02.011898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c7421b12-63ed-4bfb-b309-4fe1ec5b1e76 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:02.013566 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c7421b12-63ed-4bfb-b309-4fe1ec5b1e76 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1362 microversion: 2.26 time: 0.437196 Jul 26 14:15:02.014859 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1254/2382] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:01 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:02.043892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f5fbae65-c3a2-4fc4-86ce-18d76b7c0a42 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f87993fc1f0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:02.143851 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f5fbae65-c3a2-4fc4-86ce-18d76b7c0a42 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 200 len: 1412 microversion: 2.1 time: 0.129974 Jul 26 14:15:02.146158 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1129/2383] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:15:02 2022] GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:02.569942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5da1e746-2374-47d8-84e2-563973b4203a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:02.570633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5da1e746-2374-47d8-84e2-563973b4203a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:02.580682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da1e746-2374-47d8-84e2-563973b4203a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:02.589181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da1e746-2374-47d8-84e2-563973b4203a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:02.590349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da1e746-2374-47d8-84e2-563973b4203a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:02.590990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da1e746-2374-47d8-84e2-563973b4203a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:02.601298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-52f0b146-23bf-44aa-bde8-843adb7a52c5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:02.602173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-52f0b146-23bf-44aa-bde8-843adb7a52c5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:02.618185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-52f0b146-23bf-44aa-bde8-843adb7a52c5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:02.626785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-52f0b146-23bf-44aa-bde8-843adb7a52c5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:02.627876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-52f0b146-23bf-44aa-bde8-843adb7a52c5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:02.634879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-52f0b146-23bf-44aa-bde8-843adb7a52c5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:02.716578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:03.423791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5da1e746-2374-47d8-84e2-563973b4203a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:03.434858 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5da1e746-2374-47d8-84e2-563973b4203a tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1490 microversion: 2.1 time: 0.874691 Jul 26 14:15:03.441997 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1255/2384] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:02 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1490 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:03.447749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8eb435e6-abb4-4d7c-b32d-e84eaa362322 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:03.457887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-52f0b146-23bf-44aa-bde8-843adb7a52c5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:03.459437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8eb435e6-abb4-4d7c-b32d-e84eaa362322 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:03.467170 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-52f0b146-23bf-44aa-bde8-843adb7a52c5 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1511 microversion: 2.1 time: 0.869068 Jul 26 14:15:03.470687 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1130/2385] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:02 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1511 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:15:03.477989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8eb435e6-abb4-4d7c-b32d-e84eaa362322 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:03.478814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8eb435e6-abb4-4d7c-b32d-e84eaa362322 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:03.480348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8eb435e6-abb4-4d7c-b32d-e84eaa362322 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:03.481671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8eb435e6-abb4-4d7c-b32d-e84eaa362322 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:03.482935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-88cf7c8d-10e8-4915-8119-412cc5c7c06d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8787f39ca0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:03.587734 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-88cf7c8d-10e8-4915-8119-412cc5c7c06d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 200 len: 1412 microversion: 2.1 time: 0.115788 Jul 26 14:15:03.589467 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1131/2386] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:15:03 2022] GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:04.464629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ba91c140-c915-4d0f-82c2-7b4a27fd40aa tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:04.465965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ba91c140-c915-4d0f-82c2-7b4a27fd40aa tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:04.484458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba91c140-c915-4d0f-82c2-7b4a27fd40aa tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:04.494825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8eb435e6-abb4-4d7c-b32d-e84eaa362322 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:04.496158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba91c140-c915-4d0f-82c2-7b4a27fd40aa tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:04.497315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba91c140-c915-4d0f-82c2-7b4a27fd40aa tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:04.497551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba91c140-c915-4d0f-82c2-7b4a27fd40aa tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:04.510122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8eb435e6-abb4-4d7c-b32d-e84eaa362322 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:04.519441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8eb435e6-abb4-4d7c-b32d-e84eaa362322 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:04.523009 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8eb435e6-abb4-4d7c-b32d-e84eaa362322 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1362 microversion: 2.26 time: 1.079471 Jul 26 14:15:04.525344 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1256/2387] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:03 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1362 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:04.535774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3780752f-94c5-4307-9278-8acd3c097ceb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:04.552151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3780752f-94c5-4307-9278-8acd3c097ceb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:04.567755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3780752f-94c5-4307-9278-8acd3c097ceb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:04.568321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3780752f-94c5-4307-9278-8acd3c097ceb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:04.569423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3780752f-94c5-4307-9278-8acd3c097ceb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:04.569673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3780752f-94c5-4307-9278-8acd3c097ceb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:05.484135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3780752f-94c5-4307-9278-8acd3c097ceb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:05.507679 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3780752f-94c5-4307-9278-8acd3c097ceb tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1532 microversion: 2.1 time: 0.975211 Jul 26 14:15:05.508754 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1257/2388] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:04 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1532 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:05.520533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cf526518-da3e-424f-9210-4aefbd1ee53c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f879937bf70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:05.703378 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cf526518-da3e-424f-9210-4aefbd1ee53c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 200 len: 1412 microversion: 2.1 time: 0.193268 Jul 26 14:15:05.703979 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1258/2389] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:15:05 2022] GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 1412 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:05.721681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-71354837-29d0-41ce-8a70-714785ef1d2b req-db6ae6fb-4360-4034-9ed5-2bbacf296dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f930a87-b048-44cc-86eb-7db98aaaff65", "name": "network-vif-plugged", "status": "completed", "tag": "bc51517b-e7e7-4587-a668-10a85cc83812"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:05.765051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-71354837-29d0-41ce-8a70-714785ef1d2b req-db6ae6fb-4360-4034-9ed5-2bbacf296dc2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:05.765773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-71354837-29d0-41ce-8a70-714785ef1d2b req-db6ae6fb-4360-4034-9ed5-2bbacf296dc2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:05.822960 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-71354837-29d0-41ce-8a70-714785ef1d2b req-db6ae6fb-4360-4034-9ed5-2bbacf296dc2 service nova] Creating event network-vif-plugged:bc51517b-e7e7-4587-a668-10a85cc83812 for instance 2f930a87-b048-44cc-86eb-7db98aaaff65 on n-h2-833090-9 Jul 26 14:15:05.833382 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-71354837-29d0-41ce-8a70-714785ef1d2b req-db6ae6fb-4360-4034-9ed5-2bbacf296dc2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123671 Jul 26 14:15:05.850374 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1259/2390] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:05.856730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70d568a4-3d7c-4265-80e4-a56299edf78c tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:05.862252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70d568a4-3d7c-4265-80e4-a56299edf78c tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:05.887605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70d568a4-3d7c-4265-80e4-a56299edf78c tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:05.891332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70d568a4-3d7c-4265-80e4-a56299edf78c tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:05.896799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70d568a4-3d7c-4265-80e4-a56299edf78c tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:05.897449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70d568a4-3d7c-4265-80e4-a56299edf78c tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:05.993965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ba91c140-c915-4d0f-82c2-7b4a27fd40aa tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58bff9719b9e4d9995199bd43fa118fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cce280cfb40401581a18078069bb592', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:06.007933 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ba91c140-c915-4d0f-82c2-7b4a27fd40aa tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 200 len: 1490 microversion: 2.1 time: 1.548577 Jul 26 14:15:06.043199 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1132/2391] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:04 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 1490 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:06.078096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-0bc76599-7665-46d1-8696-0f19452389b9 req-152d9cdd-e690-414b-bead-6d63291ce2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9", "tag": "024d383e-7ce7-49cd-a002-2e9f6a98e46a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:06.109633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0bc76599-7665-46d1-8696-0f19452389b9 req-152d9cdd-e690-414b-bead-6d63291ce2c9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:06.111628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0bc76599-7665-46d1-8696-0f19452389b9 req-152d9cdd-e690-414b-bead-6d63291ce2c9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:06.150691 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-0bc76599-7665-46d1-8696-0f19452389b9 req-152d9cdd-e690-414b-bead-6d63291ce2c9 service nova] Creating event network-changed:024d383e-7ce7-49cd-a002-2e9f6a98e46a for instance 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 on n-h1-833090-9 Jul 26 14:15:06.165982 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-0bc76599-7665-46d1-8696-0f19452389b9 req-152d9cdd-e690-414b-bead-6d63291ce2c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098784 Jul 26 14:15:06.166656 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1133/2392] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:06.189297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-dc06e0d6-9780-4ccc-a3c8-ca4365fce1a2 req-87953bf4-b5bc-4fdf-a7dd-acc9dbb3bbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b84552b-8ea2-4d88-b72d-8f8547cd9f9c", "name": "network-vif-deleted", "tag": "643af9ca-999a-4ed7-8769-8e923e01a843"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:06.253323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-dc06e0d6-9780-4ccc-a3c8-ca4365fce1a2 req-87953bf4-b5bc-4fdf-a7dd-acc9dbb3bbcd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:06.255622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-dc06e0d6-9780-4ccc-a3c8-ca4365fce1a2 req-87953bf4-b5bc-4fdf-a7dd-acc9dbb3bbcd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:06.340780 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-dc06e0d6-9780-4ccc-a3c8-ca4365fce1a2 req-87953bf4-b5bc-4fdf-a7dd-acc9dbb3bbcd service nova] Creating event network-vif-deleted:643af9ca-999a-4ed7-8769-8e923e01a843 for instance 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c on n-h1-833090-9 Jul 26 14:15:06.380338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70d568a4-3d7c-4265-80e4-a56299edf78c tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:06.398749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70d568a4-3d7c-4265-80e4-a56299edf78c tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:06.401126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70d568a4-3d7c-4265-80e4-a56299edf78c tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:06.409911 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70d568a4-3d7c-4265-80e4-a56299edf78c tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1362 microversion: 2.26 time: 0.557506 Jul 26 14:15:06.417763 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1260/2393] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:05 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1362 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:06.445409 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-dc06e0d6-9780-4ccc-a3c8-ca4365fce1a2 req-87953bf4-b5bc-4fdf-a7dd-acc9dbb3bbcd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266703 Jul 26 14:15:06.449607 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1134/2394] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:06.538749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2bd96cba-53c6-4dc8-a9e3-e1c8831c3ecc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:06.540811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2bd96cba-53c6-4dc8-a9e3-e1c8831c3ecc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:06.555541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bd96cba-53c6-4dc8-a9e3-e1c8831c3ecc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:06.556970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bd96cba-53c6-4dc8-a9e3-e1c8831c3ecc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:06.559525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bd96cba-53c6-4dc8-a9e3-e1c8831c3ecc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:06.561750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bd96cba-53c6-4dc8-a9e3-e1c8831c3ecc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:06.724030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-091d00cc-1c6b-4f0b-a4f8-b3fc3201a101 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799409820>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:06.815195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:06.870615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:07.457913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:07.469992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2bd96cba-53c6-4dc8-a9e3-e1c8831c3ecc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:07.478326 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2bd96cba-53c6-4dc8-a9e3-e1c8831c3ecc tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.946094 Jul 26 14:15:07.490383 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1261/2395] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:06 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:07.501244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb4dd535-c922-4cee-b22a-e20be86bc06b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:07.502433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cb4dd535-c922-4cee-b22a-e20be86bc06b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] [instance: 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:07.538870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb4dd535-c922-4cee-b22a-e20be86bc06b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:07.542753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb4dd535-c922-4cee-b22a-e20be86bc06b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:07.545923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb4dd535-c922-4cee-b22a-e20be86bc06b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:07.547293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb4dd535-c922-4cee-b22a-e20be86bc06b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:07.586937 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-cb4dd535-c922-4cee-b22a-e20be86bc06b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] HTTP exception thrown: Instance 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c could not be found. Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb4dd535-c922-4cee-b22a-e20be86bc06b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Request method failure captured: Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c HTTP/1.1 Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZeDwOYBLx_vptIaTJpgIFYAKMf3o2HS98hQoZrfSenWuV95YKGjX16RMB_tc1j_ZpWXUljKfIFx8ssQEKB-rHRD7SvKdT3M5LFDhTxOg0TBYAphfpGy8THAr3SNxxPfLRBGOb5zUznuQqkA_D6rDqFgCjHcg7PQ0JduXupnVmf9JE Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2cce280cfb40401581a18078069bb592 Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerRescueTestJSON-596551926 Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2cce280cfb40401581a18078069bb592"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2cce280cfb40401581a18078069bb592"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2cce280cfb40401581a18078069bb592", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2cce280cfb40401581a18078069bb592"}]}] Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerRescueTestJSON-596551926 Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2cce280cfb40401581a18078069bb592 Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerRescueTestJSON-596551926 Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerRescueTestJSON-596551926-project Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 58bff9719b9e4d9995199bd43fa118fd Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerRescueTestJSON-596551926-project Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c could not be found. Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '3b84552b-8ea2-4d88-b72d-8f8547cd9f9c'} Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c could not be found. Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c could not be found. Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:07.592338 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:15:07.596058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:07.596058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:07.596058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:07.596058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:15:07.596058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:15:07.596058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c could not be found. Jul 26 14:15:07.596058 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:15:07.598392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb4dd535-c922-4cee-b22a-e20be86bc06b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] Returning 404 to user: Instance 3b84552b-8ea2-4d88-b72d-8f8547cd9f9c could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:15:07.599498 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cb4dd535-c922-4cee-b22a-e20be86bc06b tempest-ServerRescueTestJSON-596551926 tempest-ServerRescueTestJSON-596551926-project] 10.222.0.70 "GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c" status: 404 len: 111 microversion: 2.1 time: 0.106410 Jul 26 14:15:07.605152 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1262/2396] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:07 2022] GET /compute/v2.1/servers/3b84552b-8ea2-4d88-b72d-8f8547cd9f9c => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:15:07.615115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d84fcddf-0549-429e-a87a-d61b499c14e3 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:07.616659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d84fcddf-0549-429e-a87a-d61b499c14e3 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:07.638271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d84fcddf-0549-429e-a87a-d61b499c14e3 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:07.641697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d84fcddf-0549-429e-a87a-d61b499c14e3 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:07.645066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d84fcddf-0549-429e-a87a-d61b499c14e3 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:07.645930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d84fcddf-0549-429e-a87a-d61b499c14e3 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:09.130396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d84fcddf-0549-429e-a87a-d61b499c14e3 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:09.157714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d84fcddf-0549-429e-a87a-d61b499c14e3 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:09.165416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d84fcddf-0549-429e-a87a-d61b499c14e3 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:09.181344 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d84fcddf-0549-429e-a87a-d61b499c14e3 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1362 microversion: 2.26 time: 1.574758 Jul 26 14:15:09.208453 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1263/2397] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:07 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1362 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:09.215380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b895ec00-782c-454f-bb6f-cefd11e03e59 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:09.220885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b895ec00-782c-454f-bb6f-cefd11e03e59 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:09.234131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b895ec00-782c-454f-bb6f-cefd11e03e59 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:09.236595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b895ec00-782c-454f-bb6f-cefd11e03e59 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:09.237684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b895ec00-782c-454f-bb6f-cefd11e03e59 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:09.238350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b895ec00-782c-454f-bb6f-cefd11e03e59 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:09.560201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b895ec00-782c-454f-bb6f-cefd11e03e59 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:09.570671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b895ec00-782c-454f-bb6f-cefd11e03e59 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.360721 Jul 26 14:15:09.576386 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1264/2398] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:09 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:09.592390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5381c031-c39f-4416-ad55-6876aea0504c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d745197-b03c-4d3d-b4b2-311b6a4c097f"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:09.604662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5381c031-c39f-4416-ad55-6876aea0504c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:09.630998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5381c031-c39f-4416-ad55-6876aea0504c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:09.634720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5381c031-c39f-4416-ad55-6876aea0504c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:09.640900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5381c031-c39f-4416-ad55-6876aea0504c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:09.641911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5381c031-c39f-4416-ad55-6876aea0504c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:10.364258 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5381c031-c39f-4416-ad55-6876aea0504c tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "POST /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767064 Jul 26 14:15:10.370167 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1265/2399] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:15:09 2022] POST /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments => generated 194 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:10.417156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4fc4fd28-60e7-4ddd-a873-9897a9acaf1b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:10.424768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4fc4fd28-60e7-4ddd-a873-9897a9acaf1b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:10.463290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4fc4fd28-60e7-4ddd-a873-9897a9acaf1b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:10.465247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4fc4fd28-60e7-4ddd-a873-9897a9acaf1b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:10.468469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4fc4fd28-60e7-4ddd-a873-9897a9acaf1b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:10.471646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4fc4fd28-60e7-4ddd-a873-9897a9acaf1b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:11.061611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4fc4fd28-60e7-4ddd-a873-9897a9acaf1b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:11.069046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:11.075821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4fc4fd28-60e7-4ddd-a873-9897a9acaf1b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:11.096605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4fc4fd28-60e7-4ddd-a873-9897a9acaf1b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:11.101107 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4fc4fd28-60e7-4ddd-a873-9897a9acaf1b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1362 microversion: 2.26 time: 0.729064 Jul 26 14:15:11.121482 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1266/2400] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:10 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1362 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:11.130498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a2c8a39c-d53c-4ee1-8690-321c74c3702f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:11.139368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a2c8a39c-d53c-4ee1-8690-321c74c3702f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:11.168937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a2c8a39c-d53c-4ee1-8690-321c74c3702f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:11.176769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a2c8a39c-d53c-4ee1-8690-321c74c3702f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:11.178235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a2c8a39c-d53c-4ee1-8690-321c74c3702f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:11.179040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a2c8a39c-d53c-4ee1-8690-321c74c3702f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:12.209772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a2c8a39c-d53c-4ee1-8690-321c74c3702f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:12.237217 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a2c8a39c-d53c-4ee1-8690-321c74c3702f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 1.109637 Jul 26 14:15:12.243169 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1267/2401] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:11 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:12.249848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7b1109ef-4b62-401a-b0ad-928cd0d12165 req-e5ee8630-c5cf-4f39-9aa0-1222ea53bf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b94307-dd41-4f71-b529-c6cbb944c27f", "name": "network-vif-plugged", "status": "completed", "tag": "5c60dac8-f587-41cf-8357-66980afb2e01"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:12.319318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7b1109ef-4b62-401a-b0ad-928cd0d12165 req-e5ee8630-c5cf-4f39-9aa0-1222ea53bf19 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:12.319934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7b1109ef-4b62-401a-b0ad-928cd0d12165 req-e5ee8630-c5cf-4f39-9aa0-1222ea53bf19 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:12.369779 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7b1109ef-4b62-401a-b0ad-928cd0d12165 req-e5ee8630-c5cf-4f39-9aa0-1222ea53bf19 service nova] Creating event network-vif-plugged:5c60dac8-f587-41cf-8357-66980afb2e01 for instance e6b94307-dd41-4f71-b529-c6cbb944c27f on n-h1-833090-9 Jul 26 14:15:12.397074 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7b1109ef-4b62-401a-b0ad-928cd0d12165 req-e5ee8630-c5cf-4f39-9aa0-1222ea53bf19 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151966 Jul 26 14:15:12.397940 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1268/2402] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:12.410337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ee99b5e9-7347-4cdc-9398-bdf3d06f2291 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:12.425022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ee99b5e9-7347-4cdc-9398-bdf3d06f2291 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:12.452898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee99b5e9-7347-4cdc-9398-bdf3d06f2291 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:12.453368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee99b5e9-7347-4cdc-9398-bdf3d06f2291 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:12.454174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee99b5e9-7347-4cdc-9398-bdf3d06f2291 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:12.454615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee99b5e9-7347-4cdc-9398-bdf3d06f2291 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:13.107875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ee99b5e9-7347-4cdc-9398-bdf3d06f2291 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:13.142315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ee99b5e9-7347-4cdc-9398-bdf3d06f2291 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:13.152786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ee99b5e9-7347-4cdc-9398-bdf3d06f2291 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:13.167262 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ee99b5e9-7347-4cdc-9398-bdf3d06f2291 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1362 microversion: 2.26 time: 0.766629 Jul 26 14:15:13.175434 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1269/2403] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:12 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1362 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:13.273090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-291f7261-84e8-466c-b3de-135ee298fa33 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:13.279339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-291f7261-84e8-466c-b3de-135ee298fa33 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:13.302906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-291f7261-84e8-466c-b3de-135ee298fa33 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:13.303654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-291f7261-84e8-466c-b3de-135ee298fa33 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:13.305088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-291f7261-84e8-466c-b3de-135ee298fa33 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:13.311685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-291f7261-84e8-466c-b3de-135ee298fa33 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:14.722097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-291f7261-84e8-466c-b3de-135ee298fa33 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:14.740279 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-291f7261-84e8-466c-b3de-135ee298fa33 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 1.471094 Jul 26 14:15:14.741798 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1270/2404] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:13 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:14.750382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63bf2b0f-c865-4832-94b4-1c9c1913fcc7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:14.751339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63bf2b0f-c865-4832-94b4-1c9c1913fcc7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:14.768657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63bf2b0f-c865-4832-94b4-1c9c1913fcc7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:14.783846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63bf2b0f-c865-4832-94b4-1c9c1913fcc7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:14.785024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63bf2b0f-c865-4832-94b4-1c9c1913fcc7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:14.785620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63bf2b0f-c865-4832-94b4-1c9c1913fcc7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:15.766287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63bf2b0f-c865-4832-94b4-1c9c1913fcc7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:15.789928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63bf2b0f-c865-4832-94b4-1c9c1913fcc7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:15.792182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63bf2b0f-c865-4832-94b4-1c9c1913fcc7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:15.798052 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63bf2b0f-c865-4832-94b4-1c9c1913fcc7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1362 microversion: 2.26 time: 1.054530 Jul 26 14:15:15.803865 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1271/2405] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:14 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1362 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:15.813880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a6464dda-1ede-439b-9301-5e072ab5a651 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:15.824948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a6464dda-1ede-439b-9301-5e072ab5a651 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:15.855437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6464dda-1ede-439b-9301-5e072ab5a651 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:15.856203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6464dda-1ede-439b-9301-5e072ab5a651 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:15.860953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6464dda-1ede-439b-9301-5e072ab5a651 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:15.863003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6464dda-1ede-439b-9301-5e072ab5a651 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:16.248683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:16.334096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=12 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:16.510044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a6464dda-1ede-439b-9301-5e072ab5a651 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:16.525973 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a6464dda-1ede-439b-9301-5e072ab5a651 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.720729 Jul 26 14:15:16.546186 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1272/2406] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:15 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:16.552734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-781a70bd-f34b-487c-acc9-1ea46aefc2b9 req-37ce4881-fc91-4416-9539-e7d4493c2631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9", "name": "network-vif-plugged", "status": "completed", "tag": "024d383e-7ce7-49cd-a002-2e9f6a98e46a"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:16.569580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:16.577040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-781a70bd-f34b-487c-acc9-1ea46aefc2b9 req-37ce4881-fc91-4416-9539-e7d4493c2631 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:16.578593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-781a70bd-f34b-487c-acc9-1ea46aefc2b9 req-37ce4881-fc91-4416-9539-e7d4493c2631 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:16.618839 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-781a70bd-f34b-487c-acc9-1ea46aefc2b9 req-37ce4881-fc91-4416-9539-e7d4493c2631 service nova] Creating event network-vif-plugged:024d383e-7ce7-49cd-a002-2e9f6a98e46a for instance 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 on n-h1-833090-9 Jul 26 14:15:16.648808 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-781a70bd-f34b-487c-acc9-1ea46aefc2b9 req-37ce4881-fc91-4416-9539-e7d4493c2631 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099530 Jul 26 14:15:16.650018 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1273/2407] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:16.832484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d731613a-a845-41d0-88c7-cd39d546869d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:16.833908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d731613a-a845-41d0-88c7-cd39d546869d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:16.867490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d731613a-a845-41d0-88c7-cd39d546869d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:16.871399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d731613a-a845-41d0-88c7-cd39d546869d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:16.876984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d731613a-a845-41d0-88c7-cd39d546869d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:16.879408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d731613a-a845-41d0-88c7-cd39d546869d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:17.648097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d731613a-a845-41d0-88c7-cd39d546869d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:17.660872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d731613a-a845-41d0-88c7-cd39d546869d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:17.665814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d731613a-a845-41d0-88c7-cd39d546869d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:17.667607 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d731613a-a845-41d0-88c7-cd39d546869d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1362 microversion: 2.26 time: 0.843660 Jul 26 14:15:17.678984 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1274/2408] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:16 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1362 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:17.697849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c05edaff-b73a-4fad-9718-c235dbd35cd6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:17.699189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c05edaff-b73a-4fad-9718-c235dbd35cd6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:17.736886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c05edaff-b73a-4fad-9718-c235dbd35cd6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:17.755543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c05edaff-b73a-4fad-9718-c235dbd35cd6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:17.757038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c05edaff-b73a-4fad-9718-c235dbd35cd6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:17.757516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c05edaff-b73a-4fad-9718-c235dbd35cd6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:18.218006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c05edaff-b73a-4fad-9718-c235dbd35cd6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:18.261384 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c05edaff-b73a-4fad-9718-c235dbd35cd6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.564279 Jul 26 14:15:18.263120 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1275/2409] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:17 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:18.699816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c4cd2f3c-8f27-4c31-91a2-c91f24351176 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:18.703795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c4cd2f3c-8f27-4c31-91a2-c91f24351176 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:18.725003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4cd2f3c-8f27-4c31-91a2-c91f24351176 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:18.730533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4cd2f3c-8f27-4c31-91a2-c91f24351176 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:18.734160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4cd2f3c-8f27-4c31-91a2-c91f24351176 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:18.737657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4cd2f3c-8f27-4c31-91a2-c91f24351176 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:19.114876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c4cd2f3c-8f27-4c31-91a2-c91f24351176 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:19.131367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c4cd2f3c-8f27-4c31-91a2-c91f24351176 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:19.135737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c4cd2f3c-8f27-4c31-91a2-c91f24351176 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:19.141827 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c4cd2f3c-8f27-4c31-91a2-c91f24351176 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1546 microversion: 2.26 time: 0.443542 Jul 26 14:15:19.157696 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1276/2410] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:18 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1546 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:15:19.176121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87993bab80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:19.201614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:19.202577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:19.207848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:19.218844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:19.220202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:19.221222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:19.221881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:19.283699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:19.284575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:19.304897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:19.306049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:19.364614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:19.413960 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-44c1b828-9dc7-4d2f-8d5a-d5ab4ec42975 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-1451254399" status: 201 len: 0 microversion: 2.26 time: 0.248536 Jul 26 14:15:19.422542 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1277/2411] 10.222.0.70 () {62 vars in 1380 bytes} [Tue Jul 26 14:15:19 2022] PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-1451254399 => generated 0 bytes in 257 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 26 14:15:19.434771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a4c616c2-e5ea-4c56-9e7a-ae86a39eb71b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:19.440810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a4c616c2-e5ea-4c56-9e7a-ae86a39eb71b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:19.455086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4c616c2-e5ea-4c56-9e7a-ae86a39eb71b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:19.459224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4c616c2-e5ea-4c56-9e7a-ae86a39eb71b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:19.460424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4c616c2-e5ea-4c56-9e7a-ae86a39eb71b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:19.461099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4c616c2-e5ea-4c56-9e7a-ae86a39eb71b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:19.907935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a4c616c2-e5ea-4c56-9e7a-ae86a39eb71b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:19.918638 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a4c616c2-e5ea-4c56-9e7a-ae86a39eb71b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.494341 Jul 26 14:15:19.930998 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1278/2412] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:19 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:19.954528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a2790f52-cf67-4d66-a44b-d014f390faa4 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87993dab80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:19.979910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a2790f52-cf67-4d66-a44b-d014f390faa4 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:19.982472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a2790f52-cf67-4d66-a44b-d014f390faa4 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.019468 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a2790f52-cf67-4d66-a44b-d014f390faa4 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-1451254399" status: 204 len: 0 microversion: 2.26 time: 0.083122 Jul 26 14:15:20.025782 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1279/2413] 10.222.0.70 () {60 vars in 1361 bytes} [Tue Jul 26 14:15:19 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-1451254399 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:15:20.037888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f879938f4c0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:20.055546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.059263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.063252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:20.100167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.100875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.101797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.102261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.163462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.163923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.207418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:20.296321 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2abf2baf-3518-40b0-8034-982fbe18a5c9 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 204 len: 0 microversion: 2.26 time: 0.264005 Jul 26 14:15:20.305814 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1280/2414] 10.222.0.70 () {60 vars in 1295 bytes} [Tue Jul 26 14:15:20 2022] DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:15:20.335380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b293fe57-171c-4ffc-bbce-5fd082ba64b2 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87993d45e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:20.388362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b293fe57-171c-4ffc-bbce-5fd082ba64b2 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.395099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b293fe57-171c-4ffc-bbce-5fd082ba64b2 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.459449 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b293fe57-171c-4ffc-bbce-5fd082ba64b2 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 200 len: 12 microversion: 2.26 time: 0.145592 Jul 26 14:15:20.463069 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1281/2415] 10.222.0.70 () {60 vars in 1292 bytes} [Tue Jul 26 14:15:20 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 12 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:20.485234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f879937b550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:20.533291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.533751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.534240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:20.572608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.573246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.574111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.574565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.680560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.680953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.694189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.694781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.700073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:20.767620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:20.800207 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d04cfbb0-565b-41bc-ab9a-e1173ab29c16 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-1811630052" status: 201 len: 0 microversion: 2.26 time: 0.318884 Jul 26 14:15:20.802698 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1282/2416] 10.222.0.70 () {62 vars in 1380 bytes} [Tue Jul 26 14:15:20 2022] PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-1811630052 => generated 0 bytes in 333 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 26 14:15:20.822338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9c618c97-98dd-497c-9661-4e1b31164311 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87948f6940>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:20.843282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c618c97-98dd-497c-9661-4e1b31164311 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.844972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c618c97-98dd-497c-9661-4e1b31164311 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.867809 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9c618c97-98dd-497c-9661-4e1b31164311 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 200 len: 36 microversion: 2.26 time: 0.059024 Jul 26 14:15:20.869791 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1283/2417] 10.222.0.70 () {60 vars in 1292 bytes} [Tue Jul 26 14:15:20 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 36 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:20.881260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87993afee0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:20.906895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.907098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.907531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:20.929845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.930315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:20.931121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:20.931572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:21.037870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:21.038340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:21.118708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:21.171362 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-28c64410-8643-46eb-9f41-3c0126d74750 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-1811630052" status: 204 len: 0 microversion: 2.26 time: 0.294524 Jul 26 14:15:21.175417 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1284/2418] 10.222.0.70 () {60 vars in 1364 bytes} [Tue Jul 26 14:15:20 2022] DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-1811630052 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 14:15:21.186238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76e52321-a611-4763-b793-ab0399a4c56e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:21.186987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-76e52321-a611-4763-b793-ab0399a4c56e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:21.199528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76e52321-a611-4763-b793-ab0399a4c56e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:21.200627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76e52321-a611-4763-b793-ab0399a4c56e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:21.205372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76e52321-a611-4763-b793-ab0399a4c56e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:21.205851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76e52321-a611-4763-b793-ab0399a4c56e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.050458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-76e52321-a611-4763-b793-ab0399a4c56e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:22.061315 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76e52321-a611-4763-b793-ab0399a4c56e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.884593 Jul 26 14:15:22.064143 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1285/2419] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:21 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:22.089143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76a84cc6-7b75-4af9-b1af-e6f34df5502e tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f8799350e50>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:22.110206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76a84cc6-7b75-4af9-b1af-e6f34df5502e tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:22.125340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76a84cc6-7b75-4af9-b1af-e6f34df5502e tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.171150 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76a84cc6-7b75-4af9-b1af-e6f34df5502e tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 200 len: 12 microversion: 2.26 time: 0.100220 Jul 26 14:15:22.187211 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1286/2420] 10.222.0.70 () {60 vars in 1292 bytes} [Tue Jul 26 14:15:22 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 12 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:22.205584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87993afca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:22.257442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:22.265977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.267836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:22.294410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:22.312086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.313232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:22.316485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.426739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:22.429882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.469619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:22.546713 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c679ebdb-79fa-4da9-a9a1-f3aaa3a8e04b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 204 len: 0 microversion: 2.26 time: 0.354905 Jul 26 14:15:22.550808 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1287/2421] 10.222.0.70 () {60 vars in 1295 bytes} [Tue Jul 26 14:15:22 2022] DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:15:22.578905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87993993a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:22.622962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:22.632538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.633428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:22.645967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:22.648652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.649789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:22.652943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.798121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:22.800395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.849936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:22.850498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:22.954912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:23.061047 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db26982d-968c-4651-887f-cea6d24d9184 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-1452540435" status: 201 len: 0 microversion: 2.26 time: 0.500828 Jul 26 14:15:23.062682 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1288/2422] 10.222.0.70 () {62 vars in 1380 bytes} [Tue Jul 26 14:15:22 2022] PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-1452540435 => generated 0 bytes in 505 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 26 14:15:23.095074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87993eab80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:23.126757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:23.141917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:23.146679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:23.190596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:23.198309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:23.199937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:23.201262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:23.317393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:23.318150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:23.332767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:23.334055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:23.411320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:23.472222 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5f9022b6-4c1d-49b7-b712-f89f393d5584 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-818938878" status: 201 len: 0 microversion: 2.26 time: 0.388347 Jul 26 14:15:23.474003 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1289/2423] 10.222.0.70 () {62 vars in 1377 bytes} [Tue Jul 26 14:15:23 2022] PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-818938878 => generated 0 bytes in 397 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Jul 26 14:15:23.489213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2cbb0308-1fb9-42cb-abde-832fd92e612a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:23.490165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2cbb0308-1fb9-42cb-abde-832fd92e612a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:23.522542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cbb0308-1fb9-42cb-abde-832fd92e612a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:23.526444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cbb0308-1fb9-42cb-abde-832fd92e612a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:23.527806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cbb0308-1fb9-42cb-abde-832fd92e612a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:23.530957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cbb0308-1fb9-42cb-abde-832fd92e612a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:23.926273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2cbb0308-1fb9-42cb-abde-832fd92e612a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:23.940064 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2cbb0308-1fb9-42cb-abde-832fd92e612a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.464560 Jul 26 14:15:23.946466 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1290/2424] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:23 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:23.993819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f8799345790>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:24.041206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.046936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.055477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:24.089665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.090362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.097203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.099390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.205591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.206059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.252720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:24.298342 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-60ffcf4a-87c5-4fae-ad1b-d6ef74d57ef7 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 204 len: 0 microversion: 2.26 time: 0.330120 Jul 26 14:15:24.300804 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1291/2425] 10.222.0.70 () {60 vars in 1295 bytes} [Tue Jul 26 14:15:23 2022] DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:15:24.312992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-419d59a7-104e-43de-8d21-3ac4f37e8ff1 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f8787d7a1f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:24.337560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-419d59a7-104e-43de-8d21-3ac4f37e8ff1 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.341109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-419d59a7-104e-43de-8d21-3ac4f37e8ff1 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.369488 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-419d59a7-104e-43de-8d21-3ac4f37e8ff1 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 200 len: 12 microversion: 2.26 time: 0.061338 Jul 26 14:15:24.376344 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1292/2426] 10.222.0.70 () {60 vars in 1292 bytes} [Tue Jul 26 14:15:24 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 12 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:24.386595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87993459d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:24.425327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.427088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.428958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:24.443824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.447463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.448677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.449412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.515994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.516750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.534919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:SELECT=87,nova_cell1:DELETE=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:24.563178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:24.630292 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f1101ab7-f549-4f8d-8b43-9ffece4505f5 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 204 len: 0 microversion: 2.26 time: 0.248228 Jul 26 14:15:24.631243 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1293/2427] 10.222.0.70 () {60 vars in 1295 bytes} [Tue Jul 26 14:15:24 2022] DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 14:15:24.647343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87993af4c0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:24.689207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.692791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.698008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:24.718763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.719224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.720045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.728407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.858897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.868784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:24.945107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:24.945579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.025521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:25.049111 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ee55a521-e6e4-4881-bac9-16b10dd22eba tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-344777873" status: 201 len: 0 microversion: 2.26 time: 0.412414 Jul 26 14:15:25.050094 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1294/2428] 10.222.0.70 () {62 vars in 1377 bytes} [Tue Jul 26 14:15:24 2022] PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-344777873 => generated 0 bytes in 414 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 26 14:15:25.057559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b37fb512-ca18-406f-8097-d4d9448d69b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:25.058249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b37fb512-ca18-406f-8097-d4d9448d69b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:25.072323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b37fb512-ca18-406f-8097-d4d9448d69b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.072780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b37fb512-ca18-406f-8097-d4d9448d69b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.073756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b37fb512-ca18-406f-8097-d4d9448d69b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.075170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b37fb512-ca18-406f-8097-d4d9448d69b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.417710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b37fb512-ca18-406f-8097-d4d9448d69b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:25.427242 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b37fb512-ca18-406f-8097-d4d9448d69b1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.376009 Jul 26 14:15:25.449505 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1295/2429] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:25 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:25.460941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f8799350550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:25.486825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.491805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.498731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:25.512955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.516982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.518541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.519217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.605745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.607304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.632244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.635150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.692837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:25.730196 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d74b3dc9-ed00-4351-950e-4593f7cded4a tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-350492016" status: 201 len: 0 microversion: 2.26 time: 0.277744 Jul 26 14:15:25.735611 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1296/2430] 10.222.0.70 () {62 vars in 1377 bytes} [Tue Jul 26 14:15:25 2022] PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags/tempest-tag-350492016 => generated 0 bytes in 284 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 26 14:15:25.748200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Action: 'update_all', calling method: .version_select at 0x7f87993aa670>, body: {"tags": ["tempest-tag-2092212450", "tempest-tag-536021034"]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:25.769684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.771457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.772556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:25.785194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.787968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.789191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.789863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.883120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:25.883567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:25.993310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:26.056986 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2c8b60d9-8787-4c9f-8f6b-4d465a2b7bcd tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 200 len: 61 microversion: 2.26 time: 0.308374 Jul 26 14:15:26.057884 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1297/2431] 10.222.0.70 () {62 vars in 1312 bytes} [Tue Jul 26 14:15:25 2022] PUT /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 61 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:15:26.069447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6e90edc6-91a5-491e-b615-0485c500444d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f87948f6940>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:26.094426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e90edc6-91a5-491e-b615-0485c500444d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:26.094868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e90edc6-91a5-491e-b615-0485c500444d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:26.134078 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6e90edc6-91a5-491e-b615-0485c500444d tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 200 len: 61 microversion: 2.26 time: 0.068541 Jul 26 14:15:26.140813 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1298/2432] 10.222.0.70 () {60 vars in 1292 bytes} [Tue Jul 26 14:15:26 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 61 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:26.150427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '.version_select at 0x7f8799310550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:26.177280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:26.177737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:26.178240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:26.207678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:26.208380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:26.212663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:26.214438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:26.301830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:26.302292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:26.376752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'flavor' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:26.471716 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3b160cde-62de-4417-8fbe-fe50a2de247f tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags" status: 204 len: 0 microversion: 2.26 time: 0.325250 Jul 26 14:15:26.473616 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1299/2433] 10.222.0.70 () {60 vars in 1295 bytes} [Tue Jul 26 14:15:26 2022] DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9/tags => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 14:15:26.484141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aa13e4ad-3e02-4169-be4e-6de4416dc57b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:26.499025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aa13e4ad-3e02-4169-be4e-6de4416dc57b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:26.526060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa13e4ad-3e02-4169-be4e-6de4416dc57b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:26.527122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa13e4ad-3e02-4169-be4e-6de4416dc57b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:26.528930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa13e4ad-3e02-4169-be4e-6de4416dc57b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:26.529540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa13e4ad-3e02-4169-be4e-6de4416dc57b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:27.129866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa13e4ad-3e02-4169-be4e-6de4416dc57b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:27.149762 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aa13e4ad-3e02-4169-be4e-6de4416dc57b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.671908 Jul 26 14:15:27.166351 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1300/2434] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:26 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:27.193557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d28b6a3d-75e0-42ef-949c-a4036d80884b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:27.194082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d28b6a3d-75e0-42ef-949c-a4036d80884b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:27.246390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28b6a3d-75e0-42ef-949c-a4036d80884b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:27.247662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28b6a3d-75e0-42ef-949c-a4036d80884b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:27.273730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28b6a3d-75e0-42ef-949c-a4036d80884b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:27.274187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28b6a3d-75e0-42ef-949c-a4036d80884b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:27.325399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d28b6a3d-75e0-42ef-949c-a4036d80884b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:15:27.530568 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d28b6a3d-75e0-42ef-949c-a4036d80884b tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 204 len: 0 microversion: 2.26 time: 0.362698 Jul 26 14:15:27.535313 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1301/2435] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:15:27 2022] DELETE /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:15:27.544282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ecea9d16-a008-4129-8ef8-e337f14cfd22 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:27.552504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ecea9d16-a008-4129-8ef8-e337f14cfd22 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:27.579039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ecea9d16-a008-4129-8ef8-e337f14cfd22 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:27.579892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ecea9d16-a008-4129-8ef8-e337f14cfd22 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:27.581150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ecea9d16-a008-4129-8ef8-e337f14cfd22 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:27.586626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ecea9d16-a008-4129-8ef8-e337f14cfd22 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:28.590845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ecea9d16-a008-4129-8ef8-e337f14cfd22 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:28.599980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ecea9d16-a008-4129-8ef8-e337f14cfd22 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:28.601536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ecea9d16-a008-4129-8ef8-e337f14cfd22 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:28.615501 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ecea9d16-a008-4129-8ef8-e337f14cfd22 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1552 microversion: 2.26 time: 1.078606 Jul 26 14:15:28.624003 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1302/2436] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:27 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1552 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:28.635677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8d3fb971-805f-4a08-93cb-7528dd143a43 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:28.636336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8d3fb971-805f-4a08-93cb-7528dd143a43 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:28.670163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d3fb971-805f-4a08-93cb-7528dd143a43 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:28.670618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d3fb971-805f-4a08-93cb-7528dd143a43 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:28.681993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d3fb971-805f-4a08-93cb-7528dd143a43 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:28.689666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d3fb971-805f-4a08-93cb-7528dd143a43 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:29.194446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8d3fb971-805f-4a08-93cb-7528dd143a43 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:29.198068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:29.223977 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8d3fb971-805f-4a08-93cb-7528dd143a43 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.592163 Jul 26 14:15:29.225516 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1303/2437] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:28 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:29.257543 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-091d00cc-1c6b-4f0b-a4f8-b3fc3201a101 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 200 len: 1421 microversion: 2.1 time: 22.538276 Jul 26 14:15:29.266836 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1135/2438] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:15:06 2022] GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 1421 bytes in 22543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:29.272879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-afb6ee27-f7bb-49d0-9ae2-859542ff3b7b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f879938ff70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:29.399530 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-afb6ee27-f7bb-49d0-9ae2-859542ff3b7b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 200 len: 1421 microversion: 2.1 time: 0.131441 Jul 26 14:15:29.400155 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1304/2439] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:15:29 2022] GET /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 1421 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:29.414208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8e4aeddd-ae28-4ed7-b00b-87de879629c4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799429dc0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:29.647992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1698334f-8357-472f-9cd0-9dc832f68c35 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:29.649366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1698334f-8357-472f-9cd0-9dc832f68c35 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:29.665383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1698334f-8357-472f-9cd0-9dc832f68c35 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:29.669066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1698334f-8357-472f-9cd0-9dc832f68c35 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:29.677018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1698334f-8357-472f-9cd0-9dc832f68c35 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:29.681380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1698334f-8357-472f-9cd0-9dc832f68c35 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:30.893829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1698334f-8357-472f-9cd0-9dc832f68c35 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:30.910367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1698334f-8357-472f-9cd0-9dc832f68c35 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:30.915897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1698334f-8357-472f-9cd0-9dc832f68c35 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:30.919832 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1698334f-8357-472f-9cd0-9dc832f68c35 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1552 microversion: 2.26 time: 1.276929 Jul 26 14:15:30.921366 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1305/2440] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:29 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1552 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:15:30.934969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e68bd78b-16bb-419d-96f2-f3c8021a71be tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:30.942354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e68bd78b-16bb-419d-96f2-f3c8021a71be tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:30.961766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e68bd78b-16bb-419d-96f2-f3c8021a71be tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:30.962509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e68bd78b-16bb-419d-96f2-f3c8021a71be tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:30.964033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e68bd78b-16bb-419d-96f2-f3c8021a71be tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:30.965520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e68bd78b-16bb-419d-96f2-f3c8021a71be tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:31.387042 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8e4aeddd-ae28-4ed7-b00b-87de879629c4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 204 len: 0 microversion: 2.1 time: 1.976554 Jul 26 14:15:31.393641 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1136/2441] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:29 2022] DELETE /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 0 bytes in 1979 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:15:31.404363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4c3de4a8-5aa6-4ffa-8f7d-4aad2f400a17 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:31.404363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4c3de4a8-5aa6-4ffa-8f7d-4aad2f400a17 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:31.468548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c3de4a8-5aa6-4ffa-8f7d-4aad2f400a17 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:31.468548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c3de4a8-5aa6-4ffa-8f7d-4aad2f400a17 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:31.468548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c3de4a8-5aa6-4ffa-8f7d-4aad2f400a17 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:31.468548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c3de4a8-5aa6-4ffa-8f7d-4aad2f400a17 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:31.550692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4c3de4a8-5aa6-4ffa-8f7d-4aad2f400a17 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:15:31.879194 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4c3de4a8-5aa6-4ffa-8f7d-4aad2f400a17 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 204 len: 0 microversion: 2.1 time: 0.484080 Jul 26 14:15:31.879814 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1137/2442] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:15:31 2022] DELETE /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:15:31.880778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e68bd78b-16bb-419d-96f2-f3c8021a71be tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:31.914383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-25e477fb-f071-4c88-90e2-415565dc4095 req-89632261-8f62-4643-9f5e-b52ec3257cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9", "name": "network-vif-deleted", "tag": "024d383e-7ce7-49cd-a002-2e9f6a98e46a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:31.923012 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e68bd78b-16bb-419d-96f2-f3c8021a71be tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.999072 Jul 26 14:15:31.929371 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1306/2443] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:30 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:31.952300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:31.955360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:31.963596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-25e477fb-f071-4c88-90e2-415565dc4095 req-89632261-8f62-4643-9f5e-b52ec3257cd7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:31.964072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-25e477fb-f071-4c88-90e2-415565dc4095 req-89632261-8f62-4643-9f5e-b52ec3257cd7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:31.999315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:32.001034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:32.007409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:32.010314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:32.026447 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-25e477fb-f071-4c88-90e2-415565dc4095 req-89632261-8f62-4643-9f5e-b52ec3257cd7 service nova] Creating event network-vif-deleted:024d383e-7ce7-49cd-a002-2e9f6a98e46a for instance 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 on n-h1-833090-9 Jul 26 14:15:32.048507 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-25e477fb-f071-4c88-90e2-415565dc4095 req-89632261-8f62-4643-9f5e-b52ec3257cd7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154455 Jul 26 14:15:32.049692 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1138/2444] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:32.092716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:32.110565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:32.111515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:32.112547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lazy-loading 'fault' on Instance uuid 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:32.189070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1531528933", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "08dc4566-921c-4f62-8f9a-1a9e3f005bb9"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:32.267499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] validate_networks() for [('08dc4566-921c-4f62-8f9a-1a9e3f005bb9', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:15:32.700232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:32.717913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:32.723103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '535280f0289041f1b483469d057c6aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65f93d79a9694a7d9e7d3172f69eb766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:32.727871 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f928a9bc-ebf3-4302-a61e-637346674f96 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 200 len: 1352 microversion: 2.26 time: 0.782605 Jul 26 14:15:32.729233 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1307/2445] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:31 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 1352 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:15:32.963414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6a6b6fcc-610c-400c-9268-fb67d62b65c1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:32.963414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6a6b6fcc-610c-400c-9268-fb67d62b65c1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:33.001003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a6b6fcc-610c-400c-9268-fb67d62b65c1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:33.003511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a6b6fcc-610c-400c-9268-fb67d62b65c1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:33.004734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a6b6fcc-610c-400c-9268-fb67d62b65c1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:33.006140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a6b6fcc-610c-400c-9268-fb67d62b65c1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:33.610292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6a6b6fcc-610c-400c-9268-fb67d62b65c1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:33.624445 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6a6b6fcc-610c-400c-9268-fb67d62b65c1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1527 microversion: 2.1 time: 0.671382 Jul 26 14:15:33.625587 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1308/2446] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:32 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1527 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:33.757129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-294b2d29-f964-4031-9f12-4618e5a59979 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:33.757921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-294b2d29-f964-4031-9f12-4618e5a59979 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] [instance: 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:33.769084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-294b2d29-f964-4031-9f12-4618e5a59979 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:33.769924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-294b2d29-f964-4031-9f12-4618e5a59979 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:33.771863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-294b2d29-f964-4031-9f12-4618e5a59979 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:33.772580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-294b2d29-f964-4031-9f12-4618e5a59979 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:33.834220 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-294b2d29-f964-4031-9f12-4618e5a59979 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] HTTP exception thrown: Instance 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 could not be found. Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-294b2d29-f964-4031-9f12-4618e5a59979 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Request method failure captured: Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 HTTP/1.1 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_be0bBm-kiFw9vBbV1dV2xRouGRVwVEoRkuZoBuVlo6fGlukZyMeEnYeVD4n1feTnsLeIWcvfDCV_pN2h3RT7k8epJJtQib7kuPUd6E241CaDWaXw5Td6yt_5wXNSPIWQdwbYGRmuPP5zzU058Ypv2TH9ogrbXk60XM7-GOu6O_3dU Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.26 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 65f93d79a9694a7d9e7d3172f69eb766 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerTagsTestJSON-576891929 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/65f93d79a9694a7d9e7d3172f69eb766"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/65f93d79a9694a7d9e7d3172f69eb766"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_65f93d79a9694a7d9e7d3172f69eb766", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/65f93d79a9694a7d9e7d3172f69eb766"}]}] Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerTagsTestJSON-576891929 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 65f93d79a9694a7d9e7d3172f69eb766 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerTagsTestJSON-576891929 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerTagsTestJSON-576891929-project Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 535280f0289041f1b483469d057c6aa2 Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerTagsTestJSON-576891929-project Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 could not be found. Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9'} Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 could not be found. Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 could not be found. Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:33.837434 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:15:33.842621 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:33.842621 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:33.842621 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:33.842621 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:15:33.842621 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:15:33.842621 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 could not be found. Jul 26 14:15:33.842621 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:15:33.846669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-294b2d29-f964-4031-9f12-4618e5a59979 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] Returning 404 to user: Instance 61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:15:33.851531 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-294b2d29-f964-4031-9f12-4618e5a59979 tempest-ServerTagsTestJSON-576891929 tempest-ServerTagsTestJSON-576891929-project] 10.222.0.70 "GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9" status: 404 len: 111 microversion: 2.26 time: 0.097204 Jul 26 14:15:33.853429 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1309/2447] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:15:33 2022] GET /compute/v2.1/servers/61fa4b24-fbbe-4ec0-aa77-67b35fc4a3a9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 14:15:34.487278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:15:34.488390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:15:34.489096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:15:34.489701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:15:34.490397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:15:34.506107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9b199b0a-3b84-480f-ba26-28cce4e7d1b9 req-49d2983b-62b7-4d37-963b-f7cb497a1801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f930a87-b048-44cc-86eb-7db98aaaff65", "name": "network-vif-unplugged", "status": "completed", "tag": "bc51517b-e7e7-4587-a668-10a85cc83812"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:34.525580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:34.526740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:34.528849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:34.529427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:34.538918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9b199b0a-3b84-480f-ba26-28cce4e7d1b9 req-49d2983b-62b7-4d37-963b-f7cb497a1801 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:34.540541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9b199b0a-3b84-480f-ba26-28cce4e7d1b9 req-49d2983b-62b7-4d37-963b-f7cb497a1801 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:34.562313 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9b199b0a-3b84-480f-ba26-28cce4e7d1b9 req-49d2983b-62b7-4d37-963b-f7cb497a1801 service nova] Creating event network-vif-unplugged:bc51517b-e7e7-4587-a668-10a85cc83812 for instance 2f930a87-b048-44cc-86eb-7db98aaaff65 on n-h2-833090-9 Jul 26 14:15:34.571986 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9b199b0a-3b84-480f-ba26-28cce4e7d1b9 req-49d2983b-62b7-4d37-963b-f7cb497a1801 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072854 Jul 26 14:15:34.573465 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1310/2448] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:34.594614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Getting quotas for project af3d0a242a34482d8737db7862279e87. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:15:34.601331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Getting quotas for user f94de8d57f854570b3ceda6ae5e7b9ae and project af3d0a242a34482d8737db7862279e87. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:15:34.628466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:15:34.631805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:15:34.651712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a7ffaba6-aeb1-4109-a58f-03a77c005555 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:34.654520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a7ffaba6-aeb1-4109-a58f-03a77c005555 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:34.680377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7ffaba6-aeb1-4109-a58f-03a77c005555 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:34.681983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7ffaba6-aeb1-4109-a58f-03a77c005555 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:34.683091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7ffaba6-aeb1-4109-a58f-03a77c005555 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:34.684939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7ffaba6-aeb1-4109-a58f-03a77c005555 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:34.698398 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2ebf99c4-529e-43f6-ae92-5a6cdc708c7a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514427 Jul 26 14:15:34.700156 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1139/2449] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:15:34.711777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fb78fc86-4781-4c69-95b7-6da6ad7365c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:34.712563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fb78fc86-4781-4c69-95b7-6da6ad7365c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:35.492259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb78fc86-4781-4c69-95b7-6da6ad7365c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:35.503801 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fb78fc86-4781-4c69-95b7-6da6ad7365c1 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 200 len: 1208 microversion: 2.1 time: 0.796317 Jul 26 14:15:35.518356 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1140/2450] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:34 2022] GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 1208 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:35.789362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-afd957b9-d5d3-430a-b8eb-7b71aef91faf tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "934f0df4-212b-4f84-b9f6-0f43c0594ca3"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:35.792306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-afd957b9-d5d3-430a-b8eb-7b71aef91faf tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:35.800958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afd957b9-d5d3-430a-b8eb-7b71aef91faf tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:35.801653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afd957b9-d5d3-430a-b8eb-7b71aef91faf tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:35.802609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afd957b9-d5d3-430a-b8eb-7b71aef91faf tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:35.803201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afd957b9-d5d3-430a-b8eb-7b71aef91faf tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:35.874585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a7ffaba6-aeb1-4109-a58f-03a77c005555 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:35.890293 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a7ffaba6-aeb1-4109-a58f-03a77c005555 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1509 microversion: 2.1 time: 1.242962 Jul 26 14:15:35.890875 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1311/2451] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:34 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1509 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:36.055688 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-afd957b9-d5d3-430a-b8eb-7b71aef91faf tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] HTTP exception thrown: Volume 934f0df4-212b-4f84-b9f6-0f43c0594ca3 could not be found. Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-afd957b9-d5d3-430a-b8eb-7b71aef91faf tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Request method failure captured: Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: request: PUT /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments/3d745197-b03c-4d3d-b4b2-311b6a4c097f HTTP/1.1 Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 74 Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_aSfH29kWSjDEJY_Sc-KPSpMOoFxyMGFinHizg2l-TzBJpGy44zrd0_L7M1UcpnO9_2pvoD2Z6Byh62ALWUTVfmETCSo21rJf9gCyqUcbr69Afd-7qWZy9Klh4gIAx8qgJbugy7HdrVws30rt7s9OG8IQbOnYUKHMPdoQ8o0HrNu_I Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 909370538d8849cfa87645a6df9434e9 Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-VolumesAdminNegativeTest-82692021 Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/909370538d8849cfa87645a6df9434e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/909370538d8849cfa87645a6df9434e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_909370538d8849cfa87645a6df9434e9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/909370538d8849cfa87645a6df9434e9"}]}] Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-VolumesAdminNegativeTest-82692021 Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 909370538d8849cfa87645a6df9434e9 Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-82692021 Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-VolumesAdminNegativeTest-82692021-project-admin Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: baa52af6bb1a4e2883ced99ff3e156f0 Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-VolumesAdminNegativeTest-82692021-project-admin Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: {"volumeAttachment": {"volumeId": "934f0df4-212b-4f84-b9f6-0f43c0594ca3"}} Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: exception: Volume 934f0df4-212b-4f84-b9f6-0f43c0594ca3 could not be found. Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': '1e90299d-2a73-4c84-95bc-a08fa220c671', 'id': '3d745197-b03c-4d3d-b4b2-311b6a4c097f', 'body': {'volumeAttachment': {'volumeId': '934f0df4-212b-4f84-b9f6-0f43c0594ca3'}}} Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 934f0df4-212b-4f84-b9f6-0f43c0594ca3 could not be found. (HTTP 404) (Request-ID: req-db9c31f7-a523-4200-af25-64f142efcae2) Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:15:36.107375 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 934f0df4-212b-4f84-b9f6-0f43c0594ca3 could not be found. Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 934f0df4-212b-4f84-b9f6-0f43c0594ca3 could not be found. Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 934f0df4-212b-4f84-b9f6-0f43c0594ca3 could not be found. Jul 26 14:15:36.111726 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:36.119269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-afd957b9-d5d3-430a-b8eb-7b71aef91faf tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Returning 400 to user: Volume 934f0df4-212b-4f84-b9f6-0f43c0594ca3 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:15:36.120220 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-afd957b9-d5d3-430a-b8eb-7b71aef91faf tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] 10.222.0.70 "PUT /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments/3d745197-b03c-4d3d-b4b2-311b6a4c097f" status: 400 len: 107 microversion: 2.1 time: 0.613625 Jul 26 14:15:36.120885 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1141/2452] 10.222.0.70 () {60 vars in 1433 bytes} [Tue Jul 26 14:15:35 2022] PUT /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments/3d745197-b03c-4d3d-b4b2-311b6a4c097f => generated 107 bytes in 615 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:15:36.236233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0b68969-7dfa-4fd9-9ef1-2520341617c9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:36.237015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d0b68969-7dfa-4fd9-9ef1-2520341617c9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:36.245328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0b68969-7dfa-4fd9-9ef1-2520341617c9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:36.246817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0b68969-7dfa-4fd9-9ef1-2520341617c9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:36.247695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0b68969-7dfa-4fd9-9ef1-2520341617c9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:36.248337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0b68969-7dfa-4fd9-9ef1-2520341617c9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:36.462413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-d0b68969-7dfa-4fd9-9ef1-2520341617c9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lazy-loading 'services' on Instance uuid 1e90299d-2a73-4c84-95bc-a08fa220c671 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:36.526540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b88b6340-75ea-490b-9f8f-47282304f413 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:36.527427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b88b6340-75ea-490b-9f8f-47282304f413 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:36.553368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b88b6340-75ea-490b-9f8f-47282304f413 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:36.559686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b88b6340-75ea-490b-9f8f-47282304f413 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:36.566018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b88b6340-75ea-490b-9f8f-47282304f413 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:36.569697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b88b6340-75ea-490b-9f8f-47282304f413 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:36.800408 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d0b68969-7dfa-4fd9-9ef1-2520341617c9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments/3d745197-b03c-4d3d-b4b2-311b6a4c097f" status: 202 len: 0 microversion: 2.1 time: 0.567782 Jul 26 14:15:36.801500 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1312/2453] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:15:36 2022] DELETE /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments/3d745197-b03c-4d3d-b4b2-311b6a4c097f => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:15:36.814370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ea4a8bdd-f24e-494c-9370-9d85c96c83e1 req-ec1d840a-f21b-4cf0-9344-c3d93e72ef09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f930a87-b048-44cc-86eb-7db98aaaff65", "name": "network-vif-deleted", "tag": "bc51517b-e7e7-4587-a668-10a85cc83812"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:36.833712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ea4a8bdd-f24e-494c-9370-9d85c96c83e1 req-ec1d840a-f21b-4cf0-9344-c3d93e72ef09 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:36.835531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ea4a8bdd-f24e-494c-9370-9d85c96c83e1 req-ec1d840a-f21b-4cf0-9344-c3d93e72ef09 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:36.860376 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ea4a8bdd-f24e-494c-9370-9d85c96c83e1 req-ec1d840a-f21b-4cf0-9344-c3d93e72ef09 service nova] Creating event network-vif-deleted:bc51517b-e7e7-4587-a668-10a85cc83812 for instance 2f930a87-b048-44cc-86eb-7db98aaaff65 on n-h2-833090-9 Jul 26 14:15:36.879706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b88b6340-75ea-490b-9f8f-47282304f413 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:36.891649 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ea4a8bdd-f24e-494c-9370-9d85c96c83e1 req-ec1d840a-f21b-4cf0-9344-c3d93e72ef09 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067874 Jul 26 14:15:36.901220 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1313/2454] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:36.901785 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b88b6340-75ea-490b-9f8f-47282304f413 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 200 len: 1268 microversion: 2.1 time: 0.372620 Jul 26 14:15:36.927129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dadec70e-cad2-4b7c-af17-640e1fabee9f tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:36.930054 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1142/2455] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:36 2022] GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 1268 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:15:36.940134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dadec70e-cad2-4b7c-af17-640e1fabee9f tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:36.941782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-18beaf9c-cef8-41cb-8280-27441e35e76e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:36.942668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-18beaf9c-cef8-41cb-8280-27441e35e76e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:36.951493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18beaf9c-cef8-41cb-8280-27441e35e76e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:36.952451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18beaf9c-cef8-41cb-8280-27441e35e76e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:36.954428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18beaf9c-cef8-41cb-8280-27441e35e76e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:36.955534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18beaf9c-cef8-41cb-8280-27441e35e76e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:36.980885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dadec70e-cad2-4b7c-af17-640e1fabee9f tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:36.981353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dadec70e-cad2-4b7c-af17-640e1fabee9f tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:36.982160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dadec70e-cad2-4b7c-af17-640e1fabee9f tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:36.991787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dadec70e-cad2-4b7c-af17-640e1fabee9f tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:37.083444 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dadec70e-cad2-4b7c-af17-640e1fabee9f tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179312 Jul 26 14:15:37.092365 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1314/2456] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:15:36 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:37.494872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1641042481", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "07889a08-85b2-40b9-923c-1a167cfebc11"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:37.601105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-18beaf9c-cef8-41cb-8280-27441e35e76e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:37.631288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] validate_networks() for [('07889a08-85b2-40b9-923c-1a167cfebc11', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:15:37.664469 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-18beaf9c-cef8-41cb-8280-27441e35e76e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1509 microversion: 2.1 time: 0.728174 Jul 26 14:15:37.665689 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1143/2457] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:36 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1509 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:37.947079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de307d07-f751-4347-9c87-9809223cd35a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:37.952903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-de307d07-f751-4347-9c87-9809223cd35a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:37.988379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de307d07-f751-4347-9c87-9809223cd35a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:37.990210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de307d07-f751-4347-9c87-9809223cd35a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:38.004175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de307d07-f751-4347-9c87-9809223cd35a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:38.008428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de307d07-f751-4347-9c87-9809223cd35a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:38.490143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-de307d07-f751-4347-9c87-9809223cd35a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:38.502343 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-de307d07-f751-4347-9c87-9809223cd35a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 200 len: 1278 microversion: 2.1 time: 0.564706 Jul 26 14:15:38.519141 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1144/2458] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:37 2022] GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 1278 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:15:38.560655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2eb46a65-c763-4770-9252-4a8ffcbc2f89 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:38.569993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2eb46a65-c763-4770-9252-4a8ffcbc2f89 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:38.584446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2eb46a65-c763-4770-9252-4a8ffcbc2f89 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:38.585241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2eb46a65-c763-4770-9252-4a8ffcbc2f89 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:38.586235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2eb46a65-c763-4770-9252-4a8ffcbc2f89 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:38.586833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2eb46a65-c763-4770-9252-4a8ffcbc2f89 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:38.649521 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2eb46a65-c763-4770-9252-4a8ffcbc2f89 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113275 Jul 26 14:15:38.651232 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1145/2459] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:15:38 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:38.658791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-bec7d914-6ccc-43f0-a37a-fb2833229c26 req-b7d449e8-18ed-4824-9fc6-98889a0b843c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b94307-dd41-4f71-b529-c6cbb944c27f", "name": "network-vif-unplugged", "status": "completed", "tag": "5c60dac8-f587-41cf-8357-66980afb2e01"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:38.675655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bec7d914-6ccc-43f0-a37a-fb2833229c26 req-b7d449e8-18ed-4824-9fc6-98889a0b843c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:38.676610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bec7d914-6ccc-43f0-a37a-fb2833229c26 req-b7d449e8-18ed-4824-9fc6-98889a0b843c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:38.705562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.compute.server_external_events [req-bec7d914-6ccc-43f0-a37a-fb2833229c26 req-b7d449e8-18ed-4824-9fc6-98889a0b843c service nova] Unable to find a host for instance e6b94307-dd41-4f71-b529-c6cbb944c27f. Dropping event network-vif-unplugged {{(pid=119478) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 14:15:38.707158 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-bec7d914-6ccc-43f0-a37a-fb2833229c26 req-b7d449e8-18ed-4824-9fc6-98889a0b843c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052957 Jul 26 14:15:38.708309 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1146/2460] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 14:15:38.713730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c379167f-b2a0-4879-a97d-99ee1bbc1219 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:38.716216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c379167f-b2a0-4879-a97d-99ee1bbc1219 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:38.727745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c379167f-b2a0-4879-a97d-99ee1bbc1219 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:38.728556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c379167f-b2a0-4879-a97d-99ee1bbc1219 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:38.732647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c379167f-b2a0-4879-a97d-99ee1bbc1219 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:38.733304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c379167f-b2a0-4879-a97d-99ee1bbc1219 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:41.098474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c379167f-b2a0-4879-a97d-99ee1bbc1219 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:41.112347 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c379167f-b2a0-4879-a97d-99ee1bbc1219 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1452 microversion: 2.1 time: 2.402462 Jul 26 14:15:41.115939 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1147/2461] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:38 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1452 bytes in 2407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:41.150070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d4c09e96-347a-499c-8049-cee15b64c276 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:41.150701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d4c09e96-347a-499c-8049-cee15b64c276 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:41.177414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4c09e96-347a-499c-8049-cee15b64c276 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:41.180275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4c09e96-347a-499c-8049-cee15b64c276 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:41.181275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4c09e96-347a-499c-8049-cee15b64c276 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:41.186889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4c09e96-347a-499c-8049-cee15b64c276 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:41.737887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:15:41.741348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:15:41.745322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:15:41.748958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:15:41.750292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:15:41.778333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:41.779038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:41.780407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:41.783603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:41.828534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Getting quotas for project 1976cab4a83747a68cadf5b4dc2dbef0. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:15:41.841246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Getting quotas for user e35f47eb9e094bdc8d08ea4cf2970d8c and project 1976cab4a83747a68cadf5b4dc2dbef0. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:15:41.862098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:15:41.865231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:15:41.896761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d4c09e96-347a-499c-8049-cee15b64c276 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:41.910498 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d4c09e96-347a-499c-8049-cee15b64c276 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 200 len: 1308 microversion: 2.1 time: 0.777223 Jul 26 14:15:41.911498 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1148/2462] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:41 2022] GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 1308 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:41.925335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1299be6b-3053-4b33-b360-3e8d00b7df52 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:41.932480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1299be6b-3053-4b33-b360-3e8d00b7df52 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:41.947549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1299be6b-3053-4b33-b360-3e8d00b7df52 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:41.948019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1299be6b-3053-4b33-b360-3e8d00b7df52 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:41.949501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1299be6b-3053-4b33-b360-3e8d00b7df52 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:41.950012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1299be6b-3053-4b33-b360-3e8d00b7df52 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:41.972833 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d897996f-5dd4-4ca0-beab-31932ad8874b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.878407 Jul 26 14:15:41.973954 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1315/2463] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:15:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 4881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:15:41.990639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-eadfccd5-16d4-4229-a1ef-84686028ec55 req-d50f0590-0167-47c6-ace3-55e3d65ce2be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c", "tag": "0522387b-5774-45c6-a116-88891b1f1994"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:42.033618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-eadfccd5-16d4-4229-a1ef-84686028ec55 req-d50f0590-0167-47c6-ace3-55e3d65ce2be service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:42.035163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-eadfccd5-16d4-4229-a1ef-84686028ec55 req-d50f0590-0167-47c6-ace3-55e3d65ce2be service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:42.051009 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-eadfccd5-16d4-4229-a1ef-84686028ec55 req-d50f0590-0167-47c6-ace3-55e3d65ce2be service nova] Creating event network-changed:0522387b-5774-45c6-a116-88891b1f1994 for instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c on n-h1-833090-9 Jul 26 14:15:42.057274 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-eadfccd5-16d4-4229-a1ef-84686028ec55 req-d50f0590-0167-47c6-ace3-55e3d65ce2be service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073013 Jul 26 14:15:42.058913 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1316/2464] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:42.068448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ceb90da3-3d22-4dc0-bd8c-0e27db6bf68d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:42.069568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ceb90da3-3d22-4dc0-bd8c-0e27db6bf68d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:42.078101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ceb90da3-3d22-4dc0-bd8c-0e27db6bf68d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:42.078882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ceb90da3-3d22-4dc0-bd8c-0e27db6bf68d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:42.079732 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1299be6b-3053-4b33-b360-3e8d00b7df52 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166904 Jul 26 14:15:42.080214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ceb90da3-3d22-4dc0-bd8c-0e27db6bf68d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:42.080701 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1149/2465] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:15:41 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:42.081257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ceb90da3-3d22-4dc0-bd8c-0e27db6bf68d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:42.099795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-594dd930-dd42-49e4-8fa4-b2bf2abdcb30 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:42.101071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-594dd930-dd42-49e4-8fa4-b2bf2abdcb30 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:42.501207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-594dd930-dd42-49e4-8fa4-b2bf2abdcb30 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:42.528658 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-594dd930-dd42-49e4-8fa4-b2bf2abdcb30 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1211 microversion: 2.1 time: 0.444221 Jul 26 14:15:42.529699 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1150/2466] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:42 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1211 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:42.757124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ceb90da3-3d22-4dc0-bd8c-0e27db6bf68d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:42.770588 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ceb90da3-3d22-4dc0-bd8c-0e27db6bf68d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1452 microversion: 2.1 time: 0.704695 Jul 26 14:15:42.772112 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1317/2467] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:42 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1452 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:42.838711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:42.841865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:42.868489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:42.891483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:42.913880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:42.927336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:42.935287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8235b972-c403-4bca-9f68-5ab60845993e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:42.936343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8235b972-c403-4bca-9f68-5ab60845993e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:42.955596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8235b972-c403-4bca-9f68-5ab60845993e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:42.956629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8235b972-c403-4bca-9f68-5ab60845993e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:42.962489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8235b972-c403-4bca-9f68-5ab60845993e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:42.965921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8235b972-c403-4bca-9f68-5ab60845993e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:43.058640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lazy-loading 'flavor' on Instance uuid e6b94307-dd41-4f71-b529-c6cbb944c27f {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:43.129397 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Cannot 'shelve' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state shelved_offloaded Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action HTTP/1.1 Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 14 Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: {"shelve": {}} Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: exception: Cannot 'shelve' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state shelved_offloaded Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e6b94307-dd41-4f71-b529-c6cbb944c27f', 'body': {'shelve': {}}} Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 26 14:15:43.137677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state shelved_offloaded Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state shelved_offloaded Jul 26 14:15:43.141715 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:15:43.146994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 409 to user: Cannot 'shelve' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state shelved_offloaded {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:15:43.149297 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e2db6ef4-8b9b-4ace-95bd-3c9bed9e5946 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 409 len: 155 microversion: 2.1 time: 0.320000 Jul 26 14:15:43.155236 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1151/2468] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:15:42 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 155 bytes in 327 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:15:43.178531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e91ca7bd-7d97-4943-8008-9711e1f8d728 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:43.189506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e91ca7bd-7d97-4943-8008-9711e1f8d728 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:43.227630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e91ca7bd-7d97-4943-8008-9711e1f8d728 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:43.228173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e91ca7bd-7d97-4943-8008-9711e1f8d728 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:43.229004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e91ca7bd-7d97-4943-8008-9711e1f8d728 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:43.239722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e91ca7bd-7d97-4943-8008-9711e1f8d728 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:43.318848 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e91ca7bd-7d97-4943-8008-9711e1f8d728 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157917 Jul 26 14:15:43.328728 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1152/2469] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:15:43 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:43.350111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c2da7ce-0917-4a1b-ade5-58ac49d18653 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:43.351896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c2da7ce-0917-4a1b-ade5-58ac49d18653 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:43.376792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c2da7ce-0917-4a1b-ade5-58ac49d18653 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:43.381998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c2da7ce-0917-4a1b-ade5-58ac49d18653 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:43.383241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c2da7ce-0917-4a1b-ade5-58ac49d18653 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:43.386539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c2da7ce-0917-4a1b-ade5-58ac49d18653 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:43.655849 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c2da7ce-0917-4a1b-ade5-58ac49d18653 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 202 len: 0 microversion: 2.1 time: 0.324202 Jul 26 14:15:43.661731 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1153/2470] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:15:43 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:15:43.700255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5b5b97d1-36b4-440a-ab0e-09dbaf3f8e75 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:43.702953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b5b97d1-36b4-440a-ab0e-09dbaf3f8e75 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:43.738451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b5b97d1-36b4-440a-ab0e-09dbaf3f8e75 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:43.742168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b5b97d1-36b4-440a-ab0e-09dbaf3f8e75 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:43.745213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b5b97d1-36b4-440a-ab0e-09dbaf3f8e75 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:43.746890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b5b97d1-36b4-440a-ab0e-09dbaf3f8e75 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:43.950840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8235b972-c403-4bca-9f68-5ab60845993e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:43.966265 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8235b972-c403-4bca-9f68-5ab60845993e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 200 len: 1308 microversion: 2.1 time: 1.036705 Jul 26 14:15:43.969437 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1318/2471] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:42 2022] GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 1308 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:43.985751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d27e98b5-4892-4fb4-9b45-002cbfbdd1f2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:43.988428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d27e98b5-4892-4fb4-9b45-002cbfbdd1f2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:44.023132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d27e98b5-4892-4fb4-9b45-002cbfbdd1f2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:44.024349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d27e98b5-4892-4fb4-9b45-002cbfbdd1f2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:44.027332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d27e98b5-4892-4fb4-9b45-002cbfbdd1f2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:44.029514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d27e98b5-4892-4fb4-9b45-002cbfbdd1f2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:44.189411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5b5b97d1-36b4-440a-ab0e-09dbaf3f8e75 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:44.203535 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5b5b97d1-36b4-440a-ab0e-09dbaf3f8e75 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1263 microversion: 2.1 time: 0.539194 Jul 26 14:15:44.224805 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1154/2472] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:43 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1263 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:44.332497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5bc865d7-aac0-4b42-acc5-ad9f5640da65 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:44.335151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5bc865d7-aac0-4b42-acc5-ad9f5640da65 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:44.352217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bc865d7-aac0-4b42-acc5-ad9f5640da65 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:44.352885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bc865d7-aac0-4b42-acc5-ad9f5640da65 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:44.354054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bc865d7-aac0-4b42-acc5-ad9f5640da65 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:44.356999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bc865d7-aac0-4b42-acc5-ad9f5640da65 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:44.409392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:44.444178 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5bc865d7-aac0-4b42-acc5-ad9f5640da65 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116377 Jul 26 14:15:44.453547 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1155/2473] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:15:44 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:44.991221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:44.998064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d4958dca-75cb-43dd-8363-265e0d05082c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:44.998804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d4958dca-75cb-43dd-8363-265e0d05082c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:45.028986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4958dca-75cb-43dd-8363-265e0d05082c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:45.029504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4958dca-75cb-43dd-8363-265e0d05082c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:45.030503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4958dca-75cb-43dd-8363-265e0d05082c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:45.032952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4958dca-75cb-43dd-8363-265e0d05082c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:45.876445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d27e98b5-4892-4fb4-9b45-002cbfbdd1f2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:45.895822 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d27e98b5-4892-4fb4-9b45-002cbfbdd1f2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1460 microversion: 2.1 time: 1.924906 Jul 26 14:15:45.896782 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1319/2474] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:43 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1460 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:45.910384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8fc3a1ac-395a-4742-ac2c-af888240f69b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:45.911602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8fc3a1ac-395a-4742-ac2c-af888240f69b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:45.919222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fc3a1ac-395a-4742-ac2c-af888240f69b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:45.919934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fc3a1ac-395a-4742-ac2c-af888240f69b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:45.920905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fc3a1ac-395a-4742-ac2c-af888240f69b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:45.921507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8fc3a1ac-395a-4742-ac2c-af888240f69b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:46.187204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8fc3a1ac-395a-4742-ac2c-af888240f69b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:46.200720 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8fc3a1ac-395a-4742-ac2c-af888240f69b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1269 microversion: 2.1 time: 0.302562 Jul 26 14:15:46.216785 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1320/2475] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:45 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1269 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:46.222885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fbc95071-c54b-4981-a5f8-146cf7db96d4 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:46.225691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fbc95071-c54b-4981-a5f8-146cf7db96d4 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:46.234192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc95071-c54b-4981-a5f8-146cf7db96d4 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:46.235085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc95071-c54b-4981-a5f8-146cf7db96d4 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:46.236114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc95071-c54b-4981-a5f8-146cf7db96d4 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:46.237228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc95071-c54b-4981-a5f8-146cf7db96d4 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:46.291279 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fbc95071-c54b-4981-a5f8-146cf7db96d4 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073070 Jul 26 14:15:46.297182 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1321/2476] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:15:46 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:46.440632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d4958dca-75cb-43dd-8363-265e0d05082c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:46.460498 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d4958dca-75cb-43dd-8363-265e0d05082c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 200 len: 1308 microversion: 2.1 time: 1.470410 Jul 26 14:15:46.488509 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1156/2477] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:44 2022] GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 1308 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:46.923382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b17c2253-6d0a-42e6-bab3-7cade6388534 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:46.924039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b17c2253-6d0a-42e6-bab3-7cade6388534 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:46.937571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b17c2253-6d0a-42e6-bab3-7cade6388534 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:46.938043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b17c2253-6d0a-42e6-bab3-7cade6388534 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:46.938858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b17c2253-6d0a-42e6-bab3-7cade6388534 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:46.939314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b17c2253-6d0a-42e6-bab3-7cade6388534 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:47.227578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d6a394a-f9c1-48f5-9ebe-792ad72dae0c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:47.228390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8d6a394a-f9c1-48f5-9ebe-792ad72dae0c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:47.253714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d6a394a-f9c1-48f5-9ebe-792ad72dae0c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:47.254668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d6a394a-f9c1-48f5-9ebe-792ad72dae0c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:47.255679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d6a394a-f9c1-48f5-9ebe-792ad72dae0c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:47.256505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d6a394a-f9c1-48f5-9ebe-792ad72dae0c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:47.641392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d6a394a-f9c1-48f5-9ebe-792ad72dae0c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:47.661355 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d6a394a-f9c1-48f5-9ebe-792ad72dae0c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1269 microversion: 2.1 time: 0.437654 Jul 26 14:15:47.662366 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1157/2478] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:47 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1269 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:47.670042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d696dd30-dc93-4e45-920c-09450c462cf3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:47.672450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d696dd30-dc93-4e45-920c-09450c462cf3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:47.689533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d696dd30-dc93-4e45-920c-09450c462cf3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:47.690027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d696dd30-dc93-4e45-920c-09450c462cf3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:47.690832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d696dd30-dc93-4e45-920c-09450c462cf3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:47.691458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d696dd30-dc93-4e45-920c-09450c462cf3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:47.787405 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d696dd30-dc93-4e45-920c-09450c462cf3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123821 Jul 26 14:15:47.788281 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1158/2479] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:15:47 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:47.797848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7320cbb0-83b9-46ff-b239-9f422b53dc23 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:47.806231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7320cbb0-83b9-46ff-b239-9f422b53dc23 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:47.816310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7320cbb0-83b9-46ff-b239-9f422b53dc23 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:47.816973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7320cbb0-83b9-46ff-b239-9f422b53dc23 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:47.828917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7320cbb0-83b9-46ff-b239-9f422b53dc23 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:47.833440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7320cbb0-83b9-46ff-b239-9f422b53dc23 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:48.062203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b17c2253-6d0a-42e6-bab3-7cade6388534 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:48.072660 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b17c2253-6d0a-42e6-bab3-7cade6388534 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1518 microversion: 2.1 time: 1.153324 Jul 26 14:15:48.091641 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1322/2480] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:46 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1518 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:48.231391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-69fc7c3b-060d-4251-859c-f3cfbb89240a req-dc66ab91-774c-48ea-ab2b-18e107884e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c", "name": "network-vif-plugged", "status": "completed", "tag": "0522387b-5774-45c6-a116-88891b1f1994"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:48.243359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-69fc7c3b-060d-4251-859c-f3cfbb89240a req-dc66ab91-774c-48ea-ab2b-18e107884e2b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:48.243815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-69fc7c3b-060d-4251-859c-f3cfbb89240a req-dc66ab91-774c-48ea-ab2b-18e107884e2b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:48.342878 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-69fc7c3b-060d-4251-859c-f3cfbb89240a req-dc66ab91-774c-48ea-ab2b-18e107884e2b service nova] Creating event network-vif-plugged:0522387b-5774-45c6-a116-88891b1f1994 for instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c on n-h1-833090-9 Jul 26 14:15:48.356308 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-69fc7c3b-060d-4251-859c-f3cfbb89240a req-dc66ab91-774c-48ea-ab2b-18e107884e2b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130945 Jul 26 14:15:48.357400 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1323/2481] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:15:48.684035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-26ff8997-e814-4afa-85fa-6667828a18ae tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:48.685012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-26ff8997-e814-4afa-85fa-6667828a18ae tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:48.715898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26ff8997-e814-4afa-85fa-6667828a18ae tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:48.716832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26ff8997-e814-4afa-85fa-6667828a18ae tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:48.717808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26ff8997-e814-4afa-85fa-6667828a18ae tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:48.718578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26ff8997-e814-4afa-85fa-6667828a18ae tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:48.756403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:49.137155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7320cbb0-83b9-46ff-b239-9f422b53dc23 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:49.177135 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7320cbb0-83b9-46ff-b239-9f422b53dc23 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 200 len: 1308 microversion: 2.1 time: 1.383121 Jul 26 14:15:49.184425 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1159/2482] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:47 2022] GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 1308 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:49.195375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2dffec0d-92c1-44f4-97dc-feec358d5631 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:49.204002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2dffec0d-92c1-44f4-97dc-feec358d5631 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:49.225459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2dffec0d-92c1-44f4-97dc-feec358d5631 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:49.226098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2dffec0d-92c1-44f4-97dc-feec358d5631 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:49.245836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2dffec0d-92c1-44f4-97dc-feec358d5631 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:49.247094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2dffec0d-92c1-44f4-97dc-feec358d5631 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:49.367830 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2dffec0d-92c1-44f4-97dc-feec358d5631 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.181381 Jul 26 14:15:49.371359 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1160/2483] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:15:49 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671/os-volume_attachments => generated 25 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:15:49.394726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-24244826-95fa-41ff-8f34-b9e2f4eb2afd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:49.395636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-24244826-95fa-41ff-8f34-b9e2f4eb2afd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:49.406498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24244826-95fa-41ff-8f34-b9e2f4eb2afd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:49.407198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24244826-95fa-41ff-8f34-b9e2f4eb2afd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:49.408197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24244826-95fa-41ff-8f34-b9e2f4eb2afd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:49.408642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24244826-95fa-41ff-8f34-b9e2f4eb2afd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:50.546378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-26ff8997-e814-4afa-85fa-6667828a18ae tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:50.554082 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-26ff8997-e814-4afa-85fa-6667828a18ae tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1311 microversion: 2.1 time: 1.875046 Jul 26 14:15:50.560076 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1324/2484] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:48 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1311 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:15:50.576569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-988885484", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "cdba9fba-7f48-4210-9a88-ee2c4219ba59"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:50.725890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] validate_networks() for [('cdba9fba-7f48-4210-9a88-ee2c4219ba59', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:15:51.366599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-24244826-95fa-41ff-8f34-b9e2f4eb2afd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:51.391671 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-24244826-95fa-41ff-8f34-b9e2f4eb2afd tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1518 microversion: 2.1 time: 2.013460 Jul 26 14:15:51.395058 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1161/2485] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:49 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1518 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:51.439208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-548e1ecb-9826-4cc6-9f4e-234ae24bf7bf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:51.445376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-548e1ecb-9826-4cc6-9f4e-234ae24bf7bf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:51.457753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-548e1ecb-9826-4cc6-9f4e-234ae24bf7bf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:51.458627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-548e1ecb-9826-4cc6-9f4e-234ae24bf7bf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:51.459650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-548e1ecb-9826-4cc6-9f4e-234ae24bf7bf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:51.460341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-548e1ecb-9826-4cc6-9f4e-234ae24bf7bf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:51.802044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:51.868155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:52.508493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:53.352224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-548e1ecb-9826-4cc6-9f4e-234ae24bf7bf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:53.370686 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-548e1ecb-9826-4cc6-9f4e-234ae24bf7bf tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 200 len: 1487 microversion: 2.1 time: 1.958335 Jul 26 14:15:53.392088 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1162/2486] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:51 2022] GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 1487 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:53.413126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-788358b3-5e86-4ed2-9a06-8f1ecb560f6c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:53.415701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-788358b3-5e86-4ed2-9a06-8f1ecb560f6c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:53.425440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-788358b3-5e86-4ed2-9a06-8f1ecb560f6c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:53.426488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-788358b3-5e86-4ed2-9a06-8f1ecb560f6c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:53.427618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-788358b3-5e86-4ed2-9a06-8f1ecb560f6c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:53.447536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-788358b3-5e86-4ed2-9a06-8f1ecb560f6c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:53.981240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-788358b3-5e86-4ed2-9a06-8f1ecb560f6c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:53.990880 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-788358b3-5e86-4ed2-9a06-8f1ecb560f6c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1311 microversion: 2.1 time: 0.594054 Jul 26 14:15:53.993678 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1163/2487] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:53 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1311 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:54.014921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-199d3767-3adc-4ee9-b147-037a37cfdb78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:54.015685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-199d3767-3adc-4ee9-b147-037a37cfdb78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:54.050958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-199d3767-3adc-4ee9-b147-037a37cfdb78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:54.051389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-199d3767-3adc-4ee9-b147-037a37cfdb78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:54.052226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-199d3767-3adc-4ee9-b147-037a37cfdb78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:54.052676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-199d3767-3adc-4ee9-b147-037a37cfdb78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:55.394862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:15:55.396198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:15:55.397023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:15:55.397953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:15:55.398538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:15:55.423874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:55.440375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:55.441532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:55.442169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:55.538549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-199d3767-3adc-4ee9-b147-037a37cfdb78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:55.550993 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-199d3767-3adc-4ee9-b147-037a37cfdb78 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1518 microversion: 2.1 time: 1.553571 Jul 26 14:15:55.567397 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1164/2488] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:53 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1518 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:55.567785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3659a8b2-d206-4cb6-89c2-90282e1a1b71 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:15:55.569857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3659a8b2-d206-4cb6-89c2-90282e1a1b71 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:55.572104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Getting quotas for project 98c00816adb64fa4ad579cef5acc13d9. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:15:55.581734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Getting quotas for user 77c5d610c6134ed28c5747c6ac79ea6d and project 98c00816adb64fa4ad579cef5acc13d9. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:15:55.592755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3659a8b2-d206-4cb6-89c2-90282e1a1b71 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:55.593317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3659a8b2-d206-4cb6-89c2-90282e1a1b71 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:55.594676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3659a8b2-d206-4cb6-89c2-90282e1a1b71 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:55.602771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3659a8b2-d206-4cb6-89c2-90282e1a1b71 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:55.665952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:15:55.668803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:15:55.706050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-3659a8b2-d206-4cb6-89c2-90282e1a1b71 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lazy-loading 'flavor' on Instance uuid 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:15:55.822822 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8facbeb5-112d-48b2-b9d9-293b8cf7cecd tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.261271 Jul 26 14:15:55.823837 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1325/2489] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 5263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:15:55.833066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aef54a63-535d-4c27-b865-fd8ed93c64cc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:55.833912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aef54a63-535d-4c27-b865-fd8ed93c64cc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:55.880678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aef54a63-535d-4c27-b865-fd8ed93c64cc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:55.884686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aef54a63-535d-4c27-b865-fd8ed93c64cc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:55.885980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aef54a63-535d-4c27-b865-fd8ed93c64cc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:55.886446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aef54a63-535d-4c27-b865-fd8ed93c64cc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:56.033124 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3659a8b2-d206-4cb6-89c2-90282e1a1b71 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c/action" status: 202 len: 0 microversion: 2.1 time: 0.477067 Jul 26 14:15:56.035526 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1165/2490] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:15:55 2022] POST /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:15:56.052117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-655a52c7-ee9a-4f15-ab37-b81c04aa2ef7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:56.054204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-655a52c7-ee9a-4f15-ab37-b81c04aa2ef7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:56.596712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-655a52c7-ee9a-4f15-ab37-b81c04aa2ef7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:56.604034 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-655a52c7-ee9a-4f15-ab37-b81c04aa2ef7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1217 microversion: 2.1 time: 0.563797 Jul 26 14:15:56.608989 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1166/2491] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:56 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1217 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:56.616840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5d5bf698-013d-4c3e-b47b-226c24dec30f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:56.642590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d5bf698-013d-4c3e-b47b-226c24dec30f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:56.672205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:15:56.674902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d5bf698-013d-4c3e-b47b-226c24dec30f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:56.676273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d5bf698-013d-4c3e-b47b-226c24dec30f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:56.678673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d5bf698-013d-4c3e-b47b-226c24dec30f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:56.678673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d5bf698-013d-4c3e-b47b-226c24dec30f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:57.674244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aef54a63-535d-4c27-b865-fd8ed93c64cc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:57.691791 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aef54a63-535d-4c27-b865-fd8ed93c64cc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1311 microversion: 2.1 time: 1.866362 Jul 26 14:15:57.700015 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1326/2492] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:55 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1311 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:57.703446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-be321d47-770f-4a60-97da-ab24dfc35461 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:15:57.717947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-be321d47-770f-4a60-97da-ab24dfc35461 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:15:57.743568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be321d47-770f-4a60-97da-ab24dfc35461 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:57.744159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be321d47-770f-4a60-97da-ab24dfc35461 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:57.747287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be321d47-770f-4a60-97da-ab24dfc35461 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:15:57.756972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be321d47-770f-4a60-97da-ab24dfc35461 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:15:58.094520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5d5bf698-013d-4c3e-b47b-226c24dec30f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:15:58.110700 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5d5bf698-013d-4c3e-b47b-226c24dec30f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 200 len: 1478 microversion: 2.1 time: 1.496177 Jul 26 14:15:58.112038 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1167/2493] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:56 2022] GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 1478 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:15:58.498137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-808752626", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": "none"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:00.290204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-be321d47-770f-4a60-97da-ab24dfc35461 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:00.314349 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-be321d47-770f-4a60-97da-ab24dfc35461 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1518 microversion: 2.1 time: 2.618708 Jul 26 14:16:00.317941 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1327/2494] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:15:57 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1518 bytes in 2624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:00.345121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fb635281-3681-445c-a829-03dcec8433e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:00.346263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fb635281-3681-445c-a829-03dcec8433e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:00.383070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb635281-3681-445c-a829-03dcec8433e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:00.383753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb635281-3681-445c-a829-03dcec8433e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:00.395802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb635281-3681-445c-a829-03dcec8433e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:00.401099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb635281-3681-445c-a829-03dcec8433e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:00.588128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fb635281-3681-445c-a829-03dcec8433e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:00.609870 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fb635281-3681-445c-a829-03dcec8433e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1275 microversion: 2.1 time: 0.287538 Jul 26 14:16:00.614335 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1328/2495] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:00 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1275 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:00.659495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b097268-ad51-47f7-9a39-68f0e22974ca tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-908525447"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:00.664260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4b097268-ad51-47f7-9a39-68f0e22974ca tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:00.683170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b097268-ad51-47f7-9a39-68f0e22974ca tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:00.690418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b097268-ad51-47f7-9a39-68f0e22974ca tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:00.696893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b097268-ad51-47f7-9a39-68f0e22974ca tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:00.699509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b097268-ad51-47f7-9a39-68f0e22974ca tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:04.411848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:16:04.411848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:16:04.411848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:16:04.411848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:16:04.411848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:16:04.449803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:04.450712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:04.453737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:04.454990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:04.497717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Getting quotas for project e61ca0c2974c4a7880d4fe53d15bdf66. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:16:04.534466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Getting quotas for user fce2c000c2d840fb8f0b53736e45fcbd and project e61ca0c2974c4a7880d4fe53d15bdf66. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:16:04.573451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:16:04.579012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: dcaf7033-f14c-4c88-90d2-4060c1fc2b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:16:04.724678 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-89c663aa-678d-460f-aea8-77362683d556 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 6.610956 Jul 26 14:16:04.729899 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1168/2496] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:15:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 6617 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:16:04.743884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-43ff64d9-ae23-4b2f-b09e-e5612c144201 req-5e145502-717a-41d4-8fb3-02a7fb7f6874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66a91319-e533-46c4-988e-f7480ff27ba4", "tag": "0ab4988a-bac5-4440-ac27-184f1fcd12b8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:04.794634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-43ff64d9-ae23-4b2f-b09e-e5612c144201 req-5e145502-717a-41d4-8fb3-02a7fb7f6874 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:04.797944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-43ff64d9-ae23-4b2f-b09e-e5612c144201 req-5e145502-717a-41d4-8fb3-02a7fb7f6874 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:04.859099 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-43ff64d9-ae23-4b2f-b09e-e5612c144201 req-5e145502-717a-41d4-8fb3-02a7fb7f6874 service nova] Creating event network-changed:0ab4988a-bac5-4440-ac27-184f1fcd12b8 for instance 66a91319-e533-46c4-988e-f7480ff27ba4 on n-h2-833090-9 Jul 26 14:16:04.879539 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-43ff64d9-ae23-4b2f-b09e-e5612c144201 req-5e145502-717a-41d4-8fb3-02a7fb7f6874 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147398 Jul 26 14:16:04.881821 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4b097268-ad51-47f7-9a39-68f0e22974ca tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c/action" status: 202 len: 0 microversion: 2.1 time: 4.262444 Jul 26 14:16:04.884776 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1329/2498] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:00 2022] POST /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c/action => generated 0 bytes in 4269 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 14:16:04.885632 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1169/2498] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:04.919800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8a152601-5259-4f52-a2bb-711e294116e7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:04.928834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8a152601-5259-4f52-a2bb-711e294116e7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:04.965173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:04.979436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8a152601-5259-4f52-a2bb-711e294116e7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:04.982712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8a152601-5259-4f52-a2bb-711e294116e7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:04.999362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8a152601-5259-4f52-a2bb-711e294116e7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:05.000405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8a152601-5259-4f52-a2bb-711e294116e7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:05.081443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1771737074", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:05.226420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] validate_networks() for [('5269779e-9361-4476-8afc-7e1c2e18c835', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:16:05.479500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:05.635873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:05.901841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8a152601-5259-4f52-a2bb-711e294116e7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:05.912828 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8a152601-5259-4f52-a2bb-711e294116e7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1311 microversion: 2.1 time: 1.025403 Jul 26 14:16:05.915471 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1330/2499] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:04 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1311 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:05.932541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6dfb8906-78af-4830-9f4a-6fbcefe1e91a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:05.933179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6dfb8906-78af-4830-9f4a-6fbcefe1e91a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:05.941026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dfb8906-78af-4830-9f4a-6fbcefe1e91a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:05.941485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dfb8906-78af-4830-9f4a-6fbcefe1e91a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:05.942274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dfb8906-78af-4830-9f4a-6fbcefe1e91a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:05.942713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dfb8906-78af-4830-9f4a-6fbcefe1e91a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:06.440221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6dfb8906-78af-4830-9f4a-6fbcefe1e91a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:06.457345 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6dfb8906-78af-4830-9f4a-6fbcefe1e91a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1518 microversion: 2.1 time: 0.538786 Jul 26 14:16:06.462221 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1331/2500] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:05 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1518 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:06.477548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af8d1733-e5d5-439d-b3ec-ccaa5f7c47db tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:06.480030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af8d1733-e5d5-439d-b3ec-ccaa5f7c47db tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:06.500976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8d1733-e5d5-439d-b3ec-ccaa5f7c47db tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:06.504581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8d1733-e5d5-439d-b3ec-ccaa5f7c47db tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:06.506566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8d1733-e5d5-439d-b3ec-ccaa5f7c47db tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:06.509003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8d1733-e5d5-439d-b3ec-ccaa5f7c47db tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:07.162696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:16:07.164329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:16:07.165066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:16:07.165542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:16:07.166620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:16:07.174861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af8d1733-e5d5-439d-b3ec-ccaa5f7c47db tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:07.190402 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af8d1733-e5d5-439d-b3ec-ccaa5f7c47db tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1317 microversion: 2.1 time: 0.724987 Jul 26 14:16:07.193164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:07.194125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:07.195294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:07.196035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:07.208215 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1332/2501] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:06 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1317 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:07.219651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1b81cb4f-d29c-448f-95f1-8ec0d7f39ba9 req-9c6f8f3d-79e8-49f2-a8ff-47d24c2a52bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7b249a7-0a91-42a1-a4c1-85272a588947", "tag": "a725abbe-5c65-46b5-b00d-577459cfb075"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:07.240987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1b81cb4f-d29c-448f-95f1-8ec0d7f39ba9 req-9c6f8f3d-79e8-49f2-a8ff-47d24c2a52bf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:07.254160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1b81cb4f-d29c-448f-95f1-8ec0d7f39ba9 req-9c6f8f3d-79e8-49f2-a8ff-47d24c2a52bf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:07.273956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Getting quotas for project b9afeb78afff4a448db4261f7333ce3c. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:16:07.274310 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1b81cb4f-d29c-448f-95f1-8ec0d7f39ba9 req-9c6f8f3d-79e8-49f2-a8ff-47d24c2a52bf service nova] Creating event network-changed:a725abbe-5c65-46b5-b00d-577459cfb075 for instance d7b249a7-0a91-42a1-a4c1-85272a588947 on n-h1-833090-9 Jul 26 14:16:07.281878 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1b81cb4f-d29c-448f-95f1-8ec0d7f39ba9 req-9c6f8f3d-79e8-49f2-a8ff-47d24c2a52bf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071325 Jul 26 14:16:07.283454 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1333/2502] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:07.292508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b1c23d82-fe16-4b9e-b911-bfe0f00a7003 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:07.294242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b1c23d82-fe16-4b9e-b911-bfe0f00a7003 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: dcaf7033-f14c-4c88-90d2-4060c1fc2b8a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:07.302943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1c23d82-fe16-4b9e-b911-bfe0f00a7003 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:07.304087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1c23d82-fe16-4b9e-b911-bfe0f00a7003 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:07.305825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1c23d82-fe16-4b9e-b911-bfe0f00a7003 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:07.307972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Getting quotas for user d80cfcc0fbb94f60b2e8648e2357b00b and project b9afeb78afff4a448db4261f7333ce3c. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:16:07.308282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1c23d82-fe16-4b9e-b911-bfe0f00a7003 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:07.365895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:16:07.380591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:16:07.458243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1c23d82-fe16-4b9e-b911-bfe0f00a7003 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:07.487172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1c23d82-fe16-4b9e-b911-bfe0f00a7003 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:07.490403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1c23d82-fe16-4b9e-b911-bfe0f00a7003 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:07.493263 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b1c23d82-fe16-4b9e-b911-bfe0f00a7003 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a" status: 200 len: 1347 microversion: 2.47 time: 0.208324 Jul 26 14:16:07.495673 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1334/2503] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:07 2022] GET /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a => generated 1347 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:07.522189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a5dbc74-8f73-4610-bfb3-ec343044a4fb tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799370e50>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:07.532834 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5006f49e-5b41-4d77-a8bd-ac51f4049516 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.643479 Jul 26 14:16:07.535712 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1170/2504] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:16:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:16:07.558573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2793cf2d-6e42-4148-b99a-ee119e3935ea req-954480ae-e08d-4a89-aec7-39e16f7f63df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66a91319-e533-46c4-988e-f7480ff27ba4", "name": "network-vif-plugged", "status": "completed", "tag": "0ab4988a-bac5-4440-ac27-184f1fcd12b8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:07.602155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2793cf2d-6e42-4148-b99a-ee119e3935ea req-954480ae-e08d-4a89-aec7-39e16f7f63df service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:07.615250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2793cf2d-6e42-4148-b99a-ee119e3935ea req-954480ae-e08d-4a89-aec7-39e16f7f63df service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:07.686666 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2793cf2d-6e42-4148-b99a-ee119e3935ea req-954480ae-e08d-4a89-aec7-39e16f7f63df service nova] Creating event network-vif-plugged:0ab4988a-bac5-4440-ac27-184f1fcd12b8 for instance 66a91319-e533-46c4-988e-f7480ff27ba4 on n-h2-833090-9 Jul 26 14:16:07.703723 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2793cf2d-6e42-4148-b99a-ee119e3935ea req-954480ae-e08d-4a89-aec7-39e16f7f63df service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166687 Jul 26 14:16:07.704695 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1171/2505] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:07.717969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22483c1a-fd6c-46f7-95d2-043a11f0862c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:07.718758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22483c1a-fd6c-46f7-95d2-043a11f0862c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:07.725569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22483c1a-fd6c-46f7-95d2-043a11f0862c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:07.726031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22483c1a-fd6c-46f7-95d2-043a11f0862c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:07.726833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22483c1a-fd6c-46f7-95d2-043a11f0862c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:07.727283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22483c1a-fd6c-46f7-95d2-043a11f0862c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:07.744847 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a5dbc74-8f73-4610-bfb3-ec343044a4fb tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1437 microversion: 2.1 time: 0.239685 Jul 26 14:16:07.747324 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1335/2506] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:07 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1437 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:07.768134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0259bd1-ba0f-4d99-ba7e-436162c13391 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:07.770435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0259bd1-ba0f-4d99-ba7e-436162c13391 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:07.783119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0259bd1-ba0f-4d99-ba7e-436162c13391 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:07.787730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0259bd1-ba0f-4d99-ba7e-436162c13391 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:07.787730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0259bd1-ba0f-4d99-ba7e-436162c13391 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:07.787730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0259bd1-ba0f-4d99-ba7e-436162c13391 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:08.208999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22483c1a-fd6c-46f7-95d2-043a11f0862c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:08.222648 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22483c1a-fd6c-46f7-95d2-043a11f0862c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1311 microversion: 2.1 time: 0.516329 Jul 26 14:16:08.224956 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1172/2507] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:07 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1311 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:08.240187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02b94ec7-214f-414e-ae46-85c4b0495856 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:08.241280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-02b94ec7-214f-414e-ae46-85c4b0495856 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:08.272282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0259bd1-ba0f-4d99-ba7e-436162c13391 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:08.288898 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0259bd1-ba0f-4d99-ba7e-436162c13391 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1518 microversion: 2.1 time: 0.533685 Jul 26 14:16:08.291934 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1336/2508] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:07 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1518 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:08.316834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-381330208", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": "none"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:08.363575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-02b94ec7-214f-414e-ae46-85c4b0495856 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:08.380305 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-02b94ec7-214f-414e-ae46-85c4b0495856 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1223 microversion: 2.1 time: 0.151523 Jul 26 14:16:08.393498 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1173/2509] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:08 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1223 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:08.405018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3a37eae6-92cf-42ff-b486-9c5e18fa0f83 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:08.405953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3a37eae6-92cf-42ff-b486-9c5e18fa0f83 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:08.416322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a37eae6-92cf-42ff-b486-9c5e18fa0f83 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:08.417214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a37eae6-92cf-42ff-b486-9c5e18fa0f83 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:08.418954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a37eae6-92cf-42ff-b486-9c5e18fa0f83 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:08.419757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a37eae6-92cf-42ff-b486-9c5e18fa0f83 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:08.442484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:16:08.442920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:16:08.443526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:16:08.444024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:16:08.444637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:16:08.472828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:08.473940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:08.476135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:08.477212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:08.508394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Getting quotas for project e61ca0c2974c4a7880d4fe53d15bdf66. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:16:08.518827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Getting quotas for user fce2c000c2d840fb8f0b53736e45fcbd and project e61ca0c2974c4a7880d4fe53d15bdf66. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:16:08.548241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:16:08.555126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:16:08.663158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3a37eae6-92cf-42ff-b486-9c5e18fa0f83 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:08.675172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:08.688017 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d1af3740-d512-4f0f-944b-82ddc157f266 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.385041 Jul 26 14:16:08.689395 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1337/2510] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:16:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:16:08.703719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b8f09301-a96a-4ed0-9201-e0748c573f8b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:08.707286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b8f09301-a96a-4ed0-9201-e0748c573f8b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:08.716230 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3a37eae6-92cf-42ff-b486-9c5e18fa0f83 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1317 microversion: 2.1 time: 0.316474 Jul 26 14:16:08.721554 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1174/2511] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:08 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:08.763916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad45ace8-6dda-4d77-8c47-8f0c92e4cc2a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799429e50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:08.775942 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b8f09301-a96a-4ed0-9201-e0748c573f8b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "PUT /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 991 microversion: 2.47 time: 0.076607 Jul 26 14:16:08.780281 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1338/2512] 10.222.0.70 () {62 vars in 1297 bytes} [Tue Jul 26 14:16:08 2022] PUT /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:16:08.800955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3cac1ed-602c-41f7-bda0-5d6e982ba7da tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:08.801681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b3cac1ed-602c-41f7-bda0-5d6e982ba7da tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:08.906785 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad45ace8-6dda-4d77-8c47-8f0c92e4cc2a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1437 microversion: 2.1 time: 0.148923 Jul 26 14:16:08.910584 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1175/2513] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:08 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1437 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:08.937651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3cac1ed-602c-41f7-bda0-5d6e982ba7da tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:08.946200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3cac1ed-602c-41f7-bda0-5d6e982ba7da tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:08.947844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3cac1ed-602c-41f7-bda0-5d6e982ba7da tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:08.949067 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3cac1ed-602c-41f7-bda0-5d6e982ba7da tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1277 microversion: 2.47 time: 0.154608 Jul 26 14:16:08.949852 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1339/2514] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:08 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:16:09.250363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-271dbc68-4247-4052-95f0-641818b7deff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:09.251434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-271dbc68-4247-4052-95f0-641818b7deff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:09.287721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-271dbc68-4247-4052-95f0-641818b7deff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:09.293784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-271dbc68-4247-4052-95f0-641818b7deff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:09.300627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-271dbc68-4247-4052-95f0-641818b7deff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:09.303839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-271dbc68-4247-4052-95f0-641818b7deff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:09.317694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a8f10b20-fb2f-431d-8f50-bc143e951e5b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:09.318652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a8f10b20-fb2f-431d-8f50-bc143e951e5b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:09.342920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8f10b20-fb2f-431d-8f50-bc143e951e5b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:09.343379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8f10b20-fb2f-431d-8f50-bc143e951e5b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:09.344227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8f10b20-fb2f-431d-8f50-bc143e951e5b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:09.344672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8f10b20-fb2f-431d-8f50-bc143e951e5b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:10.028980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a8f10b20-fb2f-431d-8f50-bc143e951e5b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:10.041076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-271dbc68-4247-4052-95f0-641818b7deff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:10.046786 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a8f10b20-fb2f-431d-8f50-bc143e951e5b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1518 microversion: 2.1 time: 0.733220 Jul 26 14:16:10.059989 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1340/2515] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:09 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1518 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:10.064022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-94f9e892-dceb-4e3f-875c-a249b602fa4f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:10.064022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-94f9e892-dceb-4e3f-875c-a249b602fa4f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:10.074435 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-271dbc68-4247-4052-95f0-641818b7deff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1311 microversion: 2.1 time: 0.831880 Jul 26 14:16:10.077896 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1176/2516] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:09 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1311 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:10.082201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94f9e892-dceb-4e3f-875c-a249b602fa4f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:10.082995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94f9e892-dceb-4e3f-875c-a249b602fa4f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:10.084445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e818e6f9-4fa7-45be-bb18-4d0cc445b796 req-c3613cd1-2a84-4842-8861-fa306da73981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b94307-dd41-4f71-b529-c6cbb944c27f", "name": "network-vif-plugged", "status": "completed", "tag": "5c60dac8-f587-41cf-8357-66980afb2e01"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:10.085372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94f9e892-dceb-4e3f-875c-a249b602fa4f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:10.086173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94f9e892-dceb-4e3f-875c-a249b602fa4f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:10.112367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e818e6f9-4fa7-45be-bb18-4d0cc445b796 req-c3613cd1-2a84-4842-8861-fa306da73981 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:10.112817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e818e6f9-4fa7-45be-bb18-4d0cc445b796 req-c3613cd1-2a84-4842-8861-fa306da73981 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:10.160440 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e818e6f9-4fa7-45be-bb18-4d0cc445b796 req-c3613cd1-2a84-4842-8861-fa306da73981 service nova] Creating event network-vif-plugged:5c60dac8-f587-41cf-8357-66980afb2e01 for instance e6b94307-dd41-4f71-b529-c6cbb944c27f on n-h1-833090-9 Jul 26 14:16:10.195187 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e818e6f9-4fa7-45be-bb18-4d0cc445b796 req-c3613cd1-2a84-4842-8861-fa306da73981 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114688 Jul 26 14:16:10.199541 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1177/2517] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:10.238073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a4641cd8-6968-4633-9fbe-2481ea165d28 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:10.252403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a4641cd8-6968-4633-9fbe-2481ea165d28 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:10.273720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4641cd8-6968-4633-9fbe-2481ea165d28 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:10.277902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4641cd8-6968-4633-9fbe-2481ea165d28 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:10.285115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4641cd8-6968-4633-9fbe-2481ea165d28 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:10.286232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4641cd8-6968-4633-9fbe-2481ea165d28 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:10.488542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-94f9e892-dceb-4e3f-875c-a249b602fa4f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:10.503900 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-94f9e892-dceb-4e3f-875c-a249b602fa4f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1275 microversion: 2.1 time: 0.452723 Jul 26 14:16:10.522167 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1341/2518] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:10 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1275 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:10.533787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed7502ed-e278-44ad-852a-4c7368ee934e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f879937bb80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:10.745836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a4641cd8-6968-4633-9fbe-2481ea165d28 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:10.755087 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a4641cd8-6968-4633-9fbe-2481ea165d28 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1317 microversion: 2.1 time: 0.548254 Jul 26 14:16:10.755707 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1178/2519] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:10 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:10.761231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a31ddbe7-2ede-47c2-b255-b2a4110f215f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:10.761863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a31ddbe7-2ede-47c2-b255-b2a4110f215f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:10.769361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a31ddbe7-2ede-47c2-b255-b2a4110f215f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:10.770205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a31ddbe7-2ede-47c2-b255-b2a4110f215f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:10.771243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a31ddbe7-2ede-47c2-b255-b2a4110f215f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:10.771756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a31ddbe7-2ede-47c2-b255-b2a4110f215f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:10.921033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a31ddbe7-2ede-47c2-b255-b2a4110f215f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:10.942197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a31ddbe7-2ede-47c2-b255-b2a4110f215f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:10.951595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a31ddbe7-2ede-47c2-b255-b2a4110f215f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:10.953633 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a31ddbe7-2ede-47c2-b255-b2a4110f215f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1329 microversion: 2.47 time: 0.196410 Jul 26 14:16:10.956823 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1179/2520] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:10 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1329 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:11.093806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0dce2828-0308-4114-9912-a4e7265c3e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:11.095515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0dce2828-0308-4114-9912-a4e7265c3e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:11.111414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dce2828-0308-4114-9912-a4e7265c3e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:11.113359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dce2828-0308-4114-9912-a4e7265c3e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:11.115705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dce2828-0308-4114-9912-a4e7265c3e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:11.116672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dce2828-0308-4114-9912-a4e7265c3e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:11.631547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0dce2828-0308-4114-9912-a4e7265c3e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:11.649289 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0dce2828-0308-4114-9912-a4e7265c3e23 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1518 microversion: 2.1 time: 0.564345 Jul 26 14:16:11.651402 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1180/2521] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:11 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1518 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:16:11.663685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c317c0f5-6e1b-4750-81d2-7a452c577e53 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:11.666676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c317c0f5-6e1b-4750-81d2-7a452c577e53 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:11.682430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c317c0f5-6e1b-4750-81d2-7a452c577e53 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:11.684319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c317c0f5-6e1b-4750-81d2-7a452c577e53 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:11.686745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c317c0f5-6e1b-4750-81d2-7a452c577e53 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:11.690647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c317c0f5-6e1b-4750-81d2-7a452c577e53 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:12.024517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c317c0f5-6e1b-4750-81d2-7a452c577e53 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:12.040096 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c317c0f5-6e1b-4750-81d2-7a452c577e53 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1494 microversion: 2.1 time: 0.386070 Jul 26 14:16:12.043643 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1181/2522] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:11 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1494 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:12.073472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-61c5e192-30a6-4b6b-944f-eb8eae23f0cf tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:12.074272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-61c5e192-30a6-4b6b-944f-eb8eae23f0cf tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:12.098676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61c5e192-30a6-4b6b-944f-eb8eae23f0cf tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:12.099941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61c5e192-30a6-4b6b-944f-eb8eae23f0cf tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:12.101427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61c5e192-30a6-4b6b-944f-eb8eae23f0cf tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:12.101987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61c5e192-30a6-4b6b-944f-eb8eae23f0cf tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:12.467736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-61c5e192-30a6-4b6b-944f-eb8eae23f0cf tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:12.474489 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-61c5e192-30a6-4b6b-944f-eb8eae23f0cf tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1323 microversion: 2.1 time: 0.425224 Jul 26 14:16:12.475276 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1182/2523] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:12 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1323 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:12.498098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-704e7d09-2d5e-47a3-9861-27cb02e0c85e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:12.500284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-704e7d09-2d5e-47a3-9861-27cb02e0c85e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:12.509951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-704e7d09-2d5e-47a3-9861-27cb02e0c85e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:12.510846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-704e7d09-2d5e-47a3-9861-27cb02e0c85e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:12.511902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-704e7d09-2d5e-47a3-9861-27cb02e0c85e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:12.512729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-704e7d09-2d5e-47a3-9861-27cb02e0c85e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:12.810940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-704e7d09-2d5e-47a3-9861-27cb02e0c85e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:12.820841 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-704e7d09-2d5e-47a3-9861-27cb02e0c85e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1317 microversion: 2.1 time: 0.331644 Jul 26 14:16:12.824466 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1183/2524] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:12 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:12.834039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea308465-4625-4643-a0ae-ca14919c91a4 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:12.834988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ea308465-4625-4643-a0ae-ca14919c91a4 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:12.860941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea308465-4625-4643-a0ae-ca14919c91a4 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:12.862713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea308465-4625-4643-a0ae-ca14919c91a4 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:12.865403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea308465-4625-4643-a0ae-ca14919c91a4 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:12.866101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea308465-4625-4643-a0ae-ca14919c91a4 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:13.040139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ea308465-4625-4643-a0ae-ca14919c91a4 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:13.056475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ea308465-4625-4643-a0ae-ca14919c91a4 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:13.058654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ea308465-4625-4643-a0ae-ca14919c91a4 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:13.060153 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ea308465-4625-4643-a0ae-ca14919c91a4 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1335 microversion: 2.47 time: 0.233831 Jul 26 14:16:13.063015 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1184/2525] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:12 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1335 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:13.314235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a971d991-e02a-4799-bf05-5debd52c3d2e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:13.318240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a971d991-e02a-4799-bf05-5debd52c3d2e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:13.334509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a971d991-e02a-4799-bf05-5debd52c3d2e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:13.336257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a971d991-e02a-4799-bf05-5debd52c3d2e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:13.338950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a971d991-e02a-4799-bf05-5debd52c3d2e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:13.340218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a971d991-e02a-4799-bf05-5debd52c3d2e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:13.735355 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a971d991-e02a-4799-bf05-5debd52c3d2e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1645 microversion: 2.1 time: 0.670796 Jul 26 14:16:13.736264 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1185/2526] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:13 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1645 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:13.771819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-624fbcb4-1f00-452b-83f1-59bdd6613251 req-0d4c02c0-3dfd-4dac-af1b-c2c9a6acfec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c", "name": "network-vif-plugged", "status": "completed", "tag": "0522387b-5774-45c6-a116-88891b1f1994"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:13.785208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-624fbcb4-1f00-452b-83f1-59bdd6613251 req-0d4c02c0-3dfd-4dac-af1b-c2c9a6acfec2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:13.786229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-624fbcb4-1f00-452b-83f1-59bdd6613251 req-0d4c02c0-3dfd-4dac-af1b-c2c9a6acfec2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:13.799720 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-624fbcb4-1f00-452b-83f1-59bdd6613251 req-0d4c02c0-3dfd-4dac-af1b-c2c9a6acfec2 service nova] Creating event network-vif-plugged:0522387b-5774-45c6-a116-88891b1f1994 for instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c on n-h1-833090-9 Jul 26 14:16:13.809386 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-624fbcb4-1f00-452b-83f1-59bdd6613251 req-0d4c02c0-3dfd-4dac-af1b-c2c9a6acfec2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048093 Jul 26 14:16:13.814469 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1186/2527] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:13.822332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af0cc59b-ce09-457d-8697-2ea9efec96b9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:13.824382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-af0cc59b-ce09-457d-8697-2ea9efec96b9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:13.834047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af0cc59b-ce09-457d-8697-2ea9efec96b9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:13.834534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af0cc59b-ce09-457d-8697-2ea9efec96b9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:13.835331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af0cc59b-ce09-457d-8697-2ea9efec96b9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:13.835790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af0cc59b-ce09-457d-8697-2ea9efec96b9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:14.126041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-af0cc59b-ce09-457d-8697-2ea9efec96b9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:14.146226 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af0cc59b-ce09-457d-8697-2ea9efec96b9 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1518 microversion: 2.1 time: 0.329338 Jul 26 14:16:14.148518 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1187/2528] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:13 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1518 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:14.158154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af458dfa-c39a-4c80-a9d2-9163750b91f8 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:14.159613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-af458dfa-c39a-4c80-a9d2-9163750b91f8 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:14.169814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af458dfa-c39a-4c80-a9d2-9163750b91f8 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:14.171375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af458dfa-c39a-4c80-a9d2-9163750b91f8 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:14.172669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af458dfa-c39a-4c80-a9d2-9163750b91f8 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:14.173532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af458dfa-c39a-4c80-a9d2-9163750b91f8 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:14.501591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-af458dfa-c39a-4c80-a9d2-9163750b91f8 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:14.513094 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af458dfa-c39a-4c80-a9d2-9163750b91f8 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1323 microversion: 2.1 time: 0.360045 Jul 26 14:16:14.530155 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1188/2529] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:14 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1323 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:14.536291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-538abdcd-eb54-44b8-9a80-641017aaf762 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:14.537292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-538abdcd-eb54-44b8-9a80-641017aaf762 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:14.551072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-538abdcd-eb54-44b8-9a80-641017aaf762 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:14.551913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-538abdcd-eb54-44b8-9a80-641017aaf762 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:14.552997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-538abdcd-eb54-44b8-9a80-641017aaf762 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:14.553650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-538abdcd-eb54-44b8-9a80-641017aaf762 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:14.857270 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-538abdcd-eb54-44b8-9a80-641017aaf762 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1645 microversion: 2.1 time: 0.324433 Jul 26 14:16:14.880278 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1189/2530] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:14 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1645 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:14.886232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1b1e222d-4b3c-4f53-b50a-93dfa6bb0af6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:14.886869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1b1e222d-4b3c-4f53-b50a-93dfa6bb0af6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:14.898951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b1e222d-4b3c-4f53-b50a-93dfa6bb0af6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:14.899410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b1e222d-4b3c-4f53-b50a-93dfa6bb0af6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:14.900896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b1e222d-4b3c-4f53-b50a-93dfa6bb0af6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:14.901342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b1e222d-4b3c-4f53-b50a-93dfa6bb0af6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:15.515859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1b1e222d-4b3c-4f53-b50a-93dfa6bb0af6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:15.524416 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1b1e222d-4b3c-4f53-b50a-93dfa6bb0af6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1317 microversion: 2.1 time: 0.642927 Jul 26 14:16:15.525863 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1190/2531] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:14 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:15.530873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9204d43b-291a-467f-9dec-191d3584e774 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:15.531491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9204d43b-291a-467f-9dec-191d3584e774 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:15.553096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9204d43b-291a-467f-9dec-191d3584e774 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:15.553573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9204d43b-291a-467f-9dec-191d3584e774 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:15.554534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9204d43b-291a-467f-9dec-191d3584e774 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:15.554979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9204d43b-291a-467f-9dec-191d3584e774 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:15.649106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9204d43b-291a-467f-9dec-191d3584e774 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:15.666371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9204d43b-291a-467f-9dec-191d3584e774 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:15.668201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9204d43b-291a-467f-9dec-191d3584e774 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:15.669542 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9204d43b-291a-467f-9dec-191d3584e774 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1356 microversion: 2.47 time: 0.142449 Jul 26 14:16:15.681919 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1191/2532] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:15 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1356 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:15.692900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-600ed785-2105-4792-bddf-b465610a422c req-e2d9f6ff-7749-4ff6-a295-e05984599c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1e35fe-99b6-426a-9c00-890423632b69", "tag": "70c52961-0644-4b44-9202-3493a2dafa42"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:15.705760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-600ed785-2105-4792-bddf-b465610a422c req-e2d9f6ff-7749-4ff6-a295-e05984599c66 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:15.706210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-600ed785-2105-4792-bddf-b465610a422c req-e2d9f6ff-7749-4ff6-a295-e05984599c66 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:15.722260 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-600ed785-2105-4792-bddf-b465610a422c req-e2d9f6ff-7749-4ff6-a295-e05984599c66 service nova] Creating event network-changed:70c52961-0644-4b44-9202-3493a2dafa42 for instance da1e35fe-99b6-426a-9c00-890423632b69 on n-h2-833090-9 Jul 26 14:16:15.734378 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-600ed785-2105-4792-bddf-b465610a422c req-e2d9f6ff-7749-4ff6-a295-e05984599c66 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046069 Jul 26 14:16:15.735602 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1192/2533] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:15.740849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f08e75f5-e57c-47c5-9da4-227397cd9f40 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:15.747342 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:16:15.747342 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:16:15.749627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f08e75f5-e57c-47c5-9da4-227397cd9f40 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:15.750515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f08e75f5-e57c-47c5-9da4-227397cd9f40 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:15.751804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f08e75f5-e57c-47c5-9da4-227397cd9f40 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:15.752281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f08e75f5-e57c-47c5-9da4-227397cd9f40 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:15.783152 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f08e75f5-e57c-47c5-9da4-227397cd9f40 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042369 Jul 26 14:16:15.783152 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1193/2534] 10.222.0.70 () {58 vars in 1176 bytes} [Tue Jul 26 14:16:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:15.787278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7a9d4702-856b-438a-ab91-5037d72edbfe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:15.788127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7a9d4702-856b-438a-ab91-5037d72edbfe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:15.798884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a9d4702-856b-438a-ab91-5037d72edbfe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:15.799399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a9d4702-856b-438a-ab91-5037d72edbfe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:15.800784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a9d4702-856b-438a-ab91-5037d72edbfe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:15.801244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a9d4702-856b-438a-ab91-5037d72edbfe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:16.055514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7a9d4702-856b-438a-ab91-5037d72edbfe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:16.067817 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7a9d4702-856b-438a-ab91-5037d72edbfe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1518 microversion: 2.1 time: 0.283780 Jul 26 14:16:16.068576 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1194/2535] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:15 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1518 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:16.074498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3498427a-d0c0-4852-a9e4-1a7c6cac66f7 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:16.075581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3498427a-d0c0-4852-a9e4-1a7c6cac66f7 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:16.115224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3498427a-d0c0-4852-a9e4-1a7c6cac66f7 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:16.116309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3498427a-d0c0-4852-a9e4-1a7c6cac66f7 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:16.118435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3498427a-d0c0-4852-a9e4-1a7c6cac66f7 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:16.120086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3498427a-d0c0-4852-a9e4-1a7c6cac66f7 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:16.125907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:16.336998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3498427a-d0c0-4852-a9e4-1a7c6cac66f7 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:16.354173 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3498427a-d0c0-4852-a9e4-1a7c6cac66f7 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1323 microversion: 2.1 time: 0.283528 Jul 26 14:16:16.369598 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1195/2536] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:16 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1323 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:16.378815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:16.382630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:16.392479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:16.392931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:16.394024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:16.394466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:17.044104 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed7502ed-e278-44ad-852a-4c7368ee934e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1437 microversion: 2.1 time: 6.514894 Jul 26 14:16:17.061806 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1342/2537] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:10 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1437 bytes in 6539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:17.098003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-773d6002-de8b-4160-a3a8-7f4bf028b88d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-9", "block_migration": true, "disk_over_commit": false}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:17.103007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-773d6002-de8b-4160-a3a8-7f4bf028b88d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:17.118575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-773d6002-de8b-4160-a3a8-7f4bf028b88d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:17.119694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-773d6002-de8b-4160-a3a8-7f4bf028b88d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:17.121597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-773d6002-de8b-4160-a3a8-7f4bf028b88d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:17.122711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-773d6002-de8b-4160-a3a8-7f4bf028b88d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:17.133693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:16:17.136590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:16:17.140943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:16:17.140943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:16:17.140943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:16:17.277490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:17.294427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:17.294694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:17.295688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:17.296492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:17.308192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-773d6002-de8b-4160-a3a8-7f4bf028b88d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lazy-loading 'flavor' on Instance uuid 66a91319-e533-46c4-988e-f7480ff27ba4 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:16:17.327616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-773d6002-de8b-4160-a3a8-7f4bf028b88d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Going to try to live migrate instance to n-h1-833090-9 {{(pid=119479) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 14:16:17.340922 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05300d0c-fed5-4f7a-a05f-092463fb4f8a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "POST /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6/action" status: 202 len: 1078 microversion: 2.47 time: 0.969650 Jul 26 14:16:17.357290 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1196/2538] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:16:16 2022] POST /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6/action => generated 1078 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 14:16:17.368132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-225bf05a-dfd2-4bb6-9e78-40bb6d06d9cf req-8971e1e1-1d0b-44c1-bed5-e39e4cc47266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7b249a7-0a91-42a1-a4c1-85272a588947", "name": "network-vif-plugged", "status": "completed", "tag": "a725abbe-5c65-46b5-b00d-577459cfb075"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:17.387127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-225bf05a-dfd2-4bb6-9e78-40bb6d06d9cf req-8971e1e1-1d0b-44c1-bed5-e39e4cc47266 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:17.387577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-225bf05a-dfd2-4bb6-9e78-40bb6d06d9cf req-8971e1e1-1d0b-44c1-bed5-e39e4cc47266 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:17.408675 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-225bf05a-dfd2-4bb6-9e78-40bb6d06d9cf req-8971e1e1-1d0b-44c1-bed5-e39e4cc47266 service nova] Creating event network-vif-plugged:a725abbe-5c65-46b5-b00d-577459cfb075 for instance d7b249a7-0a91-42a1-a4c1-85272a588947 on n-h1-833090-9 Jul 26 14:16:17.415093 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-225bf05a-dfd2-4bb6-9e78-40bb6d06d9cf req-8971e1e1-1d0b-44c1-bed5-e39e4cc47266 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055265 Jul 26 14:16:17.416258 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1197/2539] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:17.438591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ffc9e3c1-f3a2-4518-9535-79cf2e01d7e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:17.440723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ffc9e3c1-f3a2-4518-9535-79cf2e01d7e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:17.460452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ffc9e3c1-f3a2-4518-9535-79cf2e01d7e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:17.462069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ffc9e3c1-f3a2-4518-9535-79cf2e01d7e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:17.462895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ffc9e3c1-f3a2-4518-9535-79cf2e01d7e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:17.464713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ffc9e3c1-f3a2-4518-9535-79cf2e01d7e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:17.474046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:17.965190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ffc9e3c1-f3a2-4518-9535-79cf2e01d7e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:17.989246 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ffc9e3c1-f3a2-4518-9535-79cf2e01d7e6 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1317 microversion: 2.1 time: 0.570732 Jul 26 14:16:17.991345 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1198/2540] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:17 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:18.005606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5b9347cf-9da1-46ec-98d6-9f0b36f5b6ea tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:18.005606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b9347cf-9da1-46ec-98d6-9f0b36f5b6ea tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:18.022467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b9347cf-9da1-46ec-98d6-9f0b36f5b6ea tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:18.023798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b9347cf-9da1-46ec-98d6-9f0b36f5b6ea tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:18.026690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b9347cf-9da1-46ec-98d6-9f0b36f5b6ea tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:18.028492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b9347cf-9da1-46ec-98d6-9f0b36f5b6ea tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:18.104851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b9347cf-9da1-46ec-98d6-9f0b36f5b6ea tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:16:18.319402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:18.362008 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5b9347cf-9da1-46ec-98d6-9f0b36f5b6ea tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 204 len: 0 microversion: 2.42 time: 0.366080 Jul 26 14:16:18.366996 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1199/2541] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:16:17 2022] DELETE /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:16:18.379755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e2cdbf0a-a779-4dc8-82a1-3a684fb82e67 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:18.382396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e2cdbf0a-a779-4dc8-82a1-3a684fb82e67 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:18.393440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=16 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:18.413017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2cdbf0a-a779-4dc8-82a1-3a684fb82e67 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:18.415022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2cdbf0a-a779-4dc8-82a1-3a684fb82e67 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:18.421359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2cdbf0a-a779-4dc8-82a1-3a684fb82e67 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:18.432084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2cdbf0a-a779-4dc8-82a1-3a684fb82e67 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:18.489693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:18.796425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e2cdbf0a-a779-4dc8-82a1-3a684fb82e67 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:18.828198 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e2cdbf0a-a779-4dc8-82a1-3a684fb82e67 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.463135 Jul 26 14:16:18.829429 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1200/2542] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:18 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:18.862014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f4b96fef-dfd8-4148-8be7-5526b0fc3f4a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:18.864249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f4b96fef-dfd8-4148-8be7-5526b0fc3f4a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:18.875072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4b96fef-dfd8-4148-8be7-5526b0fc3f4a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:18.876068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4b96fef-dfd8-4148-8be7-5526b0fc3f4a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:18.881047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4b96fef-dfd8-4148-8be7-5526b0fc3f4a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:18.882106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4b96fef-dfd8-4148-8be7-5526b0fc3f4a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:18.945097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:19.037463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4b96fef-dfd8-4148-8be7-5526b0fc3f4a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:19.049507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4b96fef-dfd8-4148-8be7-5526b0fc3f4a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:19.058567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4b96fef-dfd8-4148-8be7-5526b0fc3f4a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:19.060187 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f4b96fef-dfd8-4148-8be7-5526b0fc3f4a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.229408 Jul 26 14:16:19.061211 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1201/2543] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:18 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:19.086537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5ec32193-fabf-4ec8-b27f-8d15eaa14afc tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:19.088842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5ec32193-fabf-4ec8-b27f-8d15eaa14afc tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:19.111104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ec32193-fabf-4ec8-b27f-8d15eaa14afc tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:19.112305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ec32193-fabf-4ec8-b27f-8d15eaa14afc tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:19.114038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ec32193-fabf-4ec8-b27f-8d15eaa14afc tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:19.115064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ec32193-fabf-4ec8-b27f-8d15eaa14afc tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:19.370153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5ec32193-fabf-4ec8-b27f-8d15eaa14afc tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:19.387126 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5ec32193-fabf-4ec8-b27f-8d15eaa14afc tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1323 microversion: 2.1 time: 0.324485 Jul 26 14:16:19.399997 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1202/2544] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:19 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1323 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:19.412850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f88ee5ac-b805-4152-b6bc-92c83e9a7a9c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f87993fc040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:19.516676 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f88ee5ac-b805-4152-b6bc-92c83e9a7a9c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1437 microversion: 2.1 time: 0.116600 Jul 26 14:16:19.524375 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1203/2545] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:19 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1437 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:19.530244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9478a240-66fd-4fb9-b652-1add65fc9fa1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:19.530874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9478a240-66fd-4fb9-b652-1add65fc9fa1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:19.538577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9478a240-66fd-4fb9-b652-1add65fc9fa1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:19.538834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9478a240-66fd-4fb9-b652-1add65fc9fa1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:19.539630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9478a240-66fd-4fb9-b652-1add65fc9fa1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:19.540648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9478a240-66fd-4fb9-b652-1add65fc9fa1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:19.824758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9478a240-66fd-4fb9-b652-1add65fc9fa1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:19.842160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9478a240-66fd-4fb9-b652-1add65fc9fa1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:19.845565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9478a240-66fd-4fb9-b652-1add65fc9fa1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:19.847144 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9478a240-66fd-4fb9-b652-1add65fc9fa1 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2961 microversion: 2.42 time: 0.321180 Jul 26 14:16:19.847892 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1204/2546] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:19 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2961 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:19.862377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6de035cd-82af-4cb3-9ff7-fcc282beecd1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:19.866207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6de035cd-82af-4cb3-9ff7-fcc282beecd1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:19.886752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6de035cd-82af-4cb3-9ff7-fcc282beecd1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:19.887563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6de035cd-82af-4cb3-9ff7-fcc282beecd1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:19.889121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6de035cd-82af-4cb3-9ff7-fcc282beecd1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:19.891208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6de035cd-82af-4cb3-9ff7-fcc282beecd1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:20.090198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6de035cd-82af-4cb3-9ff7-fcc282beecd1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:20.104817 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6de035cd-82af-4cb3-9ff7-fcc282beecd1 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.255661 Jul 26 14:16:20.108012 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1205/2547] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:19 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:20.119007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cf33cbaa-37f6-47d5-a46a-e78dd02b489d tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:20.119929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cf33cbaa-37f6-47d5-a46a-e78dd02b489d tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:20.131434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf33cbaa-37f6-47d5-a46a-e78dd02b489d tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:20.134559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf33cbaa-37f6-47d5-a46a-e78dd02b489d tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:20.135410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf33cbaa-37f6-47d5-a46a-e78dd02b489d tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:20.135863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf33cbaa-37f6-47d5-a46a-e78dd02b489d tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:20.362731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cf33cbaa-37f6-47d5-a46a-e78dd02b489d tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:20.375504 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cf33cbaa-37f6-47d5-a46a-e78dd02b489d tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1508 microversion: 2.1 time: 0.265737 Jul 26 14:16:20.376441 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1206/2548] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:20 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:20.383371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a87a3ff6-5663-491f-821c-7dcb477c0b60 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:20.383740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a87a3ff6-5663-491f-821c-7dcb477c0b60 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:20.418089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a87a3ff6-5663-491f-821c-7dcb477c0b60 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:20.418616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a87a3ff6-5663-491f-821c-7dcb477c0b60 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:20.419470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a87a3ff6-5663-491f-821c-7dcb477c0b60 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:20.419922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a87a3ff6-5663-491f-821c-7dcb477c0b60 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:20.552944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a87a3ff6-5663-491f-821c-7dcb477c0b60 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:20.585305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a87a3ff6-5663-491f-821c-7dcb477c0b60 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:20.588274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a87a3ff6-5663-491f-821c-7dcb477c0b60 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:20.618019 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a87a3ff6-5663-491f-821c-7dcb477c0b60 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.212347 Jul 26 14:16:20.618019 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1207/2549] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:20 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:20.624662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20f7d848-0b6b-4cea-857a-3ee585cb7828 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:20.625352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-20f7d848-0b6b-4cea-857a-3ee585cb7828 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:20.636658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20f7d848-0b6b-4cea-857a-3ee585cb7828 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:20.637321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20f7d848-0b6b-4cea-857a-3ee585cb7828 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:20.638646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20f7d848-0b6b-4cea-857a-3ee585cb7828 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:20.639251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20f7d848-0b6b-4cea-857a-3ee585cb7828 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:20.916649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-20f7d848-0b6b-4cea-857a-3ee585cb7828 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:20.973145 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-20f7d848-0b6b-4cea-857a-3ee585cb7828 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.342913 Jul 26 14:16:20.986165 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1208/2550] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:20 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:20.991272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-496dff38-67e4-487c-92ec-fc83695fbea3 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:21.007281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-496dff38-67e4-487c-92ec-fc83695fbea3 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:21.052886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-496dff38-67e4-487c-92ec-fc83695fbea3 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:21.058467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-496dff38-67e4-487c-92ec-fc83695fbea3 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:21.068215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-496dff38-67e4-487c-92ec-fc83695fbea3 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:21.070044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-496dff38-67e4-487c-92ec-fc83695fbea3 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:21.366027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-496dff38-67e4-487c-92ec-fc83695fbea3 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:21.371987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:21.383749 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-496dff38-67e4-487c-92ec-fc83695fbea3 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1323 microversion: 2.1 time: 0.396050 Jul 26 14:16:21.384792 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1209/2551] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:20 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1323 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:21.400403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c9d9eb8-5274-4ff6-b0e5-ba9261632ce8 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799409670>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:21.522589 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c9d9eb8-5274-4ff6-b0e5-ba9261632ce8 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1437 microversion: 2.1 time: 0.136497 Jul 26 14:16:21.523195 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1210/2552] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:21 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1437 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:21.529414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d3d8536-1683-4f17-8f5d-265a6eb0d116 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:21.530420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6d3d8536-1683-4f17-8f5d-265a6eb0d116 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:21.551854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d3d8536-1683-4f17-8f5d-265a6eb0d116 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:21.559936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d3d8536-1683-4f17-8f5d-265a6eb0d116 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:21.560847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d3d8536-1683-4f17-8f5d-265a6eb0d116 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:21.561309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d3d8536-1683-4f17-8f5d-265a6eb0d116 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:22.019632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d3d8536-1683-4f17-8f5d-265a6eb0d116 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:22.031521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d3d8536-1683-4f17-8f5d-265a6eb0d116 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:22.033223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d3d8536-1683-4f17-8f5d-265a6eb0d116 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:22.035076 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6d3d8536-1683-4f17-8f5d-265a6eb0d116 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2961 microversion: 2.42 time: 0.510512 Jul 26 14:16:22.045434 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1211/2553] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:21 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2961 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:22.045434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b28f17c2-814b-42c0-b1da-82f1d49b11d3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:22.050853 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b28f17c2-814b-42c0-b1da-82f1d49b11d3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance e7f720f7-360c-41ac-8d3e-b5485fd0c2ea has no mapping to a cell. Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b28f17c2-814b-42c0-b1da-82f1d49b11d3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/e7f720f7-360c-41ac-8d3e-b5485fd0c2ea/action HTTP/1.1 Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 15 Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: {"os-stop": {}} Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance e7f720f7-360c-41ac-8d3e-b5485fd0c2ea has no mapping to a cell. Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e7f720f7-360c-41ac-8d3e-b5485fd0c2ea', 'body': {'os-stop': {}}} Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance e7f720f7-360c-41ac-8d3e-b5485fd0c2ea has no mapping to a cell. Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:16:22.068035 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7f720f7-360c-41ac-8d3e-b5485fd0c2ea has no mapping to a cell. Jul 26 14:16:22.072969 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:22.072969 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:22.072969 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:22.072969 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:22.072969 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:22.072969 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:22.072969 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:16:22.072969 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:16:22.072969 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7f720f7-360c-41ac-8d3e-b5485fd0c2ea has no mapping to a cell. Jul 26 14:16:22.072969 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:22.074541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b28f17c2-814b-42c0-b1da-82f1d49b11d3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance e7f720f7-360c-41ac-8d3e-b5485fd0c2ea has no mapping to a cell. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:16:22.075568 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b28f17c2-814b-42c0-b1da-82f1d49b11d3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e7f720f7-360c-41ac-8d3e-b5485fd0c2ea/action" status: 404 len: 117 microversion: 2.1 time: 0.038493 Jul 26 14:16:22.080856 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1212/2554] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:22 2022] POST /compute/v2.1/servers/e7f720f7-360c-41ac-8d3e-b5485fd0c2ea/action => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:16:22.093991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ff099a41-eb61-472d-8ff5-3ba020058c8a req-5ce53960-4e43-452c-adc3-a6b005e88c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1e35fe-99b6-426a-9c00-890423632b69", "name": "network-vif-plugged", "status": "completed", "tag": "70c52961-0644-4b44-9202-3493a2dafa42"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:22.157982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ff099a41-eb61-472d-8ff5-3ba020058c8a req-5ce53960-4e43-452c-adc3-a6b005e88c30 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:22.164017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ff099a41-eb61-472d-8ff5-3ba020058c8a req-5ce53960-4e43-452c-adc3-a6b005e88c30 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:22.222501 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ff099a41-eb61-472d-8ff5-3ba020058c8a req-5ce53960-4e43-452c-adc3-a6b005e88c30 service nova] Creating event network-vif-plugged:70c52961-0644-4b44-9202-3493a2dafa42 for instance da1e35fe-99b6-426a-9c00-890423632b69 on n-h2-833090-9 Jul 26 14:16:22.245748 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ff099a41-eb61-472d-8ff5-3ba020058c8a req-5ce53960-4e43-452c-adc3-a6b005e88c30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156645 Jul 26 14:16:22.250400 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1213/2555] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:22.281709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-525ce592-dc71-4587-9ec4-9997a801ab95 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:22.286168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-525ce592-dc71-4587-9ec4-9997a801ab95 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:22.300332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-525ce592-dc71-4587-9ec4-9997a801ab95 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:22.301143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-525ce592-dc71-4587-9ec4-9997a801ab95 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:22.302146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-525ce592-dc71-4587-9ec4-9997a801ab95 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:22.302817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-525ce592-dc71-4587-9ec4-9997a801ab95 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:22.463166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-525ce592-dc71-4587-9ec4-9997a801ab95 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:22.482953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-525ce592-dc71-4587-9ec4-9997a801ab95 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:22.488721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-525ce592-dc71-4587-9ec4-9997a801ab95 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:22.490279 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-525ce592-dc71-4587-9ec4-9997a801ab95 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.237067 Jul 26 14:16:22.493576 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1214/2556] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:22 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:22.515145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0bc46f04-c70f-412e-920f-6d5fbf99958e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:22.525500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0bc46f04-c70f-412e-920f-6d5fbf99958e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:22.575340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bc46f04-c70f-412e-920f-6d5fbf99958e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:22.576183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bc46f04-c70f-412e-920f-6d5fbf99958e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:22.577590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bc46f04-c70f-412e-920f-6d5fbf99958e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:22.578233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bc46f04-c70f-412e-920f-6d5fbf99958e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:22.611673 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-773d6002-de8b-4160-a3a8-7f4bf028b88d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4/action" status: 202 len: 0 microversion: 2.1 time: 5.546181 Jul 26 14:16:22.612781 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1343/2557] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:17 2022] POST /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4/action => generated 0 bytes in 5550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:16:22.663362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d28b2f98-dfaa-42f2-a0a3-906f1dfb52f9 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:22.665500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d28b2f98-dfaa-42f2-a0a3-906f1dfb52f9 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:22.685191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28b2f98-dfaa-42f2-a0a3-906f1dfb52f9 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:22.686226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28b2f98-dfaa-42f2-a0a3-906f1dfb52f9 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:22.687354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28b2f98-dfaa-42f2-a0a3-906f1dfb52f9 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:22.688056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28b2f98-dfaa-42f2-a0a3-906f1dfb52f9 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:23.207848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0bc46f04-c70f-412e-920f-6d5fbf99958e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:23.227219 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0bc46f04-c70f-412e-920f-6d5fbf99958e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.728862 Jul 26 14:16:23.241779 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1215/2558] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:22 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:23.284809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af02d44a-df4b-4366-9d99-ddf2fe08815d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799304e50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:23.434150 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af02d44a-df4b-4366-9d99-ddf2fe08815d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1437 microversion: 2.1 time: 0.186787 Jul 26 14:16:23.448307 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1216/2559] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:23 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1437 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:23.465626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-85159d9e-4424-49a6-ae61-7e942fe3da14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:23.465626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-85159d9e-4424-49a6-ae61-7e942fe3da14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:23.518320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85159d9e-4424-49a6-ae61-7e942fe3da14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:23.518320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85159d9e-4424-49a6-ae61-7e942fe3da14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:23.533085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85159d9e-4424-49a6-ae61-7e942fe3da14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:23.533917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85159d9e-4424-49a6-ae61-7e942fe3da14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:23.538534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d28b2f98-dfaa-42f2-a0a3-906f1dfb52f9 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:23.564776 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d28b2f98-dfaa-42f2-a0a3-906f1dfb52f9 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1323 microversion: 2.1 time: 0.949625 Jul 26 14:16:23.568856 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1344/2560] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:22 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1323 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:23.578585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ac7bb6f4-ee23-49f8-833a-a1d1bac75f4e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:23.581161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ac7bb6f4-ee23-49f8-833a-a1d1bac75f4e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:23.609751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac7bb6f4-ee23-49f8-833a-a1d1bac75f4e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:23.610262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac7bb6f4-ee23-49f8-833a-a1d1bac75f4e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:23.611163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac7bb6f4-ee23-49f8-833a-a1d1bac75f4e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:23.611761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac7bb6f4-ee23-49f8-833a-a1d1bac75f4e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:24.206794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-85159d9e-4424-49a6-ae61-7e942fe3da14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:24.228730 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-85159d9e-4424-49a6-ae61-7e942fe3da14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1504 microversion: 2.1 time: 0.786396 Jul 26 14:16:24.229548 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1217/2561] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:23 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1504 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:24.250755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-38ceb64e-955a-4ca4-aa6c-61321aa58351 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:24.251323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-38ceb64e-955a-4ca4-aa6c-61321aa58351 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:24.282471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38ceb64e-955a-4ca4-aa6c-61321aa58351 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:24.283006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38ceb64e-955a-4ca4-aa6c-61321aa58351 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:24.288136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38ceb64e-955a-4ca4-aa6c-61321aa58351 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:24.288691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38ceb64e-955a-4ca4-aa6c-61321aa58351 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:24.384953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ac7bb6f4-ee23-49f8-833a-a1d1bac75f4e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:24.421970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ac7bb6f4-ee23-49f8-833a-a1d1bac75f4e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:24.423848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ac7bb6f4-ee23-49f8-833a-a1d1bac75f4e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:24.425309 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ac7bb6f4-ee23-49f8-833a-a1d1bac75f4e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2961 microversion: 2.42 time: 0.855242 Jul 26 14:16:24.425908 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1345/2562] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:23 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2961 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:24.437415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4c6eb98-6239-4659-a2cb-6ebae29dd1ce tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4d0f7a6a-0f64-43d2-80a3-7af569ea09b5"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:24.464151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e4c6eb98-6239-4659-a2cb-6ebae29dd1ce tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:24.474426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4c6eb98-6239-4659-a2cb-6ebae29dd1ce tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:24.474880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4c6eb98-6239-4659-a2cb-6ebae29dd1ce tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:24.475812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4c6eb98-6239-4659-a2cb-6ebae29dd1ce tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:24.476495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4c6eb98-6239-4659-a2cb-6ebae29dd1ce tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:24.597889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-38ceb64e-955a-4ca4-aa6c-61321aa58351 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:24.622266 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-38ceb64e-955a-4ca4-aa6c-61321aa58351 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.390219 Jul 26 14:16:24.630567 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1218/2563] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:24 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:24.654978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1ffda019-6e76-4c4c-a21d-3b3eda350b37 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:24.656398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1ffda019-6e76-4c4c-a21d-3b3eda350b37 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:24.688272 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e4c6eb98-6239-4659-a2cb-6ebae29dd1ce tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] HTTP exception thrown: Volume d7f177f3-c5b4-4fbc-99e7-84b569786440 could not be found. Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4c6eb98-6239-4659-a2cb-6ebae29dd1ce tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Request method failure captured: Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947/os-volume_attachments/d7f177f3-c5b4-4fbc-99e7-84b569786440 HTTP/1.1 Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 74 Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_aSfH29kWSjDEJY_Sc-KPSpMOoFxyMGFinHizg2l-TzBJpGy44zrd0_L7M1UcpnO9_2pvoD2Z6Byh62ALWUTVfmETCSo21rJf9gCyqUcbr69Afd-7qWZy9Klh4gIAx8qgJbugy7HdrVws30rt7s9OG8IQbOnYUKHMPdoQ8o0HrNu_I Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 909370538d8849cfa87645a6df9434e9 Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesAdminNegativeTest-82692021 Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/909370538d8849cfa87645a6df9434e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/909370538d8849cfa87645a6df9434e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_909370538d8849cfa87645a6df9434e9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/909370538d8849cfa87645a6df9434e9"}]}] Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesAdminNegativeTest-82692021 Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 909370538d8849cfa87645a6df9434e9 Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-82692021 Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesAdminNegativeTest-82692021-project-admin Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: baa52af6bb1a4e2883ced99ff3e156f0 Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesAdminNegativeTest-82692021-project-admin Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: {"volumeAttachment": {"volumeId": "4d0f7a6a-0f64-43d2-80a3-7af569ea09b5"}} Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: exception: Volume d7f177f3-c5b4-4fbc-99e7-84b569786440 could not be found. Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'server_id': 'd7b249a7-0a91-42a1-a4c1-85272a588947', 'id': 'd7f177f3-c5b4-4fbc-99e7-84b569786440', 'body': {'volumeAttachment': {'volumeId': '4d0f7a6a-0f64-43d2-80a3-7af569ea09b5'}}} Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d7f177f3-c5b4-4fbc-99e7-84b569786440 could not be found. (HTTP 404) (Request-ID: req-4aff6212-8dac-4369-bf71-d658ed4a3c98) Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:16:24.689353 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d7f177f3-c5b4-4fbc-99e7-84b569786440 could not be found. Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d7f177f3-c5b4-4fbc-99e7-84b569786440 could not be found. Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d7f177f3-c5b4-4fbc-99e7-84b569786440 could not be found. Jul 26 14:16:24.693335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:24.708845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4c6eb98-6239-4659-a2cb-6ebae29dd1ce tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] Returning 404 to user: Volume d7f177f3-c5b4-4fbc-99e7-84b569786440 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:16:24.709420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ffda019-6e76-4c4c-a21d-3b3eda350b37 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:24.710252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ffda019-6e76-4c4c-a21d-3b3eda350b37 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:24.710760 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4c6eb98-6239-4659-a2cb-6ebae29dd1ce tempest-VolumesAdminNegativeTest-82692021 tempest-VolumesAdminNegativeTest-82692021-project-admin] 10.222.0.70 "PUT /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947/os-volume_attachments/d7f177f3-c5b4-4fbc-99e7-84b569786440" status: 404 len: 109 microversion: 2.1 time: 0.283732 Jul 26 14:16:24.711520 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1346/2564] 10.222.0.70 () {60 vars in 1433 bytes} [Tue Jul 26 14:16:24 2022] PUT /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947/os-volume_attachments/d7f177f3-c5b4-4fbc-99e7-84b569786440 => generated 109 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:16:24.711689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ffda019-6e76-4c4c-a21d-3b3eda350b37 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:24.713087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ffda019-6e76-4c4c-a21d-3b3eda350b37 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:24.740646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57b87571-b2bc-4d92-8263-e0bcb510b347 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f878706be50>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:24.875764 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57b87571-b2bc-4d92-8263-e0bcb510b347 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1437 microversion: 2.1 time: 0.161592 Jul 26 14:16:24.906387 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1347/2565] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:24 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1437 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:24.922724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-01f1a0a4-1179-44a2-8306-c306989d455c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:24.924399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-01f1a0a4-1179-44a2-8306-c306989d455c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:24.944479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01f1a0a4-1179-44a2-8306-c306989d455c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:24.945242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01f1a0a4-1179-44a2-8306-c306989d455c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:24.952681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01f1a0a4-1179-44a2-8306-c306989d455c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:24.953641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01f1a0a4-1179-44a2-8306-c306989d455c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:25.028190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ffda019-6e76-4c4c-a21d-3b3eda350b37 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:25.054227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ffda019-6e76-4c4c-a21d-3b3eda350b37 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:25.058146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ffda019-6e76-4c4c-a21d-3b3eda350b37 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:25.064280 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1ffda019-6e76-4c4c-a21d-3b3eda350b37 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.431649 Jul 26 14:16:25.089429 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1219/2566] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:24 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:25.099537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a8b5376b-d2a1-44d7-9fe8-99022eb65a4f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:25.103804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a8b5376b-d2a1-44d7-9fe8-99022eb65a4f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 539d821c-9caa-45d6-bd19-74bf8fa8afaa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:25.121628 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-a8b5376b-d2a1-44d7-9fe8-99022eb65a4f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 539d821c-9caa-45d6-bd19-74bf8fa8afaa could not be found. Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a8b5376b-d2a1-44d7-9fe8-99022eb65a4f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/539d821c-9caa-45d6-bd19-74bf8fa8afaa/action HTTP/1.1 Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 15 Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: {"suspend": {}} Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 539d821c-9caa-45d6-bd19-74bf8fa8afaa could not be found. Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '539d821c-9caa-45d6-bd19-74bf8fa8afaa', 'body': {'suspend': {}}} Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 539d821c-9caa-45d6-bd19-74bf8fa8afaa could not be found. Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 539d821c-9caa-45d6-bd19-74bf8fa8afaa could not be found. Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:25.123845 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:25.133790 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:16:25.133790 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:16:25.133790 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 539d821c-9caa-45d6-bd19-74bf8fa8afaa could not be found. Jul 26 14:16:25.133790 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:25.145749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a8b5376b-d2a1-44d7-9fe8-99022eb65a4f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 539d821c-9caa-45d6-bd19-74bf8fa8afaa could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:16:25.146938 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a8b5376b-d2a1-44d7-9fe8-99022eb65a4f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/539d821c-9caa-45d6-bd19-74bf8fa8afaa/action" status: 404 len: 111 microversion: 2.1 time: 0.055712 Jul 26 14:16:25.148230 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1220/2567] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:25 2022] POST /compute/v2.1/servers/539d821c-9caa-45d6-bd19-74bf8fa8afaa/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:16:25.157631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e52eaba7-ddea-4f44-8c38-1f64aeed34db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:25.158720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e52eaba7-ddea-4f44-8c38-1f64aeed34db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:25.171662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e52eaba7-ddea-4f44-8c38-1f64aeed34db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:25.179565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e52eaba7-ddea-4f44-8c38-1f64aeed34db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:25.181242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e52eaba7-ddea-4f44-8c38-1f64aeed34db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:25.182306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e52eaba7-ddea-4f44-8c38-1f64aeed34db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:25.476942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-01f1a0a4-1179-44a2-8306-c306989d455c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:25.495426 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-01f1a0a4-1179-44a2-8306-c306989d455c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1323 microversion: 2.1 time: 0.587595 Jul 26 14:16:25.500696 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1348/2568] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:24 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1323 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:25.507340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4370171d-4359-414d-bbe2-fd318c7c69cb req-50e2b8ab-106d-4f53-9fe4-9fa4160a35d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-unplugged", "status": "completed", "tag": "995b58f3-2d21-4838-b5f8-d2d38a7e67b6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:25.552198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4370171d-4359-414d-bbe2-fd318c7c69cb req-50e2b8ab-106d-4f53-9fe4-9fa4160a35d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:25.552581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4370171d-4359-414d-bbe2-fd318c7c69cb req-50e2b8ab-106d-4f53-9fe4-9fa4160a35d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:25.578477 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4370171d-4359-414d-bbe2-fd318c7c69cb req-50e2b8ab-106d-4f53-9fe4-9fa4160a35d4 service nova] Creating event network-vif-unplugged:995b58f3-2d21-4838-b5f8-d2d38a7e67b6 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:25.597726 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4370171d-4359-414d-bbe2-fd318c7c69cb req-50e2b8ab-106d-4f53-9fe4-9fa4160a35d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090107 Jul 26 14:16:25.606194 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1349/2569] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:25.612062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70488591-4bee-4dd2-bc71-211c113d9a9a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:25.613178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70488591-4bee-4dd2-bc71-211c113d9a9a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:25.632279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70488591-4bee-4dd2-bc71-211c113d9a9a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:25.637015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70488591-4bee-4dd2-bc71-211c113d9a9a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:25.638138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70488591-4bee-4dd2-bc71-211c113d9a9a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:25.639088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70488591-4bee-4dd2-bc71-211c113d9a9a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:25.757280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:26.020922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e52eaba7-ddea-4f44-8c38-1f64aeed34db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:26.038782 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e52eaba7-ddea-4f44-8c38-1f64aeed34db tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.884912 Jul 26 14:16:26.039670 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1221/2570] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:25 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:16:26.072842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d5b5d322-43f7-4218-b676-a242fe481c21 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:26.073729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d5b5d322-43f7-4218-b676-a242fe481c21 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:26.080649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5b5d322-43f7-4218-b676-a242fe481c21 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:26.084461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5b5d322-43f7-4218-b676-a242fe481c21 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:26.086461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5b5d322-43f7-4218-b676-a242fe481c21 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:26.087266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5b5d322-43f7-4218-b676-a242fe481c21 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:26.921385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70488591-4bee-4dd2-bc71-211c113d9a9a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:26.940909 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70488591-4bee-4dd2-bc71-211c113d9a9a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1504 microversion: 2.1 time: 1.332854 Jul 26 14:16:26.949647 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1350/2571] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:25 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1504 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:26.969624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-8fa27201-4668-4fc6-b3ec-c4a5ef350bcc req-0c77754e-d640-4c75-adb9-c0e5034a24f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66a91319-e533-46c4-988e-f7480ff27ba4", "name": "network-vif-unplugged", "status": "completed", "tag": "0ab4988a-bac5-4440-ac27-184f1fcd12b8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:27.017044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8fa27201-4668-4fc6-b3ec-c4a5ef350bcc req-0c77754e-d640-4c75-adb9-c0e5034a24f9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:27.025093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8fa27201-4668-4fc6-b3ec-c4a5ef350bcc req-0c77754e-d640-4c75-adb9-c0e5034a24f9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:27.080816 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8fa27201-4668-4fc6-b3ec-c4a5ef350bcc req-0c77754e-d640-4c75-adb9-c0e5034a24f9 service nova] Creating event network-vif-unplugged:0ab4988a-bac5-4440-ac27-184f1fcd12b8 for instance 66a91319-e533-46c4-988e-f7480ff27ba4 on n-h2-833090-9 Jul 26 14:16:27.090187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5b5d322-43f7-4218-b676-a242fe481c21 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:27.101445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5b5d322-43f7-4218-b676-a242fe481c21 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:27.106004 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-8fa27201-4668-4fc6-b3ec-c4a5ef350bcc req-0c77754e-d640-4c75-adb9-c0e5034a24f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152657 Jul 26 14:16:27.107659 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1351/2572] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:27.112915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5b5d322-43f7-4218-b676-a242fe481c21 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:27.114283 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d5b5d322-43f7-4218-b676-a242fe481c21 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2940 microversion: 2.42 time: 1.046216 Jul 26 14:16:27.114881 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1222/2573] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:26 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2940 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:27.117566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f0c13a7-024d-43ed-8ddd-2c1bbe78ef99 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799345ca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:27.131643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fe42be8c-b3eb-46e5-8c8e-6a1b48d640af tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:27.154669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fe42be8c-b3eb-46e5-8c8e-6a1b48d640af tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:27.185049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe42be8c-b3eb-46e5-8c8e-6a1b48d640af tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:27.185613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe42be8c-b3eb-46e5-8c8e-6a1b48d640af tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:27.186569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe42be8c-b3eb-46e5-8c8e-6a1b48d640af tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:27.198080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe42be8c-b3eb-46e5-8c8e-6a1b48d640af tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:27.246294 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f0c13a7-024d-43ed-8ddd-2c1bbe78ef99 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1437 microversion: 2.1 time: 0.136516 Jul 26 14:16:27.247136 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1352/2574] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:27 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1437 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:27.274125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-060b69cb-af5f-48e0-b15d-b0143964cfde tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:27.281337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-060b69cb-af5f-48e0-b15d-b0143964cfde tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:27.299012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-060b69cb-af5f-48e0-b15d-b0143964cfde tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:27.299872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-060b69cb-af5f-48e0-b15d-b0143964cfde tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:27.301131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-060b69cb-af5f-48e0-b15d-b0143964cfde tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:27.304232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-060b69cb-af5f-48e0-b15d-b0143964cfde tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:27.713200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-060b69cb-af5f-48e0-b15d-b0143964cfde tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:27.729078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-060b69cb-af5f-48e0-b15d-b0143964cfde tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:27.731214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-060b69cb-af5f-48e0-b15d-b0143964cfde tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:27.732668 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-060b69cb-af5f-48e0-b15d-b0143964cfde tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.480940 Jul 26 14:16:27.744895 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1353/2575] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:27 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:27.752721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a7b33a0-3300-4c44-8b27-f805c5fe3d98 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:27.768853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0a7b33a0-3300-4c44-8b27-f805c5fe3d98 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:27.788055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a7b33a0-3300-4c44-8b27-f805c5fe3d98 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:27.789254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a7b33a0-3300-4c44-8b27-f805c5fe3d98 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:27.791372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a7b33a0-3300-4c44-8b27-f805c5fe3d98 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:27.792118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a7b33a0-3300-4c44-8b27-f805c5fe3d98 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:28.145554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fe42be8c-b3eb-46e5-8c8e-6a1b48d640af tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:28.183885 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fe42be8c-b3eb-46e5-8c8e-6a1b48d640af tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 1.067508 Jul 26 14:16:28.189538 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1223/2576] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:27 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:28.201922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-304196af-a956-455a-b52f-d91add86a279 req-595b6110-da5a-4d27-b8fb-a98aa335a572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-unplugged", "status": "completed", "tag": "db84c629-f002-4e47-a54a-944c2e55a5d7"}, {"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-unplugged", "status": "completed", "tag": "b923158a-9822-423c-abbf-187f52ae32d2"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:28.209483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0a7b33a0-3300-4c44-8b27-f805c5fe3d98 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:28.244413 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0a7b33a0-3300-4c44-8b27-f805c5fe3d98 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1517 microversion: 2.1 time: 0.496745 Jul 26 14:16:28.259238 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1354/2577] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:27 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1517 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:28.286291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-983a6a6c-ba48-46fa-8f28-8dea65db735e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:28.287776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-983a6a6c-ba48-46fa-8f28-8dea65db735e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:28.308124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-304196af-a956-455a-b52f-d91add86a279 req-595b6110-da5a-4d27-b8fb-a98aa335a572 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:28.310083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-304196af-a956-455a-b52f-d91add86a279 req-595b6110-da5a-4d27-b8fb-a98aa335a572 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:28.343440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-983a6a6c-ba48-46fa-8f28-8dea65db735e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:28.354796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-983a6a6c-ba48-46fa-8f28-8dea65db735e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:28.356214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-983a6a6c-ba48-46fa-8f28-8dea65db735e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:28.357026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-983a6a6c-ba48-46fa-8f28-8dea65db735e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:28.357947 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-304196af-a956-455a-b52f-d91add86a279 req-595b6110-da5a-4d27-b8fb-a98aa335a572 service nova] Creating event network-vif-unplugged:db84c629-f002-4e47-a54a-944c2e55a5d7 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:28.358740 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-304196af-a956-455a-b52f-d91add86a279 req-595b6110-da5a-4d27-b8fb-a98aa335a572 service nova] Creating event network-vif-unplugged:b923158a-9822-423c-abbf-187f52ae32d2 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:28.373712 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-304196af-a956-455a-b52f-d91add86a279 req-595b6110-da5a-4d27-b8fb-a98aa335a572 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.182230 Jul 26 14:16:28.375695 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1224/2578] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:28.403606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f164d040-3923-4bdb-a239-ff69b7319bb5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:28.404378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f164d040-3923-4bdb-a239-ff69b7319bb5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:28.432318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f164d040-3923-4bdb-a239-ff69b7319bb5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:28.435731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f164d040-3923-4bdb-a239-ff69b7319bb5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:28.436865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f164d040-3923-4bdb-a239-ff69b7319bb5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:28.437522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f164d040-3923-4bdb-a239-ff69b7319bb5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:29.142951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f164d040-3923-4bdb-a239-ff69b7319bb5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:29.188165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f164d040-3923-4bdb-a239-ff69b7319bb5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:29.199628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f164d040-3923-4bdb-a239-ff69b7319bb5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:29.205942 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f164d040-3923-4bdb-a239-ff69b7319bb5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2940 microversion: 2.42 time: 0.826586 Jul 26 14:16:29.206607 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1225/2579] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:28 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2940 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:29.234580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a6ea8a02-f44a-4eba-8d4c-4208329a87b0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:29.236329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-983a6a6c-ba48-46fa-8f28-8dea65db735e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:29.241542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a6ea8a02-f44a-4eba-8d4c-4208329a87b0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:29.255237 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-983a6a6c-ba48-46fa-8f28-8dea65db735e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1504 microversion: 2.1 time: 0.978842 Jul 26 14:16:29.260307 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1355/2580] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:28 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1504 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:29.265076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6ea8a02-f44a-4eba-8d4c-4208329a87b0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:29.266065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6ea8a02-f44a-4eba-8d4c-4208329a87b0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:29.268102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6ea8a02-f44a-4eba-8d4c-4208329a87b0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:29.269958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6ea8a02-f44a-4eba-8d4c-4208329a87b0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:29.274401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-59354a3f-3f4e-497a-a86c-419b7c7a174b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f87993af430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:29.414462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-a6ea8a02-f44a-4eba-8d4c-4208329a87b0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lazy-loading 'flavor' on Instance uuid e6b94307-dd41-4f71-b529-c6cbb944c27f {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:16:29.427765 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-59354a3f-3f4e-497a-a86c-419b7c7a174b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1437 microversion: 2.1 time: 0.165951 Jul 26 14:16:29.436159 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1356/2581] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:29 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1437 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:29.451625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-979cb3e8-ce33-4faa-af4c-859e6847b502 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:29.457071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-979cb3e8-ce33-4faa-af4c-859e6847b502 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:29.493061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-979cb3e8-ce33-4faa-af4c-859e6847b502 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:29.497088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-979cb3e8-ce33-4faa-af4c-859e6847b502 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:29.503329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-979cb3e8-ce33-4faa-af4c-859e6847b502 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:29.504645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-979cb3e8-ce33-4faa-af4c-859e6847b502 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:29.619052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-979cb3e8-ce33-4faa-af4c-859e6847b502 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lazy-loading 'flavor' on Instance uuid da1e35fe-99b6-426a-9c00-890423632b69 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:16:29.677770 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a6ea8a02-f44a-4eba-8d4c-4208329a87b0 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 202 len: 0 microversion: 2.1 time: 0.446178 Jul 26 14:16:29.683693 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1226/2582] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:29 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:16:29.707428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca2087da-64db-45a6-b106-5962f624c96f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:29.708207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ca2087da-64db-45a6-b106-5962f624c96f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:29.747659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca2087da-64db-45a6-b106-5962f624c96f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:29.749979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca2087da-64db-45a6-b106-5962f624c96f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:29.751498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca2087da-64db-45a6-b106-5962f624c96f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:29.761843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca2087da-64db-45a6-b106-5962f624c96f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:29.931878 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-979cb3e8-ce33-4faa-af4c-859e6847b502 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "POST /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69/action" status: 200 len: 32 microversion: 2.1 time: 0.491973 Jul 26 14:16:29.941029 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1357/2583] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:29 2022] POST /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69/action => generated 32 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:16:29.967320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ee87210f-4882-480e-947f-f77be435a881 req-85c3d4ea-c5da-4164-ac62-c5c8592383a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66a91319-e533-46c4-988e-f7480ff27ba4", "tag": "0ab4988a-bac5-4440-ac27-184f1fcd12b8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:29.982159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ca2087da-64db-45a6-b106-5962f624c96f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:30.010807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ee87210f-4882-480e-947f-f77be435a881 req-85c3d4ea-c5da-4164-ac62-c5c8592383a0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:30.016148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ee87210f-4882-480e-947f-f77be435a881 req-85c3d4ea-c5da-4164-ac62-c5c8592383a0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:30.025296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ca2087da-64db-45a6-b106-5962f624c96f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:30.035878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ca2087da-64db-45a6-b106-5962f624c96f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:30.044157 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ca2087da-64db-45a6-b106-5962f624c96f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.357884 Jul 26 14:16:30.046144 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1227/2584] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:29 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:30.067520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84806530-6bd6-421e-8bdf-dc2e4cdb1abe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:30.072774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-84806530-6bd6-421e-8bdf-dc2e4cdb1abe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:30.078578 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ee87210f-4882-480e-947f-f77be435a881 req-85c3d4ea-c5da-4164-ac62-c5c8592383a0 service nova] Creating event network-changed:0ab4988a-bac5-4440-ac27-184f1fcd12b8 for instance 66a91319-e533-46c4-988e-f7480ff27ba4 on n-h2-833090-9 Jul 26 14:16:30.105395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84806530-6bd6-421e-8bdf-dc2e4cdb1abe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:30.106310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84806530-6bd6-421e-8bdf-dc2e4cdb1abe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:30.106860 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ee87210f-4882-480e-947f-f77be435a881 req-85c3d4ea-c5da-4164-ac62-c5c8592383a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151751 Jul 26 14:16:30.108263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84806530-6bd6-421e-8bdf-dc2e4cdb1abe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:30.109087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84806530-6bd6-421e-8bdf-dc2e4cdb1abe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:30.121035 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1358/2585] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:30.147360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-41f82e17-ba54-4cab-a0d9-6a478dbb4493 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:30.151476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-41f82e17-ba54-4cab-a0d9-6a478dbb4493 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:30.210327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41f82e17-ba54-4cab-a0d9-6a478dbb4493 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:30.221633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41f82e17-ba54-4cab-a0d9-6a478dbb4493 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:30.228914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41f82e17-ba54-4cab-a0d9-6a478dbb4493 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:30.249031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41f82e17-ba54-4cab-a0d9-6a478dbb4493 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:31.873764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-84806530-6bd6-421e-8bdf-dc2e4cdb1abe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:31.885788 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-84806530-6bd6-421e-8bdf-dc2e4cdb1abe tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1513 microversion: 2.1 time: 1.837642 Jul 26 14:16:31.902663 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1228/2586] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:30 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1513 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:31.915519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-213581bb-b7f7-4073-b2fa-492821169f41 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:31.915723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-213581bb-b7f7-4073-b2fa-492821169f41 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:31.923158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-213581bb-b7f7-4073-b2fa-492821169f41 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:31.923744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-213581bb-b7f7-4073-b2fa-492821169f41 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:31.924675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-213581bb-b7f7-4073-b2fa-492821169f41 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:31.925694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-213581bb-b7f7-4073-b2fa-492821169f41 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:32.028927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-41f82e17-ba54-4cab-a0d9-6a478dbb4493 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:32.062657 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-41f82e17-ba54-4cab-a0d9-6a478dbb4493 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 1.926345 Jul 26 14:16:32.063852 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1359/2587] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:30 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:32.102804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-47aeefdf-24db-42bb-82da-6f42270006bb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:32.104076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47aeefdf-24db-42bb-82da-6f42270006bb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:32.116840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47aeefdf-24db-42bb-82da-6f42270006bb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:32.117290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47aeefdf-24db-42bb-82da-6f42270006bb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:32.121000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47aeefdf-24db-42bb-82da-6f42270006bb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:32.121000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47aeefdf-24db-42bb-82da-6f42270006bb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:32.841711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47aeefdf-24db-42bb-82da-6f42270006bb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:32.849659 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-47aeefdf-24db-42bb-82da-6f42270006bb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1504 microversion: 2.1 time: 0.762761 Jul 26 14:16:32.856264 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1360/2588] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:32 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1504 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:32.867203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-30ed113a-6d97-4925-b7fd-513228ff026c req-e8b3c4b4-1fb2-439a-859e-7f4c6c5b4c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-unplugged", "status": "completed", "tag": "989be3eb-05ab-401f-a4a3-8eb746b5d1b3"}, {"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-unplugged", "status": "completed", "tag": "8440feb4-5af7-47f7-93be-a1f774aeb7ab"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:32.879823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-30ed113a-6d97-4925-b7fd-513228ff026c req-e8b3c4b4-1fb2-439a-859e-7f4c6c5b4c1c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:32.881033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-30ed113a-6d97-4925-b7fd-513228ff026c req-e8b3c4b4-1fb2-439a-859e-7f4c6c5b4c1c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:32.910882 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-30ed113a-6d97-4925-b7fd-513228ff026c req-e8b3c4b4-1fb2-439a-859e-7f4c6c5b4c1c service nova] Creating event network-vif-unplugged:989be3eb-05ab-401f-a4a3-8eb746b5d1b3 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:32.912143 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-30ed113a-6d97-4925-b7fd-513228ff026c req-e8b3c4b4-1fb2-439a-859e-7f4c6c5b4c1c service nova] Creating event network-vif-unplugged:8440feb4-5af7-47f7-93be-a1f774aeb7ab for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:32.927387 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-30ed113a-6d97-4925-b7fd-513228ff026c req-e8b3c4b4-1fb2-439a-859e-7f4c6c5b4c1c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.067149 Jul 26 14:16:32.931589 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1361/2589] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:32.945225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-213581bb-b7f7-4073-b2fa-492821169f41 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:32.952232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c5b400f7-5dbc-4c64-ae8f-8bafbf4d6e3f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799272b80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:32.964802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-213581bb-b7f7-4073-b2fa-492821169f41 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:32.970654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-213581bb-b7f7-4073-b2fa-492821169f41 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:32.981151 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-213581bb-b7f7-4073-b2fa-492821169f41 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2919 microversion: 2.42 time: 1.075519 Jul 26 14:16:32.995748 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1229/2590] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:31 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2919 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:33.019185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7299bb3-d9ba-4237-846f-1743ffa7eab3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:33.024717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c7299bb3-d9ba-4237-846f-1743ffa7eab3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:33.059907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7299bb3-d9ba-4237-846f-1743ffa7eab3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.060424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7299bb3-d9ba-4237-846f-1743ffa7eab3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.061240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7299bb3-d9ba-4237-846f-1743ffa7eab3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.061689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7299bb3-d9ba-4237-846f-1743ffa7eab3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.086638 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c5b400f7-5dbc-4c64-ae8f-8bafbf4d6e3f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1446 microversion: 2.1 time: 0.151786 Jul 26 14:16:33.090329 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1362/2591] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:32 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:33.109515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:33.112671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6361c33b-e49b-4d21-9d2d-9546832c0c4c tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:33.115559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6361c33b-e49b-4d21-9d2d-9546832c0c4c tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:33.133111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6361c33b-e49b-4d21-9d2d-9546832c0c4c tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.141460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6361c33b-e49b-4d21-9d2d-9546832c0c4c tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.144168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6361c33b-e49b-4d21-9d2d-9546832c0c4c tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.144806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6361c33b-e49b-4d21-9d2d-9546832c0c4c tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.157883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c7299bb3-d9ba-4237-846f-1743ffa7eab3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:16:33.299319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6361c33b-e49b-4d21-9d2d-9546832c0c4c tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:33.311183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6361c33b-e49b-4d21-9d2d-9546832c0c4c tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:33.312706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6361c33b-e49b-4d21-9d2d-9546832c0c4c tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:33.314710 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6361c33b-e49b-4d21-9d2d-9546832c0c4c tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.222411 Jul 26 14:16:33.315008 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1363/2592] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:33 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:33.340166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-8aa60d5a-ec96-4c22-b548-cc3624e38c19 req-5a76df90-232a-49cf-9b39-c794d9dcb88a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66a91319-e533-46c4-988e-f7480ff27ba4", "name": "network-vif-unplugged", "status": "completed", "tag": "0ab4988a-bac5-4440-ac27-184f1fcd12b8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:33.380388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8aa60d5a-ec96-4c22-b548-cc3624e38c19 req-5a76df90-232a-49cf-9b39-c794d9dcb88a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.380835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8aa60d5a-ec96-4c22-b548-cc3624e38c19 req-5a76df90-232a-49cf-9b39-c794d9dcb88a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.398628 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c7299bb3-d9ba-4237-846f-1743ffa7eab3 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 204 len: 0 microversion: 2.1 time: 0.400222 Jul 26 14:16:33.402298 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1230/2593] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:16:32 2022] DELETE /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:16:33.425950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a68ca4dc-b0c1-4807-9085-a351e96633ec tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:33.426675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a68ca4dc-b0c1-4807-9085-a351e96633ec tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:33.437092 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8aa60d5a-ec96-4c22-b548-cc3624e38c19 req-5a76df90-232a-49cf-9b39-c794d9dcb88a service nova] Creating event network-vif-unplugged:0ab4988a-bac5-4440-ac27-184f1fcd12b8 for instance 66a91319-e533-46c4-988e-f7480ff27ba4 on n-h2-833090-9 Jul 26 14:16:33.463560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a68ca4dc-b0c1-4807-9085-a351e96633ec tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.463871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a68ca4dc-b0c1-4807-9085-a351e96633ec tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.464753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a68ca4dc-b0c1-4807-9085-a351e96633ec tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.465116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a68ca4dc-b0c1-4807-9085-a351e96633ec tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.468290 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-8aa60d5a-ec96-4c22-b548-cc3624e38c19 req-5a76df90-232a-49cf-9b39-c794d9dcb88a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121803 Jul 26 14:16:33.477477 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1364/2594] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:33.483686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04e77168-2c69-4b62-b32e-a0b0f2ea5c2e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:33.484700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-04e77168-2c69-4b62-b32e-a0b0f2ea5c2e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:33.492399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04e77168-2c69-4b62-b32e-a0b0f2ea5c2e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.494019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04e77168-2c69-4b62-b32e-a0b0f2ea5c2e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.495273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04e77168-2c69-4b62-b32e-a0b0f2ea5c2e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.496293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04e77168-2c69-4b62-b32e-a0b0f2ea5c2e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.854837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-04e77168-2c69-4b62-b32e-a0b0f2ea5c2e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:33.869516 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-04e77168-2c69-4b62-b32e-a0b0f2ea5c2e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.390303 Jul 26 14:16:33.870556 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1365/2595] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:33 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:33.876114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-617e1736-113e-4650-a469-515504490c36 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f879938ff70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:33.878309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a68ca4dc-b0c1-4807-9085-a351e96633ec tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:33.896998 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a68ca4dc-b0c1-4807-9085-a351e96633ec tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1496 microversion: 2.1 time: 0.492898 Jul 26 14:16:33.897400 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1231/2596] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:33 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1496 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:33.902621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-10d86f28-2684-4754-988e-b8493f8fd042 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:33.903236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-10d86f28-2684-4754-988e-b8493f8fd042 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:33.910081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10d86f28-2684-4754-988e-b8493f8fd042 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.910737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10d86f28-2684-4754-988e-b8493f8fd042 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.911648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10d86f28-2684-4754-988e-b8493f8fd042 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.912256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-10d86f28-2684-4754-988e-b8493f8fd042 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.952601 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-617e1736-113e-4650-a469-515504490c36 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 200 len: 1446 microversion: 2.1 time: 0.080565 Jul 26 14:16:33.953198 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1366/2597] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:16:33 2022] GET /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 1446 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:33.959667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4832defc-9ac3-4107-926f-93d05ebc666e req-edfea7b0-549e-49d3-8433-6be8d147817e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-deleted", "tag": "672376f8-b9e7-4c34-b66d-00f8e644af8a"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:33.971140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4832defc-9ac3-4107-926f-93d05ebc666e req-edfea7b0-549e-49d3-8433-6be8d147817e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:33.971899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4832defc-9ac3-4107-926f-93d05ebc666e req-edfea7b0-549e-49d3-8433-6be8d147817e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:33.976185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:33.987256 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4832defc-9ac3-4107-926f-93d05ebc666e req-edfea7b0-549e-49d3-8433-6be8d147817e service nova] Creating event network-vif-deleted:672376f8-b9e7-4c34-b66d-00f8e644af8a for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:33.994784 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4832defc-9ac3-4107-926f-93d05ebc666e req-edfea7b0-549e-49d3-8433-6be8d147817e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040204 Jul 26 14:16:33.995688 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1367/2598] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:34.001305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f07c7630-e6c9-4d9e-9358-bf337f07bbd1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:34.002444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f07c7630-e6c9-4d9e-9358-bf337f07bbd1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:34.011337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f07c7630-e6c9-4d9e-9358-bf337f07bbd1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:34.011692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f07c7630-e6c9-4d9e-9358-bf337f07bbd1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:34.012617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f07c7630-e6c9-4d9e-9358-bf337f07bbd1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:34.012968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f07c7630-e6c9-4d9e-9358-bf337f07bbd1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:34.298740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-10d86f28-2684-4754-988e-b8493f8fd042 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:34.318021 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-10d86f28-2684-4754-988e-b8493f8fd042 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1514 microversion: 2.1 time: 0.418777 Jul 26 14:16:34.319818 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1232/2599] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:33 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1514 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:34.329524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:34.330454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:34.345144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:34.345651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:34.348835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:34.349550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:34.362102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f07c7630-e6c9-4d9e-9358-bf337f07bbd1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:34.377181 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f07c7630-e6c9-4d9e-9358-bf337f07bbd1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1504 microversion: 2.1 time: 0.379441 Jul 26 14:16:34.378412 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1368/2600] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:33 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:34.387294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f50a681-d86f-4968-9ed4-c01eb7f02d57 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f87993af430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:34.397724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lazy-loading 'flavor' on Instance uuid e6b94307-dd41-4f71-b529-c6cbb944c27f {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:16:34.415356 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Cannot 'suspend' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state suspended Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action HTTP/1.1 Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 15 Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: {"suspend": {}} Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: exception: Cannot 'suspend' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state suspended Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e6b94307-dd41-4f71-b529-c6cbb944c27f', 'body': {'suspend': {}}} Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f in vm_state suspended. Cannot suspend while the instance is in this state. Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 26 14:16:34.418132 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state suspended Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state suspended Jul 26 14:16:34.422662 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:34.423509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 409 to user: Cannot 'suspend' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state suspended {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:16:34.424223 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-82830924-793f-4f68-8e97-a44414cfb063 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 409 len: 148 microversion: 2.1 time: 0.101854 Jul 26 14:16:34.424536 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1233/2601] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:34 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 148 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:16:34.438209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-15865de0-d028-4d95-96d7-0b1354767294 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:34.438866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-15865de0-d028-4d95-96d7-0b1354767294 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:34.446447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15865de0-d028-4d95-96d7-0b1354767294 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:34.447432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15865de0-d028-4d95-96d7-0b1354767294 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:34.448365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15865de0-d028-4d95-96d7-0b1354767294 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:34.448880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15865de0-d028-4d95-96d7-0b1354767294 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:34.917411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-15865de0-d028-4d95-96d7-0b1354767294 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:34.927164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-15865de0-d028-4d95-96d7-0b1354767294 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:34.928718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-15865de0-d028-4d95-96d7-0b1354767294 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:34.930010 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-15865de0-d028-4d95-96d7-0b1354767294 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2533 microversion: 2.42 time: 0.504437 Jul 26 14:16:34.930578 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1234/2602] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:34 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2533 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:34.938815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6f28d6d3-4088-4c6e-8b9e-f0f77dacf7d3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:34.939443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6f28d6d3-4088-4c6e-8b9e-f0f77dacf7d3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:34.979520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f28d6d3-4088-4c6e-8b9e-f0f77dacf7d3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:34.984745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f28d6d3-4088-4c6e-8b9e-f0f77dacf7d3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:34.985609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f28d6d3-4088-4c6e-8b9e-f0f77dacf7d3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:34.986043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f28d6d3-4088-4c6e-8b9e-f0f77dacf7d3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.185812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6f28d6d3-4088-4c6e-8b9e-f0f77dacf7d3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:35.194417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6f28d6d3-4088-4c6e-8b9e-f0f77dacf7d3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:35.203264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6f28d6d3-4088-4c6e-8b9e-f0f77dacf7d3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:35.204708 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6f28d6d3-4088-4c6e-8b9e-f0f77dacf7d3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.272984 Jul 26 14:16:35.206096 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1235/2603] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:34 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:35.220568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-154ce678-4f23-4dd5-a845-07a167d27f6a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:35.221613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-154ce678-4f23-4dd5-a845-07a167d27f6a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:35.240909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-154ce678-4f23-4dd5-a845-07a167d27f6a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.241521 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4f50a681-d86f-4968-9ed4-c01eb7f02d57 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 204 len: 0 microversion: 2.1 time: 0.861559 Jul 26 14:16:35.241882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-154ce678-4f23-4dd5-a845-07a167d27f6a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.242278 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1369/2604] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:34 2022] DELETE /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:16:35.243756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-154ce678-4f23-4dd5-a845-07a167d27f6a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.246639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-154ce678-4f23-4dd5-a845-07a167d27f6a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.248343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df98f3fa-72ac-4730-9181-9010f2115121 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:35.249292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df98f3fa-72ac-4730-9181-9010f2115121 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:35.255100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:35.296061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df98f3fa-72ac-4730-9181-9010f2115121 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.296857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df98f3fa-72ac-4730-9181-9010f2115121 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.299298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df98f3fa-72ac-4730-9181-9010f2115121 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.300336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df98f3fa-72ac-4730-9181-9010f2115121 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.354162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-154ce678-4f23-4dd5-a845-07a167d27f6a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 202 len: 0 microversion: 2.1 time: 0.143164 Jul 26 14:16:35.358359 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1236/2605] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:35 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:16:35.369423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-948779e3-9f30-46e8-a3bf-0211277731c9 req-2d607e38-3128-42a4-88cb-0591f6395ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-unplugged", "status": "completed", "tag": "672376f8-b9e7-4c34-b66d-00f8e644af8a"}, {"server_uuid": "20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c", "name": "network-vif-unplugged", "status": "completed", "tag": "0522387b-5774-45c6-a116-88891b1f1994"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:35.405465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-948779e3-9f30-46e8-a3bf-0211277731c9 req-2d607e38-3128-42a4-88cb-0591f6395ea3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.405960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-948779e3-9f30-46e8-a3bf-0211277731c9 req-2d607e38-3128-42a4-88cb-0591f6395ea3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.436862 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-948779e3-9f30-46e8-a3bf-0211277731c9 req-2d607e38-3128-42a4-88cb-0591f6395ea3 service nova] Creating event network-vif-unplugged:672376f8-b9e7-4c34-b66d-00f8e644af8a for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:35.437363 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-948779e3-9f30-46e8-a3bf-0211277731c9 req-2d607e38-3128-42a4-88cb-0591f6395ea3 service nova] Creating event network-vif-unplugged:0522387b-5774-45c6-a116-88891b1f1994 for instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c on n-h1-833090-9 Jul 26 14:16:35.462302 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-948779e3-9f30-46e8-a3bf-0211277731c9 req-2d607e38-3128-42a4-88cb-0591f6395ea3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.101672 Jul 26 14:16:35.463390 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1237/2606] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:35.480681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-96c2ba18-0604-4f63-a836-da0939150418 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:35.481276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-96c2ba18-0604-4f63-a836-da0939150418 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:35.493680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96c2ba18-0604-4f63-a836-da0939150418 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.494137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96c2ba18-0604-4f63-a836-da0939150418 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.494931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96c2ba18-0604-4f63-a836-da0939150418 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.495369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96c2ba18-0604-4f63-a836-da0939150418 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.545405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-96c2ba18-0604-4f63-a836-da0939150418 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:16:35.663918 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-96c2ba18-0604-4f63-a836-da0939150418 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 204 len: 0 microversion: 2.1 time: 0.198069 Jul 26 14:16:35.676775 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1238/2607] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:16:35 2022] DELETE /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:16:35.683666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e7dbd1bd-1f35-4c61-807c-7b52b4c6e5c7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:35.684417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e7dbd1bd-1f35-4c61-807c-7b52b4c6e5c7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:35.691440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7dbd1bd-1f35-4c61-807c-7b52b4c6e5c7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.692256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7dbd1bd-1f35-4c61-807c-7b52b4c6e5c7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.692790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7dbd1bd-1f35-4c61-807c-7b52b4c6e5c7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.693271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7dbd1bd-1f35-4c61-807c-7b52b4c6e5c7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.874686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df98f3fa-72ac-4730-9181-9010f2115121 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:35.882907 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df98f3fa-72ac-4730-9181-9010f2115121 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.638801 Jul 26 14:16:35.894316 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1370/2608] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:35 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:35.901623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ee0f543b-9932-4c8d-9ae5-3da346e0c81a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:35.902575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ee0f543b-9932-4c8d-9ae5-3da346e0c81a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:35.913073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee0f543b-9932-4c8d-9ae5-3da346e0c81a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.913683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee0f543b-9932-4c8d-9ae5-3da346e0c81a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:35.914818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee0f543b-9932-4c8d-9ae5-3da346e0c81a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:35.915382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee0f543b-9932-4c8d-9ae5-3da346e0c81a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:36.052619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e7dbd1bd-1f35-4c61-807c-7b52b4c6e5c7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:36.062732 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e7dbd1bd-1f35-4c61-807c-7b52b4c6e5c7 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1514 microversion: 2.1 time: 0.384485 Jul 26 14:16:36.063628 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1239/2609] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:35 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1514 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:36.081074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-54455931-09e2-4040-9ab9-23537b192967 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:36.082349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-54455931-09e2-4040-9ab9-23537b192967 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:36.096192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54455931-09e2-4040-9ab9-23537b192967 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:36.096880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54455931-09e2-4040-9ab9-23537b192967 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:36.098246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54455931-09e2-4040-9ab9-23537b192967 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:36.098880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54455931-09e2-4040-9ab9-23537b192967 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:36.397772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ee0f543b-9932-4c8d-9ae5-3da346e0c81a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:36.408383 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ee0f543b-9932-4c8d-9ae5-3da346e0c81a tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1502 microversion: 2.1 time: 0.512558 Jul 26 14:16:36.422842 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1371/2610] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:35 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1502 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:36.434884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1820614852", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "08dc4566-921c-4f62-8f9a-1a9e3f005bb9"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:36.484834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-54455931-09e2-4040-9ab9-23537b192967 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:36.494908 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-54455931-09e2-4040-9ab9-23537b192967 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1504 microversion: 2.1 time: 0.429649 Jul 26 14:16:36.495550 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1240/2611] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:36 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:36.500779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fc51a403-7afc-4292-9d14-d2a4a6d84d99 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:36.501218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] validate_networks() for [('08dc4566-921c-4f62-8f9a-1a9e3f005bb9', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:16:36.501939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fc51a403-7afc-4292-9d14-d2a4a6d84d99 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:36.508821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc51a403-7afc-4292-9d14-d2a4a6d84d99 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:36.509485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc51a403-7afc-4292-9d14-d2a4a6d84d99 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:36.510517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc51a403-7afc-4292-9d14-d2a4a6d84d99 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:36.511116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc51a403-7afc-4292-9d14-d2a4a6d84d99 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:37.230843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fc51a403-7afc-4292-9d14-d2a4a6d84d99 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:37.240523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fc51a403-7afc-4292-9d14-d2a4a6d84d99 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:37.242040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fc51a403-7afc-4292-9d14-d2a4a6d84d99 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:37.244124 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fc51a403-7afc-4292-9d14-d2a4a6d84d99 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2486 microversion: 2.42 time: 0.747059 Jul 26 14:16:37.244718 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1241/2612] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:36 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2486 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:37.256091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-df8924ab-fa8a-4a9a-8c74-391dbcb4292a req-4b3171d0-c0ae-4003-9e1b-9226f3072767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-deleted", "tag": "989be3eb-05ab-401f-a4a3-8eb746b5d1b3"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:37.259823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-df8924ab-fa8a-4a9a-8c74-391dbcb4292a req-4b3171d0-c0ae-4003-9e1b-9226f3072767 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:37.260541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-df8924ab-fa8a-4a9a-8c74-391dbcb4292a req-4b3171d0-c0ae-4003-9e1b-9226f3072767 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:37.281495 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-df8924ab-fa8a-4a9a-8c74-391dbcb4292a req-4b3171d0-c0ae-4003-9e1b-9226f3072767 service nova] Creating event network-vif-deleted:989be3eb-05ab-401f-a4a3-8eb746b5d1b3 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:37.286978 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-df8924ab-fa8a-4a9a-8c74-391dbcb4292a req-4b3171d0-c0ae-4003-9e1b-9226f3072767 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040858 Jul 26 14:16:37.287651 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1242/2613] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:37.295006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-97cb9ef1-a9ef-4b6a-b84d-293622604f6a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:37.295845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-97cb9ef1-a9ef-4b6a-b84d-293622604f6a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:37.303158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97cb9ef1-a9ef-4b6a-b84d-293622604f6a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:37.303612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97cb9ef1-a9ef-4b6a-b84d-293622604f6a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:37.304576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97cb9ef1-a9ef-4b6a-b84d-293622604f6a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:37.304941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97cb9ef1-a9ef-4b6a-b84d-293622604f6a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:37.464281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-97cb9ef1-a9ef-4b6a-b84d-293622604f6a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:37.469300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:37.484335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-97cb9ef1-a9ef-4b6a-b84d-293622604f6a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:37.486684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-97cb9ef1-a9ef-4b6a-b84d-293622604f6a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:37.487885 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-97cb9ef1-a9ef-4b6a-b84d-293622604f6a tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.198777 Jul 26 14:16:37.489030 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1243/2614] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:37 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:37.506414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-068988c3-7312-4a09-9d6a-5741cdfcc07b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:37.507351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-068988c3-7312-4a09-9d6a-5741cdfcc07b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:37.514306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:37.516457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-068988c3-7312-4a09-9d6a-5741cdfcc07b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:37.517231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-068988c3-7312-4a09-9d6a-5741cdfcc07b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:37.518518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-068988c3-7312-4a09-9d6a-5741cdfcc07b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:37.519336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-068988c3-7312-4a09-9d6a-5741cdfcc07b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:38.045897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-068988c3-7312-4a09-9d6a-5741cdfcc07b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:38.063695 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-068988c3-7312-4a09-9d6a-5741cdfcc07b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.573230 Jul 26 14:16:38.064506 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1244/2615] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:37 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:38.069607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:38.071062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:38.078863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:38.079439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:38.080505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:38.081054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:38.125381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:16:38.127459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:16:38.128310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:16:38.129005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:16:38.129687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:16:38.134945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:38.135552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:38.136234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lazy-loading 'fault' on Instance uuid d7b249a7-0a91-42a1-a4c1-85272a588947 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:16:38.150242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:38.151422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:38.152560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:38.153167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:38.175467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Getting quotas for project af3d0a242a34482d8737db7862279e87. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:16:38.183402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Getting quotas for user f94de8d57f854570b3ceda6ae5e7b9ae and project af3d0a242a34482d8737db7862279e87. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:16:38.201061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:16:38.204067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:16:38.284365 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c0e608f0-bbd6-433f-8fa8-ef81039cff98 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.855355 Jul 26 14:16:38.285527 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1372/2616] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:16:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:16:38.299385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6a5eb481-4588-4887-a76d-702312adc25b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:38.300292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6a5eb481-4588-4887-a76d-702312adc25b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:38.309729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a5eb481-4588-4887-a76d-702312adc25b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:38.310521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a5eb481-4588-4887-a76d-702312adc25b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:38.312551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a5eb481-4588-4887-a76d-702312adc25b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:38.313328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a5eb481-4588-4887-a76d-702312adc25b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:38.322821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:38.344513 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0e9af1ef-eeb0-446b-9704-ba36eba2c4ec tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 200 len: 1307 microversion: 2.1 time: 0.278576 Jul 26 14:16:38.345417 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1245/2617] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:38 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 1307 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:38.373932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9540df4-085d-40f8-be2d-6e9c012d3c73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:38.376139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d9540df4-085d-40f8-be2d-6e9c012d3c73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:38.393900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9540df4-085d-40f8-be2d-6e9c012d3c73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:38.397259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9540df4-085d-40f8-be2d-6e9c012d3c73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:38.399109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9540df4-085d-40f8-be2d-6e9c012d3c73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:38.399739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9540df4-085d-40f8-be2d-6e9c012d3c73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.152491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6a5eb481-4588-4887-a76d-702312adc25b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:39.157276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d9540df4-085d-40f8-be2d-6e9c012d3c73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:39.166796 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d9540df4-085d-40f8-be2d-6e9c012d3c73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1494 microversion: 2.1 time: 0.796896 Jul 26 14:16:39.167395 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1246/2618] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:38 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1494 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:39.183731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6e0a8fe4-7aa0-41bd-8793-eed98397f41f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:39.184667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6e0a8fe4-7aa0-41bd-8793-eed98397f41f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:39.201958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e0a8fe4-7aa0-41bd-8793-eed98397f41f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.202538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e0a8fe4-7aa0-41bd-8793-eed98397f41f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.202797 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6a5eb481-4588-4887-a76d-702312adc25b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1502 microversion: 2.1 time: 0.914684 Jul 26 14:16:39.203754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e0a8fe4-7aa0-41bd-8793-eed98397f41f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.205565 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1373/2619] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:38 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1502 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:39.207602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e0a8fe4-7aa0-41bd-8793-eed98397f41f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.225636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0340841e-b45f-4899-8fc6-a58db7151490 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:39.226409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0340841e-b45f-4899-8fc6-a58db7151490 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:39.236016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0340841e-b45f-4899-8fc6-a58db7151490 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.236674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0340841e-b45f-4899-8fc6-a58db7151490 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.238258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0340841e-b45f-4899-8fc6-a58db7151490 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.238932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0340841e-b45f-4899-8fc6-a58db7151490 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.375728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0340841e-b45f-4899-8fc6-a58db7151490 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:39.386494 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0340841e-b45f-4899-8fc6-a58db7151490 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1204 microversion: 2.1 time: 0.177760 Jul 26 14:16:39.387420 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1374/2620] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:39 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1204 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:39.394129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da913a0a-9450-4641-8131-1e494d17ce13 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:39.394904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-da913a0a-9450-4641-8131-1e494d17ce13 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:39.417334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da913a0a-9450-4641-8131-1e494d17ce13 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.418019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da913a0a-9450-4641-8131-1e494d17ce13 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.419285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da913a0a-9450-4641-8131-1e494d17ce13 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.419745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da913a0a-9450-4641-8131-1e494d17ce13 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.595720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da913a0a-9450-4641-8131-1e494d17ce13 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:39.627852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da913a0a-9450-4641-8131-1e494d17ce13 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:39.631851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da913a0a-9450-4641-8131-1e494d17ce13 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:39.634677 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-da913a0a-9450-4641-8131-1e494d17ce13 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.245736 Jul 26 14:16:39.635913 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1375/2621] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:39 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:39.645119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-fe3e1c1a-d49f-41af-adde-77985a396a7d req-8fd3bfb9-7290-4fee-8d57-829da57d9e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c", "name": "network-vif-deleted", "tag": "0522387b-5774-45c6-a116-88891b1f1994"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:39.665060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fe3e1c1a-d49f-41af-adde-77985a396a7d req-8fd3bfb9-7290-4fee-8d57-829da57d9e4d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.665323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6e0a8fe4-7aa0-41bd-8793-eed98397f41f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:39.666530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fe3e1c1a-d49f-41af-adde-77985a396a7d req-8fd3bfb9-7290-4fee-8d57-829da57d9e4d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.680758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6e0a8fe4-7aa0-41bd-8793-eed98397f41f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:39.683706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6e0a8fe4-7aa0-41bd-8793-eed98397f41f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:39.685814 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6e0a8fe4-7aa0-41bd-8793-eed98397f41f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 2325 microversion: 2.42 time: 0.513107 Jul 26 14:16:39.686489 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-fe3e1c1a-d49f-41af-adde-77985a396a7d req-8fd3bfb9-7290-4fee-8d57-829da57d9e4d service nova] Creating event network-vif-deleted:0522387b-5774-45c6-a116-88891b1f1994 for instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c on n-h1-833090-9 Jul 26 14:16:39.692361 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-fe3e1c1a-d49f-41af-adde-77985a396a7d req-8fd3bfb9-7290-4fee-8d57-829da57d9e4d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054604 Jul 26 14:16:39.693786 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1376/2622] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:39.700464 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1247/2623] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:39 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 2325 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:39.702251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c2d9ac0e-cee1-4809-bfe3-0b74023228ad tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:39.703429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c2d9ac0e-cee1-4809-bfe3-0b74023228ad tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:39.709952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32438955-279d-42df-a9ef-16d2ed5433a2 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '.version_select at 0x7f879936a040>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:39.713638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2d9ac0e-cee1-4809-bfe3-0b74023228ad tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.714151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2d9ac0e-cee1-4809-bfe3-0b74023228ad tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.715263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2d9ac0e-cee1-4809-bfe3-0b74023228ad tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.715835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2d9ac0e-cee1-4809-bfe3-0b74023228ad tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.717544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32438955-279d-42df-a9ef-16d2ed5433a2 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.718292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32438955-279d-42df-a9ef-16d2ed5433a2 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.731728 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32438955-279d-42df-a9ef-16d2ed5433a2 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.029933 Jul 26 14:16:39.740912 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1248/2624] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:16:39 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:39.746817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-18d7d478-22e6-4824-850d-771d521aaa25 req-5ed102bc-30f9-4f7b-8e0e-90994dc0b3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-deleted", "tag": "db84c629-f002-4e47-a54a-944c2e55a5d7"}, {"server_uuid": "d7b249a7-0a91-42a1-a4c1-85272a588947", "name": "network-vif-deleted", "tag": "a725abbe-5c65-46b5-b00d-577459cfb075"}, {"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-deleted", "tag": "b923158a-9822-423c-abbf-187f52ae32d2"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:39.760238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-18d7d478-22e6-4824-850d-771d521aaa25 req-5ed102bc-30f9-4f7b-8e0e-90994dc0b3d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.761337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-18d7d478-22e6-4824-850d-771d521aaa25 req-5ed102bc-30f9-4f7b-8e0e-90994dc0b3d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.776452 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-18d7d478-22e6-4824-850d-771d521aaa25 req-5ed102bc-30f9-4f7b-8e0e-90994dc0b3d4 service nova] Creating event network-vif-deleted:db84c629-f002-4e47-a54a-944c2e55a5d7 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:39.777697 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-18d7d478-22e6-4824-850d-771d521aaa25 req-5ed102bc-30f9-4f7b-8e0e-90994dc0b3d4 service nova] Creating event network-vif-deleted:a725abbe-5c65-46b5-b00d-577459cfb075 for instance d7b249a7-0a91-42a1-a4c1-85272a588947 on n-h1-833090-9 Jul 26 14:16:39.778376 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-18d7d478-22e6-4824-850d-771d521aaa25 req-5ed102bc-30f9-4f7b-8e0e-90994dc0b3d4 service nova] Creating event network-vif-deleted:b923158a-9822-423c-abbf-187f52ae32d2 for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:39.793565 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-18d7d478-22e6-4824-850d-771d521aaa25 req-5ed102bc-30f9-4f7b-8e0e-90994dc0b3d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051084 Jul 26 14:16:39.795238 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1249/2625] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:39.799604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-94d166c7-661c-4f5f-ba0f-e37a59e3a12b tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:39.800333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-94d166c7-661c-4f5f-ba0f-e37a59e3a12b tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: d7b249a7-0a91-42a1-a4c1-85272a588947] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:39.809274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94d166c7-661c-4f5f-ba0f-e37a59e3a12b tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.809728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94d166c7-661c-4f5f-ba0f-e37a59e3a12b tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.810824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94d166c7-661c-4f5f-ba0f-e37a59e3a12b tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.811617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94d166c7-661c-4f5f-ba0f-e37a59e3a12b tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.828887 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-94d166c7-661c-4f5f-ba0f-e37a59e3a12b tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] HTTP exception thrown: Instance d7b249a7-0a91-42a1-a4c1-85272a588947 could not be found. Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-94d166c7-661c-4f5f-ba0f-e37a59e3a12b tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Request method failure captured: Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 HTTP/1.1 Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_aD4he09CLa-J1r_-KV_9tm8xU-O8cXQiL9FmKztpB7JedT05AwjLzjoFWH3JZoH_9H7S4ZHR9hkw3jEMeZh6ZHa0QKPTr579Ol-vTHg8Ag8d6Ds6XG2el1-PUqZXIGgsXfRKgGwVldtzrC6Xe-TVZeP7Ty0Rl82nv30MwCKkDRcUU Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 98c00816adb64fa4ad579cef5acc13d9 Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-VolumesAdminNegativeTest-1405006507 Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/98c00816adb64fa4ad579cef5acc13d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/98c00816adb64fa4ad579cef5acc13d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_98c00816adb64fa4ad579cef5acc13d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/98c00816adb64fa4ad579cef5acc13d9"}]}] Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-VolumesAdminNegativeTest-1405006507 Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 98c00816adb64fa4ad579cef5acc13d9 Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1405006507 Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-VolumesAdminNegativeTest-1405006507-project Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 77c5d610c6134ed28c5747c6ac79ea6d Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-VolumesAdminNegativeTest-1405006507-project Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance d7b249a7-0a91-42a1-a4c1-85272a588947 could not be found. Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd7b249a7-0a91-42a1-a4c1-85272a588947'} Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7b249a7-0a91-42a1-a4c1-85272a588947 could not be found. Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7b249a7-0a91-42a1-a4c1-85272a588947 could not be found. Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:39.831214 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:39.835122 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:39.835122 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:39.835122 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:39.835122 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:16:39.835122 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:16:39.835122 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7b249a7-0a91-42a1-a4c1-85272a588947 could not be found. Jul 26 14:16:39.835122 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:39.839584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-94d166c7-661c-4f5f-ba0f-e37a59e3a12b tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Returning 404 to user: Instance d7b249a7-0a91-42a1-a4c1-85272a588947 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:16:39.840937 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-94d166c7-661c-4f5f-ba0f-e37a59e3a12b tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947" status: 404 len: 111 microversion: 2.1 time: 0.045128 Jul 26 14:16:39.841933 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1250/2626] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:39 2022] GET /compute/v2.1/servers/d7b249a7-0a91-42a1-a4c1-85272a588947 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:16:39.849409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-78903d44-9b73-4a15-9c50-279bfd48ed82 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:39.850195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-78903d44-9b73-4a15-9c50-279bfd48ed82 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:39.861014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78903d44-9b73-4a15-9c50-279bfd48ed82 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.863283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78903d44-9b73-4a15-9c50-279bfd48ed82 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:39.864573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78903d44-9b73-4a15-9c50-279bfd48ed82 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:39.865298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78903d44-9b73-4a15-9c50-279bfd48ed82 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:40.851494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c2d9ac0e-cee1-4809-bfe3-0b74023228ad tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:40.878748 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c2d9ac0e-cee1-4809-bfe3-0b74023228ad tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 1.183112 Jul 26 14:16:40.879371 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1377/2627] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:39 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:40.888788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2571a0e9-7748-4bb3-b0d1-589c89408b6c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:40.889400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2571a0e9-7748-4bb3-b0d1-589c89408b6c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:40.924006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2571a0e9-7748-4bb3-b0d1-589c89408b6c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:40.924342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2571a0e9-7748-4bb3-b0d1-589c89408b6c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:40.925361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2571a0e9-7748-4bb3-b0d1-589c89408b6c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:40.926020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2571a0e9-7748-4bb3-b0d1-589c89408b6c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:41.085017 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-78903d44-9b73-4a15-9c50-279bfd48ed82 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1645 microversion: 2.1 time: 1.241557 Jul 26 14:16:41.100527 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1251/2628] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:39 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1645 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:41.116134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93771c4b-5f06-4dd3-9e42-e4f6471b65db tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:41.118802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-93771c4b-5f06-4dd3-9e42-e4f6471b65db tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:41.156919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93771c4b-5f06-4dd3-9e42-e4f6471b65db tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:41.160446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93771c4b-5f06-4dd3-9e42-e4f6471b65db tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:41.161499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93771c4b-5f06-4dd3-9e42-e4f6471b65db tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:41.162143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93771c4b-5f06-4dd3-9e42-e4f6471b65db tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:41.430807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-93771c4b-5f06-4dd3-9e42-e4f6471b65db tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:41.444719 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-93771c4b-5f06-4dd3-9e42-e4f6471b65db tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1266 microversion: 2.1 time: 0.342036 Jul 26 14:16:41.445703 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1252/2629] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:41 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:41.460059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e5ad3406-4c70-4b71-b059-30035e6dfa89 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:41.461552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e5ad3406-4c70-4b71-b059-30035e6dfa89 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:41.469835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5ad3406-4c70-4b71-b059-30035e6dfa89 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:41.472796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5ad3406-4c70-4b71-b059-30035e6dfa89 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:41.473827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5ad3406-4c70-4b71-b059-30035e6dfa89 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:41.477668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5ad3406-4c70-4b71-b059-30035e6dfa89 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:41.598240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2571a0e9-7748-4bb3-b0d1-589c89408b6c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:41.611267 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2571a0e9-7748-4bb3-b0d1-589c89408b6c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1502 microversion: 2.1 time: 0.730820 Jul 26 14:16:41.612180 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1378/2630] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:40 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1502 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:41.623404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c97d7008-0db9-48fa-bd84-f8afcf1892fb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:41.625495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c97d7008-0db9-48fa-bd84-f8afcf1892fb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:41.641514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c97d7008-0db9-48fa-bd84-f8afcf1892fb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:41.642343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c97d7008-0db9-48fa-bd84-f8afcf1892fb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:41.644574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c97d7008-0db9-48fa-bd84-f8afcf1892fb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:41.649838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c97d7008-0db9-48fa-bd84-f8afcf1892fb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:41.706122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e5ad3406-4c70-4b71-b059-30035e6dfa89 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:41.732628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e5ad3406-4c70-4b71-b059-30035e6dfa89 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:41.739054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e5ad3406-4c70-4b71-b059-30035e6dfa89 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:41.740052 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e5ad3406-4c70-4b71-b059-30035e6dfa89 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.293006 Jul 26 14:16:41.740463 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1253/2631] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:41 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:41.748744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1492610319", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "07889a08-85b2-40b9-923c-1a167cfebc11"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:41.758827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c97d7008-0db9-48fa-bd84-f8afcf1892fb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:41.772981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c97d7008-0db9-48fa-bd84-f8afcf1892fb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:41.780899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c97d7008-0db9-48fa-bd84-f8afcf1892fb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:41.782170 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c97d7008-0db9-48fa-bd84-f8afcf1892fb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1603 microversion: 2.42 time: 0.168262 Jul 26 14:16:41.782764 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1379/2632] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:41 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1603 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:41.832833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9ad09fc4-66d4-4a94-9a1d-2717e00876b3 req-05b0b817-a74b-4cdb-b3ff-a70c85020241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dfcc2ed-fde9-4ef4-840b-012106b72b1b", "name": "network-vif-deleted", "tag": "8440feb4-5af7-47f7-93be-a1f774aeb7ab"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:41.854015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9ad09fc4-66d4-4a94-9a1d-2717e00876b3 req-05b0b817-a74b-4cdb-b3ff-a70c85020241 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:41.860228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] validate_networks() for [('07889a08-85b2-40b9-923c-1a167cfebc11', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:16:41.866884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9ad09fc4-66d4-4a94-9a1d-2717e00876b3 req-05b0b817-a74b-4cdb-b3ff-a70c85020241 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:41.881431 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9ad09fc4-66d4-4a94-9a1d-2717e00876b3 req-05b0b817-a74b-4cdb-b3ff-a70c85020241 service nova] Creating event network-vif-deleted:8440feb4-5af7-47f7-93be-a1f774aeb7ab for instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b on n-h2-833090-9 Jul 26 14:16:41.890034 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9ad09fc4-66d4-4a94-9a1d-2717e00876b3 req-05b0b817-a74b-4cdb-b3ff-a70c85020241 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060891 Jul 26 14:16:41.891269 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1380/2633] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:41.908386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b29510bf-4eab-4ed9-ad41-c8e5c4879ade tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:41.917559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b29510bf-4eab-4ed9-ad41-c8e5c4879ade tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:41.929607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b29510bf-4eab-4ed9-ad41-c8e5c4879ade tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:41.930605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b29510bf-4eab-4ed9-ad41-c8e5c4879ade tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:41.931753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b29510bf-4eab-4ed9-ad41-c8e5c4879ade tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:41.932577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b29510bf-4eab-4ed9-ad41-c8e5c4879ade tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:42.965591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b29510bf-4eab-4ed9-ad41-c8e5c4879ade tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:42.984441 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b29510bf-4eab-4ed9-ad41-c8e5c4879ade tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 1.082705 Jul 26 14:16:42.993858 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1381/2634] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:41 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:43.011374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cf84cc22-1346-4167-a9ab-708480ca8e64 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:43.013158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cf84cc22-1346-4167-a9ab-708480ca8e64 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:43.039411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf84cc22-1346-4167-a9ab-708480ca8e64 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:43.041373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf84cc22-1346-4167-a9ab-708480ca8e64 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:43.043557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf84cc22-1346-4167-a9ab-708480ca8e64 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:43.046896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf84cc22-1346-4167-a9ab-708480ca8e64 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:43.897717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cf84cc22-1346-4167-a9ab-708480ca8e64 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:43.910668 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cf84cc22-1346-4167-a9ab-708480ca8e64 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1308 microversion: 2.1 time: 0.911917 Jul 26 14:16:43.911330 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1382/2635] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:42 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1308 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:43.926988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9905b7af-1495-4b9f-acd4-fcdbd8c5798d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:43.934755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9905b7af-1495-4b9f-acd4-fcdbd8c5798d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:43.950465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9905b7af-1495-4b9f-acd4-fcdbd8c5798d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:43.952605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9905b7af-1495-4b9f-acd4-fcdbd8c5798d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:43.953752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9905b7af-1495-4b9f-acd4-fcdbd8c5798d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:43.955757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9905b7af-1495-4b9f-acd4-fcdbd8c5798d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:44.174261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:16:44.174924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:16:44.175450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:16:44.175870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:16:44.177168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:16:44.189908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:44.191477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:44.193052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:44.194145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:44.234614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Getting quotas for project 1976cab4a83747a68cadf5b4dc2dbef0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:16:44.241857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Getting quotas for user e35f47eb9e094bdc8d08ea4cf2970d8c and project 1976cab4a83747a68cadf5b4dc2dbef0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:16:44.259511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:16:44.262342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:16:44.351016 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7cff26a1-bbe8-4a16-b69e-af177add2ae2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.605662 Jul 26 14:16:44.357399 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1254/2636] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:16:44.400031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3163ea1-399e-488b-9227-d041d681acc6 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:44.401172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f3163ea1-399e-488b-9227-d041d681acc6 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:44.415940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3163ea1-399e-488b-9227-d041d681acc6 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:44.417487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3163ea1-399e-488b-9227-d041d681acc6 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:44.426187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3163ea1-399e-488b-9227-d041d681acc6 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:44.427033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3163ea1-399e-488b-9227-d041d681acc6 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:44.678599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9905b7af-1495-4b9f-acd4-fcdbd8c5798d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:44.699554 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9905b7af-1495-4b9f-acd4-fcdbd8c5798d tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.778247 Jul 26 14:16:44.703664 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1383/2637] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:43 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:44.721451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50d4f7f1-9ba1-493a-a4e5-4baf6251ab6f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:44.722786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-50d4f7f1-9ba1-493a-a4e5-4baf6251ab6f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:44.734995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f3163ea1-399e-488b-9227-d041d681acc6 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:44.743067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50d4f7f1-9ba1-493a-a4e5-4baf6251ab6f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:44.744604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50d4f7f1-9ba1-493a-a4e5-4baf6251ab6f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:44.747314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50d4f7f1-9ba1-493a-a4e5-4baf6251ab6f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:44.748021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50d4f7f1-9ba1-493a-a4e5-4baf6251ab6f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:44.778276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f3163ea1-399e-488b-9227-d041d681acc6 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:44.784182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f3163ea1-399e-488b-9227-d041d681acc6 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:44.799452 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f3163ea1-399e-488b-9227-d041d681acc6 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.436623 Jul 26 14:16:44.804291 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1255/2638] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:44 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:44.811925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ff55f8a-1c20-4d54-ab64-bd77a2709291 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Action: 'create', calling method: .version_select at 0x7f8799304dc0>, body: {"keypair": {"name": "tempest-keypair-656765471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSVOx06/91ZlDZIpcRfzJlVzCul4NBY5ACuGbaPIwj3ox20+ooeX0p39b+lx9N5I1KxliQ+oHXxGafCkfBWoYnoJt6JWVlBLOWt4yefveSMgan9bBBb7TSyRx56huJEYA=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:44.888299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-4ff55f8a-1c20-4d54-ab64-bd77a2709291 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Getting quotas for project 2ff150afe7324391a987f18a674d3240. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:16:44.916093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-4ff55f8a-1c20-4d54-ab64-bd77a2709291 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Getting quotas for user a72611cad5b0425a9fe7111c923db0f9 and project 2ff150afe7324391a987f18a674d3240. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:16:44.980120 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ff55f8a-1c20-4d54-ab64-bd77a2709291 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.173579 Jul 26 14:16:44.986802 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1256/2639] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Jul 26 14:16:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 14:16:44.986802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-636e2737-d317-4882-84a3-6b26c3429511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:44.986802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-636e2737-d317-4882-84a3-6b26c3429511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:45.029590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-636e2737-d317-4882-84a3-6b26c3429511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:45.030468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-636e2737-d317-4882-84a3-6b26c3429511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:45.031444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-636e2737-d317-4882-84a3-6b26c3429511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:45.032041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-636e2737-d317-4882-84a3-6b26c3429511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:45.076110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-50d4f7f1-9ba1-493a-a4e5-4baf6251ab6f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:45.125211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-50d4f7f1-9ba1-493a-a4e5-4baf6251ab6f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:45.141198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-50d4f7f1-9ba1-493a-a4e5-4baf6251ab6f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:45.144368 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-50d4f7f1-9ba1-493a-a4e5-4baf6251ab6f tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1603 microversion: 2.42 time: 0.438274 Jul 26 14:16:45.153507 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1384/2640] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:44 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1603 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:45.161482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ae1c4d7-a1e6-4447-8d28-e7a9a7596dcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:45.162820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ae1c4d7-a1e6-4447-8d28-e7a9a7596dcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:45.453584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7ae1c4d7-a1e6-4447-8d28-e7a9a7596dcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:45.467768 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ae1c4d7-a1e6-4447-8d28-e7a9a7596dcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1211 microversion: 2.1 time: 0.311732 Jul 26 14:16:45.469742 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1385/2641] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:45 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1211 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:45.474683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-84d324b2-ca0f-4c73-9000-47ea2a93d5a7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:45.480906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-84d324b2-ca0f-4c73-9000-47ea2a93d5a7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:45.497119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84d324b2-ca0f-4c73-9000-47ea2a93d5a7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:45.498022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84d324b2-ca0f-4c73-9000-47ea2a93d5a7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:45.499842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84d324b2-ca0f-4c73-9000-47ea2a93d5a7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:45.500712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84d324b2-ca0f-4c73-9000-47ea2a93d5a7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:46.101132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-636e2737-d317-4882-84a3-6b26c3429511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:46.122005 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-636e2737-d317-4882-84a3-6b26c3429511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 1.137841 Jul 26 14:16:46.124349 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1257/2642] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:44 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:46.158454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7560c472-7c88-4799-8924-350546869f91 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:46.164814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7560c472-7c88-4799-8924-350546869f91 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:46.194620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7560c472-7c88-4799-8924-350546869f91 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:46.197704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7560c472-7c88-4799-8924-350546869f91 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:46.198729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7560c472-7c88-4799-8924-350546869f91 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:46.203573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7560c472-7c88-4799-8924-350546869f91 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:46.667486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-84d324b2-ca0f-4c73-9000-47ea2a93d5a7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:46.681485 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-84d324b2-ca0f-4c73-9000-47ea2a93d5a7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 1.210398 Jul 26 14:16:46.684884 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1386/2643] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:45 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:46.700503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9c0650dd-5043-438e-acad-77b134d95b43 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:46.703511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9c0650dd-5043-438e-acad-77b134d95b43 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:46.723297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c0650dd-5043-438e-acad-77b134d95b43 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:46.728630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c0650dd-5043-438e-acad-77b134d95b43 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:46.729514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c0650dd-5043-438e-acad-77b134d95b43 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:46.729985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c0650dd-5043-438e-acad-77b134d95b43 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:46.864469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9c0650dd-5043-438e-acad-77b134d95b43 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:46.877449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9c0650dd-5043-438e-acad-77b134d95b43 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:46.884999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9c0650dd-5043-438e-acad-77b134d95b43 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:46.886517 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9c0650dd-5043-438e-acad-77b134d95b43 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.200432 Jul 26 14:16:46.889455 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1387/2644] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:46 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:46.902716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3d68248f-0a29-47b7-9e51-ac82df330880 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:46.903627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3d68248f-0a29-47b7-9e51-ac82df330880 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:46.922481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d68248f-0a29-47b7-9e51-ac82df330880 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:46.922834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d68248f-0a29-47b7-9e51-ac82df330880 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:46.923646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d68248f-0a29-47b7-9e51-ac82df330880 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:46.924130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d68248f-0a29-47b7-9e51-ac82df330880 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:46.994327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7560c472-7c88-4799-8924-350546869f91 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:46.998156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:47.019423 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7560c472-7c88-4799-8924-350546869f91 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1308 microversion: 2.1 time: 0.892296 Jul 26 14:16:47.027476 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1258/2645] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:46 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1308 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:47.047813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f35f4872-c2de-4f9a-ab52-d22b5092046f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:47.050787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f35f4872-c2de-4f9a-ab52-d22b5092046f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:47.078650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f35f4872-c2de-4f9a-ab52-d22b5092046f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:47.079260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f35f4872-c2de-4f9a-ab52-d22b5092046f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:47.084899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f35f4872-c2de-4f9a-ab52-d22b5092046f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:47.085695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f35f4872-c2de-4f9a-ab52-d22b5092046f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:47.272492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f35f4872-c2de-4f9a-ab52-d22b5092046f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:47.289715 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f35f4872-c2de-4f9a-ab52-d22b5092046f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1281 microversion: 2.1 time: 0.259681 Jul 26 14:16:47.295256 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1259/2646] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:47 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1281 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:47.300106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3d68248f-0a29-47b7-9e51-ac82df330880 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:47.317505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d07b5d5-d509-4d2a-958e-d0971f8d64ed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:47.318711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d07b5d5-d509-4d2a-958e-d0971f8d64ed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: bf1f2057-884c-4ee3-9cc1-8b1581905e4e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:47.320742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3d68248f-0a29-47b7-9e51-ac82df330880 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:47.322775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3d68248f-0a29-47b7-9e51-ac82df330880 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:47.324057 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3d68248f-0a29-47b7-9e51-ac82df330880 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1603 microversion: 2.42 time: 0.432532 Jul 26 14:16:47.324645 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1388/2647] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:46 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1603 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:47.348019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73a1aa64-9ea0-4728-a573-cd208de3c3bb tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:47.348019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-73a1aa64-9ea0-4728-a573-cd208de3c3bb tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:47.348790 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-0d07b5d5-d509-4d2a-958e-d0971f8d64ed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance bf1f2057-884c-4ee3-9cc1-8b1581905e4e could not be found. Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d07b5d5-d509-4d2a-958e-d0971f8d64ed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/bf1f2057-884c-4ee3-9cc1-8b1581905e4e/action HTTP/1.1 Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 15 Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: {"unpause": {}} Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance bf1f2057-884c-4ee3-9cc1-8b1581905e4e could not be found. Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'bf1f2057-884c-4ee3-9cc1-8b1581905e4e', 'body': {'unpause': {}}} Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1f2057-884c-4ee3-9cc1-8b1581905e4e could not be found. Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1f2057-884c-4ee3-9cc1-8b1581905e4e could not be found. Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:47.350903 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:47.356674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:16:47.356674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:16:47.356674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1f2057-884c-4ee3-9cc1-8b1581905e4e could not be found. Jul 26 14:16:47.356674 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:47.358188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d07b5d5-d509-4d2a-958e-d0971f8d64ed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance bf1f2057-884c-4ee3-9cc1-8b1581905e4e could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:16:47.359878 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d07b5d5-d509-4d2a-958e-d0971f8d64ed tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/bf1f2057-884c-4ee3-9cc1-8b1581905e4e/action" status: 404 len: 111 microversion: 2.1 time: 0.063148 Jul 26 14:16:47.366662 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1260/2648] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:47 2022] POST /compute/v2.1/servers/bf1f2057-884c-4ee3-9cc1-8b1581905e4e/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:16:47.379224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-66758d3a-59aa-44fd-a359-3d4bee6db1af tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:47.380235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-66758d3a-59aa-44fd-a359-3d4bee6db1af tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:47.384419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73a1aa64-9ea0-4728-a573-cd208de3c3bb tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:47.388553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73a1aa64-9ea0-4728-a573-cd208de3c3bb tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:47.389499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73a1aa64-9ea0-4728-a573-cd208de3c3bb tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:47.389954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73a1aa64-9ea0-4728-a573-cd208de3c3bb tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:47.393919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66758d3a-59aa-44fd-a359-3d4bee6db1af tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:47.394607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66758d3a-59aa-44fd-a359-3d4bee6db1af tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:47.395655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66758d3a-59aa-44fd-a359-3d4bee6db1af tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:47.396296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66758d3a-59aa-44fd-a359-3d4bee6db1af tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:47.505017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-73a1aa64-9ea0-4728-a573-cd208de3c3bb tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:16:47.677585 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-73a1aa64-9ea0-4728-a573-cd208de3c3bb tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 204 len: 0 microversion: 2.1 time: 0.351589 Jul 26 14:16:47.679096 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1389/2649] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:16:47 2022] DELETE /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:16:47.689532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-756491b6-5a79-4468-9a69-52b73fc9384b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:47.690435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-756491b6-5a79-4468-9a69-52b73fc9384b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:47.708612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-756491b6-5a79-4468-9a69-52b73fc9384b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:47.711339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-756491b6-5a79-4468-9a69-52b73fc9384b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:47.715682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-756491b6-5a79-4468-9a69-52b73fc9384b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:47.716584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-756491b6-5a79-4468-9a69-52b73fc9384b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:48.162068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:48.414922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-756491b6-5a79-4468-9a69-52b73fc9384b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:48.427386 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-756491b6-5a79-4468-9a69-52b73fc9384b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.745486 Jul 26 14:16:48.434352 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1390/2650] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:47 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:48.459340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-586759b0-0adc-4451-a913-7d0bb5fff29a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:48.462582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-586759b0-0adc-4451-a913-7d0bb5fff29a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:48.485301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-586759b0-0adc-4451-a913-7d0bb5fff29a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:48.486472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-586759b0-0adc-4451-a913-7d0bb5fff29a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:48.489356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-586759b0-0adc-4451-a913-7d0bb5fff29a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:48.493742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-586759b0-0adc-4451-a913-7d0bb5fff29a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:48.634315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-66758d3a-59aa-44fd-a359-3d4bee6db1af tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:48.644881 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-66758d3a-59aa-44fd-a359-3d4bee6db1af tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 1.271083 Jul 26 14:16:48.647521 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1261/2651] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:47 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:48.654052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4ebf1d7-e2ad-41d5-9741-7cb7e0f34802 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:48.655100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b4ebf1d7-e2ad-41d5-9741-7cb7e0f34802 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:48.662376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4ebf1d7-e2ad-41d5-9741-7cb7e0f34802 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:48.663216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4ebf1d7-e2ad-41d5-9741-7cb7e0f34802 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:48.665073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4ebf1d7-e2ad-41d5-9741-7cb7e0f34802 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:48.665930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4ebf1d7-e2ad-41d5-9741-7cb7e0f34802 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:49.174704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4ebf1d7-e2ad-41d5-9741-7cb7e0f34802 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:49.190314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4ebf1d7-e2ad-41d5-9741-7cb7e0f34802 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:49.191759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4ebf1d7-e2ad-41d5-9741-7cb7e0f34802 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:49.198468 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b4ebf1d7-e2ad-41d5-9741-7cb7e0f34802 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.548699 Jul 26 14:16:49.200176 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1262/2652] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:48 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:49.206997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-57415b67-df77-4fd6-b811-1a5748f26dc8 req-edcf5297-4ea1-4af7-b263-a747397e4b63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c447924-08ae-4341-8ed0-2dd7a29e6899", "tag": "23a8575a-87d4-4b4e-89c9-fa2c87e39090"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:49.221550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-57415b67-df77-4fd6-b811-1a5748f26dc8 req-edcf5297-4ea1-4af7-b263-a747397e4b63 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:49.222760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-57415b67-df77-4fd6-b811-1a5748f26dc8 req-edcf5297-4ea1-4af7-b263-a747397e4b63 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:49.251805 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-57415b67-df77-4fd6-b811-1a5748f26dc8 req-edcf5297-4ea1-4af7-b263-a747397e4b63 service nova] Creating event network-changed:23a8575a-87d4-4b4e-89c9-fa2c87e39090 for instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 on n-h1-833090-9 Jul 26 14:16:49.257997 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-57415b67-df77-4fd6-b811-1a5748f26dc8 req-edcf5297-4ea1-4af7-b263-a747397e4b63 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055588 Jul 26 14:16:49.259570 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1263/2653] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:49.266415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9b82c717-9ab7-4b38-8b97-bf48fe82acb2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:49.267135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9b82c717-9ab7-4b38-8b97-bf48fe82acb2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:49.276342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b82c717-9ab7-4b38-8b97-bf48fe82acb2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:49.276800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b82c717-9ab7-4b38-8b97-bf48fe82acb2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:49.277596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b82c717-9ab7-4b38-8b97-bf48fe82acb2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:49.278177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b82c717-9ab7-4b38-8b97-bf48fe82acb2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:49.347724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-586759b0-0adc-4451-a913-7d0bb5fff29a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:49.357080 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-586759b0-0adc-4451-a913-7d0bb5fff29a tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1681 microversion: 2.1 time: 0.914986 Jul 26 14:16:49.358578 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1391/2654] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:48 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1681 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:49.365644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c476211-bd8c-4ba4-897f-777e26a8d000 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:49.366596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8c476211-bd8c-4ba4-897f-777e26a8d000 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:49.377344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c476211-bd8c-4ba4-897f-777e26a8d000 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:49.378053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c476211-bd8c-4ba4-897f-777e26a8d000 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:49.379033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c476211-bd8c-4ba4-897f-777e26a8d000 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:49.379629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c476211-bd8c-4ba4-897f-777e26a8d000 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:49.526364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8c476211-bd8c-4ba4-897f-777e26a8d000 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:49.538552 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8c476211-bd8c-4ba4-897f-777e26a8d000 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1269 microversion: 2.1 time: 0.178374 Jul 26 14:16:49.550002 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1392/2655] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:49 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1269 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:49.557363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-78606498-34b7-4a09-b364-2d332b5c0e3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:49.558217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-78606498-34b7-4a09-b364-2d332b5c0e3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:49.567499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78606498-34b7-4a09-b364-2d332b5c0e3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:49.568320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78606498-34b7-4a09-b364-2d332b5c0e3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:49.569578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78606498-34b7-4a09-b364-2d332b5c0e3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:49.570411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78606498-34b7-4a09-b364-2d332b5c0e3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:49.710244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-78606498-34b7-4a09-b364-2d332b5c0e3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:49.723623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9b82c717-9ab7-4b38-8b97-bf48fe82acb2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:49.725378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-78606498-34b7-4a09-b364-2d332b5c0e3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:49.728519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-78606498-34b7-4a09-b364-2d332b5c0e3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:49.730450 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-78606498-34b7-4a09-b364-2d332b5c0e3e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1603 microversion: 2.42 time: 0.187369 Jul 26 14:16:49.731752 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1393/2656] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:49 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1603 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:49.737087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-494936eb-254c-4510-ab45-9f9711e1514c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:49.738047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-494936eb-254c-4510-ab45-9f9711e1514c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:49.741268 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9b82c717-9ab7-4b38-8b97-bf48fe82acb2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1308 microversion: 2.1 time: 0.479935 Jul 26 14:16:49.743794 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1264/2657] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:49 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:49.754079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1779395334", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "216611d2-61a1-47c9-be84-1bee153ea28e"}, {"port": "655c801d-619c-4703-833e-49b7cd5986f5", "tag": "port-1"}, {"port": "d3a78f25-3960-4067-8f30-6daf5be1078e", "tag": "port-2"}, {"uuid": "ca8bd70b-e46b-416f-b6a9-b80edc513b66", "tag": "net-1"}, {"uuid": "ca8bd70b-e46b-416f-b6a9-b80edc513b66"}, {"uuid": "c1e9e8c4-9c04-48d5-85f1-9741ad481264", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c1e9e8c4-9c04-48d5-85f1-9741ad481264", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5a9a590c-919b-493e-bc5b-69e328a5499d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "8b4619ed-427b-4edf-a8bb-70eeb84273e6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3bad7219-428d-47e3-9d8c-f06c07f0dcf4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--668579519"}], "key_name": "tempest-keypair-656765471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:49.760559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-494936eb-254c-4510-ab45-9f9711e1514c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:49.761272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-494936eb-254c-4510-ab45-9f9711e1514c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:49.762293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-494936eb-254c-4510-ab45-9f9711e1514c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:49.763250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-494936eb-254c-4510-ab45-9f9711e1514c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:50.057726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] validate_networks() for [('216611d2-61a1-47c9-be84-1bee153ea28e', None, None, None, None, None), (None, None, '655c801d-619c-4703-833e-49b7cd5986f5', None, None, None), (None, None, 'd3a78f25-3960-4067-8f30-6daf5be1078e', None, None, None), ('ca8bd70b-e46b-416f-b6a9-b80edc513b66', None, None, None, None, None), ('ca8bd70b-e46b-416f-b6a9-b80edc513b66', None, None, None, None, None), ('c1e9e8c4-9c04-48d5-85f1-9741ad481264', '10.2.2.100', None, None, None, None), ('c1e9e8c4-9c04-48d5-85f1-9741ad481264', '10.2.2.200', None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:16:50.152914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-494936eb-254c-4510-ab45-9f9711e1514c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:50.166091 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-494936eb-254c-4510-ab45-9f9711e1514c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.432897 Jul 26 14:16:50.166861 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1394/2658] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:49 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:50.174229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9938aa2a-0561-4b45-a842-bad59247ed5c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:50.175795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9938aa2a-0561-4b45-a842-bad59247ed5c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:50.188710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9938aa2a-0561-4b45-a842-bad59247ed5c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:50.189801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9938aa2a-0561-4b45-a842-bad59247ed5c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:50.191490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9938aa2a-0561-4b45-a842-bad59247ed5c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:50.193391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9938aa2a-0561-4b45-a842-bad59247ed5c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:50.760821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9938aa2a-0561-4b45-a842-bad59247ed5c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:50.770400 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9938aa2a-0561-4b45-a842-bad59247ed5c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.601979 Jul 26 14:16:50.771324 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1395/2659] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:50 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:50.777325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b764db2b-dcfe-4991-93da-22b085f8f03e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:50.785295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b764db2b-dcfe-4991-93da-22b085f8f03e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:50.800767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b764db2b-dcfe-4991-93da-22b085f8f03e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:50.801825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b764db2b-dcfe-4991-93da-22b085f8f03e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:50.803503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b764db2b-dcfe-4991-93da-22b085f8f03e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:50.804569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b764db2b-dcfe-4991-93da-22b085f8f03e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:50.848701 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-b764db2b-dcfe-4991-93da-22b085f8f03e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Cannot 'unpause' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b764db2b-dcfe-4991-93da-22b085f8f03e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action HTTP/1.1 Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 15 Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: {"unpause": {}} Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: exception: Cannot 'unpause' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e6b94307-dd41-4f71-b529-c6cbb944c27f', 'body': {'unpause': {}}} Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f in vm_state active. Cannot unpause while the instance is in this state. Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:50.850992 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:50.855831 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:50.855831 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:16:50.855831 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:16:50.855831 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:16:50.855831 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:50.857225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b764db2b-dcfe-4991-93da-22b085f8f03e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 409 to user: Cannot 'unpause' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:16:50.859124 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b764db2b-dcfe-4991-93da-22b085f8f03e tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 409 len: 145 microversion: 2.1 time: 0.085860 Jul 26 14:16:50.863817 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1396/2660] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:50 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 145 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:16:50.869970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eb310ca0-de46-41ac-8714-6fe57c720f66 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:50.870595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eb310ca0-de46-41ac-8714-6fe57c720f66 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:50.878191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb310ca0-de46-41ac-8714-6fe57c720f66 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:50.878717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb310ca0-de46-41ac-8714-6fe57c720f66 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:50.879702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb310ca0-de46-41ac-8714-6fe57c720f66 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:50.880340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb310ca0-de46-41ac-8714-6fe57c720f66 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:50.994795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb310ca0-de46-41ac-8714-6fe57c720f66 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:51.006998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb310ca0-de46-41ac-8714-6fe57c720f66 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:51.010393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb310ca0-de46-41ac-8714-6fe57c720f66 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:51.011866 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eb310ca0-de46-41ac-8714-6fe57c720f66 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1365 microversion: 2.47 time: 0.146819 Jul 26 14:16:51.012621 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1397/2661] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:50 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:51.018257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0700c844-c084-411e-9672-1dd5fb11214e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:51.019349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0700c844-c084-411e-9672-1dd5fb11214e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:51.027462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0700c844-c084-411e-9672-1dd5fb11214e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:51.028188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0700c844-c084-411e-9672-1dd5fb11214e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:51.029471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0700c844-c084-411e-9672-1dd5fb11214e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:51.030436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0700c844-c084-411e-9672-1dd5fb11214e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:51.645408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0700c844-c084-411e-9672-1dd5fb11214e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c5d610c6134ed28c5747c6ac79ea6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c00816adb64fa4ad579cef5acc13d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:51.655524 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0700c844-c084-411e-9672-1dd5fb11214e tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 200 len: 1681 microversion: 2.1 time: 0.641288 Jul 26 14:16:51.656835 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1398/2662] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:51 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 1681 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:51.661701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d825f144-cdb1-4a11-924a-2f2ab5ccfcb5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:51.662603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d825f144-cdb1-4a11-924a-2f2ab5ccfcb5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:51.670370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d825f144-cdb1-4a11-924a-2f2ab5ccfcb5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:51.671086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d825f144-cdb1-4a11-924a-2f2ab5ccfcb5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:51.672458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d825f144-cdb1-4a11-924a-2f2ab5ccfcb5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:51.673218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d825f144-cdb1-4a11-924a-2f2ab5ccfcb5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:52.542315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d825f144-cdb1-4a11-924a-2f2ab5ccfcb5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:52.556550 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d825f144-cdb1-4a11-924a-2f2ab5ccfcb5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1311 microversion: 2.1 time: 0.898037 Jul 26 14:16:52.558922 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1399/2663] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:51 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1311 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:52.565842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fc3c3baf-8f7f-4fe7-99de-94d51ade054e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:52.566998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fc3c3baf-8f7f-4fe7-99de-94d51ade054e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:52.578954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc3c3baf-8f7f-4fe7-99de-94d51ade054e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:52.580021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc3c3baf-8f7f-4fe7-99de-94d51ade054e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:52.582724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc3c3baf-8f7f-4fe7-99de-94d51ade054e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:52.583405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc3c3baf-8f7f-4fe7-99de-94d51ade054e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:52.746372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fc3c3baf-8f7f-4fe7-99de-94d51ade054e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:52.760354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fc3c3baf-8f7f-4fe7-99de-94d51ade054e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:52.762596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fc3c3baf-8f7f-4fe7-99de-94d51ade054e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:52.764371 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fc3c3baf-8f7f-4fe7-99de-94d51ade054e tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1603 microversion: 2.42 time: 0.204133 Jul 26 14:16:52.765115 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1400/2664] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:52 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1603 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:52.772183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d47f3ab9-75fd-43bd-b837-43cea4fdac3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:52.773677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d47f3ab9-75fd-43bd-b837-43cea4fdac3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:52.780911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d47f3ab9-75fd-43bd-b837-43cea4fdac3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:52.781823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d47f3ab9-75fd-43bd-b837-43cea4fdac3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:52.782670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d47f3ab9-75fd-43bd-b837-43cea4fdac3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:52.783867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d47f3ab9-75fd-43bd-b837-43cea4fdac3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:53.491325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d47f3ab9-75fd-43bd-b837-43cea4fdac3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:53.518736 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d47f3ab9-75fd-43bd-b837-43cea4fdac3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1308 microversion: 2.1 time: 0.752331 Jul 26 14:16:53.521489 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1401/2665] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:52 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1308 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:53.528535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-51f73c55-8c0f-4809-b751-3e8c20a5e67c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:53.529214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-51f73c55-8c0f-4809-b751-3e8c20a5e67c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:53.540577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51f73c55-8c0f-4809-b751-3e8c20a5e67c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:53.541208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51f73c55-8c0f-4809-b751-3e8c20a5e67c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:53.542232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51f73c55-8c0f-4809-b751-3e8c20a5e67c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:53.542786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51f73c55-8c0f-4809-b751-3e8c20a5e67c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:54.014424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-51f73c55-8c0f-4809-b751-3e8c20a5e67c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:54.034213 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-51f73c55-8c0f-4809-b751-3e8c20a5e67c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.508644 Jul 26 14:16:54.035235 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1402/2666] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:53 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:54.050112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf150ebe-d15a-4194-9fb1-e14692e69396 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:54.051576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bf150ebe-d15a-4194-9fb1-e14692e69396 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:54.067706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf150ebe-d15a-4194-9fb1-e14692e69396 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:54.068417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf150ebe-d15a-4194-9fb1-e14692e69396 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:54.071328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf150ebe-d15a-4194-9fb1-e14692e69396 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:54.073418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf150ebe-d15a-4194-9fb1-e14692e69396 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:54.225091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:54.603186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bf150ebe-d15a-4194-9fb1-e14692e69396 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:54.613469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:54.628429 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bf150ebe-d15a-4194-9fb1-e14692e69396 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.589708 Jul 26 14:16:54.629662 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1403/2667] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:54 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:54.636917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90b42d95-5f9b-4c86-88ca-bb45f1c9aaeb tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:54.638665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-90b42d95-5f9b-4c86-88ca-bb45f1c9aaeb tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:54.648973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90b42d95-5f9b-4c86-88ca-bb45f1c9aaeb tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:54.649806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90b42d95-5f9b-4c86-88ca-bb45f1c9aaeb tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:54.651774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90b42d95-5f9b-4c86-88ca-bb45f1c9aaeb tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:54.653421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90b42d95-5f9b-4c86-88ca-bb45f1c9aaeb tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:54.937417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:55.193516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90b42d95-5f9b-4c86-88ca-bb45f1c9aaeb tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:55.209677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90b42d95-5f9b-4c86-88ca-bb45f1c9aaeb tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:55.212974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90b42d95-5f9b-4c86-88ca-bb45f1c9aaeb tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:55.218140 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90b42d95-5f9b-4c86-88ca-bb45f1c9aaeb tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1383 microversion: 2.47 time: 0.587106 Jul 26 14:16:55.221316 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1404/2668] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:54 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1383 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:55.234973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fac6eba8-d3aa-403c-87ef-89fd5f92bbf8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:55.236006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fac6eba8-d3aa-403c-87ef-89fd5f92bbf8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] [instance: 1e90299d-2a73-4c84-95bc-a08fa220c671] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:55.243686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fac6eba8-d3aa-403c-87ef-89fd5f92bbf8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:55.244570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fac6eba8-d3aa-403c-87ef-89fd5f92bbf8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:55.245634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fac6eba8-d3aa-403c-87ef-89fd5f92bbf8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:55.246246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fac6eba8-d3aa-403c-87ef-89fd5f92bbf8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:55.265704 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-fac6eba8-d3aa-403c-87ef-89fd5f92bbf8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] HTTP exception thrown: Instance 1e90299d-2a73-4c84-95bc-a08fa220c671 could not be found. Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fac6eba8-d3aa-403c-87ef-89fd5f92bbf8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Request method failure captured: Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 HTTP/1.1 Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_aD4he09CLa-J1r_-KV_9tm8xU-O8cXQiL9FmKztpB7JedT05AwjLzjoFWH3JZoH_9H7S4ZHR9hkw3jEMeZh6ZHa0QKPTr579Ol-vTHg8Ag8d6Ds6XG2el1-PUqZXIGgsXfRKgGwVldtzrC6Xe-TVZeP7Ty0Rl82nv30MwCKkDRcUU Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 98c00816adb64fa4ad579cef5acc13d9 Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesAdminNegativeTest-1405006507 Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/98c00816adb64fa4ad579cef5acc13d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/98c00816adb64fa4ad579cef5acc13d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_98c00816adb64fa4ad579cef5acc13d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/98c00816adb64fa4ad579cef5acc13d9"}]}] Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesAdminNegativeTest-1405006507 Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 98c00816adb64fa4ad579cef5acc13d9 Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1405006507 Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesAdminNegativeTest-1405006507-project Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 77c5d610c6134ed28c5747c6ac79ea6d Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesAdminNegativeTest-1405006507-project Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 1e90299d-2a73-4c84-95bc-a08fa220c671 could not be found. Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '1e90299d-2a73-4c84-95bc-a08fa220c671'} Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e90299d-2a73-4c84-95bc-a08fa220c671 could not be found. Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e90299d-2a73-4c84-95bc-a08fa220c671 could not be found. Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:55.267647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:55.272478 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:55.272478 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:55.272478 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:55.272478 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:16:55.272478 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:16:55.272478 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e90299d-2a73-4c84-95bc-a08fa220c671 could not be found. Jul 26 14:16:55.272478 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:55.274897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fac6eba8-d3aa-403c-87ef-89fd5f92bbf8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Returning 404 to user: Instance 1e90299d-2a73-4c84-95bc-a08fa220c671 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:16:55.275776 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fac6eba8-d3aa-403c-87ef-89fd5f92bbf8 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671" status: 404 len: 111 microversion: 2.1 time: 0.053204 Jul 26 14:16:55.280172 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1405/2669] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:55 2022] GET /compute/v2.1/servers/1e90299d-2a73-4c84-95bc-a08fa220c671 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:16:55.285875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29ae9fbf-d08d-4cb9-84e1-86f41fdf87e6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:55.287001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-29ae9fbf-d08d-4cb9-84e1-86f41fdf87e6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:55.296311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29ae9fbf-d08d-4cb9-84e1-86f41fdf87e6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:55.297037 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29ae9fbf-d08d-4cb9-84e1-86f41fdf87e6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:55.298682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29ae9fbf-d08d-4cb9-84e1-86f41fdf87e6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:55.299303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29ae9fbf-d08d-4cb9-84e1-86f41fdf87e6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:55.467438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:55.779769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-29ae9fbf-d08d-4cb9-84e1-86f41fdf87e6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:55.804638 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-29ae9fbf-d08d-4cb9-84e1-86f41fdf87e6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1311 microversion: 2.1 time: 0.522921 Jul 26 14:16:55.805547 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1406/2670] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:55 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1311 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:55.810329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db867bee-3c1b-4574-b193-ba3a3085b334 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:55.821163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-db867bee-3c1b-4574-b193-ba3a3085b334 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:55.839464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db867bee-3c1b-4574-b193-ba3a3085b334 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:55.840471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db867bee-3c1b-4574-b193-ba3a3085b334 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:55.840953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db867bee-3c1b-4574-b193-ba3a3085b334 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:55.841385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db867bee-3c1b-4574-b193-ba3a3085b334 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:55.943064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-db867bee-3c1b-4574-b193-ba3a3085b334 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:55.954419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-db867bee-3c1b-4574-b193-ba3a3085b334 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:55.955896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-db867bee-3c1b-4574-b193-ba3a3085b334 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:55.957272 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db867bee-3c1b-4574-b193-ba3a3085b334 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1603 microversion: 2.42 time: 0.151031 Jul 26 14:16:55.970549 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1407/2671] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:55 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1603 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:55.970549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-c076106f-7b19-4b4a-9f93-59a0d8d72f01 req-7a3c3459-c700-4892-af2d-96b2c2b464f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e90299d-2a73-4c84-95bc-a08fa220c671", "name": "network-vif-deleted", "tag": "cbe2651a-3688-408d-8285-f4a58c062b03"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:55.974064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c076106f-7b19-4b4a-9f93-59a0d8d72f01 req-7a3c3459-c700-4892-af2d-96b2c2b464f4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:55.980137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c076106f-7b19-4b4a-9f93-59a0d8d72f01 req-7a3c3459-c700-4892-af2d-96b2c2b464f4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:56.011550 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-c076106f-7b19-4b4a-9f93-59a0d8d72f01 req-7a3c3459-c700-4892-af2d-96b2c2b464f4 service nova] Creating event network-vif-deleted:cbe2651a-3688-408d-8285-f4a58c062b03 for instance 1e90299d-2a73-4c84-95bc-a08fa220c671 on n-h2-833090-9 Jul 26 14:16:56.024667 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-c076106f-7b19-4b4a-9f93-59a0d8d72f01 req-7a3c3459-c700-4892-af2d-96b2c2b464f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065089 Jul 26 14:16:56.028256 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1408/2672] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:56.040475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d4047fc-869e-40e8-aa24-f6d36048c951 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:56.041830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4d4047fc-869e-40e8-aa24-f6d36048c951 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:56.047732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:56.049794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d4047fc-869e-40e8-aa24-f6d36048c951 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:56.050631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d4047fc-869e-40e8-aa24-f6d36048c951 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:56.051709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d4047fc-869e-40e8-aa24-f6d36048c951 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:56.052901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d4047fc-869e-40e8-aa24-f6d36048c951 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:56.310566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4d4047fc-869e-40e8-aa24-f6d36048c951 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:56.321329 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d4047fc-869e-40e8-aa24-f6d36048c951 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.291574 Jul 26 14:16:56.321883 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1409/2673] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:56 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:56.328584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85f12769-795c-4922-92cc-8fd71ca75472 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:56.329511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85f12769-795c-4922-92cc-8fd71ca75472 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:56.340021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f12769-795c-4922-92cc-8fd71ca75472 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:56.341236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f12769-795c-4922-92cc-8fd71ca75472 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:56.350368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f12769-795c-4922-92cc-8fd71ca75472 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:56.354644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f12769-795c-4922-92cc-8fd71ca75472 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:56.625518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-85f12769-795c-4922-92cc-8fd71ca75472 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:56.636754 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85f12769-795c-4922-92cc-8fd71ca75472 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1308 microversion: 2.1 time: 0.313262 Jul 26 14:16:56.644041 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1410/2674] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:56 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:56.654615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-aa277081-50c8-4dd1-9119-301684825cd2 req-67708b28-29a5-4a31-9edb-656e28bacfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c447924-08ae-4341-8ed0-2dd7a29e6899", "name": "network-vif-plugged", "status": "completed", "tag": "23a8575a-87d4-4b4e-89c9-fa2c87e39090"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:56.671049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-aa277081-50c8-4dd1-9119-301684825cd2 req-67708b28-29a5-4a31-9edb-656e28bacfba service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:56.671916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-aa277081-50c8-4dd1-9119-301684825cd2 req-67708b28-29a5-4a31-9edb-656e28bacfba service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:56.697514 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-aa277081-50c8-4dd1-9119-301684825cd2 req-67708b28-29a5-4a31-9edb-656e28bacfba service nova] Creating event network-vif-plugged:23a8575a-87d4-4b4e-89c9-fa2c87e39090 for instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 on n-h1-833090-9 Jul 26 14:16:56.706831 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-aa277081-50c8-4dd1-9119-301684825cd2 req-67708b28-29a5-4a31-9edb-656e28bacfba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066931 Jul 26 14:16:56.708044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1411/2675] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:56.718509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0cbb7702-29be-4ce5-be72-3b0349a7c6d9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] Calling method '.version_select at 0x7f87992723a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:56.745066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:16:56.747934 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0cbb7702-29be-4ce5-be72-3b0349a7c6d9 tempest-VolumesAdminNegativeTest-1405006507 tempest-VolumesAdminNegativeTest-1405006507-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1640826207" status: 202 len: 0 microversion: 2.1 time: 0.037968 Jul 26 14:16:56.748483 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1412/2676] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1640826207 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:16:56.749756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:16:56.751665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:16:56.753275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:16:56.754184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:16:56.760698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-335805ec-d354-4338-abcd-569b456034b5 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:56.761871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-335805ec-d354-4338-abcd-569b456034b5 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:56.770953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:56.772095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:56.774146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:56.774838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:56.775487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335805ec-d354-4338-abcd-569b456034b5 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:56.776404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335805ec-d354-4338-abcd-569b456034b5 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:56.777356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335805ec-d354-4338-abcd-569b456034b5 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:56.778143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335805ec-d354-4338-abcd-569b456034b5 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:56.803507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Getting quotas for project 2ff150afe7324391a987f18a674d3240. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:16:56.811287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Getting quotas for user a72611cad5b0425a9fe7111c923db0f9 and project 2ff150afe7324391a987f18a674d3240. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:16:56.992179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-335805ec-d354-4338-abcd-569b456034b5 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:57.004755 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-335805ec-d354-4338-abcd-569b456034b5 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.255036 Jul 26 14:16:57.005574 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1413/2677] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:56 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:57.015230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-505b814a-2a0b-4610-9a45-f3db5f3bd92b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:57.016567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-505b814a-2a0b-4610-9a45-f3db5f3bd92b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:57.044726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-505b814a-2a0b-4610-9a45-f3db5f3bd92b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:57.045201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-505b814a-2a0b-4610-9a45-f3db5f3bd92b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:57.046008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-505b814a-2a0b-4610-9a45-f3db5f3bd92b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:57.046456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-505b814a-2a0b-4610-9a45-f3db5f3bd92b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:57.141436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:16:57.144626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5a9a590c-919b-493e-bc5b-69e328a5499d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='8b4619ed-427b-4edf-a8bb-70eeb84273e6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3bad7219-428d-47e3-9d8c-f06c07f0dcf4',volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:16:57.224295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-505b814a-2a0b-4610-9a45-f3db5f3bd92b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:57.270460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-505b814a-2a0b-4610-9a45-f3db5f3bd92b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:57.285679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-505b814a-2a0b-4610-9a45-f3db5f3bd92b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:57.288377 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-505b814a-2a0b-4610-9a45-f3db5f3bd92b tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1371 microversion: 2.47 time: 0.281231 Jul 26 14:16:57.289295 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1414/2678] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:57 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:57.297113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5d04743-8fa3-4d38-82ed-cfbc4168bf2b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:57.297889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a5d04743-8fa3-4d38-82ed-cfbc4168bf2b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 8fd14614-1f85-43a0-b2da-544c226de29b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:57.305608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a5d04743-8fa3-4d38-82ed-cfbc4168bf2b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 8fd14614-1f85-43a0-b2da-544c226de29b could not be found. Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5d04743-8fa3-4d38-82ed-cfbc4168bf2b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/8fd14614-1f85-43a0-b2da-544c226de29b/action HTTP/1.1 Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 18 Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: {"unshelve": null} Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 8fd14614-1f85-43a0-b2da-544c226de29b could not be found. Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '8fd14614-1f85-43a0-b2da-544c226de29b', 'body': {'unshelve': None}} Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd14614-1f85-43a0-b2da-544c226de29b could not be found. Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd14614-1f85-43a0-b2da-544c226de29b could not be found. Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:57.307670 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:57.314432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:57.314432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:57.314432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:16:57.314432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:16:57.314432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd14614-1f85-43a0-b2da-544c226de29b could not be found. Jul 26 14:16:57.314432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:16:57.314432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5d04743-8fa3-4d38-82ed-cfbc4168bf2b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 8fd14614-1f85-43a0-b2da-544c226de29b could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:16:57.314432 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a5d04743-8fa3-4d38-82ed-cfbc4168bf2b tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/8fd14614-1f85-43a0-b2da-544c226de29b/action" status: 404 len: 111 microversion: 2.1 time: 0.018030 Jul 26 14:16:57.314432 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1415/2679] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:57 2022] POST /compute/v2.1/servers/8fd14614-1f85-43a0-b2da-544c226de29b/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:16:57.315969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ba14e60-cbb4-4457-9728-c63ece87d4b1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:57.317120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4ba14e60-cbb4-4457-9728-c63ece87d4b1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:57.331438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ba14e60-cbb4-4457-9728-c63ece87d4b1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:57.331921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ba14e60-cbb4-4457-9728-c63ece87d4b1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:57.333004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ba14e60-cbb4-4457-9728-c63ece87d4b1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:57.333462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ba14e60-cbb4-4457-9728-c63ece87d4b1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:57.673977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4ba14e60-cbb4-4457-9728-c63ece87d4b1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:57.693524 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-27602e39-db72-4d60-9820-538d8cf764ac tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.947349 Jul 26 14:16:57.695582 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1265/2680] 10.222.0.70 () {62 vars in 1189 bytes} [Tue Jul 26 14:16:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 7951 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:16:57.705521 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4ba14e60-cbb4-4457-9728-c63ece87d4b1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1311 microversion: 2.1 time: 0.384733 Jul 26 14:16:57.716197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-42bdadf1-2a51-469a-8a3e-611c8d39ee98 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:57.717837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-42bdadf1-2a51-469a-8a3e-611c8d39ee98 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:57.724853 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1416/2681] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:57 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1311 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:57.731034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d3cc8625-cba4-4d18-9348-59f3f02329b8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:57.731664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d3cc8625-cba4-4d18-9348-59f3f02329b8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:57.739048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3cc8625-cba4-4d18-9348-59f3f02329b8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:57.739500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3cc8625-cba4-4d18-9348-59f3f02329b8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:57.740328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3cc8625-cba4-4d18-9348-59f3f02329b8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:57.740939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3cc8625-cba4-4d18-9348-59f3f02329b8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:57.747362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42bdadf1-2a51-469a-8a3e-611c8d39ee98 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:57.747362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42bdadf1-2a51-469a-8a3e-611c8d39ee98 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:57.747362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42bdadf1-2a51-469a-8a3e-611c8d39ee98 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:57.747362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42bdadf1-2a51-469a-8a3e-611c8d39ee98 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:57.764701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:16:57.886467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-42bdadf1-2a51-469a-8a3e-611c8d39ee98 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:57.900339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-42bdadf1-2a51-469a-8a3e-611c8d39ee98 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:57.902438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-42bdadf1-2a51-469a-8a3e-611c8d39ee98 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:57.905256 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-42bdadf1-2a51-469a-8a3e-611c8d39ee98 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1603 microversion: 2.42 time: 0.197821 Jul 26 14:16:57.916187 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1266/2682] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:57 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1603 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:57.928120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-45b95597-23e8-4364-ad4e-7d30a2bc30a2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:57.929953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-45b95597-23e8-4364-ad4e-7d30a2bc30a2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:57.941896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45b95597-23e8-4364-ad4e-7d30a2bc30a2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:57.943117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45b95597-23e8-4364-ad4e-7d30a2bc30a2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:57.945610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45b95597-23e8-4364-ad4e-7d30a2bc30a2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:57.946430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45b95597-23e8-4364-ad4e-7d30a2bc30a2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:57.973323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d3cc8625-cba4-4d18-9348-59f3f02329b8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:57.984618 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d3cc8625-cba4-4d18-9348-59f3f02329b8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.258495 Jul 26 14:16:57.987358 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1417/2683] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:57 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:57.992880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-746dbcd3-9b54-46e0-8d7d-5c8a200023e8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:57.996184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-746dbcd3-9b54-46e0-8d7d-5c8a200023e8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:58.150016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-746dbcd3-9b54-46e0-8d7d-5c8a200023e8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:58.166079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-746dbcd3-9b54-46e0-8d7d-5c8a200023e8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:58.167818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-746dbcd3-9b54-46e0-8d7d-5c8a200023e8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:58.169041 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-746dbcd3-9b54-46e0-8d7d-5c8a200023e8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1285 microversion: 2.32 time: 0.180458 Jul 26 14:16:58.170292 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1418/2684] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:57 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:58.195571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d8d14aed-c7a1-4f6f-ab7f-38d8361a6ea7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:58.196545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d8d14aed-c7a1-4f6f-ab7f-38d8361a6ea7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:58.211445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8d14aed-c7a1-4f6f-ab7f-38d8361a6ea7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.212361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8d14aed-c7a1-4f6f-ab7f-38d8361a6ea7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.213420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8d14aed-c7a1-4f6f-ab7f-38d8361a6ea7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.214163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8d14aed-c7a1-4f6f-ab7f-38d8361a6ea7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.391865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-45b95597-23e8-4364-ad4e-7d30a2bc30a2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:58.405794 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-45b95597-23e8-4364-ad4e-7d30a2bc30a2 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1308 microversion: 2.1 time: 0.487970 Jul 26 14:16:58.406675 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1267/2685] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:57 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1308 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:58.412144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5bbebb5e-9f5b-426f-b0ba-a437acbe7642 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:58.416813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5bbebb5e-9f5b-426f-b0ba-a437acbe7642 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:58.445959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bbebb5e-9f5b-426f-b0ba-a437acbe7642 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.446426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bbebb5e-9f5b-426f-b0ba-a437acbe7642 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.447435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bbebb5e-9f5b-426f-b0ba-a437acbe7642 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.448097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bbebb5e-9f5b-426f-b0ba-a437acbe7642 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.655369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d8d14aed-c7a1-4f6f-ab7f-38d8361a6ea7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:58.672300 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d8d14aed-c7a1-4f6f-ab7f-38d8361a6ea7 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.485250 Jul 26 14:16:58.672906 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1419/2686] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:58 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:58.685620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1db240d3-fbf4-47ec-a25d-3bfecb9bbcdc req-2ee458a4-5a9f-4580-91bc-d15df3f2ae8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f48b35a-d0b1-4601-a9d6-1af81d99f6b6", "tag": "824da495-3034-4a08-821e-b7d317b4eb25"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:58.720437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1db240d3-fbf4-47ec-a25d-3bfecb9bbcdc req-2ee458a4-5a9f-4580-91bc-d15df3f2ae8e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.720437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1db240d3-fbf4-47ec-a25d-3bfecb9bbcdc req-2ee458a4-5a9f-4580-91bc-d15df3f2ae8e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.740336 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1db240d3-fbf4-47ec-a25d-3bfecb9bbcdc req-2ee458a4-5a9f-4580-91bc-d15df3f2ae8e service nova] Creating event network-changed:824da495-3034-4a08-821e-b7d317b4eb25 for instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 on n-h1-833090-9 Jul 26 14:16:58.752161 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1db240d3-fbf4-47ec-a25d-3bfecb9bbcdc req-2ee458a4-5a9f-4580-91bc-d15df3f2ae8e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068650 Jul 26 14:16:58.752921 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1420/2687] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:16:58.768027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f6a4af6-407d-421f-9be7-b9ed8eeb14de tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:58.769402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5bbebb5e-9f5b-426f-b0ba-a437acbe7642 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:58.771027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f6a4af6-407d-421f-9be7-b9ed8eeb14de tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:58.786559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f6a4af6-407d-421f-9be7-b9ed8eeb14de tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.787163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f6a4af6-407d-421f-9be7-b9ed8eeb14de tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.787798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f6a4af6-407d-421f-9be7-b9ed8eeb14de tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.788348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f6a4af6-407d-421f-9be7-b9ed8eeb14de tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.810701 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5bbebb5e-9f5b-426f-b0ba-a437acbe7642 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.402175 Jul 26 14:16:58.816427 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1268/2688] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:58 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:58.826801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ba819177-c10e-48c4-8553-e8fdcd4acbd2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:16:58.828313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ba819177-c10e-48c4-8553-e8fdcd4acbd2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:58.844183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba819177-c10e-48c4-8553-e8fdcd4acbd2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.845637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba819177-c10e-48c4-8553-e8fdcd4acbd2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.849773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba819177-c10e-48c4-8553-e8fdcd4acbd2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.855392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba819177-c10e-48c4-8553-e8fdcd4acbd2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.892514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ba819177-c10e-48c4-8553-e8fdcd4acbd2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Cannot 'unshelve' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ba819177-c10e-48c4-8553-e8fdcd4acbd2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action HTTP/1.1 Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 18 Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: {"unshelve": null} Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: exception: Cannot 'unshelve' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e6b94307-dd41-4f71-b529-c6cbb944c27f', 'body': {'unshelve': None}} Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f in vm_state active. Cannot unshelve while the instance is in this state. Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:16:58.894986 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:16:58.900829 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:58.900829 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:16:58.900829 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:58.900829 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:16:58.900829 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:16:58.900829 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:16:58.900829 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:16:58.900829 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:16:58.900829 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active Jul 26 14:16:58.900829 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:16:58.905173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ba819177-c10e-48c4-8553-e8fdcd4acbd2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 409 to user: Cannot 'unshelve' instance e6b94307-dd41-4f71-b529-c6cbb944c27f while it is in vm_state active {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:16:58.906593 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ba819177-c10e-48c4-8553-e8fdcd4acbd2 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action" status: 409 len: 146 microversion: 2.1 time: 0.088171 Jul 26 14:16:58.907715 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1269/2689] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:16:58 2022] POST /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f/action => generated 146 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:16:58.913120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a1fb3d0c-8a09-4260-bd40-791f6a3faf78 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:58.914824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a1fb3d0c-8a09-4260-bd40-791f6a3faf78 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:58.922305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1fb3d0c-8a09-4260-bd40-791f6a3faf78 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.923330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1fb3d0c-8a09-4260-bd40-791f6a3faf78 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.926277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1fb3d0c-8a09-4260-bd40-791f6a3faf78 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:58.932206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1fb3d0c-8a09-4260-bd40-791f6a3faf78 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:58.966381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f6a4af6-407d-421f-9be7-b9ed8eeb14de tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:58.992716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f6a4af6-407d-421f-9be7-b9ed8eeb14de tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.001759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f6a4af6-407d-421f-9be7-b9ed8eeb14de tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.005034 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f6a4af6-407d-421f-9be7-b9ed8eeb14de tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1356 microversion: 2.47 time: 0.250698 Jul 26 14:16:59.016013 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1421/2690] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:58 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1356 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:59.027108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6498cdd0-3063-417d-bd90-717e08b26448 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:59.033411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6498cdd0-3063-417d-bd90-717e08b26448 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:59.071031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6498cdd0-3063-417d-bd90-717e08b26448 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.072339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6498cdd0-3063-417d-bd90-717e08b26448 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:59.073839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6498cdd0-3063-417d-bd90-717e08b26448 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.080466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6498cdd0-3063-417d-bd90-717e08b26448 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:59.437562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a1fb3d0c-8a09-4260-bd40-791f6a3faf78 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.457559 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a1fb3d0c-8a09-4260-bd40-791f6a3faf78 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1311 microversion: 2.1 time: 0.548496 Jul 26 14:16:59.458160 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1270/2691] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:58 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1311 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:59.463448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-467808ef-9307-4953-a56d-563c59206dbb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:59.464114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-467808ef-9307-4953-a56d-563c59206dbb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:59.480956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-467808ef-9307-4953-a56d-563c59206dbb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.481354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-467808ef-9307-4953-a56d-563c59206dbb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:59.486633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-467808ef-9307-4953-a56d-563c59206dbb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.487412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-467808ef-9307-4953-a56d-563c59206dbb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:59.589620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6498cdd0-3063-417d-bd90-717e08b26448 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.598671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6498cdd0-3063-417d-bd90-717e08b26448 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.580632 Jul 26 14:16:59.602137 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1422/2692] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:59 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:16:59.607788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:59.613090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.614341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Searching by: {'deleted': False, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:16:59.622371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.623898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:59.625176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.625697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:59.634264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-467808ef-9307-4953-a56d-563c59206dbb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.651015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-467808ef-9307-4953-a56d-563c59206dbb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.654223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-467808ef-9307-4953-a56d-563c59206dbb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.656902 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-467808ef-9307-4953-a56d-563c59206dbb tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1603 microversion: 2.42 time: 0.196946 Jul 26 14:16:59.658110 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1271/2693] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:59 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1603 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:59.664490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad4642e3-b04f-49a4-b517-3a735125f165 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:59.666041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ad4642e3-b04f-49a4-b517-3a735125f165 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:59.676303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad4642e3-b04f-49a4-b517-3a735125f165 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.677099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad4642e3-b04f-49a4-b517-3a735125f165 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:59.678312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad4642e3-b04f-49a4-b517-3a735125f165 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.679580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad4642e3-b04f-49a4-b517-3a735125f165 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:59.787986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ad4642e3-b04f-49a4-b517-3a735125f165 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.801428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ad4642e3-b04f-49a4-b517-3a735125f165 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.803141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ad4642e3-b04f-49a4-b517-3a735125f165 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.804843 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad4642e3-b04f-49a4-b517-3a735125f165 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1575 microversion: 2.32 time: 0.145423 Jul 26 14:16:59.815983 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1272/2694] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:16:59 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:16:59.828291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-43a03c59-4f27-42c2-b500-6209621d9a3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:16:59.828291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-43a03c59-4f27-42c2-b500-6209621d9a3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:16:59.837489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a03c59-4f27-42c2-b500-6209621d9a3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.837947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a03c59-4f27-42c2-b500-6209621d9a3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:59.839326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a03c59-4f27-42c2-b500-6209621d9a3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.839326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a03c59-4f27-42c2-b500-6209621d9a3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:16:59.845514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:16:59.970434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:16:59.986025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:16:59.986776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:00.010859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:00.017784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:00.225065 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a17ea709-0225-4976-8f04-f39b7f7b6145 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.621462 Jul 26 14:17:00.227481 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1423/2695] 10.222.0.70 () {60 vars in 1187 bytes} [Tue Jul 26 14:16:59 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:00.233985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0b6294c3-270e-48ba-81ac-74fda3dfc715 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:00.235652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0b6294c3-270e-48ba-81ac-74fda3dfc715 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:00.265961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43a03c59-4f27-42c2-b500-6209621d9a3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:00.268645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b6294c3-270e-48ba-81ac-74fda3dfc715 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:00.269677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b6294c3-270e-48ba-81ac-74fda3dfc715 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:00.274646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b6294c3-270e-48ba-81ac-74fda3dfc715 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:00.275481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b6294c3-270e-48ba-81ac-74fda3dfc715 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:00.287741 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-43a03c59-4f27-42c2-b500-6209621d9a3a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1487 microversion: 2.1 time: 0.480833 Jul 26 14:17:00.296612 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1273/2696] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:16:59 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1487 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:00.312416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-553dd80f-8980-4e8d-b8df-3a2746f1271b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:00.313460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-553dd80f-8980-4e8d-b8df-3a2746f1271b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:00.334744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:00.337140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-553dd80f-8980-4e8d-b8df-3a2746f1271b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:00.340624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-553dd80f-8980-4e8d-b8df-3a2746f1271b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:00.341818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-553dd80f-8980-4e8d-b8df-3a2746f1271b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:00.344435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-553dd80f-8980-4e8d-b8df-3a2746f1271b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:00.641787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0b6294c3-270e-48ba-81ac-74fda3dfc715 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:00.652820 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0b6294c3-270e-48ba-81ac-74fda3dfc715 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.423868 Jul 26 14:17:00.664563 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1424/2697] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:00 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:00.675473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-806c5f44-a3ac-4f7b-98d6-ac11b644e134 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:00.676013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-806c5f44-a3ac-4f7b-98d6-ac11b644e134 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:00.691639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806c5f44-a3ac-4f7b-98d6-ac11b644e134 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:00.692235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806c5f44-a3ac-4f7b-98d6-ac11b644e134 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:00.693093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806c5f44-a3ac-4f7b-98d6-ac11b644e134 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:00.697210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-806c5f44-a3ac-4f7b-98d6-ac11b644e134 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:00.757751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:00.767850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-806c5f44-a3ac-4f7b-98d6-ac11b644e134 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:17:00.911745 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-806c5f44-a3ac-4f7b-98d6-ac11b644e134 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "DELETE /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 204 len: 0 microversion: 2.47 time: 0.245625 Jul 26 14:17:00.916384 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1425/2698] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:17:00 2022] DELETE /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:17:00.927404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2cfa0e01-3023-42db-85bc-e4ea3f5af57e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1047236043"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:00.931336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2cfa0e01-3023-42db-85bc-e4ea3f5af57e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:00.936612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-553dd80f-8980-4e8d-b8df-3a2746f1271b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:00.940860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cfa0e01-3023-42db-85bc-e4ea3f5af57e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:00.941392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cfa0e01-3023-42db-85bc-e4ea3f5af57e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:00.942289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cfa0e01-3023-42db-85bc-e4ea3f5af57e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:00.942863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cfa0e01-3023-42db-85bc-e4ea3f5af57e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:00.945783 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-553dd80f-8980-4e8d-b8df-3a2746f1271b tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.647692 Jul 26 14:17:00.958624 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1274/2699] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:00 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:00.978633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2b17719e-89c0-42e0-a97a-910fcb16bea2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:00.979633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2b17719e-89c0-42e0-a97a-910fcb16bea2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:00.993585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b17719e-89c0-42e0-a97a-910fcb16bea2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:00.994389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b17719e-89c0-42e0-a97a-910fcb16bea2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:00.995385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b17719e-89c0-42e0-a97a-910fcb16bea2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:00.996047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b17719e-89c0-42e0-a97a-910fcb16bea2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:01.343026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2b17719e-89c0-42e0-a97a-910fcb16bea2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:01.350743 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2b17719e-89c0-42e0-a97a-910fcb16bea2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1311 microversion: 2.1 time: 0.377249 Jul 26 14:17:01.357404 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1275/2700] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:00 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:01.362631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-8c6fa020-994c-4ec4-8f12-c3a3b0bac52d req-6b4d1dcb-508e-4ff9-a9be-8f1f8aca896f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f48b35a-d0b1-4601-a9d6-1af81d99f6b6", "name": "network-vif-plugged", "status": "completed", "tag": "824da495-3034-4a08-821e-b7d317b4eb25"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:01.386640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-8c6fa020-994c-4ec4-8f12-c3a3b0bac52d req-6b4d1dcb-508e-4ff9-a9be-8f1f8aca896f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:01.387328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-8c6fa020-994c-4ec4-8f12-c3a3b0bac52d req-6b4d1dcb-508e-4ff9-a9be-8f1f8aca896f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:01.401311 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-8c6fa020-994c-4ec4-8f12-c3a3b0bac52d req-6b4d1dcb-508e-4ff9-a9be-8f1f8aca896f service nova] Creating event network-vif-plugged:824da495-3034-4a08-821e-b7d317b4eb25 for instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 on n-h1-833090-9 Jul 26 14:17:01.407635 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-8c6fa020-994c-4ec4-8f12-c3a3b0bac52d req-6b4d1dcb-508e-4ff9-a9be-8f1f8aca896f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048556 Jul 26 14:17:01.414825 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1276/2701] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:01.434230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32c0c9ad-220f-4c9f-9e85-f7ec916c716f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1412594123_updated"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:01.437009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-32c0c9ad-220f-4c9f-9e85-f7ec916c716f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 72c1ac66-4554-4065-b537-43b3ee89273d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:01.451456 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-32c0c9ad-220f-4c9f-9e85-f7ec916c716f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 72c1ac66-4554-4065-b537-43b3ee89273d could not be found. Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32c0c9ad-220f-4c9f-9e85-f7ec916c716f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: request: PUT /compute/v2.1/servers/72c1ac66-4554-4065-b537-43b3ee89273d HTTP/1.1 Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 81 Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1412594123_updated"}} Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 72c1ac66-4554-4065-b537-43b3ee89273d could not be found. Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '72c1ac66-4554-4065-b537-43b3ee89273d', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1412594123_updated'}}} Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c1ac66-4554-4065-b537-43b3ee89273d could not be found. Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 26 14:17:01.453570 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c1ac66-4554-4065-b537-43b3ee89273d could not be found. Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c1ac66-4554-4065-b537-43b3ee89273d could not be found. Jul 26 14:17:01.458201 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:01.460258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32c0c9ad-220f-4c9f-9e85-f7ec916c716f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 72c1ac66-4554-4065-b537-43b3ee89273d could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:01.461889 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32c0c9ad-220f-4c9f-9e85-f7ec916c716f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "PUT /compute/v2.1/servers/72c1ac66-4554-4065-b537-43b3ee89273d" status: 404 len: 111 microversion: 2.1 time: 0.045388 Jul 26 14:17:01.462646 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1277/2702] 10.222.0.70 () {60 vars in 1256 bytes} [Tue Jul 26 14:17:01 2022] PUT /compute/v2.1/servers/72c1ac66-4554-4065-b537-43b3ee89273d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:01.469854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff166203-ce93-40d5-ba18-3cf76461cfe5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:01.480142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ff166203-ce93-40d5-ba18-3cf76461cfe5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:01.489796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff166203-ce93-40d5-ba18-3cf76461cfe5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:01.490538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff166203-ce93-40d5-ba18-3cf76461cfe5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:01.492299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff166203-ce93-40d5-ba18-3cf76461cfe5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:01.492952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff166203-ce93-40d5-ba18-3cf76461cfe5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:01.656099 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2cfa0e01-3023-42db-85bc-e4ea3f5af57e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "POST /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899/action" status: 202 len: 0 microversion: 2.1 time: 0.734362 Jul 26 14:17:01.657861 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1426/2703] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:17:00 2022] POST /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 14:17:01.664721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8757844d-fa41-4640-9fa2-a6c979d0c49e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:01.665670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8757844d-fa41-4640-9fa2-a6c979d0c49e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:01.680239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8757844d-fa41-4640-9fa2-a6c979d0c49e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:01.681281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8757844d-fa41-4640-9fa2-a6c979d0c49e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:01.697251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8757844d-fa41-4640-9fa2-a6c979d0c49e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:01.698196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8757844d-fa41-4640-9fa2-a6c979d0c49e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:02.112841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ff166203-ce93-40d5-ba18-3cf76461cfe5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:02.134243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ff166203-ce93-40d5-ba18-3cf76461cfe5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:02.142031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ff166203-ce93-40d5-ba18-3cf76461cfe5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:02.143689 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff166203-ce93-40d5-ba18-3cf76461cfe5 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1603 microversion: 2.42 time: 0.679837 Jul 26 14:17:02.160627 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1278/2704] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:01 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1603 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:02.181099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b3ecff8b-c19f-4fb7-b121-18ae60da07c1 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:02.182298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b3ecff8b-c19f-4fb7-b121-18ae60da07c1 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:02.190031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3ecff8b-c19f-4fb7-b121-18ae60da07c1 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:02.192105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3ecff8b-c19f-4fb7-b121-18ae60da07c1 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:02.193212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3ecff8b-c19f-4fb7-b121-18ae60da07c1 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:02.196574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3ecff8b-c19f-4fb7-b121-18ae60da07c1 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:02.254145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8757844d-fa41-4640-9fa2-a6c979d0c49e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:02.281357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8757844d-fa41-4640-9fa2-a6c979d0c49e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:02.294922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8757844d-fa41-4640-9fa2-a6c979d0c49e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:02.297003 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8757844d-fa41-4640-9fa2-a6c979d0c49e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1593 microversion: 2.32 time: 0.637492 Jul 26 14:17:02.299990 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1427/2705] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:01 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1593 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:02.315710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba6ac206-214f-46b2-a337-07ed4cd440b6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:02.321736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba6ac206-214f-46b2-a337-07ed4cd440b6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:02.337272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba6ac206-214f-46b2-a337-07ed4cd440b6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:02.340351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba6ac206-214f-46b2-a337-07ed4cd440b6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:02.341469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba6ac206-214f-46b2-a337-07ed4cd440b6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:02.342165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba6ac206-214f-46b2-a337-07ed4cd440b6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:02.418350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b3ecff8b-c19f-4fb7-b121-18ae60da07c1 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:02.430959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b3ecff8b-c19f-4fb7-b121-18ae60da07c1 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:02.432425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b3ecff8b-c19f-4fb7-b121-18ae60da07c1 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:02.434063 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b3ecff8b-c19f-4fb7-b121-18ae60da07c1 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 200 len: 1362 microversion: 2.47 time: 0.271873 Jul 26 14:17:02.444985 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1279/2706] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:02 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:02.458378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3231e7e1-40cc-47b6-9161-e869a78ebc0e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799259280>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:02.520713 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3231e7e1-40cc-47b6-9161-e869a78ebc0e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318" status: 200 len: 1412 microversion: 2.1 time: 0.074154 Jul 26 14:17:02.523203 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1280/2707] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:17:02 2022] GET /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:02.528709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c94d0673-375f-4ab9-92ef-ccf1a3781511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:02.529670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c94d0673-375f-4ab9-92ef-ccf1a3781511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:02.537515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c94d0673-375f-4ab9-92ef-ccf1a3781511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:02.538884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c94d0673-375f-4ab9-92ef-ccf1a3781511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:02.539722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c94d0673-375f-4ab9-92ef-ccf1a3781511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:02.540197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c94d0673-375f-4ab9-92ef-ccf1a3781511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:02.834106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba6ac206-214f-46b2-a337-07ed4cd440b6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:02.854490 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba6ac206-214f-46b2-a337-07ed4cd440b6 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.551581 Jul 26 14:17:02.856901 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1428/2708] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:02 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:02.877902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0b25175-9891-47e0-a6e9-900e4237f936 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:02.878558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d0b25175-9891-47e0-a6e9-900e4237f936 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:02.894565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0b25175-9891-47e0-a6e9-900e4237f936 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:02.895138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0b25175-9891-47e0-a6e9-900e4237f936 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:02.896032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0b25175-9891-47e0-a6e9-900e4237f936 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:02.898787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0b25175-9891-47e0-a6e9-900e4237f936 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:03.229533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c94d0673-375f-4ab9-92ef-ccf1a3781511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:03.253258 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c94d0673-375f-4ab9-92ef-ccf1a3781511 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.727957 Jul 26 14:17:03.263989 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1281/2709] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:02 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:03.263989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d90983e7-29b8-44eb-b099-cb7b9a4ec889 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f87992dc3a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:03.297001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d0b25175-9891-47e0-a6e9-900e4237f936 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:03.315094 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d0b25175-9891-47e0-a6e9-900e4237f936 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1311 microversion: 2.1 time: 0.447405 Jul 26 14:17:03.315741 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1429/2710] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:02 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1311 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:03.330990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4e0a600b-d7ae-4041-8c28-f8088379468f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:03.331711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4e0a600b-d7ae-4041-8c28-f8088379468f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:03.348012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e0a600b-d7ae-4041-8c28-f8088379468f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:03.348857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e0a600b-d7ae-4041-8c28-f8088379468f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:03.352226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e0a600b-d7ae-4041-8c28-f8088379468f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:03.352947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e0a600b-d7ae-4041-8c28-f8088379468f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:03.363378 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d90983e7-29b8-44eb-b099-cb7b9a4ec889 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318" status: 200 len: 1412 microversion: 2.1 time: 0.107895 Jul 26 14:17:03.388444 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1282/2711] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:17:03 2022] GET /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318 => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:03.394671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:03.395659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:03.413560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:03.415345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:03.420598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:03.421336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:03.542976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:03.544831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:03.546022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lazy-loading 'fault' on Instance uuid 9dfcc2ed-fde9-4ef4-840b-012106b72b1b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:17:03.693988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:03.706357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:03.711832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad8834232064fa7bb2164d542d29e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bbec12160842eab535494da3e993aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:03.715650 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bff63c24-f2fc-446d-ac26-f3bf2218d300 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 200 len: 1370 microversion: 2.42 time: 0.325506 Jul 26 14:17:03.717252 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1283/2712] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:03 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 1370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:03.728700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44dad157-4cb6-4110-a8fd-670cf28f1302 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:03.730588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44dad157-4cb6-4110-a8fd-670cf28f1302 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:03.745196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44dad157-4cb6-4110-a8fd-670cf28f1302 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:03.748436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44dad157-4cb6-4110-a8fd-670cf28f1302 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:03.750226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44dad157-4cb6-4110-a8fd-670cf28f1302 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:03.752986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44dad157-4cb6-4110-a8fd-670cf28f1302 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:03.828769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4e0a600b-d7ae-4041-8c28-f8088379468f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:03.852880 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4e0a600b-d7ae-4041-8c28-f8088379468f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.533667 Jul 26 14:17:03.854636 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1430/2713] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:03 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:03.878774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-028eadf8-bde7-4b86-8140-6f0ee2b99820 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8786fe80d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:04.109607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-44dad157-4cb6-4110-a8fd-670cf28f1302 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:04.165919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-44dad157-4cb6-4110-a8fd-670cf28f1302 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:04.172055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-44dad157-4cb6-4110-a8fd-670cf28f1302 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:04.180172 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-44dad157-4cb6-4110-a8fd-670cf28f1302 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1660 microversion: 2.32 time: 0.456708 Jul 26 14:17:04.186563 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1284/2714] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:03 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1660 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:04.214260 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-028eadf8-bde7-4b86-8140-6f0ee2b99820 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318" status: 204 len: 0 microversion: 2.1 time: 0.356610 Jul 26 14:17:04.218827 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1431/2715] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:03 2022] DELETE /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:04.224730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf4bf567-5841-424b-8e42-2e08c9e8e006 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf4bf567-5841-424b-8e42-2e08c9e8e006 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f HTTP/1.1 Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 280 Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e6b94307-dd41-4f71-b529-c6cbb944c27f', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.231218 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:17:04.235234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.241169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf4bf567-5841-424b-8e42-2e08c9e8e006 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:04.243333 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bf4bf567-5841-424b-8e42-2e08c9e8e006 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "PUT /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 400 len: 619 microversion: 2.1 time: 0.022959 Jul 26 14:17:04.244143 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1432/2716] 10.222.0.70 () {60 vars in 1257 bytes} [Tue Jul 26 14:17:04 2022] PUT /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:17:04.251353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f1ecb16b-1fa9-4441-88d5-b1bde5ad01e3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:04.255274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5063a433-122a-4126-b2a2-e1166d4ff9dc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799264160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:04.259289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f1ecb16b-1fa9-4441-88d5-b1bde5ad01e3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: 139acc5c-7598-492e-aac6-1545f1fa7de6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:04.292974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1ecb16b-1fa9-4441-88d5-b1bde5ad01e3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:04.293439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1ecb16b-1fa9-4441-88d5-b1bde5ad01e3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:04.294227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1ecb16b-1fa9-4441-88d5-b1bde5ad01e3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:04.300637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1ecb16b-1fa9-4441-88d5-b1bde5ad01e3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:04.304303 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-5063a433-122a-4126-b2a2-e1166d4ff9dc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Image not found. Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5063a433-122a-4126-b2a2-e1166d4ff9dc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318 HTTP/1.1 Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: exception: Image not found. Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '81c213a0-9ce1-4108-9478-c9c6c21a2318'} Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 81c213a0-9ce1-4108-9478-c9c6c21a2318 Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 14:17:04.307184 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 81c213a0-9ce1-4108-9478-c9c6c21a2318 could not be found. Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:17:04.312201 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.317626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5063a433-122a-4126-b2a2-e1166d4ff9dc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Image not found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:04.318743 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5063a433-122a-4126-b2a2-e1166d4ff9dc tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318" status: 404 len: 62 microversion: 2.1 time: 0.070009 Jul 26 14:17:04.336184 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1433/2717] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:17:04 2022] GET /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:17:04.349171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c162c734-bca5-4ffe-90f2-acbd237fa114 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:04.349908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c162c734-bca5-4ffe-90f2-acbd237fa114 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:04.352651 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-f1ecb16b-1fa9-4441-88d5-b1bde5ad01e3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] HTTP exception thrown: Instance 139acc5c-7598-492e-aac6-1545f1fa7de6 could not be found. Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f1ecb16b-1fa9-4441-88d5-b1bde5ad01e3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Request method failure captured: Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 HTTP/1.1 Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ccMZHaq5W1GzKOHfU4M3oVxUObPzUldRkXoKZdhT10-oBisAFgv4i96HAvHJZX91cIZ9_nDeffNPyptfgbDEbvlUPYGnx4pjl_avVnjBEuBGoeMxzDrGP10b9wohpK1yNKMzT2ngsZd7p8alM8_7SjbA5eY5WFQ_FaV7qmrdAfL3I Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.47 Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: e61ca0c2974c4a7880d4fe53d15bdf66 Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerShowV247Test-1823304033 Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e61ca0c2974c4a7880d4fe53d15bdf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e61ca0c2974c4a7880d4fe53d15bdf66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e61ca0c2974c4a7880d4fe53d15bdf66", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e61ca0c2974c4a7880d4fe53d15bdf66"}]}] Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerShowV247Test-1823304033 Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: e61ca0c2974c4a7880d4fe53d15bdf66 Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerShowV247Test-1823304033 Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerShowV247Test-1823304033-project Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: fce2c000c2d840fb8f0b53736e45fcbd Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerShowV247Test-1823304033-project Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 139acc5c-7598-492e-aac6-1545f1fa7de6 could not be found. Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '139acc5c-7598-492e-aac6-1545f1fa7de6'} Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 139acc5c-7598-492e-aac6-1545f1fa7de6 could not be found. Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 139acc5c-7598-492e-aac6-1545f1fa7de6 could not be found. Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:04.354252 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.358990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:04.358990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:04.358990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:04.358990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:04.358990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:04.358990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 139acc5c-7598-492e-aac6-1545f1fa7de6 could not be found. Jul 26 14:17:04.358990 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:04.358990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f1ecb16b-1fa9-4441-88d5-b1bde5ad01e3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Returning 404 to user: Instance 139acc5c-7598-492e-aac6-1545f1fa7de6 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:04.358990 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f1ecb16b-1fa9-4441-88d5-b1bde5ad01e3 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6" status: 404 len: 111 microversion: 2.47 time: 0.167320 Jul 26 14:17:04.374970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c162c734-bca5-4ffe-90f2-acbd237fa114 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:04.375500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c162c734-bca5-4ffe-90f2-acbd237fa114 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:04.377324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c162c734-bca5-4ffe-90f2-acbd237fa114 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:04.377480 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1285/2718] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:04 2022] GET /compute/v2.1/servers/139acc5c-7598-492e-aac6-1545f1fa7de6 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:17:04.380142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c162c734-bca5-4ffe-90f2-acbd237fa114 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:04.389050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bea9b6b7-f503-4d0c-b2e2-f0bc4da9a90e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:04.393757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bea9b6b7-f503-4d0c-b2e2-f0bc4da9a90e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:04.410552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bea9b6b7-f503-4d0c-b2e2-f0bc4da9a90e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:04.411178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bea9b6b7-f503-4d0c-b2e2-f0bc4da9a90e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:04.414010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bea9b6b7-f503-4d0c-b2e2-f0bc4da9a90e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:04.414792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bea9b6b7-f503-4d0c-b2e2-f0bc4da9a90e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:04.782428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bea9b6b7-f503-4d0c-b2e2-f0bc4da9a90e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:04.795394 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bea9b6b7-f503-4d0c-b2e2-f0bc4da9a90e tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.416523 Jul 26 14:17:04.796800 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1286/2719] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:04 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:04.804510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b25056d2-4bf5-464b-a91a-2851db74df9a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:04.805463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b25056d2-4bf5-464b-a91a-2851db74df9a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:04.814864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25056d2-4bf5-464b-a91a-2851db74df9a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:04.815765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25056d2-4bf5-464b-a91a-2851db74df9a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:04.816887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25056d2-4bf5-464b-a91a-2851db74df9a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:04.817569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25056d2-4bf5-464b-a91a-2851db74df9a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:04.825741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:04.952072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c162c734-bca5-4ffe-90f2-acbd237fa114 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:04.962509 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c162c734-bca5-4ffe-90f2-acbd237fa114 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.623960 Jul 26 14:17:04.969709 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1434/2720] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:04 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:04.985415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cf89ec3d-4e08-46ba-85a7-961b0eb6f187 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:04.986455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cf89ec3d-4e08-46ba-85a7-961b0eb6f187 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:04.998096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf89ec3d-4e08-46ba-85a7-961b0eb6f187 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:05.004947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf89ec3d-4e08-46ba-85a7-961b0eb6f187 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:05.006178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf89ec3d-4e08-46ba-85a7-961b0eb6f187 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:05.007583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf89ec3d-4e08-46ba-85a7-961b0eb6f187 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:05.044792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b25056d2-4bf5-464b-a91a-2851db74df9a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:05.052500 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b25056d2-4bf5-464b-a91a-2851db74df9a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1505 microversion: 2.1 time: 0.253706 Jul 26 14:17:05.060620 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1287/2721] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:04 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:05.067288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cba39a5a-0faa-474c-b4e1-f2d63c07c73f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:05.067817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cba39a5a-0faa-474c-b4e1-f2d63c07c73f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: dcaf7033-f14c-4c88-90d2-4060c1fc2b8a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:05.086218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cba39a5a-0faa-474c-b4e1-f2d63c07c73f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:05.087020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cba39a5a-0faa-474c-b4e1-f2d63c07c73f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:05.087868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cba39a5a-0faa-474c-b4e1-f2d63c07c73f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:05.088341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cba39a5a-0faa-474c-b4e1-f2d63c07c73f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:05.150320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cba39a5a-0faa-474c-b4e1-f2d63c07c73f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: dcaf7033-f14c-4c88-90d2-4060c1fc2b8a] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:17:05.328662 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cba39a5a-0faa-474c-b4e1-f2d63c07c73f tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a" status: 204 len: 0 microversion: 2.47 time: 0.265757 Jul 26 14:17:05.330254 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1288/2722] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:17:05 2022] DELETE /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:17:05.336482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d1c80709-dc8e-45ec-a65b-08481af91b7c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:05.344726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d1c80709-dc8e-45ec-a65b-08481af91b7c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:05.352330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1c80709-dc8e-45ec-a65b-08481af91b7c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:05.355595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1c80709-dc8e-45ec-a65b-08481af91b7c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:05.364347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1c80709-dc8e-45ec-a65b-08481af91b7c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:05.365176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1c80709-dc8e-45ec-a65b-08481af91b7c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:05.406393 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d1c80709-dc8e-45ec-a65b-08481af91b7c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] HTTP exception thrown: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d1c80709-dc8e-45ec-a65b-08481af91b7c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Request method failure captured: Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b HTTP/1.1 Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VwPBfiFwSMWhm63JOoZ17tTa9nT7br__eXo1Y152S2bJtgtwlEC5O6acyWxQZckWj9nITI4htu3HNn33LOXAhaza_wIl4KfJhbz3wycN8Tn0yActs48s8Jwhxeyj-GdbnjhGRGAvb3CQN_pvjG3Bm2RMtlCUFr67CymWaOUR1HXJs Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.42 Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: b2bbec12160842eab535494da3e993aa Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1638952214 Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2bbec12160842eab535494da3e993aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b2bbec12160842eab535494da3e993aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b2bbec12160842eab535494da3e993aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2bbec12160842eab535494da3e993aa"}]}] Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1638952214 Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: b2bbec12160842eab535494da3e993aa Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1638952214 Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TaggedBootDevicesTest_v242-1638952214-project Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8ad8834232064fa7bb2164d542d29e32 Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1638952214-project Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '9dfcc2ed-fde9-4ef4-840b-012106b72b1b'} Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:05.409795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:05.414091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:05.414091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:05.414091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:05.414091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:05.414091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:05.414091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:05.414091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:05.414091 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:05.414778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cf89ec3d-4e08-46ba-85a7-961b0eb6f187 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:05.420476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d1c80709-dc8e-45ec-a65b-08481af91b7c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Returning 404 to user: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:05.428233 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d1c80709-dc8e-45ec-a65b-08481af91b7c tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 404 len: 111 microversion: 2.42 time: 0.095962 Jul 26 14:17:05.429506 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1289/2723] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:05 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:17:05.435224 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cf89ec3d-4e08-46ba-85a7-961b0eb6f187 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1493 microversion: 2.1 time: 0.464121 Jul 26 14:17:05.435847 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1435/2724] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:04 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1493 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:05.437215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-786db759-c352-4c91-a77f-c589c089cef8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:05.438834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-786db759-c352-4c91-a77f-c589c089cef8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:05.448964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-786db759-c352-4c91-a77f-c589c089cef8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:05.458247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-786db759-c352-4c91-a77f-c589c089cef8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:05.458411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5f2c2585-d2ba-4847-80ac-ecb8b38a22d1 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:05.459025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5f2c2585-d2ba-4847-80ac-ecb8b38a22d1 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:05.466712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-786db759-c352-4c91-a77f-c589c089cef8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:05.472628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-786db759-c352-4c91-a77f-c589c089cef8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:05.485159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f2c2585-d2ba-4847-80ac-ecb8b38a22d1 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:05.485621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f2c2585-d2ba-4847-80ac-ecb8b38a22d1 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:05.486417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f2c2585-d2ba-4847-80ac-ecb8b38a22d1 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:05.486859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f2c2585-d2ba-4847-80ac-ecb8b38a22d1 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:05.951048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5f2c2585-d2ba-4847-80ac-ecb8b38a22d1 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:05.983559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5f2c2585-d2ba-4847-80ac-ecb8b38a22d1 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:05.987191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5f2c2585-d2ba-4847-80ac-ecb8b38a22d1 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:05.989281 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5f2c2585-d2ba-4847-80ac-ecb8b38a22d1 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1706 microversion: 2.32 time: 0.548007 Jul 26 14:17:06.020484 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1436/2725] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:05 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1706 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:06.036342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29a623c8-9b51-4435-a7c2-b48770a3eede tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:06.037687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-29a623c8-9b51-4435-a7c2-b48770a3eede tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: dcaf7033-f14c-4c88-90d2-4060c1fc2b8a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:06.046734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29a623c8-9b51-4435-a7c2-b48770a3eede tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:06.047439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29a623c8-9b51-4435-a7c2-b48770a3eede tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:06.048705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29a623c8-9b51-4435-a7c2-b48770a3eede tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:06.049347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29a623c8-9b51-4435-a7c2-b48770a3eede tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:06.051525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-786db759-c352-4c91-a77f-c589c089cef8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:06.063971 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-786db759-c352-4c91-a77f-c589c089cef8 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.632989 Jul 26 14:17:06.064581 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1290/2726] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:05 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:06.092962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7993914b-2c3f-4d83-b1d3-c03fa1b9d490 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '.version_select at 0x7f8799259a60>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:06.126071 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7993914b-2c3f-4d83-b1d3-c03fa1b9d490 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-713665900" status: 204 len: 0 microversion: 2.42 time: 0.052168 Jul 26 14:17:06.130209 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1291/2727] 10.222.0.70 () {60 vars in 1259 bytes} [Tue Jul 26 14:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-713665900 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:17:06.142771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9e4db2f5-dd68-4fb7-aa46-db770b7d02f8 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:06.143413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9e4db2f5-dd68-4fb7-aa46-db770b7d02f8 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:06.157818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e4db2f5-dd68-4fb7-aa46-db770b7d02f8 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:06.158313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e4db2f5-dd68-4fb7-aa46-db770b7d02f8 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:06.159123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e4db2f5-dd68-4fb7-aa46-db770b7d02f8 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:06.159570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e4db2f5-dd68-4fb7-aa46-db770b7d02f8 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:06.291099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-29a623c8-9b51-4435-a7c2-b48770a3eede tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:06.307226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-29a623c8-9b51-4435-a7c2-b48770a3eede tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:06.315856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-29a623c8-9b51-4435-a7c2-b48770a3eede tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:06.318114 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-29a623c8-9b51-4435-a7c2-b48770a3eede tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a" status: 200 len: 1362 microversion: 2.47 time: 0.294555 Jul 26 14:17:06.321276 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1437/2728] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:06 2022] GET /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:06.337247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0c1422fe-b620-4dbe-b4d3-f4c60ab864c0 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:06.337915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0c1422fe-b620-4dbe-b4d3-f4c60ab864c0 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:06.354560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c1422fe-b620-4dbe-b4d3-f4c60ab864c0 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:06.355023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c1422fe-b620-4dbe-b4d3-f4c60ab864c0 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:06.355816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c1422fe-b620-4dbe-b4d3-f4c60ab864c0 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:06.356381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c1422fe-b620-4dbe-b4d3-f4c60ab864c0 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:06.499765 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9e4db2f5-dd68-4fb7-aa46-db770b7d02f8 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1644 microversion: 2.1 time: 0.363249 Jul 26 14:17:06.501965 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1292/2729] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:06 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1644 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:06.522965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b3df24a3-9f48-4f28-a228-c375975cd187 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:06.526038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b3df24a3-9f48-4f28-a228-c375975cd187 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:06.548113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3df24a3-9f48-4f28-a228-c375975cd187 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:06.550839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3df24a3-9f48-4f28-a228-c375975cd187 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:06.556289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3df24a3-9f48-4f28-a228-c375975cd187 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:06.558181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3df24a3-9f48-4f28-a228-c375975cd187 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:06.753021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0c1422fe-b620-4dbe-b4d3-f4c60ab864c0 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:06.769029 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0c1422fe-b620-4dbe-b4d3-f4c60ab864c0 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1523 microversion: 2.1 time: 0.445955 Jul 26 14:17:06.771549 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1438/2730] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:06 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1523 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:06.779662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-babd7ae6-5179-49bf-91ab-511abd0e86d3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:06.789243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-babd7ae6-5179-49bf-91ab-511abd0e86d3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f HTTP/1.1 Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 24 Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": ""}} Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e6b94307-dd41-4f71-b529-c6cbb944c27f', 'body': {'server': {'name': ''}}} Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi '' Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:17:06.791603 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:06.795882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-babd7ae6-5179-49bf-91ab-511abd0e86d3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:06.798396 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-babd7ae6-5179-49bf-91ab-511abd0e86d3 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "PUT /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 400 len: 108 microversion: 2.1 time: 0.021126 Jul 26 14:17:06.799911 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1439/2731] 10.222.0.70 () {60 vars in 1256 bytes} [Tue Jul 26 14:17:06 2022] PUT /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:17:06.813549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af27aa82-2292-4146-9216-72b4d84d0a30 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:06.815242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af27aa82-2292-4146-9216-72b4d84d0a30 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:06.823107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:06.840450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af27aa82-2292-4146-9216-72b4d84d0a30 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:06.841261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af27aa82-2292-4146-9216-72b4d84d0a30 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:06.842819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af27aa82-2292-4146-9216-72b4d84d0a30 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:06.843610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af27aa82-2292-4146-9216-72b4d84d0a30 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:06.987224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b3df24a3-9f48-4f28-a228-c375975cd187 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:06.995725 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b3df24a3-9f48-4f28-a228-c375975cd187 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1487 microversion: 2.1 time: 0.492137 Jul 26 14:17:07.008792 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1293/2732] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:06 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1487 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:07.014576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b662681a-bf71-4da1-93d5-6a5ab7fa6054 req-a3aca13d-8fae-4c6a-b328-b901a61a2017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c447924-08ae-4341-8ed0-2dd7a29e6899", "name": "network-vif-plugged", "status": "completed", "tag": "23a8575a-87d4-4b4e-89c9-fa2c87e39090"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:07.034617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b662681a-bf71-4da1-93d5-6a5ab7fa6054 req-a3aca13d-8fae-4c6a-b328-b901a61a2017 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:07.035348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b662681a-bf71-4da1-93d5-6a5ab7fa6054 req-a3aca13d-8fae-4c6a-b328-b901a61a2017 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:07.057359 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b662681a-bf71-4da1-93d5-6a5ab7fa6054 req-a3aca13d-8fae-4c6a-b328-b901a61a2017 service nova] Creating event network-vif-plugged:23a8575a-87d4-4b4e-89c9-fa2c87e39090 for instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 on n-h1-833090-9 Jul 26 14:17:07.063477 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b662681a-bf71-4da1-93d5-6a5ab7fa6054 req-a3aca13d-8fae-4c6a-b328-b901a61a2017 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052615 Jul 26 14:17:07.064410 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1294/2733] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:07.071354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-42723554-257e-4c7b-bace-fb669cfc343f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:07.072941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-42723554-257e-4c7b-bace-fb669cfc343f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:07.091279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42723554-257e-4c7b-bace-fb669cfc343f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:07.092087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42723554-257e-4c7b-bace-fb669cfc343f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:07.097403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42723554-257e-4c7b-bace-fb669cfc343f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:07.098167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42723554-257e-4c7b-bace-fb669cfc343f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:07.452930 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af27aa82-2292-4146-9216-72b4d84d0a30 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1644 microversion: 2.1 time: 0.650711 Jul 26 14:17:07.453911 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1440/2734] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:06 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1644 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:07.458747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aa8ff843-210d-4d5c-983a-5b8b5e725dbc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:07.459372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aa8ff843-210d-4d5c-983a-5b8b5e725dbc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:07.474669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa8ff843-210d-4d5c-983a-5b8b5e725dbc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:07.476017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa8ff843-210d-4d5c-983a-5b8b5e725dbc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:07.477070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa8ff843-210d-4d5c-983a-5b8b5e725dbc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:07.477700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa8ff843-210d-4d5c-983a-5b8b5e725dbc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:07.548187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-42723554-257e-4c7b-bace-fb669cfc343f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:07.564684 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-42723554-257e-4c7b-bace-fb669cfc343f tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1505 microversion: 2.1 time: 0.498860 Jul 26 14:17:07.566728 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1295/2735] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:07 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:07.580675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4414c01e-1803-4faf-afd5-099da8b0c4da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:07.581193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4414c01e-1803-4faf-afd5-099da8b0c4da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:07.601010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4414c01e-1803-4faf-afd5-099da8b0c4da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:07.601470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4414c01e-1803-4faf-afd5-099da8b0c4da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:07.602294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4414c01e-1803-4faf-afd5-099da8b0c4da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:07.602735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4414c01e-1803-4faf-afd5-099da8b0c4da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:07.693156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4414c01e-1803-4faf-afd5-099da8b0c4da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:17:07.898305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa8ff843-210d-4d5c-983a-5b8b5e725dbc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:07.911829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa8ff843-210d-4d5c-983a-5b8b5e725dbc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:07.914007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa8ff843-210d-4d5c-983a-5b8b5e725dbc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:07.915355 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aa8ff843-210d-4d5c-983a-5b8b5e725dbc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1706 microversion: 2.32 time: 0.460332 Jul 26 14:17:07.915927 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1441/2736] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:07 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1706 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:07.938521 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4414c01e-1803-4faf-afd5-099da8b0c4da tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 204 len: 0 microversion: 2.1 time: 0.370228 Jul 26 14:17:07.940262 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1296/2737] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:17:07 2022] DELETE /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:07.961829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:07.965514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: dcaf7033-f14c-4c88-90d2-4060c1fc2b8a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:07.967554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6bed3953-0798-424a-bc33-e6c5a2a18be2 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:07.979761 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:17:07.979761 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:17:07.983228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bed3953-0798-424a-bc33-e6c5a2a18be2 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:07.983938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bed3953-0798-424a-bc33-e6c5a2a18be2 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:07.985004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bed3953-0798-424a-bc33-e6c5a2a18be2 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:07.985617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6bed3953-0798-424a-bc33-e6c5a2a18be2 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:07.987783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:07.997298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:07.999293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:08.000741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:08.035017 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6bed3953-0798-424a-bc33-e6c5a2a18be2 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.087896 Jul 26 14:17:08.043872 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1442/2738] 10.222.0.70 () {58 vars in 1176 bytes} [Tue Jul 26 14:17:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:08.049987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7aa5c2d7-0d03-4c61-a8c6-379882e11cca tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:08.050908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7aa5c2d7-0d03-4c61-a8c6-379882e11cca tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:08.063430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7aa5c2d7-0d03-4c61-a8c6-379882e11cca tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:08.064212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7aa5c2d7-0d03-4c61-a8c6-379882e11cca tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:08.065226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7aa5c2d7-0d03-4c61-a8c6-379882e11cca tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:08.065846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7aa5c2d7-0d03-4c61-a8c6-379882e11cca tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:08.197326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:08.198109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:08.203706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lazy-loading 'fault' on Instance uuid dcaf7033-f14c-4c88-90d2-4060c1fc2b8a {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:17:08.475202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:08.506177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:08.515687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fce2c000c2d840fb8f0b53736e45fcbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e61ca0c2974c4a7880d4fe53d15bdf66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:08.526099 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ffa3884-ae7a-40d9-bd4c-fa1f0f6a6f18 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a" status: 200 len: 1367 microversion: 2.47 time: 0.583784 Jul 26 14:17:08.527898 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1297/2739] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:07 2022] GET /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a => generated 1367 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:08.548243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fccb45d8-8d3b-485f-8f5d-0f28533063e9 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f879926cf70>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:08.608398 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-fccb45d8-8d3b-485f-8f5d-0f28533063e9 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Image not found. Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fccb45d8-8d3b-485f-8f5d-0f28533063e9 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318 HTTP/1.1 Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '81c213a0-9ce1-4108-9478-c9c6c21a2318'} Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 81c213a0-9ce1-4108-9478-c9c6c21a2318 to delete Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 81c213a0-9ce1-4108-9478-c9c6c21a2318 could not be found. Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:08.611219 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:17:08.615305 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:08.619184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fccb45d8-8d3b-485f-8f5d-0f28533063e9 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:08.620365 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fccb45d8-8d3b-485f-8f5d-0f28533063e9 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318" status: 404 len: 62 microversion: 2.1 time: 0.091074 Jul 26 14:17:08.624936 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1298/2740] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:08 2022] DELETE /compute/v2.1/images/81c213a0-9ce1-4108-9478-c9c6c21a2318 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:17:08.629939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1899b80a-87e1-4020-9b88-46f08789bf91 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:08.630717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1899b80a-87e1-4020-9b88-46f08789bf91 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:08.639573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1899b80a-87e1-4020-9b88-46f08789bf91 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:08.640556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1899b80a-87e1-4020-9b88-46f08789bf91 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:08.641539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1899b80a-87e1-4020-9b88-46f08789bf91 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:08.642197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1899b80a-87e1-4020-9b88-46f08789bf91 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:08.794446 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1899b80a-87e1-4020-9b88-46f08789bf91 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6/action" status: 202 len: 0 microversion: 2.1 time: 0.167679 Jul 26 14:17:08.798989 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1299/2741] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:17:08 2022] POST /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:17:08.807968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44754cbc-3be7-425d-a98d-69745a31dde5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:08.809879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44754cbc-3be7-425d-a98d-69745a31dde5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:08.818529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44754cbc-3be7-425d-a98d-69745a31dde5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:08.820898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44754cbc-3be7-425d-a98d-69745a31dde5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:08.823712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44754cbc-3be7-425d-a98d-69745a31dde5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:08.824272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44754cbc-3be7-425d-a98d-69745a31dde5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:08.888465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44754cbc-3be7-425d-a98d-69745a31dde5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:17:08.958296 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.compute.api [None req-44754cbc-3be7-425d-a98d-69745a31dde5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Instance is already in deleting state, ignoring this request Jul 26 14:17:08.959563 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-44754cbc-3be7-425d-a98d-69745a31dde5 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 204 len: 0 microversion: 2.1 time: 0.159388 Jul 26 14:17:08.961680 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1300/2742] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:17:08 2022] DELETE /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:08.967663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4dcdad84-22de-4674-aeb1-8b86065330f7 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:08.968601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4dcdad84-22de-4674-aeb1-8b86065330f7 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:08.976224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dcdad84-22de-4674-aeb1-8b86065330f7 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:08.977351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dcdad84-22de-4674-aeb1-8b86065330f7 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:08.978380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dcdad84-22de-4674-aeb1-8b86065330f7 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:08.979029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dcdad84-22de-4674-aeb1-8b86065330f7 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:09.005144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:09.018799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7aa5c2d7-0d03-4c61-a8c6-379882e11cca tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:09.036360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:09.051597 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7aa5c2d7-0d03-4c61-a8c6-379882e11cca tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1503 microversion: 2.1 time: 1.005670 Jul 26 14:17:09.060277 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1443/2743] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:08 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1503 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:09.082498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-99f4f61a-bb84-48a9-b3dc-2d86d15e0257 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:09.083279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-99f4f61a-bb84-48a9-b3dc-2d86d15e0257 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:09.094812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99f4f61a-bb84-48a9-b3dc-2d86d15e0257 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:09.095276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99f4f61a-bb84-48a9-b3dc-2d86d15e0257 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:09.096105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99f4f61a-bb84-48a9-b3dc-2d86d15e0257 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:09.096554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99f4f61a-bb84-48a9-b3dc-2d86d15e0257 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:09.331776 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4dcdad84-22de-4674-aeb1-8b86065330f7 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1649 microversion: 2.1 time: 0.368488 Jul 26 14:17:09.332744 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1301/2744] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:08 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1649 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:09.345872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-70372766-2ce3-4990-ad1b-ec0b707d4861 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:09.348674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-70372766-2ce3-4990-ad1b-ec0b707d4861 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:09.367754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70372766-2ce3-4990-ad1b-ec0b707d4861 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:09.368378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70372766-2ce3-4990-ad1b-ec0b707d4861 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:09.369481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70372766-2ce3-4990-ad1b-ec0b707d4861 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:09.370181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70372766-2ce3-4990-ad1b-ec0b707d4861 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:09.965854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:10.714244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99f4f61a-bb84-48a9-b3dc-2d86d15e0257 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:10.716506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-70372766-2ce3-4990-ad1b-ec0b707d4861 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:10.726242 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-70372766-2ce3-4990-ad1b-ec0b707d4861 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1493 microversion: 2.1 time: 1.388847 Jul 26 14:17:10.731247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99f4f61a-bb84-48a9-b3dc-2d86d15e0257 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:10.731581 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1302/2745] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:09 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1493 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:10.736264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0b6dd463-776f-4f90-9945-194fadab3dd3 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Action: 'create', calling method: .version_select at 0x7f87992f1e50>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-65770837", "description": "tempest-description-1074082544"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:10.736598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99f4f61a-bb84-48a9-b3dc-2d86d15e0257 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:10.738071 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-99f4f61a-bb84-48a9-b3dc-2d86d15e0257 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1752 microversion: 2.32 time: 1.664471 Jul 26 14:17:10.742067 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1444/2746] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:09 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1752 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:10.752897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70923d94-f86f-4896-8132-4f9394e596b8 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:10.754725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70923d94-f86f-4896-8132-4f9394e596b8 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] [instance: dcaf7033-f14c-4c88-90d2-4060c1fc2b8a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:10.769090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70923d94-f86f-4896-8132-4f9394e596b8 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:10.776710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70923d94-f86f-4896-8132-4f9394e596b8 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:10.777835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70923d94-f86f-4896-8132-4f9394e596b8 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:10.778504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70923d94-f86f-4896-8132-4f9394e596b8 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:10.811737 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-70923d94-f86f-4896-8132-4f9394e596b8 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] HTTP exception thrown: Instance dcaf7033-f14c-4c88-90d2-4060c1fc2b8a could not be found. Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70923d94-f86f-4896-8132-4f9394e596b8 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Request method failure captured: Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a HTTP/1.1 Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ccMZHaq5W1GzKOHfU4M3oVxUObPzUldRkXoKZdhT10-oBisAFgv4i96HAvHJZX91cIZ9_nDeffNPyptfgbDEbvlUPYGnx4pjl_avVnjBEuBGoeMxzDrGP10b9wohpK1yNKMzT2ngsZd7p8alM8_7SjbA5eY5WFQ_FaV7qmrdAfL3I Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.47 Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: e61ca0c2974c4a7880d4fe53d15bdf66 Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerShowV247Test-1823304033 Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e61ca0c2974c4a7880d4fe53d15bdf66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e61ca0c2974c4a7880d4fe53d15bdf66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e61ca0c2974c4a7880d4fe53d15bdf66", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e61ca0c2974c4a7880d4fe53d15bdf66"}]}] Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerShowV247Test-1823304033 Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: e61ca0c2974c4a7880d4fe53d15bdf66 Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerShowV247Test-1823304033 Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerShowV247Test-1823304033-project Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: fce2c000c2d840fb8f0b53736e45fcbd Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerShowV247Test-1823304033-project Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance dcaf7033-f14c-4c88-90d2-4060c1fc2b8a could not be found. Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'dcaf7033-f14c-4c88-90d2-4060c1fc2b8a'} Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcaf7033-f14c-4c88-90d2-4060c1fc2b8a could not be found. Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcaf7033-f14c-4c88-90d2-4060c1fc2b8a could not be found. Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:10.813875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:10.817809 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:10.817809 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:10.817809 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:10.817809 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:10.817809 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:10.817809 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcaf7033-f14c-4c88-90d2-4060c1fc2b8a could not be found. Jul 26 14:17:10.817809 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:10.824693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70923d94-f86f-4896-8132-4f9394e596b8 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] Returning 404 to user: Instance dcaf7033-f14c-4c88-90d2-4060c1fc2b8a could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:10.825898 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70923d94-f86f-4896-8132-4f9394e596b8 tempest-ServerShowV247Test-1823304033 tempest-ServerShowV247Test-1823304033-project] 10.222.0.70 "GET /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a" status: 404 len: 111 microversion: 2.47 time: 0.082494 Jul 26 14:17:10.826772 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1445/2747] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:10 2022] GET /compute/v2.1/servers/dcaf7033-f14c-4c88-90d2-4060c1fc2b8a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:17:10.849094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e3d12cb2-8f3f-49a7-8c87-a92e3da80d59 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:10.854789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e3d12cb2-8f3f-49a7-8c87-a92e3da80d59 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:10.878958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3d12cb2-8f3f-49a7-8c87-a92e3da80d59 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:10.881929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3d12cb2-8f3f-49a7-8c87-a92e3da80d59 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:10.883024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3d12cb2-8f3f-49a7-8c87-a92e3da80d59 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:10.883822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3d12cb2-8f3f-49a7-8c87-a92e3da80d59 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:11.675048 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0b6dd463-776f-4f90-9945-194fadab3dd3 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.942086 Jul 26 14:17:11.681995 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1303/2748] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:17:10 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:11.722454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f25e0848-f8ee-4e48-a4bb-34d28bcaec24 req-6eed16e7-eee0-47e5-9321-aadf786d4fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c447924-08ae-4341-8ed0-2dd7a29e6899", "name": "network-vif-unplugged", "status": "completed", "tag": "23a8575a-87d4-4b4e-89c9-fa2c87e39090"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:11.770478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f25e0848-f8ee-4e48-a4bb-34d28bcaec24 req-6eed16e7-eee0-47e5-9321-aadf786d4fc3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:11.771119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f25e0848-f8ee-4e48-a4bb-34d28bcaec24 req-6eed16e7-eee0-47e5-9321-aadf786d4fc3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:11.791790 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f25e0848-f8ee-4e48-a4bb-34d28bcaec24 req-6eed16e7-eee0-47e5-9321-aadf786d4fc3 service nova] Creating event network-vif-unplugged:23a8575a-87d4-4b4e-89c9-fa2c87e39090 for instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 on n-h1-833090-9 Jul 26 14:17:11.800777 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e3d12cb2-8f3f-49a7-8c87-a92e3da80d59 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1629 microversion: 2.1 time: 0.971406 Jul 26 14:17:11.815813 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1446/2749] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:10 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1629 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:11.816323 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f25e0848-f8ee-4e48-a4bb-34d28bcaec24 req-6eed16e7-eee0-47e5-9321-aadf786d4fc3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121106 Jul 26 14:17:11.816936 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1304/2750] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:11.825346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-624c29b5-a064-4118-9bc0-94826385d97f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-65770837"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:11.828117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-624c29b5-a064-4118-9bc0-94826385d97f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:11.829277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5df913aa-0b6a-426c-8dbd-074261923bb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:11.830200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5df913aa-0b6a-426c-8dbd-074261923bb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:11.840231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-624c29b5-a064-4118-9bc0-94826385d97f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:11.842911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-624c29b5-a064-4118-9bc0-94826385d97f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:11.845038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-624c29b5-a064-4118-9bc0-94826385d97f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:11.851163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-624c29b5-a064-4118-9bc0-94826385d97f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:11.854605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5df913aa-0b6a-426c-8dbd-074261923bb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:11.855266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5df913aa-0b6a-426c-8dbd-074261923bb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:11.857843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5df913aa-0b6a-426c-8dbd-074261923bb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:11.858489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5df913aa-0b6a-426c-8dbd-074261923bb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:13.261379 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.network.security_group_api [None req-624c29b5-a064-4118-9bc0-94826385d97f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Adding security group 0eaa6452-f2d3-4882-91a4-917e4588f9fe to port 70c52961-0644-4b44-9202-3493a2dafa42 Jul 26 14:17:13.343567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5df913aa-0b6a-426c-8dbd-074261923bb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f94de8d57f854570b3ceda6ae5e7b9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3d0a242a34482d8737db7862279e87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:13.372163 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5df913aa-0b6a-426c-8dbd-074261923bb4 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 200 len: 1493 microversion: 2.1 time: 1.539434 Jul 26 14:17:13.373197 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1305/2751] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:11 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 1493 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:13.378221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f1967fa2-9ff9-4350-b573-a801ad7adb5b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:13.380730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f1967fa2-9ff9-4350-b573-a801ad7adb5b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:13.404903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1967fa2-9ff9-4350-b573-a801ad7adb5b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:13.405375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1967fa2-9ff9-4350-b573-a801ad7adb5b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:13.406170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1967fa2-9ff9-4350-b573-a801ad7adb5b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:13.406615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1967fa2-9ff9-4350-b573-a801ad7adb5b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:14.927039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f1967fa2-9ff9-4350-b573-a801ad7adb5b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:14.936553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f1967fa2-9ff9-4350-b573-a801ad7adb5b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:14.948947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f1967fa2-9ff9-4350-b573-a801ad7adb5b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:14.950641 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f1967fa2-9ff9-4350-b573-a801ad7adb5b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1798 microversion: 2.32 time: 1.576274 Jul 26 14:17:14.951718 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1306/2752] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:13 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1798 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:14.956646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-808c5fac-b15e-4bba-8de7-b1383d52b931 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-9", "block_migration": true, "disk_over_commit": false}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:14.978806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-808c5fac-b15e-4bba-8de7-b1383d52b931 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:15.003168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-808c5fac-b15e-4bba-8de7-b1383d52b931 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:15.003907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-808c5fac-b15e-4bba-8de7-b1383d52b931 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:15.004945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-808c5fac-b15e-4bba-8de7-b1383d52b931 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:15.005539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-808c5fac-b15e-4bba-8de7-b1383d52b931 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:15.097952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-808c5fac-b15e-4bba-8de7-b1383d52b931 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lazy-loading 'flavor' on Instance uuid 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:17:15.117341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-808c5fac-b15e-4bba-8de7-b1383d52b931 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Going to try to live migrate instance to n-h2-833090-9 {{(pid=119478) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 14:17:16.244608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-624c29b5-a064-4118-9bc0-94826385d97f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "POST /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69/action" status: 202 len: 0 microversion: 2.1 time: 4.434206 Jul 26 14:17:16.246421 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1447/2753] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:17:11 2022] POST /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69/action => generated 0 bytes in 4442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:17:16.258814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-cf453d5f-9fb3-4eba-86a6-2d3d1cd2789b req-b5ce685f-47c2-4e68-8aef-02911b88b9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c447924-08ae-4341-8ed0-2dd7a29e6899", "name": "network-vif-deleted", "tag": "23a8575a-87d4-4b4e-89c9-fa2c87e39090"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:16.277710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-cf453d5f-9fb3-4eba-86a6-2d3d1cd2789b req-b5ce685f-47c2-4e68-8aef-02911b88b9d6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:16.278630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-cf453d5f-9fb3-4eba-86a6-2d3d1cd2789b req-b5ce685f-47c2-4e68-8aef-02911b88b9d6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:16.300647 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-cf453d5f-9fb3-4eba-86a6-2d3d1cd2789b req-b5ce685f-47c2-4e68-8aef-02911b88b9d6 service nova] Creating event network-vif-deleted:23a8575a-87d4-4b4e-89c9-fa2c87e39090 for instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 on n-h1-833090-9 Jul 26 14:17:16.310037 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-cf453d5f-9fb3-4eba-86a6-2d3d1cd2789b req-b5ce685f-47c2-4e68-8aef-02911b88b9d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061825 Jul 26 14:17:16.319564 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1448/2754] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:16.330484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9136d28a-b38c-442a-919b-5a11c1e9914d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:16.331093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9136d28a-b38c-442a-919b-5a11c1e9914d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2c447924-08ae-4341-8ed0-2dd7a29e6899] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:16.342484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9136d28a-b38c-442a-919b-5a11c1e9914d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:16.343372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9136d28a-b38c-442a-919b-5a11c1e9914d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:16.344455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9136d28a-b38c-442a-919b-5a11c1e9914d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:16.346138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9136d28a-b38c-442a-919b-5a11c1e9914d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:16.376791 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-9136d28a-b38c-442a-919b-5a11c1e9914d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 could not be found. Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9136d28a-b38c-442a-919b-5a11c1e9914d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 HTTP/1.1 Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 could not be found. Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '2c447924-08ae-4341-8ed0-2dd7a29e6899'} Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 could not be found. Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 could not be found. Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:16.380314 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:16.385935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:16.385935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:16.385935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:16.385935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:16.385935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 could not be found. Jul 26 14:17:16.385935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:16.388041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9136d28a-b38c-442a-919b-5a11c1e9914d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Instance 2c447924-08ae-4341-8ed0-2dd7a29e6899 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:16.392877 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9136d28a-b38c-442a-919b-5a11c1e9914d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899" status: 404 len: 111 microversion: 2.1 time: 0.070021 Jul 26 14:17:16.399190 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1449/2755] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:16 2022] GET /compute/v2.1/servers/2c447924-08ae-4341-8ed0-2dd7a29e6899 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:16.405122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0b42b1d1-391f-4898-aa91-9f3769488d5e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:16.406651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0b42b1d1-391f-4898-aa91-9f3769488d5e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:16.422982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b42b1d1-391f-4898-aa91-9f3769488d5e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:16.423805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b42b1d1-391f-4898-aa91-9f3769488d5e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:16.424870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b42b1d1-391f-4898-aa91-9f3769488d5e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:16.425665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b42b1d1-391f-4898-aa91-9f3769488d5e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:16.935597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0b42b1d1-391f-4898-aa91-9f3769488d5e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:16.960218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0b42b1d1-391f-4898-aa91-9f3769488d5e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:16.964928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0b42b1d1-391f-4898-aa91-9f3769488d5e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:16.966216 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0b42b1d1-391f-4898-aa91-9f3769488d5e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1844 microversion: 2.32 time: 0.565479 Jul 26 14:17:16.969175 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1450/2756] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:16 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1844 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:16.980940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2175c832-5bc1-4653-ac9e-0cac53190b76 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-65770837"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:16.983700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2175c832-5bc1-4653-ac9e-0cac53190b76 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:17.001979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2175c832-5bc1-4653-ac9e-0cac53190b76 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:17.002458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2175c832-5bc1-4653-ac9e-0cac53190b76 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:17.004217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2175c832-5bc1-4653-ac9e-0cac53190b76 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:17.004678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2175c832-5bc1-4653-ac9e-0cac53190b76 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:17.440450 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.network.security_group_api [None req-2175c832-5bc1-4653-ac9e-0cac53190b76 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Removing security group 0eaa6452-f2d3-4882-91a4-917e4588f9fe from port 70c52961-0644-4b44-9202-3493a2dafa42 Jul 26 14:17:18.004751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:18.192434 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2175c832-5bc1-4653-ac9e-0cac53190b76 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "POST /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69/action" status: 202 len: 0 microversion: 2.1 time: 1.220186 Jul 26 14:17:18.195639 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1451/2757] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:17:16 2022] POST /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69/action => generated 0 bytes in 1226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:17:18.224268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e09a0341-5e26-4ef2-89d8-3ad70368442c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8794c5b310>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:18.309971 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e09a0341-5e26-4ef2-89d8-3ad70368442c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Image not found. Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e09a0341-5e26-4ef2-89d8-3ad70368442c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 HTTP/1.1 Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: exception: Image not found. Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '58eedb6b-b199-42aa-a4db-987a44f53b74'} Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 58eedb6b-b199-42aa-a4db-987a44f53b74 to delete Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58eedb6b-b199-42aa-a4db-987a44f53b74 could not be found. Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.311822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e09a0341-5e26-4ef2-89d8-3ad70368442c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Image not found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e09a0341-5e26-4ef2-89d8-3ad70368442c tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74" status: 404 len: 62 microversion: 2.1 time: 0.111533 Jul 26 14:17:18.325773 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1452/2758] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:18 2022] DELETE /compute/v2.1/images/58eedb6b-b199-42aa-a4db-987a44f53b74 => generated 62 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:17:18.344529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-41d5f7c2-8753-4386-98dc-e28f8bc5fa74 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:18.345059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-41d5f7c2-8753-4386-98dc-e28f8bc5fa74 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:18.370250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41d5f7c2-8753-4386-98dc-e28f8bc5fa74 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:18.373041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41d5f7c2-8753-4386-98dc-e28f8bc5fa74 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:18.374061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41d5f7c2-8753-4386-98dc-e28f8bc5fa74 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:18.374533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41d5f7c2-8753-4386-98dc-e28f8bc5fa74 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:18.433202 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-41d5f7c2-8753-4386-98dc-e28f8bc5fa74 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-41d5f7c2-8753-4386-98dc-e28f8bc5fa74 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e HTTP/1.1 Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '02e40948-c72a-4e90-9db3-6302b9e8379e'} Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:18.437588 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-41d5f7c2-8753-4386-98dc-e28f8bc5fa74 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-41d5f7c2-8753-4386-98dc-e28f8bc5fa74 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "DELETE /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 404 len: 111 microversion: 2.1 time: 0.122436 Jul 26 14:17:18.450154 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1453/2759] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:17:18 2022] DELETE /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:18.458213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a814454d-d998-4afb-968d-79f4776c71d4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:18.458213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a814454d-d998-4afb-968d-79f4776c71d4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:18.477390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a814454d-d998-4afb-968d-79f4776c71d4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:18.477876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a814454d-d998-4afb-968d-79f4776c71d4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:18.482504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a814454d-d998-4afb-968d-79f4776c71d4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:18.488130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a814454d-d998-4afb-968d-79f4776c71d4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:18.975868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a814454d-d998-4afb-968d-79f4776c71d4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:18.995784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a814454d-d998-4afb-968d-79f4776c71d4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:18.998142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a814454d-d998-4afb-968d-79f4776c71d4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:18.999521 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a814454d-d998-4afb-968d-79f4776c71d4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1844 microversion: 2.32 time: 0.558686 Jul 26 14:17:19.000451 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1454/2760] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:18 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1844 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:19.018398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6a960903-d002-44b2-98bf-efc56312fe53 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Action: 'create', calling method: .version_select at 0x7f87992cdc10>, body: {"pool": null} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:19.671439 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-808c5fac-b15e-4bba-8de7-b1383d52b931 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6/action" status: 202 len: 0 microversion: 2.1 time: 4.716153 Jul 26 14:17:19.674425 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1307/2761] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:17:14 2022] POST /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6/action => generated 0 bytes in 4722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:17:19.723238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-134582be-0d72-4bca-9cf2-2b984d8b7cad tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:19.730500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-134582be-0d72-4bca-9cf2-2b984d8b7cad tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:19.753495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-134582be-0d72-4bca-9cf2-2b984d8b7cad tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:19.757564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-134582be-0d72-4bca-9cf2-2b984d8b7cad tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:19.771168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-134582be-0d72-4bca-9cf2-2b984d8b7cad tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:19.773956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-134582be-0d72-4bca-9cf2-2b984d8b7cad tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:19.817264 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-134582be-0d72-4bca-9cf2-2b984d8b7cad tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-134582be-0d72-4bca-9cf2-2b984d8b7cad tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c HTTP/1.1 Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c'} Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:19.823552 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. Jul 26 14:17:19.830867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:19.830867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:19.830867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:19.830867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:19.830867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:19.830867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:19.830867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:19.830867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:19.830867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. Jul 26 14:17:19.830867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:19.841133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-134582be-0d72-4bca-9cf2-2b984d8b7cad tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:19.843247 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-134582be-0d72-4bca-9cf2-2b984d8b7cad tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 404 len: 111 microversion: 2.1 time: 0.166474 Jul 26 14:17:19.859592 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1308/2762] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:17:19 2022] DELETE /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:19.879720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-171cff89-e4d4-4b81-96f1-331aa4da2381 req-125d5b86-2e1b-4e4d-bcaa-6a79efb4d865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da1e35fe-99b6-426a-9c00-890423632b69", "tag": "70c52961-0644-4b44-9202-3493a2dafa42"}, {"name": "network-changed", "server_uuid": "da1e35fe-99b6-426a-9c00-890423632b69", "tag": "70c52961-0644-4b44-9202-3493a2dafa42"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:19.923872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-171cff89-e4d4-4b81-96f1-331aa4da2381 req-125d5b86-2e1b-4e4d-bcaa-6a79efb4d865 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:19.929393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-171cff89-e4d4-4b81-96f1-331aa4da2381 req-125d5b86-2e1b-4e4d-bcaa-6a79efb4d865 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:19.992079 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-171cff89-e4d4-4b81-96f1-331aa4da2381 req-125d5b86-2e1b-4e4d-bcaa-6a79efb4d865 service nova] Creating event network-changed:70c52961-0644-4b44-9202-3493a2dafa42 for instance da1e35fe-99b6-426a-9c00-890423632b69 on n-h2-833090-9 Jul 26 14:17:19.993194 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-171cff89-e4d4-4b81-96f1-331aa4da2381 req-125d5b86-2e1b-4e4d-bcaa-6a79efb4d865 service nova] Creating event network-changed:70c52961-0644-4b44-9202-3493a2dafa42 for instance da1e35fe-99b6-426a-9c00-890423632b69 on n-h2-833090-9 Jul 26 14:17:20.018457 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-171cff89-e4d4-4b81-96f1-331aa4da2381 req-125d5b86-2e1b-4e4d-bcaa-6a79efb4d865 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.156454 Jul 26 14:17:20.036289 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1309/2763] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:20.055129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0cf830f1-c7c7-4beb-8caa-abffd6afa10c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:20.062864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0cf830f1-c7c7-4beb-8caa-abffd6afa10c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: 02e40948-c72a-4e90-9db3-6302b9e8379e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:20.104998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cf830f1-c7c7-4beb-8caa-abffd6afa10c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:20.116579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cf830f1-c7c7-4beb-8caa-abffd6afa10c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:20.119845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cf830f1-c7c7-4beb-8caa-abffd6afa10c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:20.122648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cf830f1-c7c7-4beb-8caa-abffd6afa10c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:20.143263 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-0cf830f1-c7c7-4beb-8caa-abffd6afa10c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0cf830f1-c7c7-4beb-8caa-abffd6afa10c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e HTTP/1.1 Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '02e40948-c72a-4e90-9db3-6302b9e8379e'} Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:20.145234 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.150157 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:20.150157 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:20.150157 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:20.150157 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:20.150157 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:20.150157 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. Jul 26 14:17:20.150157 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.151500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0cf830f1-c7c7-4beb-8caa-abffd6afa10c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance 02e40948-c72a-4e90-9db3-6302b9e8379e could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:20.152636 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0cf830f1-c7c7-4beb-8caa-abffd6afa10c tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e" status: 404 len: 111 microversion: 2.1 time: 0.113341 Jul 26 14:17:20.153706 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1310/2764] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:20 2022] GET /compute/v2.1/servers/02e40948-c72a-4e90-9db3-6302b9e8379e => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:20.158894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84e1aeb0-9f03-43db-8158-bf1f541cd327 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:20.159592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-84e1aeb0-9f03-43db-8158-bf1f541cd327 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:20.181003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84e1aeb0-9f03-43db-8158-bf1f541cd327 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:20.182169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84e1aeb0-9f03-43db-8158-bf1f541cd327 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:20.183270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84e1aeb0-9f03-43db-8158-bf1f541cd327 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:20.184006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84e1aeb0-9f03-43db-8158-bf1f541cd327 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:20.258135 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-84e1aeb0-9f03-43db-8158-bf1f541cd327 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] HTTP exception thrown: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84e1aeb0-9f03-43db-8158-bf1f541cd327 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Request method failure captured: Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b HTTP/1.1 Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VwPBfiFwSMWhm63JOoZ17tTa9nT7br__eXo1Y152S2bJtgtwlEC5O6acyWxQZckWj9nITI4htu3HNn33LOXAhaza_wIl4KfJhbz3wycN8Tn0yActs48s8Jwhxeyj-GdbnjhGRGAvb3CQN_pvjG3Bm2RMtlCUFr67CymWaOUR1HXJs Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.42 Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: b2bbec12160842eab535494da3e993aa Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1638952214 Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2bbec12160842eab535494da3e993aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b2bbec12160842eab535494da3e993aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b2bbec12160842eab535494da3e993aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2bbec12160842eab535494da3e993aa"}]}] Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1638952214 Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: b2bbec12160842eab535494da3e993aa Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1638952214 Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TaggedBootDevicesTest_v242-1638952214-project Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8ad8834232064fa7bb2164d542d29e32 Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1638952214-project Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '9dfcc2ed-fde9-4ef4-840b-012106b72b1b'} Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:20.260009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84e1aeb0-9f03-43db-8158-bf1f541cd327 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Returning 404 to user: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:20.264958 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-84e1aeb0-9f03-43db-8158-bf1f541cd327 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 404 len: 111 microversion: 2.42 time: 0.106658 Jul 26 14:17:20.276429 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1311/2765] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:17:20 2022] DELETE /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:17:20.290790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-34a32710-bc90-4202-be33-9986f31959b9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:20.291919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-34a32710-bc90-4202-be33-9986f31959b9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:20.308828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34a32710-bc90-4202-be33-9986f31959b9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:20.310819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34a32710-bc90-4202-be33-9986f31959b9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:20.311726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34a32710-bc90-4202-be33-9986f31959b9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:20.312364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34a32710-bc90-4202-be33-9986f31959b9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:20.733815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-34a32710-bc90-4202-be33-9986f31959b9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:20.745582 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-34a32710-bc90-4202-be33-9986f31959b9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1503 microversion: 2.1 time: 0.467920 Jul 26 14:17:20.751018 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1312/2766] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:20 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1503 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:20.766212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d885d71-14d1-49c1-a47d-1424387f1286 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:20.767186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4d885d71-14d1-49c1-a47d-1424387f1286 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:20.780208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d885d71-14d1-49c1-a47d-1424387f1286 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:20.783206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d885d71-14d1-49c1-a47d-1424387f1286 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:20.789261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d885d71-14d1-49c1-a47d-1424387f1286 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:20.790463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d885d71-14d1-49c1-a47d-1424387f1286 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:20.816775 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-4d885d71-14d1-49c1-a47d-1424387f1286 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d885d71-14d1-49c1-a47d-1424387f1286 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c HTTP/1.1 Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c'} Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.819335 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:20.823500 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:20.823500 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:20.823500 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:20.823500 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:20.823500 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. Jul 26 14:17:20.823500 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:20.825414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d885d71-14d1-49c1-a47d-1424387f1286 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Instance 20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:20.826454 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4d885d71-14d1-49c1-a47d-1424387f1286 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c" status: 404 len: 111 microversion: 2.1 time: 0.073590 Jul 26 14:17:20.827557 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1313/2767] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:20 2022] GET /compute/v2.1/servers/20e204fb-7a2f-4ad7-8b3d-2b7d4f15d42c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:20.837738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6815aa8-0bfb-49f5-8415-cdbd527f68f6 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:20.838760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e6815aa8-0bfb-49f5-8415-cdbd527f68f6 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:20.851354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6815aa8-0bfb-49f5-8415-cdbd527f68f6 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:20.852612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6815aa8-0bfb-49f5-8415-cdbd527f68f6 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:20.854000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6815aa8-0bfb-49f5-8415-cdbd527f68f6 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:20.854622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6815aa8-0bfb-49f5-8415-cdbd527f68f6 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:22.139198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6815aa8-0bfb-49f5-8415-cdbd527f68f6 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:22.163406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6815aa8-0bfb-49f5-8415-cdbd527f68f6 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:22.166552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6815aa8-0bfb-49f5-8415-cdbd527f68f6 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:22.171875 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6815aa8-0bfb-49f5-8415-cdbd527f68f6 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1844 microversion: 2.32 time: 1.342300 Jul 26 14:17:22.173580 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1314/2768] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:20 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1844 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:22.195814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4e06034e-e1cf-4915-b2e3-b44dc3a90066 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:22.197955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4e06034e-e1cf-4915-b2e3-b44dc3a90066 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:22.221410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e06034e-e1cf-4915-b2e3-b44dc3a90066 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:22.223512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e06034e-e1cf-4915-b2e3-b44dc3a90066 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:22.225973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e06034e-e1cf-4915-b2e3-b44dc3a90066 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:22.229826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e06034e-e1cf-4915-b2e3-b44dc3a90066 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:22.308999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4e06034e-e1cf-4915-b2e3-b44dc3a90066 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:17:22.502961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:22.509500 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4e06034e-e1cf-4915-b2e3-b44dc3a90066 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 204 len: 0 microversion: 2.1 time: 0.333483 Jul 26 14:17:22.510860 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1315/2769] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:17:22 2022] DELETE /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:22.526617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da85ee01-7ff6-4a71-ae8a-1a993df88c33 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:22.527526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-da85ee01-7ff6-4a71-ae8a-1a993df88c33 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] [instance: 9dfcc2ed-fde9-4ef4-840b-012106b72b1b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:22.538507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da85ee01-7ff6-4a71-ae8a-1a993df88c33 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:22.539820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da85ee01-7ff6-4a71-ae8a-1a993df88c33 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:22.541535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da85ee01-7ff6-4a71-ae8a-1a993df88c33 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:22.542129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da85ee01-7ff6-4a71-ae8a-1a993df88c33 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:22.572118 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-da85ee01-7ff6-4a71-ae8a-1a993df88c33 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] HTTP exception thrown: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da85ee01-7ff6-4a71-ae8a-1a993df88c33 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Request method failure captured: Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b HTTP/1.1 Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_VwPBfiFwSMWhm63JOoZ17tTa9nT7br__eXo1Y152S2bJtgtwlEC5O6acyWxQZckWj9nITI4htu3HNn33LOXAhaza_wIl4KfJhbz3wycN8Tn0yActs48s8Jwhxeyj-GdbnjhGRGAvb3CQN_pvjG3Bm2RMtlCUFr67CymWaOUR1HXJs Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.42 Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: b2bbec12160842eab535494da3e993aa Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1638952214 Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2bbec12160842eab535494da3e993aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b2bbec12160842eab535494da3e993aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b2bbec12160842eab535494da3e993aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2bbec12160842eab535494da3e993aa"}]}] Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1638952214 Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: b2bbec12160842eab535494da3e993aa Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1638952214 Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TaggedBootDevicesTest_v242-1638952214-project Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8ad8834232064fa7bb2164d542d29e32 Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1638952214-project Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '9dfcc2ed-fde9-4ef4-840b-012106b72b1b'} Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.573856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da85ee01-7ff6-4a71-ae8a-1a993df88c33 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] Returning 404 to user: Instance 9dfcc2ed-fde9-4ef4-840b-012106b72b1b could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-da85ee01-7ff6-4a71-ae8a-1a993df88c33 tempest-TaggedBootDevicesTest_v242-1638952214 tempest-TaggedBootDevicesTest_v242-1638952214-project] 10.222.0.70 "GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b" status: 404 len: 111 microversion: 2.42 time: 0.062961 Jul 26 14:17:22.580566 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1316/2770] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:22 2022] GET /compute/v2.1/servers/9dfcc2ed-fde9-4ef4-840b-012106b72b1b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:17:22.582825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-50af41b1-db9a-4b67-9485-fdddef1c6c3f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f8799297d30>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:22.640781 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-50af41b1-db9a-4b67-9485-fdddef1c6c3f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Image not found. Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-50af41b1-db9a-4b67-9485-fdddef1c6c3f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b HTTP/1.1 Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '9b5de015-f0c6-4818-bf58-2511e8a29a2b'} Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9b5de015-f0c6-4818-bf58-2511e8a29a2b to delete Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9b5de015-f0c6-4818-bf58-2511e8a29a2b could not be found. Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.645240 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:17:22.650437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:22.652919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-50af41b1-db9a-4b67-9485-fdddef1c6c3f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:22.655863 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-50af41b1-db9a-4b67-9485-fdddef1c6c3f tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b" status: 404 len: 62 microversion: 2.1 time: 0.075583 Jul 26 14:17:22.657210 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1317/2771] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:22 2022] DELETE /compute/v2.1/images/9b5de015-f0c6-4818-bf58-2511e8a29a2b => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:17:22.675295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d9b6bdd-2cc0-44b2-ba19-eaf85e38d27d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:22.676034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6d9b6bdd-2cc0-44b2-ba19-eaf85e38d27d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:22.704789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d9b6bdd-2cc0-44b2-ba19-eaf85e38d27d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:22.705502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d9b6bdd-2cc0-44b2-ba19-eaf85e38d27d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:22.709717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d9b6bdd-2cc0-44b2-ba19-eaf85e38d27d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:22.710455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d9b6bdd-2cc0-44b2-ba19-eaf85e38d27d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:23.786067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d9b6bdd-2cc0-44b2-ba19-eaf85e38d27d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:23.804788 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6d9b6bdd-2cc0-44b2-ba19-eaf85e38d27d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1503 microversion: 2.1 time: 1.144611 Jul 26 14:17:23.822145 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1318/2772] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:22 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1503 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:24.297016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a816b84a-fa1f-4db9-96cc-94d7242a82eb tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Action: 'create', calling method: .version_select at 0x7f878704eee0>, body: {"keypair": {"name": "tempest-keypair-1977006621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACaJ1fyLvIU0z6/EUkVA/mYRACH59oOMRP3Ms9l7WkDWB+2oDHzvwHEQMVPO24aY2gUDTh3+H3JpElEU3D3xQRAwmyn/z7ovc/mySYc4GzN3y3/ce29E7/SMb2iLmsESw=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:24.362425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-a816b84a-fa1f-4db9-96cc-94d7242a82eb tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:24.389530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-a816b84a-fa1f-4db9-96cc-94d7242a82eb tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for user dfc3d1debe894f768524ad8382786523 and project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:24.474308 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a816b84a-fa1f-4db9-96cc-94d7242a82eb tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.650114 Jul 26 14:17:24.481784 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1319/2773] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jul 26 14:17:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 654 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 14:17:24.498781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-20b395f9-2783-4189-8636-97b7274b03d2 req-8f7c58d4-c1b3-490a-8974-a353e7ca14dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "tag": "725e91c3-1621-400a-b82a-3ec7c07edfc6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:24.555878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-20b395f9-2783-4189-8636-97b7274b03d2 req-8f7c58d4-c1b3-490a-8974-a353e7ca14dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:24.557389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-20b395f9-2783-4189-8636-97b7274b03d2 req-8f7c58d4-c1b3-490a-8974-a353e7ca14dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:24.593763 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-20b395f9-2783-4189-8636-97b7274b03d2 req-8f7c58d4-c1b3-490a-8974-a353e7ca14dd service nova] Creating event network-changed:725e91c3-1621-400a-b82a-3ec7c07edfc6 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:17:24.606593 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-20b395f9-2783-4189-8636-97b7274b03d2 req-8f7c58d4-c1b3-490a-8974-a353e7ca14dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122630 Jul 26 14:17:24.609195 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1320/2774] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:24.641204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-26eeb415-3a72-407e-8260-72f062d17227 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:24.643768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-26eeb415-3a72-407e-8260-72f062d17227 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:24.665983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26eeb415-3a72-407e-8260-72f062d17227 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:24.669641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26eeb415-3a72-407e-8260-72f062d17227 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:24.671183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26eeb415-3a72-407e-8260-72f062d17227 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:24.671768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26eeb415-3a72-407e-8260-72f062d17227 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:26.035336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-26eeb415-3a72-407e-8260-72f062d17227 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa42b309ab240418fa01e6d4e65e19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14cbcd06677b464ab54dab55a8acd782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:26.059728 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-26eeb415-3a72-407e-8260-72f062d17227 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 200 len: 1511 microversion: 2.1 time: 1.448520 Jul 26 14:17:26.070203 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1321/2775] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:24 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 1511 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:26.106416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9270bf4e-bb29-4bdc-825f-a73acc29d526 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:26.109427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9270bf4e-bb29-4bdc-825f-a73acc29d526 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:26.130368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9270bf4e-bb29-4bdc-825f-a73acc29d526 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:26.131732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9270bf4e-bb29-4bdc-825f-a73acc29d526 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:26.140956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9270bf4e-bb29-4bdc-825f-a73acc29d526 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:26.141678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9270bf4e-bb29-4bdc-825f-a73acc29d526 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:26.191310 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-9270bf4e-bb29-4bdc-825f-a73acc29d526 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9270bf4e-bb29-4bdc-825f-a73acc29d526 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 HTTP/1.1 Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '2f930a87-b048-44cc-86eb-7db98aaaff65'} Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:26.194941 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. Jul 26 14:17:26.199463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:26.199463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:26.199463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:26.199463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:26.199463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:26.199463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:26.199463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:26.199463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:26.199463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. Jul 26 14:17:26.199463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:26.206707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9270bf4e-bb29-4bdc-825f-a73acc29d526 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:26.208582 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9270bf4e-bb29-4bdc-825f-a73acc29d526 tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 404 len: 111 microversion: 2.1 time: 0.122247 Jul 26 14:17:26.216948 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1322/2776] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:17:26 2022] DELETE /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:26.240788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-37234f0c-9dc8-45df-b60f-37f7fcb84c2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:26.241855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-37234f0c-9dc8-45df-b60f-37f7fcb84c2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:26.277253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37234f0c-9dc8-45df-b60f-37f7fcb84c2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:26.282640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37234f0c-9dc8-45df-b60f-37f7fcb84c2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:26.284190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37234f0c-9dc8-45df-b60f-37f7fcb84c2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:26.293501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37234f0c-9dc8-45df-b60f-37f7fcb84c2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:26.305017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:28.086324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-37234f0c-9dc8-45df-b60f-37f7fcb84c2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:28.137928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-37234f0c-9dc8-45df-b60f-37f7fcb84c2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:28.145157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-37234f0c-9dc8-45df-b60f-37f7fcb84c2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:28.151257 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-37234f0c-9dc8-45df-b60f-37f7fcb84c2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1886 microversion: 2.32 time: 1.929211 Jul 26 14:17:28.155441 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1323/2777] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:26 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1886 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:28.167837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4fe2fc07-c082-4f66-8edc-a1af45eee6e3 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f8799268940>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:28.197350 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4fe2fc07-c082-4f66-8edc-a1af45eee6e3 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-1977006621" status: 200 len: 513 microversion: 2.2 time: 0.040593 Jul 26 14:17:28.207629 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1324/2778] 10.222.0.70 () {60 vars in 1258 bytes} [Tue Jul 26 14:17:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1977006621 => generated 513 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:28.213970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12029b6b-3d08-46d1-b44f-4656256cf6c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:28.218137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-12029b6b-3d08-46d1-b44f-4656256cf6c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:28.239854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12029b6b-3d08-46d1-b44f-4656256cf6c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:28.240938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12029b6b-3d08-46d1-b44f-4656256cf6c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:28.243424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12029b6b-3d08-46d1-b44f-4656256cf6c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:28.246641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12029b6b-3d08-46d1-b44f-4656256cf6c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:28.476128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:28.981206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=40 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:29.472839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-12029b6b-3d08-46d1-b44f-4656256cf6c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:29.496191 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-12029b6b-3d08-46d1-b44f-4656256cf6c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1503 microversion: 2.1 time: 1.293121 Jul 26 14:17:29.498493 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1325/2779] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:28 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1503 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:29.514390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ddefd652-0d8d-4c60-8c2f-5c287667be1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:29.515560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ddefd652-0d8d-4c60-8c2f-5c287667be1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 2f930a87-b048-44cc-86eb-7db98aaaff65] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:29.533600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddefd652-0d8d-4c60-8c2f-5c287667be1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:29.534460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddefd652-0d8d-4c60-8c2f-5c287667be1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:29.535773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddefd652-0d8d-4c60-8c2f-5c287667be1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:29.536914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddefd652-0d8d-4c60-8c2f-5c287667be1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:29.591038 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ddefd652-0d8d-4c60-8c2f-5c287667be1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ddefd652-0d8d-4c60-8c2f-5c287667be1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 HTTP/1.1 Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '2f930a87-b048-44cc-86eb-7db98aaaff65'} Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:29.592966 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:29.598741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:29.598741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:29.598741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:29.598741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:29.598741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. Jul 26 14:17:29.598741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:29.598741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ddefd652-0d8d-4c60-8c2f-5c287667be1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Instance 2f930a87-b048-44cc-86eb-7db98aaaff65 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:29.601162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ddefd652-0d8d-4c60-8c2f-5c287667be1e tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65" status: 404 len: 111 microversion: 2.1 time: 0.097219 Jul 26 14:17:29.602927 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1326/2780] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:29 2022] GET /compute/v2.1/servers/2f930a87-b048-44cc-86eb-7db98aaaff65 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:29.965142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de8beb66-6da4-4eab-91d1-8e1df4714cc4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:29.972028 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6a960903-d002-44b2-98bf-efc56312fe53 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 10.970358 Jul 26 14:17:29.973031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-de8beb66-6da4-4eab-91d1-8e1df4714cc4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] [instance: e6b94307-dd41-4f71-b529-c6cbb944c27f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:29.973316 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1455/2781] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:17:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 10972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:29.981884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1b645c93-a93e-49f2-b36f-501e14978392 req-c7774724-b5f8-4f3f-90a9-830c39858762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "tag": "655c801d-619c-4703-833e-49b7cd5986f5"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:29.988000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de8beb66-6da4-4eab-91d1-8e1df4714cc4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:29.992498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de8beb66-6da4-4eab-91d1-8e1df4714cc4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:29.993396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de8beb66-6da4-4eab-91d1-8e1df4714cc4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:29.993851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de8beb66-6da4-4eab-91d1-8e1df4714cc4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:30.023224 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-de8beb66-6da4-4eab-91d1-8e1df4714cc4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] HTTP exception thrown: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f could not be found. Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de8beb66-6da4-4eab-91d1-8e1df4714cc4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Request method failure captured: Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f HTTP/1.1 Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZLsvLnZkC8oTenEUIGGp5_9spvCeMa8BK8hnAiza9SHyaEexZViVnavNOIrhLsBl-wx_mMmjIq43-3bEnCCb-h9juP2i6IBhys7oU0k95kSw0D0U3ka3-6vBz_LrrYRNodCj_BYUJsaqWriVva95W47g06KQkjHsSY0iUqtyOAlu4 Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14cbcd06677b464ab54dab55a8acd782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14cbcd06677b464ab54dab55a8acd782", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14cbcd06677b464ab54dab55a8acd782"}]}] Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 14cbcd06677b464ab54dab55a8acd782 Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1976340234 Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8aa42b309ab240418fa01e6d4e65e19d Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1976340234-project Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f could not be found. Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e6b94307-dd41-4f71-b529-c6cbb944c27f'} Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f could not be found. Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f could not be found. Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:30.027264 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.031254 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:30.031254 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:30.031254 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:30.031254 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:30.031254 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:30.031254 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f could not be found. Jul 26 14:17:30.031254 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.034588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de8beb66-6da4-4eab-91d1-8e1df4714cc4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] Returning 404 to user: Instance e6b94307-dd41-4f71-b529-c6cbb944c27f could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:30.038010 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-de8beb66-6da4-4eab-91d1-8e1df4714cc4 tempest-ServersNegativeTestJSON-1976340234 tempest-ServersNegativeTestJSON-1976340234-project] 10.222.0.70 "GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f" status: 404 len: 111 microversion: 2.1 time: 0.434616 Jul 26 14:17:30.045712 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1327/2782] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:29 2022] GET /compute/v2.1/servers/e6b94307-dd41-4f71-b529-c6cbb944c27f => generated 111 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:30.053999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e861158f-4af1-4d09-bde6-c215df74e79d tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f87992683a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:30.060126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1b645c93-a93e-49f2-b36f-501e14978392 req-c7774724-b5f8-4f3f-90a9-830c39858762 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:30.060597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1b645c93-a93e-49f2-b36f-501e14978392 req-c7774724-b5f8-4f3f-90a9-830c39858762 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:30.101422 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1b645c93-a93e-49f2-b36f-501e14978392 req-c7774724-b5f8-4f3f-90a9-830c39858762 service nova] Creating event network-changed:655c801d-619c-4703-833e-49b7cd5986f5 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:17:30.113060 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1b645c93-a93e-49f2-b36f-501e14978392 req-c7774724-b5f8-4f3f-90a9-830c39858762 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136083 Jul 26 14:17:30.114328 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1456/2783] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:30.122924 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e861158f-4af1-4d09-bde6-c215df74e79d tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977006621" status: 204 len: 0 microversion: 2.2 time: 0.075438 Jul 26 14:17:30.125718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6e11fc5c-b451-4563-a9a7-51a72c057a77 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:30.127131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6e11fc5c-b451-4563-a9a7-51a72c057a77 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:30.136398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e11fc5c-b451-4563-a9a7-51a72c057a77 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:30.138734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e11fc5c-b451-4563-a9a7-51a72c057a77 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:30.140291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e11fc5c-b451-4563-a9a7-51a72c057a77 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:30.141207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e11fc5c-b451-4563-a9a7-51a72c057a77 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:30.150220 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1328/2784] 10.222.0.70 () {60 vars in 1261 bytes} [Tue Jul 26 14:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1977006621 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:30.160943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-796dd29e-81d9-48eb-9de1-1295a14e4d0b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '.version_select at 0x7f87992514c0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:30.224052 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-796dd29e-81d9-48eb-9de1-1295a14e4d0b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Image not found. Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-796dd29e-81d9-48eb-9de1-1295a14e4d0b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd HTTP/1.1 Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '82110b18-ee7e-4fb0-8e19-3570f163dafd'} Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 82110b18-ee7e-4fb0-8e19-3570f163dafd to delete Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 82110b18-ee7e-4fb0-8e19-3570f163dafd could not be found. Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.232473 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:17:30.239621 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:17:30.248367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-796dd29e-81d9-48eb-9de1-1295a14e4d0b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:30.248367 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-796dd29e-81d9-48eb-9de1-1295a14e4d0b tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd" status: 404 len: 62 microversion: 2.1 time: 0.090796 Jul 26 14:17:30.248367 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1329/2785] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:30 2022] DELETE /compute/v2.1/images/82110b18-ee7e-4fb0-8e19-3570f163dafd => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:17:30.266974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.64"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:30.275574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:30.310128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:30.314701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:30.318522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:30.320686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:30.411297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Acquired lock "refresh_cache-da1e35fe-99b6-426a-9c00-890423632b69" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:17:31.626253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6e11fc5c-b451-4563-a9a7-51a72c057a77 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:31.638906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6e11fc5c-b451-4563-a9a7-51a72c057a77 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:31.640757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6e11fc5c-b451-4563-a9a7-51a72c057a77 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:31.642189 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6e11fc5c-b451-4563-a9a7-51a72c057a77 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1886 microversion: 2.32 time: 1.526426 Jul 26 14:17:31.643306 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1457/2786] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:30 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1886 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:31.648895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4fa0b549-3b8a-4f99-9cef-1183ebd648b0 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Action: 'create', calling method: .version_select at 0x7f87993af700>, body: {"keypair": {"name": "tempest-keypair-1108701855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2tJQECsh0ioiPMvUFQjZzIjwVfotS4/rLKsX0vWx2KLeAbZSYHaIGlZ/HyVcUsfhZx2/K4NSFso0/jQ41vEZClHKOG32gE1IcfFN0Wm3UgckBvDMTwsVbvtqsnhHZ8eA=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:31.666900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-4fa0b549-3b8a-4f99-9cef-1183ebd648b0 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:31.674590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-4fa0b549-3b8a-4f99-9cef-1183ebd648b0 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for user dfc3d1debe894f768524ad8382786523 and project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:31.728672 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4fa0b549-3b8a-4f99-9cef-1183ebd648b0 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.083455 Jul 26 14:17:31.730341 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1458/2787] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jul 26 14:17:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 14:17:31.742399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5da0f417-4104-4cc0-b0df-67354f95cd2d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:31.743703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5da0f417-4104-4cc0-b0df-67354f95cd2d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:31.755422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da0f417-4104-4cc0-b0df-67354f95cd2d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:31.756922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da0f417-4104-4cc0-b0df-67354f95cd2d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:31.758528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da0f417-4104-4cc0-b0df-67354f95cd2d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:31.759759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da0f417-4104-4cc0-b0df-67354f95cd2d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:31.799337 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-5da0f417-4104-4cc0-b0df-67354f95cd2d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5da0f417-4104-4cc0-b0df-67354f95cd2d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 HTTP/1.1 Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '7d63bc9c-464d-40bc-84f1-ffc106ed6cb7'} Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:31.803055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. Jul 26 14:17:31.807974 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:31.807974 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:31.807974 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:31.807974 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:31.807974 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:31.807974 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:31.807974 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:31.807974 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:31.807974 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. Jul 26 14:17:31.807974 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:31.811692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5da0f417-4104-4cc0-b0df-67354f95cd2d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:31.814047 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5da0f417-4104-4cc0-b0df-67354f95cd2d tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 404 len: 111 microversion: 2.1 time: 0.081239 Jul 26 14:17:31.819460 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1459/2788] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:17:31 2022] DELETE /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:31.827943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7cf4d6a9-0ab1-42af-8ac4-41870f980e6b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:31.829695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7cf4d6a9-0ab1-42af-8ac4-41870f980e6b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:31.840655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cf4d6a9-0ab1-42af-8ac4-41870f980e6b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:31.842929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cf4d6a9-0ab1-42af-8ac4-41870f980e6b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:31.845984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cf4d6a9-0ab1-42af-8ac4-41870f980e6b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:31.847010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cf4d6a9-0ab1-42af-8ac4-41870f980e6b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:32.951078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7cf4d6a9-0ab1-42af-8ac4-41870f980e6b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:32.974869 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7cf4d6a9-0ab1-42af-8ac4-41870f980e6b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1503 microversion: 2.1 time: 1.153336 Jul 26 14:17:32.981851 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1460/2789] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:31 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1503 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:33.171784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b1ca6674-b4eb-4c19-9fde-c0a12e001f63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'create', calling method: .version_select at 0x7f8786fe8040>, body: {"keypair": {"name": "tempest-keypair-1982894533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHM3yh2CID7udzXzGylURnwtBRycrIOzb3Phl0ep6vEVw2we02YAaZFeWIKrUH5HuvpZGjrdGSrpmjsS++vuh83zLalamt+7+8kcS4PkrlT/1S3eEE6x344aFvI8aIwwYw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:33.258131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-b1ca6674-b4eb-4c19-9fde-c0a12e001f63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Getting quotas for project 36cdecfd17974d588bc69d8e369a7fd1. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:33.306244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-b1ca6674-b4eb-4c19-9fde-c0a12e001f63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Getting quotas for user 0a19594a069a4981b97987a892d918e1 and project 36cdecfd17974d588bc69d8e369a7fd1. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:33.406124 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b1ca6674-b4eb-4c19-9fde-c0a12e001f63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.417064 Jul 26 14:17:33.408423 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1461/2790] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:17:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:33.451313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9cbbf669-2ebf-4f25-8f85-28409e9f1a37 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f87992b0700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:33.547356 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9cbbf669-2ebf-4f25-8f85-28409e9f1a37 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108701855" status: 204 len: 0 microversion: 2.2 time: 0.127758 Jul 26 14:17:33.551734 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1462/2791] 10.222.0.70 () {60 vars in 1261 bytes} [Tue Jul 26 14:17:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108701855 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:33.589902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-649d19be-19a3-42fa-b142-ddb3e0ffb96a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:33.590942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-649d19be-19a3-42fa-b142-ddb3e0ffb96a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] [instance: 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:33.613006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-649d19be-19a3-42fa-b142-ddb3e0ffb96a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:33.615937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-649d19be-19a3-42fa-b142-ddb3e0ffb96a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:33.620132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-649d19be-19a3-42fa-b142-ddb3e0ffb96a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:33.623171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-649d19be-19a3-42fa-b142-ddb3e0ffb96a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:33.686288 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-649d19be-19a3-42fa-b142-ddb3e0ffb96a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] HTTP exception thrown: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-649d19be-19a3-42fa-b142-ddb3e0ffb96a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Request method failure captured: Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 HTTP/1.1 Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ZkylRZjy9nEYABaag4gZmhsUCC5r4t0jFhqlhwU-eZ6vedCoeIaGYSnBtGCM5K_HC_S2xdpAb99Qomxp2qOSQfGMzxzYlWqctXcYXKXkoymo7vt0vuql9T5pnIFevx_t3iIbpTvE0TSPps51rX1N9nAXVC44DkcEo3po1pbuDHlcI Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/af3d0a242a34482d8737db7862279e87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_af3d0a242a34482d8737db7862279e87", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/af3d0a242a34482d8737db7862279e87"}]}] Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesTestJSON-617895148 Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: af3d0a242a34482d8737db7862279e87 Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesTestJSON-617895148 Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f94de8d57f854570b3ceda6ae5e7b9ae Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesTestJSON-617895148-project Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '7d63bc9c-464d-40bc-84f1-ffc106ed6cb7'} Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:33.690165 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:17:33.697349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:17:33.697349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:17:33.697349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:17:33.697349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:17:33.697349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. Jul 26 14:17:33.697349 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:17:33.697349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-649d19be-19a3-42fa-b142-ddb3e0ffb96a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] Returning 404 to user: Instance 7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:17:33.697349 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-649d19be-19a3-42fa-b142-ddb3e0ffb96a tempest-ImagesTestJSON-617895148 tempest-ImagesTestJSON-617895148-project] 10.222.0.70 "GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7" status: 404 len: 111 microversion: 2.1 time: 0.133617 Jul 26 14:17:33.705194 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1463/2792] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:33 2022] GET /compute/v2.1/servers/7d63bc9c-464d-40bc-84f1-ffc106ed6cb7 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:17:33.722115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-bb66b98b-2297-4d82-bdca-1d8cb8b994d8 req-95b6f24b-f577-483c-abc7-a4a8f696e4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b94307-dd41-4f71-b529-c6cbb944c27f", "name": "network-vif-deleted", "tag": "5c60dac8-f587-41cf-8357-66980afb2e01"}, {"server_uuid": "1f48b35a-d0b1-4601-a9d6-1af81d99f6b6", "name": "network-vif-unplugged", "status": "completed", "tag": "824da495-3034-4a08-821e-b7d317b4eb25"}, {"name": "network-changed", "server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "tag": "d3a78f25-3960-4067-8f30-6daf5be1078e"}, {"name": "network-changed", "server_uuid": "1f48b35a-d0b1-4601-a9d6-1af81d99f6b6", "tag": "824da495-3034-4a08-821e-b7d317b4eb25"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:33.784483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-bb66b98b-2297-4d82-bdca-1d8cb8b994d8 req-95b6f24b-f577-483c-abc7-a4a8f696e4f3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:33.788257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-bb66b98b-2297-4d82-bdca-1d8cb8b994d8 req-95b6f24b-f577-483c-abc7-a4a8f696e4f3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:33.842197 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-bb66b98b-2297-4d82-bdca-1d8cb8b994d8 req-95b6f24b-f577-483c-abc7-a4a8f696e4f3 service nova] Creating event network-vif-deleted:5c60dac8-f587-41cf-8357-66980afb2e01 for instance e6b94307-dd41-4f71-b529-c6cbb944c27f on n-h1-833090-9 Jul 26 14:17:33.845085 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-bb66b98b-2297-4d82-bdca-1d8cb8b994d8 req-95b6f24b-f577-483c-abc7-a4a8f696e4f3 service nova] Creating event network-vif-unplugged:824da495-3034-4a08-821e-b7d317b4eb25 for instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 on n-h1-833090-9 Jul 26 14:17:33.853867 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-bb66b98b-2297-4d82-bdca-1d8cb8b994d8 req-95b6f24b-f577-483c-abc7-a4a8f696e4f3 service nova] Creating event network-changed:d3a78f25-3960-4067-8f30-6daf5be1078e for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:17:33.855059 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-bb66b98b-2297-4d82-bdca-1d8cb8b994d8 req-95b6f24b-f577-483c-abc7-a4a8f696e4f3 service nova] Creating event network-changed:824da495-3034-4a08-821e-b7d317b4eb25 for instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 on n-h1-833090-9 Jul 26 14:17:33.911276 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-bb66b98b-2297-4d82-bdca-1d8cb8b994d8 req-95b6f24b-f577-483c-abc7-a4a8f696e4f3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 690 microversion: 2.1 time: 0.201196 Jul 26 14:17:33.917174 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1464/2793] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 690 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:33.935432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af606d13-c1c1-4fc8-bb00-9b73fe1dd9be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:33.941087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af606d13-c1c1-4fc8-bb00-9b73fe1dd9be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:33.964194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af606d13-c1c1-4fc8-bb00-9b73fe1dd9be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:33.964991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af606d13-c1c1-4fc8-bb00-9b73fe1dd9be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:33.966568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af606d13-c1c1-4fc8-bb00-9b73fe1dd9be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:33.973126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af606d13-c1c1-4fc8-bb00-9b73fe1dd9be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:34.432531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:36.603181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af606d13-c1c1-4fc8-bb00-9b73fe1dd9be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:36.650057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af606d13-c1c1-4fc8-bb00-9b73fe1dd9be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:36.685397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af606d13-c1c1-4fc8-bb00-9b73fe1dd9be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:36.688924 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af606d13-c1c1-4fc8-bb00-9b73fe1dd9be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1886 microversion: 2.32 time: 2.769796 Jul 26 14:17:36.709113 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1465/2794] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:33 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1886 bytes in 2790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:36.726339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-281c90ed-b489-4d55-8b40-a299a6ff640d tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Action: 'create', calling method: .version_select at 0x7f8786fe3430>, body: {"keypair": {"name": "tempest-keypair-1164468155", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:36.761074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-281c90ed-b489-4d55-8b40-a299a6ff640d tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:36.773274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-281c90ed-b489-4d55-8b40-a299a6ff640d tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for user dfc3d1debe894f768524ad8382786523 and project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:36.837216 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-281c90ed-b489-4d55-8b40-a299a6ff640d tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.126196 Jul 26 14:17:36.838464 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1466/2795] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jul 26 14:17:36 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 14:17:36.843914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d2808cf2-995a-46df-ac43-1a7b7f27692c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:36.848180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d2808cf2-995a-46df-ac43-1a7b7f27692c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:36.866699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2808cf2-995a-46df-ac43-1a7b7f27692c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:36.867482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2808cf2-995a-46df-ac43-1a7b7f27692c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:36.868540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2808cf2-995a-46df-ac43-1a7b7f27692c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:36.881572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2808cf2-995a-46df-ac43-1a7b7f27692c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:37.877570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d2808cf2-995a-46df-ac43-1a7b7f27692c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:37.902509 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d2808cf2-995a-46df-ac43-1a7b7f27692c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1503 microversion: 2.1 time: 1.062349 Jul 26 14:17:37.903645 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1467/2796] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:36 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1503 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:37.912830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-16016c18-74c6-4f0d-9f46-dfc6cde86544 req-d8b02cdc-c5f8-4c8a-9ee4-0c92bf4bc2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "tag": "1caf9c4e-e16d-4c2d-b589-6ae470a2ecc0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:37.961441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-16016c18-74c6-4f0d-9f46-dfc6cde86544 req-d8b02cdc-c5f8-4c8a-9ee4-0c92bf4bc2dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:37.962184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-16016c18-74c6-4f0d-9f46-dfc6cde86544 req-d8b02cdc-c5f8-4c8a-9ee4-0c92bf4bc2dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:37.985354 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-16016c18-74c6-4f0d-9f46-dfc6cde86544 req-d8b02cdc-c5f8-4c8a-9ee4-0c92bf4bc2dd service nova] Creating event network-changed:1caf9c4e-e16d-4c2d-b589-6ae470a2ecc0 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:17:38.003333 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-16016c18-74c6-4f0d-9f46-dfc6cde86544 req-d8b02cdc-c5f8-4c8a-9ee4-0c92bf4bc2dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097272 Jul 26 14:17:38.004311 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1468/2797] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:38.021918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29fef1c4-b8db-48dc-a918-61b39bc8b229 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f87992c28b0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:38.100123 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-29fef1c4-b8db-48dc-a918-61b39bc8b229 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164468155" status: 204 len: 0 microversion: 2.2 time: 0.091472 Jul 26 14:17:38.111239 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1469/2798] 10.222.0.70 () {60 vars in 1261 bytes} [Tue Jul 26 14:17:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164468155 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:38.127404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e535b8da-80dd-4bd6-9f64-e2a9ae0d2b49 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:38.136476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e535b8da-80dd-4bd6-9f64-e2a9ae0d2b49 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:38.169947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e535b8da-80dd-4bd6-9f64-e2a9ae0d2b49 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:38.174371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e535b8da-80dd-4bd6-9f64-e2a9ae0d2b49 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:38.175908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e535b8da-80dd-4bd6-9f64-e2a9ae0d2b49 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:38.183661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e535b8da-80dd-4bd6-9f64-e2a9ae0d2b49 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:39.437838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e535b8da-80dd-4bd6-9f64-e2a9ae0d2b49 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:39.521342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e535b8da-80dd-4bd6-9f64-e2a9ae0d2b49 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:39.551798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e535b8da-80dd-4bd6-9f64-e2a9ae0d2b49 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:39.553731 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e535b8da-80dd-4bd6-9f64-e2a9ae0d2b49 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 1.450687 Jul 26 14:17:39.554938 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1470/2799] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:38 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:39.560625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-75d3730c-d031-4d44-b7e4-d43ea64bd7bf tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Action: 'create', calling method: .version_select at 0x7f87946e8430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-253340014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuIbnqzIkemg1OPLkw5mSUxMIQp3TrEeQ6J0T49ZlVigqYUO/zYvhRTRWJUMFtUr8OgsGP9hubeLwqzZFE1pMqzV8g0fBIZNJrVwxcDDvXJzY0mhXJNhaWaAnf1KK9c7g=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:39.593845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-75d3730c-d031-4d44-b7e4-d43ea64bd7bf tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:39.627393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-75d3730c-d031-4d44-b7e4-d43ea64bd7bf tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for user dfc3d1debe894f768524ad8382786523 and project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:39.707568 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-75d3730c-d031-4d44-b7e4-d43ea64bd7bf tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.151203 Jul 26 14:17:39.710595 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1471/2800] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jul 26 14:17:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 14:17:39.740550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90537edd-e3cf-4611-92a3-3541eec6fd91 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:39.742261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-90537edd-e3cf-4611-92a3-3541eec6fd91 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:39.758738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90537edd-e3cf-4611-92a3-3541eec6fd91 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:39.764406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90537edd-e3cf-4611-92a3-3541eec6fd91 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:39.765657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90537edd-e3cf-4611-92a3-3541eec6fd91 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:39.770372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90537edd-e3cf-4611-92a3-3541eec6fd91 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:40.296725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:40.400910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=18 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:41.008538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90537edd-e3cf-4611-92a3-3541eec6fd91 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:41.062308 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90537edd-e3cf-4611-92a3-3541eec6fd91 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1503 microversion: 2.1 time: 1.346870 Jul 26 14:17:41.064859 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1472/2801] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:39 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1503 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:41.085210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a365e6e2-1426-4756-a068-9e989b69fdfd tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Action: 'create', calling method: .version_select at 0x7f87992bfb80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-687215671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl2n7WGa7utzULTBN4x49GCn+0t0LKmbN6tZLXFiLNYKLcf7ZpZuAxWQjL/buYXPogxjs2NhiT9XYLCfwp5I8FT/JgbdImJUJak9Zp3qtlysq6H0YKcs6On6/hKkG/usQ=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:41.144202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-a365e6e2-1426-4756-a068-9e989b69fdfd tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:41.157572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-a365e6e2-1426-4756-a068-9e989b69fdfd tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for user dfc3d1debe894f768524ad8382786523 and project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:41.197488 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a365e6e2-1426-4756-a068-9e989b69fdfd tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.131115 Jul 26 14:17:41.198557 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1473/2802] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jul 26 14:17:41 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 14:17:41.219408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9289f8e0-6963-49ab-a1b7-7d3998f3b67d req-7957a606-ea70-473f-82c0-8fb359627cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f48b35a-d0b1-4601-a9d6-1af81d99f6b6", "name": "network-vif-unplugged", "status": "completed", "tag": "824da495-3034-4a08-821e-b7d317b4eb25"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:41.249264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9289f8e0-6963-49ab-a1b7-7d3998f3b67d req-7957a606-ea70-473f-82c0-8fb359627cd1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:41.251239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9289f8e0-6963-49ab-a1b7-7d3998f3b67d req-7957a606-ea70-473f-82c0-8fb359627cd1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:41.276507 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9289f8e0-6963-49ab-a1b7-7d3998f3b67d req-7957a606-ea70-473f-82c0-8fb359627cd1 service nova] Creating event network-vif-unplugged:824da495-3034-4a08-821e-b7d317b4eb25 for instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 on n-h1-833090-9 Jul 26 14:17:41.284259 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9289f8e0-6963-49ab-a1b7-7d3998f3b67d req-7957a606-ea70-473f-82c0-8fb359627cd1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084137 Jul 26 14:17:41.285198 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1474/2803] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:41.292476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ddbf76e0-8e3b-4a45-9c74-a676cdd2958f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:41.293195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ddbf76e0-8e3b-4a45-9c74-a676cdd2958f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:41.301392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddbf76e0-8e3b-4a45-9c74-a676cdd2958f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:41.301627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddbf76e0-8e3b-4a45-9c74-a676cdd2958f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:41.302997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddbf76e0-8e3b-4a45-9c74-a676cdd2958f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:41.303450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddbf76e0-8e3b-4a45-9c74-a676cdd2958f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:42.354881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Building network info cache for instance {{(pid=119478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 14:17:42.630713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ddbf76e0-8e3b-4a45-9c74-a676cdd2958f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:42.643149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ddbf76e0-8e3b-4a45-9c74-a676cdd2958f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:42.656206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ddbf76e0-8e3b-4a45-9c74-a676cdd2958f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:42.657720 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ddbf76e0-8e3b-4a45-9c74-a676cdd2958f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 1.369872 Jul 26 14:17:42.658464 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1475/2804] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:41 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:42.673058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dbd2cb51-90a4-438d-a988-a3970c850bfa tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Action: 'create', calling method: .version_select at 0x7f8786fe84c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-463805608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD66eLdJd1Ew6pINTkKsDXrZVVXqNSWn3eSFM+KdsmhimzmtEy0kRAyymEBcstltoNcvmDPZouKA9wl7uZXkQDu/1bwVl+60vnJ3OxU0o5KEO/Vf8nMkckLKAgBM8qk2oQ=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:42.724755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-dbd2cb51-90a4-438d-a988-a3970c850bfa tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:42.729444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:42.746822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-dbd2cb51-90a4-438d-a988-a3970c850bfa tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for user dfc3d1debe894f768524ad8382786523 and project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:42.815375 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dbd2cb51-90a4-438d-a988-a3970c850bfa tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.155215 Jul 26 14:17:42.824315 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1476/2805] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jul 26 14:17:42 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 14:17:42.837148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-780beefd-ffc9-464f-b5cf-c1181618647e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:42.838209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-780beefd-ffc9-464f-b5cf-c1181618647e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:42.855389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-780beefd-ffc9-464f-b5cf-c1181618647e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:42.856139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-780beefd-ffc9-464f-b5cf-c1181618647e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:42.858446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-780beefd-ffc9-464f-b5cf-c1181618647e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:42.861922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-780beefd-ffc9-464f-b5cf-c1181618647e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:43.245865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-780beefd-ffc9-464f-b5cf-c1181618647e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:43.261667 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-780beefd-ffc9-464f-b5cf-c1181618647e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1503 microversion: 2.1 time: 0.435581 Jul 26 14:17:43.269238 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1477/2806] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:42 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1503 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:43.289933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76a8ef7a-d89d-4316-aea0-2ff981a52598 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f878705bf70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:43.301650 n-d-833090-9 devstack@n-api.service[119479]: WARNING oslo_db.sqlalchemy.utils [None req-76a8ef7a-d89d-4316-aea0-2ff981a52598 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 14:17:43.326995 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76a8ef7a-d89d-4316-aea0-2ff981a52598 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.056457 Jul 26 14:17:43.328551 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1478/2807] 10.222.0.70 () {60 vars in 1177 bytes} [Tue Jul 26 14:17:43 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:43.347847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-68dd4d88-436e-42f5-9d28-3b76abd5574a tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f8799370940>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:43.407162 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-68dd4d88-436e-42f5-9d28-3b76abd5574a tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-463805608" status: 204 len: 0 microversion: 2.2 time: 0.069479 Jul 26 14:17:43.408414 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1479/2808] 10.222.0.70 () {60 vars in 1318 bytes} [Tue Jul 26 14:17:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-463805608 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:43.418366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-efa2bdef-cc29-4138-8462-90864a135089 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f8799370790>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:43.462427 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-efa2bdef-cc29-4138-8462-90864a135089 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-687215671" status: 204 len: 0 microversion: 2.2 time: 0.047338 Jul 26 14:17:43.464099 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1480/2809] 10.222.0.70 () {60 vars in 1318 bytes} [Tue Jul 26 14:17:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-687215671 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:17:43.478322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d038e88-9761-4c05-8ebf-f9495527653c tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f8786fe88b0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:43.519254 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d038e88-9761-4c05-8ebf-f9495527653c tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-253340014" status: 204 len: 0 microversion: 2.2 time: 0.049836 Jul 26 14:17:43.527092 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1481/2810] 10.222.0.70 () {60 vars in 1318 bytes} [Tue Jul 26 14:17:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-253340014 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:43.532587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0f2dcbd-653c-41c3-87a8-5785ac3d97d8 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Action: 'create', calling method: .version_select at 0x7f87993ba790>, body: {"keypair": {"name": "tempest-keypair-696034976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALbx09IOAkEuNYiK85maOFd3TbXJVc2F4E5MbPdur9VHsamJNLMP4grrU84QFEspDZGD6MPplhRRmlyS/1SYgRVeihg4Bk4sFEuBCKpVVNah7s2eKIOrgbDaEGyBmdMzA=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:43.566950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d0f2dcbd-653c-41c3-87a8-5785ac3d97d8 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:43.573887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d0f2dcbd-653c-41c3-87a8-5785ac3d97d8 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for user dfc3d1debe894f768524ad8382786523 and project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:43.606521 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d0f2dcbd-653c-41c3-87a8-5785ac3d97d8 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.076709 Jul 26 14:17:43.614072 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1482/2811] 10.222.0.70 () {62 vars in 1199 bytes} [Tue Jul 26 14:17:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 26 14:17:43.621599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-67869469-d0ed-45ad-a759-b6d17473fec5 req-9118eb7e-c7b7-4695-b0a2-f5887a158695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "tag": "238ee548-dff9-412c-84cd-2631e15a0247"}, {"name": "network-changed", "server_uuid": "da1e35fe-99b6-426a-9c00-890423632b69", "tag": "70c52961-0644-4b44-9202-3493a2dafa42"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:43.649654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-67869469-d0ed-45ad-a759-b6d17473fec5 req-9118eb7e-c7b7-4695-b0a2-f5887a158695 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:43.649654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-67869469-d0ed-45ad-a759-b6d17473fec5 req-9118eb7e-c7b7-4695-b0a2-f5887a158695 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:43.689113 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-67869469-d0ed-45ad-a759-b6d17473fec5 req-9118eb7e-c7b7-4695-b0a2-f5887a158695 service nova] Creating event network-changed:238ee548-dff9-412c-84cd-2631e15a0247 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:17:43.689599 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-67869469-d0ed-45ad-a759-b6d17473fec5 req-9118eb7e-c7b7-4695-b0a2-f5887a158695 service nova] Creating event network-changed:70c52961-0644-4b44-9202-3493a2dafa42 for instance da1e35fe-99b6-426a-9c00-890423632b69 on n-h2-833090-9 Jul 26 14:17:43.708028 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-67869469-d0ed-45ad-a759-b6d17473fec5 req-9118eb7e-c7b7-4695-b0a2-f5887a158695 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096189 Jul 26 14:17:43.718627 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1483/2812] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:43.728585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a82a51ee-7058-48d9-919d-ca2b1c6522e6 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f87993509d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:43.751507 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a82a51ee-7058-48d9-919d-ca2b1c6522e6 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-696034976" status: 200 len: 512 microversion: 2.2 time: 0.030722 Jul 26 14:17:43.763412 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1484/2813] 10.222.0.70 () {60 vars in 1255 bytes} [Tue Jul 26 14:17:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-696034976 => generated 512 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:43.778509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-264c549a-6cd0-43ae-bf1d-30aec19676be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:43.782350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-264c549a-6cd0-43ae-bf1d-30aec19676be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:43.816808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-264c549a-6cd0-43ae-bf1d-30aec19676be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:43.817420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-264c549a-6cd0-43ae-bf1d-30aec19676be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:43.819721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-264c549a-6cd0-43ae-bf1d-30aec19676be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:43.822856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-264c549a-6cd0-43ae-bf1d-30aec19676be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:44.502854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-264c549a-6cd0-43ae-bf1d-30aec19676be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:44.512737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-264c549a-6cd0-43ae-bf1d-30aec19676be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:44.514257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-264c549a-6cd0-43ae-bf1d-30aec19676be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:44.515463 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-264c549a-6cd0-43ae-bf1d-30aec19676be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.750209 Jul 26 14:17:44.533854 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1485/2814] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:43 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:44.548916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-78ce861c-db52-46bc-b9b8-02cf2b66085c tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f87993501f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:44.555219 n-d-833090-9 devstack@n-api.service[119479]: WARNING oslo_db.sqlalchemy.utils [None req-78ce861c-db52-46bc-b9b8-02cf2b66085c tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 14:17:44.571130 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-78ce861c-db52-46bc-b9b8-02cf2b66085c tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.035984 Jul 26 14:17:44.577037 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1486/2815] 10.222.0.70 () {60 vars in 1177 bytes} [Tue Jul 26 14:17:44 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:44.585662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1176386893", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d418b403-dd4d-4f55-89c9-6fcfc87770fa"}], "security_groups": [{"name": "tempest-securitygroup--335230839"}], "key_name": "tempest-keypair-1982894533", "user_data": "}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:45.059459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] validate_networks() for [('d418b403-dd4d-4f55-89c9-6fcfc87770fa', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:17:45.094054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Updating instance_info_cache with network_info: [{"id": "70c52961-0644-4b44-9202-3493a2dafa42", "address": "fa:16:3e:af:89:58", "network": {"id": "5269779e-9361-4476-8afc-7e1c2e18c835", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-724023630-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b9afeb78afff4a448db4261f7333ce3c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap70c52961-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:17:45.119046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Releasing lock "refresh_cache-da1e35fe-99b6-426a-9c00-890423632b69" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:17:45.120559 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-19e7eb0e-fd32-4733-800c-a7d9effb0004 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "POST /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69/action" status: 202 len: 0 microversion: 2.1 time: 14.870879 Jul 26 14:17:45.121413 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1330/2816] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:17:30 2022] POST /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69/action => generated 0 bytes in 14878 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 14:17:45.133126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-91541125-b215-40aa-bf6c-ca4e8d5a728a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:45.135998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-91541125-b215-40aa-bf6c-ca4e8d5a728a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:45.144207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91541125-b215-40aa-bf6c-ca4e8d5a728a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:45.145070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91541125-b215-40aa-bf6c-ca4e8d5a728a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:45.146174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91541125-b215-40aa-bf6c-ca4e8d5a728a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:45.146917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91541125-b215-40aa-bf6c-ca4e8d5a728a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:45.716037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-91541125-b215-40aa-bf6c-ca4e8d5a728a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:45.728565 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-91541125-b215-40aa-bf6c-ca4e8d5a728a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1478 microversion: 2.1 time: 0.601429 Jul 26 14:17:45.729148 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1331/2817] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:45 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1478 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:45.737888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dc1f656e-e03c-4e56-8268-0d3f9e6fad6e tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f8799268af0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:45.766620 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dc1f656e-e03c-4e56-8268-0d3f9e6fad6e tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-696034976" status: 204 len: 0 microversion: 2.2 time: 0.035572 Jul 26 14:17:45.768079 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1332/2818] 10.222.0.70 () {60 vars in 1258 bytes} [Tue Jul 26 14:17:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-696034976 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:45.776872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.64"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:46.651540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:46.664518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:46.665922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:46.667185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:46.668681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:46.867986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:17:46.870469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:17:46.871228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:17:46.871856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:17:46.874339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:17:46.895161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:46.897064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:46.898336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:46.899184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:46.951617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Getting quotas for project 36cdecfd17974d588bc69d8e369a7fd1. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:46.961903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Getting quotas for user 0a19594a069a4981b97987a892d918e1 and project 36cdecfd17974d588bc69d8e369a7fd1. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:46.988409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:17:46.993690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:17:47.065330 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e98a2a77-d9d4-49fd-a1bc-7a040973f742 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.492384 Jul 26 14:17:47.066662 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1487/2819] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:17:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 2494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:17:47.080632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b14420a5-b932-44cc-9503-a713abc37064 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:47.081264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b14420a5-b932-44cc-9503-a713abc37064 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:47.092870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b14420a5-b932-44cc-9503-a713abc37064 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:47.093384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b14420a5-b932-44cc-9503-a713abc37064 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:47.094229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b14420a5-b932-44cc-9503-a713abc37064 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:47.095066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b14420a5-b932-44cc-9503-a713abc37064 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:47.433979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Acquired lock "refresh_cache-da1e35fe-99b6-426a-9c00-890423632b69" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:17:47.942034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b14420a5-b932-44cc-9503-a713abc37064 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:47.957178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b14420a5-b932-44cc-9503-a713abc37064 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:47.961513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b14420a5-b932-44cc-9503-a713abc37064 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:47.963298 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b14420a5-b932-44cc-9503-a713abc37064 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.894347 Jul 26 14:17:47.967269 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1488/2820] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:47 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:47.972363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e03adb17-c115-4f4c-9aa0-8bb7af7c1b1b tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '.version_select at 0x7f87993ba790>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:47.979005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e03adb17-c115-4f4c-9aa0-8bb7af7c1b1b tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:47.979680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e03adb17-c115-4f4c-9aa0-8bb7af7c1b1b tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:48.030519 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e03adb17-c115-4f4c-9aa0-8bb7af7c1b1b tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 785 microversion: 2.1 time: 0.061849 Jul 26 14:17:48.043813 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1489/2821] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:17:47 2022] GET /compute/v2.1/os-migrations => generated 785 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:48.050736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-550c29f1-bbcb-4eb7-a5f6-db1e3cee47de tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Action: 'create', calling method: .version_select at 0x7f8786fe3a60>, body: {"keypair": {"name": "tempest-keypair-172977096", "type": "x509"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:48.076822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-550c29f1-bbcb-4eb7-a5f6-db1e3cee47de tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:48.085293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-550c29f1-bbcb-4eb7-a5f6-db1e3cee47de tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for user dfc3d1debe894f768524ad8382786523 and project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:48.117146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.processutils [None req-550c29f1-bbcb-4eb7-a5f6-db1e3cee47de tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmphy_amcb2/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmphy_amcb2/temp.key -subj /CN=dfc3d1debe894f768524ad8382786523 -extensions v3_req_client {{(pid=119479) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 26 14:17:49.130670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.processutils [None req-550c29f1-bbcb-4eb7-a5f6-db1e3cee47de tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmphy_amcb2/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmphy_amcb2/temp.key -subj /CN=dfc3d1debe894f768524ad8382786523 -extensions v3_req_client" returned: 0 in 1.013s {{(pid=119479) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 26 14:17:49.134486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.processutils [None req-550c29f1-bbcb-4eb7-a5f6-db1e3cee47de tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmphy_amcb2/temp.key -password pass: {{(pid=119479) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 26 14:17:49.196733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.processutils [None req-550c29f1-bbcb-4eb7-a5f6-db1e3cee47de tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] CMD "openssl pkcs12 -export -inkey /tmp/tmphy_amcb2/temp.key -password pass:" returned: 0 in 0.061s {{(pid=119479) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 26 14:17:49.298541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-550c29f1-bbcb-4eb7-a5f6-db1e3cee47de tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:49.310035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-550c29f1-bbcb-4eb7-a5f6-db1e3cee47de tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Getting quotas for user dfc3d1debe894f768524ad8382786523 and project 009f803dfe0c4f6895b6c3b1dbb3d1e6. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:49.365033 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-550c29f1-bbcb-4eb7-a5f6-db1e3cee47de tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.319339 Jul 26 14:17:49.371506 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1490/2822] 10.222.0.70 () {62 vars in 1198 bytes} [Tue Jul 26 14:17:48 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1321 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:49.383614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-59b58cf2-9744-407d-88a0-ab63dfa55363 req-dcde443a-2a18-4cf7-9ab8-f5073f7da385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "tag": "f6ef9b57-da48-4401-878d-831cea8a8c9f"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:49.410717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-59b58cf2-9744-407d-88a0-ab63dfa55363 req-dcde443a-2a18-4cf7-9ab8-f5073f7da385 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:49.411240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-59b58cf2-9744-407d-88a0-ab63dfa55363 req-dcde443a-2a18-4cf7-9ab8-f5073f7da385 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:49.437657 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-59b58cf2-9744-407d-88a0-ab63dfa55363 req-dcde443a-2a18-4cf7-9ab8-f5073f7da385 service nova] Creating event network-changed:f6ef9b57-da48-4401-878d-831cea8a8c9f for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:17:49.445253 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-59b58cf2-9744-407d-88a0-ab63dfa55363 req-dcde443a-2a18-4cf7-9ab8-f5073f7da385 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071305 Jul 26 14:17:49.448633 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1491/2823] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:49.455337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-072dcbf9-bdc1-4743-98a1-dc6901e2c7c4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:49.457039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-072dcbf9-bdc1-4743-98a1-dc6901e2c7c4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:49.465943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-072dcbf9-bdc1-4743-98a1-dc6901e2c7c4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:49.466515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-072dcbf9-bdc1-4743-98a1-dc6901e2c7c4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:49.467468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-072dcbf9-bdc1-4743-98a1-dc6901e2c7c4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:49.468240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-072dcbf9-bdc1-4743-98a1-dc6901e2c7c4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:49.608460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-072dcbf9-bdc1-4743-98a1-dc6901e2c7c4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:49.621225 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-072dcbf9-bdc1-4743-98a1-dc6901e2c7c4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1296 microversion: 2.1 time: 0.170916 Jul 26 14:17:49.622157 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1492/2824] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:49 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1296 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:49.630671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d98097ef-321f-42b6-827d-d2bee62de33c tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:49.631299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d98097ef-321f-42b6-827d-d2bee62de33c tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:49.640996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d98097ef-321f-42b6-827d-d2bee62de33c tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:49.641433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d98097ef-321f-42b6-827d-d2bee62de33c tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:49.643226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d98097ef-321f-42b6-827d-d2bee62de33c tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:49.643708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d98097ef-321f-42b6-827d-d2bee62de33c tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:49.948253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Building network info cache for instance {{(pid=119478) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 26 14:17:50.145452 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d98097ef-321f-42b6-827d-d2bee62de33c tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1629 microversion: 2.1 time: 0.515875 Jul 26 14:17:50.161302 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1493/2825] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:49 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1629 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:50.182796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-98d39293-b31b-47ba-b52f-a3ab9e4272a5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:50.183621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-98d39293-b31b-47ba-b52f-a3ab9e4272a5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:50.201059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98d39293-b31b-47ba-b52f-a3ab9e4272a5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:50.204713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98d39293-b31b-47ba-b52f-a3ab9e4272a5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:50.205769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98d39293-b31b-47ba-b52f-a3ab9e4272a5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:50.206414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98d39293-b31b-47ba-b52f-a3ab9e4272a5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:50.742835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-98d39293-b31b-47ba-b52f-a3ab9e4272a5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:50.756493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-98d39293-b31b-47ba-b52f-a3ab9e4272a5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:50.758032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-98d39293-b31b-47ba-b52f-a3ab9e4272a5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:50.759261 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-98d39293-b31b-47ba-b52f-a3ab9e4272a5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.596182 Jul 26 14:17:50.768522 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1494/2826] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:50 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:50.780168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9cbce832-ce53-4c77-8674-dabbda78b0c9 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f87992cdd30>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:50.800228 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9cbce832-ce53-4c77-8674-dabbda78b0c9 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-172977096" status: 200 len: 1533 microversion: 2.2 time: 0.030183 Jul 26 14:17:50.801139 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1495/2827] 10.222.0.70 () {60 vars in 1255 bytes} [Tue Jul 26 14:17:50 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-172977096 => generated 1533 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:50.809459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-920b04cd-0bd2-476f-b551-aca98b21476a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Action: 'create', calling method: .version_select at 0x7f8786fd2280>, body: {"keypair": {"name": "tempest-keypair-875563219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEizDGk99TyqWe9CzrM/4OX9GRWpEFpGV3sgtotmIf4c2EK9krdR2XrchxvWs4T3h8mHPj5YQ3gq13AnT4ySOS4E+AzNQ65X9KNYhCK0vUWe+/9YhKpGyM7bkjoDkTAh4g=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:50.850565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-920b04cd-0bd2-476f-b551-aca98b21476a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Getting quotas for project 1976cab4a83747a68cadf5b4dc2dbef0. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:17:50.866911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:50.872841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-920b04cd-0bd2-476f-b551-aca98b21476a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Getting quotas for user e35f47eb9e094bdc8d08ea4cf2970d8c and project 1976cab4a83747a68cadf5b4dc2dbef0. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:17:50.931924 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-920b04cd-0bd2-476f-b551-aca98b21476a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127072 Jul 26 14:17:50.934052 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1496/2828] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:17:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:50.960885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e7db3198-2463-451e-ae13-d683a3a132f9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:50.962146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e7db3198-2463-451e-ae13-d683a3a132f9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:50.976920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7db3198-2463-451e-ae13-d683a3a132f9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:50.978196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7db3198-2463-451e-ae13-d683a3a132f9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:50.981838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7db3198-2463-451e-ae13-d683a3a132f9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:50.983937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7db3198-2463-451e-ae13-d683a3a132f9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:50.993047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:51.611138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e7db3198-2463-451e-ae13-d683a3a132f9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:51.626383 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e7db3198-2463-451e-ae13-d683a3a132f9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1296 microversion: 2.1 time: 0.690729 Jul 26 14:17:51.629353 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1497/2829] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:50 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1296 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:51.642699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aada6c81-7b1c-47b3-b9b2-98eccbf8940f tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f8799264040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:51.651472 n-d-833090-9 devstack@n-api.service[119479]: WARNING oslo_db.sqlalchemy.utils [None req-aada6c81-7b1c-47b3-b9b2-98eccbf8940f tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 14:17:51.663594 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aada6c81-7b1c-47b3-b9b2-98eccbf8940f tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.031930 Jul 26 14:17:51.669898 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1498/2830] 10.222.0.70 () {60 vars in 1177 bytes} [Tue Jul 26 14:17:51 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:51.681666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-45167f80-b458-4391-b73e-a40f72d1f32b req-b02df704-0531-46f8-83a7-17c2e5d868f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "tag": "94991b0a-9173-43b7-afe8-7a5e6b1a961e"}, {"name": "network-changed", "server_uuid": "da1e35fe-99b6-426a-9c00-890423632b69", "tag": "70c52961-0644-4b44-9202-3493a2dafa42"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:51.717869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-45167f80-b458-4391-b73e-a40f72d1f32b req-b02df704-0531-46f8-83a7-17c2e5d868f9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:51.718331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-45167f80-b458-4391-b73e-a40f72d1f32b req-b02df704-0531-46f8-83a7-17c2e5d868f9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:51.755427 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-45167f80-b458-4391-b73e-a40f72d1f32b req-b02df704-0531-46f8-83a7-17c2e5d868f9 service nova] Creating event network-changed:94991b0a-9173-43b7-afe8-7a5e6b1a961e for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:17:51.756248 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-45167f80-b458-4391-b73e-a40f72d1f32b req-b02df704-0531-46f8-83a7-17c2e5d868f9 service nova] Creating event network-changed:70c52961-0644-4b44-9202-3493a2dafa42 for instance da1e35fe-99b6-426a-9c00-890423632b69 on n-h2-833090-9 Jul 26 14:17:51.772528 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-45167f80-b458-4391-b73e-a40f72d1f32b req-b02df704-0531-46f8-83a7-17c2e5d868f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099747 Jul 26 14:17:51.773515 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1499/2831] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:17:51.782559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ac51e3a-5747-4d3f-994e-0c140c03fe45 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] Calling method '.version_select at 0x7f8799370b80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:51.815866 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ac51e3a-5747-4d3f-994e-0c140c03fe45 tempest-KeyPairsV22TestJSON-1803411590 tempest-KeyPairsV22TestJSON-1803411590-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-172977096" status: 204 len: 0 microversion: 2.2 time: 0.040225 Jul 26 14:17:51.816761 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1500/2832] 10.222.0.70 () {60 vars in 1258 bytes} [Tue Jul 26 14:17:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-172977096 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:51.824245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64a01292-a49b-4c11-b6ee-1ca69ce985f5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:51.825075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-64a01292-a49b-4c11-b6ee-1ca69ce985f5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:51.833062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64a01292-a49b-4c11-b6ee-1ca69ce985f5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:51.834301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64a01292-a49b-4c11-b6ee-1ca69ce985f5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:51.835425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64a01292-a49b-4c11-b6ee-1ca69ce985f5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:51.836118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64a01292-a49b-4c11-b6ee-1ca69ce985f5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:52.404467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Updating instance_info_cache with network_info: [{"id": "70c52961-0644-4b44-9202-3493a2dafa42", "address": "fa:16:3e:af:89:58", "network": {"id": "5269779e-9361-4476-8afc-7e1c2e18c835", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-724023630-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b9afeb78afff4a448db4261f7333ce3c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap70c52961-06", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:17:52.420111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Releasing lock "refresh_cache-da1e35fe-99b6-426a-9c00-890423632b69" {{(pid=119478) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:17:52.421380 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-39eb3859-b5ef-41d9-b1b5-c83a5d5caf18 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "POST /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69/action" status: 202 len: 0 microversion: 2.1 time: 6.651983 Jul 26 14:17:52.428451 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1333/2833] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:17:45 2022] POST /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69/action => generated 0 bytes in 6659 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 26 14:17:52.443251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4786bfe6-99a3-4274-a509-a08269101575 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '.version_select at 0x7f8799251430>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:52.708975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-64a01292-a49b-4c11-b6ee-1ca69ce985f5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:52.724588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-64a01292-a49b-4c11-b6ee-1ca69ce985f5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:52.729222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-64a01292-a49b-4c11-b6ee-1ca69ce985f5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:52.735170 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-64a01292-a49b-4c11-b6ee-1ca69ce985f5 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.916733 Jul 26 14:17:52.736157 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1501/2834] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:51 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:52.744663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d87873c0-e661-4a71-9725-1590ab71f89b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:52.745306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d87873c0-e661-4a71-9725-1590ab71f89b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:52.760589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87873c0-e661-4a71-9725-1590ab71f89b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:52.761058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87873c0-e661-4a71-9725-1590ab71f89b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:52.761867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87873c0-e661-4a71-9725-1590ab71f89b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:52.762595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87873c0-e661-4a71-9725-1590ab71f89b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:53.159078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d87873c0-e661-4a71-9725-1590ab71f89b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:53.181574 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d87873c0-e661-4a71-9725-1590ab71f89b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1296 microversion: 2.1 time: 0.444007 Jul 26 14:17:53.182178 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1502/2835] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:52 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1296 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:53.771857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3d5b6e5d-654d-4e57-9287-f390fdce8a81 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:53.772678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3d5b6e5d-654d-4e57-9287-f390fdce8a81 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:53.785672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d5b6e5d-654d-4e57-9287-f390fdce8a81 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:53.786397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d5b6e5d-654d-4e57-9287-f390fdce8a81 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:53.797889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d5b6e5d-654d-4e57-9287-f390fdce8a81 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:53.799313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d5b6e5d-654d-4e57-9287-f390fdce8a81 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:54.641979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3d5b6e5d-654d-4e57-9287-f390fdce8a81 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:54.705413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3d5b6e5d-654d-4e57-9287-f390fdce8a81 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:54.714937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3d5b6e5d-654d-4e57-9287-f390fdce8a81 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:54.719614 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3d5b6e5d-654d-4e57-9287-f390fdce8a81 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.959283 Jul 26 14:17:54.724485 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1503/2836] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:53 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:54.743013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aff942c4-cb75-4581-911d-c6b5e99a165c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:54.747773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aff942c4-cb75-4581-911d-c6b5e99a165c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:54.761638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aff942c4-cb75-4581-911d-c6b5e99a165c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:54.763030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aff942c4-cb75-4581-911d-c6b5e99a165c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:54.765576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aff942c4-cb75-4581-911d-c6b5e99a165c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:54.766282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aff942c4-cb75-4581-911d-c6b5e99a165c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:55.845556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aff942c4-cb75-4581-911d-c6b5e99a165c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:55.861149 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aff942c4-cb75-4581-911d-c6b5e99a165c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1363 microversion: 2.1 time: 1.126228 Jul 26 14:17:55.862352 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1504/2837] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:54 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1363 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:55.887840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0ac36d32-27e7-4759-bd20-55a6313d1bc3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:55.890293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0ac36d32-27e7-4759-bd20-55a6313d1bc3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:55.910402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ac36d32-27e7-4759-bd20-55a6313d1bc3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:55.913400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ac36d32-27e7-4759-bd20-55a6313d1bc3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:55.914450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ac36d32-27e7-4759-bd20-55a6313d1bc3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:55.915150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ac36d32-27e7-4759-bd20-55a6313d1bc3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:56.658978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:56.941141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:17:57.038731 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4786bfe6-99a3-4274-a509-a08269101575 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/0b1a28ea-09ca-47c5-8478-4ddc86ca45c2" status: 202 len: 0 microversion: 2.1 time: 4.607672 Jul 26 14:17:57.040622 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1334/2838] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:17:52 2022] DELETE /compute/v2.1/os-floating-ips/0b1a28ea-09ca-47c5-8478-4ddc86ca45c2 => generated 0 bytes in 4611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:17:57.051857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d313441e-1e51-4f17-af1a-9a4c9501530d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:57.058935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d313441e-1e51-4f17-af1a-9a4c9501530d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:57.097033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d313441e-1e51-4f17-af1a-9a4c9501530d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:57.100462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d313441e-1e51-4f17-af1a-9a4c9501530d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:57.102006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d313441e-1e51-4f17-af1a-9a4c9501530d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:57.102806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d313441e-1e51-4f17-af1a-9a4c9501530d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:57.259697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ac36d32-27e7-4759-bd20-55a6313d1bc3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:57.276066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ac36d32-27e7-4759-bd20-55a6313d1bc3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:57.284951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ac36d32-27e7-4759-bd20-55a6313d1bc3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:57.286869 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0ac36d32-27e7-4759-bd20-55a6313d1bc3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 1.422603 Jul 26 14:17:57.287465 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1505/2839] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:55 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:57.305595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-280890a1-349b-45d7-bc53-be46235f7fb4 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '.version_select at 0x7f8799272700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:57.874104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d313441e-1e51-4f17-af1a-9a4c9501530d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:57.896563 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d313441e-1e51-4f17-af1a-9a4c9501530d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1363 microversion: 2.1 time: 0.853723 Jul 26 14:17:57.897928 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1335/2840] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:57 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1363 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:58.317044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1743700a-2a51-453b-963f-5f40790366d3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:58.318664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1743700a-2a51-453b-963f-5f40790366d3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:58.337460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1743700a-2a51-453b-963f-5f40790366d3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:58.338872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1743700a-2a51-453b-963f-5f40790366d3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:58.343257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1743700a-2a51-453b-963f-5f40790366d3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:58.344180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1743700a-2a51-453b-963f-5f40790366d3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:58.758853 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-280890a1-349b-45d7-bc53-be46235f7fb4 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/0eaa6452-f2d3-4882-91a4-917e4588f9fe" status: 202 len: 0 microversion: 2.1 time: 1.470110 Jul 26 14:17:58.763566 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1506/2841] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:17:57 2022] DELETE /compute/v2.1/os-security-groups/0eaa6452-f2d3-4882-91a4-917e4588f9fe => generated 0 bytes in 1475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:17:58.784245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a7f995d-fccc-42aa-bd8e-cc17ab3d7216 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:58.785018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1a7f995d-fccc-42aa-bd8e-cc17ab3d7216 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:58.795573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a7f995d-fccc-42aa-bd8e-cc17ab3d7216 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:58.796408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a7f995d-fccc-42aa-bd8e-cc17ab3d7216 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:58.797973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a7f995d-fccc-42aa-bd8e-cc17ab3d7216 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:58.798820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a7f995d-fccc-42aa-bd8e-cc17ab3d7216 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:58.833773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1a7f995d-fccc-42aa-bd8e-cc17ab3d7216 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:17:58.967411 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1a7f995d-fccc-42aa-bd8e-cc17ab3d7216 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "DELETE /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 204 len: 0 microversion: 2.1 time: 0.197958 Jul 26 14:17:58.968782 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1507/2842] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:17:58 2022] DELETE /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:17:58.976083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d05b9f1b-a370-4eb8-bcb0-a3a156ea7ea5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:58.977133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d05b9f1b-a370-4eb8-bcb0-a3a156ea7ea5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:58.984369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d05b9f1b-a370-4eb8-bcb0-a3a156ea7ea5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:58.985134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d05b9f1b-a370-4eb8-bcb0-a3a156ea7ea5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:58.986259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d05b9f1b-a370-4eb8-bcb0-a3a156ea7ea5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:58.986928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d05b9f1b-a370-4eb8-bcb0-a3a156ea7ea5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:59.081791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1743700a-2a51-453b-963f-5f40790366d3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:59.094518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1743700a-2a51-453b-963f-5f40790366d3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:59.096942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1743700a-2a51-453b-963f-5f40790366d3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:59.098916 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1743700a-2a51-453b-963f-5f40790366d3 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.787230 Jul 26 14:17:59.120573 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1336/2843] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:17:58 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:17:59.126709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c84701b-b90f-4041-908d-10027db6d3de tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:17:59.127490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c84701b-b90f-4041-908d-10027db6d3de tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:17:59.148765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c84701b-b90f-4041-908d-10027db6d3de tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:59.149621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c84701b-b90f-4041-908d-10027db6d3de tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:59.150947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c84701b-b90f-4041-908d-10027db6d3de tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:59.151143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c84701b-b90f-4041-908d-10027db6d3de tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:59.774357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d05b9f1b-a370-4eb8-bcb0-a3a156ea7ea5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:17:59.789333 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d05b9f1b-a370-4eb8-bcb0-a3a156ea7ea5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1363 microversion: 2.1 time: 0.818835 Jul 26 14:17:59.790288 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1508/2844] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:58 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1363 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:17:59.795045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-37df82d0-3844-414a-9784-a14c356243ec req-5623a60f-ca4a-4231-a963-7d1b060af91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b34e8fe-9a39-4c51-80fe-5f03e674baba", "tag": "c858bc4b-8fd2-4f32-a3d5-177e57a448dd"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:17:59.820568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-37df82d0-3844-414a-9784-a14c356243ec req-5623a60f-ca4a-4231-a963-7d1b060af91f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:17:59.821300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-37df82d0-3844-414a-9784-a14c356243ec req-5623a60f-ca4a-4231-a963-7d1b060af91f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:17:59.835496 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-37df82d0-3844-414a-9784-a14c356243ec req-5623a60f-ca4a-4231-a963-7d1b060af91f service nova] Creating event network-changed:c858bc4b-8fd2-4f32-a3d5-177e57a448dd for instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba on n-h1-833090-9 Jul 26 14:17:59.841504 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-37df82d0-3844-414a-9784-a14c356243ec req-5623a60f-ca4a-4231-a963-7d1b060af91f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049890 Jul 26 14:17:59.842671 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1509/2845] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:00.126058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-773628ae-b19f-4fbb-b61b-d781133a5315 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:00.127562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-773628ae-b19f-4fbb-b61b-d781133a5315 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:00.159307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-773628ae-b19f-4fbb-b61b-d781133a5315 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:00.159783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-773628ae-b19f-4fbb-b61b-d781133a5315 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:00.160617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-773628ae-b19f-4fbb-b61b-d781133a5315 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:00.161111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-773628ae-b19f-4fbb-b61b-d781133a5315 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:00.171988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c84701b-b90f-4041-908d-10027db6d3de tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:00.186290 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c84701b-b90f-4041-908d-10027db6d3de tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1509 microversion: 2.1 time: 1.063572 Jul 26 14:18:00.187316 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1337/2846] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:17:59 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1509 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:00.340626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1911000060", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "07889a08-85b2-40b9-923c-1a167cfebc11"}], "security_groups": [{"name": "tempest-securitygroup--1369282020"}], "key_name": "tempest-keypair-875563219", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:00.896317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=46 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:01.269517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] validate_networks() for [('07889a08-85b2-40b9-923c-1a167cfebc11', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:18:01.387578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-773628ae-b19f-4fbb-b61b-d781133a5315 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:01.408136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-773628ae-b19f-4fbb-b61b-d781133a5315 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:01.411555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-773628ae-b19f-4fbb-b61b-d781133a5315 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:01.413087 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-773628ae-b19f-4fbb-b61b-d781133a5315 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 1.292080 Jul 26 14:18:01.414353 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1510/2847] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:00 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:01.420429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8853097a-e9ad-4408-b7d0-1a819e9d59a9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:01.421315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8853097a-e9ad-4408-b7d0-1a819e9d59a9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:01.440630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8853097a-e9ad-4408-b7d0-1a819e9d59a9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:01.441430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8853097a-e9ad-4408-b7d0-1a819e9d59a9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:01.444542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8853097a-e9ad-4408-b7d0-1a819e9d59a9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:01.446286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8853097a-e9ad-4408-b7d0-1a819e9d59a9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:02.173755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8853097a-e9ad-4408-b7d0-1a819e9d59a9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:02.185867 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8853097a-e9ad-4408-b7d0-1a819e9d59a9 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1363 microversion: 2.1 time: 0.769345 Jul 26 14:18:02.187873 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1511/2848] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:01 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1363 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:02.206678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8dd32f17-a716-440e-b3d8-49250b653d1c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:02.209234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8dd32f17-a716-440e-b3d8-49250b653d1c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:02.227624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8dd32f17-a716-440e-b3d8-49250b653d1c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:02.229342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8dd32f17-a716-440e-b3d8-49250b653d1c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:02.230203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8dd32f17-a716-440e-b3d8-49250b653d1c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:02.230721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8dd32f17-a716-440e-b3d8-49250b653d1c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:03.622779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8dd32f17-a716-440e-b3d8-49250b653d1c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:03.642502 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8dd32f17-a716-440e-b3d8-49250b653d1c tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1509 microversion: 2.1 time: 1.452160 Jul 26 14:18:03.655978 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1512/2849] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:02 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1509 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:03.655978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cfdd22b3-5ec8-4222-b027-1a8c954aaf21 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:03.655978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cfdd22b3-5ec8-4222-b027-1a8c954aaf21 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:03.679902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfdd22b3-5ec8-4222-b027-1a8c954aaf21 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:03.680406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfdd22b3-5ec8-4222-b027-1a8c954aaf21 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:03.681221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfdd22b3-5ec8-4222-b027-1a8c954aaf21 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:03.682189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfdd22b3-5ec8-4222-b027-1a8c954aaf21 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:04.627787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:18:04.628389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:18:04.629649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:18:04.630273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:18:04.630868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:18:04.648350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:04.648828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:04.649780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:04.650279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:04.734653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Getting quotas for project 1976cab4a83747a68cadf5b4dc2dbef0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:18:04.761378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Getting quotas for user e35f47eb9e094bdc8d08ea4cf2970d8c and project 1976cab4a83747a68cadf5b4dc2dbef0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:18:04.803265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:18:04.815347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:18:04.905360 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-76315e6e-bfeb-42e5-bac0-5b5c0a66d1ad tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.569395 Jul 26 14:18:04.909875 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1338/2850] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:18:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 4573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:18:04.928673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fe8292bd-66b3-4a1c-9b30-32c5799f3613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:04.929234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fe8292bd-66b3-4a1c-9b30-32c5799f3613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:04.949770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe8292bd-66b3-4a1c-9b30-32c5799f3613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:04.950247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe8292bd-66b3-4a1c-9b30-32c5799f3613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:04.951050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe8292bd-66b3-4a1c-9b30-32c5799f3613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:04.963330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe8292bd-66b3-4a1c-9b30-32c5799f3613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:05.748584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cfdd22b3-5ec8-4222-b027-1a8c954aaf21 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:05.772443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cfdd22b3-5ec8-4222-b027-1a8c954aaf21 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:05.778947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cfdd22b3-5ec8-4222-b027-1a8c954aaf21 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:05.782777 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cfdd22b3-5ec8-4222-b027-1a8c954aaf21 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 2.134667 Jul 26 14:18:05.783678 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1513/2851] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:03 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:05.812825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-472bd356-05a7-4f79-abda-a7e67ae87b72 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:05.813999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-472bd356-05a7-4f79-abda-a7e67ae87b72 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:05.823591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-472bd356-05a7-4f79-abda-a7e67ae87b72 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:05.824362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-472bd356-05a7-4f79-abda-a7e67ae87b72 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:05.826254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-472bd356-05a7-4f79-abda-a7e67ae87b72 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:05.826942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-472bd356-05a7-4f79-abda-a7e67ae87b72 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:06.390210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-472bd356-05a7-4f79-abda-a7e67ae87b72 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd80cfcc0fbb94f60b2e8648e2357b00b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9afeb78afff4a448db4261f7333ce3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:06.400116 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-472bd356-05a7-4f79-abda-a7e67ae87b72 tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 200 len: 1467 microversion: 2.1 time: 0.604430 Jul 26 14:18:06.401409 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1514/2852] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:05 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 1467 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:06.406694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4046f69b-6b0d-4aa0-83ad-f0e28f1bffd0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:06.409626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4046f69b-6b0d-4aa0-83ad-f0e28f1bffd0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:06.436721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4046f69b-6b0d-4aa0-83ad-f0e28f1bffd0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:06.438044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4046f69b-6b0d-4aa0-83ad-f0e28f1bffd0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:06.439401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4046f69b-6b0d-4aa0-83ad-f0e28f1bffd0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:06.440095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4046f69b-6b0d-4aa0-83ad-f0e28f1bffd0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:06.535136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fe8292bd-66b3-4a1c-9b30-32c5799f3613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:06.552950 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fe8292bd-66b3-4a1c-9b30-32c5799f3613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1363 microversion: 2.1 time: 1.641694 Jul 26 14:18:06.571607 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1339/2853] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:04 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1363 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:06.578752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c7a8529a-1787-44dc-9532-8c67d0dea86b req-05b982b4-89f7-4ba6-8c4b-aa128efc35d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da1e35fe-99b6-426a-9c00-890423632b69", "name": "network-vif-deleted", "tag": "70c52961-0644-4b44-9202-3493a2dafa42"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:06.605306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c7a8529a-1787-44dc-9532-8c67d0dea86b req-05b982b4-89f7-4ba6-8c4b-aa128efc35d1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:06.605777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c7a8529a-1787-44dc-9532-8c67d0dea86b req-05b982b4-89f7-4ba6-8c4b-aa128efc35d1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:06.622599 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c7a8529a-1787-44dc-9532-8c67d0dea86b req-05b982b4-89f7-4ba6-8c4b-aa128efc35d1 service nova] Creating event network-vif-deleted:70c52961-0644-4b44-9202-3493a2dafa42 for instance da1e35fe-99b6-426a-9c00-890423632b69 on n-h2-833090-9 Jul 26 14:18:06.629372 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c7a8529a-1787-44dc-9532-8c67d0dea86b req-05b982b4-89f7-4ba6-8c4b-aa128efc35d1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055149 Jul 26 14:18:06.632048 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1340/2854] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:06.697767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4046f69b-6b0d-4aa0-83ad-f0e28f1bffd0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:06.712895 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4046f69b-6b0d-4aa0-83ad-f0e28f1bffd0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1230 microversion: 2.1 time: 0.310043 Jul 26 14:18:06.713501 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1515/2855] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:06 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1230 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:06.736691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d09b8e93-0ff8-4c99-9181-0bf40613dbb5 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Action: 'create', calling method: .version_select at 0x7f879934b940>, body: {"keypair": {"name": "tempest-keypair-1542889772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+njmsvRB+JdHn4nGrXv1WNMSAFbltD8FK82uMF5PJCgkuMGypUCXzA6ce8wr6gRdxchT/lpEaT9baOKnzW0cAeHNVLy3dj68MjcvRdhCxpQfPwn4l9KAp/vxAV8h6k2w=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:06.758709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-d09b8e93-0ff8-4c99-9181-0bf40613dbb5 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Getting quotas for project b2c11617314349c1adeebc55c8c1a6ba. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:18:06.765753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-d09b8e93-0ff8-4c99-9181-0bf40613dbb5 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Getting quotas for user 9f581ec33ecc4fad95a02efcc51594ac and project b2c11617314349c1adeebc55c8c1a6ba. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:18:06.799735 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d09b8e93-0ff8-4c99-9181-0bf40613dbb5 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164527 Jul 26 14:18:06.800905 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1341/2856] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:18:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:06.810905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27d9bf49-4621-4354-ad68-f4b9d674c95c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:06.817579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27d9bf49-4621-4354-ad68-f4b9d674c95c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:06.832310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27d9bf49-4621-4354-ad68-f4b9d674c95c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:06.833723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27d9bf49-4621-4354-ad68-f4b9d674c95c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:06.834836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27d9bf49-4621-4354-ad68-f4b9d674c95c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:06.836120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27d9bf49-4621-4354-ad68-f4b9d674c95c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:06.870100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:07.425383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-30d5e18f-3d40-4687-87ff-b60e84f0f47f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:07.427491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-30d5e18f-3d40-4687-87ff-b60e84f0f47f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] [instance: da1e35fe-99b6-426a-9c00-890423632b69] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:07.446829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30d5e18f-3d40-4687-87ff-b60e84f0f47f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:07.453511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30d5e18f-3d40-4687-87ff-b60e84f0f47f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:07.455261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30d5e18f-3d40-4687-87ff-b60e84f0f47f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:07.455873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30d5e18f-3d40-4687-87ff-b60e84f0f47f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:07.477907 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-30d5e18f-3d40-4687-87ff-b60e84f0f47f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] HTTP exception thrown: Instance da1e35fe-99b6-426a-9c00-890423632b69 could not be found. Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-30d5e18f-3d40-4687-87ff-b60e84f0f47f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Request method failure captured: Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 HTTP/1.1 Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_cgOGihVwS5eQszCqZebhruCJsXH7rFJIUSkbkEBIUPLpzhZ5CXdcILVqRtko106M-BbISlsXzXQctKR2AJqeW_IyIGJGdfcIUmy0cIyCwFpAQgH0wI-ohIbDI0ZG43eXGHWYxfm9iasZ_ZcEZfgfbW9tevXhI1_D1BgXtxtTXnE6Q Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: b9afeb78afff4a448db4261f7333ce3c Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-109025546 Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b9afeb78afff4a448db4261f7333ce3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b9afeb78afff4a448db4261f7333ce3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b9afeb78afff4a448db4261f7333ce3c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b9afeb78afff4a448db4261f7333ce3c"}]}] Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-109025546 Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: b9afeb78afff4a448db4261f7333ce3c Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-109025546 Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerRescueTestJSONUnderV235-109025546-project Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: d80cfcc0fbb94f60b2e8648e2357b00b Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-109025546-project Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance da1e35fe-99b6-426a-9c00-890423632b69 could not be found. Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'da1e35fe-99b6-426a-9c00-890423632b69'} Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da1e35fe-99b6-426a-9c00-890423632b69 could not be found. Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da1e35fe-99b6-426a-9c00-890423632b69 could not be found. Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:07.479601 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:18:07.484849 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:07.484849 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:18:07.484849 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:18:07.484849 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:18:07.484849 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:18:07.484849 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:18:07.484849 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da1e35fe-99b6-426a-9c00-890423632b69 could not be found. Jul 26 14:18:07.484849 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:07.493981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-30d5e18f-3d40-4687-87ff-b60e84f0f47f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] Returning 404 to user: Instance da1e35fe-99b6-426a-9c00-890423632b69 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:18:07.495152 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-30d5e18f-3d40-4687-87ff-b60e84f0f47f tempest-ServerRescueTestJSONUnderV235-109025546 tempest-ServerRescueTestJSONUnderV235-109025546-project] 10.222.0.70 "GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69" status: 404 len: 111 microversion: 2.1 time: 0.076581 Jul 26 14:18:07.495969 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1342/2857] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:07 2022] GET /compute/v2.1/servers/da1e35fe-99b6-426a-9c00-890423632b69 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:18:07.577216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0417be80-e75d-4e51-8e63-a70b703de13d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:07.577920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0417be80-e75d-4e51-8e63-a70b703de13d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:07.589450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0417be80-e75d-4e51-8e63-a70b703de13d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:07.590111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0417be80-e75d-4e51-8e63-a70b703de13d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:07.590967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0417be80-e75d-4e51-8e63-a70b703de13d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:07.597838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0417be80-e75d-4e51-8e63-a70b703de13d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:08.667104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27d9bf49-4621-4354-ad68-f4b9d674c95c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:08.690682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27d9bf49-4621-4354-ad68-f4b9d674c95c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:08.698146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0417be80-e75d-4e51-8e63-a70b703de13d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:08.700415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27d9bf49-4621-4354-ad68-f4b9d674c95c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:08.702597 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27d9bf49-4621-4354-ad68-f4b9d674c95c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 1.896014 Jul 26 14:18:08.720027 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1516/2858] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:06 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:18:08.720323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6856bb44-92ca-4ff8-8700-7ccce37930dd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:08.721471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6856bb44-92ca-4ff8-8700-7ccce37930dd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:08.735583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6856bb44-92ca-4ff8-8700-7ccce37930dd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:08.740391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6856bb44-92ca-4ff8-8700-7ccce37930dd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:08.743181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6856bb44-92ca-4ff8-8700-7ccce37930dd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:08.744315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6856bb44-92ca-4ff8-8700-7ccce37930dd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:08.753598 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0417be80-e75d-4e51-8e63-a70b703de13d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1363 microversion: 2.1 time: 1.180391 Jul 26 14:18:08.757148 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1343/2859] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:07 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1363 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:18:08.771278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ee3004e9-e82b-423e-8e39-164043c49dbd req-da1e5a99-a52b-450c-8915-ce93a92a9891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b34e8fe-9a39-4c51-80fe-5f03e674baba", "name": "network-vif-plugged", "status": "completed", "tag": "c858bc4b-8fd2-4f32-a3d5-177e57a448dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:08.793295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ee3004e9-e82b-423e-8e39-164043c49dbd req-da1e5a99-a52b-450c-8915-ce93a92a9891 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:08.794203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ee3004e9-e82b-423e-8e39-164043c49dbd req-da1e5a99-a52b-450c-8915-ce93a92a9891 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:08.823159 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ee3004e9-e82b-423e-8e39-164043c49dbd req-da1e5a99-a52b-450c-8915-ce93a92a9891 service nova] Creating event network-vif-plugged:c858bc4b-8fd2-4f32-a3d5-177e57a448dd for instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba on n-h1-833090-9 Jul 26 14:18:08.849672 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ee3004e9-e82b-423e-8e39-164043c49dbd req-da1e5a99-a52b-450c-8915-ce93a92a9891 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090425 Jul 26 14:18:08.851359 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1344/2860] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:09.025508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6856bb44-92ca-4ff8-8700-7ccce37930dd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:09.047715 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6856bb44-92ca-4ff8-8700-7ccce37930dd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1292 microversion: 2.1 time: 0.334529 Jul 26 14:18:09.048938 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1517/2861] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:08 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1292 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:09.747271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-153b1447-696e-4267-8ed4-71b6c975bb68 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:09.749969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-153b1447-696e-4267-8ed4-71b6c975bb68 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:09.760128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-153b1447-696e-4267-8ed4-71b6c975bb68 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:09.761015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-153b1447-696e-4267-8ed4-71b6c975bb68 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:09.762773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-153b1447-696e-4267-8ed4-71b6c975bb68 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:09.763462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-153b1447-696e-4267-8ed4-71b6c975bb68 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:09.780788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-06cfd552-a7b5-48d1-b28e-9b9b14666cee tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:09.782516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-06cfd552-a7b5-48d1-b28e-9b9b14666cee tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:09.806211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-06cfd552-a7b5-48d1-b28e-9b9b14666cee tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:09.810409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-06cfd552-a7b5-48d1-b28e-9b9b14666cee tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:09.811536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-06cfd552-a7b5-48d1-b28e-9b9b14666cee tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:09.816297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-06cfd552-a7b5-48d1-b28e-9b9b14666cee tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:11.437450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-06cfd552-a7b5-48d1-b28e-9b9b14666cee tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:11.454017 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-06cfd552-a7b5-48d1-b28e-9b9b14666cee tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1363 microversion: 2.1 time: 1.679144 Jul 26 14:18:11.459233 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1518/2862] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:09 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1363 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:18:11.470737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-709f6f3f-ec05-4da0-824b-8633168b2b9b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:11.476616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-709f6f3f-ec05-4da0-824b-8633168b2b9b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:11.487777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-709f6f3f-ec05-4da0-824b-8633168b2b9b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:11.488141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-709f6f3f-ec05-4da0-824b-8633168b2b9b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:11.490199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-709f6f3f-ec05-4da0-824b-8633168b2b9b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:11.491135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-709f6f3f-ec05-4da0-824b-8633168b2b9b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:11.730049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-709f6f3f-ec05-4da0-824b-8633168b2b9b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:11.741932 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-709f6f3f-ec05-4da0-824b-8633168b2b9b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1292 microversion: 2.1 time: 0.280660 Jul 26 14:18:11.746895 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1519/2863] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:11 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1292 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:11.904491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-153b1447-696e-4267-8ed4-71b6c975bb68 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:11.907741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=61,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:11.925223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-153b1447-696e-4267-8ed4-71b6c975bb68 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:11.928049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-153b1447-696e-4267-8ed4-71b6c975bb68 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:11.933061 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-153b1447-696e-4267-8ed4-71b6c975bb68 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 2.194340 Jul 26 14:18:11.939248 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1345/2864] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:09 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:12.189449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1526058155", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b4dbfe04-aab0-4b10-b851-51fca5083086"}], "security_groups": [{"name": "tempest-securitygroup--1991624287"}], "key_name": "tempest-keypair-1542889772", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:12.482003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-30e4e475-1086-4d93-80e5-19023446b2ea tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:12.483233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-30e4e475-1086-4d93-80e5-19023446b2ea tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:12.516175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30e4e475-1086-4d93-80e5-19023446b2ea tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:12.516853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30e4e475-1086-4d93-80e5-19023446b2ea tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:12.517992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30e4e475-1086-4d93-80e5-19023446b2ea tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:12.518666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30e4e475-1086-4d93-80e5-19023446b2ea tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:12.540140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] validate_networks() for [('b4dbfe04-aab0-4b10-b851-51fca5083086', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:18:13.901310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-30e4e475-1086-4d93-80e5-19023446b2ea tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:13.912668 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-30e4e475-1086-4d93-80e5-19023446b2ea tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1548 microversion: 2.1 time: 1.436009 Jul 26 14:18:13.928801 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1346/2865] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:12 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1548 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:13.943711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0b7d134b-775f-4c49-837a-e992679cfaf0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:13.945135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0b7d134b-775f-4c49-837a-e992679cfaf0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:13.955595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b7d134b-775f-4c49-837a-e992679cfaf0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:13.956352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b7d134b-775f-4c49-837a-e992679cfaf0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:13.957517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b7d134b-775f-4c49-837a-e992679cfaf0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:13.958054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b7d134b-775f-4c49-837a-e992679cfaf0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:14.673944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0b7d134b-775f-4c49-837a-e992679cfaf0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:14.690336 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0b7d134b-775f-4c49-837a-e992679cfaf0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1360 microversion: 2.1 time: 0.759944 Jul 26 14:18:14.695630 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1347/2866] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:13 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1360 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:14.724063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aa9129cb-7f09-4903-8101-193f80cb582b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:14.725123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aa9129cb-7f09-4903-8101-193f80cb582b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:14.734612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:14.744039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa9129cb-7f09-4903-8101-193f80cb582b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:14.744796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa9129cb-7f09-4903-8101-193f80cb582b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:14.746274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa9129cb-7f09-4903-8101-193f80cb582b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:14.747587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa9129cb-7f09-4903-8101-193f80cb582b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:15.499685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Getting quotas for project b2c11617314349c1adeebc55c8c1a6ba. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:18:15.524378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Getting quotas for user 9f581ec33ecc4fad95a02efcc51594ac and project b2c11617314349c1adeebc55c8c1a6ba. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:18:15.569003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:18:15.569447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:18:15.569948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:18:15.570376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:18:15.570811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:18:15.595117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:15.595646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:15.596385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:15.596821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:15.652056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Getting quotas for project b2c11617314349c1adeebc55c8c1a6ba. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:18:15.670730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Getting quotas for user 9f581ec33ecc4fad95a02efcc51594ac and project b2c11617314349c1adeebc55c8c1a6ba. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:18:15.704116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:18:15.709819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:18:15.740405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aa9129cb-7f09-4903-8101-193f80cb582b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:15.769705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aa9129cb-7f09-4903-8101-193f80cb582b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:15.771969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aa9129cb-7f09-4903-8101-193f80cb582b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:15.773466 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aa9129cb-7f09-4903-8101-193f80cb582b tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 1.075044 Jul 26 14:18:15.776536 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1348/2867] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:14 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:15.794585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fd2dc23f-c3f6-4bb1-bba0-4115c864f5f7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:15.802270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fd2dc23f-c3f6-4bb1-bba0-4115c864f5f7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:15.827941 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-75277b4c-1de9-4d73-8c79-8ce5b17fa37b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.647883 Jul 26 14:18:15.828744 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1520/2868] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:18:12 2022] POST /compute/v2.1/servers => generated 407 bytes in 3650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:18:15.836631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd2dc23f-c3f6-4bb1-bba0-4115c864f5f7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:15.838213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd2dc23f-c3f6-4bb1-bba0-4115c864f5f7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:15.839180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd2dc23f-c3f6-4bb1-bba0-4115c864f5f7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:15.840660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd2dc23f-c3f6-4bb1-bba0-4115c864f5f7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:16.261070 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fd2dc23f-c3f6-4bb1-bba0-4115c864f5f7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.483171 Jul 26 14:18:16.261793 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1349/2869] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:18:15 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/os-interface => generated 284 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:16.267714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d70072f-50df-4fe9-9a89-9376c480978f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:16.268582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6d70072f-50df-4fe9-9a89-9376c480978f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:16.278343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d70072f-50df-4fe9-9a89-9376c480978f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:16.280563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d70072f-50df-4fe9-9a89-9376c480978f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:16.282056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d70072f-50df-4fe9-9a89-9376c480978f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:16.282795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d70072f-50df-4fe9-9a89-9376c480978f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:16.357917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e36a5bc3-48e1-4d2d-b332-1e3b518a4a8e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Action: 'create', calling method: .version_select at 0x7f879938f790>, body: {"keypair": {"name": "tempest-keypair-2061777975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6GCKznM1xKv3IhCArW4HnHHICbrxJ0fowVhAZoDuKqcwTQIhrVEcd4EFMiGnhIChUYSbskkdGoxu+5eEVpO9dgbPlfyE86DcAVUC78GXzgSJPHTRqHIkRmLVGboJd3g=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:16.469532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e36a5bc3-48e1-4d2d-b332-1e3b518a4a8e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Getting quotas for project eaa556625719414283409d2773814cf7. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:18:16.491189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e36a5bc3-48e1-4d2d-b332-1e3b518a4a8e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Getting quotas for user 8d9d1bc9d8e44404a6bf64e912fbe562 and project eaa556625719414283409d2773814cf7. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:18:16.581039 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e36a5bc3-48e1-4d2d-b332-1e3b518a4a8e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.751135 Jul 26 14:18:16.582813 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1521/2870] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Jul 26 14:18:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 754 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 14:18:16.595416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b42da4ec-76aa-4000-992b-2a3c3578aa94 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:16.603206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b42da4ec-76aa-4000-992b-2a3c3578aa94 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:16.620057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:16.778286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:16.849156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b42da4ec-76aa-4000-992b-2a3c3578aa94 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:16.875473 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b42da4ec-76aa-4000-992b-2a3c3578aa94 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1270 microversion: 2.1 time: 0.291195 Jul 26 14:18:16.882598 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1522/2871] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:16 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1270 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:16.888644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f8fc4d86-4a25-43d6-899e-9e0924fb4a1e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:16.902370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f8fc4d86-4a25-43d6-899e-9e0924fb4a1e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:16.915711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8fc4d86-4a25-43d6-899e-9e0924fb4a1e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:16.916530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8fc4d86-4a25-43d6-899e-9e0924fb4a1e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:16.917598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8fc4d86-4a25-43d6-899e-9e0924fb4a1e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:16.918273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8fc4d86-4a25-43d6-899e-9e0924fb4a1e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:17.783190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d70072f-50df-4fe9-9a89-9376c480978f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:17.803186 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6d70072f-50df-4fe9-9a89-9376c480978f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1360 microversion: 2.1 time: 1.538487 Jul 26 14:18:17.803811 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1350/2872] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:16 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1360 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:17.903021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-96f43845-cf79-4b34-9ffc-844d3d0fe77b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:17.904318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-96f43845-cf79-4b34-9ffc-844d3d0fe77b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:17.926089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96f43845-cf79-4b34-9ffc-844d3d0fe77b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:17.926841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96f43845-cf79-4b34-9ffc-844d3d0fe77b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:17.929099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96f43845-cf79-4b34-9ffc-844d3d0fe77b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:17.929937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96f43845-cf79-4b34-9ffc-844d3d0fe77b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:19.066132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-96f43845-cf79-4b34-9ffc-844d3d0fe77b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:19.085528 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-96f43845-cf79-4b34-9ffc-844d3d0fe77b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1330 microversion: 2.1 time: 1.182682 Jul 26 14:18:19.099782 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1351/2873] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:17 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1330 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:19.099782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-56697db9-8e4e-44f1-b876-83c1713ebbc7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:19.099782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-56697db9-8e4e-44f1-b876-83c1713ebbc7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:19.116474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-56697db9-8e4e-44f1-b876-83c1713ebbc7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:19.120505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-56697db9-8e4e-44f1-b876-83c1713ebbc7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:19.122322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-56697db9-8e4e-44f1-b876-83c1713ebbc7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:19.126482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-56697db9-8e4e-44f1-b876-83c1713ebbc7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:19.309558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f8fc4d86-4a25-43d6-899e-9e0924fb4a1e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:19.325226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f8fc4d86-4a25-43d6-899e-9e0924fb4a1e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:19.329993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f8fc4d86-4a25-43d6-899e-9e0924fb4a1e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:19.337246 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f8fc4d86-4a25-43d6-899e-9e0924fb4a1e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 2.452141 Jul 26 14:18:19.340863 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1523/2874] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:16 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:19.900520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-56697db9-8e4e-44f1-b876-83c1713ebbc7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:19.918577 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-56697db9-8e4e-44f1-b876-83c1713ebbc7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1360 microversion: 2.1 time: 0.829728 Jul 26 14:18:19.920411 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1352/2875] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:19 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1360 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:20.123460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5c8590cf-6537-49ee-94a4-c313f3a3c9bc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:20.124394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5c8590cf-6537-49ee-94a4-c313f3a3c9bc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:20.136460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c8590cf-6537-49ee-94a4-c313f3a3c9bc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:20.137596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c8590cf-6537-49ee-94a4-c313f3a3c9bc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:20.139471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c8590cf-6537-49ee-94a4-c313f3a3c9bc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:20.140423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c8590cf-6537-49ee-94a4-c313f3a3c9bc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:20.344300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5c8590cf-6537-49ee-94a4-c313f3a3c9bc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:20.357152 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5c8590cf-6537-49ee-94a4-c313f3a3c9bc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1328 microversion: 2.1 time: 0.245690 Jul 26 14:18:20.359500 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1524/2876] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:20 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1328 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:20.373460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-722da08a-69a5-4b41-9b97-a41fdc3aa0c2 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:20.400769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-722da08a-69a5-4b41-9b97-a41fdc3aa0c2 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:20.416434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-722da08a-69a5-4b41-9b97-a41fdc3aa0c2 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:20.417175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-722da08a-69a5-4b41-9b97-a41fdc3aa0c2 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:20.419280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-722da08a-69a5-4b41-9b97-a41fdc3aa0c2 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:20.420718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-722da08a-69a5-4b41-9b97-a41fdc3aa0c2 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:20.545958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-50310990-c1b3-4429-be54-fee8a9d6ad93 req-ffc6f874-5869-4b05-828c-92efbddfabbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a900e83e-11a0-4cd4-85c0-c09b6e4da5c7", "tag": "e7e7e1e8-b611-45a9-ab4b-a0bf0c504929"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:20.567253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-50310990-c1b3-4429-be54-fee8a9d6ad93 req-ffc6f874-5869-4b05-828c-92efbddfabbd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:20.568187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-50310990-c1b3-4429-be54-fee8a9d6ad93 req-ffc6f874-5869-4b05-828c-92efbddfabbd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:20.590354 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-50310990-c1b3-4429-be54-fee8a9d6ad93 req-ffc6f874-5869-4b05-828c-92efbddfabbd service nova] Creating event network-changed:e7e7e1e8-b611-45a9-ab4b-a0bf0c504929 for instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 on n-h1-833090-9 Jul 26 14:18:20.596301 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-50310990-c1b3-4429-be54-fee8a9d6ad93 req-ffc6f874-5869-4b05-828c-92efbddfabbd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062139 Jul 26 14:18:20.597623 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1525/2877] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:20.944418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-999f9a7f-9a7a-4b3d-9041-fd79b7c7e4a1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:20.945818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-999f9a7f-9a7a-4b3d-9041-fd79b7c7e4a1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:20.953079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-999f9a7f-9a7a-4b3d-9041-fd79b7c7e4a1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:20.953539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-999f9a7f-9a7a-4b3d-9041-fd79b7c7e4a1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:20.954333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-999f9a7f-9a7a-4b3d-9041-fd79b7c7e4a1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:20.955149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-999f9a7f-9a7a-4b3d-9041-fd79b7c7e4a1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:21.133616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-722da08a-69a5-4b41-9b97-a41fdc3aa0c2 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:21.144155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-722da08a-69a5-4b41-9b97-a41fdc3aa0c2 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:21.146172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-722da08a-69a5-4b41-9b97-a41fdc3aa0c2 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:21.147376 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-722da08a-69a5-4b41-9b97-a41fdc3aa0c2 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.783116 Jul 26 14:18:21.147941 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1353/2878] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:20 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:21.382142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22bcfe2c-5fbf-4639-910f-434a16d59032 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:21.382758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22bcfe2c-5fbf-4639-910f-434a16d59032 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:21.411616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22bcfe2c-5fbf-4639-910f-434a16d59032 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:21.412383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22bcfe2c-5fbf-4639-910f-434a16d59032 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:21.413334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22bcfe2c-5fbf-4639-910f-434a16d59032 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:21.413871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22bcfe2c-5fbf-4639-910f-434a16d59032 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:21.428969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-999f9a7f-9a7a-4b3d-9041-fd79b7c7e4a1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:21.448394 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-999f9a7f-9a7a-4b3d-9041-fd79b7c7e4a1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1360 microversion: 2.1 time: 0.510161 Jul 26 14:18:21.451917 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1526/2879] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:20 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1360 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:18:21.544240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22bcfe2c-5fbf-4639-910f-434a16d59032 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:21.555347 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22bcfe2c-5fbf-4639-910f-434a16d59032 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1328 microversion: 2.1 time: 0.177778 Jul 26 14:18:21.556542 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1354/2880] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:21 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:18:22.171943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fea601df-a8ac-47d4-a0e4-3f332a008603 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:22.172686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fea601df-a8ac-47d4-a0e4-3f332a008603 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:22.188494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea601df-a8ac-47d4-a0e4-3f332a008603 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:22.188965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea601df-a8ac-47d4-a0e4-3f332a008603 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:22.189779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea601df-a8ac-47d4-a0e4-3f332a008603 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:22.190516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea601df-a8ac-47d4-a0e4-3f332a008603 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:22.475845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-45b5efb6-aa36-4ad0-a2fd-c62a0f41afb6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:22.477150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-45b5efb6-aa36-4ad0-a2fd-c62a0f41afb6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:22.492251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45b5efb6-aa36-4ad0-a2fd-c62a0f41afb6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:22.499281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45b5efb6-aa36-4ad0-a2fd-c62a0f41afb6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:22.500358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45b5efb6-aa36-4ad0-a2fd-c62a0f41afb6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:22.502159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45b5efb6-aa36-4ad0-a2fd-c62a0f41afb6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:23.584255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-45b5efb6-aa36-4ad0-a2fd-c62a0f41afb6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:23.598552 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-45b5efb6-aa36-4ad0-a2fd-c62a0f41afb6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1360 microversion: 2.1 time: 1.126919 Jul 26 14:18:23.606893 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1355/2881] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:22 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1360 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:23.612251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-869ce696-7581-41ac-bc8b-11af797e1a3e tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:23.615762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-869ce696-7581-41ac-bc8b-11af797e1a3e tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:23.629395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-869ce696-7581-41ac-bc8b-11af797e1a3e tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:23.647839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-869ce696-7581-41ac-bc8b-11af797e1a3e tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:23.649144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-869ce696-7581-41ac-bc8b-11af797e1a3e tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:23.649763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-869ce696-7581-41ac-bc8b-11af797e1a3e tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:23.670181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fea601df-a8ac-47d4-a0e4-3f332a008603 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:23.685204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fea601df-a8ac-47d4-a0e4-3f332a008603 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:23.686756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fea601df-a8ac-47d4-a0e4-3f332a008603 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:23.701662 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fea601df-a8ac-47d4-a0e4-3f332a008603 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 1.520147 Jul 26 14:18:23.726039 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1527/2882] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:22 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:23.959591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3b4f3270-5a85-4634-bc64-5d018280567b tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f87993d6280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-416721786", "description": "tempest-description-1642956285"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:25.216090 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3b4f3270-5a85-4634-bc64-5d018280567b tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.488440 Jul 26 14:18:25.219238 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1528/2883] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:18:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:25.229197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1028182195", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04761f16-862f-4701-bf1c-36d698a99d99"}], "security_groups": [{"name": "tempest-securitygroup--1359197056"}], "key_name": "tempest-keypair-2061777975", "user_data": "}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:25.246235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-869ce696-7581-41ac-bc8b-11af797e1a3e tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:25.257715 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-869ce696-7581-41ac-bc8b-11af797e1a3e tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 1.649279 Jul 26 14:18:25.266906 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1356/2884] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:23 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:25.273314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-cba9f030-24fa-4067-a42b-fab7e2717d46 req-4b97aba4-b55d-48a3-b919-27f826b1e860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b34e8fe-9a39-4c51-80fe-5f03e674baba", "tag": "c858bc4b-8fd2-4f32-a3d5-177e57a448dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:25.315146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cba9f030-24fa-4067-a42b-fab7e2717d46 req-4b97aba4-b55d-48a3-b919-27f826b1e860 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:25.317716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cba9f030-24fa-4067-a42b-fab7e2717d46 req-4b97aba4-b55d-48a3-b919-27f826b1e860 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:25.369554 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-cba9f030-24fa-4067-a42b-fab7e2717d46 req-4b97aba4-b55d-48a3-b919-27f826b1e860 service nova] Creating event network-changed:c858bc4b-8fd2-4f32-a3d5-177e57a448dd for instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba on n-h1-833090-9 Jul 26 14:18:25.376658 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-cba9f030-24fa-4067-a42b-fab7e2717d46 req-4b97aba4-b55d-48a3-b919-27f826b1e860 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107765 Jul 26 14:18:25.377937 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1357/2885] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:25.389189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-075ff310-aa47-41c1-8135-243882983837 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:25.391793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-075ff310-aa47-41c1-8135-243882983837 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:25.403471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-075ff310-aa47-41c1-8135-243882983837 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:25.406008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-075ff310-aa47-41c1-8135-243882983837 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:25.407504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-075ff310-aa47-41c1-8135-243882983837 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:25.408819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-075ff310-aa47-41c1-8135-243882983837 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:25.623321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:26.556603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] validate_networks() for [('04761f16-862f-4701-bf1c-36d698a99d99', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:18:26.758543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-075ff310-aa47-41c1-8135-243882983837 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:26.767906 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-075ff310-aa47-41c1-8135-243882983837 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1360 microversion: 2.1 time: 1.387672 Jul 26 14:18:26.784590 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1358/2886] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:25 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1360 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:26.797066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1b4601fa-11e8-4ac7-aeef-89e77cd76440 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:26.801848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1b4601fa-11e8-4ac7-aeef-89e77cd76440 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:26.812821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:26.818246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b4601fa-11e8-4ac7-aeef-89e77cd76440 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:26.821458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b4601fa-11e8-4ac7-aeef-89e77cd76440 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:26.822477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b4601fa-11e8-4ac7-aeef-89e77cd76440 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:26.823510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b4601fa-11e8-4ac7-aeef-89e77cd76440 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:26.863687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=16 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:27.549106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1b4601fa-11e8-4ac7-aeef-89e77cd76440 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:27.591693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1b4601fa-11e8-4ac7-aeef-89e77cd76440 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:27.618700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1b4601fa-11e8-4ac7-aeef-89e77cd76440 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:27.620262 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1b4601fa-11e8-4ac7-aeef-89e77cd76440 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.833844 Jul 26 14:18:27.621042 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1359/2887] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:26 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:27.626753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0015a6b7-71eb-4908-a169-f7788a5b42d6 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f879936a310>, body: {"security_group_rule": {"parent_group_id": "dabc86e8-fea7-47ee-a1d2-1c2678d5e2fd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:29.442158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:18:29.444235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:18:29.444920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:18:29.445497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:18:29.450271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:18:29.464964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:29.465693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:29.466673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:29.467351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:29.491287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Getting quotas for project eaa556625719414283409d2773814cf7. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:18:29.499083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Getting quotas for user 8d9d1bc9d8e44404a6bf64e912fbe562 and project eaa556625719414283409d2773814cf7. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:18:29.520179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:18:29.523301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:18:29.621492 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e94d7aa9-bf56-411e-bc0f-50c69008f20e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.395709 Jul 26 14:18:29.632792 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1529/2888] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:18:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 4412 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:18:29.645862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eadb36bd-e0c8-4a6c-a801-632212c9c82c tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:29.649197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eadb36bd-e0c8-4a6c-a801-632212c9c82c tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:29.659538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eadb36bd-e0c8-4a6c-a801-632212c9c82c tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:29.662014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eadb36bd-e0c8-4a6c-a801-632212c9c82c tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:29.663060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eadb36bd-e0c8-4a6c-a801-632212c9c82c tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:29.663736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eadb36bd-e0c8-4a6c-a801-632212c9c82c tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:29.807289 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0015a6b7-71eb-4908-a169-f7788a5b42d6 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.184273 Jul 26 14:18:29.811050 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1360/2889] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:18:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:29.818506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-038ac322-12b3-4747-97f0-c5859169c9ed req-ae13f452-d14e-4700-88ef-759745ccef07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42c5141-d427-4b45-8d3f-facf56bfe668", "tag": "56cb7e7e-d518-4bee-8b79-70858a8691e3"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:29.846707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-038ac322-12b3-4747-97f0-c5859169c9ed req-ae13f452-d14e-4700-88ef-759745ccef07 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:29.848112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-038ac322-12b3-4747-97f0-c5859169c9ed req-ae13f452-d14e-4700-88ef-759745ccef07 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:29.872798 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-038ac322-12b3-4747-97f0-c5859169c9ed req-ae13f452-d14e-4700-88ef-759745ccef07 service nova] Creating event network-changed:56cb7e7e-d518-4bee-8b79-70858a8691e3 for instance e42c5141-d427-4b45-8d3f-facf56bfe668 on n-h2-833090-9 Jul 26 14:18:29.878986 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-038ac322-12b3-4747-97f0-c5859169c9ed req-ae13f452-d14e-4700-88ef-759745ccef07 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066029 Jul 26 14:18:29.880923 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1361/2890] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:29.888101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7b8168dd-357e-45ab-817d-e15e0c35eb73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:29.889206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7b8168dd-357e-45ab-817d-e15e0c35eb73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:29.898340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b8168dd-357e-45ab-817d-e15e0c35eb73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:29.899687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b8168dd-357e-45ab-817d-e15e0c35eb73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:29.901739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b8168dd-357e-45ab-817d-e15e0c35eb73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:29.902233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b8168dd-357e-45ab-817d-e15e0c35eb73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:30.447308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eadb36bd-e0c8-4a6c-a801-632212c9c82c tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:30.462916 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eadb36bd-e0c8-4a6c-a801-632212c9c82c tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 0.827540 Jul 26 14:18:30.464887 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1530/2891] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:29 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:30.470451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e47fba85-fad2-4f0f-851c-275a34986a2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:30.471401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e47fba85-fad2-4f0f-851c-275a34986a2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:30.478729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e47fba85-fad2-4f0f-851c-275a34986a2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:30.479715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e47fba85-fad2-4f0f-851c-275a34986a2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:30.481371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e47fba85-fad2-4f0f-851c-275a34986a2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:30.482074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e47fba85-fad2-4f0f-851c-275a34986a2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:30.492857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7b8168dd-357e-45ab-817d-e15e0c35eb73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:30.524455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7b8168dd-357e-45ab-817d-e15e0c35eb73 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1360 microversion: 2.1 time: 0.641786 Jul 26 14:18:30.525162 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1362/2892] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:29 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1360 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:30.616129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-840618603", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "2dc9e1a8-4a4f-459a-8038-83a80381fb0e"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:30.679277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] validate_networks() for [('2dc9e1a8-4a4f-459a-8038-83a80381fb0e', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:18:31.242011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e47fba85-fad2-4f0f-851c-275a34986a2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:31.257289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e47fba85-fad2-4f0f-851c-275a34986a2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:31.259268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e47fba85-fad2-4f0f-851c-275a34986a2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:31.265340 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e47fba85-fad2-4f0f-851c-275a34986a2d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.798089 Jul 26 14:18:31.266518 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1531/2893] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:30 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:31.289331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df156b9c-3331-484e-be8c-241936fccdcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:31.291284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df156b9c-3331-484e-be8c-241936fccdcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:31.302496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df156b9c-3331-484e-be8c-241936fccdcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:31.304075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df156b9c-3331-484e-be8c-241936fccdcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:31.305900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df156b9c-3331-484e-be8c-241936fccdcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:31.306664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df156b9c-3331-484e-be8c-241936fccdcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:31.531074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df156b9c-3331-484e-be8c-241936fccdcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:31.567156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df156b9c-3331-484e-be8c-241936fccdcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:31.575379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df156b9c-3331-484e-be8c-241936fccdcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:31.580315 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df156b9c-3331-484e-be8c-241936fccdcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1342 microversion: 2.20 time: 0.307732 Jul 26 14:18:31.582461 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1532/2894] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:31 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1342 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:31.592837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c364f78d-eb1e-4b7e-a75e-f9d6426b4558 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f87993da3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1646815124", "description": "tempest-description-1671703623"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:32.093831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:18:32.094413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:18:32.094784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:18:32.095369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:18:32.096010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:18:32.113771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:32.114516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:32.115601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:32.116797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:32.151500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:18:32.158941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for user 55daeaaa37a8498c9e540f5546277dc3 and project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:18:32.179294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:18:32.184153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:18:32.279864 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8a45f89d-b62a-45f8-98c7-1dd3af6ac4ef tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.749400 Jul 26 14:18:32.282271 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1363/2895] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:18:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:18:32.298900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e75085fd-b044-494a-a0fc-11d4e122dbcc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:32.304204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e75085fd-b044-494a-a0fc-11d4e122dbcc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:32.317520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e75085fd-b044-494a-a0fc-11d4e122dbcc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:32.318951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e75085fd-b044-494a-a0fc-11d4e122dbcc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:32.324890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e75085fd-b044-494a-a0fc-11d4e122dbcc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:32.326628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e75085fd-b044-494a-a0fc-11d4e122dbcc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:32.937239 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c364f78d-eb1e-4b7e-a75e-f9d6426b4558 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.353414 Jul 26 14:18:32.948051 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1533/2896] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:18:31 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:32.953451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-624f9b0f-47c5-4333-ba9d-9e92ca3b643e req-cfcaf361-7a38-415f-a414-1eeeca6b7e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a900e83e-11a0-4cd4-85c0-c09b6e4da5c7", "name": "network-vif-plugged", "status": "completed", "tag": "e7e7e1e8-b611-45a9-ab4b-a0bf0c504929"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:32.989768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-624f9b0f-47c5-4333-ba9d-9e92ca3b643e req-cfcaf361-7a38-415f-a414-1eeeca6b7e91 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:32.991127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-624f9b0f-47c5-4333-ba9d-9e92ca3b643e req-cfcaf361-7a38-415f-a414-1eeeca6b7e91 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:33.020966 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-624f9b0f-47c5-4333-ba9d-9e92ca3b643e req-cfcaf361-7a38-415f-a414-1eeeca6b7e91 service nova] Creating event network-vif-plugged:e7e7e1e8-b611-45a9-ab4b-a0bf0c504929 for instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 on n-h1-833090-9 Jul 26 14:18:33.037556 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-624f9b0f-47c5-4333-ba9d-9e92ca3b643e req-cfcaf361-7a38-415f-a414-1eeeca6b7e91 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087773 Jul 26 14:18:33.051099 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1534/2897] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:33.073476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a8bd66d1-f865-444e-a20f-3185d0a40abd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:33.075324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a8bd66d1-f865-444e-a20f-3185d0a40abd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:33.124274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8bd66d1-f865-444e-a20f-3185d0a40abd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:33.125760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8bd66d1-f865-444e-a20f-3185d0a40abd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:33.129924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8bd66d1-f865-444e-a20f-3185d0a40abd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:33.131427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8bd66d1-f865-444e-a20f-3185d0a40abd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:33.305281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e75085fd-b044-494a-a0fc-11d4e122dbcc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:33.340483 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e75085fd-b044-494a-a0fc-11d4e122dbcc tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 1.049954 Jul 26 14:18:33.359981 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1364/2898] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:32 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:33.381235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-392759b7-5adc-43d1-a2d8-bbfcb2dd48fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:33.385336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-392759b7-5adc-43d1-a2d8-bbfcb2dd48fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:33.435298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-392759b7-5adc-43d1-a2d8-bbfcb2dd48fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:33.435887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-392759b7-5adc-43d1-a2d8-bbfcb2dd48fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:33.440782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-392759b7-5adc-43d1-a2d8-bbfcb2dd48fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:33.441923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-392759b7-5adc-43d1-a2d8-bbfcb2dd48fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:33.676464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-392759b7-5adc-43d1-a2d8-bbfcb2dd48fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:33.682861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:33.695910 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-392759b7-5adc-43d1-a2d8-bbfcb2dd48fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1196 microversion: 2.1 time: 0.340957 Jul 26 14:18:33.698108 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1365/2899] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:33 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1196 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:33.707671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de61ed57-82aa-41f6-99ae-8f27eb90f306 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:33.709092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-de61ed57-82aa-41f6-99ae-8f27eb90f306 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:33.719240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de61ed57-82aa-41f6-99ae-8f27eb90f306 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:33.726396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de61ed57-82aa-41f6-99ae-8f27eb90f306 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:33.729369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de61ed57-82aa-41f6-99ae-8f27eb90f306 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:33.730322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de61ed57-82aa-41f6-99ae-8f27eb90f306 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:33.792888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a8bd66d1-f865-444e-a20f-3185d0a40abd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:33.816062 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a8bd66d1-f865-444e-a20f-3185d0a40abd tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1360 microversion: 2.1 time: 0.751987 Jul 26 14:18:33.833978 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1535/2900] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:33 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1360 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:33.845653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e39827a5-7be9-4908-9014-6d3699781d4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:33.853819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e39827a5-7be9-4908-9014-6d3699781d4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:33.874057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e39827a5-7be9-4908-9014-6d3699781d4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:33.875162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e39827a5-7be9-4908-9014-6d3699781d4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:33.876546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e39827a5-7be9-4908-9014-6d3699781d4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:33.877235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e39827a5-7be9-4908-9014-6d3699781d4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:34.021703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e39827a5-7be9-4908-9014-6d3699781d4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:34.048430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e39827a5-7be9-4908-9014-6d3699781d4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:34.058064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e39827a5-7be9-4908-9014-6d3699781d4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:34.062272 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e39827a5-7be9-4908-9014-6d3699781d4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1340 microversion: 2.20 time: 0.224919 Jul 26 14:18:34.065420 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1536/2901] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:33 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1340 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:34.073831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-75209e4d-73da-4ec5-9efd-17012252d50e tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f87993703a0>, body: {"security_group_rule": {"parent_group_id": "4640d08f-3953-4aca-af8b-3dd609b60a48", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:34.662861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-de61ed57-82aa-41f6-99ae-8f27eb90f306 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:34.678741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-de61ed57-82aa-41f6-99ae-8f27eb90f306 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:34.696788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-de61ed57-82aa-41f6-99ae-8f27eb90f306 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:34.699104 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-de61ed57-82aa-41f6-99ae-8f27eb90f306 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.997478 Jul 26 14:18:34.700107 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1366/2902] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:33 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:34.715486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b7be5a48-f973-4846-83ec-b57f677b34af tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:34.716218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b7be5a48-f973-4846-83ec-b57f677b34af tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:34.745584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7be5a48-f973-4846-83ec-b57f677b34af tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:34.746513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7be5a48-f973-4846-83ec-b57f677b34af tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:34.750446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7be5a48-f973-4846-83ec-b57f677b34af tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:34.753584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7be5a48-f973-4846-83ec-b57f677b34af tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:35.879566 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-75209e4d-73da-4ec5-9efd-17012252d50e tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.810156 Jul 26 14:18:35.880258 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1537/2903] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:18:34 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:35.886484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74b35738-b21c-415d-9cea-378f9850e79e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:35.893045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-74b35738-b21c-415d-9cea-378f9850e79e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:35.926424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74b35738-b21c-415d-9cea-378f9850e79e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:35.927474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74b35738-b21c-415d-9cea-378f9850e79e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:35.929188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74b35738-b21c-415d-9cea-378f9850e79e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:35.930009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74b35738-b21c-415d-9cea-378f9850e79e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:36.119201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b7be5a48-f973-4846-83ec-b57f677b34af tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:36.127481 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b7be5a48-f973-4846-83ec-b57f677b34af tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 1.426247 Jul 26 14:18:36.131385 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1367/2904] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:34 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:36.155768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-70dbfbd7-c314-4874-a6ca-22badcd0c23e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:36.156523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-70dbfbd7-c314-4874-a6ca-22badcd0c23e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:36.161991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-74b35738-b21c-415d-9cea-378f9850e79e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:36.168877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70dbfbd7-c314-4874-a6ca-22badcd0c23e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:36.171206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70dbfbd7-c314-4874-a6ca-22badcd0c23e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:36.174902 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-74b35738-b21c-415d-9cea-378f9850e79e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1250 microversion: 2.1 time: 0.293097 Jul 26 14:18:36.175544 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1538/2905] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:35 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1250 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:36.177685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70dbfbd7-c314-4874-a6ca-22badcd0c23e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:36.178914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70dbfbd7-c314-4874-a6ca-22badcd0c23e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:36.205074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-47984eba-117c-47f5-9c44-548a3ec7a3bd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:36.208185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47984eba-117c-47f5-9c44-548a3ec7a3bd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:36.219679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47984eba-117c-47f5-9c44-548a3ec7a3bd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:36.234067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47984eba-117c-47f5-9c44-548a3ec7a3bd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:36.235266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47984eba-117c-47f5-9c44-548a3ec7a3bd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:36.246124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47984eba-117c-47f5-9c44-548a3ec7a3bd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:36.719634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-70dbfbd7-c314-4874-a6ca-22badcd0c23e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:36.730859 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-70dbfbd7-c314-4874-a6ca-22badcd0c23e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1542 microversion: 2.1 time: 0.584074 Jul 26 14:18:36.742070 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1368/2906] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:36 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1542 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:36.757211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-37cf3512-6b8b-4087-9195-36d6d30b07ff tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:36.758340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-37cf3512-6b8b-4087-9195-36d6d30b07ff tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:36.766813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37cf3512-6b8b-4087-9195-36d6d30b07ff tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:36.768149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37cf3512-6b8b-4087-9195-36d6d30b07ff tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:36.769825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37cf3512-6b8b-4087-9195-36d6d30b07ff tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:36.770781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37cf3512-6b8b-4087-9195-36d6d30b07ff tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:36.835920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47984eba-117c-47f5-9c44-548a3ec7a3bd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:36.846252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47984eba-117c-47f5-9c44-548a3ec7a3bd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:36.848495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47984eba-117c-47f5-9c44-548a3ec7a3bd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:36.851504 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-47984eba-117c-47f5-9c44-548a3ec7a3bd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1408 microversion: 2.20 time: 0.662054 Jul 26 14:18:36.855448 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1539/2907] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:36 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1408 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:36.867035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c602b22b-65d1-4fa2-bd63-dd55dcf49616 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f879938faf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-59628699", "description": "tempest-description-1209002239"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:37.512673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-37cf3512-6b8b-4087-9195-36d6d30b07ff tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:37.533525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-37cf3512-6b8b-4087-9195-36d6d30b07ff tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:37.537506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-37cf3512-6b8b-4087-9195-36d6d30b07ff tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:37.539984 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-37cf3512-6b8b-4087-9195-36d6d30b07ff tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.790857 Jul 26 14:18:37.541545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1369/2908] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:36 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:37.652408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1386795818", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "09a32ee5-2216-49bb-aa81-fe16fad9a574"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:37.741919 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c602b22b-65d1-4fa2-bd63-dd55dcf49616 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.884106 Jul 26 14:18:37.743997 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1540/2909] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:18:36 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:37.755404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-68f1844d-f521-4938-a7f0-f63336fc180f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:37.756238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-68f1844d-f521-4938-a7f0-f63336fc180f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:37.764508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68f1844d-f521-4938-a7f0-f63336fc180f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:37.764927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68f1844d-f521-4938-a7f0-f63336fc180f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:37.765920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68f1844d-f521-4938-a7f0-f63336fc180f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:37.766575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68f1844d-f521-4938-a7f0-f63336fc180f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:37.768236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] validate_networks() for [('09a32ee5-2216-49bb-aa81-fe16fad9a574', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:18:37.797285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=95 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:38.123550 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-68f1844d-f521-4938-a7f0-f63336fc180f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.378753 Jul 26 14:18:38.125290 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1541/2910] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:18:37 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-interface => generated 284 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:38.141016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32eceb78-2be7-4fc1-a088-eddcb59c896a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:38.142282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32eceb78-2be7-4fc1-a088-eddcb59c896a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:38.152150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32eceb78-2be7-4fc1-a088-eddcb59c896a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:38.153051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32eceb78-2be7-4fc1-a088-eddcb59c896a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:38.154291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32eceb78-2be7-4fc1-a088-eddcb59c896a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:38.154999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32eceb78-2be7-4fc1-a088-eddcb59c896a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:38.743484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32eceb78-2be7-4fc1-a088-eddcb59c896a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:38.759043 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-32eceb78-2be7-4fc1-a088-eddcb59c896a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 0.632206 Jul 26 14:18:38.759930 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1542/2911] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:38 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:38.765410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-795a4a6a-f5b8-41d4-b041-f189cc0bdea9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:38.773043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-795a4a6a-f5b8-41d4-b041-f189cc0bdea9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:38.810547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-795a4a6a-f5b8-41d4-b041-f189cc0bdea9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:38.818323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-795a4a6a-f5b8-41d4-b041-f189cc0bdea9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:38.819457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-795a4a6a-f5b8-41d4-b041-f189cc0bdea9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:38.820374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-795a4a6a-f5b8-41d4-b041-f189cc0bdea9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:39.482096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:39.511408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:39.970169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-795a4a6a-f5b8-41d4-b041-f189cc0bdea9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:39.980059 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-795a4a6a-f5b8-41d4-b041-f189cc0bdea9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1292 microversion: 2.1 time: 1.218608 Jul 26 14:18:39.980883 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1543/2912] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:38 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1292 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:40.008299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-87d03a30-2f9d-4512-a594-3419a5eb397c tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f87993daa60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1171270854", "description": "tempest-description-130146471"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:40.059304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:18:40.059788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:18:40.060521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:18:40.060649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:18:40.061051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:18:40.078233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:40.078973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:40.079791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:40.080266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:40.101045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Getting quotas for project 4d37e260b04147cd99d35aca62da8d25. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:18:40.107517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Getting quotas for user e085b43a4d3a463c94540c2b0469bb56 and project 4d37e260b04147cd99d35aca62da8d25. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:18:40.127557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Going to run 3 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:18:40.130731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: fd702cae-ec61-4f92-95d5-8a4a5dbf6f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:18:40.176148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=fd702cae-ec61-4f92-95d5-8a4a5dbf6f07,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:18:40.228537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=e77241a1-3c1d-4054-af62-c60ff2ad00ef,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:18:40.318681 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5d9e2326-1350-4ab5-9677-0fbc044f5dfd tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.775074 Jul 26 14:18:40.320516 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1370/2913] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:18:40.329843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-00b7d3ef-623c-4560-b4dd-d576717afb3b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:40.330769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-00b7d3ef-623c-4560-b4dd-d576717afb3b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:40.354466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00b7d3ef-623c-4560-b4dd-d576717afb3b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:40.355065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00b7d3ef-623c-4560-b4dd-d576717afb3b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:40.369597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00b7d3ef-623c-4560-b4dd-d576717afb3b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:40.370294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00b7d3ef-623c-4560-b4dd-d576717afb3b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:40.797150 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-87d03a30-2f9d-4512-a594-3419a5eb397c tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.803206 Jul 26 14:18:40.798290 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1544/2914] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:18:39 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:40.805200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-636ef9ab-2656-442f-b9bb-11bea81199fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:40.821891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-636ef9ab-2656-442f-b9bb-11bea81199fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:40.840883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-636ef9ab-2656-442f-b9bb-11bea81199fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:40.841419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-636ef9ab-2656-442f-b9bb-11bea81199fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:40.843263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-636ef9ab-2656-442f-b9bb-11bea81199fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:40.844075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-636ef9ab-2656-442f-b9bb-11bea81199fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:40.990328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-00b7d3ef-623c-4560-b4dd-d576717afb3b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:41.020122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-00b7d3ef-623c-4560-b4dd-d576717afb3b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:41.028175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-00b7d3ef-623c-4560-b4dd-d576717afb3b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:41.031709 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-00b7d3ef-623c-4560-b4dd-d576717afb3b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1408 microversion: 2.20 time: 0.708929 Jul 26 14:18:41.067743 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1371/2915] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:40 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1408 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:41.086957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4ad478e0-0e0d-4398-90a6-a0d0731bdf12 req-faec9cea-7df1-4bb3-9d3e-5033b1dd7643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9c25cd-3b3d-4c48-b620-b7ea6101bf3e", "tag": "13068f91-4844-4f82-95a3-ee7530c55d60"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:41.123743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4ad478e0-0e0d-4398-90a6-a0d0731bdf12 req-faec9cea-7df1-4bb3-9d3e-5033b1dd7643 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:41.127495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4ad478e0-0e0d-4398-90a6-a0d0731bdf12 req-faec9cea-7df1-4bb3-9d3e-5033b1dd7643 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:41.168837 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4ad478e0-0e0d-4398-90a6-a0d0731bdf12 req-faec9cea-7df1-4bb3-9d3e-5033b1dd7643 service nova] Creating event network-changed:13068f91-4844-4f82-95a3-ee7530c55d60 for instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e on n-h1-833090-9 Jul 26 14:18:41.177140 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4ad478e0-0e0d-4398-90a6-a0d0731bdf12 req-faec9cea-7df1-4bb3-9d3e-5033b1dd7643 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107355 Jul 26 14:18:41.177811 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1372/2916] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:41.184313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f9c60148-c4d9-4a44-99bc-73190df1ceb4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:41.185277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f9c60148-c4d9-4a44-99bc-73190df1ceb4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:41.195495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9c60148-c4d9-4a44-99bc-73190df1ceb4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:41.196361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9c60148-c4d9-4a44-99bc-73190df1ceb4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:41.197596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9c60148-c4d9-4a44-99bc-73190df1ceb4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:41.198460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9c60148-c4d9-4a44-99bc-73190df1ceb4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:41.635780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-636ef9ab-2656-442f-b9bb-11bea81199fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:41.681038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-636ef9ab-2656-442f-b9bb-11bea81199fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:41.684836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-636ef9ab-2656-442f-b9bb-11bea81199fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:41.687351 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-636ef9ab-2656-442f-b9bb-11bea81199fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.887201 Jul 26 14:18:41.692289 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1545/2917] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:40 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:41.750478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f9c60148-c4d9-4a44-99bc-73190df1ceb4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:41.764066 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f9c60148-c4d9-4a44-99bc-73190df1ceb4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 0.584650 Jul 26 14:18:41.766887 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1373/2918] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:41 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:41.777612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eef2103d-f7a3-4249-bb50-255ed90b4e67 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:41.802357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-eef2103d-f7a3-4249-bb50-255ed90b4e67 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:41.802357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eef2103d-f7a3-4249-bb50-255ed90b4e67 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Searching by: {'deleted': False, 'project_id': '4d37e260b04147cd99d35aca62da8d25'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:18:41.869025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eef2103d-f7a3-4249-bb50-255ed90b4e67 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:41.869958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eef2103d-f7a3-4249-bb50-255ed90b4e67 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:41.870898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eef2103d-f7a3-4249-bb50-255ed90b4e67 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:41.871885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eef2103d-f7a3-4249-bb50-255ed90b4e67 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:41.931632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-8fb70e95-fd2c-4f34-bfe5-8dee0dca6258 req-e4ad45fb-adee-4fd4-858f-575f7357faab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a900e83e-11a0-4cd4-85c0-c09b6e4da5c7", "tag": "e7e7e1e8-b611-45a9-ab4b-a0bf0c504929"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:41.965976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8fb70e95-fd2c-4f34-bfe5-8dee0dca6258 req-e4ad45fb-adee-4fd4-858f-575f7357faab service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:41.966806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8fb70e95-fd2c-4f34-bfe5-8dee0dca6258 req-e4ad45fb-adee-4fd4-858f-575f7357faab service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:41.971205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-eef2103d-f7a3-4249-bb50-255ed90b4e67 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Listed batch of 3 results from cell out of 997 limit. Returned 3 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:18:41.992461 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8fb70e95-fd2c-4f34-bfe5-8dee0dca6258 req-e4ad45fb-adee-4fd4-858f-575f7357faab service nova] Creating event network-changed:e7e7e1e8-b611-45a9-ab4b-a0bf0c504929 for instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 on n-h1-833090-9 Jul 26 14:18:42.002718 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-8fb70e95-fd2c-4f34-bfe5-8dee0dca6258 req-e4ad45fb-adee-4fd4-858f-575f7357faab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.307269 Jul 26 14:18:42.005382 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1546/2919] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:42.018057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d3542a18-1229-4cc2-b05e-673ef92ddefe tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f879937bdc0>, body: {"security_group_rule": {"parent_group_id": "feae7dba-2752-46fd-8bd6-fe5ecfb71161", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "4a2f3198-e07d-4772-9ffa-3f097d9b3d39"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:42.076539 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eef2103d-f7a3-4249-bb50-255ed90b4e67 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.288557 Jul 26 14:18:42.085376 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1374/2920] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:18:41 2022] GET /compute/v2.1/servers => generated 1018 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:42.093202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0a1f93d8-32e4-460b-b6a2-417fe3d09d64 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:42.094027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0a1f93d8-32e4-460b-b6a2-417fe3d09d64 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:42.109073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a1f93d8-32e4-460b-b6a2-417fe3d09d64 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:42.109754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a1f93d8-32e4-460b-b6a2-417fe3d09d64 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:42.113510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a1f93d8-32e4-460b-b6a2-417fe3d09d64 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:42.117708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a1f93d8-32e4-460b-b6a2-417fe3d09d64 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:42.874358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0a1f93d8-32e4-460b-b6a2-417fe3d09d64 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:42.896697 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0a1f93d8-32e4-460b-b6a2-417fe3d09d64 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1292 microversion: 2.1 time: 0.814845 Jul 26 14:18:42.912512 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1375/2921] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:42 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1292 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:43.169163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-0c698388-0ee9-4e3e-adc6-bd6edb387b9a req-c7e03af9-a72b-476f-ba17-0d03bf974486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-plugged", "status": "completed", "tag": "725e91c3-1621-400a-b82a-3ec7c07edfc6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:43.205995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0c698388-0ee9-4e3e-adc6-bd6edb387b9a req-c7e03af9-a72b-476f-ba17-0d03bf974486 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:43.207487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0c698388-0ee9-4e3e-adc6-bd6edb387b9a req-c7e03af9-a72b-476f-ba17-0d03bf974486 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:43.227827 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-0c698388-0ee9-4e3e-adc6-bd6edb387b9a req-c7e03af9-a72b-476f-ba17-0d03bf974486 service nova] Creating event network-vif-plugged:725e91c3-1621-400a-b82a-3ec7c07edfc6 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:18:43.238723 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-0c698388-0ee9-4e3e-adc6-bd6edb387b9a req-c7e03af9-a72b-476f-ba17-0d03bf974486 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323113 Jul 26 14:18:43.240131 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1376/2922] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:43.249009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1ed3247a-7b3b-4a88-8055-8f4b6863e9a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:43.250504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1ed3247a-7b3b-4a88-8055-8f4b6863e9a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:43.263209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ed3247a-7b3b-4a88-8055-8f4b6863e9a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:43.264389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ed3247a-7b3b-4a88-8055-8f4b6863e9a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:43.266269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ed3247a-7b3b-4a88-8055-8f4b6863e9a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:43.268557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ed3247a-7b3b-4a88-8055-8f4b6863e9a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:44.295633 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d3542a18-1229-4cc2-b05e-673ef92ddefe tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.288088 Jul 26 14:18:44.299821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1547/2923] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:18:42 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 2293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:44.311093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1d9cc2b6-ebde-4dd8-8a64-f537111d24ab tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:44.313643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1d9cc2b6-ebde-4dd8-8a64-f537111d24ab tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:44.332397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d9cc2b6-ebde-4dd8-8a64-f537111d24ab tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:44.336080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d9cc2b6-ebde-4dd8-8a64-f537111d24ab tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:44.339684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d9cc2b6-ebde-4dd8-8a64-f537111d24ab tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:44.340918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d9cc2b6-ebde-4dd8-8a64-f537111d24ab tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:44.797622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1d9cc2b6-ebde-4dd8-8a64-f537111d24ab tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:44.836838 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1d9cc2b6-ebde-4dd8-8a64-f537111d24ab tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0" status: 200 len: 1281 microversion: 2.1 time: 0.529895 Jul 26 14:18:44.840596 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1548/2924] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:44 2022] GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 => generated 1281 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:44.875372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f5171e52-805c-41ac-818f-43685340065f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:44.881517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f5171e52-805c-41ac-818f-43685340065f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:44.914004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ed3247a-7b3b-4a88-8055-8f4b6863e9a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:45.001969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ed3247a-7b3b-4a88-8055-8f4b6863e9a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:45.004103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ed3247a-7b3b-4a88-8055-8f4b6863e9a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:45.005313 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1ed3247a-7b3b-4a88-8055-8f4b6863e9a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1408 microversion: 2.20 time: 1.763731 Jul 26 14:18:45.005891 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1377/2925] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:43 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1408 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:45.008047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5171e52-805c-41ac-818f-43685340065f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:45.020637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5171e52-805c-41ac-818f-43685340065f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:45.022396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a7bba2ae-311d-4d5e-9b86-17553b627a6a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:45.023030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a7bba2ae-311d-4d5e-9b86-17553b627a6a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:45.026951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5171e52-805c-41ac-818f-43685340065f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:45.032771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5171e52-805c-41ac-818f-43685340065f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:45.038517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7bba2ae-311d-4d5e-9b86-17553b627a6a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:45.043852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7bba2ae-311d-4d5e-9b86-17553b627a6a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:45.044990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7bba2ae-311d-4d5e-9b86-17553b627a6a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:45.045854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7bba2ae-311d-4d5e-9b86-17553b627a6a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:46.467792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a7bba2ae-311d-4d5e-9b86-17553b627a6a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:46.484713 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a7bba2ae-311d-4d5e-9b86-17553b627a6a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 1.477711 Jul 26 14:18:46.485927 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1378/2926] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:45 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:46.492032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2e1f1021-f905-4310-b8d7-faababaa662e req-e6a7c172-b5ee-4a66-a81f-3c9eef311395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26e6716b-8039-48ec-9e12-fb154188021f", "tag": "13953793-6bfa-4e86-a84a-bcaecb648e87"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:46.517416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2e1f1021-f905-4310-b8d7-faababaa662e req-e6a7c172-b5ee-4a66-a81f-3c9eef311395 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:46.518189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2e1f1021-f905-4310-b8d7-faababaa662e req-e6a7c172-b5ee-4a66-a81f-3c9eef311395 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:46.551517 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2e1f1021-f905-4310-b8d7-faababaa662e req-e6a7c172-b5ee-4a66-a81f-3c9eef311395 service nova] Creating event network-changed:13953793-6bfa-4e86-a84a-bcaecb648e87 for instance 26e6716b-8039-48ec-9e12-fb154188021f on n-h2-833090-9 Jul 26 14:18:46.568797 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2e1f1021-f905-4310-b8d7-faababaa662e req-e6a7c172-b5ee-4a66-a81f-3c9eef311395 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081185 Jul 26 14:18:46.569749 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1379/2927] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:46.575374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9fb24403-8963-46b0-9cce-0ff565b95d81 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:46.586768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9fb24403-8963-46b0-9cce-0ff565b95d81 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:46.608048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9fb24403-8963-46b0-9cce-0ff565b95d81 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:46.608820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9fb24403-8963-46b0-9cce-0ff565b95d81 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:46.609832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9fb24403-8963-46b0-9cce-0ff565b95d81 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:46.610480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9fb24403-8963-46b0-9cce-0ff565b95d81 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:46.871697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f5171e52-805c-41ac-818f-43685340065f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:46.895886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f5171e52-805c-41ac-818f-43685340065f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:46.902543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f5171e52-805c-41ac-818f-43685340065f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:46.905959 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f5171e52-805c-41ac-818f-43685340065f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 2.061634 Jul 26 14:18:46.907253 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1549/2928] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:44 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:46.914162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ea7c515c-4b44-4da2-966b-ca0a944b46b8 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f87993d48b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-454117405", "description": "tempest-description-389092269"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:47.028938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9fb24403-8963-46b0-9cce-0ff565b95d81 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:47.043206 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9fb24403-8963-46b0-9cce-0ff565b95d81 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1292 microversion: 2.1 time: 0.471870 Jul 26 14:18:47.065964 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1380/2929] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:46 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1292 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:47.073411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4cd1e7bc-fdf9-498e-87b2-90f9f753d8f7 req-d84169d2-971d-4db0-9a2a-ebae3aa86b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-plugged", "status": "completed", "tag": "655c801d-619c-4703-833e-49b7cd5986f5"}, {"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-plugged", "status": "completed", "tag": "238ee548-dff9-412c-84cd-2631e15a0247"}, {"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-plugged", "status": "completed", "tag": "d3a78f25-3960-4067-8f30-6daf5be1078e"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:47.095147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4cd1e7bc-fdf9-498e-87b2-90f9f753d8f7 req-d84169d2-971d-4db0-9a2a-ebae3aa86b0e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:47.096200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4cd1e7bc-fdf9-498e-87b2-90f9f753d8f7 req-d84169d2-971d-4db0-9a2a-ebae3aa86b0e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:47.117533 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4cd1e7bc-fdf9-498e-87b2-90f9f753d8f7 req-d84169d2-971d-4db0-9a2a-ebae3aa86b0e service nova] Creating event network-vif-plugged:655c801d-619c-4703-833e-49b7cd5986f5 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:18:47.118469 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4cd1e7bc-fdf9-498e-87b2-90f9f753d8f7 req-d84169d2-971d-4db0-9a2a-ebae3aa86b0e service nova] Creating event network-vif-plugged:238ee548-dff9-412c-84cd-2631e15a0247 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:18:47.119430 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4cd1e7bc-fdf9-498e-87b2-90f9f753d8f7 req-d84169d2-971d-4db0-9a2a-ebae3aa86b0e service nova] Creating event network-vif-plugged:d3a78f25-3960-4067-8f30-6daf5be1078e for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:18:47.127882 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4cd1e7bc-fdf9-498e-87b2-90f9f753d8f7 req-d84169d2-971d-4db0-9a2a-ebae3aa86b0e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.059921 Jul 26 14:18:47.131178 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1381/2930] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:47.166612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b498ec02-4cb0-44eb-be42-2d55d459ed88 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:47.172163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b498ec02-4cb0-44eb-be42-2d55d459ed88 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:47.190223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b498ec02-4cb0-44eb-be42-2d55d459ed88 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:47.196361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b498ec02-4cb0-44eb-be42-2d55d459ed88 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:47.197799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b498ec02-4cb0-44eb-be42-2d55d459ed88 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:47.198284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b498ec02-4cb0-44eb-be42-2d55d459ed88 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:47.408874 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ea7c515c-4b44-4da2-966b-ca0a944b46b8 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.499590 Jul 26 14:18:47.410706 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1550/2931] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:18:46 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:47.416815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8f24f29a-a7cb-4607-b6fe-83d0c0c4eceb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:47.418112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8f24f29a-a7cb-4607-b6fe-83d0c0c4eceb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:47.434590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:47.437473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f24f29a-a7cb-4607-b6fe-83d0c0c4eceb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:47.438437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f24f29a-a7cb-4607-b6fe-83d0c0c4eceb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:47.439555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f24f29a-a7cb-4607-b6fe-83d0c0c4eceb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:47.440264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f24f29a-a7cb-4607-b6fe-83d0c0c4eceb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:47.753358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b498ec02-4cb0-44eb-be42-2d55d459ed88 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:47.784885 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b498ec02-4cb0-44eb-be42-2d55d459ed88 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0" status: 200 len: 1323 microversion: 2.1 time: 0.645522 Jul 26 14:18:47.803992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8f24f29a-a7cb-4607-b6fe-83d0c0c4eceb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:47.808132 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1382/2932] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:47 2022] GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 => generated 1323 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:47.817448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8a71a1dc-c471-4f7c-a9ca-93c3f4273db0 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f8799297820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-760928907", "description": "tempest-description-291218767"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:47.830090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8f24f29a-a7cb-4607-b6fe-83d0c0c4eceb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:47.832565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8f24f29a-a7cb-4607-b6fe-83d0c0c4eceb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:47.844123 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8f24f29a-a7cb-4607-b6fe-83d0c0c4eceb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1408 microversion: 2.20 time: 0.431308 Jul 26 14:18:47.845170 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1551/2933] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:47 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1408 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:47.851255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d1805bb2-2a5f-4ceb-a04b-aaf72c6b64ad tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:47.857203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d1805bb2-2a5f-4ceb-a04b-aaf72c6b64ad tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:47.871916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1805bb2-2a5f-4ceb-a04b-aaf72c6b64ad tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:47.873180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1805bb2-2a5f-4ceb-a04b-aaf72c6b64ad tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:47.873362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1805bb2-2a5f-4ceb-a04b-aaf72c6b64ad tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:47.874292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1805bb2-2a5f-4ceb-a04b-aaf72c6b64ad tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:48.665001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d1805bb2-2a5f-4ceb-a04b-aaf72c6b64ad tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:48.688453 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d1805bb2-2a5f-4ceb-a04b-aaf72c6b64ad tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 0.840352 Jul 26 14:18:48.693075 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1552/2934] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:47 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:48.709588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fcdef7b5-46eb-4907-a6e9-fd073f82b876 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:48.710395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fcdef7b5-46eb-4907-a6e9-fd073f82b876 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:48.742440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcdef7b5-46eb-4907-a6e9-fd073f82b876 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:48.743293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcdef7b5-46eb-4907-a6e9-fd073f82b876 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:48.744414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcdef7b5-46eb-4907-a6e9-fd073f82b876 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:48.745329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcdef7b5-46eb-4907-a6e9-fd073f82b876 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:48.929162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8a71a1dc-c471-4f7c-a9ca-93c3f4273db0 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.118667 Jul 26 14:18:48.930885 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1383/2935] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:18:47 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:48.937367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-70798e36-b212-4277-b2cd-bb128b652e68 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:48.938340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-70798e36-b212-4277-b2cd-bb128b652e68 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:48.965794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70798e36-b212-4277-b2cd-bb128b652e68 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:48.966446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70798e36-b212-4277-b2cd-bb128b652e68 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:48.967460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70798e36-b212-4277-b2cd-bb128b652e68 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:48.968123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70798e36-b212-4277-b2cd-bb128b652e68 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:49.591281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fcdef7b5-46eb-4907-a6e9-fd073f82b876 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:49.611210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fcdef7b5-46eb-4907-a6e9-fd073f82b876 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:49.615461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fcdef7b5-46eb-4907-a6e9-fd073f82b876 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:49.618070 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fcdef7b5-46eb-4907-a6e9-fd073f82b876 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.923324 Jul 26 14:18:49.619809 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1553/2936] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:48 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:49.628138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-84e7ccf3-ce10-44c1-8044-59ff78af66b2 req-11cd3125-daae-41a5-a80d-341e281e66ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4034f1ea-40a3-4aa7-8651-d090322b26d0", "tag": "9c25a792-23a6-49bb-abc9-17d93c26e1ad"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:49.650603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-84e7ccf3-ce10-44c1-8044-59ff78af66b2 req-11cd3125-daae-41a5-a80d-341e281e66ef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:49.651877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-84e7ccf3-ce10-44c1-8044-59ff78af66b2 req-11cd3125-daae-41a5-a80d-341e281e66ef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:49.671835 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-84e7ccf3-ce10-44c1-8044-59ff78af66b2 req-11cd3125-daae-41a5-a80d-341e281e66ef service nova] Creating event network-changed:9c25a792-23a6-49bb-abc9-17d93c26e1ad for instance 4034f1ea-40a3-4aa7-8651-d090322b26d0 on n-h2-833090-9 Jul 26 14:18:49.679605 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-84e7ccf3-ce10-44c1-8044-59ff78af66b2 req-11cd3125-daae-41a5-a80d-341e281e66ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057554 Jul 26 14:18:49.680659 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1554/2937] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:49.686435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0995a189-d5d0-4c31-b2e0-104467051e79 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:49.687545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0995a189-d5d0-4c31-b2e0-104467051e79 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:49.695429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0995a189-d5d0-4c31-b2e0-104467051e79 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:49.696234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0995a189-d5d0-4c31-b2e0-104467051e79 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:49.697446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0995a189-d5d0-4c31-b2e0-104467051e79 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:49.698302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0995a189-d5d0-4c31-b2e0-104467051e79 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:49.725210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-70798e36-b212-4277-b2cd-bb128b652e68 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:49.740898 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-70798e36-b212-4277-b2cd-bb128b652e68 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1292 microversion: 2.1 time: 0.808308 Jul 26 14:18:49.742998 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1384/2938] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:48 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1292 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:49.750367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f47e663e-7adf-4084-9d2f-bd6e433e7d7d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:49.751342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f47e663e-7adf-4084-9d2f-bd6e433e7d7d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:49.761926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f47e663e-7adf-4084-9d2f-bd6e433e7d7d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:49.762753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f47e663e-7adf-4084-9d2f-bd6e433e7d7d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:49.763628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f47e663e-7adf-4084-9d2f-bd6e433e7d7d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:49.764476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f47e663e-7adf-4084-9d2f-bd6e433e7d7d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:50.067543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0995a189-d5d0-4c31-b2e0-104467051e79 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:50.078340 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0995a189-d5d0-4c31-b2e0-104467051e79 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0" status: 200 len: 1323 microversion: 2.1 time: 0.396220 Jul 26 14:18:50.079610 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1555/2939] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:49 2022] GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 => generated 1323 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:50.089570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-31b7a8e3-567d-4d3e-85da-1bc6f76c04c7 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f879945a550>, body: {"security_group_rule": {"parent_group_id": "c9a1e438-5f00-4b19-8f91-ede234ee9670", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:50.117487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=12 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:50.209124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f47e663e-7adf-4084-9d2f-bd6e433e7d7d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:50.228276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f47e663e-7adf-4084-9d2f-bd6e433e7d7d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:50.230973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f47e663e-7adf-4084-9d2f-bd6e433e7d7d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:50.233209 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f47e663e-7adf-4084-9d2f-bd6e433e7d7d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1408 microversion: 2.20 time: 0.488122 Jul 26 14:18:50.234854 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1385/2940] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:49 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1408 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:50.243209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-143b9279-a8e3-4ef4-8916-71f5df4291cf req-03a278d8-53e6-498e-8c4d-ea24047cb8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-plugged", "status": "completed", "tag": "1caf9c4e-e16d-4c2d-b589-6ae470a2ecc0"}, {"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-plugged", "status": "completed", "tag": "94991b0a-9173-43b7-afe8-7a5e6b1a961e"}, {"server_uuid": "e42c5141-d427-4b45-8d3f-facf56bfe668", "name": "network-vif-plugged", "status": "completed", "tag": "56cb7e7e-d518-4bee-8b79-70858a8691e3"}, {"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-plugged", "status": "completed", "tag": "f6ef9b57-da48-4401-878d-831cea8a8c9f"}, {"server_uuid": "be9c25cd-3b3d-4c48-b620-b7ea6101bf3e", "name": "network-vif-plugged", "status": "completed", "tag": "13068f91-4844-4f82-95a3-ee7530c55d60"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:50.277213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-143b9279-a8e3-4ef4-8916-71f5df4291cf req-03a278d8-53e6-498e-8c4d-ea24047cb8e2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:50.278002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-143b9279-a8e3-4ef4-8916-71f5df4291cf req-03a278d8-53e6-498e-8c4d-ea24047cb8e2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:50.304737 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-143b9279-a8e3-4ef4-8916-71f5df4291cf req-03a278d8-53e6-498e-8c4d-ea24047cb8e2 service nova] Creating event network-vif-plugged:1caf9c4e-e16d-4c2d-b589-6ae470a2ecc0 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:18:50.306440 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-143b9279-a8e3-4ef4-8916-71f5df4291cf req-03a278d8-53e6-498e-8c4d-ea24047cb8e2 service nova] Creating event network-vif-plugged:94991b0a-9173-43b7-afe8-7a5e6b1a961e for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:18:50.307576 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-143b9279-a8e3-4ef4-8916-71f5df4291cf req-03a278d8-53e6-498e-8c4d-ea24047cb8e2 service nova] Creating event network-vif-plugged:56cb7e7e-d518-4bee-8b79-70858a8691e3 for instance e42c5141-d427-4b45-8d3f-facf56bfe668 on n-h2-833090-9 Jul 26 14:18:50.308500 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-143b9279-a8e3-4ef4-8916-71f5df4291cf req-03a278d8-53e6-498e-8c4d-ea24047cb8e2 service nova] Creating event network-vif-plugged:f6ef9b57-da48-4401-878d-831cea8a8c9f for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:18:50.309591 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-143b9279-a8e3-4ef4-8916-71f5df4291cf req-03a278d8-53e6-498e-8c4d-ea24047cb8e2 service nova] Creating event network-vif-plugged:13068f91-4844-4f82-95a3-ee7530c55d60 for instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e on n-h1-833090-9 Jul 26 14:18:50.324319 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-143b9279-a8e3-4ef4-8916-71f5df4291cf req-03a278d8-53e6-498e-8c4d-ea24047cb8e2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.087518 Jul 26 14:18:50.325031 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1386/2941] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:50.331299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9868d05e-d28c-4ed8-b0c2-3b38aed4bab6 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:50.332503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9868d05e-d28c-4ed8-b0c2-3b38aed4bab6 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:50.340400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9868d05e-d28c-4ed8-b0c2-3b38aed4bab6 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:50.340875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9868d05e-d28c-4ed8-b0c2-3b38aed4bab6 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:50.343286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9868d05e-d28c-4ed8-b0c2-3b38aed4bab6 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:50.344144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9868d05e-d28c-4ed8-b0c2-3b38aed4bab6 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:50.350615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:50.692627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9868d05e-d28c-4ed8-b0c2-3b38aed4bab6 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:50.701063 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9868d05e-d28c-4ed8-b0c2-3b38aed4bab6 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 0.374467 Jul 26 14:18:50.702078 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1387/2942] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:50 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:50.719720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20ec8ae2-aa6c-4323-aa37-326bec086206 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:50.720854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-20ec8ae2-aa6c-4323-aa37-326bec086206 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:50.731011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20ec8ae2-aa6c-4323-aa37-326bec086206 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:50.731693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20ec8ae2-aa6c-4323-aa37-326bec086206 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:50.732641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20ec8ae2-aa6c-4323-aa37-326bec086206 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:50.733165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20ec8ae2-aa6c-4323-aa37-326bec086206 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:51.088651 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-31b7a8e3-567d-4d3e-85da-1bc6f76c04c7 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.007223 Jul 26 14:18:51.090764 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1556/2943] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:18:50 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:51.103147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b50592b-21ad-4db4-b8f0-637194505098 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:51.108072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4b50592b-21ad-4db4-b8f0-637194505098 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:51.134956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b50592b-21ad-4db4-b8f0-637194505098 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:51.135449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b50592b-21ad-4db4-b8f0-637194505098 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:51.137032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b50592b-21ad-4db4-b8f0-637194505098 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:51.137943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b50592b-21ad-4db4-b8f0-637194505098 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:51.755997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-20ec8ae2-aa6c-4323-aa37-326bec086206 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:51.772833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-20ec8ae2-aa6c-4323-aa37-326bec086206 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:51.775650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-20ec8ae2-aa6c-4323-aa37-326bec086206 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:51.777684 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-20ec8ae2-aa6c-4323-aa37-326bec086206 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 1.074161 Jul 26 14:18:51.778612 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1388/2944] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:50 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:51.788227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-13da9ab9-aa91-4c66-b789-4581a24b477b req-4306485c-8e51-4979-93f2-e440045a8eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77241a1-3c1d-4054-af62-c60ff2ad00ef", "tag": "217dc8e3-1f0f-41ce-baf8-fc21aabc77a3"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:51.805156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-13da9ab9-aa91-4c66-b789-4581a24b477b req-4306485c-8e51-4979-93f2-e440045a8eef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:51.805955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-13da9ab9-aa91-4c66-b789-4581a24b477b req-4306485c-8e51-4979-93f2-e440045a8eef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:51.823040 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-13da9ab9-aa91-4c66-b789-4581a24b477b req-4306485c-8e51-4979-93f2-e440045a8eef service nova] Creating event network-changed:217dc8e3-1f0f-41ce-baf8-fc21aabc77a3 for instance e77241a1-3c1d-4054-af62-c60ff2ad00ef on n-h2-833090-9 Jul 26 14:18:51.839324 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-13da9ab9-aa91-4c66-b789-4581a24b477b req-4306485c-8e51-4979-93f2-e440045a8eef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056777 Jul 26 14:18:51.840602 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1389/2945] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:51.848499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4b50592b-21ad-4db4-b8f0-637194505098 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:51.858827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8af9b82f-ab70-4fad-950e-62321151635d tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:51.861134 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4b50592b-21ad-4db4-b8f0-637194505098 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1292 microversion: 2.1 time: 0.768702 Jul 26 14:18:51.862223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8af9b82f-ab70-4fad-950e-62321151635d tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:51.872773 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1557/2946] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:51 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1292 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:51.886017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7daab353-a117-4fd2-b6a5-90a8736743c9 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f8799264790>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:51.888170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8af9b82f-ab70-4fad-950e-62321151635d tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:51.889047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8af9b82f-ab70-4fad-950e-62321151635d tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:51.890753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8af9b82f-ab70-4fad-950e-62321151635d tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:51.894296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8af9b82f-ab70-4fad-950e-62321151635d tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:51.928554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:52.244043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8af9b82f-ab70-4fad-950e-62321151635d tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:52.254572 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8af9b82f-ab70-4fad-950e-62321151635d tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0" status: 200 len: 1323 microversion: 2.1 time: 0.412305 Jul 26 14:18:52.256277 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1390/2947] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:51 2022] GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 => generated 1323 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:52.264055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1d2dad7a-b86c-4473-91e8-5422583ba0b6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:52.265310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1d2dad7a-b86c-4473-91e8-5422583ba0b6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:52.274731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d2dad7a-b86c-4473-91e8-5422583ba0b6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:52.275188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d2dad7a-b86c-4473-91e8-5422583ba0b6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:52.276345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d2dad7a-b86c-4473-91e8-5422583ba0b6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:52.276868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d2dad7a-b86c-4473-91e8-5422583ba0b6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:52.499556 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7daab353-a117-4fd2-b6a5-90a8736743c9 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f" status: 202 len: 0 microversion: 2.1 time: 0.625062 Jul 26 14:18:52.500409 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1558/2948] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:18:51 2022] DELETE /compute/v2.1/os-security-groups/19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:18:52.506301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3b114dae-eeae-4b44-adc5-1f7e22b2d3aa tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:52.506863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3b114dae-eeae-4b44-adc5-1f7e22b2d3aa tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:52.516890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b114dae-eeae-4b44-adc5-1f7e22b2d3aa tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:52.518521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b114dae-eeae-4b44-adc5-1f7e22b2d3aa tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:52.520847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b114dae-eeae-4b44-adc5-1f7e22b2d3aa tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:52.521327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b114dae-eeae-4b44-adc5-1f7e22b2d3aa tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:52.559976 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3b114dae-eeae-4b44-adc5-1f7e22b2d3aa tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/ips" status: 200 len: 144 microversion: 2.1 time: 0.058335 Jul 26 14:18:52.560605 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1559/2949] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:18:52 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/ips => generated 144 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:52.561947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d2dad7a-b86c-4473-91e8-5422583ba0b6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:52.567009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a0984695-9f2e-40c7-bbb4-e6b16a42500f req-cf88b74e-afdb-45e9-9dc0-30949d68cb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd702cae-ec61-4f92-95d5-8a4a5dbf6f07", "tag": "c5a700b8-78be-414e-88a6-4c0bf7798dc5"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:52.580067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a0984695-9f2e-40c7-bbb4-e6b16a42500f req-cf88b74e-afdb-45e9-9dc0-30949d68cb99 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:52.580655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a0984695-9f2e-40c7-bbb4-e6b16a42500f req-cf88b74e-afdb-45e9-9dc0-30949d68cb99 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:52.581846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d2dad7a-b86c-4473-91e8-5422583ba0b6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:52.585112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d2dad7a-b86c-4473-91e8-5422583ba0b6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:52.586484 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1d2dad7a-b86c-4473-91e8-5422583ba0b6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1408 microversion: 2.20 time: 0.328012 Jul 26 14:18:52.588039 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1391/2950] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:52 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1408 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:52.593346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6797098-d240-4975-937b-754062fd54b8 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:52.594447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6797098-d240-4975-937b-754062fd54b8 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:52.603706 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a0984695-9f2e-40c7-bbb4-e6b16a42500f req-cf88b74e-afdb-45e9-9dc0-30949d68cb99 service nova] Creating event network-changed:c5a700b8-78be-414e-88a6-4c0bf7798dc5 for instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 on n-h1-833090-9 Jul 26 14:18:52.604678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6797098-d240-4975-937b-754062fd54b8 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:52.605149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6797098-d240-4975-937b-754062fd54b8 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:52.605959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6797098-d240-4975-937b-754062fd54b8 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:52.606414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6797098-d240-4975-937b-754062fd54b8 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:52.612993 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a0984695-9f2e-40c7-bbb4-e6b16a42500f req-cf88b74e-afdb-45e9-9dc0-30949d68cb99 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049792 Jul 26 14:18:52.614368 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1560/2951] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:52.622093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ae15dd30-6e80-41fc-9885-7e12634f0158 req-32abc61f-6c00-4e9c-a461-eaa9009a26c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e6716b-8039-48ec-9e12-fb154188021f", "name": "network-vif-plugged", "status": "completed", "tag": "13953793-6bfa-4e86-a84a-bcaecb648e87"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:52.637135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ae15dd30-6e80-41fc-9885-7e12634f0158 req-32abc61f-6c00-4e9c-a461-eaa9009a26c3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:52.638133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ae15dd30-6e80-41fc-9885-7e12634f0158 req-32abc61f-6c00-4e9c-a461-eaa9009a26c3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:52.654093 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ae15dd30-6e80-41fc-9885-7e12634f0158 req-32abc61f-6c00-4e9c-a461-eaa9009a26c3 service nova] Creating event network-vif-plugged:13953793-6bfa-4e86-a84a-bcaecb648e87 for instance 26e6716b-8039-48ec-9e12-fb154188021f on n-h2-833090-9 Jul 26 14:18:52.660330 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ae15dd30-6e80-41fc-9885-7e12634f0158 req-32abc61f-6c00-4e9c-a461-eaa9009a26c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043295 Jul 26 14:18:52.660995 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1561/2952] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:52.668677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-14cf7c91-d07f-422f-8e07-aa5538a0f4da tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f87993da940>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:52.792644 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-14cf7c91-d07f-422f-8e07-aa5538a0f4da tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/c9a1e438-5f00-4b19-8f91-ede234ee9670" status: 200 len: 246 microversion: 2.1 time: 0.129207 Jul 26 14:18:52.793814 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1562/2953] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:18:52 2022] GET /compute/v2.1/os-security-groups/c9a1e438-5f00-4b19-8f91-ede234ee9670 => generated 246 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:52.819357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-670eea55-1651-4a9d-976d-d0b565e4e5bf tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:52.821990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-670eea55-1651-4a9d-976d-d0b565e4e5bf tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:52.842281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-670eea55-1651-4a9d-976d-d0b565e4e5bf tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:52.843560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-670eea55-1651-4a9d-976d-d0b565e4e5bf tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:52.845332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-670eea55-1651-4a9d-976d-d0b565e4e5bf tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:52.846371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-670eea55-1651-4a9d-976d-d0b565e4e5bf tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:52.921540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c6797098-d240-4975-937b-754062fd54b8 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:52.949371 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6797098-d240-4975-937b-754062fd54b8 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 0.357871 Jul 26 14:18:52.950333 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1392/2954] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:52 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:52.974775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-41ea4a98-55e8-40b0-ba8b-a415c8db595f tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f87870743a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-684231030", "description": "tempest-description-723285676"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:53.304929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-670eea55-1651-4a9d-976d-d0b565e4e5bf tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:53.332563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-670eea55-1651-4a9d-976d-d0b565e4e5bf tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:53.335642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-670eea55-1651-4a9d-976d-d0b565e4e5bf tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:53.337882 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-670eea55-1651-4a9d-976d-d0b565e4e5bf tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.526475 Jul 26 14:18:53.339100 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1563/2955] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:52 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:53.347797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b2896c92-8fee-4861-b8b7-f65b69c0f031 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:53.349247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b2896c92-8fee-4861-b8b7-f65b69c0f031 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:53.359135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b2896c92-8fee-4861-b8b7-f65b69c0f031 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:53.360391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b2896c92-8fee-4861-b8b7-f65b69c0f031 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:53.362837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b2896c92-8fee-4861-b8b7-f65b69c0f031 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:53.363842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b2896c92-8fee-4861-b8b7-f65b69c0f031 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:53.415514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-41ea4a98-55e8-40b0-ba8b-a415c8db595f tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.459148 Jul 26 14:18:53.416275 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1393/2956] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:18:52 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:53.423226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c481aa74-bd20-4121-82ef-c125f382ccf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:53.429475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c481aa74-bd20-4121-82ef-c125f382ccf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:53.432137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:53.442599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c481aa74-bd20-4121-82ef-c125f382ccf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:53.443414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c481aa74-bd20-4121-82ef-c125f382ccf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:53.444444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c481aa74-bd20-4121-82ef-c125f382ccf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:53.445728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c481aa74-bd20-4121-82ef-c125f382ccf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:53.660569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b2896c92-8fee-4861-b8b7-f65b69c0f031 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:53.669381 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b2896c92-8fee-4861-b8b7-f65b69c0f031 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1292 microversion: 2.1 time: 0.328472 Jul 26 14:18:53.670556 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1564/2957] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:53 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1292 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:53.678219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cf615f4d-2313-4caa-adf1-3608cccf0ca6 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f8799350b80>, body: {"security_group_rule": {"parent_group_id": "f4fd5c06-9fad-4fc0-a039-91dac2c3cf28", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:53.734192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c481aa74-bd20-4121-82ef-c125f382ccf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:53.751930 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c481aa74-bd20-4121-82ef-c125f382ccf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0" status: 200 len: 1323 microversion: 2.1 time: 0.334095 Jul 26 14:18:53.753602 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1394/2958] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:53 2022] GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 => generated 1323 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:53.765668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bea60971-d779-4466-adce-2f947d861ce9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:53.768285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bea60971-d779-4466-adce-2f947d861ce9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:53.783565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bea60971-d779-4466-adce-2f947d861ce9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:53.785079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bea60971-d779-4466-adce-2f947d861ce9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:53.786556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bea60971-d779-4466-adce-2f947d861ce9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:53.788443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bea60971-d779-4466-adce-2f947d861ce9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:54.054252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bea60971-d779-4466-adce-2f947d861ce9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:54.073953 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cf615f4d-2313-4caa-adf1-3608cccf0ca6 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.401661 Jul 26 14:18:54.076061 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1565/2959] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:18:53 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:54.080433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bea60971-d779-4466-adce-2f947d861ce9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:54.081104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2b6aebd8-f4fb-48c2-a53f-b37b34ffd9c4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:54.081742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2b6aebd8-f4fb-48c2-a53f-b37b34ffd9c4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:54.083430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bea60971-d779-4466-adce-2f947d861ce9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:54.087106 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bea60971-d779-4466-adce-2f947d861ce9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1600 microversion: 2.20 time: 0.331002 Jul 26 14:18:54.088284 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1395/2960] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:53 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1600 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:54.100014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9490bfd7-7f1f-4cfa-b5b7-d7a9e87d8673 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Action: 'create', calling method: .version_select at 0x7f8799437b80>, body: {"security_group_rule": {"parent_group_id": "f4fd5c06-9fad-4fc0-a039-91dac2c3cf28", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:54.113516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b6aebd8-f4fb-48c2-a53f-b37b34ffd9c4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:54.114284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b6aebd8-f4fb-48c2-a53f-b37b34ffd9c4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:54.125787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b6aebd8-f4fb-48c2-a53f-b37b34ffd9c4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:54.126371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b6aebd8-f4fb-48c2-a53f-b37b34ffd9c4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:54.370259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2b6aebd8-f4fb-48c2-a53f-b37b34ffd9c4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:54.385584 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2b6aebd8-f4fb-48c2-a53f-b37b34ffd9c4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1396 microversion: 2.1 time: 0.308133 Jul 26 14:18:54.402261 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1566/2961] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:54 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1396 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:54.418145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-573cf597-760c-4b1d-b86b-fb3fc82bb955 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:54.419036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-573cf597-760c-4b1d-b86b-fb3fc82bb955 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:54.434374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573cf597-760c-4b1d-b86b-fb3fc82bb955 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:54.439262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573cf597-760c-4b1d-b86b-fb3fc82bb955 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:54.441933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573cf597-760c-4b1d-b86b-fb3fc82bb955 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:54.442913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573cf597-760c-4b1d-b86b-fb3fc82bb955 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:54.595590 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-573cf597-760c-4b1d-b86b-fb3fc82bb955 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.191088 Jul 26 14:18:54.596664 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1567/2962] 10.222.0.70 () {60 vars in 1316 bytes} [Tue Jul 26 14:18:54 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:18:54.608155 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9490bfd7-7f1f-4cfa-b5b7-d7a9e87d8673 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.512554 Jul 26 14:18:54.608155 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1396/2963] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:18:54 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:54.608867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2d41e1ca-2f8f-4f1e-b6d3-e1b425f4febc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:54.609782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2d41e1ca-2f8f-4f1e-b6d3-e1b425f4febc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:54.617738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fcb9582c-71e8-44a4-8636-bfd1311340d7 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f8799264040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:54.619446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d41e1ca-2f8f-4f1e-b6d3-e1b425f4febc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:54.620336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d41e1ca-2f8f-4f1e-b6d3-e1b425f4febc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:54.621290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d41e1ca-2f8f-4f1e-b6d3-e1b425f4febc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:54.621845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2d41e1ca-2f8f-4f1e-b6d3-e1b425f4febc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:54.777890 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fcb9582c-71e8-44a4-8636-bfd1311340d7 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/f4fd5c06-9fad-4fc0-a039-91dac2c3cf28" status: 200 len: 663 microversion: 2.1 time: 0.166706 Jul 26 14:18:54.779897 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1568/2964] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:18:54 2022] GET /compute/v2.1/os-security-groups/f4fd5c06-9fad-4fc0-a039-91dac2c3cf28 => generated 663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:54.788976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9aa1831e-5310-4d91-b8a0-b381ff886275 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:54.789745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9aa1831e-5310-4d91-b8a0-b381ff886275 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:54.813447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9aa1831e-5310-4d91-b8a0-b381ff886275 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:54.814154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9aa1831e-5310-4d91-b8a0-b381ff886275 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:54.815034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9aa1831e-5310-4d91-b8a0-b381ff886275 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:54.816574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9aa1831e-5310-4d91-b8a0-b381ff886275 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:54.938308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:18:55.199038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2d41e1ca-2f8f-4f1e-b6d3-e1b425f4febc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:55.231051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2d41e1ca-2f8f-4f1e-b6d3-e1b425f4febc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:55.233137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2d41e1ca-2f8f-4f1e-b6d3-e1b425f4febc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:55.234457 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2d41e1ca-2f8f-4f1e-b6d3-e1b425f4febc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1874 microversion: 2.32 time: 0.630576 Jul 26 14:18:55.252648 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1397/2965] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:54 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1874 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:55.264576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b18525df-638d-4ca3-a73a-226c5a3d8290 req-d1ab6565-1e4d-4b6d-b955-6735c7f62bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4034f1ea-40a3-4aa7-8651-d090322b26d0", "name": "network-vif-plugged", "status": "completed", "tag": "9c25a792-23a6-49bb-abc9-17d93c26e1ad"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:55.277926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b18525df-638d-4ca3-a73a-226c5a3d8290 req-d1ab6565-1e4d-4b6d-b955-6735c7f62bfe service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:55.278316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b18525df-638d-4ca3-a73a-226c5a3d8290 req-d1ab6565-1e4d-4b6d-b955-6735c7f62bfe service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:55.297041 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b18525df-638d-4ca3-a73a-226c5a3d8290 req-d1ab6565-1e4d-4b6d-b955-6735c7f62bfe service nova] Creating event network-vif-plugged:9c25a792-23a6-49bb-abc9-17d93c26e1ad for instance 4034f1ea-40a3-4aa7-8651-d090322b26d0 on n-h2-833090-9 Jul 26 14:18:55.306704 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b18525df-638d-4ca3-a73a-226c5a3d8290 req-d1ab6565-1e4d-4b6d-b955-6735c7f62bfe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046534 Jul 26 14:18:55.306933 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1398/2966] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:55.320298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c8eee73f-a397-4f37-aed1-9ca55fcd3c6e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:55.324288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c8eee73f-a397-4f37-aed1-9ca55fcd3c6e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:55.332699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8eee73f-a397-4f37-aed1-9ca55fcd3c6e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:55.333464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8eee73f-a397-4f37-aed1-9ca55fcd3c6e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:55.334712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8eee73f-a397-4f37-aed1-9ca55fcd3c6e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:55.335167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8eee73f-a397-4f37-aed1-9ca55fcd3c6e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:55.538364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9aa1831e-5310-4d91-b8a0-b381ff886275 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:55.546489 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9aa1831e-5310-4d91-b8a0-b381ff886275 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1292 microversion: 2.1 time: 0.765193 Jul 26 14:18:55.560142 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1569/2967] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:54 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1292 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:55.572009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-93840d14-f542-437d-acc7-645f640c918c tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f8799399ee0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:55.708639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c8eee73f-a397-4f37-aed1-9ca55fcd3c6e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:55.720024 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c8eee73f-a397-4f37-aed1-9ca55fcd3c6e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0" status: 200 len: 1323 microversion: 2.1 time: 0.408686 Jul 26 14:18:55.722099 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1399/2968] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:55 2022] GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 => generated 1323 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:55.727603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c17e2d3b-2549-473d-8656-ccda923ba562 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:55.728611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c17e2d3b-2549-473d-8656-ccda923ba562 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:55.738783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c17e2d3b-2549-473d-8656-ccda923ba562 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:55.739874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c17e2d3b-2549-473d-8656-ccda923ba562 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:55.747715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c17e2d3b-2549-473d-8656-ccda923ba562 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:55.748262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c17e2d3b-2549-473d-8656-ccda923ba562 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:55.934757 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-93840d14-f542-437d-acc7-645f640c918c tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/08cb6e61-4723-4abd-b0b8-4ae1bd4618d3" status: 202 len: 0 microversion: 2.1 time: 0.364095 Jul 26 14:18:55.937830 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1570/2969] 10.222.0.70 () {58 vars in 1287 bytes} [Tue Jul 26 14:18:55 2022] DELETE /compute/v2.1/os-security-group-rules/08cb6e61-4723-4abd-b0b8-4ae1bd4618d3 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:18:55.986931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b87ced48-aea4-4fdc-8b91-990ea1d937a6 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f8799243af0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:56.195171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c17e2d3b-2549-473d-8656-ccda923ba562 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:56.208816 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c17e2d3b-2549-473d-8656-ccda923ba562 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1577 microversion: 2.1 time: 0.484921 Jul 26 14:18:56.209659 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1400/2970] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:55 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1577 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:56.236075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d136a0ff-0ef3-4f67-8674-66b302c1eb05 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:56.239194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d136a0ff-0ef3-4f67-8674-66b302c1eb05 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:56.247617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d136a0ff-0ef3-4f67-8674-66b302c1eb05 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:56.248112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d136a0ff-0ef3-4f67-8674-66b302c1eb05 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:56.249972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d136a0ff-0ef3-4f67-8674-66b302c1eb05 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:56.250867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d136a0ff-0ef3-4f67-8674-66b302c1eb05 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:56.480679 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d136a0ff-0ef3-4f67-8674-66b302c1eb05 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.248997 Jul 26 14:18:56.482171 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1401/2971] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:18:56 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668/os-interface => generated 285 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:18:56.499900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b5e5f8a5-914a-435a-9a42-4b9f6ba7e6c4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:56.501189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b5e5f8a5-914a-435a-9a42-4b9f6ba7e6c4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:56.528959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5e5f8a5-914a-435a-9a42-4b9f6ba7e6c4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:56.529935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5e5f8a5-914a-435a-9a42-4b9f6ba7e6c4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:56.531748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5e5f8a5-914a-435a-9a42-4b9f6ba7e6c4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:56.532507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5e5f8a5-914a-435a-9a42-4b9f6ba7e6c4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:57.112034 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b87ced48-aea4-4fdc-8b91-990ea1d937a6 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/f4fd5c06-9fad-4fc0-a039-91dac2c3cf28" status: 202 len: 0 microversion: 2.1 time: 1.160634 Jul 26 14:18:57.117930 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1571/2972] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:18:55 2022] DELETE /compute/v2.1/os-security-groups/f4fd5c06-9fad-4fc0-a039-91dac2c3cf28 => generated 0 bytes in 1169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:18:57.159146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-525a2f2b-d4d1-4e13-8d84-2e3e88bcb365 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb09fb5f-5806-4488-af51-8c82387d5b5c"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:57.181774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-525a2f2b-d4d1-4e13-8d84-2e3e88bcb365 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:57.200440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-525a2f2b-d4d1-4e13-8d84-2e3e88bcb365 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:57.200787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-525a2f2b-d4d1-4e13-8d84-2e3e88bcb365 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:57.215152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-525a2f2b-d4d1-4e13-8d84-2e3e88bcb365 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:57.220224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-525a2f2b-d4d1-4e13-8d84-2e3e88bcb365 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:57.593440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b5e5f8a5-914a-435a-9a42-4b9f6ba7e6c4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:57.610406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b5e5f8a5-914a-435a-9a42-4b9f6ba7e6c4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:57.632029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b5e5f8a5-914a-435a-9a42-4b9f6ba7e6c4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:57.635201 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b5e5f8a5-914a-435a-9a42-4b9f6ba7e6c4 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 2825 microversion: 2.32 time: 1.151053 Jul 26 14:18:57.636935 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1402/2973] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:18:56 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 2825 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:57.666738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1de3f940-af2d-4b3c-b5a4-f86c11fd1acf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:57.677727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1de3f940-af2d-4b3c-b5a4-f86c11fd1acf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:57.697038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1de3f940-af2d-4b3c-b5a4-f86c11fd1acf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:57.699213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1de3f940-af2d-4b3c-b5a4-f86c11fd1acf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:57.701974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1de3f940-af2d-4b3c-b5a4-f86c11fd1acf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:57.703852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1de3f940-af2d-4b3c-b5a4-f86c11fd1acf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:57.964862 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-525a2f2b-d4d1-4e13-8d84-2e3e88bcb365 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.843620 Jul 26 14:18:57.966178 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1572/2974] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:18:57 2022] POST /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:57.974449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2beda05a-2c1c-433d-8a74-0617bf5236af tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:57.975646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2beda05a-2c1c-433d-8a74-0617bf5236af tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:57.990517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2beda05a-2c1c-433d-8a74-0617bf5236af tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:57.994191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2beda05a-2c1c-433d-8a74-0617bf5236af tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:57.996694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2beda05a-2c1c-433d-8a74-0617bf5236af tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:57.997507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2beda05a-2c1c-433d-8a74-0617bf5236af tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:58.072317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1de3f940-af2d-4b3c-b5a4-f86c11fd1acf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:58.117921 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1de3f940-af2d-4b3c-b5a4-f86c11fd1acf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1292 microversion: 2.1 time: 0.478538 Jul 26 14:18:58.128473 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1403/2975] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:57 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1292 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:58.137748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f44001a6-9599-467c-a72d-ec2e783eb290 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f8799437af0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:58.265482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-f44001a6-9599-467c-a72d-ec2e783eb290 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f does not exist", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:18:58.266215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.security_group_api [None req-f44001a6-9599-467c-a72d-ec2e783eb290 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Neutron security group 19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f not found {{(pid=119478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:18:58.267017 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-f44001a6-9599-467c-a72d-ec2e783eb290 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] HTTP exception thrown: Security group 19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f does not exist Jul 26 14:18:58.267017 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-b72401e4-7234-469b-b150-814b90b17d87'] Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f44001a6-9599-467c-a72d-ec2e783eb290 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Request method failure captured: Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-security-groups/19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f HTTP/1.1 Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_euq25FezvPYtWQJ9g1etC0wws4gvMDdOC-C_ig-bTHijCW7YCskdaSlmGEAmJ-ai6rFIqMH2ZGygFqdWWcgn_A-yakk6FmGfSI2bTJ5wggkGTp6ek6htmMlBSBCemEN6eR2EALnANDPKBINJRhCokHT4EeG2K_htrEP_43tXuiYZk Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 88562c5b5873422bba7b9dfd2c4a508f Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1372559540 Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88562c5b5873422bba7b9dfd2c4a508f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/88562c5b5873422bba7b9dfd2c4a508f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_88562c5b5873422bba7b9dfd2c4a508f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/88562c5b5873422bba7b9dfd2c4a508f"}]}] Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1372559540 Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 88562c5b5873422bba7b9dfd2c4a508f Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1372559540 Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupRulesTestJSON-1372559540-project Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ecd1093b125f46dca61e38aff16757a6 Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1372559540-project Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: exception: Security group 19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f does not exist Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-b72401e4-7234-469b-b150-814b90b17d87'] Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f'} Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:18:58.278737 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f does not exist Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b72401e4-7234-469b-b150-814b90b17d87'] Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f does not exist Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b72401e4-7234-469b-b150-814b90b17d87'] Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f does not exist Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b72401e4-7234-469b-b150-814b90b17d87'] Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f does not exist Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b72401e4-7234-469b-b150-814b90b17d87'] Jul 26 14:18:58.284397 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:18:58.291703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f44001a6-9599-467c-a72d-ec2e783eb290 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Returning 404 to user: Security group 19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f does not exist Jul 26 14:18:58.291703 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-b72401e4-7234-469b-b150-814b90b17d87'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:18:58.291703 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f44001a6-9599-467c-a72d-ec2e783eb290 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f" status: 404 len: 194 microversion: 2.1 time: 0.161222 Jul 26 14:18:58.292552 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1404/2976] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:18:58 2022] DELETE /compute/v2.1/os-security-groups/19cf8249-6a93-43ee-a5ba-8fbcc1dbe78f => generated 194 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:18:58.297652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4c011548-471c-451a-8079-cc8b6729746d req-5dd284af-c90d-420a-a13c-c437400185d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd702cae-ec61-4f92-95d5-8a4a5dbf6f07", "name": "network-vif-plugged", "status": "completed", "tag": "c5a700b8-78be-414e-88a6-4c0bf7798dc5"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:58.322384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4c011548-471c-451a-8079-cc8b6729746d req-5dd284af-c90d-420a-a13c-c437400185d3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:58.325490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4c011548-471c-451a-8079-cc8b6729746d req-5dd284af-c90d-420a-a13c-c437400185d3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:58.365865 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4c011548-471c-451a-8079-cc8b6729746d req-5dd284af-c90d-420a-a13c-c437400185d3 service nova] Creating event network-vif-plugged:c5a700b8-78be-414e-88a6-4c0bf7798dc5 for instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 on n-h1-833090-9 Jul 26 14:18:58.378618 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4c011548-471c-451a-8079-cc8b6729746d req-5dd284af-c90d-420a-a13c-c437400185d3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083748 Jul 26 14:18:58.383632 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1405/2977] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:58.397705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4347fc3c-9cbc-4999-9492-ce2f716ab5fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:58.405014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4347fc3c-9cbc-4999-9492-ce2f716ab5fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:58.413390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4347fc3c-9cbc-4999-9492-ce2f716ab5fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:58.413789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4347fc3c-9cbc-4999-9492-ce2f716ab5fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:58.414613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4347fc3c-9cbc-4999-9492-ce2f716ab5fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:58.415071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4347fc3c-9cbc-4999-9492-ce2f716ab5fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:58.690669 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4347fc3c-9cbc-4999-9492-ce2f716ab5fd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.302958 Jul 26 14:18:58.708298 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1406/2978] 10.222.0.70 () {60 vars in 1316 bytes} [Tue Jul 26 14:18:58 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb/os-interface => generated 1830 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:18:58.713006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e8a16b52-cc0f-4f37-aef1-86a262b36846 req-1568e8fb-e9b1-47d4-b903-0b0b17eedcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9c25cd-3b3d-4c48-b620-b7ea6101bf3e", "tag": "13068f91-4844-4f82-95a3-ee7530c55d60"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:18:58.756950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e8a16b52-cc0f-4f37-aef1-86a262b36846 req-1568e8fb-e9b1-47d4-b903-0b0b17eedcd8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:58.757646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e8a16b52-cc0f-4f37-aef1-86a262b36846 req-1568e8fb-e9b1-47d4-b903-0b0b17eedcd8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:58.800084 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e8a16b52-cc0f-4f37-aef1-86a262b36846 req-1568e8fb-e9b1-47d4-b903-0b0b17eedcd8 service nova] Creating event network-changed:13068f91-4844-4f82-95a3-ee7530c55d60 for instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e on n-h1-833090-9 Jul 26 14:18:58.820231 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e8a16b52-cc0f-4f37-aef1-86a262b36846 req-1568e8fb-e9b1-47d4-b903-0b0b17eedcd8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124422 Jul 26 14:18:58.821308 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1407/2979] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:18:58.845531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0e8178de-66fe-434c-a802-9dfbfcf4909c tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f8799447f70>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:59.366175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2beda05a-2c1c-433d-8a74-0617bf5236af tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:18:59.374597 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2beda05a-2c1c-433d-8a74-0617bf5236af tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0" status: 200 len: 1323 microversion: 2.1 time: 1.406388 Jul 26 14:18:59.389217 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1573/2980] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:57 2022] GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 => generated 1323 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:18:59.405244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-79002429-352f-4335-ad26-bb21df6a8701 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:18:59.413068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79002429-352f-4335-ad26-bb21df6a8701 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:18:59.438099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79002429-352f-4335-ad26-bb21df6a8701 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:59.445238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79002429-352f-4335-ad26-bb21df6a8701 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:18:59.446373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79002429-352f-4335-ad26-bb21df6a8701 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:18:59.446996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79002429-352f-4335-ad26-bb21df6a8701 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:00.159198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-79002429-352f-4335-ad26-bb21df6a8701 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:00.185511 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-79002429-352f-4335-ad26-bb21df6a8701 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1472 microversion: 2.1 time: 0.789222 Jul 26 14:19:00.187046 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1574/2981] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:18:59 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1472 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:00.298516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1128572562", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:00.484733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] validate_networks() for [('2dc9e1a8-4a4f-459a-8038-83a80381fb0e', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:19:00.603010 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0e8178de-66fe-434c-a802-9dfbfcf4909c tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c9a1e438-5f00-4b19-8f91-ede234ee9670" status: 202 len: 0 microversion: 2.1 time: 1.774751 Jul 26 14:19:00.605383 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1408/2982] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:18:58 2022] DELETE /compute/v2.1/os-security-groups/c9a1e438-5f00-4b19-8f91-ede234ee9670 => generated 0 bytes in 1779 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:19:00.625961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-07793468-c4b2-4500-a94e-b79cf29b725e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:00.628211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-07793468-c4b2-4500-a94e-b79cf29b725e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:00.643011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07793468-c4b2-4500-a94e-b79cf29b725e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:00.655784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07793468-c4b2-4500-a94e-b79cf29b725e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:00.657941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07793468-c4b2-4500-a94e-b79cf29b725e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:00.659479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07793468-c4b2-4500-a94e-b79cf29b725e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:01.025051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-07793468-c4b2-4500-a94e-b79cf29b725e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:01.036899 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-07793468-c4b2-4500-a94e-b79cf29b725e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0" status: 200 len: 1515 microversion: 2.1 time: 0.429854 Jul 26 14:19:01.038929 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1409/2983] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:00 2022] GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 => generated 1515 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:01.043869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ae400fd9-dc80-4672-b880-2c7212b90cce req-165d0021-334e-4ef1-968d-e2b6f763c746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77241a1-3c1d-4054-af62-c60ff2ad00ef", "name": "network-vif-plugged", "status": "completed", "tag": "217dc8e3-1f0f-41ce-baf8-fc21aabc77a3"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:01.057301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ae400fd9-dc80-4672-b880-2c7212b90cce req-165d0021-334e-4ef1-968d-e2b6f763c746 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:01.058155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ae400fd9-dc80-4672-b880-2c7212b90cce req-165d0021-334e-4ef1-968d-e2b6f763c746 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:01.083100 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ae400fd9-dc80-4672-b880-2c7212b90cce req-165d0021-334e-4ef1-968d-e2b6f763c746 service nova] Creating event network-vif-plugged:217dc8e3-1f0f-41ce-baf8-fc21aabc77a3 for instance e77241a1-3c1d-4054-af62-c60ff2ad00ef on n-h2-833090-9 Jul 26 14:19:01.093358 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ae400fd9-dc80-4672-b880-2c7212b90cce req-165d0021-334e-4ef1-968d-e2b6f763c746 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052510 Jul 26 14:19:01.097808 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1410/2984] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:01.160404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-151e3a1e-d67f-42f1-b088-3cdd0e3b20de tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:01.164231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-151e3a1e-d67f-42f1-b088-3cdd0e3b20de tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:01.186723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-151e3a1e-d67f-42f1-b088-3cdd0e3b20de tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:01.192550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-151e3a1e-d67f-42f1-b088-3cdd0e3b20de tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:01.194534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-151e3a1e-d67f-42f1-b088-3cdd0e3b20de tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:01.195558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-151e3a1e-d67f-42f1-b088-3cdd0e3b20de tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:01.810201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:19:01.811802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:19:01.813484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:19:01.814226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:19:01.814961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:19:01.842365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:01.843075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:01.844361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:01.845120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:01.872020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:19:01.890239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for user 55daeaaa37a8498c9e540f5546277dc3 and project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:19:01.915371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:19:01.918306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-151e3a1e-d67f-42f1-b088-3cdd0e3b20de tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:01.920819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:19:01.922927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:01.953575 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-151e3a1e-d67f-42f1-b088-3cdd0e3b20de tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1577 microversion: 2.1 time: 0.843920 Jul 26 14:19:01.955018 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1411/2985] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:01 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1577 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:01.993299 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-47daf6da-fe44-4a3a-b08b-e0a081516ca0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.707745 Jul 26 14:19:01.995222 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1575/2986] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:19:02.002313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73daf8c1-4290-40d0-950a-ed456364e677 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f87992cdb80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:02.169487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f1e5f74c-736d-49f3-bae8-9d0f1a13256f req-f54fc05e-4cd3-4889-a2e9-950dbce168de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42c5141-d427-4b45-8d3f-facf56bfe668", "tag": "56cb7e7e-d518-4bee-8b79-70858a8691e3"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:02.221236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f1e5f74c-736d-49f3-bae8-9d0f1a13256f req-f54fc05e-4cd3-4889-a2e9-950dbce168de service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:02.224574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f1e5f74c-736d-49f3-bae8-9d0f1a13256f req-f54fc05e-4cd3-4889-a2e9-950dbce168de service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:02.295173 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f1e5f74c-736d-49f3-bae8-9d0f1a13256f req-f54fc05e-4cd3-4889-a2e9-950dbce168de service nova] Creating event network-changed:56cb7e7e-d518-4bee-8b79-70858a8691e3 for instance e42c5141-d427-4b45-8d3f-facf56bfe668 on n-h2-833090-9 Jul 26 14:19:02.305535 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f1e5f74c-736d-49f3-bae8-9d0f1a13256f req-f54fc05e-4cd3-4889-a2e9-950dbce168de service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347371 Jul 26 14:19:02.307408 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1412/2987] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:02.318521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e56e1141-c25e-4009-ae48-2864e1fafcaa tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:02.320152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e56e1141-c25e-4009-ae48-2864e1fafcaa tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:02.335719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e56e1141-c25e-4009-ae48-2864e1fafcaa tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:02.336794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e56e1141-c25e-4009-ae48-2864e1fafcaa tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:02.338424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e56e1141-c25e-4009-ae48-2864e1fafcaa tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:02.339441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e56e1141-c25e-4009-ae48-2864e1fafcaa tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:02.712405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e56e1141-c25e-4009-ae48-2864e1fafcaa tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:02.760059 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e56e1141-c25e-4009-ae48-2864e1fafcaa tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef" status: 200 len: 1323 microversion: 2.1 time: 0.436361 Jul 26 14:19:02.766841 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-73daf8c1-4290-40d0-950a-ed456364e677 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/4a2f3198-e07d-4772-9ffa-3f097d9b3d39" status: 202 len: 0 microversion: 2.1 time: 0.770314 Jul 26 14:19:02.767686 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1576/2988] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:19:01 2022] DELETE /compute/v2.1/os-security-groups/4a2f3198-e07d-4772-9ffa-3f097d9b3d39 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:19:02.775553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6adcbead-9636-4660-8c38-432822302767 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:02.777586 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1413/2989] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:02 2022] GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef => generated 1323 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:02.781368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6adcbead-9636-4660-8c38-432822302767 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:02.800826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64d643c7-4ced-40a6-9027-04df2aeed35a tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f8799268670>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:02.858418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6adcbead-9636-4660-8c38-432822302767 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:19:03.532487 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64d643c7-4ced-40a6-9027-04df2aeed35a tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/feae7dba-2752-46fd-8bd6-fe5ecfb71161" status: 202 len: 0 microversion: 2.1 time: 0.748637 Jul 26 14:19:03.534838 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1414/2990] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:19:02 2022] DELETE /compute/v2.1/os-security-groups/feae7dba-2752-46fd-8bd6-fe5ecfb71161 => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:19:03.546143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b4279e5c-e008-408b-9de4-265848f0353c req-ae4425c0-77e2-437e-9f71-35005efb54f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "tag": "725e91c3-1621-400a-b82a-3ec7c07edfc6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:03.591106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b4279e5c-e008-408b-9de4-265848f0353c req-ae4425c0-77e2-437e-9f71-35005efb54f5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:03.592007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b4279e5c-e008-408b-9de4-265848f0353c req-ae4425c0-77e2-437e-9f71-35005efb54f5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:03.630873 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b4279e5c-e008-408b-9de4-265848f0353c req-ae4425c0-77e2-437e-9f71-35005efb54f5 service nova] Creating event network-changed:725e91c3-1621-400a-b82a-3ec7c07edfc6 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:19:03.656739 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b4279e5c-e008-408b-9de4-265848f0353c req-ae4425c0-77e2-437e-9f71-35005efb54f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119763 Jul 26 14:19:03.657927 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1415/2991] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:03.671743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9dffa054-bb7d-4106-819e-44d13cb84b14 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f8799297d30>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:03.726461 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.scheduler.client.report [None req-6adcbead-9636-4660-8c38-432822302767 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Deleted allocations for instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 Jul 26 14:19:03.772089 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6adcbead-9636-4660-8c38-432822302767 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3" status: 204 len: 0 microversion: 2.1 time: 1.000969 Jul 26 14:19:03.778084 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1577/2992] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:19:02 2022] DELETE /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:19:03.796597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c72c8422-67b4-4ee4-aa67-e3b327c830c3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:03.798042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c72c8422-67b4-4ee4-aa67-e3b327c830c3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:03.811253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c72c8422-67b4-4ee4-aa67-e3b327c830c3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:03.812590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c72c8422-67b4-4ee4-aa67-e3b327c830c3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:03.814391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c72c8422-67b4-4ee4-aa67-e3b327c830c3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:03.815792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c72c8422-67b4-4ee4-aa67-e3b327c830c3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:03.881058 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c72c8422-67b4-4ee4-aa67-e3b327c830c3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c72c8422-67b4-4ee4-aa67-e3b327c830c3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 HTTP/1.1 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '1e83cb5b-8fa8-46d3-98f2-7dc424b164f3'} Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:03.887029 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:03.899318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:03.899318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:03.899318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:19:03.899318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:19:03.899318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:19:03.899318 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:03.899318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c72c8422-67b4-4ee4-aa67-e3b327c830c3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:19:03.899318 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c72c8422-67b4-4ee4-aa67-e3b327c830c3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3" status: 404 len: 111 microversion: 2.1 time: 0.113031 Jul 26 14:19:03.909445 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1578/2993] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:03 2022] GET /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:19:03.933752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c0ebbbf9-c560-4e9c-b6e2-fa6200208938 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:03.935380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0ebbbf9-c560-4e9c-b6e2-fa6200208938 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:03.964899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0ebbbf9-c560-4e9c-b6e2-fa6200208938 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:03.969105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0ebbbf9-c560-4e9c-b6e2-fa6200208938 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:03.972777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0ebbbf9-c560-4e9c-b6e2-fa6200208938 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:03.977196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0ebbbf9-c560-4e9c-b6e2-fa6200208938 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:04.595465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c0ebbbf9-c560-4e9c-b6e2-fa6200208938 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:04.630657 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c0ebbbf9-c560-4e9c-b6e2-fa6200208938 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef" status: 200 len: 1323 microversion: 2.1 time: 0.715927 Jul 26 14:19:04.640029 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1579/2994] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:03 2022] GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef => generated 1323 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:04.653515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-683872572", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "2dc9e1a8-4a4f-459a-8038-83a80381fb0e"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:04.755117 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9dffa054-bb7d-4106-819e-44d13cb84b14 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/4640d08f-3953-4aca-af8b-3dd609b60a48" status: 202 len: 0 microversion: 2.1 time: 1.094671 Jul 26 14:19:04.761931 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1416/2995] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:19:03 2022] DELETE /compute/v2.1/os-security-groups/4640d08f-3953-4aca-af8b-3dd609b60a48 => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:19:04.771695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dac4b1f3-06d3-43a7-978f-5d9c22d47a70 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] Calling method '.version_select at 0x7f87993b84c0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:04.813975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] validate_networks() for [('2dc9e1a8-4a4f-459a-8038-83a80381fb0e', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:19:05.810876 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dac4b1f3-06d3-43a7-978f-5d9c22d47a70 tempest-SecurityGroupRulesTestJSON-1372559540 tempest-SecurityGroupRulesTestJSON-1372559540-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/dabc86e8-fea7-47ee-a1d2-1c2678d5e2fd" status: 202 len: 0 microversion: 2.1 time: 1.046179 Jul 26 14:19:05.813944 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1417/2996] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:19:04 2022] DELETE /compute/v2.1/os-security-groups/dabc86e8-fea7-47ee-a1d2-1c2678d5e2fd => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:19:05.849268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1648775c-2548-4019-aa45-9b632ea089ac tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:05.851411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1648775c-2548-4019-aa45-9b632ea089ac tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:05.873333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1648775c-2548-4019-aa45-9b632ea089ac tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:05.876046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1648775c-2548-4019-aa45-9b632ea089ac tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:05.917932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1648775c-2548-4019-aa45-9b632ea089ac tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:05.918780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1648775c-2548-4019-aa45-9b632ea089ac tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:05.984784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:19:05.987218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:19:05.988484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:19:05.990342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:19:05.991326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:19:06.013829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:06.015702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:06.017436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:06.019596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:06.054668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:19:06.066223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for user 55daeaaa37a8498c9e540f5546277dc3 and project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:19:06.090836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:19:06.095532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:19:06.204309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1648775c-2548-4019-aa45-9b632ea089ac tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:06.223977 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1648775c-2548-4019-aa45-9b632ea089ac tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef" status: 200 len: 1515 microversion: 2.1 time: 0.406815 Jul 26 14:19:06.227091 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1418/2997] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:05 2022] GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef => generated 1515 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:06.254246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bdfbc344-0d42-45bc-83a2-519ea63c8d3b tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:06.255284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bdfbc344-0d42-45bc-83a2-519ea63c8d3b tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: fd702cae-ec61-4f92-95d5-8a4a5dbf6f07] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:06.267753 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f45bf719-9b75-43cb-aa13-198ac03251a2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.630997 Jul 26 14:19:06.274720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bdfbc344-0d42-45bc-83a2-519ea63c8d3b tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:06.275978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bdfbc344-0d42-45bc-83a2-519ea63c8d3b tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:06.277594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bdfbc344-0d42-45bc-83a2-519ea63c8d3b tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:06.279733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bdfbc344-0d42-45bc-83a2-519ea63c8d3b tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:06.281351 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1580/2998] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:19:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:19:06.290677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2e895637-2d63-49a7-a424-d102e8441e4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:06.292080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2e895637-2d63-49a7-a424-d102e8441e4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:06.398626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2e895637-2d63-49a7-a424-d102e8441e4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:06.414822 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2e895637-2d63-49a7-a424-d102e8441e4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1220 microversion: 2.1 time: 0.131296 Jul 26 14:19:06.425044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1581/2999] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:06 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:06.599198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bdfbc344-0d42-45bc-83a2-519ea63c8d3b tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:06.617687 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bdfbc344-0d42-45bc-83a2-519ea63c8d3b tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07" status: 200 len: 1515 microversion: 2.1 time: 0.370804 Jul 26 14:19:06.628383 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1419/3000] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:06 2022] GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:19:06.648119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-15c9783f-7c97-4cd5-ae98-cab012bc1e8c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:06.648991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-15c9783f-7c97-4cd5-ae98-cab012bc1e8c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: fd702cae-ec61-4f92-95d5-8a4a5dbf6f07] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:06.659826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15c9783f-7c97-4cd5-ae98-cab012bc1e8c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:06.661358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15c9783f-7c97-4cd5-ae98-cab012bc1e8c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:06.662766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15c9783f-7c97-4cd5-ae98-cab012bc1e8c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:06.663759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15c9783f-7c97-4cd5-ae98-cab012bc1e8c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:06.731346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-15c9783f-7c97-4cd5-ae98-cab012bc1e8c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: fd702cae-ec61-4f92-95d5-8a4a5dbf6f07] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:19:06.891069 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-15c9783f-7c97-4cd5-ae98-cab012bc1e8c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07" status: 204 len: 0 microversion: 2.1 time: 0.246168 Jul 26 14:19:06.896064 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1582/3001] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:19:06 2022] DELETE /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:19:06.912180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fc898a24-f7c5-46db-9033-d8202fb67266 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:06.914820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fc898a24-f7c5-46db-9033-d8202fb67266 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: fd702cae-ec61-4f92-95d5-8a4a5dbf6f07] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:06.926953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc898a24-f7c5-46db-9033-d8202fb67266 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:06.927842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc898a24-f7c5-46db-9033-d8202fb67266 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:06.929715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc898a24-f7c5-46db-9033-d8202fb67266 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:06.930632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc898a24-f7c5-46db-9033-d8202fb67266 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:07.179212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fc898a24-f7c5-46db-9033-d8202fb67266 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:07.192352 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fc898a24-f7c5-46db-9033-d8202fb67266 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07" status: 200 len: 1521 microversion: 2.1 time: 0.291457 Jul 26 14:19:07.204483 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1420/3002] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:06 2022] GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:07.468901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e50b3269-7aca-4a9b-b312-30ac2f698c51 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:07.470038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e50b3269-7aca-4a9b-b312-30ac2f698c51 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:07.484722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e50b3269-7aca-4a9b-b312-30ac2f698c51 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:07.485963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e50b3269-7aca-4a9b-b312-30ac2f698c51 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:07.488389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e50b3269-7aca-4a9b-b312-30ac2f698c51 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:07.489160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e50b3269-7aca-4a9b-b312-30ac2f698c51 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:07.617668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e50b3269-7aca-4a9b-b312-30ac2f698c51 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:07.632445 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e50b3269-7aca-4a9b-b312-30ac2f698c51 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1224 microversion: 2.1 time: 0.171024 Jul 26 14:19:07.633476 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1583/3003] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:07 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1224 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:08.227641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-42acd3fb-fcb5-4422-a213-52293f783f43 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:08.229193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-42acd3fb-fcb5-4422-a213-52293f783f43 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: fd702cae-ec61-4f92-95d5-8a4a5dbf6f07] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:08.242370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42acd3fb-fcb5-4422-a213-52293f783f43 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:08.243644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42acd3fb-fcb5-4422-a213-52293f783f43 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:08.245513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42acd3fb-fcb5-4422-a213-52293f783f43 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:08.246769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42acd3fb-fcb5-4422-a213-52293f783f43 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:08.523329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-42acd3fb-fcb5-4422-a213-52293f783f43 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:08.542138 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-42acd3fb-fcb5-4422-a213-52293f783f43 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07" status: 200 len: 1521 microversion: 2.1 time: 0.322854 Jul 26 14:19:08.544354 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1421/3004] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:08 2022] GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:08.674119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6682d73d-2f9d-4cec-9512-dec62057a78f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:08.678714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6682d73d-2f9d-4cec-9512-dec62057a78f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:08.690669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:08.705022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6682d73d-2f9d-4cec-9512-dec62057a78f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:08.706751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6682d73d-2f9d-4cec-9512-dec62057a78f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:08.710123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6682d73d-2f9d-4cec-9512-dec62057a78f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:08.711183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6682d73d-2f9d-4cec-9512-dec62057a78f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:08.880094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6682d73d-2f9d-4cec-9512-dec62057a78f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:08.889742 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6682d73d-2f9d-4cec-9512-dec62057a78f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1272 microversion: 2.1 time: 0.225333 Jul 26 14:19:08.890618 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1584/3005] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:08 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:09.575691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1be97d1d-aa24-481c-8d35-56ceda884b0c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:09.576620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1be97d1d-aa24-481c-8d35-56ceda884b0c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: fd702cae-ec61-4f92-95d5-8a4a5dbf6f07] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:09.597267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1be97d1d-aa24-481c-8d35-56ceda884b0c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:09.600278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1be97d1d-aa24-481c-8d35-56ceda884b0c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:09.603507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1be97d1d-aa24-481c-8d35-56ceda884b0c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:09.604670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1be97d1d-aa24-481c-8d35-56ceda884b0c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:09.877523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-93a6c378-ba56-48a5-83cc-14c0f354e7d7 req-e66a5519-6cc2-4c4b-b3ba-185527251b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd702cae-ec61-4f92-95d5-8a4a5dbf6f07", "name": "network-vif-deleted", "tag": "c5a700b8-78be-414e-88a6-4c0bf7798dc5"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:09.928213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-93a6c378-ba56-48a5-83cc-14c0f354e7d7 req-e66a5519-6cc2-4c4b-b3ba-185527251b20 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:09.929605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-93a6c378-ba56-48a5-83cc-14c0f354e7d7 req-e66a5519-6cc2-4c4b-b3ba-185527251b20 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:09.961403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1be97d1d-aa24-481c-8d35-56ceda884b0c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:09.988213 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1be97d1d-aa24-481c-8d35-56ceda884b0c tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07" status: 200 len: 1479 microversion: 2.1 time: 0.416452 Jul 26 14:19:09.990880 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1422/3006] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:09 2022] GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 => generated 1479 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:10.010863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7c6e99a-631b-42c7-90fb-2d500006bcde tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:10.016651 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-93a6c378-ba56-48a5-83cc-14c0f354e7d7 req-e66a5519-6cc2-4c4b-b3ba-185527251b20 service nova] Creating event network-vif-deleted:c5a700b8-78be-414e-88a6-4c0bf7798dc5 for instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 on n-h1-833090-9 Jul 26 14:19:10.021295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c7c6e99a-631b-42c7-90fb-2d500006bcde tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:10.036902 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-93a6c378-ba56-48a5-83cc-14c0f354e7d7 req-e66a5519-6cc2-4c4b-b3ba-185527251b20 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167158 Jul 26 14:19:10.041587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7c6e99a-631b-42c7-90fb-2d500006bcde tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:10.042405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7c6e99a-631b-42c7-90fb-2d500006bcde tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:10.044967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7c6e99a-631b-42c7-90fb-2d500006bcde tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:10.046980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7c6e99a-631b-42c7-90fb-2d500006bcde tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:10.055203 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1585/3007] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:19:10.206842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c7c6e99a-631b-42c7-90fb-2d500006bcde tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:10.232997 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c7c6e99a-631b-42c7-90fb-2d500006bcde tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1278 microversion: 2.1 time: 0.239416 Jul 26 14:19:10.246563 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1423/3008] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:09 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:11.040170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cb855ea-07d1-4a2c-a398-9a6ba63e5bf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:11.042321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5cb855ea-07d1-4a2c-a398-9a6ba63e5bf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: fd702cae-ec61-4f92-95d5-8a4a5dbf6f07] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:11.056710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cb855ea-07d1-4a2c-a398-9a6ba63e5bf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.065930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cb855ea-07d1-4a2c-a398-9a6ba63e5bf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.068755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cb855ea-07d1-4a2c-a398-9a6ba63e5bf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.070450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cb855ea-07d1-4a2c-a398-9a6ba63e5bf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.094340 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-5cb855ea-07d1-4a2c-a398-9a6ba63e5bf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] HTTP exception thrown: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cb855ea-07d1-4a2c-a398-9a6ba63e5bf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Request method failure captured: Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 HTTP/1.1 Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e7y1RFqunQHxtTGWbEoiIjOeltzXj7E9EabttKkx4kC_tPZngOYVwZzbmnkKi-YhCpQqrCXjEcazJxXKtg857lmGlHMBUg-I7FGOt3BFrK19G4ElA7dvZZ03OH0jfCvTl7k52Jzfrpvz4A0oODHvpc_xjXK3PON8eVaIjeqPaHrsk Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d37e260b04147cd99d35aca62da8d25", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}] Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e085b43a4d3a463c94540c2b0469bb56 Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'fd702cae-ec61-4f92-95d5-8a4a5dbf6f07'} Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:11.097593 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.102760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.102760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:11.102760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:11.102760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:19:11.102760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:19:11.102760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:11.102760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.105199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cb855ea-07d1-4a2c-a398-9a6ba63e5bf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Returning 404 to user: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:19:11.106520 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5cb855ea-07d1-4a2c-a398-9a6ba63e5bf7 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07" status: 404 len: 111 microversion: 2.1 time: 0.085028 Jul 26 14:19:11.108998 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1586/3009] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:11 2022] GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:19:11.125968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-798d5e09-6945-4b6b-a50f-7cda925025a5 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:11.138365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-798d5e09-6945-4b6b-a50f-7cda925025a5 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:11.140794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-798d5e09-6945-4b6b-a50f-7cda925025a5 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '4d37e260b04147cd99d35aca62da8d25'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:19:11.152665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-798d5e09-6945-4b6b-a50f-7cda925025a5 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.153934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-798d5e09-6945-4b6b-a50f-7cda925025a5 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.155764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-798d5e09-6945-4b6b-a50f-7cda925025a5 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.157023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-798d5e09-6945-4b6b-a50f-7cda925025a5 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.280665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c110c7e2-9537-48a4-a283-c18a6fb06272 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:11.281837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c110c7e2-9537-48a4-a283-c18a6fb06272 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:11.312542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c110c7e2-9537-48a4-a283-c18a6fb06272 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.313506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c110c7e2-9537-48a4-a283-c18a6fb06272 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.315454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c110c7e2-9537-48a4-a283-c18a6fb06272 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.316302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c110c7e2-9537-48a4-a283-c18a6fb06272 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.335530 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-798d5e09-6945-4b6b-a50f-7cda925025a5 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.218471 Jul 26 14:19:11.336860 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1424/3010] 10.222.0.70 () {58 vars in 1230 bytes} [Tue Jul 26 14:19:11 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:19:11.361065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae0bbad1-a976-4c27-a8ce-c37e9409f6a6 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae0bbad1-a976-4c27-a8ce-c37e9409f6a6 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Request method failure captured: Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e7y1RFqunQHxtTGWbEoiIjOeltzXj7E9EabttKkx4kC_tPZngOYVwZzbmnkKi-YhCpQqrCXjEcazJxXKtg857lmGlHMBUg-I7FGOt3BFrK19G4ElA7dvZZ03OH0jfCvTl7k52Jzfrpvz4A0oODHvpc_xjXK3PON8eVaIjeqPaHrsk Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d37e260b04147cd99d35aca62da8d25", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}] Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: e085b43a4d3a463c94540c2b0469bb56 Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: action_args: {} Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 26 14:19:11.369780 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae0bbad1-a976-4c27-a8ce-c37e9409f6a6 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:19:11.380426 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ae0bbad1-a976-4c27-a8ce-c37e9409f6a6 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.017367 Jul 26 14:19:11.384153 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1425/3011] 10.222.0.70 () {58 vars in 1182 bytes} [Tue Jul 26 14:19:11 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 14:19:11.394396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4aed7597-952e-483f-816c-5edcd5137a48 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:11.401105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4aed7597-952e-483f-816c-5edcd5137a48 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:11.402337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4aed7597-952e-483f-816c-5edcd5137a48 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Searching by: {'deleted': False, 'project_id': '4d37e260b04147cd99d35aca62da8d25'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:19:11.413122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4aed7597-952e-483f-816c-5edcd5137a48 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.413964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4aed7597-952e-483f-816c-5edcd5137a48 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.415350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4aed7597-952e-483f-816c-5edcd5137a48 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.416058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4aed7597-952e-483f-816c-5edcd5137a48 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.457250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-4aed7597-952e-483f-816c-5edcd5137a48 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:19:11.501250 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4aed7597-952e-483f-816c-5edcd5137a48 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.115670 Jul 26 14:19:11.501798 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1426/3012] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:19:11 2022] GET /compute/v2.1/servers => generated 683 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:11.519237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c110c7e2-9537-48a4-a283-c18a6fb06272 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:11.522598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fe643274-ab2f-4570-8241-093e9c6c3174 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:11.532339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fe643274-ab2f-4570-8241-093e9c6c3174 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:11.534401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.compute.servers [None req-fe643274-ab2f-4570-8241-093e9c6c3174 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Removing options 'limit' from query {{(pid=119478) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 26 14:19:11.535447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fe643274-ab2f-4570-8241-093e9c6c3174 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Searching by: {'deleted': False, 'project_id': '4d37e260b04147cd99d35aca62da8d25'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:19:11.545794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe643274-ab2f-4570-8241-093e9c6c3174 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.546733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe643274-ab2f-4570-8241-093e9c6c3174 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.548241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe643274-ab2f-4570-8241-093e9c6c3174 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.550736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe643274-ab2f-4570-8241-093e9c6c3174 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.552065 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c110c7e2-9537-48a4-a283-c18a6fb06272 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1278 microversion: 2.1 time: 0.280285 Jul 26 14:19:11.554445 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1587/3013] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:11 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1278 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:11.598217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-fe643274-ab2f-4570-8241-093e9c6c3174 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:19:11.638752 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fe643274-ab2f-4570-8241-093e9c6c3174 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.123853 Jul 26 14:19:11.639627 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1427/3014] 10.222.0.70 () {58 vars in 1144 bytes} [Tue Jul 26 14:19:11 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:11.660915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8894f18e-a62d-47ab-aef6-7fad7ad60b03 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8894f18e-a62d-47ab-aef6-7fad7ad60b03 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Request method failure captured: Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e7y1RFqunQHxtTGWbEoiIjOeltzXj7E9EabttKkx4kC_tPZngOYVwZzbmnkKi-YhCpQqrCXjEcazJxXKtg857lmGlHMBUg-I7FGOt3BFrK19G4ElA7dvZZ03OH0jfCvTl7k52Jzfrpvz4A0oODHvpc_xjXK3PON8eVaIjeqPaHrsk Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d37e260b04147cd99d35aca62da8d25", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}] Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e085b43a4d3a463c94540c2b0469bb56 Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: action_args: {} Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi '-1' Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 26 14:19:11.665760 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 26 14:19:11.670038 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.674995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8894f18e-a62d-47ab-aef6-7fad7ad60b03 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:19:11.674995 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8894f18e-a62d-47ab-aef6-7fad7ad60b03 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.019258 Jul 26 14:19:11.675830 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1588/3015] 10.222.0.70 () {58 vars in 1142 bytes} [Tue Jul 26 14:19:11 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:19:11.692635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c72f11dd-8421-44be-bef1-82d281181b56 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c72f11dd-8421-44be-bef1-82d281181b56 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Request method failure captured: Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e7y1RFqunQHxtTGWbEoiIjOeltzXj7E9EabttKkx4kC_tPZngOYVwZzbmnkKi-YhCpQqrCXjEcazJxXKtg857lmGlHMBUg-I7FGOt3BFrK19G4ElA7dvZZ03OH0jfCvTl7k52Jzfrpvz4A0oODHvpc_xjXK3PON8eVaIjeqPaHrsk Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d37e260b04147cd99d35aca62da8d25", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}] Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: e085b43a4d3a463c94540c2b0469bb56 Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: action_args: {} Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'testing' Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 26 14:19:11.699672 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c72f11dd-8421-44be-bef1-82d281181b56 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c72f11dd-8421-44be-bef1-82d281181b56 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017192 Jul 26 14:19:11.712602 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1428/3016] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:19:11 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:19:11.727666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-10a8af8b-c9c4-4782-ad35-c81d3d98784f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:11.746374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-10a8af8b-c9c4-4782-ad35-c81d3d98784f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:11.751041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-10a8af8b-c9c4-4782-ad35-c81d3d98784f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '4d37e260b04147cd99d35aca62da8d25'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:19:11.765367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.servers [None req-10a8af8b-c9c4-4782-ad35-c81d3d98784f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Flavor 'non_existing_flavor' could not be found {{(pid=119479) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 26 14:19:11.766750 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-10a8af8b-c9c4-4782-ad35-c81d3d98784f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.049383 Jul 26 14:19:11.767574 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1589/3017] 10.222.0.70 () {58 vars in 1178 bytes} [Tue Jul 26 14:19:11 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:19:11.785871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c44ddfe-51c6-4383-b0f6-f3e5c0a3a868 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:11.793507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c44ddfe-51c6-4383-b0f6-f3e5c0a3a868 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:11.794919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c44ddfe-51c6-4383-b0f6-f3e5c0a3a868 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '4d37e260b04147cd99d35aca62da8d25'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:19:11.812595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c44ddfe-51c6-4383-b0f6-f3e5c0a3a868 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.813215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c44ddfe-51c6-4383-b0f6-f3e5c0a3a868 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.814554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c44ddfe-51c6-4383-b0f6-f3e5c0a3a868 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:11.815641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c44ddfe-51c6-4383-b0f6-f3e5c0a3a868 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:11.999842 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c44ddfe-51c6-4383-b0f6-f3e5c0a3a868 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.220232 Jul 26 14:19:12.000986 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1429/3018] 10.222.0.70 () {58 vars in 1174 bytes} [Tue Jul 26 14:19:11 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:19:12.022993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c62d766e-01a3-480e-b2ba-a2e6ac32ba15 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:12.041334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c62d766e-01a3-480e-b2ba-a2e6ac32ba15 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:12.042448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c62d766e-01a3-480e-b2ba-a2e6ac32ba15 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '4d37e260b04147cd99d35aca62da8d25'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:19:12.054611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c62d766e-01a3-480e-b2ba-a2e6ac32ba15 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:12.055685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c62d766e-01a3-480e-b2ba-a2e6ac32ba15 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:12.057380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c62d766e-01a3-480e-b2ba-a2e6ac32ba15 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:12.058413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c62d766e-01a3-480e-b2ba-a2e6ac32ba15 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:12.246591 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c62d766e-01a3-480e-b2ba-a2e6ac32ba15 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.230239 Jul 26 14:19:12.248165 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1590/3019] 10.222.0.70 () {58 vars in 1184 bytes} [Tue Jul 26 14:19:12 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:19:12.271454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:12.280858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:12.282691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Searching by: {'deleted': False, 'project_id': '4d37e260b04147cd99d35aca62da8d25'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:19:12.295183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:12.296557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:12.298464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:12.299894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:12.366220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:19:12.468292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:12.480581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:12.481501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:12.605996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-966e3d07-9609-44fa-84e9-9dc383753e10 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:12.607371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-966e3d07-9609-44fa-84e9-9dc383753e10 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:12.619564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-966e3d07-9609-44fa-84e9-9dc383753e10 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:12.620727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-966e3d07-9609-44fa-84e9-9dc383753e10 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:12.622322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-966e3d07-9609-44fa-84e9-9dc383753e10 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:12.623376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-966e3d07-9609-44fa-84e9-9dc383753e10 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:13.086021 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5295cb9d-e7d2-4920-b2c5-c26e19c820bf tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.822744 Jul 26 14:19:13.086417 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1430/3020] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:19:12 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:13.142342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-06b1b294-7c3b-4192-8231-366e541540ba tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:13.154353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-06b1b294-7c3b-4192-8231-366e541540ba tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:13.156712 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-06b1b294-7c3b-4192-8231-366e541540ba tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.025098 Jul 26 14:19:13.163903 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1431/3021] 10.222.0.70 () {58 vars in 1178 bytes} [Tue Jul 26 14:19:13 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:19:13.182146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6ab15ec0-b37c-4446-af5f-26f549e2fe92 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:13.193345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6ab15ec0-b37c-4446-af5f-26f549e2fe92 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:13.196312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6ab15ec0-b37c-4446-af5f-26f549e2fe92 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Searching by: {'deleted': False, 'project_id': '4d37e260b04147cd99d35aca62da8d25'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:19:13.212841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ab15ec0-b37c-4446-af5f-26f549e2fe92 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:13.214245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ab15ec0-b37c-4446-af5f-26f549e2fe92 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:13.216445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ab15ec0-b37c-4446-af5f-26f549e2fe92 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:13.217772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ab15ec0-b37c-4446-af5f-26f549e2fe92 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:13.260738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-966e3d07-9609-44fa-84e9-9dc383753e10 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:13.279367 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-966e3d07-9609-44fa-84e9-9dc383753e10 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1320 microversion: 2.1 time: 0.691571 Jul 26 14:19:13.280561 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1591/3022] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:12 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1320 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:13.295383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-6ab15ec0-b37c-4446-af5f-26f549e2fe92 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:19:13.368166 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6ab15ec0-b37c-4446-af5f-26f549e2fe92 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.196313 Jul 26 14:19:13.383005 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1432/3023] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:19:13 2022] GET /compute/v2.1/servers => generated 683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:13.395497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1562c829-23cc-4acb-97c1-6c04aa70ebeb tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:13.396465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1562c829-23cc-4acb-97c1-6c04aa70ebeb tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: fd702cae-ec61-4f92-95d5-8a4a5dbf6f07] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:13.411091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1562c829-23cc-4acb-97c1-6c04aa70ebeb tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:13.412631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1562c829-23cc-4acb-97c1-6c04aa70ebeb tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:13.414423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1562c829-23cc-4acb-97c1-6c04aa70ebeb tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:13.415480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1562c829-23cc-4acb-97c1-6c04aa70ebeb tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:13.463814 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-1562c829-23cc-4acb-97c1-6c04aa70ebeb tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] HTTP exception thrown: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1562c829-23cc-4acb-97c1-6c04aa70ebeb tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Request method failure captured: Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 HTTP/1.1 Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e7y1RFqunQHxtTGWbEoiIjOeltzXj7E9EabttKkx4kC_tPZngOYVwZzbmnkKi-YhCpQqrCXjEcazJxXKtg857lmGlHMBUg-I7FGOt3BFrK19G4ElA7dvZZ03OH0jfCvTl7k52Jzfrpvz4A0oODHvpc_xjXK3PON8eVaIjeqPaHrsk Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d37e260b04147cd99d35aca62da8d25", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}] Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e085b43a4d3a463c94540c2b0469bb56 Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'fd702cae-ec61-4f92-95d5-8a4a5dbf6f07'} Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:19:13.466723 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1562c829-23cc-4acb-97c1-6c04aa70ebeb tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Returning 404 to user: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1562c829-23cc-4acb-97c1-6c04aa70ebeb tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07" status: 404 len: 111 microversion: 2.1 time: 0.084074 Jul 26 14:19:13.477251 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1592/3024] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:19:13 2022] DELETE /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:19:13.487312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e1e6fce2-a755-4598-bca0-1662226c89bc tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:13.487576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e1e6fce2-a755-4598-bca0-1662226c89bc tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:13.498722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1e6fce2-a755-4598-bca0-1662226c89bc tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:13.499413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1e6fce2-a755-4598-bca0-1662226c89bc tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:13.501850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1e6fce2-a755-4598-bca0-1662226c89bc tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:13.503376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1e6fce2-a755-4598-bca0-1662226c89bc tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:13.560672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e1e6fce2-a755-4598-bca0-1662226c89bc tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:19:13.680340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:13.761282 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e1e6fce2-a755-4598-bca0-1662226c89bc tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef" status: 204 len: 0 microversion: 2.1 time: 0.276488 Jul 26 14:19:13.764931 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1433/3025] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:19:13 2022] DELETE /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:19:13.786788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c358a610-7202-4ea9-bf6b-52960dc87e0e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:13.790442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c358a610-7202-4ea9-bf6b-52960dc87e0e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:13.807828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c358a610-7202-4ea9-bf6b-52960dc87e0e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:13.810163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c358a610-7202-4ea9-bf6b-52960dc87e0e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:13.812252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c358a610-7202-4ea9-bf6b-52960dc87e0e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:13.813746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c358a610-7202-4ea9-bf6b-52960dc87e0e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:13.878575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c358a610-7202-4ea9-bf6b-52960dc87e0e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:19:13.998092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:14.108784 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c358a610-7202-4ea9-bf6b-52960dc87e0e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0" status: 204 len: 0 microversion: 2.1 time: 0.335152 Jul 26 14:19:14.111083 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1593/3026] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:19:13 2022] DELETE /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:19:14.127102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8992e4d9-49e1-4ad4-b67d-85ece31af2c0 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:14.130022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8992e4d9-49e1-4ad4-b67d-85ece31af2c0 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: fd702cae-ec61-4f92-95d5-8a4a5dbf6f07] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:14.140440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8992e4d9-49e1-4ad4-b67d-85ece31af2c0 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:14.141586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8992e4d9-49e1-4ad4-b67d-85ece31af2c0 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:14.143026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8992e4d9-49e1-4ad4-b67d-85ece31af2c0 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:14.144195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8992e4d9-49e1-4ad4-b67d-85ece31af2c0 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:14.171134 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8992e4d9-49e1-4ad4-b67d-85ece31af2c0 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] HTTP exception thrown: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8992e4d9-49e1-4ad4-b67d-85ece31af2c0 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Request method failure captured: Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 HTTP/1.1 Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e7y1RFqunQHxtTGWbEoiIjOeltzXj7E9EabttKkx4kC_tPZngOYVwZzbmnkKi-YhCpQqrCXjEcazJxXKtg857lmGlHMBUg-I7FGOt3BFrK19G4ElA7dvZZ03OH0jfCvTl7k52Jzfrpvz4A0oODHvpc_xjXK3PON8eVaIjeqPaHrsk Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d37e260b04147cd99d35aca62da8d25", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}] Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: e085b43a4d3a463c94540c2b0469bb56 Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'fd702cae-ec61-4f92-95d5-8a4a5dbf6f07'} Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:14.174224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:14.182236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:14.182236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:14.182236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:14.182236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:19:14.182236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:19:14.182236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. Jul 26 14:19:14.182236 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:14.182236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8992e4d9-49e1-4ad4-b67d-85ece31af2c0 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Returning 404 to user: Instance fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:19:14.182236 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8992e4d9-49e1-4ad4-b67d-85ece31af2c0 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07" status: 404 len: 111 microversion: 2.1 time: 0.059034 Jul 26 14:19:14.182236 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1434/3027] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:14 2022] GET /compute/v2.1/servers/fd702cae-ec61-4f92-95d5-8a4a5dbf6f07 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:19:14.192312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57caba5f-e266-4822-94d8-ad1108aa654f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:14.193056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-57caba5f-e266-4822-94d8-ad1108aa654f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:14.200842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57caba5f-e266-4822-94d8-ad1108aa654f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:14.201330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57caba5f-e266-4822-94d8-ad1108aa654f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:14.202408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57caba5f-e266-4822-94d8-ad1108aa654f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:14.202871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57caba5f-e266-4822-94d8-ad1108aa654f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:14.259322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f32ad582-1e8c-427e-92c1-ebb8082b3218 req-7c09dd67-2a72-492e-aa8c-eb2c92dd0569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ccb0c1e-a856-4624-8324-90163926e89a", "tag": "0f75abb1-f4c5-4cde-bfa8-298bea8b6035"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:14.280839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f32ad582-1e8c-427e-92c1-ebb8082b3218 req-7c09dd67-2a72-492e-aa8c-eb2c92dd0569 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:14.281451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f32ad582-1e8c-427e-92c1-ebb8082b3218 req-7c09dd67-2a72-492e-aa8c-eb2c92dd0569 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:14.309335 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f32ad582-1e8c-427e-92c1-ebb8082b3218 req-7c09dd67-2a72-492e-aa8c-eb2c92dd0569 service nova] Creating event network-changed:0f75abb1-f4c5-4cde-bfa8-298bea8b6035 for instance 0ccb0c1e-a856-4624-8324-90163926e89a on n-h1-833090-9 Jul 26 14:19:14.327355 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f32ad582-1e8c-427e-92c1-ebb8082b3218 req-7c09dd67-2a72-492e-aa8c-eb2c92dd0569 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075758 Jul 26 14:19:14.329030 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1435/3028] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:14.339579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b25734af-6789-4f66-abb3-b3f4f6b0d36a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:14.340758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b25734af-6789-4f66-abb3-b3f4f6b0d36a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:14.354838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25734af-6789-4f66-abb3-b3f4f6b0d36a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:14.355663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25734af-6789-4f66-abb3-b3f4f6b0d36a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:14.357223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25734af-6789-4f66-abb3-b3f4f6b0d36a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:14.358038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b25734af-6789-4f66-abb3-b3f4f6b0d36a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:14.890207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-57caba5f-e266-4822-94d8-ad1108aa654f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:14.925099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b25734af-6789-4f66-abb3-b3f4f6b0d36a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:14.925871 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57caba5f-e266-4822-94d8-ad1108aa654f tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef" status: 200 len: 1521 microversion: 2.1 time: 0.734296 Jul 26 14:19:14.943480 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1594/3029] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:14 2022] GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef => generated 1521 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:14.947471 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b25734af-6789-4f66-abb3-b3f4f6b0d36a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1320 microversion: 2.1 time: 0.615561 Jul 26 14:19:14.948210 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1436/3030] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:14 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:14.985918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-450d3a8e-fb8c-403b-af7c-697884c632bb tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:14.986867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-450d3a8e-fb8c-403b-af7c-697884c632bb tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:15.004398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-450d3a8e-fb8c-403b-af7c-697884c632bb tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:15.006202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-450d3a8e-fb8c-403b-af7c-697884c632bb tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:15.008362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-450d3a8e-fb8c-403b-af7c-697884c632bb tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:15.009362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-450d3a8e-fb8c-403b-af7c-697884c632bb tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:15.275696 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-450d3a8e-fb8c-403b-af7c-697884c632bb tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1812 microversion: 2.1 time: 0.298624 Jul 26 14:19:15.284616 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1595/3031] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:14 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1812 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:15.310785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-acf15315-6180-414e-bd70-a5aa5d463b0f tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:15.318079 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:19:15.318079 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:19:15.320950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acf15315-6180-414e-bd70-a5aa5d463b0f tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:15.322068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acf15315-6180-414e-bd70-a5aa5d463b0f tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:15.323640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acf15315-6180-414e-bd70-a5aa5d463b0f tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:15.324472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acf15315-6180-414e-bd70-a5aa5d463b0f tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:15.365106 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-acf15315-6180-414e-bd70-a5aa5d463b0f tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061074 Jul 26 14:19:15.368061 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1437/3032] 10.222.0.70 () {58 vars in 1176 bytes} [Tue Jul 26 14:19:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:15.804338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-908dffdf-4ff4-445f-b6f5-ed6dc34f7fb7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:15.817181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-908dffdf-4ff4-445f-b6f5-ed6dc34f7fb7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:15.818063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-908dffdf-4ff4-445f-b6f5-ed6dc34f7fb7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:15.876368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-908dffdf-4ff4-445f-b6f5-ed6dc34f7fb7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Going to try to stop instance {{(pid=119479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:19:15.954780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6844942e-e317-4ee3-bfcc-f1167b5b7031 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:15.956495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6844942e-e317-4ee3-bfcc-f1167b5b7031 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:15.986086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6844942e-e317-4ee3-bfcc-f1167b5b7031 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:15.987378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6844942e-e317-4ee3-bfcc-f1167b5b7031 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:15.992652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6844942e-e317-4ee3-bfcc-f1167b5b7031 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:15.994148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6844942e-e317-4ee3-bfcc-f1167b5b7031 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:16.029831 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-908dffdf-4ff4-445f-b6f5-ed6dc34f7fb7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/action" status: 202 len: 0 microversion: 2.1 time: 0.233255 Jul 26 14:19:16.033370 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1596/3033] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:19:15 2022] POST /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:19:16.045205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-54d44059-c680-4a5a-9081-a281f1f45b03 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:16.054488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-54d44059-c680-4a5a-9081-a281f1f45b03 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:16.091313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54d44059-c680-4a5a-9081-a281f1f45b03 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:16.094815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54d44059-c680-4a5a-9081-a281f1f45b03 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:16.095705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54d44059-c680-4a5a-9081-a281f1f45b03 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:16.097200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54d44059-c680-4a5a-9081-a281f1f45b03 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:16.404938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6844942e-e317-4ee3-bfcc-f1167b5b7031 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:16.413800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=16 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:16.426652 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6844942e-e317-4ee3-bfcc-f1167b5b7031 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef" status: 200 len: 1521 microversion: 2.1 time: 0.478507 Jul 26 14:19:16.428447 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1438/3034] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:15 2022] GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:19:16.444161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-926ffc1d-7c94-4811-91cb-5f7febe65d0a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:16.445738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-926ffc1d-7c94-4811-91cb-5f7febe65d0a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:16.459285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-926ffc1d-7c94-4811-91cb-5f7febe65d0a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:16.459285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-926ffc1d-7c94-4811-91cb-5f7febe65d0a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:16.463648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-926ffc1d-7c94-4811-91cb-5f7febe65d0a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:16.464158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-926ffc1d-7c94-4811-91cb-5f7febe65d0a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:16.490578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-54d44059-c680-4a5a-9081-a281f1f45b03 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:16.503828 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-54d44059-c680-4a5a-9081-a281f1f45b03 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1320 microversion: 2.1 time: 0.466269 Jul 26 14:19:16.516533 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1597/3035] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:16 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1320 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:16.740260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-926ffc1d-7c94-4811-91cb-5f7febe65d0a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:16.755544 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-926ffc1d-7c94-4811-91cb-5f7febe65d0a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.324826 Jul 26 14:19:16.756461 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1439/3036] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:16 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:17.465267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9ab52646-db54-4a3d-b5d8-23e5b71cd4c2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:17.466503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9ab52646-db54-4a3d-b5d8-23e5b71cd4c2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:17.479181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ab52646-db54-4a3d-b5d8-23e5b71cd4c2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:17.480145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ab52646-db54-4a3d-b5d8-23e5b71cd4c2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:17.481853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ab52646-db54-4a3d-b5d8-23e5b71cd4c2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:17.483218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ab52646-db54-4a3d-b5d8-23e5b71cd4c2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:17.532596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20ce7843-dee9-49de-a7a6-d46873436490 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:17.535217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-20ce7843-dee9-49de-a7a6-d46873436490 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:17.552883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20ce7843-dee9-49de-a7a6-d46873436490 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:17.553358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20ce7843-dee9-49de-a7a6-d46873436490 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:17.554223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20ce7843-dee9-49de-a7a6-d46873436490 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:17.554680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20ce7843-dee9-49de-a7a6-d46873436490 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:18.066347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ab52646-db54-4a3d-b5d8-23e5b71cd4c2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:18.077123 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9ab52646-db54-4a3d-b5d8-23e5b71cd4c2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef" status: 200 len: 1521 microversion: 2.1 time: 0.619276 Jul 26 14:19:18.078525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-20ce7843-dee9-49de-a7a6-d46873436490 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:18.092520 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1598/3037] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:17 2022] GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef => generated 1521 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:18.095901 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-20ce7843-dee9-49de-a7a6-d46873436490 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1320 microversion: 2.1 time: 0.567723 Jul 26 14:19:18.097588 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1440/3038] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:17 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1320 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:19:18.098391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aa0afaea-2254-4b3c-8fe0-3ce3c618fdad tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:18.099032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aa0afaea-2254-4b3c-8fe0-3ce3c618fdad tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:18.109043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa0afaea-2254-4b3c-8fe0-3ce3c618fdad tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:18.110094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa0afaea-2254-4b3c-8fe0-3ce3c618fdad tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:18.112220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa0afaea-2254-4b3c-8fe0-3ce3c618fdad tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:18.113051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa0afaea-2254-4b3c-8fe0-3ce3c618fdad tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:18.289336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d4d0c55c-86c2-4879-a3db-4dea36479e7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f60e14aa-9f25-4471-bc55-f6d7bc82ed1c", "device": "/dev/xvdb"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:18.298600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d4d0c55c-86c2-4879-a3db-4dea36479e7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:18.310256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4d0c55c-86c2-4879-a3db-4dea36479e7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:18.311449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4d0c55c-86c2-4879-a3db-4dea36479e7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:18.313245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4d0c55c-86c2-4879-a3db-4dea36479e7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:18.314115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4d0c55c-86c2-4879-a3db-4dea36479e7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:18.608398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa0afaea-2254-4b3c-8fe0-3ce3c618fdad tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:18.622824 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aa0afaea-2254-4b3c-8fe0-3ce3c618fdad tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.528707 Jul 26 14:19:18.624044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1599/3039] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:18 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:18.873779 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d4d0c55c-86c2-4879-a3db-4dea36479e7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "POST /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.575044 Jul 26 14:19:18.880725 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1441/3040] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:19:18 2022] POST /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:19.119482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6a506adf-d76b-48c3-9be4-ccc8705d26b2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:19.136323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5232043e-75ad-47c1-a9ec-fea7f9db8932 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:19.137331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6a506adf-d76b-48c3-9be4-ccc8705d26b2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:19.140685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5232043e-75ad-47c1-a9ec-fea7f9db8932 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:19.185051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a506adf-d76b-48c3-9be4-ccc8705d26b2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:19.185692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a506adf-d76b-48c3-9be4-ccc8705d26b2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:19.186551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a506adf-d76b-48c3-9be4-ccc8705d26b2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:19.186999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a506adf-d76b-48c3-9be4-ccc8705d26b2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:19.194447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5232043e-75ad-47c1-a9ec-fea7f9db8932 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:19.196514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5232043e-75ad-47c1-a9ec-fea7f9db8932 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:19.222760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5232043e-75ad-47c1-a9ec-fea7f9db8932 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:19.223706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5232043e-75ad-47c1-a9ec-fea7f9db8932 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:20.153839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5232043e-75ad-47c1-a9ec-fea7f9db8932 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:20.162589 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5232043e-75ad-47c1-a9ec-fea7f9db8932 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1320 microversion: 2.1 time: 1.034700 Jul 26 14:19:20.163200 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1442/3041] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:19 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1320 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:20.173949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8f4962f2-3289-431e-a71b-576af2b2ae1c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:20.174775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8f4962f2-3289-431e-a71b-576af2b2ae1c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:20.181960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f4962f2-3289-431e-a71b-576af2b2ae1c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:20.182859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f4962f2-3289-431e-a71b-576af2b2ae1c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:20.184241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f4962f2-3289-431e-a71b-576af2b2ae1c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:20.185054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f4962f2-3289-431e-a71b-576af2b2ae1c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:20.219613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6a506adf-d76b-48c3-9be4-ccc8705d26b2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:20.231876 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6a506adf-d76b-48c3-9be4-ccc8705d26b2 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef" status: 200 len: 1521 microversion: 2.1 time: 1.131443 Jul 26 14:19:20.232511 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1600/3042] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:19 2022] GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef => generated 1521 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:20.257166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4c172741-a949-4a9b-a5e2-3430db5a6a46 req-bfd22665-de7d-4f8b-a3dd-10ed8c08fe43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4034f1ea-40a3-4aa7-8651-d090322b26d0", "name": "network-vif-deleted", "tag": "9c25a792-23a6-49bb-abc9-17d93c26e1ad"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:20.276489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4c172741-a949-4a9b-a5e2-3430db5a6a46 req-bfd22665-de7d-4f8b-a3dd-10ed8c08fe43 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:20.277677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4c172741-a949-4a9b-a5e2-3430db5a6a46 req-bfd22665-de7d-4f8b-a3dd-10ed8c08fe43 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:20.297034 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4c172741-a949-4a9b-a5e2-3430db5a6a46 req-bfd22665-de7d-4f8b-a3dd-10ed8c08fe43 service nova] Creating event network-vif-deleted:9c25a792-23a6-49bb-abc9-17d93c26e1ad for instance 4034f1ea-40a3-4aa7-8651-d090322b26d0 on n-h2-833090-9 Jul 26 14:19:20.304428 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4c172741-a949-4a9b-a5e2-3430db5a6a46 req-bfd22665-de7d-4f8b-a3dd-10ed8c08fe43 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058921 Jul 26 14:19:20.306202 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1601/3043] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:20.668686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8f4962f2-3289-431e-a71b-576af2b2ae1c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:20.708604 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8f4962f2-3289-431e-a71b-576af2b2ae1c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.540394 Jul 26 14:19:20.724717 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1443/3044] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:20 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:21.202261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3c13332a-ab1e-40ee-abef-fe87588686a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:21.228395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a9da751f-f674-44d3-a0c0-80193c9c2621 req-20ff8306-4509-46d9-8327-4ded3b9139a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ccb0c1e-a856-4624-8324-90163926e89a", "name": "network-vif-plugged", "status": "completed", "tag": "0f75abb1-f4c5-4cde-bfa8-298bea8b6035"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:21.232237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3c13332a-ab1e-40ee-abef-fe87588686a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:21.264463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c13332a-ab1e-40ee-abef-fe87588686a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:21.265278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c13332a-ab1e-40ee-abef-fe87588686a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:21.266706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c13332a-ab1e-40ee-abef-fe87588686a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:21.267542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c13332a-ab1e-40ee-abef-fe87588686a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:21.283160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a9da751f-f674-44d3-a0c0-80193c9c2621 req-20ff8306-4509-46d9-8327-4ded3b9139a6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:21.284559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a9da751f-f674-44d3-a0c0-80193c9c2621 req-20ff8306-4509-46d9-8327-4ded3b9139a6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:21.353772 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a9da751f-f674-44d3-a0c0-80193c9c2621 req-20ff8306-4509-46d9-8327-4ded3b9139a6 service nova] Creating event network-vif-plugged:0f75abb1-f4c5-4cde-bfa8-298bea8b6035 for instance 0ccb0c1e-a856-4624-8324-90163926e89a on n-h1-833090-9 Jul 26 14:19:21.403474 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a9da751f-f674-44d3-a0c0-80193c9c2621 req-20ff8306-4509-46d9-8327-4ded3b9139a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176719 Jul 26 14:19:21.422598 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1444/3045] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:21.481520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9dde3d42-b784-456d-8f16-7898d2eb0541 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:21.482532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9dde3d42-b784-456d-8f16-7898d2eb0541 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:21.509401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9dde3d42-b784-456d-8f16-7898d2eb0541 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:21.511730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9dde3d42-b784-456d-8f16-7898d2eb0541 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:21.522536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9dde3d42-b784-456d-8f16-7898d2eb0541 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:21.524649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9dde3d42-b784-456d-8f16-7898d2eb0541 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:21.832560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9dde3d42-b784-456d-8f16-7898d2eb0541 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e085b43a4d3a463c94540c2b0469bb56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d37e260b04147cd99d35aca62da8d25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:21.851637 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9dde3d42-b784-456d-8f16-7898d2eb0541 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef" status: 200 len: 1308 microversion: 2.1 time: 0.420281 Jul 26 14:19:21.855165 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1445/3046] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:21 2022] GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:21.874038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ff2ba20a-0059-4a12-9555-a582dbf39145 req-a9c3749f-488e-4b65-a9ff-d16192b4b710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77241a1-3c1d-4054-af62-c60ff2ad00ef", "name": "network-vif-deleted", "tag": "217dc8e3-1f0f-41ce-baf8-fc21aabc77a3"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:21.896848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ff2ba20a-0059-4a12-9555-a582dbf39145 req-a9c3749f-488e-4b65-a9ff-d16192b4b710 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:21.897898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ff2ba20a-0059-4a12-9555-a582dbf39145 req-a9c3749f-488e-4b65-a9ff-d16192b4b710 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:21.918788 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ff2ba20a-0059-4a12-9555-a582dbf39145 req-a9c3749f-488e-4b65-a9ff-d16192b4b710 service nova] Creating event network-vif-deleted:217dc8e3-1f0f-41ce-baf8-fc21aabc77a3 for instance e77241a1-3c1d-4054-af62-c60ff2ad00ef on n-h2-833090-9 Jul 26 14:19:21.925768 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ff2ba20a-0059-4a12-9555-a582dbf39145 req-a9c3749f-488e-4b65-a9ff-d16192b4b710 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068261 Jul 26 14:19:21.927471 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1446/3047] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:21.937392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4bb4cbdf-8eaa-46c6-8a02-777a256f9424 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:21.946312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4bb4cbdf-8eaa-46c6-8a02-777a256f9424 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:21.960038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bb4cbdf-8eaa-46c6-8a02-777a256f9424 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:21.961021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bb4cbdf-8eaa-46c6-8a02-777a256f9424 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:21.962742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bb4cbdf-8eaa-46c6-8a02-777a256f9424 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:21.963714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bb4cbdf-8eaa-46c6-8a02-777a256f9424 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:22.144506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:22.266352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3c13332a-ab1e-40ee-abef-fe87588686a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:22.277930 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3c13332a-ab1e-40ee-abef-fe87588686a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1320 microversion: 2.1 time: 1.087038 Jul 26 14:19:22.279075 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1602/3048] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:21 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1320 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:19:22.446907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4bb4cbdf-8eaa-46c6-8a02-777a256f9424 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:22.459694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:22.480584 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4bb4cbdf-8eaa-46c6-8a02-777a256f9424 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.550784 Jul 26 14:19:22.487940 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1447/3049] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:21 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:22.898896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0d0b61b-7a7a-4c0e-886a-dbffe794e77e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:22.900067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a0d0b61b-7a7a-4c0e-886a-dbffe794e77e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: e77241a1-3c1d-4054-af62-c60ff2ad00ef] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:22.912422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d0b61b-7a7a-4c0e-886a-dbffe794e77e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:22.913596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d0b61b-7a7a-4c0e-886a-dbffe794e77e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:22.915270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d0b61b-7a7a-4c0e-886a-dbffe794e77e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:22.916066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d0b61b-7a7a-4c0e-886a-dbffe794e77e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:22.950254 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a0d0b61b-7a7a-4c0e-886a-dbffe794e77e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] HTTP exception thrown: Instance e77241a1-3c1d-4054-af62-c60ff2ad00ef could not be found. Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0d0b61b-7a7a-4c0e-886a-dbffe794e77e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Request method failure captured: Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef HTTP/1.1 Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e7y1RFqunQHxtTGWbEoiIjOeltzXj7E9EabttKkx4kC_tPZngOYVwZzbmnkKi-YhCpQqrCXjEcazJxXKtg857lmGlHMBUg-I7FGOt3BFrK19G4ElA7dvZZ03OH0jfCvTl7k52Jzfrpvz4A0oODHvpc_xjXK3PON8eVaIjeqPaHrsk Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d37e260b04147cd99d35aca62da8d25", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}] Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e085b43a4d3a463c94540c2b0469bb56 Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance e77241a1-3c1d-4054-af62-c60ff2ad00ef could not be found. Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e77241a1-3c1d-4054-af62-c60ff2ad00ef'} Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77241a1-3c1d-4054-af62-c60ff2ad00ef could not be found. Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77241a1-3c1d-4054-af62-c60ff2ad00ef could not be found. Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:22.953496 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:22.959833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:22.959833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:22.959833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:22.959833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:19:22.959833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:19:22.959833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77241a1-3c1d-4054-af62-c60ff2ad00ef could not be found. Jul 26 14:19:22.959833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:22.959833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0d0b61b-7a7a-4c0e-886a-dbffe794e77e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Returning 404 to user: Instance e77241a1-3c1d-4054-af62-c60ff2ad00ef could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:19:22.959833 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a0d0b61b-7a7a-4c0e-886a-dbffe794e77e tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef" status: 404 len: 111 microversion: 2.1 time: 0.065054 Jul 26 14:19:22.959833 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1603/3050] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:22 2022] GET /compute/v2.1/servers/e77241a1-3c1d-4054-af62-c60ff2ad00ef => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:19:22.971244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81bc72d3-24f1-4afa-a4d6-bc0e509f1456 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:22.972692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-81bc72d3-24f1-4afa-a4d6-bc0e509f1456 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] [instance: 4034f1ea-40a3-4aa7-8651-d090322b26d0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:22.978577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:22.989647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81bc72d3-24f1-4afa-a4d6-bc0e509f1456 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:22.990454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81bc72d3-24f1-4afa-a4d6-bc0e509f1456 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:22.991825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81bc72d3-24f1-4afa-a4d6-bc0e509f1456 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:22.992886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81bc72d3-24f1-4afa-a4d6-bc0e509f1456 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:23.026190 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-81bc72d3-24f1-4afa-a4d6-bc0e509f1456 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] HTTP exception thrown: Instance 4034f1ea-40a3-4aa7-8651-d090322b26d0 could not be found. Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81bc72d3-24f1-4afa-a4d6-bc0e509f1456 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Request method failure captured: Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 HTTP/1.1 Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e7y1RFqunQHxtTGWbEoiIjOeltzXj7E9EabttKkx4kC_tPZngOYVwZzbmnkKi-YhCpQqrCXjEcazJxXKtg857lmGlHMBUg-I7FGOt3BFrK19G4ElA7dvZZ03OH0jfCvTl7k52Jzfrpvz4A0oODHvpc_xjXK3PON8eVaIjeqPaHrsk Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d37e260b04147cd99d35aca62da8d25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d37e260b04147cd99d35aca62da8d25", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d37e260b04147cd99d35aca62da8d25"}]}] Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4d37e260b04147cd99d35aca62da8d25 Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-684128631 Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: e085b43a4d3a463c94540c2b0469bb56 Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ListServersNegativeTestJSON-684128631-project Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 4034f1ea-40a3-4aa7-8651-d090322b26d0 could not be found. Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4034f1ea-40a3-4aa7-8651-d090322b26d0'} Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4034f1ea-40a3-4aa7-8651-d090322b26d0 could not be found. Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4034f1ea-40a3-4aa7-8651-d090322b26d0 could not be found. Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:23.030083 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:23.039381 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:23.039381 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:23.039381 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:23.039381 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:19:23.039381 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:19:23.039381 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4034f1ea-40a3-4aa7-8651-d090322b26d0 could not be found. Jul 26 14:19:23.039381 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:19:23.044181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81bc72d3-24f1-4afa-a4d6-bc0e509f1456 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] Returning 404 to user: Instance 4034f1ea-40a3-4aa7-8651-d090322b26d0 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:19:23.047031 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-81bc72d3-24f1-4afa-a4d6-bc0e509f1456 tempest-ListServersNegativeTestJSON-684128631 tempest-ListServersNegativeTestJSON-684128631-project] 10.222.0.70 "GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0" status: 404 len: 111 microversion: 2.1 time: 0.082385 Jul 26 14:19:23.055052 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1448/3051] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:22 2022] GET /compute/v2.1/servers/4034f1ea-40a3-4aa7-8651-d090322b26d0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:19:23.306282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-99dc035a-24d1-4440-b6e5-e4775b57ca3f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:23.307092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-99dc035a-24d1-4440-b6e5-e4775b57ca3f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:23.333701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99dc035a-24d1-4440-b6e5-e4775b57ca3f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:23.335025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99dc035a-24d1-4440-b6e5-e4775b57ca3f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:23.336481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99dc035a-24d1-4440-b6e5-e4775b57ca3f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:23.337206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99dc035a-24d1-4440-b6e5-e4775b57ca3f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:23.538017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-289e29fa-7230-489b-823e-112a13ef83df tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:23.541515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-289e29fa-7230-489b-823e-112a13ef83df tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:23.581997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-289e29fa-7230-489b-823e-112a13ef83df tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:23.583340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-289e29fa-7230-489b-823e-112a13ef83df tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:23.585068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-289e29fa-7230-489b-823e-112a13ef83df tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:23.587856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-289e29fa-7230-489b-823e-112a13ef83df tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:23.635208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99dc035a-24d1-4440-b6e5-e4775b57ca3f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:23.661132 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-99dc035a-24d1-4440-b6e5-e4775b57ca3f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1320 microversion: 2.1 time: 0.352195 Jul 26 14:19:23.665901 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1604/3052] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:23 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:24.158130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-289e29fa-7230-489b-823e-112a13ef83df tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:24.177999 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-289e29fa-7230-489b-823e-112a13ef83df tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.663429 Jul 26 14:19:24.187848 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1449/3053] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:23 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:24.716486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fbad8b52-f8aa-43de-979f-ad130067894d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:24.717777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fbad8b52-f8aa-43de-979f-ad130067894d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:24.742522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbad8b52-f8aa-43de-979f-ad130067894d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:24.742858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbad8b52-f8aa-43de-979f-ad130067894d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:24.743773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbad8b52-f8aa-43de-979f-ad130067894d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:24.744360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbad8b52-f8aa-43de-979f-ad130067894d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:25.225781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d8aaab7a-1749-4fad-9efc-f2f4cb984ebf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:25.238353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d8aaab7a-1749-4fad-9efc-f2f4cb984ebf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:25.262496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8aaab7a-1749-4fad-9efc-f2f4cb984ebf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:25.262496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8aaab7a-1749-4fad-9efc-f2f4cb984ebf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:25.278253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8aaab7a-1749-4fad-9efc-f2f4cb984ebf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:25.284718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8aaab7a-1749-4fad-9efc-f2f4cb984ebf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:25.340017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=14 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:26.215076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d8aaab7a-1749-4fad-9efc-f2f4cb984ebf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:26.246719 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d8aaab7a-1749-4fad-9efc-f2f4cb984ebf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 1.027590 Jul 26 14:19:26.260421 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1450/3054] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:25 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:26.353913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fbad8b52-f8aa-43de-979f-ad130067894d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:26.410806 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fbad8b52-f8aa-43de-979f-ad130067894d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1501 microversion: 2.1 time: 1.687094 Jul 26 14:19:26.426177 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1605/3055] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:24 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1501 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:26.455420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-feb4bf9b-1577-4628-8d79-7360990ddc55 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:26.460534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-feb4bf9b-1577-4628-8d79-7360990ddc55 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:26.486172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feb4bf9b-1577-4628-8d79-7360990ddc55 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:26.500921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feb4bf9b-1577-4628-8d79-7360990ddc55 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:26.502563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feb4bf9b-1577-4628-8d79-7360990ddc55 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:26.503436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feb4bf9b-1577-4628-8d79-7360990ddc55 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:27.205809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-feb4bf9b-1577-4628-8d79-7360990ddc55 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:27.271708 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-feb4bf9b-1577-4628-8d79-7360990ddc55 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1501 microversion: 2.1 time: 0.822865 Jul 26 14:19:27.282920 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1451/3056] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:26 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1501 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:27.312990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3aabc3ea-83c4-492b-8ae3-f06bd9f9e044 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:27.320569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3aabc3ea-83c4-492b-8ae3-f06bd9f9e044 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:27.326175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4be11e79-9755-4dc3-a931-e22562b28752 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:27.327518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4be11e79-9755-4dc3-a931-e22562b28752 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:27.359059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3aabc3ea-83c4-492b-8ae3-f06bd9f9e044 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:27.361087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3aabc3ea-83c4-492b-8ae3-f06bd9f9e044 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:27.367935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3aabc3ea-83c4-492b-8ae3-f06bd9f9e044 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:27.369191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3aabc3ea-83c4-492b-8ae3-f06bd9f9e044 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:27.395724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4be11e79-9755-4dc3-a931-e22562b28752 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:27.396495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4be11e79-9755-4dc3-a931-e22562b28752 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:27.398212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4be11e79-9755-4dc3-a931-e22562b28752 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:27.399459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4be11e79-9755-4dc3-a931-e22562b28752 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:27.467096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4be11e79-9755-4dc3-a931-e22562b28752 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:19:27.604899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:27.737009 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4be11e79-9755-4dc3-a931-e22562b28752 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 204 len: 0 microversion: 2.1 time: 0.415586 Jul 26 14:19:27.741836 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1452/3057] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:19:27 2022] DELETE /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:19:27.760113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-979e7800-58f5-442b-86da-b9ca525bfa0f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:27.762445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-979e7800-58f5-442b-86da-b9ca525bfa0f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:27.780286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-979e7800-58f5-442b-86da-b9ca525bfa0f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:27.781588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-979e7800-58f5-442b-86da-b9ca525bfa0f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:27.783738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-979e7800-58f5-442b-86da-b9ca525bfa0f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:27.784718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-979e7800-58f5-442b-86da-b9ca525bfa0f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:28.216508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3aabc3ea-83c4-492b-8ae3-f06bd9f9e044 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:28.242284 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3aabc3ea-83c4-492b-8ae3-f06bd9f9e044 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.958045 Jul 26 14:19:28.279015 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1606/3058] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:27 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:19:28.360464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-979e7800-58f5-442b-86da-b9ca525bfa0f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:28.384967 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-979e7800-58f5-442b-86da-b9ca525bfa0f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1507 microversion: 2.1 time: 0.630235 Jul 26 14:19:28.415302 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1453/3059] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:27 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1507 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:19:29.285198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b4715c1e-8816-4faa-82ec-872ba5ed31ec tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:29.291599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b4715c1e-8816-4faa-82ec-872ba5ed31ec tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:29.317860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4715c1e-8816-4faa-82ec-872ba5ed31ec tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:29.319155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4715c1e-8816-4faa-82ec-872ba5ed31ec tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:29.320949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4715c1e-8816-4faa-82ec-872ba5ed31ec tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:29.322011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4715c1e-8816-4faa-82ec-872ba5ed31ec tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:29.732232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e79182d1-85ab-44d7-a1fb-5e90264acbc8 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: .version_select at 0x7f8799437c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-390517127", "description": "tempest-description-1376076704"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:29.856884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b4715c1e-8816-4faa-82ec-872ba5ed31ec tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:29.889475 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b4715c1e-8816-4faa-82ec-872ba5ed31ec tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.612388 Jul 26 14:19:29.901427 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1607/3060] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:29 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:29.912737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a7993166-0e02-4543-97b7-caafae0a35c4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:29.914588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a7993166-0e02-4543-97b7-caafae0a35c4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:29.932613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7993166-0e02-4543-97b7-caafae0a35c4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:29.934663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7993166-0e02-4543-97b7-caafae0a35c4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:29.938536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7993166-0e02-4543-97b7-caafae0a35c4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:29.939255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7993166-0e02-4543-97b7-caafae0a35c4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:30.465685 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e79182d1-85ab-44d7-a1fb-5e90264acbc8 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.049686 Jul 26 14:19:30.466619 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1454/3061] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:19:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:30.491034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-513ac865-cfe0-4af2-9d24-23a63298ce9e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: .version_select at 0x7f8787d33ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1071116113", "description": "tempest-description-47530641"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:30.595135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a7993166-0e02-4543-97b7-caafae0a35c4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:30.611009 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a7993166-0e02-4543-97b7-caafae0a35c4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1507 microversion: 2.1 time: 0.707697 Jul 26 14:19:30.613019 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1608/3062] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:29 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1507 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:30.935548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5617b7d-2e39-432c-990f-4550448b40e7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:30.936559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d5617b7d-2e39-432c-990f-4550448b40e7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:30.960276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5617b7d-2e39-432c-990f-4550448b40e7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:30.961365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5617b7d-2e39-432c-990f-4550448b40e7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:30.962463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5617b7d-2e39-432c-990f-4550448b40e7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:30.965819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5617b7d-2e39-432c-990f-4550448b40e7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:31.370705 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-513ac865-cfe0-4af2-9d24-23a63298ce9e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.884561 Jul 26 14:19:31.371904 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1455/3063] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:19:30 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:19:31.416083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-26cc673a-c69b-41d4-9c35-3cc60c1b934a req-ef666865-da00-40c1-a5c9-1389b207e96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ccb0c1e-a856-4624-8324-90163926e89a", "name": "network-vif-deleted", "tag": "0f75abb1-f4c5-4cde-bfa8-298bea8b6035"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:31.461799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-26cc673a-c69b-41d4-9c35-3cc60c1b934a req-ef666865-da00-40c1-a5c9-1389b207e96c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:31.464017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-26cc673a-c69b-41d4-9c35-3cc60c1b934a req-ef666865-da00-40c1-a5c9-1389b207e96c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:31.504638 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-26cc673a-c69b-41d4-9c35-3cc60c1b934a req-ef666865-da00-40c1-a5c9-1389b207e96c service nova] Creating event network-vif-deleted:0f75abb1-f4c5-4cde-bfa8-298bea8b6035 for instance 0ccb0c1e-a856-4624-8324-90163926e89a on n-h1-833090-9 Jul 26 14:19:31.521841 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-26cc673a-c69b-41d4-9c35-3cc60c1b934a req-ef666865-da00-40c1-a5c9-1389b207e96c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145878 Jul 26 14:19:31.523323 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1456/3064] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:31.551153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d5617b7d-2e39-432c-990f-4550448b40e7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:31.568919 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5617b7d-2e39-432c-990f-4550448b40e7 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.638372 Jul 26 14:19:31.584472 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1609/3065] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:30 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:19:31.640532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1196607679", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "d1cc658d-b7e0-4bb4-995e-7fc1893f8983"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:31.647100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:31.653102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:31.668762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:31.670039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:31.672939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:31.674845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:31.769171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:31.787320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] validate_networks() for [('d1cc658d-b7e0-4bb4-995e-7fc1893f8983', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:19:31.792707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:31.793875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:31.795034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lazy-loading 'fault' on Instance uuid 0ccb0c1e-a856-4624-8324-90163926e89a {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:19:32.114682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:32.145233 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5839085-6dc8-4f71-84c0-9368d4cc2fc1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 200 len: 1310 microversion: 2.1 time: 0.496811 Jul 26 14:19:32.148495 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1610/3066] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:31 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 1310 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:32.604627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5d264df5-ba2b-4d46-a058-26529559bcbe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:32.605483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5d264df5-ba2b-4d46-a058-26529559bcbe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:32.621646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:19:32.622194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:19:32.622884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:19:32.623553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:19:32.624064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:19:32.644241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d264df5-ba2b-4d46-a058-26529559bcbe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:32.645266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d264df5-ba2b-4d46-a058-26529559bcbe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:32.649069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:32.649531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:32.649951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d264df5-ba2b-4d46-a058-26529559bcbe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:32.650624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:32.652702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d264df5-ba2b-4d46-a058-26529559bcbe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:32.654679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:32.715761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Getting quotas for project 8e27de07dc204a298c0279a365842602. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:19:32.730153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Getting quotas for user 16cfc68b1ac347fe95e06e60e8b5f681 and project 8e27de07dc204a298c0279a365842602. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:19:32.762098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:19:32.769833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:19:32.886322 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f0abeb03-2fea-42fa-b42c-2bd3ef342166 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251334 Jul 26 14:19:32.896875 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1457/3067] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:19:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:19:32.907208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b26cae6c-601a-4841-8309-64f2161973d6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:32.908658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b26cae6c-601a-4841-8309-64f2161973d6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:33.066777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b26cae6c-601a-4841-8309-64f2161973d6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:33.100615 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b26cae6c-601a-4841-8309-64f2161973d6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1216 microversion: 2.1 time: 0.196524 Jul 26 14:19:33.102016 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1458/3068] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:32 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:33.106788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5d264df5-ba2b-4d46-a058-26529559bcbe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:33.123484 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5d264df5-ba2b-4d46-a058-26529559bcbe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.528869 Jul 26 14:19:33.124804 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1611/3069] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:32 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:33.156228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-37c257f3-95cc-4b08-9bd3-0cf18c793058 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:33.157239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-37c257f3-95cc-4b08-9bd3-0cf18c793058 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:33.175599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37c257f3-95cc-4b08-9bd3-0cf18c793058 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:33.176296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37c257f3-95cc-4b08-9bd3-0cf18c793058 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:33.177282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37c257f3-95cc-4b08-9bd3-0cf18c793058 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:33.177973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37c257f3-95cc-4b08-9bd3-0cf18c793058 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:33.204728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-099c641d-5ef1-4132-84a6-f6a965c13a91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:33.206804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-099c641d-5ef1-4132-84a6-f6a965c13a91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:33.229203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-099c641d-5ef1-4132-84a6-f6a965c13a91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:33.230761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-099c641d-5ef1-4132-84a6-f6a965c13a91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:33.232554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-099c641d-5ef1-4132-84a6-f6a965c13a91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:33.233238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-099c641d-5ef1-4132-84a6-f6a965c13a91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:33.259753 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-099c641d-5ef1-4132-84a6-f6a965c13a91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-099c641d-5ef1-4132-84a6-f6a965c13a91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a HTTP/1.1 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '0ccb0c1e-a856-4624-8324-90163926e89a'} Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:33.261633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:19:33.271087 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:19:33.271087 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:19:33.271087 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:19:33.271087 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:19:33.271087 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:19:33.271087 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:19:33.271087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-099c641d-5ef1-4132-84a6-f6a965c13a91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:19:33.271087 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-099c641d-5ef1-4132-84a6-f6a965c13a91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 404 len: 111 microversion: 2.1 time: 0.067722 Jul 26 14:19:33.271087 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1612/3070] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:33 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:19:33.288160 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-37c257f3-95cc-4b08-9bd3-0cf18c793058 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/ips" status: 200 len: 151 microversion: 2.20 time: 0.150462 Jul 26 14:19:33.288160 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1459/3071] 10.222.0.70 () {60 vars in 1289 bytes} [Tue Jul 26 14:19:33 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/ips => generated 151 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:19:33.289342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-45fe7727-8182-4829-9d6e-0a67bdc52408 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'create', calling method: .version_select at 0x7f87993aa5e0>, body: {"keypair": {"name": "tempest-key-1206844691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtwCoNuHd8TOh7l7egFFTpaTfSPfshEzupV8s+iW39+rGFSB1lfSazWfXTitCCEl2MopQYfv9UHXTpuIwgnVwxQDRScsDc0j0PZEA/shWSvi863E4vywa2ScmMUMEF/Ww=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:33.317853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-45fe7727-8182-4829-9d6e-0a67bdc52408 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:19:33.327708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-45fe7727-8182-4829-9d6e-0a67bdc52408 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for user 55daeaaa37a8498c9e540f5546277dc3 and project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:19:33.414792 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-45fe7727-8182-4829-9d6e-0a67bdc52408 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.127767 Jul 26 14:19:33.417353 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1613/3072] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:19:33 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:33.436093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-92381f61-8cc7-479d-b6a1-b745507381ce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '.version_select at 0x7f8787f0f550>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:33.452499 n-d-833090-9 devstack@n-api.service[119478]: WARNING oslo_db.sqlalchemy.utils [None req-92381f61-8cc7-479d-b6a1-b745507381ce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 26 14:19:33.469928 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-92381f61-8cc7-479d-b6a1-b745507381ce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.041667 Jul 26 14:19:33.471330 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1460/3073] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:19:33 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:33.737064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2065958418", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "key_name": "tempest-key-1206844691", "networks": [{"uuid": "2dc9e1a8-4a4f-459a-8038-83a80381fb0e"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:33.979191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] validate_networks() for [('2dc9e1a8-4a4f-459a-8038-83a80381fb0e', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:19:34.144085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e0fe99bc-77c3-4d75-9deb-273e5212ac49 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:34.145993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e0fe99bc-77c3-4d75-9deb-273e5212ac49 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:34.197422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e0fe99bc-77c3-4d75-9deb-273e5212ac49 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:34.198820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e0fe99bc-77c3-4d75-9deb-273e5212ac49 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:34.201234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e0fe99bc-77c3-4d75-9deb-273e5212ac49 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:34.202323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e0fe99bc-77c3-4d75-9deb-273e5212ac49 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:34.362945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e0fe99bc-77c3-4d75-9deb-273e5212ac49 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:34.379256 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e0fe99bc-77c3-4d75-9deb-273e5212ac49 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1220 microversion: 2.1 time: 0.240021 Jul 26 14:19:34.396934 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1461/3074] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:34 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1220 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:34.436333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8deff4df-3bfb-4f22-8912-da2444fd7613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:34.437628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8deff4df-3bfb-4f22-8912-da2444fd7613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:34.450788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8deff4df-3bfb-4f22-8912-da2444fd7613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:34.452569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8deff4df-3bfb-4f22-8912-da2444fd7613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:34.454328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8deff4df-3bfb-4f22-8912-da2444fd7613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:34.456593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8deff4df-3bfb-4f22-8912-da2444fd7613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:35.056139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8deff4df-3bfb-4f22-8912-da2444fd7613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:35.069834 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8deff4df-3bfb-4f22-8912-da2444fd7613 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.654000 Jul 26 14:19:35.070679 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1462/3075] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:34 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:35.436393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c32cfbd-afe4-479f-957b-1777e2cc8ff0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:35.437320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0c32cfbd-afe4-479f-957b-1777e2cc8ff0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:35.455888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c32cfbd-afe4-479f-957b-1777e2cc8ff0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:35.456711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c32cfbd-afe4-479f-957b-1777e2cc8ff0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:35.457751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c32cfbd-afe4-479f-957b-1777e2cc8ff0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:35.460659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c32cfbd-afe4-479f-957b-1777e2cc8ff0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:35.598690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:19:35.599448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:19:35.600066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:19:35.600831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:19:35.601414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:19:35.630294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:35.631330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:35.632708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:35.633617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:35.761088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0c32cfbd-afe4-479f-957b-1777e2cc8ff0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:35.778079 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c32cfbd-afe4-479f-957b-1777e2cc8ff0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1268 microversion: 2.1 time: 0.359340 Jul 26 14:19:35.779052 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1463/3076] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:35 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1268 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:35.785231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:19:35.797623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-45be1e44-e408-45b2-8f58-946023f02199 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:35.798833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-45be1e44-e408-45b2-8f58-946023f02199 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:35.808070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for user 55daeaaa37a8498c9e540f5546277dc3 and project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:19:35.841425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45be1e44-e408-45b2-8f58-946023f02199 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:35.843830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45be1e44-e408-45b2-8f58-946023f02199 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:35.845076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45be1e44-e408-45b2-8f58-946023f02199 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:35.848569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45be1e44-e408-45b2-8f58-946023f02199 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:35.860331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:19:35.864065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:19:36.004643 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cf836686-9869-4a99-b781-38c12a38f28e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.277856 Jul 26 14:19:36.008639 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1614/3077] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:19:36.043202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7d4590e3-2210-4781-9f4e-bb1ea00b7c82 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:36.044499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7d4590e3-2210-4781-9f4e-bb1ea00b7c82 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:36.741215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7d4590e3-2210-4781-9f4e-bb1ea00b7c82 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:36.754341 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7d4590e3-2210-4781-9f4e-bb1ea00b7c82 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1229 microversion: 2.1 time: 0.729918 Jul 26 14:19:36.762549 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1615/3078] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:36 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1229 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:36.786850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2a28de8-8fe0-41c1-bfd6-0b75fb79b397 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:36.787706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e2a28de8-8fe0-41c1-bfd6-0b75fb79b397 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:36.811036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2a28de8-8fe0-41c1-bfd6-0b75fb79b397 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:36.815443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2a28de8-8fe0-41c1-bfd6-0b75fb79b397 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:36.816494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2a28de8-8fe0-41c1-bfd6-0b75fb79b397 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:36.816948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2a28de8-8fe0-41c1-bfd6-0b75fb79b397 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:36.896650 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-45be1e44-e408-45b2-8f58-946023f02199 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1858 microversion: 2.1 time: 1.115466 Jul 26 14:19:36.898193 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1464/3079] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:35 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1858 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:36.930931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55027c12-9499-4407-ab63-2195bcfe6c11 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:36.931884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-55027c12-9499-4407-ab63-2195bcfe6c11 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:36.946783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55027c12-9499-4407-ab63-2195bcfe6c11 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:36.948443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55027c12-9499-4407-ab63-2195bcfe6c11 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:36.951756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55027c12-9499-4407-ab63-2195bcfe6c11 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:36.952887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55027c12-9499-4407-ab63-2195bcfe6c11 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:37.173381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-55027c12-9499-4407-ab63-2195bcfe6c11 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:37.192869 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-55027c12-9499-4407-ab63-2195bcfe6c11 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1274 microversion: 2.1 time: 0.281378 Jul 26 14:19:37.194854 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1465/3080] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:36 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1274 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:37.201050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-270bc77b-b53b-437a-b5e8-8b171c734833 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:37.220891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-270bc77b-b53b-437a-b5e8-8b171c734833 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:37.244682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-270bc77b-b53b-437a-b5e8-8b171c734833 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:37.245230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-270bc77b-b53b-437a-b5e8-8b171c734833 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:37.246294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-270bc77b-b53b-437a-b5e8-8b171c734833 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:37.246780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-270bc77b-b53b-437a-b5e8-8b171c734833 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:37.335181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-270bc77b-b53b-437a-b5e8-8b171c734833 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lazy-loading 'flavor' on Instance uuid be9c25cd-3b3d-4c48-b620-b7ea6101bf3e {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:19:37.411447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e2a28de8-8fe0-41c1-bfd6-0b75fb79b397 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:37.430456 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e2a28de8-8fe0-41c1-bfd6-0b75fb79b397 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1722 microversion: 2.1 time: 0.663793 Jul 26 14:19:37.434635 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1616/3081] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:36 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1722 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:37.451773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-98228a96-3b9e-452a-bf37-9491cd47e087 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-9", "block_migration": true, "disk_over_commit": false}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:37.466729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-98228a96-3b9e-452a-bf37-9491cd47e087 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:37.475061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:37.496746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98228a96-3b9e-452a-bf37-9491cd47e087 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:37.499997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98228a96-3b9e-452a-bf37-9491cd47e087 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:37.502393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98228a96-3b9e-452a-bf37-9491cd47e087 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:37.506043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98228a96-3b9e-452a-bf37-9491cd47e087 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:37.576987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-98228a96-3b9e-452a-bf37-9491cd47e087 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lazy-loading 'flavor' on Instance uuid a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:19:37.594988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-98228a96-3b9e-452a-bf37-9491cd47e087 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Going to try to live migrate instance to n-h2-833090-9 {{(pid=119479) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 14:19:37.806745 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-270bc77b-b53b-437a-b5e8-8b171c734833 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "POST /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/action" status: 202 len: 0 microversion: 2.20 time: 0.609774 Jul 26 14:19:37.807468 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1466/3082] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:19:37 2022] POST /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:19:37.831052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05a7c0e6-e924-4654-8913-1bb419181ba9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:37.837247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05a7c0e6-e924-4654-8913-1bb419181ba9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:37.861340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05a7c0e6-e924-4654-8913-1bb419181ba9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:37.867071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05a7c0e6-e924-4654-8913-1bb419181ba9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:37.868954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05a7c0e6-e924-4654-8913-1bb419181ba9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:37.870087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05a7c0e6-e924-4654-8913-1bb419181ba9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:38.542949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05a7c0e6-e924-4654-8913-1bb419181ba9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:38.570740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05a7c0e6-e924-4654-8913-1bb419181ba9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:38.574355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05a7c0e6-e924-4654-8913-1bb419181ba9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:38.576205 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05a7c0e6-e924-4654-8913-1bb419181ba9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1724 microversion: 2.20 time: 0.760188 Jul 26 14:19:38.578200 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1467/3083] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:19:37 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1724 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:19:38.585637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7acfab78-8d04-497c-ad31-8eea636dba18 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:38.586868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7acfab78-8d04-497c-ad31-8eea636dba18 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:38.603113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7acfab78-8d04-497c-ad31-8eea636dba18 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:38.604562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7acfab78-8d04-497c-ad31-8eea636dba18 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:38.605747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7acfab78-8d04-497c-ad31-8eea636dba18 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:38.606395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7acfab78-8d04-497c-ad31-8eea636dba18 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:38.792677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7acfab78-8d04-497c-ad31-8eea636dba18 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:38.806772 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7acfab78-8d04-497c-ad31-8eea636dba18 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1287 microversion: 2.1 time: 0.225940 Jul 26 14:19:38.809632 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1468/3084] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:38 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1287 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:38.836617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a59a47f8-f233-44a3-ae32-05b85ca96244 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:38.837802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a59a47f8-f233-44a3-ae32-05b85ca96244 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:38.859347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a59a47f8-f233-44a3-ae32-05b85ca96244 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:38.863049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a59a47f8-f233-44a3-ae32-05b85ca96244 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:38.875642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a59a47f8-f233-44a3-ae32-05b85ca96244 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:38.878911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a59a47f8-f233-44a3-ae32-05b85ca96244 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:39.586988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a59a47f8-f233-44a3-ae32-05b85ca96244 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:39.612326 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a59a47f8-f233-44a3-ae32-05b85ca96244 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1316 microversion: 2.1 time: 0.799864 Jul 26 14:19:39.615692 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1469/3085] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:38 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1316 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:39.636077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-25b27053-ead5-4cf8-a967-06d96701bfc1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:39.639426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-25b27053-ead5-4cf8-a967-06d96701bfc1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:39.682639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25b27053-ead5-4cf8-a967-06d96701bfc1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:39.684984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25b27053-ead5-4cf8-a967-06d96701bfc1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:39.686148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25b27053-ead5-4cf8-a967-06d96701bfc1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:39.686837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25b27053-ead5-4cf8-a967-06d96701bfc1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:40.253205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-25b27053-ead5-4cf8-a967-06d96701bfc1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:40.272252 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-25b27053-ead5-4cf8-a967-06d96701bfc1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1699 microversion: 2.1 time: 0.654882 Jul 26 14:19:40.273796 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1470/3086] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:39 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1699 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:40.311246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-01fe77be-70dd-474b-834f-408781346fdf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:40.314962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-01fe77be-70dd-474b-834f-408781346fdf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:40.337546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01fe77be-70dd-474b-834f-408781346fdf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:40.338514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01fe77be-70dd-474b-834f-408781346fdf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:40.339569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01fe77be-70dd-474b-834f-408781346fdf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:40.341704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01fe77be-70dd-474b-834f-408781346fdf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:40.901642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-01fe77be-70dd-474b-834f-408781346fdf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:40.906218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:40.942191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-01fe77be-70dd-474b-834f-408781346fdf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:40.944550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-01fe77be-70dd-474b-834f-408781346fdf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:40.946226 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-01fe77be-70dd-474b-834f-408781346fdf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1724 microversion: 2.20 time: 0.670893 Jul 26 14:19:40.947566 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1471/3087] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:19:40 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1724 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:19:40.964200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9abd14ee-09ad-40bb-9d24-47a676fd9d13 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:40.965216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9abd14ee-09ad-40bb-9d24-47a676fd9d13 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:40.977533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9abd14ee-09ad-40bb-9d24-47a676fd9d13 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:40.985285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9abd14ee-09ad-40bb-9d24-47a676fd9d13 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:40.987590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9abd14ee-09ad-40bb-9d24-47a676fd9d13 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:40.993779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9abd14ee-09ad-40bb-9d24-47a676fd9d13 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:41.206540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9abd14ee-09ad-40bb-9d24-47a676fd9d13 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:41.229828 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9abd14ee-09ad-40bb-9d24-47a676fd9d13 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1287 microversion: 2.1 time: 0.280077 Jul 26 14:19:41.231273 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1472/3088] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:40 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1287 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:41.237854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-66a3d6bf-bd57-4aca-8dc3-b16d02130ba1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:41.262393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66a3d6bf-bd57-4aca-8dc3-b16d02130ba1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:41.263122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66a3d6bf-bd57-4aca-8dc3-b16d02130ba1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:41.522790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-66a3d6bf-bd57-4aca-8dc3-b16d02130ba1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Going to try to start instance {{(pid=119478) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 14:19:41.636220 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-66a3d6bf-bd57-4aca-8dc3-b16d02130ba1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/action" status: 202 len: 0 microversion: 2.1 time: 0.403000 Jul 26 14:19:41.641784 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1473/3089] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:19:41 2022] POST /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:19:41.662776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7949a056-b1b3-4c75-89f4-6b4ce5cae17e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:41.666043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7949a056-b1b3-4c75-89f4-6b4ce5cae17e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:41.705773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7949a056-b1b3-4c75-89f4-6b4ce5cae17e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:41.707817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7949a056-b1b3-4c75-89f4-6b4ce5cae17e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:41.713747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7949a056-b1b3-4c75-89f4-6b4ce5cae17e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:41.716555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7949a056-b1b3-4c75-89f4-6b4ce5cae17e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:42.506156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7949a056-b1b3-4c75-89f4-6b4ce5cae17e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:42.533307 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-98228a96-3b9e-452a-bf37-9491cd47e087 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/action" status: 202 len: 0 microversion: 2.1 time: 5.095443 Jul 26 14:19:42.535432 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1617/3090] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:19:37 2022] POST /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/action => generated 0 bytes in 5099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:19:42.556873 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7949a056-b1b3-4c75-89f4-6b4ce5cae17e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1316 microversion: 2.1 time: 0.912558 Jul 26 14:19:42.561103 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1474/3091] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:41 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1316 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:42.562143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-12dda8ee-5193-485c-9359-53fdfeeade09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:42.565788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-12dda8ee-5193-485c-9359-53fdfeeade09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:42.588369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-11195e4f-b978-46d8-a54f-67f23d261fbc req-fc0a65e6-14f5-478b-bed8-1ab9e80a86fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9bd635b-0eae-4f59-8e28-d6d034cdb159", "tag": "22a590f7-4427-4dc1-8d35-fc64edb623f6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:42.607359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-11195e4f-b978-46d8-a54f-67f23d261fbc req-fc0a65e6-14f5-478b-bed8-1ab9e80a86fd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:42.608134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-11195e4f-b978-46d8-a54f-67f23d261fbc req-fc0a65e6-14f5-478b-bed8-1ab9e80a86fd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:42.617092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dda8ee-5193-485c-9359-53fdfeeade09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:42.620683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dda8ee-5193-485c-9359-53fdfeeade09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:42.622556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dda8ee-5193-485c-9359-53fdfeeade09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:42.623154 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-11195e4f-b978-46d8-a54f-67f23d261fbc req-fc0a65e6-14f5-478b-bed8-1ab9e80a86fd service nova] Creating event network-changed:22a590f7-4427-4dc1-8d35-fc64edb623f6 for instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 on n-h1-833090-9 Jul 26 14:19:42.629381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dda8ee-5193-485c-9359-53fdfeeade09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:42.632960 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-11195e4f-b978-46d8-a54f-67f23d261fbc req-fc0a65e6-14f5-478b-bed8-1ab9e80a86fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067921 Jul 26 14:19:42.635646 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1475/3092] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:42.644879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-992287be-2434-4b67-b789-c12330f005b3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:42.645881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-992287be-2434-4b67-b789-c12330f005b3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:42.657588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-992287be-2434-4b67-b789-c12330f005b3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:42.659025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-992287be-2434-4b67-b789-c12330f005b3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:42.660310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-992287be-2434-4b67-b789-c12330f005b3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:42.661901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-992287be-2434-4b67-b789-c12330f005b3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:42.706040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:43.078289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:43.738319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-992287be-2434-4b67-b789-c12330f005b3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:43.758252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-992287be-2434-4b67-b789-c12330f005b3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:43.765600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-12dda8ee-5193-485c-9359-53fdfeeade09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:43.790943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-992287be-2434-4b67-b789-c12330f005b3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:43.800690 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-12dda8ee-5193-485c-9359-53fdfeeade09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1708 microversion: 2.1 time: 1.262927 Jul 26 14:19:43.801228 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-992287be-2434-4b67-b789-c12330f005b3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1724 microversion: 2.20 time: 1.158220 Jul 26 14:19:43.815627 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1476/3093] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:19:42 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1724 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:19:43.816834 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1618/3094] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:42 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1708 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:43.822727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a91f5dcc-761c-47a9-9a14-788b90a7f46a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:43.824222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a91f5dcc-761c-47a9-9a14-788b90a7f46a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:43.828819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6a344009-1c61-476d-86c2-df0fe4e1a4d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:43.830400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6a344009-1c61-476d-86c2-df0fe4e1a4d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:43.841654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a344009-1c61-476d-86c2-df0fe4e1a4d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:43.842426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a344009-1c61-476d-86c2-df0fe4e1a4d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:43.843886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a344009-1c61-476d-86c2-df0fe4e1a4d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:43.844565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a344009-1c61-476d-86c2-df0fe4e1a4d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:43.854901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a91f5dcc-761c-47a9-9a14-788b90a7f46a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:43.855536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a91f5dcc-761c-47a9-9a14-788b90a7f46a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:43.856513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a91f5dcc-761c-47a9-9a14-788b90a7f46a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:43.857077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a91f5dcc-761c-47a9-9a14-788b90a7f46a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:44.394698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6a344009-1c61-476d-86c2-df0fe4e1a4d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:44.411296 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6a344009-1c61-476d-86c2-df0fe4e1a4d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1329 microversion: 2.1 time: 0.588817 Jul 26 14:19:44.414253 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1477/3095] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:43 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1329 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:44.434585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9bbb8b26-dfe1-49e6-b3de-7def21a286d9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:44.437132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9bbb8b26-dfe1-49e6-b3de-7def21a286d9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:44.466636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9bbb8b26-dfe1-49e6-b3de-7def21a286d9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:44.467299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9bbb8b26-dfe1-49e6-b3de-7def21a286d9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:44.485540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9bbb8b26-dfe1-49e6-b3de-7def21a286d9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:44.487123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9bbb8b26-dfe1-49e6-b3de-7def21a286d9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:44.664686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a91f5dcc-761c-47a9-9a14-788b90a7f46a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:44.698070 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a91f5dcc-761c-47a9-9a14-788b90a7f46a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.879412 Jul 26 14:19:44.704002 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1619/3096] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:43 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:44.827656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9bff7371-2719-438b-8554-77e1dfc5decc tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:44.830699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9bff7371-2719-438b-8554-77e1dfc5decc tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:44.843625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bff7371-2719-438b-8554-77e1dfc5decc tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:44.845155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bff7371-2719-438b-8554-77e1dfc5decc tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:44.847613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bff7371-2719-438b-8554-77e1dfc5decc tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:44.848624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bff7371-2719-438b-8554-77e1dfc5decc tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:45.489065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9bbb8b26-dfe1-49e6-b3de-7def21a286d9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:45.519175 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9bbb8b26-dfe1-49e6-b3de-7def21a286d9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1316 microversion: 2.1 time: 1.102982 Jul 26 14:19:45.556133 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1478/3097] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:44 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1316 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:45.613511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4f46e8ca-3220-49bc-bdb9-93da3afa6737 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:45.613511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4f46e8ca-3220-49bc-bdb9-93da3afa6737 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:45.647311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f46e8ca-3220-49bc-bdb9-93da3afa6737 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:45.652793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f46e8ca-3220-49bc-bdb9-93da3afa6737 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:45.664921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f46e8ca-3220-49bc-bdb9-93da3afa6737 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:45.666291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f46e8ca-3220-49bc-bdb9-93da3afa6737 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:45.710731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:46.001397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9bff7371-2719-438b-8554-77e1dfc5decc tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:46.054830 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9bff7371-2719-438b-8554-77e1dfc5decc tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1708 microversion: 2.1 time: 1.234090 Jul 26 14:19:46.064960 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1620/3098] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:44 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1708 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:19:46.089552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e1595950-8f57-4b6f-b22b-d9c78565368a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:46.090624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e1595950-8f57-4b6f-b22b-d9c78565368a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:46.102996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1595950-8f57-4b6f-b22b-d9c78565368a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:46.104000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1595950-8f57-4b6f-b22b-d9c78565368a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:46.106267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1595950-8f57-4b6f-b22b-d9c78565368a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:46.107724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1595950-8f57-4b6f-b22b-d9c78565368a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:46.747634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:46.875572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4f46e8ca-3220-49bc-bdb9-93da3afa6737 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:46.956832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4f46e8ca-3220-49bc-bdb9-93da3afa6737 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:46.965708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4f46e8ca-3220-49bc-bdb9-93da3afa6737 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:46.968300 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4f46e8ca-3220-49bc-bdb9-93da3afa6737 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1724 microversion: 2.20 time: 1.423262 Jul 26 14:19:46.991035 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1479/3099] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:19:45 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1724 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:19:47.013436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6556875c-8b9a-46a5-b56d-a04fb69feca6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:47.018664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6556875c-8b9a-46a5-b56d-a04fb69feca6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:47.046059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6556875c-8b9a-46a5-b56d-a04fb69feca6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:47.046828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6556875c-8b9a-46a5-b56d-a04fb69feca6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:47.053140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6556875c-8b9a-46a5-b56d-a04fb69feca6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:47.056281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6556875c-8b9a-46a5-b56d-a04fb69feca6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:47.122201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e1595950-8f57-4b6f-b22b-d9c78565368a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:47.146938 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e1595950-8f57-4b6f-b22b-d9c78565368a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1329 microversion: 2.1 time: 1.073732 Jul 26 14:19:47.159986 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1621/3100] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:46 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1329 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:47.195677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a2fa9da-280b-497c-a0b1-83504a885f08 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:47.197351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9a2fa9da-280b-497c-a0b1-83504a885f08 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:47.244891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a2fa9da-280b-497c-a0b1-83504a885f08 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:47.250951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a2fa9da-280b-497c-a0b1-83504a885f08 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:47.254225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a2fa9da-280b-497c-a0b1-83504a885f08 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:47.255310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a2fa9da-280b-497c-a0b1-83504a885f08 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:48.134976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9a2fa9da-280b-497c-a0b1-83504a885f08 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:48.156977 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9a2fa9da-280b-497c-a0b1-83504a885f08 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1316 microversion: 2.1 time: 1.003066 Jul 26 14:19:48.159108 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1622/3101] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:47 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1316 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:48.169737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-3a40f5cb-ee64-47fa-8b46-f30a1cd55cfd req-168d966f-d0a7-48e6-8092-f284c99712d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a407c385-cada-449e-9963-366c564180b4", "tag": "23fae4f4-b6b5-4469-bbbf-c9307ad7b1c7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:48.203916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3a40f5cb-ee64-47fa-8b46-f30a1cd55cfd req-168d966f-d0a7-48e6-8092-f284c99712d8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:48.206515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3a40f5cb-ee64-47fa-8b46-f30a1cd55cfd req-168d966f-d0a7-48e6-8092-f284c99712d8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:48.233568 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-3a40f5cb-ee64-47fa-8b46-f30a1cd55cfd req-168d966f-d0a7-48e6-8092-f284c99712d8 service nova] Creating event network-changed:23fae4f4-b6b5-4469-bbbf-c9307ad7b1c7 for instance a407c385-cada-449e-9963-366c564180b4 on n-h2-833090-9 Jul 26 14:19:48.244702 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-3a40f5cb-ee64-47fa-8b46-f30a1cd55cfd req-168d966f-d0a7-48e6-8092-f284c99712d8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082862 Jul 26 14:19:48.246834 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1623/3102] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:48.259777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bbcb1fcb-0707-4f51-bfaf-041454ca26d3 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:48.261853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bbcb1fcb-0707-4f51-bfaf-041454ca26d3 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:48.278002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbcb1fcb-0707-4f51-bfaf-041454ca26d3 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:48.279301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbcb1fcb-0707-4f51-bfaf-041454ca26d3 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:48.281527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbcb1fcb-0707-4f51-bfaf-041454ca26d3 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:48.283409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbcb1fcb-0707-4f51-bfaf-041454ca26d3 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:48.308975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6556875c-8b9a-46a5-b56d-a04fb69feca6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:48.341786 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6556875c-8b9a-46a5-b56d-a04fb69feca6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 1.348229 Jul 26 14:19:48.377776 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1480/3103] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:46 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:48.528592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af2398f7-efcb-4c89-b6b1-2cd6bea4cb0b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'create', calling method: .version_select at 0x7f8787e4edc0>, body: {"keypair": {"name": "tempest-keypair-2071702475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCr49F/+YF5+RiwJwvi8tQRm3xlFkD9a14mZfpsD0dVDLLCF06Xq3n7dLXMOxzDYmBz8zibEBfBrRwm9YjSS/vBzJ3kc0ybW0vRDpkhBCb8q9jFvXs1RsV2Zs060CjLSw=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:48.560356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-af2398f7-efcb-4c89-b6b1-2cd6bea4cb0b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for project 991c7f82c09446409408ca9d0638fcba. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:19:48.571289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-af2398f7-efcb-4c89-b6b1-2cd6bea4cb0b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for user 7b5b7e30e280492b85d9c8f98fe09e43 and project 991c7f82c09446409408ca9d0638fcba. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:19:48.623140 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af2398f7-efcb-4c89-b6b1-2cd6bea4cb0b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.242775 Jul 26 14:19:48.649614 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1481/3104] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:19:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:48.653894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-34b25919-c613-4927-afaa-16c77447913a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:48.654517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-34b25919-c613-4927-afaa-16c77447913a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:48.670662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:48.673446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34b25919-c613-4927-afaa-16c77447913a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:48.675022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34b25919-c613-4927-afaa-16c77447913a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:48.676040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34b25919-c613-4927-afaa-16c77447913a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:48.676643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34b25919-c613-4927-afaa-16c77447913a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:48.836873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bbcb1fcb-0707-4f51-bfaf-041454ca26d3 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:48.865061 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bbcb1fcb-0707-4f51-bfaf-041454ca26d3 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1712 microversion: 2.1 time: 0.615664 Jul 26 14:19:48.866303 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1624/3105] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:48 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1712 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:48.904018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df0f69a4-faea-47a7-bd39-86ee4712f6b5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:48.905135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df0f69a4-faea-47a7-bd39-86ee4712f6b5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:48.916224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df0f69a4-faea-47a7-bd39-86ee4712f6b5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:48.917004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df0f69a4-faea-47a7-bd39-86ee4712f6b5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:48.919200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df0f69a4-faea-47a7-bd39-86ee4712f6b5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:48.919408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df0f69a4-faea-47a7-bd39-86ee4712f6b5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:49.035283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-34b25919-c613-4927-afaa-16c77447913a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:49.063680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-34b25919-c613-4927-afaa-16c77447913a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:49.067518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-34b25919-c613-4927-afaa-16c77447913a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:49.070264 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-34b25919-c613-4927-afaa-16c77447913a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1724 microversion: 2.20 time: 0.420039 Jul 26 14:19:49.072145 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1482/3106] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:19:48 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1724 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:19:49.199943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-344673fd-2077-47be-9bcb-421de910b185 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:49.201597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-344673fd-2077-47be-9bcb-421de910b185 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:49.214722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-344673fd-2077-47be-9bcb-421de910b185 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:49.216281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-344673fd-2077-47be-9bcb-421de910b185 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:49.218098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-344673fd-2077-47be-9bcb-421de910b185 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:49.219603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-344673fd-2077-47be-9bcb-421de910b185 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:49.413064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df0f69a4-faea-47a7-bd39-86ee4712f6b5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:49.452068 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df0f69a4-faea-47a7-bd39-86ee4712f6b5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1329 microversion: 2.1 time: 0.563489 Jul 26 14:19:49.452068 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1625/3107] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:48 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1329 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:49.466813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d2c0e8f2-9778-4cc6-9328-f4a0e6874e37 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:49.468980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d2c0e8f2-9778-4cc6-9328-f4a0e6874e37 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:49.483621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2c0e8f2-9778-4cc6-9328-f4a0e6874e37 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:49.484465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2c0e8f2-9778-4cc6-9328-f4a0e6874e37 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:49.487990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2c0e8f2-9778-4cc6-9328-f4a0e6874e37 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:49.489345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2c0e8f2-9778-4cc6-9328-f4a0e6874e37 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:49.703266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-344673fd-2077-47be-9bcb-421de910b185 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:49.724387 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-344673fd-2077-47be-9bcb-421de910b185 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1316 microversion: 2.1 time: 0.531326 Jul 26 14:19:49.746968 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1483/3108] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:49 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:50.013913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d2c0e8f2-9778-4cc6-9328-f4a0e6874e37 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:50.040507 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d2c0e8f2-9778-4cc6-9328-f4a0e6874e37 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.587290 Jul 26 14:19:50.043224 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1626/3109] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:49 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:50.107060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-116e0946-e11b-4001-9559-145e751c319f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:50.108393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-116e0946-e11b-4001-9559-145e751c319f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:50.139932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-116e0946-e11b-4001-9559-145e751c319f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:50.145137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-116e0946-e11b-4001-9559-145e751c319f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:50.147026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-116e0946-e11b-4001-9559-145e751c319f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:50.149377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-116e0946-e11b-4001-9559-145e751c319f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:50.491397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ea17e8e4-f414-49d5-ade7-1cd4097fa763 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:50.493042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ea17e8e4-f414-49d5-ade7-1cd4097fa763 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:50.519030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea17e8e4-f414-49d5-ade7-1cd4097fa763 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:50.521967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea17e8e4-f414-49d5-ade7-1cd4097fa763 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:50.522902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea17e8e4-f414-49d5-ade7-1cd4097fa763 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:50.523433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea17e8e4-f414-49d5-ade7-1cd4097fa763 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:50.592550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-116e0946-e11b-4001-9559-145e751c319f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:50.614086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-116e0946-e11b-4001-9559-145e751c319f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:50.651928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-116e0946-e11b-4001-9559-145e751c319f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:50.660610 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-116e0946-e11b-4001-9559-145e751c319f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1724 microversion: 2.20 time: 0.558422 Jul 26 14:19:50.661205 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1484/3110] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:19:50 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1724 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:19:50.765922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-120e2056-7bb0-44cc-901f-db8f361ddcb2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:50.766684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-120e2056-7bb0-44cc-901f-db8f361ddcb2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:50.782299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-120e2056-7bb0-44cc-901f-db8f361ddcb2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:50.782716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-120e2056-7bb0-44cc-901f-db8f361ddcb2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:50.784421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-120e2056-7bb0-44cc-901f-db8f361ddcb2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:50.784871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-120e2056-7bb0-44cc-901f-db8f361ddcb2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:51.281579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ea17e8e4-f414-49d5-ade7-1cd4097fa763 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:51.312517 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ea17e8e4-f414-49d5-ade7-1cd4097fa763 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1329 microversion: 2.1 time: 0.827044 Jul 26 14:19:51.314588 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1627/3111] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:50 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1329 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:51.327531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ac5e936c-1e8b-480e-8cbe-e7064c7eeb7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:51.330476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ac5e936c-1e8b-480e-8cbe-e7064c7eeb7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:51.347524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac5e936c-1e8b-480e-8cbe-e7064c7eeb7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:51.350263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac5e936c-1e8b-480e-8cbe-e7064c7eeb7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:51.355656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac5e936c-1e8b-480e-8cbe-e7064c7eeb7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:51.358135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac5e936c-1e8b-480e-8cbe-e7064c7eeb7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:51.406176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:51.425536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-120e2056-7bb0-44cc-901f-db8f361ddcb2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:51.451747 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-120e2056-7bb0-44cc-901f-db8f361ddcb2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1316 microversion: 2.1 time: 0.686502 Jul 26 14:19:51.455374 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1485/3112] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:50 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1316 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:51.713376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-066da477-bcd7-4a18-9936-65f6b5080a71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:51.714341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-066da477-bcd7-4a18-9936-65f6b5080a71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:51.747208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-066da477-bcd7-4a18-9936-65f6b5080a71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:51.752215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-066da477-bcd7-4a18-9936-65f6b5080a71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:51.753427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-066da477-bcd7-4a18-9936-65f6b5080a71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:51.753899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-066da477-bcd7-4a18-9936-65f6b5080a71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:52.589620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ac5e936c-1e8b-480e-8cbe-e7064c7eeb7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:52.617913 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ac5e936c-1e8b-480e-8cbe-e7064c7eeb7f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 1.300965 Jul 26 14:19:52.620408 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1628/3113] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:51 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:52.635888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f9c07053-c52a-4c56-9f31-4472e6dd77da req-98ba0d71-0be1-4901-a467-1f3e3e7ac9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9bd635b-0eae-4f59-8e28-d6d034cdb159", "name": "network-vif-plugged", "status": "completed", "tag": "22a590f7-4427-4dc1-8d35-fc64edb623f6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:52.666407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f9c07053-c52a-4c56-9f31-4472e6dd77da req-98ba0d71-0be1-4901-a467-1f3e3e7ac9c2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:52.667794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f9c07053-c52a-4c56-9f31-4472e6dd77da req-98ba0d71-0be1-4901-a467-1f3e3e7ac9c2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:52.687725 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f9c07053-c52a-4c56-9f31-4472e6dd77da req-98ba0d71-0be1-4901-a467-1f3e3e7ac9c2 service nova] Creating event network-vif-plugged:22a590f7-4427-4dc1-8d35-fc64edb623f6 for instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 on n-h1-833090-9 Jul 26 14:19:52.696751 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f9c07053-c52a-4c56-9f31-4472e6dd77da req-98ba0d71-0be1-4901-a467-1f3e3e7ac9c2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072391 Jul 26 14:19:52.698174 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1629/3114] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:52.706859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27bbc66c-fe79-4e33-b568-8054312e95c1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:52.708185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27bbc66c-fe79-4e33-b568-8054312e95c1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:52.729156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27bbc66c-fe79-4e33-b568-8054312e95c1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:52.730110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27bbc66c-fe79-4e33-b568-8054312e95c1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:52.733613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27bbc66c-fe79-4e33-b568-8054312e95c1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:52.740328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27bbc66c-fe79-4e33-b568-8054312e95c1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:52.898170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-066da477-bcd7-4a18-9936-65f6b5080a71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:52.919437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-066da477-bcd7-4a18-9936-65f6b5080a71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:52.927508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-066da477-bcd7-4a18-9936-65f6b5080a71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:52.933479 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-066da477-bcd7-4a18-9936-65f6b5080a71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1724 microversion: 2.20 time: 1.232801 Jul 26 14:19:52.935854 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1486/3115] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:19:51 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1724 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:19:52.947297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c811b0b-1ce0-475b-969e-cf067fc767e7 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:52.948758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5c811b0b-1ce0-475b-969e-cf067fc767e7 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:52.971875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c811b0b-1ce0-475b-969e-cf067fc767e7 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:52.973495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c811b0b-1ce0-475b-969e-cf067fc767e7 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:52.975602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c811b0b-1ce0-475b-969e-cf067fc767e7 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:52.976559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c811b0b-1ce0-475b-969e-cf067fc767e7 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:53.509524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5c811b0b-1ce0-475b-969e-cf067fc767e7 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:53.525389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27bbc66c-fe79-4e33-b568-8054312e95c1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:53.529212 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5c811b0b-1ce0-475b-969e-cf067fc767e7 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1316 microversion: 2.1 time: 0.591354 Jul 26 14:19:53.531120 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1487/3116] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:52 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1316 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:53.539566 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27bbc66c-fe79-4e33-b568-8054312e95c1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1329 microversion: 2.1 time: 0.838571 Jul 26 14:19:53.543301 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1630/3117] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:52 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1329 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:53.648399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-baafc90a-5f19-4e95-bc66-7f0982fac72c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:53.649131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-baafc90a-5f19-4e95-bc66-7f0982fac72c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:53.656240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-baafc90a-5f19-4e95-bc66-7f0982fac72c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:53.662203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-baafc90a-5f19-4e95-bc66-7f0982fac72c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:53.665817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-baafc90a-5f19-4e95-bc66-7f0982fac72c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:53.674652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-baafc90a-5f19-4e95-bc66-7f0982fac72c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:53.967178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4fdeed3f-f5d6-4422-8ace-59511f404f3e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:53.968373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4fdeed3f-f5d6-4422-8ace-59511f404f3e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:53.979349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4fdeed3f-f5d6-4422-8ace-59511f404f3e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:53.980169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4fdeed3f-f5d6-4422-8ace-59511f404f3e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:53.981714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4fdeed3f-f5d6-4422-8ace-59511f404f3e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:53.982453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4fdeed3f-f5d6-4422-8ace-59511f404f3e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:54.010041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-baafc90a-5f19-4e95-bc66-7f0982fac72c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:54.030877 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-baafc90a-5f19-4e95-bc66-7f0982fac72c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.384558 Jul 26 14:19:54.032423 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1488/3118] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:53 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:54.043696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-856005650", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "57ac168b-59fa-4a44-88ec-5fbc6a23582a"}], "security_groups": [{"name": "tempest-securitygroup--364712485"}], "key_name": "tempest-keypair-2071702475", "user_data": "}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:54.275106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4fdeed3f-f5d6-4422-8ace-59511f404f3e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:54.288698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] validate_networks() for [('57ac168b-59fa-4a44-88ec-5fbc6a23582a', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:19:54.295382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4fdeed3f-f5d6-4422-8ace-59511f404f3e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:54.304136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4fdeed3f-f5d6-4422-8ace-59511f404f3e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:54.307377 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4fdeed3f-f5d6-4422-8ace-59511f404f3e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1745 microversion: 2.20 time: 0.346018 Jul 26 14:19:54.308686 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1631/3119] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:19:53 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1745 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:19:54.569172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-234555a7-9c29-4c9a-b516-91ef9b263733 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:54.570192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-234555a7-9c29-4c9a-b516-91ef9b263733 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:54.579849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-234555a7-9c29-4c9a-b516-91ef9b263733 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:54.581171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-234555a7-9c29-4c9a-b516-91ef9b263733 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:54.582695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-234555a7-9c29-4c9a-b516-91ef9b263733 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:54.583773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-234555a7-9c29-4c9a-b516-91ef9b263733 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:54.978534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-234555a7-9c29-4c9a-b516-91ef9b263733 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:54.991740 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-234555a7-9c29-4c9a-b516-91ef9b263733 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1329 microversion: 2.1 time: 0.430301 Jul 26 14:19:54.992707 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1632/3120] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:54 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1329 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:19:54.998762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9f06bb2a-991a-4f9f-9d7e-2a5e4190ffaf tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:54.999727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9f06bb2a-991a-4f9f-9d7e-2a5e4190ffaf tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:55.007240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f06bb2a-991a-4f9f-9d7e-2a5e4190ffaf tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:55.008117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f06bb2a-991a-4f9f-9d7e-2a5e4190ffaf tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:55.009311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f06bb2a-991a-4f9f-9d7e-2a5e4190ffaf tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:55.010029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f06bb2a-991a-4f9f-9d7e-2a5e4190ffaf tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:55.042669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:19:55.043360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:19:55.043884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:19:55.044649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:19:55.045482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:19:55.063892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:55.065074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:55.066202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:55.066732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:55.083063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:19:55.101962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for project 991c7f82c09446409408ca9d0638fcba. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:19:55.109839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for user 7b5b7e30e280492b85d9c8f98fe09e43 and project 991c7f82c09446409408ca9d0638fcba. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:19:55.137359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:19:55.141139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:19:55.248993 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d24d0d1-f89f-44e3-945a-70c483315a65 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.214045 Jul 26 14:19:55.252661 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1489/3121] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:19:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:19:55.267621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-425c12b0-9837-4064-93df-53b24d7dc3fc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:55.269123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-425c12b0-9837-4064-93df-53b24d7dc3fc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:55.292817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-425c12b0-9837-4064-93df-53b24d7dc3fc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:55.294188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-425c12b0-9837-4064-93df-53b24d7dc3fc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:55.295654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-425c12b0-9837-4064-93df-53b24d7dc3fc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:55.296505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-425c12b0-9837-4064-93df-53b24d7dc3fc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:55.394504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9f06bb2a-991a-4f9f-9d7e-2a5e4190ffaf tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:55.428357 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9f06bb2a-991a-4f9f-9d7e-2a5e4190ffaf tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1503 microversion: 2.1 time: 0.432054 Jul 26 14:19:55.431735 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1633/3122] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:54 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1503 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:55.453109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95e1c62c-5c93-4c44-9225-67e4ebe745ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:55.457589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95e1c62c-5c93-4c44-9225-67e4ebe745ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:55.608976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-95e1c62c-5c93-4c44-9225-67e4ebe745ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:55.621340 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95e1c62c-5c93-4c44-9225-67e4ebe745ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1238 microversion: 2.1 time: 0.185838 Jul 26 14:19:55.622802 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1634/3123] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:55 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1238 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:55.630985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4bb941b0-8703-47c2-b3ba-9163cc4e6285 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:55.632260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4bb941b0-8703-47c2-b3ba-9163cc4e6285 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:55.644832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bb941b0-8703-47c2-b3ba-9163cc4e6285 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:55.645382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bb941b0-8703-47c2-b3ba-9163cc4e6285 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:55.646567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bb941b0-8703-47c2-b3ba-9163cc4e6285 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:55.647295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bb941b0-8703-47c2-b3ba-9163cc4e6285 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:55.748309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-425c12b0-9837-4064-93df-53b24d7dc3fc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:55.766518 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-425c12b0-9837-4064-93df-53b24d7dc3fc tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.511321 Jul 26 14:19:55.789625 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1490/3124] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:55 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:55.798208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-585363b8-e75a-4b52-8258-547b69ef9fb0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-390517127"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:55.799842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-585363b8-e75a-4b52-8258-547b69ef9fb0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:55.809510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-585363b8-e75a-4b52-8258-547b69ef9fb0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:55.810480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-585363b8-e75a-4b52-8258-547b69ef9fb0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:55.812002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-585363b8-e75a-4b52-8258-547b69ef9fb0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:55.812999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-585363b8-e75a-4b52-8258-547b69ef9fb0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:56.010048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4bb941b0-8703-47c2-b3ba-9163cc4e6285 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:56.051225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4bb941b0-8703-47c2-b3ba-9163cc4e6285 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:56.056625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4bb941b0-8703-47c2-b3ba-9163cc4e6285 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:56.064653 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4bb941b0-8703-47c2-b3ba-9163cc4e6285 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1745 microversion: 2.20 time: 0.440043 Jul 26 14:19:56.069131 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1635/3125] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:19:55 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1745 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:19:56.089703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-36444663-78b4-41c1-a09a-f0e624f9a7b3 req-90d1dccb-c05f-4d5b-9c7e-dd91c8d4a828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a407c385-cada-449e-9963-366c564180b4", "name": "network-vif-plugged", "status": "completed", "tag": "23fae4f4-b6b5-4469-bbbf-c9307ad7b1c7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:56.122012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-36444663-78b4-41c1-a09a-f0e624f9a7b3 req-90d1dccb-c05f-4d5b-9c7e-dd91c8d4a828 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:56.127991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-36444663-78b4-41c1-a09a-f0e624f9a7b3 req-90d1dccb-c05f-4d5b-9c7e-dd91c8d4a828 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:56.151160 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.network.security_group_api [None req-585363b8-e75a-4b52-8258-547b69ef9fb0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Adding security group 94e8ed2a-97db-4980-afff-745afacc556f to port 22a590f7-4427-4dc1-8d35-fc64edb623f6 Jul 26 14:19:56.171942 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-36444663-78b4-41c1-a09a-f0e624f9a7b3 req-90d1dccb-c05f-4d5b-9c7e-dd91c8d4a828 service nova] Creating event network-vif-plugged:23fae4f4-b6b5-4469-bbbf-c9307ad7b1c7 for instance a407c385-cada-449e-9963-366c564180b4 on n-h2-833090-9 Jul 26 14:19:56.190388 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-36444663-78b4-41c1-a09a-f0e624f9a7b3 req-90d1dccb-c05f-4d5b-9c7e-dd91c8d4a828 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118296 Jul 26 14:19:56.191441 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1636/3126] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:56.213199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7c1767b5-ed0e-41a0-8cfa-85735a31ff2d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:56.214666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7c1767b5-ed0e-41a0-8cfa-85735a31ff2d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:56.233076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c1767b5-ed0e-41a0-8cfa-85735a31ff2d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:56.237109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c1767b5-ed0e-41a0-8cfa-85735a31ff2d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:56.239110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c1767b5-ed0e-41a0-8cfa-85735a31ff2d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:56.250267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c1767b5-ed0e-41a0-8cfa-85735a31ff2d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:56.827532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7c1767b5-ed0e-41a0-8cfa-85735a31ff2d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:56.850826 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7c1767b5-ed0e-41a0-8cfa-85735a31ff2d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1329 microversion: 2.1 time: 0.656552 Jul 26 14:19:56.868582 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1637/3127] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:56 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1329 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:56.879871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1c3b98ea-3b3c-4bad-bfe3-1ae162df8e74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:56.880767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1c3b98ea-3b3c-4bad-bfe3-1ae162df8e74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:56.890264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c3b98ea-3b3c-4bad-bfe3-1ae162df8e74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:56.890888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c3b98ea-3b3c-4bad-bfe3-1ae162df8e74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:56.893053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c3b98ea-3b3c-4bad-bfe3-1ae162df8e74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:56.893402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c3b98ea-3b3c-4bad-bfe3-1ae162df8e74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:57.051352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1c3b98ea-3b3c-4bad-bfe3-1ae162df8e74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:57.126591 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1c3b98ea-3b3c-4bad-bfe3-1ae162df8e74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1290 microversion: 2.1 time: 0.253246 Jul 26 14:19:57.127645 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1638/3128] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:56 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1290 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:57.148961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-045763e9-70b8-4b29-a175-c45bdf6d8c19 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:57.158428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-045763e9-70b8-4b29-a175-c45bdf6d8c19 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:57.174783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-045763e9-70b8-4b29-a175-c45bdf6d8c19 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:57.176778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-045763e9-70b8-4b29-a175-c45bdf6d8c19 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:57.178603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-045763e9-70b8-4b29-a175-c45bdf6d8c19 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:57.179684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-045763e9-70b8-4b29-a175-c45bdf6d8c19 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:58.302303 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-585363b8-e75a-4b52-8258-547b69ef9fb0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159/action" status: 202 len: 0 microversion: 2.1 time: 2.511311 Jul 26 14:19:58.304466 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1491/3129] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:19:55 2022] POST /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159/action => generated 0 bytes in 2515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:19:58.319420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a058006e-13b5-4f3b-8700-fb4d50ac4b27 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:58.326833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a058006e-13b5-4f3b-8700-fb4d50ac4b27 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:58.361523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a058006e-13b5-4f3b-8700-fb4d50ac4b27 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:58.362934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a058006e-13b5-4f3b-8700-fb4d50ac4b27 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:58.370943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a058006e-13b5-4f3b-8700-fb4d50ac4b27 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:58.372128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a058006e-13b5-4f3b-8700-fb4d50ac4b27 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:58.581715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-045763e9-70b8-4b29-a175-c45bdf6d8c19 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:58.604349 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-045763e9-70b8-4b29-a175-c45bdf6d8c19 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 1.474850 Jul 26 14:19:58.611623 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1639/3130] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:57 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:58.628672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fa1cdef7-e882-46d9-834e-47a93709c3f6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:58.629961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fa1cdef7-e882-46d9-834e-47a93709c3f6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:58.648942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa1cdef7-e882-46d9-834e-47a93709c3f6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:58.650049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa1cdef7-e882-46d9-834e-47a93709c3f6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:58.653768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa1cdef7-e882-46d9-834e-47a93709c3f6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:58.658771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa1cdef7-e882-46d9-834e-47a93709c3f6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:59.231623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a058006e-13b5-4f3b-8700-fb4d50ac4b27 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:59.254600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a058006e-13b5-4f3b-8700-fb4d50ac4b27 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:59.256727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a058006e-13b5-4f3b-8700-fb4d50ac4b27 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:59.261284 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a058006e-13b5-4f3b-8700-fb4d50ac4b27 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1740 microversion: 2.20 time: 0.954713 Jul 26 14:19:59.263403 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1492/3131] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:19:58 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1740 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:19:59.288670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0277b202-6e50-4fba-84a5-8c0f9e603b6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:19:59.290083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0277b202-6e50-4fba-84a5-8c0f9e603b6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:59.314368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0277b202-6e50-4fba-84a5-8c0f9e603b6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:59.325145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0277b202-6e50-4fba-84a5-8c0f9e603b6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:59.328500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0277b202-6e50-4fba-84a5-8c0f9e603b6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:59.340062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0277b202-6e50-4fba-84a5-8c0f9e603b6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:59.550506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fa1cdef7-e882-46d9-834e-47a93709c3f6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:59.568765 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fa1cdef7-e882-46d9-834e-47a93709c3f6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1329 microversion: 2.1 time: 0.954695 Jul 26 14:19:59.585842 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1640/3132] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:58 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1329 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:59.598031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-c390d1b4-8e97-4416-ac07-cef9f4841df6 req-396f7443-fc2d-4999-84a4-96a55364fd3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9c25cd-3b3d-4c48-b620-b7ea6101bf3e", "name": "network-vif-plugged", "status": "completed", "tag": "13068f91-4844-4f82-95a3-ee7530c55d60"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:59.611130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c390d1b4-8e97-4416-ac07-cef9f4841df6 req-396f7443-fc2d-4999-84a4-96a55364fd3a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:59.611942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c390d1b4-8e97-4416-ac07-cef9f4841df6 req-396f7443-fc2d-4999-84a4-96a55364fd3a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:59.652191 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-c390d1b4-8e97-4416-ac07-cef9f4841df6 req-396f7443-fc2d-4999-84a4-96a55364fd3a service nova] Creating event network-vif-plugged:13068f91-4844-4f82-95a3-ee7530c55d60 for instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e on n-h1-833090-9 Jul 26 14:19:59.664389 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-c390d1b4-8e97-4416-ac07-cef9f4841df6 req-396f7443-fc2d-4999-84a4-96a55364fd3a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075663 Jul 26 14:19:59.665415 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1641/3133] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:19:59.676016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eaed5bc1-8f4b-48fa-b343-a5a8b93b8cf2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1071116113"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:59.677108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eaed5bc1-8f4b-48fa-b343-a5a8b93b8cf2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:19:59.692293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eaed5bc1-8f4b-48fa-b343-a5a8b93b8cf2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:59.693726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eaed5bc1-8f4b-48fa-b343-a5a8b93b8cf2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:59.695409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eaed5bc1-8f4b-48fa-b343-a5a8b93b8cf2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:59.696576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eaed5bc1-8f4b-48fa-b343-a5a8b93b8cf2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:19:59.931284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0277b202-6e50-4fba-84a5-8c0f9e603b6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:19:59.946080 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0277b202-6e50-4fba-84a5-8c0f9e603b6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1363 microversion: 2.1 time: 0.681215 Jul 26 14:19:59.947687 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1493/3134] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:19:59 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1363 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:19:59.955463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d6c6e0ce-c1b3-4aac-a044-bfa71aeabd5f req-9dc10335-ea55-4d99-a41e-c9b5aea06510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9bd635b-0eae-4f59-8e28-d6d034cdb159", "tag": "22a590f7-4427-4dc1-8d35-fc64edb623f6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:19:59.977591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d6c6e0ce-c1b3-4aac-a044-bfa71aeabd5f req-9dc10335-ea55-4d99-a41e-c9b5aea06510 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:19:59.978805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d6c6e0ce-c1b3-4aac-a044-bfa71aeabd5f req-9dc10335-ea55-4d99-a41e-c9b5aea06510 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:00.000549 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d6c6e0ce-c1b3-4aac-a044-bfa71aeabd5f req-9dc10335-ea55-4d99-a41e-c9b5aea06510 service nova] Creating event network-changed:22a590f7-4427-4dc1-8d35-fc64edb623f6 for instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 on n-h1-833090-9 Jul 26 14:20:00.015005 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d6c6e0ce-c1b3-4aac-a044-bfa71aeabd5f req-9dc10335-ea55-4d99-a41e-c9b5aea06510 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064607 Jul 26 14:20:00.027364 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1494/3135] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:00.038832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-36b585a9-dac5-41ed-99da-bd05c5eca61c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:00.040072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-36b585a9-dac5-41ed-99da-bd05c5eca61c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:00.052032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36b585a9-dac5-41ed-99da-bd05c5eca61c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:00.052697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36b585a9-dac5-41ed-99da-bd05c5eca61c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:00.053705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36b585a9-dac5-41ed-99da-bd05c5eca61c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:00.054235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36b585a9-dac5-41ed-99da-bd05c5eca61c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:00.159661 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.network.security_group_api [None req-eaed5bc1-8f4b-48fa-b343-a5a8b93b8cf2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Adding security group 9e5aba62-44f0-4c05-aa11-8a0564915ce5 to port 22a590f7-4427-4dc1-8d35-fc64edb623f6 Jul 26 14:20:01.437627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-36b585a9-dac5-41ed-99da-bd05c5eca61c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:01.475829 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-36b585a9-dac5-41ed-99da-bd05c5eca61c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 1.444642 Jul 26 14:20:01.481128 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1495/3136] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:00 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:01.493026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9775ea76-5f04-4683-b1a0-9da31bbf020a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:01.508622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9775ea76-5f04-4683-b1a0-9da31bbf020a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:01.510374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9775ea76-5f04-4683-b1a0-9da31bbf020a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Searching by: {'deleted': False, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:20:01.527340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9775ea76-5f04-4683-b1a0-9da31bbf020a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:01.537372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9775ea76-5f04-4683-b1a0-9da31bbf020a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:01.553212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9775ea76-5f04-4683-b1a0-9da31bbf020a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:01.554332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9775ea76-5f04-4683-b1a0-9da31bbf020a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:01.644779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-9775ea76-5f04-4683-b1a0-9da31bbf020a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:20:01.722615 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9775ea76-5f04-4683-b1a0-9da31bbf020a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.239363 Jul 26 14:20:01.736854 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1496/3137] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:20:01 2022] GET /compute/v2.1/servers => generated 334 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:01.756010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8c4d9a5d-f080-44a0-a07e-67eb2c53addc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:01.757067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8c4d9a5d-f080-44a0-a07e-67eb2c53addc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:01.765599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c4d9a5d-f080-44a0-a07e-67eb2c53addc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:01.766511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c4d9a5d-f080-44a0-a07e-67eb2c53addc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:01.768947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c4d9a5d-f080-44a0-a07e-67eb2c53addc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:01.769724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c4d9a5d-f080-44a0-a07e-67eb2c53addc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:02.332032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8c4d9a5d-f080-44a0-a07e-67eb2c53addc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:02.348162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8c4d9a5d-f080-44a0-a07e-67eb2c53addc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:02.351140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8c4d9a5d-f080-44a0-a07e-67eb2c53addc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:02.353051 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8c4d9a5d-f080-44a0-a07e-67eb2c53addc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1740 microversion: 2.20 time: 0.617334 Jul 26 14:20:02.365423 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1497/3138] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:01 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1740 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:02.374606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e307c219-cea5-4684-b1f7-0d62a518817e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:02.375775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e307c219-cea5-4684-b1f7-0d62a518817e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:02.395293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e307c219-cea5-4684-b1f7-0d62a518817e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:02.395640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e307c219-cea5-4684-b1f7-0d62a518817e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:02.397352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e307c219-cea5-4684-b1f7-0d62a518817e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:02.397824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e307c219-cea5-4684-b1f7-0d62a518817e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:02.728257 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eaed5bc1-8f4b-48fa-b343-a5a8b93b8cf2 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159/action" status: 202 len: 0 microversion: 2.1 time: 3.060895 Jul 26 14:20:02.729185 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1642/3139] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:19:59 2022] POST /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159/action => generated 0 bytes in 3063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:02.746045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ebfceb7d-4024-49ea-884f-30f291a17bc4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:02.749861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ebfceb7d-4024-49ea-884f-30f291a17bc4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:02.781465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebfceb7d-4024-49ea-884f-30f291a17bc4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:02.781968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebfceb7d-4024-49ea-884f-30f291a17bc4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:02.787237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebfceb7d-4024-49ea-884f-30f291a17bc4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:02.787882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebfceb7d-4024-49ea-884f-30f291a17bc4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:03.295816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e307c219-cea5-4684-b1f7-0d62a518817e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:03.305974 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e307c219-cea5-4684-b1f7-0d62a518817e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1509 microversion: 2.1 time: 0.938827 Jul 26 14:20:03.318900 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1498/3140] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:02 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1509 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:03.334366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-071d61fd-6590-4c2c-9c12-353e3960e2f8 req-f5346e21-0e1f-4bae-8695-aea9e49f51ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c584bb0a-2fbb-4014-9f21-bcb83a0068c0", "tag": "3ba17f96-9407-49f5-8771-0ba49b9937c1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:03.358883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-071d61fd-6590-4c2c-9c12-353e3960e2f8 req-f5346e21-0e1f-4bae-8695-aea9e49f51ae service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:03.359873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-071d61fd-6590-4c2c-9c12-353e3960e2f8 req-f5346e21-0e1f-4bae-8695-aea9e49f51ae service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:03.412198 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-071d61fd-6590-4c2c-9c12-353e3960e2f8 req-f5346e21-0e1f-4bae-8695-aea9e49f51ae service nova] Creating event network-changed:3ba17f96-9407-49f5-8771-0ba49b9937c1 for instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 on n-h1-833090-9 Jul 26 14:20:03.426016 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-071d61fd-6590-4c2c-9c12-353e3960e2f8 req-f5346e21-0e1f-4bae-8695-aea9e49f51ae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105357 Jul 26 14:20:03.429404 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1499/3141] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:03.443920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:03.460717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:03.468856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Searching by: {'deleted': False, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:20:03.479367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:03.482980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:03.484380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:03.487122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:03.498694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ebfceb7d-4024-49ea-884f-30f291a17bc4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:03.531871 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ebfceb7d-4024-49ea-884f-30f291a17bc4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1363 microversion: 2.1 time: 0.791740 Jul 26 14:20:03.543976 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1643/3142] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:02 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1363 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:03.555452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:20:03.557769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af57f2e9-2b3e-4a52-83bd-9d2bb6d1e36a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:03.559070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af57f2e9-2b3e-4a52-83bd-9d2bb6d1e36a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:03.586831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af57f2e9-2b3e-4a52-83bd-9d2bb6d1e36a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:03.587625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af57f2e9-2b3e-4a52-83bd-9d2bb6d1e36a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:03.589075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af57f2e9-2b3e-4a52-83bd-9d2bb6d1e36a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:03.589830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af57f2e9-2b3e-4a52-83bd-9d2bb6d1e36a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:03.602662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:03.613628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:03.614451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:04.079992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af57f2e9-2b3e-4a52-83bd-9d2bb6d1e36a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:04.115574 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c36421bd-476c-40c9-ae10-4301730b1b60 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 0.683385 Jul 26 14:20:04.121331 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af57f2e9-2b3e-4a52-83bd-9d2bb6d1e36a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.584418 Jul 26 14:20:04.123506 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1500/3143] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:20:03 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:04.136451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-00df987d-0ec3-4f36-a739-b8f7f0855792 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:04.137099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-00df987d-0ec3-4f36-a739-b8f7f0855792 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:04.152893 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1644/3144] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:03 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:04.160297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d67d6819-3270-451a-931b-f0acac7d1c84 req-d48f5a70-e15f-4126-9d98-0f623828f638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9bd635b-0eae-4f59-8e28-d6d034cdb159", "tag": "22a590f7-4427-4dc1-8d35-fc64edb623f6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:04.167559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00df987d-0ec3-4f36-a739-b8f7f0855792 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:04.172878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00df987d-0ec3-4f36-a739-b8f7f0855792 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:04.174929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00df987d-0ec3-4f36-a739-b8f7f0855792 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:04.175388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00df987d-0ec3-4f36-a739-b8f7f0855792 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:04.187393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d67d6819-3270-451a-931b-f0acac7d1c84 req-d48f5a70-e15f-4126-9d98-0f623828f638 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:04.198078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d67d6819-3270-451a-931b-f0acac7d1c84 req-d48f5a70-e15f-4126-9d98-0f623828f638 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:04.248685 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d67d6819-3270-451a-931b-f0acac7d1c84 req-d48f5a70-e15f-4126-9d98-0f623828f638 service nova] Creating event network-changed:22a590f7-4427-4dc1-8d35-fc64edb623f6 for instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 on n-h1-833090-9 Jul 26 14:20:04.260694 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d67d6819-3270-451a-931b-f0acac7d1c84 req-d48f5a70-e15f-4126-9d98-0f623828f638 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105811 Jul 26 14:20:04.265041 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1645/3145] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:04.295893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f77018e6-9217-4cf0-90a1-b405b50c7076 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:04.299660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f77018e6-9217-4cf0-90a1-b405b50c7076 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:04.313615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f77018e6-9217-4cf0-90a1-b405b50c7076 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:04.314923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f77018e6-9217-4cf0-90a1-b405b50c7076 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:04.316374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f77018e6-9217-4cf0-90a1-b405b50c7076 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:04.317274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f77018e6-9217-4cf0-90a1-b405b50c7076 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:04.788216 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-00df987d-0ec3-4f36-a739-b8f7f0855792 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.661062 Jul 26 14:20:04.788822 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1501/3146] 10.222.0.70 () {58 vars in 1293 bytes} [Tue Jul 26 14:20:04 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159/os-security-groups => generated 1156 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:04.794493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d616d54-830b-4260-bba0-b0fd50372323 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:04.796933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4d616d54-830b-4260-bba0-b0fd50372323 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:04.805394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f77018e6-9217-4cf0-90a1-b405b50c7076 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:04.823744 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f77018e6-9217-4cf0-90a1-b405b50c7076 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1509 microversion: 2.1 time: 0.557043 Jul 26 14:20:04.835987 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1646/3147] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:04 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1509 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:04.838200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d616d54-830b-4260-bba0-b0fd50372323 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:04.838200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d616d54-830b-4260-bba0-b0fd50372323 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:04.838200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d616d54-830b-4260-bba0-b0fd50372323 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:04.838200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d616d54-830b-4260-bba0-b0fd50372323 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:04.838964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f68a2901-649d-4a63-8b18-7bae3fd4938e tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:04.867726 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f68a2901-649d-4a63-8b18-7bae3fd4938e tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041703 Jul 26 14:20:04.877089 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1647/3148] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:20:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:04.877565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2f3c3853-4f76-4880-90f8-bd8b66a1dc7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:04.878967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2f3c3853-4f76-4880-90f8-bd8b66a1dc7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:04.890884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f3c3853-4f76-4880-90f8-bd8b66a1dc7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:04.892613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f3c3853-4f76-4880-90f8-bd8b66a1dc7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:04.894512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f3c3853-4f76-4880-90f8-bd8b66a1dc7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:04.894996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f3c3853-4f76-4880-90f8-bd8b66a1dc7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:05.335724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2f3c3853-4f76-4880-90f8-bd8b66a1dc7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:05.350674 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2f3c3853-4f76-4880-90f8-bd8b66a1dc7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1363 microversion: 2.1 time: 0.480451 Jul 26 14:20:05.364821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1648/3149] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:04 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:05.380727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90ad1ba1-2a30-46ee-91b3-68b878d1193f tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: .version_select at 0x7f8787d7a1f0>, body: {"security_group": {"name": " tempest-securitygroup -514170938 ", "description": "tempest-description-431547511"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:05.408665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4d616d54-830b-4260-bba0-b0fd50372323 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:05.422402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4d616d54-830b-4260-bba0-b0fd50372323 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:05.425705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4d616d54-830b-4260-bba0-b0fd50372323 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:05.428334 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4d616d54-830b-4260-bba0-b0fd50372323 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1740 microversion: 2.20 time: 0.638189 Jul 26 14:20:05.429298 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1502/3150] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:04 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1740 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:05.434986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d8797d5-c5c6-4790-89c2-e6c5d430bf32 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:05.435852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7d8797d5-c5c6-4790-89c2-e6c5d430bf32 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:05.445690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d8797d5-c5c6-4790-89c2-e6c5d430bf32 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:05.447752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d8797d5-c5c6-4790-89c2-e6c5d430bf32 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:05.449449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d8797d5-c5c6-4790-89c2-e6c5d430bf32 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:05.450213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d8797d5-c5c6-4790-89c2-e6c5d430bf32 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:05.517488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7d8797d5-c5c6-4790-89c2-e6c5d430bf32 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:20:05.621388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:05.764582 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7d8797d5-c5c6-4790-89c2-e6c5d430bf32 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 204 len: 0 microversion: 2.1 time: 0.331754 Jul 26 14:20:05.766260 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1503/3151] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:20:05 2022] DELETE /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:20:05.800753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4b47106d-b979-48c4-8e22-623afd55a899 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:05.802277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4b47106d-b979-48c4-8e22-623afd55a899 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:05.833051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b47106d-b979-48c4-8e22-623afd55a899 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:05.834121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b47106d-b979-48c4-8e22-623afd55a899 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:05.837927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b47106d-b979-48c4-8e22-623afd55a899 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:05.845795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b47106d-b979-48c4-8e22-623afd55a899 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:06.002980 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90ad1ba1-2a30-46ee-91b3-68b878d1193f tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.636085 Jul 26 14:20:06.016148 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1649/3152] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:20:05 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:06.023593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-81417562-a346-4351-84c6-2709eb91b438 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:06.034502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-81417562-a346-4351-84c6-2709eb91b438 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:06.056406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81417562-a346-4351-84c6-2709eb91b438 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:06.057459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81417562-a346-4351-84c6-2709eb91b438 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:06.058434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81417562-a346-4351-84c6-2709eb91b438 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:06.059016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81417562-a346-4351-84c6-2709eb91b438 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:06.111337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-81417562-a346-4351-84c6-2709eb91b438 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:20:06.136860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:06.254676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4b47106d-b979-48c4-8e22-623afd55a899 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:06.298763 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4b47106d-b979-48c4-8e22-623afd55a899 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.523454 Jul 26 14:20:06.300156 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1504/3153] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:05 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:06.313720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-08a87511-e279-4232-a1ee-2b806249ef4f req-d89fa122-43cc-4af6-a7c3-0e0809110fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a900e83e-11a0-4cd4-85c0-c09b6e4da5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "e7e7e1e8-b611-45a9-ab4b-a0bf0c504929"}, {"name": "network-changed", "server_uuid": "a900e83e-11a0-4cd4-85c0-c09b6e4da5c7", "tag": "e7e7e1e8-b611-45a9-ab4b-a0bf0c504929"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:06.320250 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-81417562-a346-4351-84c6-2709eb91b438 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 204 len: 0 microversion: 2.1 time: 0.302371 Jul 26 14:20:06.323308 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1650/3154] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:20:06 2022] DELETE /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:20:06.336581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a7fabe1a-8382-472c-a88e-3be7466e84d7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:06.339201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a7fabe1a-8382-472c-a88e-3be7466e84d7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:06.351081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7fabe1a-8382-472c-a88e-3be7466e84d7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:06.351880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7fabe1a-8382-472c-a88e-3be7466e84d7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:06.352297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-08a87511-e279-4232-a1ee-2b806249ef4f req-d89fa122-43cc-4af6-a7c3-0e0809110fc7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:06.352806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-08a87511-e279-4232-a1ee-2b806249ef4f req-d89fa122-43cc-4af6-a7c3-0e0809110fc7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:06.354259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7fabe1a-8382-472c-a88e-3be7466e84d7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:06.354957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7fabe1a-8382-472c-a88e-3be7466e84d7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:06.383130 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-08a87511-e279-4232-a1ee-2b806249ef4f req-d89fa122-43cc-4af6-a7c3-0e0809110fc7 service nova] Creating event network-vif-unplugged:e7e7e1e8-b611-45a9-ab4b-a0bf0c504929 for instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 on n-h1-833090-9 Jul 26 14:20:06.383931 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-08a87511-e279-4232-a1ee-2b806249ef4f req-d89fa122-43cc-4af6-a7c3-0e0809110fc7 service nova] Creating event network-changed:e7e7e1e8-b611-45a9-ab4b-a0bf0c504929 for instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 on n-h1-833090-9 Jul 26 14:20:06.400083 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-08a87511-e279-4232-a1ee-2b806249ef4f req-d89fa122-43cc-4af6-a7c3-0e0809110fc7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.097532 Jul 26 14:20:06.403849 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1505/3155] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:06.413127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6f3f4b4c-8c8f-4f1b-873f-6ee78a9c81f3 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f87943ffd30>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:06.780611 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6f3f4b4c-8c8f-4f1b-873f-6ee78a9c81f3 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/c2977099-e7f4-4a6b-b79c-2051927eafa1" status: 200 len: 222 microversion: 2.1 time: 0.372150 Jul 26 14:20:06.794761 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1506/3156] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:20:06 2022] GET /compute/v2.1/os-security-groups/c2977099-e7f4-4a6b-b79c-2051927eafa1 => generated 222 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:06.795289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a7fabe1a-8382-472c-a88e-3be7466e84d7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:06.803819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6e64e77-3677-4e00-8826-39edbea6942b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:06.807378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e6e64e77-3677-4e00-8826-39edbea6942b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:06.811251 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a7fabe1a-8382-472c-a88e-3be7466e84d7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1515 microversion: 2.1 time: 0.484411 Jul 26 14:20:06.822596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6e64e77-3677-4e00-8826-39edbea6942b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:06.824157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6e64e77-3677-4e00-8826-39edbea6942b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:06.824723 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1651/3157] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:06 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1515 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:06.827106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6e64e77-3677-4e00-8826-39edbea6942b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:06.828855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6e64e77-3677-4e00-8826-39edbea6942b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:06.856202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0cda83fc-b6b6-4ae7-a2ea-ae3b1a38c1ba tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:06.857238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0cda83fc-b6b6-4ae7-a2ea-ae3b1a38c1ba tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:06.864328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:06.877245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cda83fc-b6b6-4ae7-a2ea-ae3b1a38c1ba tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:06.878156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cda83fc-b6b6-4ae7-a2ea-ae3b1a38c1ba tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:06.880492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cda83fc-b6b6-4ae7-a2ea-ae3b1a38c1ba tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:06.881166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0cda83fc-b6b6-4ae7-a2ea-ae3b1a38c1ba tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:07.245476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6e64e77-3677-4e00-8826-39edbea6942b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:07.265039 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6e64e77-3677-4e00-8826-39edbea6942b tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1702 microversion: 2.1 time: 0.472791 Jul 26 14:20:07.280514 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1507/3158] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:06 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1702 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:07.315342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-efd925ab-5928-482c-bf7d-e3b3ce2a9fb4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:07.316486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-efd925ab-5928-482c-bf7d-e3b3ce2a9fb4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:07.335437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0cda83fc-b6b6-4ae7-a2ea-ae3b1a38c1ba tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:07.338878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-efd925ab-5928-482c-bf7d-e3b3ce2a9fb4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:07.339608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-efd925ab-5928-482c-bf7d-e3b3ce2a9fb4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:07.341316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-efd925ab-5928-482c-bf7d-e3b3ce2a9fb4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:07.343896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-efd925ab-5928-482c-bf7d-e3b3ce2a9fb4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:07.352979 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0cda83fc-b6b6-4ae7-a2ea-ae3b1a38c1ba tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1363 microversion: 2.1 time: 0.526873 Jul 26 14:20:07.354994 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1652/3159] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:06 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1363 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:07.363854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4dc93ad2-deb4-4df0-8718-5db97d13d396 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8799272940>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:07.823404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-efd925ab-5928-482c-bf7d-e3b3ce2a9fb4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:07.849518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-efd925ab-5928-482c-bf7d-e3b3ce2a9fb4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:07.854860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-efd925ab-5928-482c-bf7d-e3b3ce2a9fb4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:07.858865 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-efd925ab-5928-482c-bf7d-e3b3ce2a9fb4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1740 microversion: 2.20 time: 0.569614 Jul 26 14:20:07.872213 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1508/3160] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:07 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1740 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:07.886580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ee14245-4d5e-4744-a701-c39688277334 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:07.886580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ee14245-4d5e-4744-a701-c39688277334 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:07.892847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ee14245-4d5e-4744-a701-c39688277334 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:07.895741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ee14245-4d5e-4744-a701-c39688277334 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:07.897629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ee14245-4d5e-4744-a701-c39688277334 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:07.898734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ee14245-4d5e-4744-a701-c39688277334 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:08.075382 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4dc93ad2-deb4-4df0-8718-5db97d13d396 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c2977099-e7f4-4a6b-b79c-2051927eafa1" status: 202 len: 0 microversion: 2.1 time: 0.718484 Jul 26 14:20:08.076569 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1653/3161] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:20:07 2022] DELETE /compute/v2.1/os-security-groups/c2977099-e7f4-4a6b-b79c-2051927eafa1 => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:08.089425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6065530-397e-4914-8b34-7ea10373639f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:08.090266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e6065530-397e-4914-8b34-7ea10373639f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:08.117234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:08.120138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6065530-397e-4914-8b34-7ea10373639f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:08.120978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6065530-397e-4914-8b34-7ea10373639f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:08.122456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6065530-397e-4914-8b34-7ea10373639f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:08.123411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6065530-397e-4914-8b34-7ea10373639f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:08.370972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8ee14245-4d5e-4744-a701-c39688277334 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:08.384330 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ee14245-4d5e-4744-a701-c39688277334 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.521531 Jul 26 14:20:08.385209 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1509/3162] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:07 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:08.393458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-da14cf3b-b5cb-4e4b-b0d8-123d66bc6c50 req-66c0a551-d149-48b3-b948-c9a717c48eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c584bb0a-2fbb-4014-9f21-bcb83a0068c0", "name": "network-vif-plugged", "status": "completed", "tag": "3ba17f96-9407-49f5-8771-0ba49b9937c1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:08.412167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-da14cf3b-b5cb-4e4b-b0d8-123d66bc6c50 req-66c0a551-d149-48b3-b948-c9a717c48eac service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:08.413091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-da14cf3b-b5cb-4e4b-b0d8-123d66bc6c50 req-66c0a551-d149-48b3-b948-c9a717c48eac service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:08.434506 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-da14cf3b-b5cb-4e4b-b0d8-123d66bc6c50 req-66c0a551-d149-48b3-b948-c9a717c48eac service nova] Creating event network-vif-plugged:3ba17f96-9407-49f5-8771-0ba49b9937c1 for instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 on n-h1-833090-9 Jul 26 14:20:08.444556 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-da14cf3b-b5cb-4e4b-b0d8-123d66bc6c50 req-66c0a551-d149-48b3-b948-c9a717c48eac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057437 Jul 26 14:20:08.446186 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1510/3163] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:08.459418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d2fa860-1f4d-47d7-9c7b-f7b12f4c10cd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:08.461177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8d2fa860-1f4d-47d7-9c7b-f7b12f4c10cd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:08.476474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d2fa860-1f4d-47d7-9c7b-f7b12f4c10cd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:08.477641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d2fa860-1f4d-47d7-9c7b-f7b12f4c10cd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:08.479989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d2fa860-1f4d-47d7-9c7b-f7b12f4c10cd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:08.481026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d2fa860-1f4d-47d7-9c7b-f7b12f4c10cd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:08.510133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e6065530-397e-4914-8b34-7ea10373639f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:08.546063 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e6065530-397e-4914-8b34-7ea10373639f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1515 microversion: 2.1 time: 0.462949 Jul 26 14:20:08.550350 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1654/3164] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:08 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1515 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:08.565177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5700e7b8-f923-44fc-95cc-967c2e18f732 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8794acd280>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:08.636500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-5700e7b8-f923-44fc-95cc-967c2e18f732 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:20:08.638567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-5700e7b8-f923-44fc-95cc-967c2e18f732 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Neutron security group c2977099-e7f4-4a6b-b79c-2051927eafa1 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:20:08.639943 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-5700e7b8-f923-44fc-95cc-967c2e18f732 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:20:08.639943 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-334efd10-ea0a-4040-8c2a-8e87325fedaf'] Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5700e7b8-f923-44fc-95cc-967c2e18f732 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-security-groups/c2977099-e7f4-4a6b-b79c-2051927eafa1 HTTP/1.1 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-334efd10-ea0a-4040-8c2a-8e87325fedaf'] Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c2977099-e7f4-4a6b-b79c-2051927eafa1'} Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:20:08.646568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-334efd10-ea0a-4040-8c2a-8e87325fedaf'] Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-334efd10-ea0a-4040-8c2a-8e87325fedaf'] Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-334efd10-ea0a-4040-8c2a-8e87325fedaf'] Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-334efd10-ea0a-4040-8c2a-8e87325fedaf'] Jul 26 14:20:08.654082 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:08.669715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5700e7b8-f923-44fc-95cc-967c2e18f732 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:20:08.669715 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-334efd10-ea0a-4040-8c2a-8e87325fedaf'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:08.671279 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5700e7b8-f923-44fc-95cc-967c2e18f732 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/c2977099-e7f4-4a6b-b79c-2051927eafa1" status: 404 len: 194 microversion: 2.1 time: 0.118608 Jul 26 14:20:08.672485 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1655/3165] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:20:08 2022] GET /compute/v2.1/os-security-groups/c2977099-e7f4-4a6b-b79c-2051927eafa1 => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:20:08.686839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df12c09c-3241-4385-a579-a1b957a7a6f4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:08.699692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df12c09c-3241-4385-a579-a1b957a7a6f4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:08.722856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df12c09c-3241-4385-a579-a1b957a7a6f4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:08.723231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df12c09c-3241-4385-a579-a1b957a7a6f4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:08.724711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df12c09c-3241-4385-a579-a1b957a7a6f4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:08.725365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df12c09c-3241-4385-a579-a1b957a7a6f4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:09.081735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d2fa860-1f4d-47d7-9c7b-f7b12f4c10cd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:09.111762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d2fa860-1f4d-47d7-9c7b-f7b12f4c10cd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:09.115341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d2fa860-1f4d-47d7-9c7b-f7b12f4c10cd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:09.117963 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d2fa860-1f4d-47d7-9c7b-f7b12f4c10cd tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 2942 microversion: 2.32 time: 0.669746 Jul 26 14:20:09.119070 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1511/3166] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:08 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 2942 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:09.127680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c967ab05-e6fe-4021-81f2-3af0b615d5ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:09.128390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c967ab05-e6fe-4021-81f2-3af0b615d5ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:09.142781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df12c09c-3241-4385-a579-a1b957a7a6f4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:09.143455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c967ab05-e6fe-4021-81f2-3af0b615d5ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:09.144794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c967ab05-e6fe-4021-81f2-3af0b615d5ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:09.147260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c967ab05-e6fe-4021-81f2-3af0b615d5ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:09.148014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c967ab05-e6fe-4021-81f2-3af0b615d5ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:09.159375 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df12c09c-3241-4385-a579-a1b957a7a6f4 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1702 microversion: 2.1 time: 0.478511 Jul 26 14:20:09.160372 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1656/3167] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:08 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1702 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:09.167439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-393d021d-9dcd-4f03-8ea0-5a6961d2bb56 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: .version_select at 0x7f87993d6ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1161680462", "description": "tempest-description-1041127468"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:09.540021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c967ab05-e6fe-4021-81f2-3af0b615d5ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:09.556697 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c967ab05-e6fe-4021-81f2-3af0b615d5ae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1363 microversion: 2.1 time: 0.435197 Jul 26 14:20:09.572120 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1512/3168] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:09 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:09.572120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3014e37b-ad0e-4542-9161-2f16e025c729 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:09.572120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3014e37b-ad0e-4542-9161-2f16e025c729 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:09.590845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3014e37b-ad0e-4542-9161-2f16e025c729 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:09.591563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3014e37b-ad0e-4542-9161-2f16e025c729 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:09.593306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3014e37b-ad0e-4542-9161-2f16e025c729 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:09.594393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3014e37b-ad0e-4542-9161-2f16e025c729 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:09.606604 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-393d021d-9dcd-4f03-8ea0-5a6961d2bb56 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.444553 Jul 26 14:20:09.620509 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1657/3169] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:20:09 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:09.631044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e5a552cc-e11d-4479-aa98-3ecaaa1bbf15 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:09.632024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e5a552cc-e11d-4479-aa98-3ecaaa1bbf15 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:09.644023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5a552cc-e11d-4479-aa98-3ecaaa1bbf15 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:09.647339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5a552cc-e11d-4479-aa98-3ecaaa1bbf15 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:09.650461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5a552cc-e11d-4479-aa98-3ecaaa1bbf15 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:09.651571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5a552cc-e11d-4479-aa98-3ecaaa1bbf15 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:09.924544 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e5a552cc-e11d-4479-aa98-3ecaaa1bbf15 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.301647 Jul 26 14:20:09.938083 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1658/3170] 10.222.0.70 () {60 vars in 1316 bytes} [Tue Jul 26 14:20:09 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb/os-interface => generated 1830 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:09.938083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c942e868-51b5-422e-af94-9b52042fe995 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:09.938083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c942e868-51b5-422e-af94-9b52042fe995 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:09.951647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c942e868-51b5-422e-af94-9b52042fe995 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:09.952716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c942e868-51b5-422e-af94-9b52042fe995 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:09.954545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c942e868-51b5-422e-af94-9b52042fe995 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:09.955372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c942e868-51b5-422e-af94-9b52042fe995 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:09.988411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3014e37b-ad0e-4542-9161-2f16e025c729 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:10.010511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3014e37b-ad0e-4542-9161-2f16e025c729 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:10.014362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3014e37b-ad0e-4542-9161-2f16e025c729 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:10.016495 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3014e37b-ad0e-4542-9161-2f16e025c729 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1740 microversion: 2.20 time: 0.456179 Jul 26 14:20:10.017868 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1513/3171] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:09 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1740 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:10.029988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8dea8945-fd4c-49ac-a2a2-e8b100346532 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:10.029988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8dea8945-fd4c-49ac-a2a2-e8b100346532 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:10.040380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8dea8945-fd4c-49ac-a2a2-e8b100346532 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:10.041251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8dea8945-fd4c-49ac-a2a2-e8b100346532 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:10.042686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8dea8945-fd4c-49ac-a2a2-e8b100346532 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:10.043483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8dea8945-fd4c-49ac-a2a2-e8b100346532 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:10.297297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c942e868-51b5-422e-af94-9b52042fe995 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:10.317506 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c942e868-51b5-422e-af94-9b52042fe995 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.390632 Jul 26 14:20:10.333207 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1659/3172] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:09 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:10.355708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dc145dd4-5ef9-41b5-897f-3bec4683878a tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: .version_select at 0x7f8787ec0a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-743885168", "description": "tempest-description-179403489"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:10.377743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8dea8945-fd4c-49ac-a2a2-e8b100346532 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:10.407091 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8dea8945-fd4c-49ac-a2a2-e8b100346532 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 200 len: 1515 microversion: 2.1 time: 0.387589 Jul 26 14:20:10.409076 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1514/3173] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:10 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 1515 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:10.414517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4dbd5e00-fd82-4a4b-a36c-88123a61cd69 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:10.415787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4dbd5e00-fd82-4a4b-a36c-88123a61cd69 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:10.423788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dbd5e00-fd82-4a4b-a36c-88123a61cd69 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:10.424789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dbd5e00-fd82-4a4b-a36c-88123a61cd69 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:10.426151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dbd5e00-fd82-4a4b-a36c-88123a61cd69 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:10.426767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dbd5e00-fd82-4a4b-a36c-88123a61cd69 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:10.960479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4dbd5e00-fd82-4a4b-a36c-88123a61cd69 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:10.981418 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4dbd5e00-fd82-4a4b-a36c-88123a61cd69 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1702 microversion: 2.1 time: 0.570615 Jul 26 14:20:10.992639 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1515/3174] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:10 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1702 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:11.013956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e77f2347-c89d-406a-a041-c889265358be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:11.018264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e77f2347-c89d-406a-a041-c889265358be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:11.037633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e77f2347-c89d-406a-a041-c889265358be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:11.038281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e77f2347-c89d-406a-a041-c889265358be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:11.039229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e77f2347-c89d-406a-a041-c889265358be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:11.041039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e77f2347-c89d-406a-a041-c889265358be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:11.168316 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dc145dd4-5ef9-41b5-897f-3bec4683878a tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.823459 Jul 26 14:20:11.168927 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1660/3175] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:20:10 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:11.187586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b474bb7a-c03b-4f97-bcad-0d32f5accc21 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:11.189076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b474bb7a-c03b-4f97-bcad-0d32f5accc21 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:11.197597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b474bb7a-c03b-4f97-bcad-0d32f5accc21 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:11.198335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b474bb7a-c03b-4f97-bcad-0d32f5accc21 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:11.199338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b474bb7a-c03b-4f97-bcad-0d32f5accc21 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:11.200195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b474bb7a-c03b-4f97-bcad-0d32f5accc21 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:11.720985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e77f2347-c89d-406a-a041-c889265358be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:11.752192 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e77f2347-c89d-406a-a041-c889265358be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1549 microversion: 2.1 time: 0.754264 Jul 26 14:20:11.753166 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1516/3176] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:10 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1549 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:11.774259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-33e2ae5b-8a92-4dee-8e29-a5460fecec46 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: .version_select at 0x7f8799437af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-601459561", "description": "tempest-description-924508605"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:12.058019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b474bb7a-c03b-4f97-bcad-0d32f5accc21 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:12.071827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b474bb7a-c03b-4f97-bcad-0d32f5accc21 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:12.081455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b474bb7a-c03b-4f97-bcad-0d32f5accc21 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:12.088617 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b474bb7a-c03b-4f97-bcad-0d32f5accc21 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1740 microversion: 2.20 time: 0.903496 Jul 26 14:20:12.089676 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1661/3177] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:11 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1740 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:12.113048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1fdcc75a-ece8-459d-bd9b-ded5666c7bc5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:12.115469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1fdcc75a-ece8-459d-bd9b-ded5666c7bc5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:12.143918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fdcc75a-ece8-459d-bd9b-ded5666c7bc5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:12.144686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fdcc75a-ece8-459d-bd9b-ded5666c7bc5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:12.146250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fdcc75a-ece8-459d-bd9b-ded5666c7bc5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:12.147466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fdcc75a-ece8-459d-bd9b-ded5666c7bc5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:12.518923 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-33e2ae5b-8a92-4dee-8e29-a5460fecec46 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.757638 Jul 26 14:20:12.527601 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1517/3178] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:20:11 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:12.535087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-97a9fcd9-3391-4454-b854-b2919d6bc824 req-cde2c778-5364-4d47-a275-f49bafdcc024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a407c385-cada-449e-9963-366c564180b4", "name": "network-vif-deleted", "tag": "23fae4f4-b6b5-4469-bbbf-c9307ad7b1c7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:12.570484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-97a9fcd9-3391-4454-b854-b2919d6bc824 req-cde2c778-5364-4d47-a275-f49bafdcc024 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:12.573014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-97a9fcd9-3391-4454-b854-b2919d6bc824 req-cde2c778-5364-4d47-a275-f49bafdcc024 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:12.601650 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-97a9fcd9-3391-4454-b854-b2919d6bc824 req-cde2c778-5364-4d47-a275-f49bafdcc024 service nova] Creating event network-vif-deleted:23fae4f4-b6b5-4469-bbbf-c9307ad7b1c7 for instance a407c385-cada-449e-9963-366c564180b4 on n-h2-833090-9 Jul 26 14:20:12.616379 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-97a9fcd9-3391-4454-b854-b2919d6bc824 req-cde2c778-5364-4d47-a275-f49bafdcc024 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086291 Jul 26 14:20:12.621681 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1518/3179] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:12.650075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b5c97a8-0603-42a4-a682-90d6eaf0ac21 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:12.651767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b5c97a8-0603-42a4-a682-90d6eaf0ac21 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:12.678184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b5c97a8-0603-42a4-a682-90d6eaf0ac21 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:12.678680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b5c97a8-0603-42a4-a682-90d6eaf0ac21 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:12.679514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b5c97a8-0603-42a4-a682-90d6eaf0ac21 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:12.679983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b5c97a8-0603-42a4-a682-90d6eaf0ac21 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:12.701103 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8b5c97a8-0603-42a4-a682-90d6eaf0ac21 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b5c97a8-0603-42a4-a682-90d6eaf0ac21 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 HTTP/1.1 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'a407c385-cada-449e-9963-366c564180b4'} Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:12.703517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:12.714356 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:12.714356 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:12.714356 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:12.714356 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:12.714356 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:20:12.714356 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:12.714356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b5c97a8-0603-42a4-a682-90d6eaf0ac21 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:12.714356 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b5c97a8-0603-42a4-a682-90d6eaf0ac21 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 404 len: 111 microversion: 2.1 time: 0.077971 Jul 26 14:20:12.714356 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1519/3180] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:12 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:20:12.715725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d89a634f-8c3b-4f0f-8bdd-3ed4778d4c4f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:12.715725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d89a634f-8c3b-4f0f-8bdd-3ed4778d4c4f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:12.723849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d89a634f-8c3b-4f0f-8bdd-3ed4778d4c4f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:12.726987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d89a634f-8c3b-4f0f-8bdd-3ed4778d4c4f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:12.728454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d89a634f-8c3b-4f0f-8bdd-3ed4778d4c4f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:12.728925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d89a634f-8c3b-4f0f-8bdd-3ed4778d4c4f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:13.363486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1fdcc75a-ece8-459d-bd9b-ded5666c7bc5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:13.371807 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d89a634f-8c3b-4f0f-8bdd-3ed4778d4c4f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.660908 Jul 26 14:20:13.372470 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1520/3181] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:20:12 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/os-interface => generated 284 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:13.387625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-36e890a7-c6eb-4cd4-b971-c3cd1a3d9e8a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:13.390990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-36e890a7-c6eb-4cd4-b971-c3cd1a3d9e8a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:13.422342 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1fdcc75a-ece8-459d-bd9b-ded5666c7bc5 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 1.330832 Jul 26 14:20:13.423153 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1662/3182] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:12 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:13.441623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e7193e2e-b10b-4d2c-9f4b-b1630732e68b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f87993af280>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:13.468467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e890a7-c6eb-4cd4-b971-c3cd1a3d9e8a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:13.470921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e890a7-c6eb-4cd4-b971-c3cd1a3d9e8a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:13.472891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e890a7-c6eb-4cd4-b971-c3cd1a3d9e8a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:13.477258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e890a7-c6eb-4cd4-b971-c3cd1a3d9e8a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:13.578540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:13.615981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=12 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:13.718876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-36e890a7-c6eb-4cd4-b971-c3cd1a3d9e8a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f581ec33ecc4fad95a02efcc51594ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2c11617314349c1adeebc55c8c1a6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:13.728263 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-36e890a7-c6eb-4cd4-b971-c3cd1a3d9e8a tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 200 len: 1634 microversion: 2.1 time: 0.353903 Jul 26 14:20:13.737480 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1521/3183] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:13 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 1634 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:13.747669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c35e098-5d5f-4f6a-8109-cf530ef8156d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '.version_select at 0x7f8787bff700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:13.770096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:13.804936 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c35e098-5d5f-4f6a-8109-cf530ef8156d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-key-1206844691" status: 202 len: 0 microversion: 2.1 time: 0.071981 Jul 26 14:20:13.807988 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1522/3184] 10.222.0.70 () {58 vars in 1209 bytes} [Tue Jul 26 14:20:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1206844691 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:13.813249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0bfa177e-9d9a-407f-823f-55522a8e6573 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:13.814186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0bfa177e-9d9a-407f-823f-55522a8e6573 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:13.833504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bfa177e-9d9a-407f-823f-55522a8e6573 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:13.837357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bfa177e-9d9a-407f-823f-55522a8e6573 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:13.839056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bfa177e-9d9a-407f-823f-55522a8e6573 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:13.845392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0bfa177e-9d9a-407f-823f-55522a8e6573 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:14.273458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0bfa177e-9d9a-407f-823f-55522a8e6573 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:14.305814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0bfa177e-9d9a-407f-823f-55522a8e6573 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:14.308707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0bfa177e-9d9a-407f-823f-55522a8e6573 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:14.317281 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0bfa177e-9d9a-407f-823f-55522a8e6573 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1740 microversion: 2.20 time: 0.507751 Jul 26 14:20:14.318424 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1523/3185] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:13 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:14.348509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-27238698", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "2dc9e1a8-4a4f-459a-8038-83a80381fb0e"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:14.443991 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e7193e2e-b10b-4d2c-9f4b-b1630732e68b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 1.017389 Jul 26 14:20:14.453771 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1663/3186] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:20:13 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:14.460505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-11268aea-f505-4027-8d46-95eea5c24461 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787d7a4c0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:14.493070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] validate_networks() for [('2dc9e1a8-4a4f-459a-8038-83a80381fb0e', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:20:15.336817 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-11268aea-f505-4027-8d46-95eea5c24461 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/bb9e12cb-f023-470a-ba5e-7b4906832d17" status: 202 len: 0 microversion: 2.1 time: 0.880695 Jul 26 14:20:15.337732 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1664/3187] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:20:14 2022] DELETE /compute/v2.1/os-security-groups/bb9e12cb-f023-470a-ba5e-7b4906832d17 => generated 0 bytes in 883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:15.345341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a41be5af-bd1e-4082-a9c7-0d0a5f5dc92b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:15.346116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a41be5af-bd1e-4082-a9c7-0d0a5f5dc92b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:15.371113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a41be5af-bd1e-4082-a9c7-0d0a5f5dc92b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:15.373391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a41be5af-bd1e-4082-a9c7-0d0a5f5dc92b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:15.376816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a41be5af-bd1e-4082-a9c7-0d0a5f5dc92b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:15.378497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a41be5af-bd1e-4082-a9c7-0d0a5f5dc92b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:15.806618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:20:15.807591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:20:15.808949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:20:15.809947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:20:15.811465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:20:15.848571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a41be5af-bd1e-4082-a9c7-0d0a5f5dc92b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:15.859446 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a41be5af-bd1e-4082-a9c7-0d0a5f5dc92b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.520593 Jul 26 14:20:15.860313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:15.863204 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1665/3188] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:15 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:15.870433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7a7a0230-1bc9-447d-bed5-3214ead26df3 req-5a25cd10-758a-4287-ae84-4a83e920e2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42c5141-d427-4b45-8d3f-facf56bfe668", "name": "network-vif-deleted", "tag": "56cb7e7e-d518-4bee-8b79-70858a8691e3"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:15.878398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:15.896396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:15.904766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7a7a0230-1bc9-447d-bed5-3214ead26df3 req-5a25cd10-758a-4287-ae84-4a83e920e2dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:15.906992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7a7a0230-1bc9-447d-bed5-3214ead26df3 req-5a25cd10-758a-4287-ae84-4a83e920e2dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:15.910109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:15.936193 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7a7a0230-1bc9-447d-bed5-3214ead26df3 req-5a25cd10-758a-4287-ae84-4a83e920e2dd service nova] Creating event network-vif-deleted:56cb7e7e-d518-4bee-8b79-70858a8691e3 for instance e42c5141-d427-4b45-8d3f-facf56bfe668 on n-h2-833090-9 Jul 26 14:20:15.951381 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7a7a0230-1bc9-447d-bed5-3214ead26df3 req-5a25cd10-758a-4287-ae84-4a83e920e2dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086293 Jul 26 14:20:15.953184 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1666/3189] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:15.972546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f39478f1-c2e9-4d91-b5a5-599fbeac5ac9 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:15.973545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f39478f1-c2e9-4d91-b5a5-599fbeac5ac9 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] [instance: e42c5141-d427-4b45-8d3f-facf56bfe668] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:15.991374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f39478f1-c2e9-4d91-b5a5-599fbeac5ac9 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:15.992138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f39478f1-c2e9-4d91-b5a5-599fbeac5ac9 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:15.993739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f39478f1-c2e9-4d91-b5a5-599fbeac5ac9 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:15.994580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f39478f1-c2e9-4d91-b5a5-599fbeac5ac9 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:16.029596 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-f39478f1-c2e9-4d91-b5a5-599fbeac5ac9 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] HTTP exception thrown: Instance e42c5141-d427-4b45-8d3f-facf56bfe668 could not be found. Jul 26 14:20:16.030270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f39478f1-c2e9-4d91-b5a5-599fbeac5ac9 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Request method failure captured: Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 HTTP/1.1 Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_eeGmlomUw-vXOpbL1Q2yuDOMJtN60a2CAacbgz-xHkrDC_H3lqrUKpgtwiWB6xW3X_YbHL0Uy4gCmfaDONGLxl459ueoZrE4suQebm1uxWaLPmaRG12MmJ3lG9ofQ-eRRPMPcZ98cIbvnPSrfMvBEPLxhh0vJ87hPexFkPkL6TCDw Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: b2c11617314349c1adeebc55c8c1a6ba Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-948773259 Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2c11617314349c1adeebc55c8c1a6ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b2c11617314349c1adeebc55c8c1a6ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b2c11617314349c1adeebc55c8c1a6ba", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2c11617314349c1adeebc55c8c1a6ba"}]}] Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-948773259 Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: b2c11617314349c1adeebc55c8c1a6ba Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-948773259 Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-948773259-project Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 9f581ec33ecc4fad95a02efcc51594ac Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-948773259-project Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance e42c5141-d427-4b45-8d3f-facf56bfe668 could not be found. Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e42c5141-d427-4b45-8d3f-facf56bfe668'} Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42c5141-d427-4b45-8d3f-facf56bfe668 could not be found. Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42c5141-d427-4b45-8d3f-facf56bfe668 could not be found. Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.031695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:16.036680 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:16.036680 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:16.036680 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:16.036680 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:16.036680 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42c5141-d427-4b45-8d3f-facf56bfe668 could not be found. Jul 26 14:20:16.036680 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.038823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f39478f1-c2e9-4d91-b5a5-599fbeac5ac9 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Returning 404 to user: Instance e42c5141-d427-4b45-8d3f-facf56bfe668 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:16.041323 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f39478f1-c2e9-4d91-b5a5-599fbeac5ac9 tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668" status: 404 len: 111 microversion: 2.1 time: 0.082840 Jul 26 14:20:16.045046 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1667/3190] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:15 2022] GET /compute/v2.1/servers/e42c5141-d427-4b45-8d3f-facf56bfe668 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:20:16.052377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-18c7a4ff-a707-4565-8ab6-96d4199e37a0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787054550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:16.054054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for user 55daeaaa37a8498c9e540f5546277dc3 and project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:20:16.103683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:20:16.107709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:20:16.115650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-18c7a4ff-a707-4565-8ab6-96d4199e37a0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:20:16.116482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-18c7a4ff-a707-4565-8ab6-96d4199e37a0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Neutron security group bb9e12cb-f023-470a-ba5e-7b4906832d17 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:20:16.117191 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-18c7a4ff-a707-4565-8ab6-96d4199e37a0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:20:16.117191 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-dc59978c-d62c-4351-a75e-49e2645ac760'] Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-18c7a4ff-a707-4565-8ab6-96d4199e37a0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-security-groups/bb9e12cb-f023-470a-ba5e-7b4906832d17 HTTP/1.1 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-dc59978c-d62c-4351-a75e-49e2645ac760'] Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'bb9e12cb-f023-470a-ba5e-7b4906832d17'} Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:20:16.119639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc59978c-d62c-4351-a75e-49e2645ac760'] Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc59978c-d62c-4351-a75e-49e2645ac760'] Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc59978c-d62c-4351-a75e-49e2645ac760'] Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc59978c-d62c-4351-a75e-49e2645ac760'] Jul 26 14:20:16.123420 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:16.126573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-18c7a4ff-a707-4565-8ab6-96d4199e37a0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:20:16.126573 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-dc59978c-d62c-4351-a75e-49e2645ac760'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:16.127660 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-18c7a4ff-a707-4565-8ab6-96d4199e37a0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/bb9e12cb-f023-470a-ba5e-7b4906832d17" status: 404 len: 194 microversion: 2.1 time: 0.079123 Jul 26 14:20:16.128804 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1668/3191] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:20:16 2022] GET /compute/v2.1/os-security-groups/bb9e12cb-f023-470a-ba5e-7b4906832d17 => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:20:16.140308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3141dfb4-6800-47cb-af0e-9c7148b0984b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:16.147036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3141dfb4-6800-47cb-af0e-9c7148b0984b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:16.158544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3141dfb4-6800-47cb-af0e-9c7148b0984b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:16.159365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3141dfb4-6800-47cb-af0e-9c7148b0984b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:16.164859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3141dfb4-6800-47cb-af0e-9c7148b0984b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:16.166334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3141dfb4-6800-47cb-af0e-9c7148b0984b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:16.279506 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1f9168e2-ca30-4fe7-ac72-c787357ad059 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.955357 Jul 26 14:20:16.280877 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1524/3192] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:20:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:20:16.297845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-79f2344a-f1d0-431a-b83a-3eda0907a462 req-faa95232-c2fd-4946-a912-655e17b526d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c584bb0a-2fbb-4014-9f21-bcb83a0068c0", "tag": "3ba17f96-9407-49f5-8771-0ba49b9937c1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:16.316407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-79f2344a-f1d0-431a-b83a-3eda0907a462 req-faa95232-c2fd-4946-a912-655e17b526d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:16.320885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-79f2344a-f1d0-431a-b83a-3eda0907a462 req-faa95232-c2fd-4946-a912-655e17b526d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:16.364958 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-79f2344a-f1d0-431a-b83a-3eda0907a462 req-faa95232-c2fd-4946-a912-655e17b526d4 service nova] Creating event network-changed:3ba17f96-9407-49f5-8771-0ba49b9937c1 for instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 on n-h1-833090-9 Jul 26 14:20:16.385634 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-79f2344a-f1d0-431a-b83a-3eda0907a462 req-faa95232-c2fd-4946-a912-655e17b526d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091242 Jul 26 14:20:16.413172 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1525/3193] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:16.437684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-28ef38b7-ecd3-4409-9766-e98b270d3a52 req-f2829c71-9b5c-410d-a0b4-1178164247a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a900e83e-11a0-4cd4-85c0-c09b6e4da5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "e7e7e1e8-b611-45a9-ab4b-a0bf0c504929"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:16.480439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-28ef38b7-ecd3-4409-9766-e98b270d3a52 req-f2829c71-9b5c-410d-a0b4-1178164247a4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:16.481300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-28ef38b7-ecd3-4409-9766-e98b270d3a52 req-f2829c71-9b5c-410d-a0b4-1178164247a4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:16.521582 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-28ef38b7-ecd3-4409-9766-e98b270d3a52 req-f2829c71-9b5c-410d-a0b4-1178164247a4 service nova] Creating event network-vif-unplugged:e7e7e1e8-b611-45a9-ab4b-a0bf0c504929 for instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 on n-h1-833090-9 Jul 26 14:20:16.530904 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-28ef38b7-ecd3-4409-9766-e98b270d3a52 req-f2829c71-9b5c-410d-a0b4-1178164247a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112094 Jul 26 14:20:16.537365 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1526/3194] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:16.543640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a25291ca-3300-4bcf-b1ee-5a5f0d114dea tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] Calling method '.version_select at 0x7f8787bff700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:16.599274 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a25291ca-3300-4bcf-b1ee-5a5f0d114dea tempest-ServersTestJSON-948773259 tempest-ServersTestJSON-948773259-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542889772" status: 202 len: 0 microversion: 2.1 time: 0.060060 Jul 26 14:20:16.606285 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1527/3195] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:20:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542889772 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:16.615833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0a90f18d-c723-4bca-8823-0aaea87ca25c tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787add160>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:17.295323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3141dfb4-6800-47cb-af0e-9c7148b0984b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:17.333181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3141dfb4-6800-47cb-af0e-9c7148b0984b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:17.340244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3141dfb4-6800-47cb-af0e-9c7148b0984b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:17.342697 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3141dfb4-6800-47cb-af0e-9c7148b0984b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1740 microversion: 2.20 time: 1.212352 Jul 26 14:20:17.346821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1669/3196] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:16 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1740 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:17.361452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f509d1f0-120e-4826-894c-03b6b906eed9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:17.367144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f509d1f0-120e-4826-894c-03b6b906eed9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:17.656972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f509d1f0-120e-4826-894c-03b6b906eed9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:17.674795 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f509d1f0-120e-4826-894c-03b6b906eed9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1207 microversion: 2.1 time: 0.324844 Jul 26 14:20:17.698205 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1670/3197] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:17 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1207 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:17.733356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21f9b1c8-4853-483b-9995-5fc4183e134f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:17.734020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-21f9b1c8-4853-483b-9995-5fc4183e134f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:17.761946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21f9b1c8-4853-483b-9995-5fc4183e134f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:17.762546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21f9b1c8-4853-483b-9995-5fc4183e134f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:17.764545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21f9b1c8-4853-483b-9995-5fc4183e134f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:17.766259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21f9b1c8-4853-483b-9995-5fc4183e134f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:18.404011 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0a90f18d-c723-4bca-8823-0aaea87ca25c tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/ee79c273-b5fb-4a01-ac54-8d739f626ae7" status: 202 len: 0 microversion: 2.1 time: 1.796205 Jul 26 14:20:18.405746 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1528/3198] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:20:16 2022] DELETE /compute/v2.1/os-security-groups/ee79c273-b5fb-4a01-ac54-8d739f626ae7 => generated 0 bytes in 1799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:18.413299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7273e780-fa0b-48df-86ef-2b7a3b06abd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:18.414419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7273e780-fa0b-48df-86ef-2b7a3b06abd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:18.445318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7273e780-fa0b-48df-86ef-2b7a3b06abd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:18.446146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7273e780-fa0b-48df-86ef-2b7a3b06abd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:18.449609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7273e780-fa0b-48df-86ef-2b7a3b06abd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:18.452135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7273e780-fa0b-48df-86ef-2b7a3b06abd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:18.577000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-21f9b1c8-4853-483b-9995-5fc4183e134f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:18.591213 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-21f9b1c8-4853-483b-9995-5fc4183e134f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.892939 Jul 26 14:20:18.591821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1671/3199] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:17 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:18.599536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2db1de1-670a-44e9-9d64-0cea73e554e0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787fe2160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:18.701957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-e2db1de1-670a-44e9-9d64-0cea73e554e0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:20:18.702802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-e2db1de1-670a-44e9-9d64-0cea73e554e0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Neutron security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:20:18.703440 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e2db1de1-670a-44e9-9d64-0cea73e554e0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:20:18.703440 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-4154f466-fee7-4932-9a31-084c370a3af2'] Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2db1de1-670a-44e9-9d64-0cea73e554e0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-security-groups/ee79c273-b5fb-4a01-ac54-8d739f626ae7 HTTP/1.1 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-4154f466-fee7-4932-9a31-084c370a3af2'] Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'ee79c273-b5fb-4a01-ac54-8d739f626ae7'} Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:20:18.708403 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4154f466-fee7-4932-9a31-084c370a3af2'] Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4154f466-fee7-4932-9a31-084c370a3af2'] Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4154f466-fee7-4932-9a31-084c370a3af2'] Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4154f466-fee7-4932-9a31-084c370a3af2'] Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2db1de1-670a-44e9-9d64-0cea73e554e0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-4154f466-fee7-4932-9a31-084c370a3af2'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e2db1de1-670a-44e9-9d64-0cea73e554e0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/ee79c273-b5fb-4a01-ac54-8d739f626ae7" status: 404 len: 194 microversion: 2.1 time: 0.115752 Jul 26 14:20:18.718752 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1672/3200] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:20:18 2022] GET /compute/v2.1/os-security-groups/ee79c273-b5fb-4a01-ac54-8d739f626ae7 => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:20:18.737851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7046df73-85ec-4632-8b4c-523df22610fe req-742243ef-1f1e-4a31-b977-fd0eb7efa69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a900e83e-11a0-4cd4-85c0-c09b6e4da5c7", "name": "network-vif-unplugged", "status": "completed", "tag": "e7e7e1e8-b611-45a9-ab4b-a0bf0c504929"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:18.785444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7046df73-85ec-4632-8b4c-523df22610fe req-742243ef-1f1e-4a31-b977-fd0eb7efa69e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:18.787528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7046df73-85ec-4632-8b4c-523df22610fe req-742243ef-1f1e-4a31-b977-fd0eb7efa69e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:18.823436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7273e780-fa0b-48df-86ef-2b7a3b06abd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:18.837230 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7046df73-85ec-4632-8b4c-523df22610fe req-742243ef-1f1e-4a31-b977-fd0eb7efa69e service nova] Creating event network-vif-unplugged:e7e7e1e8-b611-45a9-ab4b-a0bf0c504929 for instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 on n-h1-833090-9 Jul 26 14:20:18.838068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7273e780-fa0b-48df-86ef-2b7a3b06abd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:18.843125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7273e780-fa0b-48df-86ef-2b7a3b06abd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:18.847394 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7273e780-fa0b-48df-86ef-2b7a3b06abd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1740 microversion: 2.20 time: 0.440044 Jul 26 14:20:18.849091 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1529/3201] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:18 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1740 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:18.853503 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7046df73-85ec-4632-8b4c-523df22610fe req-742243ef-1f1e-4a31-b977-fd0eb7efa69e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133878 Jul 26 14:20:18.854898 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1673/3202] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:18.859149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4f784e39-cf86-4d16-b8e7-ea6744909953 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:18.861551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4f784e39-cf86-4d16-b8e7-ea6744909953 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:18.878270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2acc71c9-5e39-450c-bb81-e9b598051d2e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8794061790>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:18.884887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f784e39-cf86-4d16-b8e7-ea6744909953 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:18.885428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f784e39-cf86-4d16-b8e7-ea6744909953 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:18.887398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f784e39-cf86-4d16-b8e7-ea6744909953 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:18.888882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f784e39-cf86-4d16-b8e7-ea6744909953 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:19.236545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4f784e39-cf86-4d16-b8e7-ea6744909953 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:19.280642 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4f784e39-cf86-4d16-b8e7-ea6744909953 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1259 microversion: 2.1 time: 0.429688 Jul 26 14:20:19.292052 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1530/3203] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:18 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1259 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:19.620361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5556a793-bfa4-4be0-bb45-fc891fcd8166 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:19.621559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5556a793-bfa4-4be0-bb45-fc891fcd8166 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:19.636245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5556a793-bfa4-4be0-bb45-fc891fcd8166 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:19.637196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5556a793-bfa4-4be0-bb45-fc891fcd8166 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:19.638719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5556a793-bfa4-4be0-bb45-fc891fcd8166 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:19.639431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5556a793-bfa4-4be0-bb45-fc891fcd8166 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:20.023046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5556a793-bfa4-4be0-bb45-fc891fcd8166 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:20.032268 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2acc71c9-5e39-450c-bb81-e9b598051d2e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/a89b51da-1fd2-4f99-a369-1e79318de775" status: 202 len: 0 microversion: 2.1 time: 1.175071 Jul 26 14:20:20.033464 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5556a793-bfa4-4be0-bb45-fc891fcd8166 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1717 microversion: 2.1 time: 0.416818 Jul 26 14:20:20.034386 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1674/3205] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:20:18 2022] DELETE /compute/v2.1/os-security-groups/a89b51da-1fd2-4f99-a369-1e79318de775 => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:20.034521 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1531/3205] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:19 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1717 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:20.041413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05f83a57-c006-48af-8a0f-52e8fce816aa tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:20.042702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05f83a57-c006-48af-8a0f-52e8fce816aa tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:20.051568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-26421de6-5d6e-456b-8f30-a9e2b58fdb86 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787fe28b0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:20.055187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05f83a57-c006-48af-8a0f-52e8fce816aa tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:20.056174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05f83a57-c006-48af-8a0f-52e8fce816aa tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:20.057302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05f83a57-c006-48af-8a0f-52e8fce816aa tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:20.057991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05f83a57-c006-48af-8a0f-52e8fce816aa tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:20.085599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:20.119796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-26421de6-5d6e-456b-8f30-a9e2b58fdb86 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:20:20.120851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-26421de6-5d6e-456b-8f30-a9e2b58fdb86 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Neutron security group a89b51da-1fd2-4f99-a369-1e79318de775 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:20:20.121965 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-26421de6-5d6e-456b-8f30-a9e2b58fdb86 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:20:20.121965 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-755b48fb-86fa-4a21-8f58-07ce9fe0a876'] Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-26421de6-5d6e-456b-8f30-a9e2b58fdb86 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-security-groups/a89b51da-1fd2-4f99-a369-1e79318de775 HTTP/1.1 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-755b48fb-86fa-4a21-8f58-07ce9fe0a876'] Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'a89b51da-1fd2-4f99-a369-1e79318de775'} Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:20:20.125055 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-755b48fb-86fa-4a21-8f58-07ce9fe0a876'] Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-755b48fb-86fa-4a21-8f58-07ce9fe0a876'] Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-755b48fb-86fa-4a21-8f58-07ce9fe0a876'] Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-755b48fb-86fa-4a21-8f58-07ce9fe0a876'] Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-26421de6-5d6e-456b-8f30-a9e2b58fdb86 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-755b48fb-86fa-4a21-8f58-07ce9fe0a876'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-26421de6-5d6e-456b-8f30-a9e2b58fdb86 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/a89b51da-1fd2-4f99-a369-1e79318de775" status: 404 len: 194 microversion: 2.1 time: 0.080766 Jul 26 14:20:20.131854 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1675/3206] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:20:20 2022] GET /compute/v2.1/os-security-groups/a89b51da-1fd2-4f99-a369-1e79318de775 => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:20:20.143177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d56cc61-01e0-4f7d-b26e-ddb98b3962e1 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787ec0430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:20.401041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05f83a57-c006-48af-8a0f-52e8fce816aa tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:20.412357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05f83a57-c006-48af-8a0f-52e8fce816aa tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:20.416145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05f83a57-c006-48af-8a0f-52e8fce816aa tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:20.417801 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05f83a57-c006-48af-8a0f-52e8fce816aa tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1740 microversion: 2.20 time: 0.382014 Jul 26 14:20:20.418514 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1532/3207] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:20 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1740 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:20.425545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dca6ebab-4b52-44f7-9721-f63da097cc38 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:20.426445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dca6ebab-4b52-44f7-9721-f63da097cc38 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:20.435305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dca6ebab-4b52-44f7-9721-f63da097cc38 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:20.436355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dca6ebab-4b52-44f7-9721-f63da097cc38 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:20.437368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dca6ebab-4b52-44f7-9721-f63da097cc38 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:20.438064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dca6ebab-4b52-44f7-9721-f63da097cc38 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:20.565947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dca6ebab-4b52-44f7-9721-f63da097cc38 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:20.575622 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dca6ebab-4b52-44f7-9721-f63da097cc38 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1265 microversion: 2.1 time: 0.155732 Jul 26 14:20:20.576484 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1533/3208] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:20 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:20.724041 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0d56cc61-01e0-4f7d-b26e-ddb98b3962e1 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.588480 Jul 26 14:20:20.725080 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1676/3209] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:20:20 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:20.748318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-879788d5-876a-438f-82dc-9d09a303c1e9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: .version_select at 0x7f87993adf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1874005150", "description": "tempest-description-1845525436"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:21.059817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70fa13c6-c928-46bc-9bf6-94816682c465 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:21.062284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70fa13c6-c928-46bc-9bf6-94816682c465 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:21.074598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70fa13c6-c928-46bc-9bf6-94816682c465 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:21.093745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70fa13c6-c928-46bc-9bf6-94816682c465 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:21.094889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70fa13c6-c928-46bc-9bf6-94816682c465 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:21.095371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70fa13c6-c928-46bc-9bf6-94816682c465 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:21.338448 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-879788d5-876a-438f-82dc-9d09a303c1e9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.599462 Jul 26 14:20:21.339735 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1534/3210] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:20:20 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:21.352754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-087c6cdb-b5d2-44ee-b693-b4a915dccd68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: .version_select at 0x7f87879061f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1947785675", "description": "tempest-description-1597816247"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:21.630025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70fa13c6-c928-46bc-9bf6-94816682c465 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:21.647588 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70fa13c6-c928-46bc-9bf6-94816682c465 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1707 microversion: 2.1 time: 0.595592 Jul 26 14:20:21.649442 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1677/3211] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:21 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1707 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:21.677563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da72a28e-da54-4857-b0de-988b3df4e4d6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:21.678655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-da72a28e-da54-4857-b0de-988b3df4e4d6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:21.686711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da72a28e-da54-4857-b0de-988b3df4e4d6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:21.688034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da72a28e-da54-4857-b0de-988b3df4e4d6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:21.690115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da72a28e-da54-4857-b0de-988b3df4e4d6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:21.690972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da72a28e-da54-4857-b0de-988b3df4e4d6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:21.873936 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-087c6cdb-b5d2-44ee-b693-b4a915dccd68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.525292 Jul 26 14:20:21.874543 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1535/3212] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:20:21 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:21.879887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a6366b73-3574-40fe-801c-9ec0dc822bdc tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:21.880431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a6366b73-3574-40fe-801c-9ec0dc822bdc tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:21.889598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6366b73-3574-40fe-801c-9ec0dc822bdc tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:21.890058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6366b73-3574-40fe-801c-9ec0dc822bdc tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:21.890847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6366b73-3574-40fe-801c-9ec0dc822bdc tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:21.892715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6366b73-3574-40fe-801c-9ec0dc822bdc tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:21.962400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da72a28e-da54-4857-b0de-988b3df4e4d6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:21.971822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da72a28e-da54-4857-b0de-988b3df4e4d6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:21.974851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da72a28e-da54-4857-b0de-988b3df4e4d6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:21.976298 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-da72a28e-da54-4857-b0de-988b3df4e4d6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1722 microversion: 2.20 time: 0.325661 Jul 26 14:20:21.977535 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1678/3213] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:21 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:21.987142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0c00f28-ad30-4f25-928d-7fa55dbbf6c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '.version_select at 0x7f87992bf0d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:21.993203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0c00f28-ad30-4f25-928d-7fa55dbbf6c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:21.993895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0c00f28-ad30-4f25-928d-7fa55dbbf6c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:22.004555 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d0c00f28-ad30-4f25-928d-7fa55dbbf6c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.022549 Jul 26 14:20:22.005885 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1679/3214] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:20:21 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:22.019527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-613228a9-2919-4729-85d7-605c1032f026 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:22.020457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-613228a9-2919-4729-85d7-605c1032f026 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:22.030389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-613228a9-2919-4729-85d7-605c1032f026 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:22.030846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-613228a9-2919-4729-85d7-605c1032f026 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:22.031624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-613228a9-2919-4729-85d7-605c1032f026 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:22.032728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-613228a9-2919-4729-85d7-605c1032f026 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:22.112511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a6366b73-3574-40fe-801c-9ec0dc822bdc tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:22.120720 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a6366b73-3574-40fe-801c-9ec0dc822bdc tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1307 microversion: 2.1 time: 0.245140 Jul 26 14:20:22.121936 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1536/3215] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:21 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1307 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:22.128247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1149062356", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "d1cc658d-b7e0-4bb4-995e-7fc1893f8983"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:22.201620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] validate_networks() for [('d1cc658d-b7e0-4bb4-995e-7fc1893f8983', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:20:22.205830 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-613228a9-2919-4729-85d7-605c1032f026 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1858 microversion: 2.1 time: 0.190424 Jul 26 14:20:22.207525 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1680/3216] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:22 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1858 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:22.227353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-62e53232-f2de-49d6-8ce8-b4fc3da24d7a tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:22.228329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-62e53232-f2de-49d6-8ce8-b4fc3da24d7a tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:22.235870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62e53232-f2de-49d6-8ce8-b4fc3da24d7a tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:22.236624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62e53232-f2de-49d6-8ce8-b4fc3da24d7a tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:22.237609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62e53232-f2de-49d6-8ce8-b4fc3da24d7a tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:22.238223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62e53232-f2de-49d6-8ce8-b4fc3da24d7a tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:22.241634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:22.852279 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-62e53232-f2de-49d6-8ce8-b4fc3da24d7a tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1858 microversion: 2.1 time: 0.628625 Jul 26 14:20:22.852907 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1681/3217] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:22 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1858 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:22.857593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ca5f5ae8-1d9c-4038-b75f-bc4e8daf33f0 req-61150660-28f9-4934-88fa-ab745cf8963a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a67171e-e026-4184-9b91-853e1ffb2256", "tag": "a81928f0-301d-4bb7-a1fa-1bdecebfcf51"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:22.876167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ca5f5ae8-1d9c-4038-b75f-bc4e8daf33f0 req-61150660-28f9-4934-88fa-ab745cf8963a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:22.876661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ca5f5ae8-1d9c-4038-b75f-bc4e8daf33f0 req-61150660-28f9-4934-88fa-ab745cf8963a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:22.907965 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ca5f5ae8-1d9c-4038-b75f-bc4e8daf33f0 req-61150660-28f9-4934-88fa-ab745cf8963a service nova] Creating event network-changed:a81928f0-301d-4bb7-a1fa-1bdecebfcf51 for instance 0a67171e-e026-4184-9b91-853e1ffb2256 on n-h2-833090-9 Jul 26 14:20:22.918390 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ca5f5ae8-1d9c-4038-b75f-bc4e8daf33f0 req-61150660-28f9-4934-88fa-ab745cf8963a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064206 Jul 26 14:20:22.919023 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1682/3218] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:22.973580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-41265e6d-f710-46c8-ab3b-b3e65b50837f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:22.974463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-41265e6d-f710-46c8-ab3b-b3e65b50837f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:22.984351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41265e6d-f710-46c8-ab3b-b3e65b50837f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:22.985035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41265e6d-f710-46c8-ab3b-b3e65b50837f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:22.987569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41265e6d-f710-46c8-ab3b-b3e65b50837f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:22.988362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41265e6d-f710-46c8-ab3b-b3e65b50837f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:23.130714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-41265e6d-f710-46c8-ab3b-b3e65b50837f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lazy-loading 'services' on Instance uuid a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:20:23.252020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:20:23.252520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:20:23.252915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:20:23.253633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:20:23.254059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:20:23.271846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:23.273299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:23.275410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:23.277068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:23.303702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Getting quotas for project 8e27de07dc204a298c0279a365842602. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:20:23.307572 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-41265e6d-f710-46c8-ab3b-b3e65b50837f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments/f60e14aa-9f25-4471-bc55-f6d7bc82ed1c" status: 202 len: 0 microversion: 2.1 time: 0.338930 Jul 26 14:20:23.311800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Getting quotas for user 16cfc68b1ac347fe95e06e60e8b5f681 and project 8e27de07dc204a298c0279a365842602. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:20:23.312217 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1683/3219] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:20:22 2022] DELETE /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments/f60e14aa-9f25-4471-bc55-f6d7bc82ed1c => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:20:23.324468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0654d65-44ff-4399-84be-1a9755e3cd16 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:23.325960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a0654d65-44ff-4399-84be-1a9755e3cd16 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:23.338165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0654d65-44ff-4399-84be-1a9755e3cd16 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:23.338615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0654d65-44ff-4399-84be-1a9755e3cd16 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:23.341526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0654d65-44ff-4399-84be-1a9755e3cd16 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:23.343043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:20:23.343257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0654d65-44ff-4399-84be-1a9755e3cd16 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:23.345936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:20:23.455536 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7db50d41-9c9e-4a4b-b975-a860d296b069 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331930 Jul 26 14:20:23.462255 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1537/3220] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:20:23.467191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1a8d93e0-0c2f-47da-ae31-e89cf0da71fa tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:23.468408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1a8d93e0-0c2f-47da-ae31-e89cf0da71fa tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:23.476369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a8d93e0-0c2f-47da-ae31-e89cf0da71fa tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:23.477077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a8d93e0-0c2f-47da-ae31-e89cf0da71fa tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:23.478061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a8d93e0-0c2f-47da-ae31-e89cf0da71fa tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:23.478671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a8d93e0-0c2f-47da-ae31-e89cf0da71fa tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:23.705263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0654d65-44ff-4399-84be-1a9755e3cd16 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:23.728797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1a8d93e0-0c2f-47da-ae31-e89cf0da71fa tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:23.729512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0654d65-44ff-4399-84be-1a9755e3cd16 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:23.731505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0654d65-44ff-4399-84be-1a9755e3cd16 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:23.733653 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a0654d65-44ff-4399-84be-1a9755e3cd16 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1722 microversion: 2.20 time: 0.417902 Jul 26 14:20:23.735533 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1684/3221] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:23 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1722 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:23.741120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c39007e4-0c8b-493d-abca-cb346025a0ef tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:23.743832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c39007e4-0c8b-493d-abca-cb346025a0ef tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:23.751823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c39007e4-0c8b-493d-abca-cb346025a0ef tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:23.752646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c39007e4-0c8b-493d-abca-cb346025a0ef tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:23.753627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c39007e4-0c8b-493d-abca-cb346025a0ef tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:23.754355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c39007e4-0c8b-493d-abca-cb346025a0ef tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:23.769363 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1a8d93e0-0c2f-47da-ae31-e89cf0da71fa tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1307 microversion: 2.1 time: 0.305489 Jul 26 14:20:23.788521 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1538/3222] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:23 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:23.800836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-adea2f0e-4492-4f44-a2fa-68562087cf9b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:23.801346 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c39007e4-0c8b-493d-abca-cb346025a0ef tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063719 Jul 26 14:20:23.801781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-adea2f0e-4492-4f44-a2fa-68562087cf9b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:23.803284 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1685/3223] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:20:23 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:23.895469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-adea2f0e-4492-4f44-a2fa-68562087cf9b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:23.903465 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-adea2f0e-4492-4f44-a2fa-68562087cf9b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1216 microversion: 2.1 time: 0.113392 Jul 26 14:20:23.904080 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1539/3224] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:23 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1216 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:24.792583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f9e163d4-311f-45bd-aa0b-3040558eb0c6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:24.793274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f9e163d4-311f-45bd-aa0b-3040558eb0c6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:24.807491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-286348dc-5e81-4e39-a32b-43a4ddbd9138 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:24.809846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-286348dc-5e81-4e39-a32b-43a4ddbd9138 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:24.821089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9e163d4-311f-45bd-aa0b-3040558eb0c6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:24.822310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9e163d4-311f-45bd-aa0b-3040558eb0c6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:24.824115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9e163d4-311f-45bd-aa0b-3040558eb0c6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:24.824819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9e163d4-311f-45bd-aa0b-3040558eb0c6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:24.831494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-286348dc-5e81-4e39-a32b-43a4ddbd9138 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:24.831494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-286348dc-5e81-4e39-a32b-43a4ddbd9138 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:24.832218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-286348dc-5e81-4e39-a32b-43a4ddbd9138 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:24.832692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-286348dc-5e81-4e39-a32b-43a4ddbd9138 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:25.103331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-286348dc-5e81-4e39-a32b-43a4ddbd9138 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:25.119056 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-286348dc-5e81-4e39-a32b-43a4ddbd9138 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1307 microversion: 2.1 time: 0.316564 Jul 26 14:20:25.125210 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1540/3225] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:24 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1307 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:25.130854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e3dd4d39-248a-4f4c-854a-117eb12debff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:25.134738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e3dd4d39-248a-4f4c-854a-117eb12debff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:25.174849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f9e163d4-311f-45bd-aa0b-3040558eb0c6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:25.175773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3dd4d39-248a-4f4c-854a-117eb12debff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:25.176661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3dd4d39-248a-4f4c-854a-117eb12debff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:25.186265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3dd4d39-248a-4f4c-854a-117eb12debff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:25.192438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3dd4d39-248a-4f4c-854a-117eb12debff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:25.206804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f9e163d4-311f-45bd-aa0b-3040558eb0c6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:25.211316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f9e163d4-311f-45bd-aa0b-3040558eb0c6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:25.221305 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f9e163d4-311f-45bd-aa0b-3040558eb0c6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1725 microversion: 2.20 time: 0.440682 Jul 26 14:20:25.222103 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1686/3226] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:24 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1725 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:25.227357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-38ec86e7-1964-46d1-b69b-185e01c7734a tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:25.229902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-38ec86e7-1964-46d1-b69b-185e01c7734a tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:25.277716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38ec86e7-1964-46d1-b69b-185e01c7734a tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:25.279196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38ec86e7-1964-46d1-b69b-185e01c7734a tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:25.286089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38ec86e7-1964-46d1-b69b-185e01c7734a tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:25.290227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38ec86e7-1964-46d1-b69b-185e01c7734a tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:25.355625 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e3dd4d39-248a-4f4c-854a-117eb12debff tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228863 Jul 26 14:20:25.366104 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1541/3227] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:20:25 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:25.382770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f828d0e9-6b6d-49be-8964-2e165542e8b5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f8c7dee-9958-4296-9b4e-90ba9fd2b40a"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:25.386341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f828d0e9-6b6d-49be-8964-2e165542e8b5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:25.411464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f828d0e9-6b6d-49be-8964-2e165542e8b5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:25.415048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f828d0e9-6b6d-49be-8964-2e165542e8b5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:25.416681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f828d0e9-6b6d-49be-8964-2e165542e8b5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:25.418209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f828d0e9-6b6d-49be-8964-2e165542e8b5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:25.461124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-38ec86e7-1964-46d1-b69b-185e01c7734a tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:25.469484 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-38ec86e7-1964-46d1-b69b-185e01c7734a tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1268 microversion: 2.1 time: 0.245949 Jul 26 14:20:25.471903 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1687/3228] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:25 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:25.927271 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f828d0e9-6b6d-49be-8964-2e165542e8b5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "POST /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.556903 Jul 26 14:20:25.929367 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1542/3229] 10.222.0.70 () {62 vars in 1364 bytes} [Tue Jul 26 14:20:25 2022] POST /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments => generated 188 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:20:25.946985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a12b38d1-9d1b-464f-b8b2-16288ac74567 req-e5caa435-e3e1-4dec-aa58-2718503aeb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9c25cd-3b3d-4c48-b620-b7ea6101bf3e", "name": "network-vif-unplugged", "status": "completed", "tag": "13068f91-4844-4f82-95a3-ee7530c55d60"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:25.991077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a12b38d1-9d1b-464f-b8b2-16288ac74567 req-e5caa435-e3e1-4dec-aa58-2718503aeb52 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:25.995222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a12b38d1-9d1b-464f-b8b2-16288ac74567 req-e5caa435-e3e1-4dec-aa58-2718503aeb52 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.026271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.server_external_events [req-a12b38d1-9d1b-464f-b8b2-16288ac74567 req-e5caa435-e3e1-4dec-aa58-2718503aeb52 service nova] Unable to find a host for instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e. Dropping event network-vif-unplugged {{(pid=119479) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 14:20:26.027208 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a12b38d1-9d1b-464f-b8b2-16288ac74567 req-e5caa435-e3e1-4dec-aa58-2718503aeb52 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.100685 Jul 26 14:20:26.028339 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1688/3230] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 102 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 14:20:26.168357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f348b448-6f19-4153-92a0-c8ab5a3573f8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:26.170709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f348b448-6f19-4153-92a0-c8ab5a3573f8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:26.187357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f348b448-6f19-4153-92a0-c8ab5a3573f8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:26.188729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f348b448-6f19-4153-92a0-c8ab5a3573f8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.190114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f348b448-6f19-4153-92a0-c8ab5a3573f8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:26.190738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f348b448-6f19-4153-92a0-c8ab5a3573f8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.247262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f2c265fb-18af-4fbc-9fcc-ae7b60d22fef tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:26.248456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f2c265fb-18af-4fbc-9fcc-ae7b60d22fef tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:26.257254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2c265fb-18af-4fbc-9fcc-ae7b60d22fef tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:26.258335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2c265fb-18af-4fbc-9fcc-ae7b60d22fef tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.259415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2c265fb-18af-4fbc-9fcc-ae7b60d22fef tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:26.260068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2c265fb-18af-4fbc-9fcc-ae7b60d22fef tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.477334 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f2c265fb-18af-4fbc-9fcc-ae7b60d22fef tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "POST /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/action" status: 202 len: 0 microversion: 2.20 time: 0.234545 Jul 26 14:20:26.482095 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1689/3231] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:20:26 2022] POST /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:20:26.491062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2981f788-8e26-4608-9073-5a8bceb475e2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:26.494484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2981f788-8e26-4608-9073-5a8bceb475e2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:26.502609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2981f788-8e26-4608-9073-5a8bceb475e2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:26.503468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2981f788-8e26-4608-9073-5a8bceb475e2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.504445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2981f788-8e26-4608-9073-5a8bceb475e2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:26.505273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2981f788-8e26-4608-9073-5a8bceb475e2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.538966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f348b448-6f19-4153-92a0-c8ab5a3573f8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:26.548707 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f348b448-6f19-4153-92a0-c8ab5a3573f8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1307 microversion: 2.1 time: 0.389617 Jul 26 14:20:26.553389 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1543/3232] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:26 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:26.565792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7f051533-c955-4301-a625-eee9c4de7f17 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:26.573860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7f051533-c955-4301-a625-eee9c4de7f17 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:26.582380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f051533-c955-4301-a625-eee9c4de7f17 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:26.586014 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2981f788-8e26-4608-9073-5a8bceb475e2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102014 Jul 26 14:20:26.586277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f051533-c955-4301-a625-eee9c4de7f17 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.587278 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1690/3233] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:20:26 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:26.593766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bbfca0dc-b461-443b-a842-1458bc150283 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:26.594108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f051533-c955-4301-a625-eee9c4de7f17 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:26.595540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f051533-c955-4301-a625-eee9c4de7f17 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.596178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bbfca0dc-b461-443b-a842-1458bc150283 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:26.604706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbfca0dc-b461-443b-a842-1458bc150283 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:26.605438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbfca0dc-b461-443b-a842-1458bc150283 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.606864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbfca0dc-b461-443b-a842-1458bc150283 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:26.607604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bbfca0dc-b461-443b-a842-1458bc150283 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:26.716623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bbfca0dc-b461-443b-a842-1458bc150283 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:26.735144 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bbfca0dc-b461-443b-a842-1458bc150283 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1274 microversion: 2.1 time: 0.145036 Jul 26 14:20:26.736750 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1691/3234] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:26 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:26.879600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7f051533-c955-4301-a625-eee9c4de7f17 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:26.897275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7f051533-c955-4301-a625-eee9c4de7f17 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:26.900057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7f051533-c955-4301-a625-eee9c4de7f17 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:26.901843 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7f051533-c955-4301-a625-eee9c4de7f17 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1751 microversion: 2.20 time: 0.346055 Jul 26 14:20:26.902913 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1544/3235] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:26 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1751 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:27.576864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ea3fab01-28a1-4433-b7a8-3a34f889b3b1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:27.578260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ea3fab01-28a1-4433-b7a8-3a34f889b3b1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:27.598553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7eaaec8d-f904-45d2-90ac-da6f8732fd13 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:27.600972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7eaaec8d-f904-45d2-90ac-da6f8732fd13 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:27.610526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea3fab01-28a1-4433-b7a8-3a34f889b3b1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:27.611194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea3fab01-28a1-4433-b7a8-3a34f889b3b1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:27.612092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea3fab01-28a1-4433-b7a8-3a34f889b3b1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:27.616083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eaaec8d-f904-45d2-90ac-da6f8732fd13 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:27.616547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eaaec8d-f904-45d2-90ac-da6f8732fd13 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:27.617332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eaaec8d-f904-45d2-90ac-da6f8732fd13 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:27.617551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea3fab01-28a1-4433-b7a8-3a34f889b3b1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:27.624905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eaaec8d-f904-45d2-90ac-da6f8732fd13 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:27.686035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:27.755341 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7eaaec8d-f904-45d2-90ac-da6f8732fd13 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160708 Jul 26 14:20:27.757403 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1545/3236] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:20:27 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:20:27.771009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-018cde0f-30d2-4b7d-8d3e-61f9a7d6cce5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:27.771698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-018cde0f-30d2-4b7d-8d3e-61f9a7d6cce5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:27.788758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-018cde0f-30d2-4b7d-8d3e-61f9a7d6cce5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:27.789228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-018cde0f-30d2-4b7d-8d3e-61f9a7d6cce5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:27.790413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-018cde0f-30d2-4b7d-8d3e-61f9a7d6cce5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:27.790940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-018cde0f-30d2-4b7d-8d3e-61f9a7d6cce5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:28.087888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ea3fab01-28a1-4433-b7a8-3a34f889b3b1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:28.104903 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ea3fab01-28a1-4433-b7a8-3a34f889b3b1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1307 microversion: 2.1 time: 0.533233 Jul 26 14:20:28.119988 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1692/3237] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:27 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1307 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:28.136582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c1c52ae8-4211-4f78-8458-48f5b0a55082 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:28.137243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c1c52ae8-4211-4f78-8458-48f5b0a55082 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:28.163904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c1c52ae8-4211-4f78-8458-48f5b0a55082 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:28.167159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c1c52ae8-4211-4f78-8458-48f5b0a55082 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:28.167868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-018cde0f-30d2-4b7d-8d3e-61f9a7d6cce5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:28.169598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c1c52ae8-4211-4f78-8458-48f5b0a55082 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:28.171205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c1c52ae8-4211-4f78-8458-48f5b0a55082 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:28.180769 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-018cde0f-30d2-4b7d-8d3e-61f9a7d6cce5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1316 microversion: 2.1 time: 0.420989 Jul 26 14:20:28.181585 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1546/3238] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:27 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:28.602722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c1c52ae8-4211-4f78-8458-48f5b0a55082 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:28.623761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c1c52ae8-4211-4f78-8458-48f5b0a55082 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:28.631546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c1c52ae8-4211-4f78-8458-48f5b0a55082 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:28.633148 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c1c52ae8-4211-4f78-8458-48f5b0a55082 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1753 microversion: 2.20 time: 0.515736 Jul 26 14:20:28.652799 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1693/3239] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:28 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1753 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:28.653671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a8eda596-2322-4b39-bd22-4173c3b7975e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:28.654304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a8eda596-2322-4b39-bd22-4173c3b7975e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:28.667547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8eda596-2322-4b39-bd22-4173c3b7975e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:28.667547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8eda596-2322-4b39-bd22-4173c3b7975e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:28.670010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8eda596-2322-4b39-bd22-4173c3b7975e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:28.672356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8eda596-2322-4b39-bd22-4173c3b7975e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:28.685732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-907224037", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": "none"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:28.779920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:20:28.780583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:20:28.781230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:20:28.781836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:20:28.782980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:20:28.794137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:28.794891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:28.795887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:28.796557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:28.826520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Getting quotas for project 78d0fbb7b6164cabbb6c6fd53e3f48f0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:20:28.834918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Getting quotas for user ecd20d5086c64b609d3b7333ff3efa00 and project 78d0fbb7b6164cabbb6c6fd53e3f48f0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:20:28.858441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:20:28.863396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:20:28.940369 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9da8479b-d232-4d8f-b304-a62894d2f3c5 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.451966 Jul 26 14:20:28.941088 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1547/3240] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:20:28.946321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1e8a02c-7cfd-40b8-a663-3288637d52a6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:28.957301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b1e8a02c-7cfd-40b8-a663-3288637d52a6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:28.992663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1e8a02c-7cfd-40b8-a663-3288637d52a6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:28.993390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1e8a02c-7cfd-40b8-a663-3288637d52a6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:28.995578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1e8a02c-7cfd-40b8-a663-3288637d52a6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:28.996410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1e8a02c-7cfd-40b8-a663-3288637d52a6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:29.087598 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b1e8a02c-7cfd-40b8-a663-3288637d52a6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142813 Jul 26 14:20:29.088292 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1548/3241] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:20:28 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:29.100363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-33c336a2-2598-4da8-980d-c7e09f970507 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:29.120623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-33c336a2-2598-4da8-980d-c7e09f970507 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:29.259686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-33c336a2-2598-4da8-980d-c7e09f970507 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:29.270923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-33c336a2-2598-4da8-980d-c7e09f970507 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:29.273673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-33c336a2-2598-4da8-980d-c7e09f970507 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:29.275626 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-33c336a2-2598-4da8-980d-c7e09f970507 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1277 microversion: 2.57 time: 0.182274 Jul 26 14:20:29.276876 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1549/3242] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:29 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:29.281680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9fba2f49-1ba3-44b5-85dc-dbde4d83c745 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:29.283387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9fba2f49-1ba3-44b5-85dc-dbde4d83c745 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:29.287574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:INSERT=9 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:29.296572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9fba2f49-1ba3-44b5-85dc-dbde4d83c745 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:29.297041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9fba2f49-1ba3-44b5-85dc-dbde4d83c745 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:29.298428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9fba2f49-1ba3-44b5-85dc-dbde4d83c745 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:29.298982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9fba2f49-1ba3-44b5-85dc-dbde4d83c745 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:29.650167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9fba2f49-1ba3-44b5-85dc-dbde4d83c745 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:29.659639 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9fba2f49-1ba3-44b5-85dc-dbde4d83c745 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1307 microversion: 2.1 time: 0.381494 Jul 26 14:20:29.664051 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1550/3243] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:29 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1307 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:29.682584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6163f392-3a89-4f6e-b1c9-ca8e8fb31789 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:29.683386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6163f392-3a89-4f6e-b1c9-ca8e8fb31789 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:29.709304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6163f392-3a89-4f6e-b1c9-ca8e8fb31789 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:29.710269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6163f392-3a89-4f6e-b1c9-ca8e8fb31789 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:29.714976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6163f392-3a89-4f6e-b1c9-ca8e8fb31789 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:29.715641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6163f392-3a89-4f6e-b1c9-ca8e8fb31789 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.111601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6163f392-3a89-4f6e-b1c9-ca8e8fb31789 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:30.114749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:30.125379 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6163f392-3a89-4f6e-b1c9-ca8e8fb31789 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1316 microversion: 2.1 time: 0.458490 Jul 26 14:20:30.134368 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1551/3244] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:29 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:30.146567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-bafdebd0-bb54-4866-a58f-a960493f4178 req-01df7aa2-dc95-4d09-80eb-1d0b5f0e1b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c2ca5f-2342-4538-a501-6bd7877bd044", "tag": "295ca1ce-51a5-4367-b0ed-b671809ee202"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:30.162809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bafdebd0-bb54-4866-a58f-a960493f4178 req-01df7aa2-dc95-4d09-80eb-1d0b5f0e1b7b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:30.163265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bafdebd0-bb54-4866-a58f-a960493f4178 req-01df7aa2-dc95-4d09-80eb-1d0b5f0e1b7b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.178455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-bafdebd0-bb54-4866-a58f-a960493f4178 req-01df7aa2-dc95-4d09-80eb-1d0b5f0e1b7b service nova] Creating event network-changed:295ca1ce-51a5-4367-b0ed-b671809ee202 for instance b3c2ca5f-2342-4538-a501-6bd7877bd044 on n-h2-833090-9 Jul 26 14:20:30.189298 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-bafdebd0-bb54-4866-a58f-a960493f4178 req-01df7aa2-dc95-4d09-80eb-1d0b5f0e1b7b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052865 Jul 26 14:20:30.190174 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1552/3245] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:30.198030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9aa70050-cb01-4da3-a570-97ed15f1388e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:30.199670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9aa70050-cb01-4da3-a570-97ed15f1388e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:30.208977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9aa70050-cb01-4da3-a570-97ed15f1388e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:30.209811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9aa70050-cb01-4da3-a570-97ed15f1388e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.210823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9aa70050-cb01-4da3-a570-97ed15f1388e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:30.211450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9aa70050-cb01-4da3-a570-97ed15f1388e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.454936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9aa70050-cb01-4da3-a570-97ed15f1388e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:30.466515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9aa70050-cb01-4da3-a570-97ed15f1388e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:30.471792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9aa70050-cb01-4da3-a570-97ed15f1388e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:30.473444 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9aa70050-cb01-4da3-a570-97ed15f1388e tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1753 microversion: 2.20 time: 0.281885 Jul 26 14:20:30.474354 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1553/3246] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:30 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1753 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:30.479653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93e57435-e01c-4986-931c-2a8d687bb50b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:30.482422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-93e57435-e01c-4986-931c-2a8d687bb50b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:30.489504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93e57435-e01c-4986-931c-2a8d687bb50b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:30.489991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93e57435-e01c-4986-931c-2a8d687bb50b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.490766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93e57435-e01c-4986-931c-2a8d687bb50b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:30.491210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93e57435-e01c-4986-931c-2a8d687bb50b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.542110 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-93e57435-e01c-4986-931c-2a8d687bb50b tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066368 Jul 26 14:20:30.546831 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1554/3247] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:20:30 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:30.548999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d5ed6a7-52b3-4319-aa4f-b4b08ef62411 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:30.549702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7d5ed6a7-52b3-4319-aa4f-b4b08ef62411 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:30.557907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d5ed6a7-52b3-4319-aa4f-b4b08ef62411 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:30.558367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d5ed6a7-52b3-4319-aa4f-b4b08ef62411 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.559166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d5ed6a7-52b3-4319-aa4f-b4b08ef62411 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:30.559618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d5ed6a7-52b3-4319-aa4f-b4b08ef62411 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.639118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d5ed6a7-52b3-4319-aa4f-b4b08ef62411 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:30.650661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d5ed6a7-52b3-4319-aa4f-b4b08ef62411 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:30.653653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d5ed6a7-52b3-4319-aa4f-b4b08ef62411 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:30.656153 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7d5ed6a7-52b3-4319-aa4f-b4b08ef62411 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1329 microversion: 2.57 time: 0.110883 Jul 26 14:20:30.671903 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1555/3248] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:30 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1329 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:30.671903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-fe239fd5-eca1-4fe4-9f7a-a101fa56eb3f req-ad69b445-7c14-4d56-a358-71de4e7fb231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a67171e-e026-4184-9b91-853e1ffb2256", "name": "network-vif-plugged", "status": "completed", "tag": "a81928f0-301d-4bb7-a1fa-1bdecebfcf51"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:30.679129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fe239fd5-eca1-4fe4-9f7a-a101fa56eb3f req-ad69b445-7c14-4d56-a358-71de4e7fb231 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:30.680164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fe239fd5-eca1-4fe4-9f7a-a101fa56eb3f req-ad69b445-7c14-4d56-a358-71de4e7fb231 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.696962 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-fe239fd5-eca1-4fe4-9f7a-a101fa56eb3f req-ad69b445-7c14-4d56-a358-71de4e7fb231 service nova] Creating event network-vif-plugged:a81928f0-301d-4bb7-a1fa-1bdecebfcf51 for instance 0a67171e-e026-4184-9b91-853e1ffb2256 on n-h2-833090-9 Jul 26 14:20:30.703184 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-fe239fd5-eca1-4fe4-9f7a-a101fa56eb3f req-ad69b445-7c14-4d56-a358-71de4e7fb231 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041502 Jul 26 14:20:30.704975 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1556/3249] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:30.710556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-196ff32c-dcf3-4727-9175-7bba2210b05d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:30.711273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-196ff32c-dcf3-4727-9175-7bba2210b05d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:30.719190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-196ff32c-dcf3-4727-9175-7bba2210b05d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:30.721944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-196ff32c-dcf3-4727-9175-7bba2210b05d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.722908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-196ff32c-dcf3-4727-9175-7bba2210b05d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:30.723620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-196ff32c-dcf3-4727-9175-7bba2210b05d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:30.859791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-a8eda596-2322-4b39-bd22-4173c3b7975e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lazy-loading 'services' on Instance uuid 0b34e8fe-9a39-4c51-80fe-5f03e674baba {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:20:30.918914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-196ff32c-dcf3-4727-9175-7bba2210b05d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:30.928691 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-196ff32c-dcf3-4727-9175-7bba2210b05d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1307 microversion: 2.1 time: 0.222258 Jul 26 14:20:30.929540 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1557/3250] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:30 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1307 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:30.960754 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a8eda596-2322-4b39-bd22-4173c3b7975e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/os-volume_attachments/fb09fb5f-5806-4488-af51-8c82387d5b5c" status: 202 len: 0 microversion: 2.1 time: 2.311125 Jul 26 14:20:30.961425 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1694/3251] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:20:28 2022] DELETE /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/os-volume_attachments/fb09fb5f-5806-4488-af51-8c82387d5b5c => generated 0 bytes in 2313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:31.151962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-50ad69f8-299e-449c-9445-81fa6c2b6687 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:31.153536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-50ad69f8-299e-449c-9445-81fa6c2b6687 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:31.161713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-50ad69f8-299e-449c-9445-81fa6c2b6687 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:31.162316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-50ad69f8-299e-449c-9445-81fa6c2b6687 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:31.163541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-50ad69f8-299e-449c-9445-81fa6c2b6687 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:31.164127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-50ad69f8-299e-449c-9445-81fa6c2b6687 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:31.334485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-50ad69f8-299e-449c-9445-81fa6c2b6687 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:31.342767 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-50ad69f8-299e-449c-9445-81fa6c2b6687 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1316 microversion: 2.1 time: 0.196666 Jul 26 14:20:31.343392 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1558/3252] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:31 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:31.500442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-39938fb5-c9eb-45a7-943b-99554ffb13e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:31.501673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-39938fb5-c9eb-45a7-943b-99554ffb13e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:31.508640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39938fb5-c9eb-45a7-943b-99554ffb13e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:31.509099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39938fb5-c9eb-45a7-943b-99554ffb13e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:31.509895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39938fb5-c9eb-45a7-943b-99554ffb13e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:31.510375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39938fb5-c9eb-45a7-943b-99554ffb13e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:31.555398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-544894b0-933d-4642-8bb9-0b28ec98e379 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:31.557916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-544894b0-933d-4642-8bb9-0b28ec98e379 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:31.565128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-544894b0-933d-4642-8bb9-0b28ec98e379 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:31.565575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-544894b0-933d-4642-8bb9-0b28ec98e379 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:31.566393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-544894b0-933d-4642-8bb9-0b28ec98e379 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:31.566991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-544894b0-933d-4642-8bb9-0b28ec98e379 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:31.614520 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-544894b0-933d-4642-8bb9-0b28ec98e379 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063039 Jul 26 14:20:31.616047 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1559/3253] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:20:31 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:20:31.685682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fe71c8a7-7cfe-4788-9f40-a8317938791e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:31.686335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fe71c8a7-7cfe-4788-9f40-a8317938791e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:31.703499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe71c8a7-7cfe-4788-9f40-a8317938791e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:31.704579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe71c8a7-7cfe-4788-9f40-a8317938791e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:31.705385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe71c8a7-7cfe-4788-9f40-a8317938791e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:31.705821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe71c8a7-7cfe-4788-9f40-a8317938791e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:31.720799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-39938fb5-c9eb-45a7-943b-99554ffb13e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:31.759004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-39938fb5-c9eb-45a7-943b-99554ffb13e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:31.761023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-39938fb5-c9eb-45a7-943b-99554ffb13e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:31.762289 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-39938fb5-c9eb-45a7-943b-99554ffb13e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1753 microversion: 2.20 time: 0.266569 Jul 26 14:20:31.762867 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1695/3254] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:31 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1753 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:31.809862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fe71c8a7-7cfe-4788-9f40-a8317938791e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:31.820257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fe71c8a7-7cfe-4788-9f40-a8317938791e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:31.821888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fe71c8a7-7cfe-4788-9f40-a8317938791e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:31.823426 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fe71c8a7-7cfe-4788-9f40-a8317938791e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1335 microversion: 2.57 time: 0.145207 Jul 26 14:20:31.830551 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1560/3255] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:31 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1335 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:31.954309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-acc6622e-61af-4969-b7d6-2963169f88c9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:31.955022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-acc6622e-61af-4969-b7d6-2963169f88c9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:31.962040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acc6622e-61af-4969-b7d6-2963169f88c9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:31.962495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acc6622e-61af-4969-b7d6-2963169f88c9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:31.963302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acc6622e-61af-4969-b7d6-2963169f88c9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:31.963745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acc6622e-61af-4969-b7d6-2963169f88c9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:32.225694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-acc6622e-61af-4969-b7d6-2963169f88c9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:32.228589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:32.237931 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-acc6622e-61af-4969-b7d6-2963169f88c9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1307 microversion: 2.1 time: 0.287618 Jul 26 14:20:32.238954 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1696/3256] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:31 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1307 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:32.364674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-35b34eac-3a3d-42e0-9e65-b0d6a4fe212b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:32.365336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-35b34eac-3a3d-42e0-9e65-b0d6a4fe212b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:32.375970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35b34eac-3a3d-42e0-9e65-b0d6a4fe212b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:32.376440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35b34eac-3a3d-42e0-9e65-b0d6a4fe212b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:32.377248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35b34eac-3a3d-42e0-9e65-b0d6a4fe212b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:32.377697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35b34eac-3a3d-42e0-9e65-b0d6a4fe212b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:32.549479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-35b34eac-3a3d-42e0-9e65-b0d6a4fe212b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:32.558135 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-35b34eac-3a3d-42e0-9e65-b0d6a4fe212b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1316 microversion: 2.1 time: 0.198070 Jul 26 14:20:32.559204 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1561/3257] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:32 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:32.633740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d7229e7c-685a-4263-8bb3-fea3eafedbcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:32.637825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d7229e7c-685a-4263-8bb3-fea3eafedbcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:32.650347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7229e7c-685a-4263-8bb3-fea3eafedbcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:32.650815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7229e7c-685a-4263-8bb3-fea3eafedbcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:32.651668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7229e7c-685a-4263-8bb3-fea3eafedbcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:32.652111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7229e7c-685a-4263-8bb3-fea3eafedbcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:32.699884 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d7229e7c-685a-4263-8bb3-fea3eafedbcb tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074672 Jul 26 14:20:32.700929 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1697/3258] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:20:32 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:20:32.800073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-43642d8a-35a0-48b5-b943-d33b8a0198ff tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:32.801393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-43642d8a-35a0-48b5-b943-d33b8a0198ff tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:32.815277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43642d8a-35a0-48b5-b943-d33b8a0198ff tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:32.816433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43642d8a-35a0-48b5-b943-d33b8a0198ff tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:32.819254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43642d8a-35a0-48b5-b943-d33b8a0198ff tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:32.819254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43642d8a-35a0-48b5-b943-d33b8a0198ff tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:32.850157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f4f88126-8269-4a17-92cb-04a7b4b43f86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:32.850822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f4f88126-8269-4a17-92cb-04a7b4b43f86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:32.871320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4f88126-8269-4a17-92cb-04a7b4b43f86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:32.871886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4f88126-8269-4a17-92cb-04a7b4b43f86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:32.872893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4f88126-8269-4a17-92cb-04a7b4b43f86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:32.873430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4f88126-8269-4a17-92cb-04a7b4b43f86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:33.068557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f4f88126-8269-4a17-92cb-04a7b4b43f86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:33.086355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f4f88126-8269-4a17-92cb-04a7b4b43f86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:33.093559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f4f88126-8269-4a17-92cb-04a7b4b43f86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:33.095899 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f4f88126-8269-4a17-92cb-04a7b4b43f86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1335 microversion: 2.57 time: 0.251266 Jul 26 14:20:33.127015 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1698/3259] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:32 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1335 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:20:33.228165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43642d8a-35a0-48b5-b943-d33b8a0198ff tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:33.247296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43642d8a-35a0-48b5-b943-d33b8a0198ff tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:33.249711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43642d8a-35a0-48b5-b943-d33b8a0198ff tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:33.251196 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-43642d8a-35a0-48b5-b943-d33b8a0198ff tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1753 microversion: 2.20 time: 0.463537 Jul 26 14:20:33.251831 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1562/3260] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:32 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1753 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:33.269467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6f6d9c14-4f7b-4174-b9eb-f0e4e6a0dd17 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:33.270094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6f6d9c14-4f7b-4174-b9eb-f0e4e6a0dd17 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:33.280685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f6d9c14-4f7b-4174-b9eb-f0e4e6a0dd17 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:33.281264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f6d9c14-4f7b-4174-b9eb-f0e4e6a0dd17 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:33.282398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f6d9c14-4f7b-4174-b9eb-f0e4e6a0dd17 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:33.283017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f6d9c14-4f7b-4174-b9eb-f0e4e6a0dd17 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:33.473109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6f6d9c14-4f7b-4174-b9eb-f0e4e6a0dd17 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:33.486045 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6f6d9c14-4f7b-4174-b9eb-f0e4e6a0dd17 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1488 microversion: 2.1 time: 0.220105 Jul 26 14:20:33.487173 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1699/3261] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:33 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1488 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:33.583319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-165db9eb-ebf2-49d6-9c19-014b46023696 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:33.584538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-165db9eb-ebf2-49d6-9c19-014b46023696 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:33.598810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-165db9eb-ebf2-49d6-9c19-014b46023696 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:33.600928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-165db9eb-ebf2-49d6-9c19-014b46023696 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:33.604354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-165db9eb-ebf2-49d6-9c19-014b46023696 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:33.605686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-165db9eb-ebf2-49d6-9c19-014b46023696 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:33.671878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-27238698", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "2dc9e1a8-4a4f-459a-8038-83a80381fb0e"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:33.761330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] validate_networks() for [('2dc9e1a8-4a4f-459a-8038-83a80381fb0e', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:20:33.933592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-165db9eb-ebf2-49d6-9c19-014b46023696 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:33.948545 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-165db9eb-ebf2-49d6-9c19-014b46023696 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1316 microversion: 2.1 time: 0.369616 Jul 26 14:20:33.950033 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1563/3262] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:33 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:34.138943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d89908c2-e24a-4933-a2a9-85c1d97d1ee1 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:34.139965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d89908c2-e24a-4933-a2a9-85c1d97d1ee1 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:34.147675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d89908c2-e24a-4933-a2a9-85c1d97d1ee1 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:34.148481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d89908c2-e24a-4933-a2a9-85c1d97d1ee1 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:34.149489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d89908c2-e24a-4933-a2a9-85c1d97d1ee1 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:34.150097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d89908c2-e24a-4933-a2a9-85c1d97d1ee1 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:34.338669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d89908c2-e24a-4933-a2a9-85c1d97d1ee1 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:34.351268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d89908c2-e24a-4933-a2a9-85c1d97d1ee1 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:34.354533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d89908c2-e24a-4933-a2a9-85c1d97d1ee1 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:34.359402 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d89908c2-e24a-4933-a2a9-85c1d97d1ee1 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1356 microversion: 2.57 time: 0.224598 Jul 26 14:20:34.363033 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1564/3263] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:34 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1356 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:20:34.381480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d84cefa0-9936-4cdc-a397-8c2613a0e59c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:34.382961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d84cefa0-9936-4cdc-a397-8c2613a0e59c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:34.400754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d84cefa0-9936-4cdc-a397-8c2613a0e59c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:34.400754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d84cefa0-9936-4cdc-a397-8c2613a0e59c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:34.409455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d84cefa0-9936-4cdc-a397-8c2613a0e59c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:34.411891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d84cefa0-9936-4cdc-a397-8c2613a0e59c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:34.436680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:20:34.438831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:20:34.439733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:20:34.440370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:20:34.440959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:20:34.455986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:34.457029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:34.459047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:34.459900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:34.488945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:20:34.500168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for user 55daeaaa37a8498c9e540f5546277dc3 and project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:20:34.521023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:20:34.526497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:20:34.629787 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-14100bdc-02ae-43d4-affb-b562bc2acd4c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962935 Jul 26 14:20:34.637166 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1700/3264] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:20:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:20:34.645127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:34.648715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:34.656702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:34.658281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:34.659486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:34.660460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:34.667054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d84cefa0-9936-4cdc-a397-8c2613a0e59c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:34.690259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d84cefa0-9936-4cdc-a397-8c2613a0e59c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:34.692235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d84cefa0-9936-4cdc-a397-8c2613a0e59c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:34.693476 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d84cefa0-9936-4cdc-a397-8c2613a0e59c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1753 microversion: 2.20 time: 0.329318 Jul 26 14:20:34.700883 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1565/3265] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:34 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1753 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:34.712733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1615c948-60a3-4449-8498-7d802d51a515 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:34.713709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1615c948-60a3-4449-8498-7d802d51a515 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:34.794382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:20:34.795081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:20:34.795803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:20:34.799130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:20:34.799814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:20:34.802582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1615c948-60a3-4449-8498-7d802d51a515 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:34.811632 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1615c948-60a3-4449-8498-7d802d51a515 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1207 microversion: 2.1 time: 0.109543 Jul 26 14:20:34.812262 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1566/3266] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:34 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1207 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:34.931907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:34.944630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:34.945367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:34.946698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:34.947447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:34.974438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f4a8351f-b7f0-4c14-9183-60d905daecba tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:34.976443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f4a8351f-b7f0-4c14-9183-60d905daecba tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:35.025437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4a8351f-b7f0-4c14-9183-60d905daecba tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:35.026878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4a8351f-b7f0-4c14-9183-60d905daecba tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:35.032752 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3fd43387-0518-454f-8708-6225a8aa2b4f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "POST /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561/action" status: 202 len: 1137 microversion: 2.57 time: 0.391996 Jul 26 14:20:35.035189 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1701/3267] 10.222.0.70 () {62 vars in 1320 bytes} [Tue Jul 26 14:20:34 2022] POST /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561/action => generated 1137 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 14:20:35.045157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4a8351f-b7f0-4c14-9183-60d905daecba tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:35.046400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4a8351f-b7f0-4c14-9183-60d905daecba tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:35.061303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-579dea87-5e73-4871-9b57-f8255646d380 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:35.064455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-579dea87-5e73-4871-9b57-f8255646d380 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:35.104474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-579dea87-5e73-4871-9b57-f8255646d380 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:35.106286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-579dea87-5e73-4871-9b57-f8255646d380 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:35.108324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-579dea87-5e73-4871-9b57-f8255646d380 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:35.109054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-579dea87-5e73-4871-9b57-f8255646d380 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:35.236184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-579dea87-5e73-4871-9b57-f8255646d380 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:35.257050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-579dea87-5e73-4871-9b57-f8255646d380 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:35.261040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-579dea87-5e73-4871-9b57-f8255646d380 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:35.265035 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-579dea87-5e73-4871-9b57-f8255646d380 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.213782 Jul 26 14:20:35.265633 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1702/3268] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:35 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:35.421402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4a8351f-b7f0-4c14-9183-60d905daecba tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:35.451643 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f4a8351f-b7f0-4c14-9183-60d905daecba tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1316 microversion: 2.1 time: 0.484140 Jul 26 14:20:35.453280 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1567/3269] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:34 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:35.727419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a39e93cc-10e7-456d-b76d-f9dce997670b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:35.729085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a39e93cc-10e7-456d-b76d-f9dce997670b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:35.736826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a39e93cc-10e7-456d-b76d-f9dce997670b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:35.737291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a39e93cc-10e7-456d-b76d-f9dce997670b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:35.738096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a39e93cc-10e7-456d-b76d-f9dce997670b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:35.738708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a39e93cc-10e7-456d-b76d-f9dce997670b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:35.839105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dbc2ddc5-a32c-4425-87f0-4845067faf47 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:35.840093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dbc2ddc5-a32c-4425-87f0-4845067faf47 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:35.849456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbc2ddc5-a32c-4425-87f0-4845067faf47 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:35.850293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbc2ddc5-a32c-4425-87f0-4845067faf47 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:35.852319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbc2ddc5-a32c-4425-87f0-4845067faf47 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:35.853188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbc2ddc5-a32c-4425-87f0-4845067faf47 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:35.981912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dbc2ddc5-a32c-4425-87f0-4845067faf47 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:35.993979 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dbc2ddc5-a32c-4425-87f0-4845067faf47 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1259 microversion: 2.1 time: 0.163099 Jul 26 14:20:35.995807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a39e93cc-10e7-456d-b76d-f9dce997670b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:36.002388 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1568/3270] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:35 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:36.015848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a39e93cc-10e7-456d-b76d-f9dce997670b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:36.025146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a39e93cc-10e7-456d-b76d-f9dce997670b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:36.027179 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a39e93cc-10e7-456d-b76d-f9dce997670b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1753 microversion: 2.20 time: 0.304453 Jul 26 14:20:36.028408 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1703/3271] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:35 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1753 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:36.308074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-552b9acc-742a-41ca-81bc-840160730cf4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:36.308945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-552b9acc-742a-41ca-81bc-840160730cf4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:36.338965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-552b9acc-742a-41ca-81bc-840160730cf4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:36.339587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-552b9acc-742a-41ca-81bc-840160730cf4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:36.342059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-552b9acc-742a-41ca-81bc-840160730cf4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:36.342639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-552b9acc-742a-41ca-81bc-840160730cf4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:36.479247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3963ab53-16b5-4189-8c10-30dcbec14ae0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:36.480076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3963ab53-16b5-4189-8c10-30dcbec14ae0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:36.483061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:36.500452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3963ab53-16b5-4189-8c10-30dcbec14ae0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:36.502029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3963ab53-16b5-4189-8c10-30dcbec14ae0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:36.502927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3963ab53-16b5-4189-8c10-30dcbec14ae0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:36.503393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3963ab53-16b5-4189-8c10-30dcbec14ae0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:36.540977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-552b9acc-742a-41ca-81bc-840160730cf4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:36.567816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-552b9acc-742a-41ca-81bc-840160730cf4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:36.569348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-552b9acc-742a-41ca-81bc-840160730cf4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:36.570533 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-552b9acc-742a-41ca-81bc-840160730cf4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.269645 Jul 26 14:20:36.571759 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1569/3272] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:36 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:36.695845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-0ce6fee3-12b6-4fa4-90d4-b61e8a035239 req-41a67c47-d2e4-449f-9f4f-10d9c3b40881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c2ca5f-2342-4538-a501-6bd7877bd044", "name": "network-vif-plugged", "status": "completed", "tag": "295ca1ce-51a5-4367-b0ed-b671809ee202"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:36.724067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0ce6fee3-12b6-4fa4-90d4-b61e8a035239 req-41a67c47-d2e4-449f-9f4f-10d9c3b40881 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:36.729178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0ce6fee3-12b6-4fa4-90d4-b61e8a035239 req-41a67c47-d2e4-449f-9f4f-10d9c3b40881 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:36.767455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-0ce6fee3-12b6-4fa4-90d4-b61e8a035239 req-41a67c47-d2e4-449f-9f4f-10d9c3b40881 service nova] Creating event network-vif-plugged:295ca1ce-51a5-4367-b0ed-b671809ee202 for instance b3c2ca5f-2342-4538-a501-6bd7877bd044 on n-h2-833090-9 Jul 26 14:20:36.785568 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-0ce6fee3-12b6-4fa4-90d4-b61e8a035239 req-41a67c47-d2e4-449f-9f4f-10d9c3b40881 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098227 Jul 26 14:20:36.786240 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1570/3273] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:20:37.025328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-83e8d2c6-d99c-4b08-8360-e7227705d4ae tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:37.026505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-83e8d2c6-d99c-4b08-8360-e7227705d4ae tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:37.038398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83e8d2c6-d99c-4b08-8360-e7227705d4ae tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:37.039552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83e8d2c6-d99c-4b08-8360-e7227705d4ae tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:37.041134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83e8d2c6-d99c-4b08-8360-e7227705d4ae tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:37.042054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83e8d2c6-d99c-4b08-8360-e7227705d4ae tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:37.082026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:37.197288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-83e8d2c6-d99c-4b08-8360-e7227705d4ae tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:37.205983 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-83e8d2c6-d99c-4b08-8360-e7227705d4ae tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1265 microversion: 2.1 time: 0.186258 Jul 26 14:20:37.215992 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1571/3274] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:37 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:37.215992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f9a55001-a384-48f6-8212-4ef51b15d3ec tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:37.215992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f9a55001-a384-48f6-8212-4ef51b15d3ec tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:37.220163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9a55001-a384-48f6-8212-4ef51b15d3ec tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:37.221028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9a55001-a384-48f6-8212-4ef51b15d3ec tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:37.222073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9a55001-a384-48f6-8212-4ef51b15d3ec tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:37.222672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9a55001-a384-48f6-8212-4ef51b15d3ec tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:37.538093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3963ab53-16b5-4189-8c10-30dcbec14ae0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:37.555691 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3963ab53-16b5-4189-8c10-30dcbec14ae0 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1316 microversion: 2.1 time: 1.076396 Jul 26 14:20:37.570506 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1704/3275] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:36 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1316 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:37.602076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f009009-5594-4230-9f0d-5fca90b94b37 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:37.603201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f009009-5594-4230-9f0d-5fca90b94b37 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:37.615690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f009009-5594-4230-9f0d-5fca90b94b37 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:37.616173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f9a55001-a384-48f6-8212-4ef51b15d3ec tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:37.616680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f009009-5594-4230-9f0d-5fca90b94b37 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:37.619420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f009009-5594-4230-9f0d-5fca90b94b37 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:37.622009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f009009-5594-4230-9f0d-5fca90b94b37 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:37.633729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f9a55001-a384-48f6-8212-4ef51b15d3ec tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:37.635333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f9a55001-a384-48f6-8212-4ef51b15d3ec tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:37.636591 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f9a55001-a384-48f6-8212-4ef51b15d3ec tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1753 microversion: 2.20 time: 0.428921 Jul 26 14:20:37.637175 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1572/3276] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:37 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1753 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:37.738843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f009009-5594-4230-9f0d-5fca90b94b37 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:37.748092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f009009-5594-4230-9f0d-5fca90b94b37 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:37.750843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f009009-5594-4230-9f0d-5fca90b94b37 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:37.752352 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f009009-5594-4230-9f0d-5fca90b94b37 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.157945 Jul 26 14:20:37.753364 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1705/3277] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:37 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:38.239544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20567424-7203-46ca-bcbb-84e43a7e0366 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:38.240226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-20567424-7203-46ca-bcbb-84e43a7e0366 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:38.257555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20567424-7203-46ca-bcbb-84e43a7e0366 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:38.258175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20567424-7203-46ca-bcbb-84e43a7e0366 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:38.259058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20567424-7203-46ca-bcbb-84e43a7e0366 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:38.259579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20567424-7203-46ca-bcbb-84e43a7e0366 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:38.582280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e1f41fd3-55b1-4850-ab1a-57529ac3980b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:38.583604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e1f41fd3-55b1-4850-ab1a-57529ac3980b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:38.603177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1f41fd3-55b1-4850-ab1a-57529ac3980b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:38.603800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1f41fd3-55b1-4850-ab1a-57529ac3980b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:38.615034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1f41fd3-55b1-4850-ab1a-57529ac3980b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:38.622986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1f41fd3-55b1-4850-ab1a-57529ac3980b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:38.626896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-20567424-7203-46ca-bcbb-84e43a7e0366 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:38.642202 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-20567424-7203-46ca-bcbb-84e43a7e0366 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1307 microversion: 2.1 time: 0.407318 Jul 26 14:20:38.643695 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1573/3278] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:38 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1307 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:38.669383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9ca16088-c351-4e8d-98f7-ff94f1f61f71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:38.670410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9ca16088-c351-4e8d-98f7-ff94f1f61f71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:38.695106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ca16088-c351-4e8d-98f7-ff94f1f61f71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:38.695752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ca16088-c351-4e8d-98f7-ff94f1f61f71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:38.702330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ca16088-c351-4e8d-98f7-ff94f1f61f71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:38.702940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ca16088-c351-4e8d-98f7-ff94f1f61f71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:38.815081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:39.175052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ca16088-c351-4e8d-98f7-ff94f1f61f71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:39.194916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ca16088-c351-4e8d-98f7-ff94f1f61f71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:39.197442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ca16088-c351-4e8d-98f7-ff94f1f61f71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:39.198851 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9ca16088-c351-4e8d-98f7-ff94f1f61f71 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1753 microversion: 2.20 time: 0.538932 Jul 26 14:20:39.199736 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1574/3279] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:38 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1753 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:39.238344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b536ec48-a8e4-4143-81b9-f1ff3527af5d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:39.239802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b536ec48-a8e4-4143-81b9-f1ff3527af5d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:39.251646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b536ec48-a8e4-4143-81b9-f1ff3527af5d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:39.252510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b536ec48-a8e4-4143-81b9-f1ff3527af5d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:39.258826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b536ec48-a8e4-4143-81b9-f1ff3527af5d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:39.260156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b536ec48-a8e4-4143-81b9-f1ff3527af5d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:39.319051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e1f41fd3-55b1-4850-ab1a-57529ac3980b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:39.333422 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e1f41fd3-55b1-4850-ab1a-57529ac3980b tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1316 microversion: 2.1 time: 0.756067 Jul 26 14:20:39.335098 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1706/3280] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:38 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1316 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:39.427815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b536ec48-a8e4-4143-81b9-f1ff3527af5d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:39.444795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b536ec48-a8e4-4143-81b9-f1ff3527af5d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:39.447454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b536ec48-a8e4-4143-81b9-f1ff3527af5d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:39.449025 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b536ec48-a8e4-4143-81b9-f1ff3527af5d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.231346 Jul 26 14:20:39.450162 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1575/3281] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:39 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:39.672100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-472dd011-d20b-4ce8-989e-4c31399fdbe8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:39.673717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-472dd011-d20b-4ce8-989e-4c31399fdbe8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:39.685185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-472dd011-d20b-4ce8-989e-4c31399fdbe8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:39.685641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-472dd011-d20b-4ce8-989e-4c31399fdbe8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:39.686452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-472dd011-d20b-4ce8-989e-4c31399fdbe8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:39.686900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-472dd011-d20b-4ce8-989e-4c31399fdbe8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:39.966244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d3c2333d-c694-4e89-8ea8-d827bdc06861 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:39.979935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3c2333d-c694-4e89-8ea8-d827bdc06861 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:39.988954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3c2333d-c694-4e89-8ea8-d827bdc06861 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:40.052088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d3c2333d-c694-4e89-8ea8-d827bdc06861 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Going to try to stop instance {{(pid=119478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:20:40.191106 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d3c2333d-c694-4e89-8ea8-d827bdc06861 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/action" status: 202 len: 0 microversion: 2.1 time: 0.232828 Jul 26 14:20:40.194250 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1576/3282] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:20:39 2022] POST /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:40.204560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e75edfa5-adac-492e-ad0d-090d54a4713e req-2f37e5a7-de7a-4d39-9a86-7d05f83018b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79a8dbc-470b-4488-aea7-124183a070dd", "tag": "6c48c417-9053-4059-a30f-a2fba0f7ced1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:40.234127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e75edfa5-adac-492e-ad0d-090d54a4713e req-2f37e5a7-de7a-4d39-9a86-7d05f83018b4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:40.236292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e75edfa5-adac-492e-ad0d-090d54a4713e req-2f37e5a7-de7a-4d39-9a86-7d05f83018b4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:40.253737 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e75edfa5-adac-492e-ad0d-090d54a4713e req-2f37e5a7-de7a-4d39-9a86-7d05f83018b4 service nova] Creating event network-changed:6c48c417-9053-4059-a30f-a2fba0f7ced1 for instance d79a8dbc-470b-4488-aea7-124183a070dd on n-h1-833090-9 Jul 26 14:20:40.261595 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e75edfa5-adac-492e-ad0d-090d54a4713e req-2f37e5a7-de7a-4d39-9a86-7d05f83018b4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063888 Jul 26 14:20:40.263272 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1577/3283] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:40.271726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c83abfca-66dd-44c6-a31c-345a5f81ce2d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:40.272835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c83abfca-66dd-44c6-a31c-345a5f81ce2d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:40.287643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c83abfca-66dd-44c6-a31c-345a5f81ce2d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:40.288458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c83abfca-66dd-44c6-a31c-345a5f81ce2d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:40.289487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c83abfca-66dd-44c6-a31c-345a5f81ce2d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:40.290131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c83abfca-66dd-44c6-a31c-345a5f81ce2d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:40.324030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-472dd011-d20b-4ce8-989e-4c31399fdbe8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:40.343635 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-472dd011-d20b-4ce8-989e-4c31399fdbe8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1307 microversion: 2.1 time: 0.676292 Jul 26 14:20:40.360067 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1707/3284] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:39 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1307 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:40.360067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cd7f5efd-ab2e-4cda-8953-6823fa8d6673 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:40.367384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cd7f5efd-ab2e-4cda-8953-6823fa8d6673 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:40.409102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd7f5efd-ab2e-4cda-8953-6823fa8d6673 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:40.409102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd7f5efd-ab2e-4cda-8953-6823fa8d6673 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:40.409102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd7f5efd-ab2e-4cda-8953-6823fa8d6673 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:40.409102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd7f5efd-ab2e-4cda-8953-6823fa8d6673 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:40.787850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cd7f5efd-ab2e-4cda-8953-6823fa8d6673 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:40.803035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cd7f5efd-ab2e-4cda-8953-6823fa8d6673 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:40.804944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cd7f5efd-ab2e-4cda-8953-6823fa8d6673 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:40.806277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c83abfca-66dd-44c6-a31c-345a5f81ce2d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:40.806666 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cd7f5efd-ab2e-4cda-8953-6823fa8d6673 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1753 microversion: 2.20 time: 0.456378 Jul 26 14:20:40.822642 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c83abfca-66dd-44c6-a31c-345a5f81ce2d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1676 microversion: 2.1 time: 0.552070 Jul 26 14:20:40.822642 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1578/3285] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:40 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1676 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:40.823568 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1708/3286] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:40 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1753 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:40.829589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7af64f0a-2879-46ea-a8dc-4bbb2f67c62f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:40.830845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7af64f0a-2879-46ea-a8dc-4bbb2f67c62f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:40.835320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a48b7a3-9422-4b30-98f5-5fea7ec01b69 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:40.836292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4a48b7a3-9422-4b30-98f5-5fea7ec01b69 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:40.838448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7af64f0a-2879-46ea-a8dc-4bbb2f67c62f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:40.839111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7af64f0a-2879-46ea-a8dc-4bbb2f67c62f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:40.840155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7af64f0a-2879-46ea-a8dc-4bbb2f67c62f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:40.840863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7af64f0a-2879-46ea-a8dc-4bbb2f67c62f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:40.854027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a48b7a3-9422-4b30-98f5-5fea7ec01b69 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:40.854493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a48b7a3-9422-4b30-98f5-5fea7ec01b69 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:40.857236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a48b7a3-9422-4b30-98f5-5fea7ec01b69 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:40.857861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a48b7a3-9422-4b30-98f5-5fea7ec01b69 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:40.992700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7af64f0a-2879-46ea-a8dc-4bbb2f67c62f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:41.002903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7af64f0a-2879-46ea-a8dc-4bbb2f67c62f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:41.005139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7af64f0a-2879-46ea-a8dc-4bbb2f67c62f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:41.006788 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7af64f0a-2879-46ea-a8dc-4bbb2f67c62f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.181941 Jul 26 14:20:41.007894 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1709/3287] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:40 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:41.177451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4a48b7a3-9422-4b30-98f5-5fea7ec01b69 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:41.190712 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4a48b7a3-9422-4b30-98f5-5fea7ec01b69 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1503 microversion: 2.1 time: 0.370440 Jul 26 14:20:41.191189 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1579/3288] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:40 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1503 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:41.214939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95ecc132-f8e5-4ed4-a7e4-a3c57e8657b9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1874005150"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:41.215806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95ecc132-f8e5-4ed4-a7e4-a3c57e8657b9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:41.223232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95ecc132-f8e5-4ed4-a7e4-a3c57e8657b9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:41.223707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95ecc132-f8e5-4ed4-a7e4-a3c57e8657b9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:41.224570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95ecc132-f8e5-4ed4-a7e4-a3c57e8657b9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:41.225022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95ecc132-f8e5-4ed4-a7e4-a3c57e8657b9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:41.374087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71f3aeb8-5268-4617-8086-0a77c415c0f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:41.376618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-71f3aeb8-5268-4617-8086-0a77c415c0f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:41.385197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71f3aeb8-5268-4617-8086-0a77c415c0f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:41.385686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71f3aeb8-5268-4617-8086-0a77c415c0f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:41.386487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71f3aeb8-5268-4617-8086-0a77c415c0f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:41.386946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-71f3aeb8-5268-4617-8086-0a77c415c0f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:41.508934 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.network.security_group_api [None req-95ecc132-f8e5-4ed4-a7e4-a3c57e8657b9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Adding security group a6b86a4f-d86b-4026-8c0e-b4828a12b692 to port 295ca1ce-51a5-4367-b0ed-b671809ee202 Jul 26 14:20:41.731211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-71f3aeb8-5268-4617-8086-0a77c415c0f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:41.748759 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-71f3aeb8-5268-4617-8086-0a77c415c0f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1307 microversion: 2.1 time: 0.377811 Jul 26 14:20:41.749358 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1580/3289] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:41 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1307 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:41.834400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-30cef9d9-d78e-49a5-b582-44bd3837c1f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:41.836041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-30cef9d9-d78e-49a5-b582-44bd3837c1f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:41.845957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30cef9d9-d78e-49a5-b582-44bd3837c1f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:41.846458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30cef9d9-d78e-49a5-b582-44bd3837c1f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:41.847386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30cef9d9-d78e-49a5-b582-44bd3837c1f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:41.848174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30cef9d9-d78e-49a5-b582-44bd3837c1f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:42.084378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-30cef9d9-d78e-49a5-b582-44bd3837c1f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:42.100629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-30cef9d9-d78e-49a5-b582-44bd3837c1f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:42.101559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-30cef9d9-d78e-49a5-b582-44bd3837c1f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:42.103797 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-30cef9d9-d78e-49a5-b582-44bd3837c1f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1753 microversion: 2.20 time: 0.277000 Jul 26 14:20:42.111606 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1581/3290] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:41 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1753 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:20:42.111606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1f21734c-d216-4baf-a140-7ab67abddedd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:42.111606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f21734c-d216-4baf-a140-7ab67abddedd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:42.133548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f21734c-d216-4baf-a140-7ab67abddedd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:42.136912 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95ecc132-f8e5-4ed4-a7e4-a3c57e8657b9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044/action" status: 202 len: 0 microversion: 2.1 time: 0.926639 Jul 26 14:20:42.137690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f21734c-d216-4baf-a140-7ab67abddedd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:42.138151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f21734c-d216-4baf-a140-7ab67abddedd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:42.140586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f21734c-d216-4baf-a140-7ab67abddedd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:42.146307 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1710/3291] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:20:41 2022] POST /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044/action => generated 0 bytes in 938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:20:42.155858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-146d4127-a888-4545-bd81-2f29edf7ba8f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:42.157698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-146d4127-a888-4545-bd81-2f29edf7ba8f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:42.168978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-146d4127-a888-4545-bd81-2f29edf7ba8f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:42.170162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-146d4127-a888-4545-bd81-2f29edf7ba8f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:42.171710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-146d4127-a888-4545-bd81-2f29edf7ba8f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:42.172743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-146d4127-a888-4545-bd81-2f29edf7ba8f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:42.333737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-146d4127-a888-4545-bd81-2f29edf7ba8f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:42.362098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-146d4127-a888-4545-bd81-2f29edf7ba8f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:42.368089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-146d4127-a888-4545-bd81-2f29edf7ba8f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:42.376485 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-146d4127-a888-4545-bd81-2f29edf7ba8f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.226683 Jul 26 14:20:42.382556 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1711/3292] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:42 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:42.425641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1f21734c-d216-4baf-a140-7ab67abddedd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:42.428819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9718b4ea-2ec3-4e88-9c97-a731ca24cf34 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f879437b5e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:42.444601 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1f21734c-d216-4baf-a140-7ab67abddedd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1676 microversion: 2.1 time: 0.336875 Jul 26 14:20:42.447152 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1582/3293] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:42 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1676 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:42.459165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-be29dc5a-de38-4cb9-8e79-5ddcfd4a59e7 req-6c4353dd-44b8-4115-a171-efff5c82e9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c2ca5f-2342-4538-a501-6bd7877bd044", "tag": "295ca1ce-51a5-4367-b0ed-b671809ee202"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:42.487706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-be29dc5a-de38-4cb9-8e79-5ddcfd4a59e7 req-6c4353dd-44b8-4115-a171-efff5c82e9e4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:42.503336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-be29dc5a-de38-4cb9-8e79-5ddcfd4a59e7 req-6c4353dd-44b8-4115-a171-efff5c82e9e4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:42.554823 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-be29dc5a-de38-4cb9-8e79-5ddcfd4a59e7 req-6c4353dd-44b8-4115-a171-efff5c82e9e4 service nova] Creating event network-changed:295ca1ce-51a5-4367-b0ed-b671809ee202 for instance b3c2ca5f-2342-4538-a501-6bd7877bd044 on n-h2-833090-9 Jul 26 14:20:42.585899 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-be29dc5a-de38-4cb9-8e79-5ddcfd4a59e7 req-6c4353dd-44b8-4115-a171-efff5c82e9e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129454 Jul 26 14:20:42.587700 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1583/3294] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:42.747925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-9718b4ea-2ec3-4e88-9c97-a731ca24cf34 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a6b86a4f-d86b-4026-8c0e-b4828a12b692 in use.", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:20:42.750068 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-9718b4ea-2ec3-4e88-9c97-a731ca24cf34 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security Group a6b86a4f-d86b-4026-8c0e-b4828a12b692 in use. Jul 26 14:20:42.750068 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-0c3eef48-541d-4def-a3eb-e693a25a4f55'] Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9718b4ea-2ec3-4e88-9c97-a731ca24cf34 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-security-groups/a6b86a4f-d86b-4026-8c0e-b4828a12b692 HTTP/1.1 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: exception: Security Group a6b86a4f-d86b-4026-8c0e-b4828a12b692 in use. Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-0c3eef48-541d-4def-a3eb-e693a25a4f55'] Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'a6b86a4f-d86b-4026-8c0e-b4828a12b692'} Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a6b86a4f-d86b-4026-8c0e-b4828a12b692 in use. Jul 26 14:20:42.755125 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c3eef48-541d-4def-a3eb-e693a25a4f55'] Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a6b86a4f-d86b-4026-8c0e-b4828a12b692 in use. Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c3eef48-541d-4def-a3eb-e693a25a4f55'] Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a6b86a4f-d86b-4026-8c0e-b4828a12b692 in use. Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c3eef48-541d-4def-a3eb-e693a25a4f55'] Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a6b86a4f-d86b-4026-8c0e-b4828a12b692 in use. Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c3eef48-541d-4def-a3eb-e693a25a4f55'] Jul 26 14:20:42.765643 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:42.785241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9718b4ea-2ec3-4e88-9c97-a731ca24cf34 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 400 to user: Security Group a6b86a4f-d86b-4026-8c0e-b4828a12b692 in use. Jul 26 14:20:42.785241 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-0c3eef48-541d-4def-a3eb-e693a25a4f55'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:42.789824 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9718b4ea-2ec3-4e88-9c97-a731ca24cf34 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/a6b86a4f-d86b-4026-8c0e-b4828a12b692" status: 400 len: 185 microversion: 2.1 time: 0.403280 Jul 26 14:20:42.790298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ed779471-be69-460d-9deb-bdd000045377 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:42.791521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ed779471-be69-460d-9deb-bdd000045377 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:42.801724 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1712/3295] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:20:42 2022] DELETE /compute/v2.1/os-security-groups/a6b86a4f-d86b-4026-8c0e-b4828a12b692 => generated 185 bytes in 417 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:20:42.804497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed779471-be69-460d-9deb-bdd000045377 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:42.805763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed779471-be69-460d-9deb-bdd000045377 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:42.806667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed779471-be69-460d-9deb-bdd000045377 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:42.807887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed779471-be69-460d-9deb-bdd000045377 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:42.814904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0371e2f4-9760-4d30-92d7-b6633fc78fd6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:42.820699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0371e2f4-9760-4d30-92d7-b6633fc78fd6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:42.845718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0371e2f4-9760-4d30-92d7-b6633fc78fd6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:42.846901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0371e2f4-9760-4d30-92d7-b6633fc78fd6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:42.849193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0371e2f4-9760-4d30-92d7-b6633fc78fd6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:42.850258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0371e2f4-9760-4d30-92d7-b6633fc78fd6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:42.899503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:43.075497 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0371e2f4-9760-4d30-92d7-b6633fc78fd6 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044/action" status: 202 len: 0 microversion: 2.1 time: 0.269347 Jul 26 14:20:43.082738 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1713/3296] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:20:42 2022] POST /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:43.096554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-985e4c37-09e5-4216-88a5-731308655746 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:43.098238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-985e4c37-09e5-4216-88a5-731308655746 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:43.116828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-985e4c37-09e5-4216-88a5-731308655746 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:43.118370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-985e4c37-09e5-4216-88a5-731308655746 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:43.121296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-985e4c37-09e5-4216-88a5-731308655746 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:43.122358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-985e4c37-09e5-4216-88a5-731308655746 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:43.468167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ed779471-be69-460d-9deb-bdd000045377 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:43.482028 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ed779471-be69-460d-9deb-bdd000045377 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1307 microversion: 2.1 time: 0.713821 Jul 26 14:20:43.483273 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1584/3297] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:42 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1307 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:43.504077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e5d6497b-ab3e-4da2-ad78-31d48bb9b6bf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:43.504976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e5d6497b-ab3e-4da2-ad78-31d48bb9b6bf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:43.512723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5d6497b-ab3e-4da2-ad78-31d48bb9b6bf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:43.513694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5d6497b-ab3e-4da2-ad78-31d48bb9b6bf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:43.514958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5d6497b-ab3e-4da2-ad78-31d48bb9b6bf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:43.517853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e5d6497b-ab3e-4da2-ad78-31d48bb9b6bf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:43.684137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-985e4c37-09e5-4216-88a5-731308655746 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:43.698645 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-985e4c37-09e5-4216-88a5-731308655746 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1574 microversion: 2.1 time: 0.611235 Jul 26 14:20:43.699987 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1714/3298] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:43 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1574 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:43.708291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1bd70fa-1bbd-4f4e-8439-dd37700eaae4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:43.708998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f1bd70fa-1bbd-4f4e-8439-dd37700eaae4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:43.718123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1bd70fa-1bbd-4f4e-8439-dd37700eaae4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:43.718958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1bd70fa-1bbd-4f4e-8439-dd37700eaae4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:43.720961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1bd70fa-1bbd-4f4e-8439-dd37700eaae4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:43.722039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1bd70fa-1bbd-4f4e-8439-dd37700eaae4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:44.198858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1bd70fa-1bbd-4f4e-8439-dd37700eaae4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:44.216904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1bd70fa-1bbd-4f4e-8439-dd37700eaae4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:44.221940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1bd70fa-1bbd-4f4e-8439-dd37700eaae4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:44.223798 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f1bd70fa-1bbd-4f4e-8439-dd37700eaae4 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.522571 Jul 26 14:20:44.224796 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1715/3299] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:43 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:44.230891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2b9afd48-16e7-4573-be4e-dc22f1e6b150 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:44.231658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2b9afd48-16e7-4573-be4e-dc22f1e6b150 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:44.241385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b9afd48-16e7-4573-be4e-dc22f1e6b150 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:44.241987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b9afd48-16e7-4573-be4e-dc22f1e6b150 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:44.242901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b9afd48-16e7-4573-be4e-dc22f1e6b150 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:44.243455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b9afd48-16e7-4573-be4e-dc22f1e6b150 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:44.270074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e5d6497b-ab3e-4da2-ad78-31d48bb9b6bf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:44.295036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e5d6497b-ab3e-4da2-ad78-31d48bb9b6bf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:44.307259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e5d6497b-ab3e-4da2-ad78-31d48bb9b6bf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:44.310162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e5d6497b-ab3e-4da2-ad78-31d48bb9b6bf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.824850 Jul 26 14:20:44.312124 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1585/3300] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:43 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:44.474372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:44.512988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:44.521871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-80f0527c-5752-422d-a563-25b4aa91634c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:44.524176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-80f0527c-5752-422d-a563-25b4aa91634c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:44.542219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80f0527c-5752-422d-a563-25b4aa91634c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:44.544171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80f0527c-5752-422d-a563-25b4aa91634c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:44.546312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80f0527c-5752-422d-a563-25b4aa91634c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:44.548494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80f0527c-5752-422d-a563-25b4aa91634c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:44.826980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=24 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:44.982415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2b9afd48-16e7-4573-be4e-dc22f1e6b150 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:45.009645 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2b9afd48-16e7-4573-be4e-dc22f1e6b150 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1676 microversion: 2.1 time: 0.782634 Jul 26 14:20:45.014152 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1716/3301] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:44 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1676 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:45.034043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e24c1618-f7d7-4fbe-93ec-802184a2aa32 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:45.040164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e24c1618-f7d7-4fbe-93ec-802184a2aa32 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:45.062405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e24c1618-f7d7-4fbe-93ec-802184a2aa32 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:45.063752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e24c1618-f7d7-4fbe-93ec-802184a2aa32 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:45.065275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e24c1618-f7d7-4fbe-93ec-802184a2aa32 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:45.066107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e24c1618-f7d7-4fbe-93ec-802184a2aa32 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:45.378711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80f0527c-5752-422d-a563-25b4aa91634c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:45.406752 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-80f0527c-5752-422d-a563-25b4aa91634c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1307 microversion: 2.1 time: 0.886186 Jul 26 14:20:45.436244 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1586/3302] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:44 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1307 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:45.442226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-46167345-eee6-41b9-bd1c-7061a5f244cf tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:45.443279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-46167345-eee6-41b9-bd1c-7061a5f244cf tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:45.462315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46167345-eee6-41b9-bd1c-7061a5f244cf tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:45.462922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46167345-eee6-41b9-bd1c-7061a5f244cf tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:45.469954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46167345-eee6-41b9-bd1c-7061a5f244cf tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:45.470667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46167345-eee6-41b9-bd1c-7061a5f244cf tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:45.701420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-46167345-eee6-41b9-bd1c-7061a5f244cf tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:45.734108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-46167345-eee6-41b9-bd1c-7061a5f244cf tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:45.742985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-46167345-eee6-41b9-bd1c-7061a5f244cf tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:45.744656 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-46167345-eee6-41b9-bd1c-7061a5f244cf tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.307717 Jul 26 14:20:45.760612 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1587/3303] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:45 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:45.770593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f0001a51-978f-44d4-b31f-3a696c5a1998 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:45.784930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f0001a51-978f-44d4-b31f-3a696c5a1998 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:45.793416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0001a51-978f-44d4-b31f-3a696c5a1998 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:45.794175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0001a51-978f-44d4-b31f-3a696c5a1998 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:45.795730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0001a51-978f-44d4-b31f-3a696c5a1998 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:45.796637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0001a51-978f-44d4-b31f-3a696c5a1998 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:45.833813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e24c1618-f7d7-4fbe-93ec-802184a2aa32 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:45.877098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:45.878224 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e24c1618-f7d7-4fbe-93ec-802184a2aa32 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1574 microversion: 2.1 time: 0.858007 Jul 26 14:20:45.892045 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1717/3304] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:45 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1574 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:46.047708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bdf9cef0-d9b4-46e2-bf40-d5d822516c99 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:46.049547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bdf9cef0-d9b4-46e2-bf40-d5d822516c99 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:46.063553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdf9cef0-d9b4-46e2-bf40-d5d822516c99 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:46.064082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdf9cef0-d9b4-46e2-bf40-d5d822516c99 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:46.064965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdf9cef0-d9b4-46e2-bf40-d5d822516c99 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:46.065549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdf9cef0-d9b4-46e2-bf40-d5d822516c99 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:46.825263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f0001a51-978f-44d4-b31f-3a696c5a1998 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:46.842286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f0001a51-978f-44d4-b31f-3a696c5a1998 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:46.844165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f0001a51-978f-44d4-b31f-3a696c5a1998 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:46.846539 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f0001a51-978f-44d4-b31f-3a696c5a1998 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 1.084310 Jul 26 14:20:46.847305 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1588/3305] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:45 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:46.852195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-9b0e6f0f-da3b-408b-b21e-57c7c55433f5 req-1eeb2455-f428-4f65-a3de-1cedb162f03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79a8dbc-470b-4488-aea7-124183a070dd", "name": "network-vif-plugged", "status": "completed", "tag": "6c48c417-9053-4059-a30f-a2fba0f7ced1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:46.863632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9b0e6f0f-da3b-408b-b21e-57c7c55433f5 req-1eeb2455-f428-4f65-a3de-1cedb162f03e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:46.864409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9b0e6f0f-da3b-408b-b21e-57c7c55433f5 req-1eeb2455-f428-4f65-a3de-1cedb162f03e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:46.877656 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-9b0e6f0f-da3b-408b-b21e-57c7c55433f5 req-1eeb2455-f428-4f65-a3de-1cedb162f03e service nova] Creating event network-vif-plugged:6c48c417-9053-4059-a30f-a2fba0f7ced1 for instance d79a8dbc-470b-4488-aea7-124183a070dd on n-h1-833090-9 Jul 26 14:20:46.883591 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-9b0e6f0f-da3b-408b-b21e-57c7c55433f5 req-1eeb2455-f428-4f65-a3de-1cedb162f03e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034890 Jul 26 14:20:46.888662 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1589/3306] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:46.895433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-114a09af-86fc-4834-a6d7-59c785a5931b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:46.896212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-114a09af-86fc-4834-a6d7-59c785a5931b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:46.902865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-114a09af-86fc-4834-a6d7-59c785a5931b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:46.903632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-114a09af-86fc-4834-a6d7-59c785a5931b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:46.904811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-114a09af-86fc-4834-a6d7-59c785a5931b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:46.905421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-114a09af-86fc-4834-a6d7-59c785a5931b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:46.920147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bdf9cef0-d9b4-46e2-bf40-d5d822516c99 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:46.944513 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bdf9cef0-d9b4-46e2-bf40-d5d822516c99 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1676 microversion: 2.1 time: 0.900572 Jul 26 14:20:46.945692 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1718/3307] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:46 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1676 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:46.955193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57f7b831-4788-4025-b13d-433953743c86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:46.956128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-57f7b831-4788-4025-b13d-433953743c86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:46.967466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57f7b831-4788-4025-b13d-433953743c86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:46.968807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57f7b831-4788-4025-b13d-433953743c86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:46.971092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57f7b831-4788-4025-b13d-433953743c86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:46.972108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57f7b831-4788-4025-b13d-433953743c86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:47.238455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-57f7b831-4788-4025-b13d-433953743c86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:47.251051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-57f7b831-4788-4025-b13d-433953743c86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:47.252786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-57f7b831-4788-4025-b13d-433953743c86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:47.254211 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57f7b831-4788-4025-b13d-433953743c86 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.306361 Jul 26 14:20:47.280054 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1719/3308] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:46 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:47.302836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-77347122-3264-4d67-a44b-54968d4ba374 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:47.303995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-77347122-3264-4d67-a44b-54968d4ba374 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:47.334227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77347122-3264-4d67-a44b-54968d4ba374 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:47.335012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77347122-3264-4d67-a44b-54968d4ba374 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:47.341212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77347122-3264-4d67-a44b-54968d4ba374 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:47.343317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77347122-3264-4d67-a44b-54968d4ba374 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:47.372641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-114a09af-86fc-4834-a6d7-59c785a5931b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:47.411384 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-114a09af-86fc-4834-a6d7-59c785a5931b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1307 microversion: 2.1 time: 0.520877 Jul 26 14:20:47.436661 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1590/3309] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:46 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1307 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:47.739289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-77347122-3264-4d67-a44b-54968d4ba374 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:47.752300 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-77347122-3264-4d67-a44b-54968d4ba374 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1574 microversion: 2.1 time: 0.468767 Jul 26 14:20:47.753551 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1720/3310] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:47 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1574 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:47.903504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb1b70cb-0b9e-46f1-863d-9cbaf58c49c7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:47.911327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bb1b70cb-0b9e-46f1-863d-9cbaf58c49c7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:47.931134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb1b70cb-0b9e-46f1-863d-9cbaf58c49c7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:47.931583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb1b70cb-0b9e-46f1-863d-9cbaf58c49c7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:47.933410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb1b70cb-0b9e-46f1-863d-9cbaf58c49c7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:47.934042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb1b70cb-0b9e-46f1-863d-9cbaf58c49c7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:47.984058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3907a1ec-d77c-4b78-9cd4-f09cd561ef63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:47.984919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3907a1ec-d77c-4b78-9cd4-f09cd561ef63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:48.006767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3907a1ec-d77c-4b78-9cd4-f09cd561ef63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:48.007527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3907a1ec-d77c-4b78-9cd4-f09cd561ef63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:48.008612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3907a1ec-d77c-4b78-9cd4-f09cd561ef63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:48.009253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3907a1ec-d77c-4b78-9cd4-f09cd561ef63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:48.473060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bb1b70cb-0b9e-46f1-863d-9cbaf58c49c7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:48.495742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bb1b70cb-0b9e-46f1-863d-9cbaf58c49c7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:48.496102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3907a1ec-d77c-4b78-9cd4-f09cd561ef63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:48.517087 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3907a1ec-d77c-4b78-9cd4-f09cd561ef63 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1676 microversion: 2.1 time: 0.534861 Jul 26 14:20:48.517417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bb1b70cb-0b9e-46f1-863d-9cbaf58c49c7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:48.520155 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bb1b70cb-0b9e-46f1-863d-9cbaf58c49c7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.623613 Jul 26 14:20:48.521157 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1721/3311] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:47 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1676 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:48.521511 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1591/3312] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:47 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:48.529635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b818444e-c7c2-47bf-8271-8959d0ef91c9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:48.529884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b818444e-c7c2-47bf-8271-8959d0ef91c9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:48.540340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b818444e-c7c2-47bf-8271-8959d0ef91c9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:48.541198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b818444e-c7c2-47bf-8271-8959d0ef91c9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:48.542649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b818444e-c7c2-47bf-8271-8959d0ef91c9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:48.543537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b818444e-c7c2-47bf-8271-8959d0ef91c9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:48.548747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-61d7e280-e6e6-4cda-8f0c-c3c536b3db79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:48.550093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-61d7e280-e6e6-4cda-8f0c-c3c536b3db79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:48.567796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61d7e280-e6e6-4cda-8f0c-c3c536b3db79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:48.569301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61d7e280-e6e6-4cda-8f0c-c3c536b3db79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:48.571200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61d7e280-e6e6-4cda-8f0c-c3c536b3db79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:48.572374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61d7e280-e6e6-4cda-8f0c-c3c536b3db79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:48.646985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b818444e-c7c2-47bf-8271-8959d0ef91c9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:48.663131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b818444e-c7c2-47bf-8271-8959d0ef91c9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:48.665879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b818444e-c7c2-47bf-8271-8959d0ef91c9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:48.667702 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b818444e-c7c2-47bf-8271-8959d0ef91c9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.144147 Jul 26 14:20:48.669074 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1722/3313] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:48 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:48.779535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-059aa90c-52a5-4250-b3b4-9507740cdd3c tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:48.781059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-059aa90c-52a5-4250-b3b4-9507740cdd3c tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:48.805972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-059aa90c-52a5-4250-b3b4-9507740cdd3c tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:48.811122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-059aa90c-52a5-4250-b3b4-9507740cdd3c tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:48.812286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-059aa90c-52a5-4250-b3b4-9507740cdd3c tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:48.813129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-059aa90c-52a5-4250-b3b4-9507740cdd3c tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:48.980314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-61d7e280-e6e6-4cda-8f0c-c3c536b3db79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:48.995522 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-61d7e280-e6e6-4cda-8f0c-c3c536b3db79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1307 microversion: 2.1 time: 0.466911 Jul 26 14:20:49.002735 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1592/3314] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:48 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1307 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:49.111310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-059aa90c-52a5-4250-b3b4-9507740cdd3c tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:49.130684 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-059aa90c-52a5-4250-b3b4-9507740cdd3c tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1572 microversion: 2.1 time: 0.358006 Jul 26 14:20:49.132539 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1723/3315] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:48 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1572 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:49.165719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1bca1fdc-f9ff-48fa-9269-cbb453f12ae5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1947785675"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:49.167940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1bca1fdc-f9ff-48fa-9269-cbb453f12ae5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:49.189364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bca1fdc-f9ff-48fa-9269-cbb453f12ae5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:49.190376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bca1fdc-f9ff-48fa-9269-cbb453f12ae5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:49.192169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bca1fdc-f9ff-48fa-9269-cbb453f12ae5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:49.192169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bca1fdc-f9ff-48fa-9269-cbb453f12ae5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:49.368569 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.network.security_group_api [None req-1bca1fdc-f9ff-48fa-9269-cbb453f12ae5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Adding security group 94851e57-caeb-4064-bde9-aee66cf7337e to port 295ca1ce-51a5-4367-b0ed-b671809ee202 Jul 26 14:20:49.561196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6170426a-63f9-4eab-a091-057b0b85fb93 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:49.561817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6170426a-63f9-4eab-a091-057b0b85fb93 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:49.576487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6170426a-63f9-4eab-a091-057b0b85fb93 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:49.576965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6170426a-63f9-4eab-a091-057b0b85fb93 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:49.581214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6170426a-63f9-4eab-a091-057b0b85fb93 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:49.586449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6170426a-63f9-4eab-a091-057b0b85fb93 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:49.870865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6170426a-63f9-4eab-a091-057b0b85fb93 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:49.899335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6170426a-63f9-4eab-a091-057b0b85fb93 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:49.900998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6170426a-63f9-4eab-a091-057b0b85fb93 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:49.903398 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6170426a-63f9-4eab-a091-057b0b85fb93 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.345416 Jul 26 14:20:49.909616 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1724/3316] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:49 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:49.919187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b659045a-f769-492a-8c72-0144e7404d98 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:49.919969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b659045a-f769-492a-8c72-0144e7404d98 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:49.939992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b659045a-f769-492a-8c72-0144e7404d98 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:49.940442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b659045a-f769-492a-8c72-0144e7404d98 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:49.941271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b659045a-f769-492a-8c72-0144e7404d98 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:49.941727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b659045a-f769-492a-8c72-0144e7404d98 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:50.258662 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1bca1fdc-f9ff-48fa-9269-cbb453f12ae5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044/action" status: 202 len: 0 microversion: 2.1 time: 1.103067 Jul 26 14:20:50.259491 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1593/3317] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:20:49 2022] POST /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044/action => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:50.264859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-963200d1-d65a-45d8-9473-ae5931ed7d07 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:50.268824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-963200d1-d65a-45d8-9473-ae5931ed7d07 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:50.296242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-963200d1-d65a-45d8-9473-ae5931ed7d07 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:50.296444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-963200d1-d65a-45d8-9473-ae5931ed7d07 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:50.298702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-963200d1-d65a-45d8-9473-ae5931ed7d07 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:50.299369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-963200d1-d65a-45d8-9473-ae5931ed7d07 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:50.326777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b659045a-f769-492a-8c72-0144e7404d98 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:50.360491 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b659045a-f769-492a-8c72-0144e7404d98 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1676 microversion: 2.1 time: 0.446656 Jul 26 14:20:50.374669 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1725/3318] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:49 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1676 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:50.424613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-077ab487-2702-4eb5-9d72-e5530cbf2c91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:50.425573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-077ab487-2702-4eb5-9d72-e5530cbf2c91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:50.438936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-077ab487-2702-4eb5-9d72-e5530cbf2c91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:50.439728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-077ab487-2702-4eb5-9d72-e5530cbf2c91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:50.440750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-077ab487-2702-4eb5-9d72-e5530cbf2c91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:50.443626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-077ab487-2702-4eb5-9d72-e5530cbf2c91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:50.601249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-963200d1-d65a-45d8-9473-ae5931ed7d07 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:50.650920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-963200d1-d65a-45d8-9473-ae5931ed7d07 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:50.652496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-963200d1-d65a-45d8-9473-ae5931ed7d07 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:50.662174 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-963200d1-d65a-45d8-9473-ae5931ed7d07 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.401594 Jul 26 14:20:50.665664 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1594/3319] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:50 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:50.682299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b52c1668-7caf-4284-8071-e115aee6debe tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f87878570d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:50.946831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-077ab487-2702-4eb5-9d72-e5530cbf2c91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:50.963688 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-077ab487-2702-4eb5-9d72-e5530cbf2c91 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1307 microversion: 2.1 time: 0.587014 Jul 26 14:20:50.964814 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1726/3320] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:50 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1307 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:50.970881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-72506369-dbc2-4705-8043-42991d7c22fd req-6145ae93-4d56-425f-b4ae-5e53d83de640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c2ca5f-2342-4538-a501-6bd7877bd044", "tag": "295ca1ce-51a5-4367-b0ed-b671809ee202"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:51.003488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-72506369-dbc2-4705-8043-42991d7c22fd req-6145ae93-4d56-425f-b4ae-5e53d83de640 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:51.005168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-72506369-dbc2-4705-8043-42991d7c22fd req-6145ae93-4d56-425f-b4ae-5e53d83de640 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:51.025827 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-72506369-dbc2-4705-8043-42991d7c22fd req-6145ae93-4d56-425f-b4ae-5e53d83de640 service nova] Creating event network-changed:295ca1ce-51a5-4367-b0ed-b671809ee202 for instance b3c2ca5f-2342-4538-a501-6bd7877bd044 on n-h2-833090-9 Jul 26 14:20:51.042234 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-72506369-dbc2-4705-8043-42991d7c22fd req-6145ae93-4d56-425f-b4ae-5e53d83de640 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075240 Jul 26 14:20:51.043805 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1727/3321] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:51.053617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aa3f3cea-14a4-4e1f-b93a-ffd3de1245df tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:51.054474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aa3f3cea-14a4-4e1f-b93a-ffd3de1245df tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:51.058304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-b52c1668-7caf-4284-8071-e115aee6debe tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 94851e57-caeb-4064-bde9-aee66cf7337e in use.", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:20:51.059390 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b52c1668-7caf-4284-8071-e115aee6debe tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security Group 94851e57-caeb-4064-bde9-aee66cf7337e in use. Jul 26 14:20:51.059390 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-d177f205-0047-4efd-ad97-322e14702c48'] Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b52c1668-7caf-4284-8071-e115aee6debe tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-security-groups/94851e57-caeb-4064-bde9-aee66cf7337e HTTP/1.1 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: exception: Security Group 94851e57-caeb-4064-bde9-aee66cf7337e in use. Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-d177f205-0047-4efd-ad97-322e14702c48'] Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '94851e57-caeb-4064-bde9-aee66cf7337e'} Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 94851e57-caeb-4064-bde9-aee66cf7337e in use. Jul 26 14:20:51.066312 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d177f205-0047-4efd-ad97-322e14702c48'] Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 94851e57-caeb-4064-bde9-aee66cf7337e in use. Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d177f205-0047-4efd-ad97-322e14702c48'] Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 94851e57-caeb-4064-bde9-aee66cf7337e in use. Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d177f205-0047-4efd-ad97-322e14702c48'] Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 94851e57-caeb-4064-bde9-aee66cf7337e in use. Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d177f205-0047-4efd-ad97-322e14702c48'] Jul 26 14:20:51.071256 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:51.077973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b52c1668-7caf-4284-8071-e115aee6debe tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 400 to user: Security Group 94851e57-caeb-4064-bde9-aee66cf7337e in use. Jul 26 14:20:51.077973 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-d177f205-0047-4efd-ad97-322e14702c48'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:51.083423 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b52c1668-7caf-4284-8071-e115aee6debe tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/94851e57-caeb-4064-bde9-aee66cf7337e" status: 400 len: 185 microversion: 2.1 time: 0.405355 Jul 26 14:20:51.084038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa3f3cea-14a4-4e1f-b93a-ffd3de1245df tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:51.085759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa3f3cea-14a4-4e1f-b93a-ffd3de1245df tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:51.086372 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1595/3322] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:20:50 2022] DELETE /compute/v2.1/os-security-groups/94851e57-caeb-4064-bde9-aee66cf7337e => generated 185 bytes in 412 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:20:51.087861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa3f3cea-14a4-4e1f-b93a-ffd3de1245df tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:51.091923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa3f3cea-14a4-4e1f-b93a-ffd3de1245df tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:51.098084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4b232a98-5b93-40b5-95bb-85ed0870a149 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:51.101338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4b232a98-5b93-40b5-95bb-85ed0870a149 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:51.113162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b232a98-5b93-40b5-95bb-85ed0870a149 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:51.113692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b232a98-5b93-40b5-95bb-85ed0870a149 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:51.114554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b232a98-5b93-40b5-95bb-85ed0870a149 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:51.115011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b232a98-5b93-40b5-95bb-85ed0870a149 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:51.192679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4b232a98-5b93-40b5-95bb-85ed0870a149 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:20:51.390497 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4b232a98-5b93-40b5-95bb-85ed0870a149 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 204 len: 0 microversion: 2.1 time: 0.297038 Jul 26 14:20:51.396606 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1596/3323] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:20:51 2022] DELETE /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:20:51.409662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4e916f4c-1606-4aa1-88b1-7da2c03a01d8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:51.412985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4e916f4c-1606-4aa1-88b1-7da2c03a01d8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:51.433834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:51.436205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e916f4c-1606-4aa1-88b1-7da2c03a01d8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:51.439965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e916f4c-1606-4aa1-88b1-7da2c03a01d8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:51.443566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e916f4c-1606-4aa1-88b1-7da2c03a01d8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:51.447384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e916f4c-1606-4aa1-88b1-7da2c03a01d8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:51.527548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa3f3cea-14a4-4e1f-b93a-ffd3de1245df tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:51.562024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa3f3cea-14a4-4e1f-b93a-ffd3de1245df tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:51.564512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa3f3cea-14a4-4e1f-b93a-ffd3de1245df tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:51.567020 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aa3f3cea-14a4-4e1f-b93a-ffd3de1245df tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.520511 Jul 26 14:20:51.571223 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1728/3324] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:51 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:51.576862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23ca4532-d632-499f-858b-beeeca36781d tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:51.583995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-23ca4532-d632-499f-858b-beeeca36781d tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:51.604016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23ca4532-d632-499f-858b-beeeca36781d tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:51.605536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23ca4532-d632-499f-858b-beeeca36781d tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:51.606689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23ca4532-d632-499f-858b-beeeca36781d tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:51.608340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23ca4532-d632-499f-858b-beeeca36781d tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:52.095311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4e916f4c-1606-4aa1-88b1-7da2c03a01d8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:52.153056 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4e916f4c-1606-4aa1-88b1-7da2c03a01d8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1676 microversion: 2.1 time: 0.757750 Jul 26 14:20:52.157705 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1597/3325] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:51 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1676 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:52.170515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e4d65133-0148-496c-a691-4d451c9bd845 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:52.173054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e4d65133-0148-496c-a691-4d451c9bd845 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:52.182659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23ca4532-d632-499f-858b-beeeca36781d tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:52.190267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:52.196526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4d65133-0148-496c-a691-4d451c9bd845 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:52.196993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4d65133-0148-496c-a691-4d451c9bd845 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:52.197924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4d65133-0148-496c-a691-4d451c9bd845 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:52.198503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4d65133-0148-496c-a691-4d451c9bd845 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:52.204792 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23ca4532-d632-499f-858b-beeeca36781d tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1647 microversion: 2.1 time: 0.632087 Jul 26 14:20:52.212273 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1729/3326] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:51 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1647 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:52.221527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ff2bc93-9800-48dc-9641-497146e7820c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:52.222556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2ff2bc93-9800-48dc-9641-497146e7820c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:52.229990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ff2bc93-9800-48dc-9641-497146e7820c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:52.231050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ff2bc93-9800-48dc-9641-497146e7820c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:52.232212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ff2bc93-9800-48dc-9641-497146e7820c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:52.232875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ff2bc93-9800-48dc-9641-497146e7820c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:52.533316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e4d65133-0148-496c-a691-4d451c9bd845 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:52.561486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e4d65133-0148-496c-a691-4d451c9bd845 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:52.579031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e4d65133-0148-496c-a691-4d451c9bd845 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:52.581610 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e4d65133-0148-496c-a691-4d451c9bd845 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.418773 Jul 26 14:20:52.585742 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1598/3327] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:52 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:52.644390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d62062f4-2f0d-44f0-9a5d-acfa76ab9cdd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:52.647077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2ff2bc93-9800-48dc-9641-497146e7820c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:52.655174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d62062f4-2f0d-44f0-9a5d-acfa76ab9cdd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:52.669861 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ff2bc93-9800-48dc-9641-497146e7820c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1488 microversion: 2.1 time: 0.455549 Jul 26 14:20:52.671154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d62062f4-2f0d-44f0-9a5d-acfa76ab9cdd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:52.671604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d62062f4-2f0d-44f0-9a5d-acfa76ab9cdd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:52.673169 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1730/3328] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:52 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1488 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:52.673511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d62062f4-2f0d-44f0-9a5d-acfa76ab9cdd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:52.674185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d62062f4-2f0d-44f0-9a5d-acfa76ab9cdd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:52.707504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-157898f3-fa7e-406f-b0b0-662c4e70e0d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:52.715122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-157898f3-fa7e-406f-b0b0-662c4e70e0d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:52.734321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-157898f3-fa7e-406f-b0b0-662c4e70e0d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:52.736277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-157898f3-fa7e-406f-b0b0-662c4e70e0d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:52.738837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-157898f3-fa7e-406f-b0b0-662c4e70e0d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:52.753296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-157898f3-fa7e-406f-b0b0-662c4e70e0d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:53.226386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d62062f4-2f0d-44f0-9a5d-acfa76ab9cdd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:53.244682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d62062f4-2f0d-44f0-9a5d-acfa76ab9cdd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:53.248120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d62062f4-2f0d-44f0-9a5d-acfa76ab9cdd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:53.250786 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d62062f4-2f0d-44f0-9a5d-acfa76ab9cdd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.629832 Jul 26 14:20:53.252023 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1599/3329] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:52 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:20:53.277707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d186f0ac-09b8-4cf9-96ab-e964a809ec9b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:53.279241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d186f0ac-09b8-4cf9-96ab-e964a809ec9b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:53.289753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d186f0ac-09b8-4cf9-96ab-e964a809ec9b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:53.291638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d186f0ac-09b8-4cf9-96ab-e964a809ec9b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:53.293482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d186f0ac-09b8-4cf9-96ab-e964a809ec9b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:53.309602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d186f0ac-09b8-4cf9-96ab-e964a809ec9b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:53.323687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-157898f3-fa7e-406f-b0b0-662c4e70e0d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:53.377952 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-157898f3-fa7e-406f-b0b0-662c4e70e0d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1488 microversion: 2.1 time: 0.679608 Jul 26 14:20:53.386865 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1731/3330] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:52 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1488 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:53.428581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0b18dc82-0644-424c-b8d3-02fdec3aab41 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:53.429942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0b18dc82-0644-424c-b8d3-02fdec3aab41 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:53.455547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b18dc82-0644-424c-b8d3-02fdec3aab41 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:53.456455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b18dc82-0644-424c-b8d3-02fdec3aab41 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:53.457898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b18dc82-0644-424c-b8d3-02fdec3aab41 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:53.458717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b18dc82-0644-424c-b8d3-02fdec3aab41 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:54.028193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d186f0ac-09b8-4cf9-96ab-e964a809ec9b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:54.054993 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d186f0ac-09b8-4cf9-96ab-e964a809ec9b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1653 microversion: 2.1 time: 0.801502 Jul 26 14:20:54.058875 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1600/3331] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:53 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1653 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:54.066555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0b7ccf9c-c889-4d5c-93b2-dd9ddc955a7d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:54.067111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0b7ccf9c-c889-4d5c-93b2-dd9ddc955a7d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:54.089399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b7ccf9c-c889-4d5c-93b2-dd9ddc955a7d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:54.089860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b7ccf9c-c889-4d5c-93b2-dd9ddc955a7d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:54.090693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b7ccf9c-c889-4d5c-93b2-dd9ddc955a7d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:54.091078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b7ccf9c-c889-4d5c-93b2-dd9ddc955a7d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:54.130470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0b18dc82-0644-424c-b8d3-02fdec3aab41 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:54.145694 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0b18dc82-0644-424c-b8d3-02fdec3aab41 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1647 microversion: 2.1 time: 0.756133 Jul 26 14:20:54.149466 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1732/3332] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:53 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1647 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:54.164387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b1a9a09f-0595-44e5-bfc4-6dce2d457671 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:54.164387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b1a9a09f-0595-44e5-bfc4-6dce2d457671 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:54.190298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1a9a09f-0595-44e5-bfc4-6dce2d457671 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:54.190298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1a9a09f-0595-44e5-bfc4-6dce2d457671 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:54.190298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1a9a09f-0595-44e5-bfc4-6dce2d457671 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:54.190298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1a9a09f-0595-44e5-bfc4-6dce2d457671 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:54.353475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1a9a09f-0595-44e5-bfc4-6dce2d457671 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:54.370293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1a9a09f-0595-44e5-bfc4-6dce2d457671 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:54.372430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1a9a09f-0595-44e5-bfc4-6dce2d457671 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:54.379752 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b1a9a09f-0595-44e5-bfc4-6dce2d457671 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.230689 Jul 26 14:20:54.381124 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1733/3333] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:54 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:54.388831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b1d1b5c3-91a4-458c-8424-7110bd11eb4a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:54.410423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1d1b5c3-91a4-458c-8424-7110bd11eb4a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:54.411214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1d1b5c3-91a4-458c-8424-7110bd11eb4a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:54.471316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b1d1b5c3-91a4-458c-8424-7110bd11eb4a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Going to try to start instance {{(pid=119479) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 14:20:54.601540 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b1d1b5c3-91a4-458c-8424-7110bd11eb4a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/action" status: 202 len: 0 microversion: 2.1 time: 0.218895 Jul 26 14:20:54.605815 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1734/3334] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:20:54 2022] POST /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:54.615143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-84794588-c158-47ed-bb4b-41175c4189f9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:54.618112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-84794588-c158-47ed-bb4b-41175c4189f9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:54.637504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84794588-c158-47ed-bb4b-41175c4189f9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:54.638073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84794588-c158-47ed-bb4b-41175c4189f9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:54.639246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84794588-c158-47ed-bb4b-41175c4189f9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:54.639847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84794588-c158-47ed-bb4b-41175c4189f9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:54.683992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0b7ccf9c-c889-4d5c-93b2-dd9ddc955a7d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:54.694749 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0b7ccf9c-c889-4d5c-93b2-dd9ddc955a7d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1488 microversion: 2.1 time: 0.634634 Jul 26 14:20:54.695765 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1601/3335] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:54 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1488 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:54.711491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-abc4f879-8d3d-4922-b68b-fb80118f3ccd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:54.719639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-abc4f879-8d3d-4922-b68b-fb80118f3ccd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:54.740252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abc4f879-8d3d-4922-b68b-fb80118f3ccd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:54.747738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abc4f879-8d3d-4922-b68b-fb80118f3ccd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:54.749002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abc4f879-8d3d-4922-b68b-fb80118f3ccd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:54.749730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abc4f879-8d3d-4922-b68b-fb80118f3ccd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:55.752772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-abc4f879-8d3d-4922-b68b-fb80118f3ccd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:55.789523 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-abc4f879-8d3d-4922-b68b-fb80118f3ccd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1662 microversion: 2.1 time: 1.084315 Jul 26 14:20:55.790127 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1602/3336] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:54 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1662 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:55.848406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8c1c5022-0936-411d-be70-5536df500587 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:55.849083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8c1c5022-0936-411d-be70-5536df500587 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:55.864861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-84794588-c158-47ed-bb4b-41175c4189f9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:55.878870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-84794588-c158-47ed-bb4b-41175c4189f9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:55.880894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c1c5022-0936-411d-be70-5536df500587 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:55.881344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c1c5022-0936-411d-be70-5536df500587 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:55.882392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-84794588-c158-47ed-bb4b-41175c4189f9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:55.882709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c1c5022-0936-411d-be70-5536df500587 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:55.883394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c1c5022-0936-411d-be70-5536df500587 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:55.890496 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-84794588-c158-47ed-bb4b-41175c4189f9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 1.283262 Jul 26 14:20:55.892662 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1735/3337] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:54 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:55.913179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:55.921932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:55.934994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:55.936299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:55.937339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:55.938711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:55.982309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:55.983023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:55.983664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lazy-loading 'fault' on Instance uuid b3c2ca5f-2342-4538-a501-6bd7877bd044 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:20:55.986223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8c1c5022-0936-411d-be70-5536df500587 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:20:56.042031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:56.063625 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fea9df14-bdda-4757-8d38-632163ceec68 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 200 len: 1306 microversion: 2.1 time: 0.169092 Jul 26 14:20:56.064625 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1736/3338] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:55 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 1306 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:56.072923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-827ebcd5-7421-4cfc-a429-ffc5aa557eb9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:56.073825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-827ebcd5-7421-4cfc-a429-ffc5aa557eb9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:56.082897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-827ebcd5-7421-4cfc-a429-ffc5aa557eb9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:56.083693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-827ebcd5-7421-4cfc-a429-ffc5aa557eb9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:56.084684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-827ebcd5-7421-4cfc-a429-ffc5aa557eb9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:56.085322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-827ebcd5-7421-4cfc-a429-ffc5aa557eb9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:56.164900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:56.230292 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8c1c5022-0936-411d-be70-5536df500587 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 204 len: 0 microversion: 2.1 time: 0.438468 Jul 26 14:20:56.237806 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1603/3339] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:20:55 2022] DELETE /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:20:56.245183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-31169f14-880e-4ae2-9254-0634cb7b30df req-ca8f4077-fc14-4520-91a3-a44827faeae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c2ca5f-2342-4538-a501-6bd7877bd044", "name": "network-vif-deleted", "tag": "295ca1ce-51a5-4367-b0ed-b671809ee202"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:56.262604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-31169f14-880e-4ae2-9254-0634cb7b30df req-ca8f4077-fc14-4520-91a3-a44827faeae1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:56.263223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-31169f14-880e-4ae2-9254-0634cb7b30df req-ca8f4077-fc14-4520-91a3-a44827faeae1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:56.284918 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-31169f14-880e-4ae2-9254-0634cb7b30df req-ca8f4077-fc14-4520-91a3-a44827faeae1 service nova] Creating event network-vif-deleted:295ca1ce-51a5-4367-b0ed-b671809ee202 for instance b3c2ca5f-2342-4538-a501-6bd7877bd044 on n-h2-833090-9 Jul 26 14:20:56.293219 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-31169f14-880e-4ae2-9254-0634cb7b30df req-ca8f4077-fc14-4520-91a3-a44827faeae1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052694 Jul 26 14:20:56.294449 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1604/3340] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:56.304748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8fba6195-17bf-451b-9b09-6484f2fa4ff3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:56.305922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8fba6195-17bf-451b-9b09-6484f2fa4ff3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:56.317677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8fba6195-17bf-451b-9b09-6484f2fa4ff3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:56.318441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8fba6195-17bf-451b-9b09-6484f2fa4ff3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:56.320173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8fba6195-17bf-451b-9b09-6484f2fa4ff3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:56.321104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8fba6195-17bf-451b-9b09-6484f2fa4ff3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:56.721884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-827ebcd5-7421-4cfc-a429-ffc5aa557eb9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:56.823728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-827ebcd5-7421-4cfc-a429-ffc5aa557eb9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:56.826223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-827ebcd5-7421-4cfc-a429-ffc5aa557eb9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:56.849175 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-827ebcd5-7421-4cfc-a429-ffc5aa557eb9 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.762341 Jul 26 14:20:56.850167 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1737/3341] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:56 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:56.856189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-230561d4-f61d-46a3-9848-52827bf0416a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:56.862191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-230561d4-f61d-46a3-9848-52827bf0416a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:56.873931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-230561d4-f61d-46a3-9848-52827bf0416a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:56.875664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-230561d4-f61d-46a3-9848-52827bf0416a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:56.877303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-230561d4-f61d-46a3-9848-52827bf0416a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:56.877937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-230561d4-f61d-46a3-9848-52827bf0416a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:56.958379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8fba6195-17bf-451b-9b09-6484f2fa4ff3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:56.970752 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8fba6195-17bf-451b-9b09-6484f2fa4ff3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1494 microversion: 2.1 time: 0.672911 Jul 26 14:20:56.972320 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1605/3342] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:56 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1494 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:56.978933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c470ff09-8841-49cd-8efc-65953b238bd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:56.979790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c470ff09-8841-49cd-8efc-65953b238bd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:56.989494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c470ff09-8841-49cd-8efc-65953b238bd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:56.990235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c470ff09-8841-49cd-8efc-65953b238bd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:56.991361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c470ff09-8841-49cd-8efc-65953b238bd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:56.992120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c470ff09-8841-49cd-8efc-65953b238bd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:57.215925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-230561d4-f61d-46a3-9848-52827bf0416a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:57.220611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c470ff09-8841-49cd-8efc-65953b238bd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:57.225259 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-230561d4-f61d-46a3-9848-52827bf0416a tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1662 microversion: 2.1 time: 0.373579 Jul 26 14:20:57.225947 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1738/3343] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:56 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1662 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:57.230904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50e81ad1-42af-4b1b-8d5c-074cc3ff0d83 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:57.231659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-50e81ad1-42af-4b1b-8d5c-074cc3ff0d83 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:57.238893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50e81ad1-42af-4b1b-8d5c-074cc3ff0d83 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:57.239639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50e81ad1-42af-4b1b-8d5c-074cc3ff0d83 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:57.240776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50e81ad1-42af-4b1b-8d5c-074cc3ff0d83 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:57.241435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50e81ad1-42af-4b1b-8d5c-074cc3ff0d83 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:57.243145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c470ff09-8841-49cd-8efc-65953b238bd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:57.245714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c470ff09-8841-49cd-8efc-65953b238bd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:57.247095 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c470ff09-8841-49cd-8efc-65953b238bd9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.273126 Jul 26 14:20:57.260012 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1606/3344] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:56 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:57.269609 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-50e81ad1-42af-4b1b-8d5c-074cc3ff0d83 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50e81ad1-42af-4b1b-8d5c-074cc3ff0d83 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 HTTP/1.1 Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'b3c2ca5f-2342-4538-a501-6bd7877bd044'} Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:57.271943 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:57.281052 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:57.281052 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:57.281052 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:57.281052 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:57.281052 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:57.281052 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:57.281052 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:20:57.281052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50e81ad1-42af-4b1b-8d5c-074cc3ff0d83 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:57.281052 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-50e81ad1-42af-4b1b-8d5c-074cc3ff0d83 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 404 len: 111 microversion: 2.1 time: 0.046955 Jul 26 14:20:57.281052 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1739/3345] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:57 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:20:57.287664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6069d5c7-b5f2-47bc-ab05-815bfd40eb26 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f878799e1f0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:57.302723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed084c8e-3dea-4161-a905-db0932839210 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:57.303713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ed084c8e-3dea-4161-a905-db0932839210 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:57.317809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed084c8e-3dea-4161-a905-db0932839210 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:57.318669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed084c8e-3dea-4161-a905-db0932839210 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:57.320008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed084c8e-3dea-4161-a905-db0932839210 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:57.320811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed084c8e-3dea-4161-a905-db0932839210 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:57.630698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ed084c8e-3dea-4161-a905-db0932839210 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:57.645675 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed084c8e-3dea-4161-a905-db0932839210 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.346881 Jul 26 14:20:57.646636 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1740/3346] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:57 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:57.670199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3b2b15f1-6c14-41f0-be3b-833b05b580f2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:57.671560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3b2b15f1-6c14-41f0-be3b-833b05b580f2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:57.677709 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6069d5c7-b5f2-47bc-ab05-815bfd40eb26 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/a6b86a4f-d86b-4026-8c0e-b4828a12b692" status: 202 len: 0 microversion: 2.1 time: 0.396105 Jul 26 14:20:57.682519 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1607/3347] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:20:57 2022] DELETE /compute/v2.1/os-security-groups/a6b86a4f-d86b-4026-8c0e-b4828a12b692 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:57.687613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-28afecf1-e78a-41f7-9234-8cd77cf2e72f tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787610820>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:57.694725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b2b15f1-6c14-41f0-be3b-833b05b580f2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:57.700376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b2b15f1-6c14-41f0-be3b-833b05b580f2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:57.701665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b2b15f1-6c14-41f0-be3b-833b05b580f2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:57.702286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b2b15f1-6c14-41f0-be3b-833b05b580f2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:57.983220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3b2b15f1-6c14-41f0-be3b-833b05b580f2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:57.992438 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3b2b15f1-6c14-41f0-be3b-833b05b580f2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.327029 Jul 26 14:20:57.993397 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1741/3348] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:57 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:57.998312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3d7736f-1b8e-4491-bde2-ed5b458dd335 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:57.998931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3d7736f-1b8e-4491-bde2-ed5b458dd335 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:58.005839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3d7736f-1b8e-4491-bde2-ed5b458dd335 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.006561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3d7736f-1b8e-4491-bde2-ed5b458dd335 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.007544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3d7736f-1b8e-4491-bde2-ed5b458dd335 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.008198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3d7736f-1b8e-4491-bde2-ed5b458dd335 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.050998 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-28afecf1-e78a-41f7-9234-8cd77cf2e72f tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/94851e57-caeb-4064-bde9-aee66cf7337e" status: 202 len: 0 microversion: 2.1 time: 0.367039 Jul 26 14:20:58.051667 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1608/3349] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:20:57 2022] DELETE /compute/v2.1/os-security-groups/94851e57-caeb-4064-bde9-aee66cf7337e => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:20:58.057606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-78d50fe2-d033-402e-8acc-473e7b7d6052 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:58.058239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-78d50fe2-d033-402e-8acc-473e7b7d6052 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:58.069478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78d50fe2-d033-402e-8acc-473e7b7d6052 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.070108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78d50fe2-d033-402e-8acc-473e7b7d6052 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.070829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78d50fe2-d033-402e-8acc-473e7b7d6052 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.071288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78d50fe2-d033-402e-8acc-473e7b7d6052 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.095902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a3d7736f-1b8e-4491-bde2-ed5b458dd335 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:58.118210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a3d7736f-1b8e-4491-bde2-ed5b458dd335 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:58.119859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a3d7736f-1b8e-4491-bde2-ed5b458dd335 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:58.121907 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a3d7736f-1b8e-4491-bde2-ed5b458dd335 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.127303 Jul 26 14:20:58.122875 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1742/3350] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:57 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:58.128336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-825aba6e-e213-4d6b-937f-b35042e83d32 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:58.130317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-825aba6e-e213-4d6b-937f-b35042e83d32 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:58.141687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-825aba6e-e213-4d6b-937f-b35042e83d32 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.142149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-825aba6e-e213-4d6b-937f-b35042e83d32 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.142962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-825aba6e-e213-4d6b-937f-b35042e83d32 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.143411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-825aba6e-e213-4d6b-937f-b35042e83d32 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.339022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-78d50fe2-d033-402e-8acc-473e7b7d6052 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:58.352403 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-78d50fe2-d033-402e-8acc-473e7b7d6052 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1494 microversion: 2.1 time: 0.299583 Jul 26 14:20:58.353006 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1609/3351] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:58 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1494 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:58.364130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1017f099-aad7-4986-ad50-00f7ab347e55 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'create', calling method: .version_select at 0x7f878799e310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-912756457", "description": "tempest-description-218836326"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:58.373946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-825aba6e-e213-4d6b-937f-b35042e83d32 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:58.382704 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-825aba6e-e213-4d6b-937f-b35042e83d32 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.258475 Jul 26 14:20:58.393684 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1743/3352] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:58 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:58.409439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0d29d13-63c9-4ac6-884b-b0cdf6311c54 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:58.410531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0d29d13-63c9-4ac6-884b-b0cdf6311c54 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:58.418528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d29d13-63c9-4ac6-884b-b0cdf6311c54 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.419376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d29d13-63c9-4ac6-884b-b0cdf6311c54 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.420250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d29d13-63c9-4ac6-884b-b0cdf6311c54 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.420662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0d29d13-63c9-4ac6-884b-b0cdf6311c54 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.603077 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1017f099-aad7-4986-ad50-00f7ab347e55 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.248765 Jul 26 14:20:58.612233 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1610/3353] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:20:58 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:58.632364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-584a6c06-9f52-4ff0-91e9-5f9768756c63 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:58.633103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-584a6c06-9f52-4ff0-91e9-5f9768756c63 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:58.643178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-584a6c06-9f52-4ff0-91e9-5f9768756c63 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.643544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0d29d13-63c9-4ac6-884b-b0cdf6311c54 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:58.643782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-584a6c06-9f52-4ff0-91e9-5f9768756c63 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.644539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-584a6c06-9f52-4ff0-91e9-5f9768756c63 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.644986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-584a6c06-9f52-4ff0-91e9-5f9768756c63 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.655762 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0d29d13-63c9-4ac6-884b-b0cdf6311c54 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1662 microversion: 2.1 time: 0.255582 Jul 26 14:20:58.656995 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1744/3354] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:58 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1662 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:20:58.662099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b492bc4f-d26d-4d97-9dce-65f1f0e35d6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1427014485"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:58.664916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b492bc4f-d26d-4d97-9dce-65f1f0e35d6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:58.671557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b492bc4f-d26d-4d97-9dce-65f1f0e35d6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.672427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b492bc4f-d26d-4d97-9dce-65f1f0e35d6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.673785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b492bc4f-d26d-4d97-9dce-65f1f0e35d6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:58.674522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b492bc4f-d26d-4d97-9dce-65f1f0e35d6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:58.713980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:20:58.831662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-584a6c06-9f52-4ff0-91e9-5f9768756c63 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:58.857525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-584a6c06-9f52-4ff0-91e9-5f9768756c63 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:58.862918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-584a6c06-9f52-4ff0-91e9-5f9768756c63 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:58.867221 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-584a6c06-9f52-4ff0-91e9-5f9768756c63 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.251133 Jul 26 14:20:58.868168 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1611/3355] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:58 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:20:58.883832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b56ef6db-aa47-4705-9d1f-d7ba8d5c3813 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Action: 'update', calling method: .version_select at 0x7f87878b0d30>, body: {"security_group": {"name": "tempest-sg-hth-333312023", "description": "tempest-description-hth-2138125976"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:20:59.058119 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b492bc4f-d26d-4d97-9dce-65f1f0e35d6d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.399079 Jul 26 14:20:59.059112 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1745/3356] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:20:58 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 26 14:20:59.147322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f29f72f1-4d33-4d42-aa1d-cc5856cbc2a6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:59.148041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f29f72f1-4d33-4d42-aa1d-cc5856cbc2a6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:59.155301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f29f72f1-4d33-4d42-aa1d-cc5856cbc2a6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:59.155771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f29f72f1-4d33-4d42-aa1d-cc5856cbc2a6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:59.156634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f29f72f1-4d33-4d42-aa1d-cc5856cbc2a6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:59.157108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f29f72f1-4d33-4d42-aa1d-cc5856cbc2a6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:59.196432 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b56ef6db-aa47-4705-9d1f-d7ba8d5c3813 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "PUT /compute/v2.1/os-security-groups/00543c3c-ea35-40a5-af73-ab9ac4c73709" status: 200 len: 217 microversion: 2.1 time: 0.325380 Jul 26 14:20:59.198525 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1612/3357] 10.222.0.70 () {60 vars in 1290 bytes} [Tue Jul 26 14:20:58 2022] PUT /compute/v2.1/os-security-groups/00543c3c-ea35-40a5-af73-ab9ac4c73709 => generated 217 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:59.213803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32015f23-97df-43d4-8116-ca4b62d8a33d tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787857c10>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:59.252975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f29f72f1-4d33-4d42-aa1d-cc5856cbc2a6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:59.265337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f29f72f1-4d33-4d42-aa1d-cc5856cbc2a6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:59.267709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f29f72f1-4d33-4d42-aa1d-cc5856cbc2a6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:59.268692 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f29f72f1-4d33-4d42-aa1d-cc5856cbc2a6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.125588 Jul 26 14:20:59.280955 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1746/3358] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:59 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:20:59.306787 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32015f23-97df-43d4-8116-ca4b62d8a33d tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/00543c3c-ea35-40a5-af73-ab9ac4c73709" status: 200 len: 217 microversion: 2.1 time: 0.098624 Jul 26 14:20:59.307463 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1613/3359] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:20:59 2022] GET /compute/v2.1/os-security-groups/00543c3c-ea35-40a5-af73-ab9ac4c73709 => generated 217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:20:59.332260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a7fc5895-3534-4e90-a3ac-cd79499927d5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f87876bbf70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:59.379313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-79baaa09-3925-4d4c-9f7b-7d035e986394 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:59.380394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-79baaa09-3925-4d4c-9f7b-7d035e986394 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:59.393184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79baaa09-3925-4d4c-9f7b-7d035e986394 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:59.394493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79baaa09-3925-4d4c-9f7b-7d035e986394 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:59.396422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79baaa09-3925-4d4c-9f7b-7d035e986394 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:59.397203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79baaa09-3925-4d4c-9f7b-7d035e986394 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:59.738881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-79baaa09-3925-4d4c-9f7b-7d035e986394 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:20:59.748056 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-79baaa09-3925-4d4c-9f7b-7d035e986394 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1494 microversion: 2.1 time: 0.376047 Jul 26 14:20:59.748705 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a7fc5895-3534-4e90-a3ac-cd79499927d5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/00543c3c-ea35-40a5-af73-ab9ac4c73709" status: 202 len: 0 microversion: 2.1 time: 0.424213 Jul 26 14:20:59.749574 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1747/3360] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:20:59 2022] DELETE /compute/v2.1/os-security-groups/00543c3c-ea35-40a5-af73-ab9ac4c73709 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:20:59.757407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-80bf905e-77e6-468f-a212-c796e3c5ec61 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:59.758370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-80bf905e-77e6-468f-a212-c796e3c5ec61 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:59.760325 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1614/3361] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:59 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1494 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:20:59.768546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b86d7edd-ac5f-46f4-8d04-9a9361ae9b16 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:59.769374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b86d7edd-ac5f-46f4-8d04-9a9361ae9b16 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:59.777386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80bf905e-77e6-468f-a212-c796e3c5ec61 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:59.778009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80bf905e-77e6-468f-a212-c796e3c5ec61 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:59.778971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b86d7edd-ac5f-46f4-8d04-9a9361ae9b16 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:59.779183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80bf905e-77e6-468f-a212-c796e3c5ec61 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:59.779754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b86d7edd-ac5f-46f4-8d04-9a9361ae9b16 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:59.780069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80bf905e-77e6-468f-a212-c796e3c5ec61 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:59.781081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b86d7edd-ac5f-46f4-8d04-9a9361ae9b16 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:59.782041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b86d7edd-ac5f-46f4-8d04-9a9361ae9b16 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:59.814442 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b86d7edd-ac5f-46f4-8d04-9a9361ae9b16 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b86d7edd-ac5f-46f4-8d04-9a9361ae9b16 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 HTTP/1.1 Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'b3c2ca5f-2342-4538-a501-6bd7877bd044'} Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:20:59.816206 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b86d7edd-ac5f-46f4-8d04-9a9361ae9b16 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b86d7edd-ac5f-46f4-8d04-9a9361ae9b16 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 404 len: 111 microversion: 2.1 time: 0.056031 Jul 26 14:20:59.821782 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1615/3362] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:20:59 2022] DELETE /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:20:59.828132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7f1dce78-51af-4af4-8065-e5fab15b732e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:59.829066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7f1dce78-51af-4af4-8065-e5fab15b732e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: b3c2ca5f-2342-4538-a501-6bd7877bd044] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:20:59.835453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f1dce78-51af-4af4-8065-e5fab15b732e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:59.836444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f1dce78-51af-4af4-8065-e5fab15b732e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:59.837407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f1dce78-51af-4af4-8065-e5fab15b732e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:20:59.840130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f1dce78-51af-4af4-8065-e5fab15b732e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:20:59.856882 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-7f1dce78-51af-4af4-8065-e5fab15b732e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7f1dce78-51af-4af4-8065-e5fab15b732e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 HTTP/1.1 Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'b3c2ca5f-2342-4538-a501-6bd7877bd044'} Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:59.860347 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.866086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:59.866086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:59.866086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:59.866086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:59.866086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:59.866086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. Jul 26 14:20:59.866086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.867533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7f1dce78-51af-4af4-8065-e5fab15b732e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Instance b3c2ca5f-2342-4538-a501-6bd7877bd044 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:59.869002 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7f1dce78-51af-4af4-8065-e5fab15b732e tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044" status: 404 len: 111 microversion: 2.1 time: 0.044777 Jul 26 14:20:59.870685 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1616/3363] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:59 2022] GET /compute/v2.1/servers/b3c2ca5f-2342-4538-a501-6bd7877bd044 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:20:59.883144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da140d3d-9658-46d9-bfdb-85c35f928d63 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787e8faf0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:20:59.970633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-da140d3d-9658-46d9-bfdb-85c35f928d63 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 94851e57-caeb-4064-bde9-aee66cf7337e does not exist", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:20:59.971468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.security_group_api [None req-da140d3d-9658-46d9-bfdb-85c35f928d63 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Neutron security group 94851e57-caeb-4064-bde9-aee66cf7337e not found {{(pid=119478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:20:59.972730 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-da140d3d-9658-46d9-bfdb-85c35f928d63 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security group 94851e57-caeb-4064-bde9-aee66cf7337e does not exist Jul 26 14:20:59.972730 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-763aac08-44b5-4aad-976c-1f56ff53ea28'] Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da140d3d-9658-46d9-bfdb-85c35f928d63 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-security-groups/94851e57-caeb-4064-bde9-aee66cf7337e HTTP/1.1 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: exception: Security group 94851e57-caeb-4064-bde9-aee66cf7337e does not exist Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-763aac08-44b5-4aad-976c-1f56ff53ea28'] Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '94851e57-caeb-4064-bde9-aee66cf7337e'} Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:20:59.974932 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 94851e57-caeb-4064-bde9-aee66cf7337e does not exist Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-763aac08-44b5-4aad-976c-1f56ff53ea28'] Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 94851e57-caeb-4064-bde9-aee66cf7337e does not exist Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-763aac08-44b5-4aad-976c-1f56ff53ea28'] Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 94851e57-caeb-4064-bde9-aee66cf7337e does not exist Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-763aac08-44b5-4aad-976c-1f56ff53ea28'] Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 94851e57-caeb-4064-bde9-aee66cf7337e does not exist Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-763aac08-44b5-4aad-976c-1f56ff53ea28'] Jul 26 14:20:59.980688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:20:59.986707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da140d3d-9658-46d9-bfdb-85c35f928d63 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Security group 94851e57-caeb-4064-bde9-aee66cf7337e does not exist Jul 26 14:20:59.986707 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-763aac08-44b5-4aad-976c-1f56ff53ea28'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:20:59.988109 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-da140d3d-9658-46d9-bfdb-85c35f928d63 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/94851e57-caeb-4064-bde9-aee66cf7337e" status: 404 len: 194 microversion: 2.1 time: 0.113132 Jul 26 14:20:59.992206 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1617/3364] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:20:59 2022] DELETE /compute/v2.1/os-security-groups/94851e57-caeb-4064-bde9-aee66cf7337e => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:00.006231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-744d0698-718b-40b6-aafd-9f032899de83 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:00.006862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-744d0698-718b-40b6-aafd-9f032899de83 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:00.028683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-744d0698-718b-40b6-aafd-9f032899de83 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:00.030688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-744d0698-718b-40b6-aafd-9f032899de83 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:00.034342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-744d0698-718b-40b6-aafd-9f032899de83 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:00.034822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-744d0698-718b-40b6-aafd-9f032899de83 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:00.159060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-80bf905e-77e6-468f-a212-c796e3c5ec61 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:00.174321 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-80bf905e-77e6-468f-a212-c796e3c5ec61 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1662 microversion: 2.1 time: 0.422467 Jul 26 14:21:00.175376 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1748/3365] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:20:59 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1662 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:00.198366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4296725d-f768-4f50-86b5-71961a9bea03 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787fe2820>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:00.237052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-4296725d-f768-4f50-86b5-71961a9bea03 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a6b86a4f-d86b-4026-8c0e-b4828a12b692 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:21:00.238414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-4296725d-f768-4f50-86b5-71961a9bea03 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Neutron security group a6b86a4f-d86b-4026-8c0e-b4828a12b692 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:21:00.239686 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-4296725d-f768-4f50-86b5-71961a9bea03 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security group a6b86a4f-d86b-4026-8c0e-b4828a12b692 does not exist Jul 26 14:21:00.239686 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-e4b4a2b6-5535-4e23-b3c4-a9e2fe6a52c4'] Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4296725d-f768-4f50-86b5-71961a9bea03 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-security-groups/a6b86a4f-d86b-4026-8c0e-b4828a12b692 HTTP/1.1 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group a6b86a4f-d86b-4026-8c0e-b4828a12b692 does not exist Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-e4b4a2b6-5535-4e23-b3c4-a9e2fe6a52c4'] Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'a6b86a4f-d86b-4026-8c0e-b4828a12b692'} Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:21:00.243660 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a6b86a4f-d86b-4026-8c0e-b4828a12b692 does not exist Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b4a2b6-5535-4e23-b3c4-a9e2fe6a52c4'] Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a6b86a4f-d86b-4026-8c0e-b4828a12b692 does not exist Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b4a2b6-5535-4e23-b3c4-a9e2fe6a52c4'] Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a6b86a4f-d86b-4026-8c0e-b4828a12b692 does not exist Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b4a2b6-5535-4e23-b3c4-a9e2fe6a52c4'] Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a6b86a4f-d86b-4026-8c0e-b4828a12b692 does not exist Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4b4a2b6-5535-4e23-b3c4-a9e2fe6a52c4'] Jul 26 14:21:00.253375 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.264502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4296725d-f768-4f50-86b5-71961a9bea03 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Security group a6b86a4f-d86b-4026-8c0e-b4828a12b692 does not exist Jul 26 14:21:00.264502 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-e4b4a2b6-5535-4e23-b3c4-a9e2fe6a52c4'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:00.264502 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4296725d-f768-4f50-86b5-71961a9bea03 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/a6b86a4f-d86b-4026-8c0e-b4828a12b692" status: 404 len: 194 microversion: 2.1 time: 0.072374 Jul 26 14:21:00.265265 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1749/3366] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:21:00 2022] DELETE /compute/v2.1/os-security-groups/a6b86a4f-d86b-4026-8c0e-b4828a12b692 => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:00.277852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3e8b66b6-1f38-4a47-a392-28bb64d36105 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8794619790>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:00.290350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-744d0698-718b-40b6-aafd-9f032899de83 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:00.305827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-744d0698-718b-40b6-aafd-9f032899de83 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:00.308434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-744d0698-718b-40b6-aafd-9f032899de83 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:00.309859 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-744d0698-718b-40b6-aafd-9f032899de83 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.316385 Jul 26 14:21:00.310419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-3e8b66b6-1f38-4a47-a392-28bb64d36105 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:21:00.310927 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1618/3367] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:20:59 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:00.311519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-3e8b66b6-1f38-4a47-a392-28bb64d36105 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Neutron security group a89b51da-1fd2-4f99-a369-1e79318de775 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:21:00.312265 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-3e8b66b6-1f38-4a47-a392-28bb64d36105 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:21:00.312265 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-1e1ed9ae-897c-40ae-b8e3-eb212aeb35bf'] Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3e8b66b6-1f38-4a47-a392-28bb64d36105 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-security-groups/a89b51da-1fd2-4f99-a369-1e79318de775 HTTP/1.1 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-1e1ed9ae-897c-40ae-b8e3-eb212aeb35bf'] Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'a89b51da-1fd2-4f99-a369-1e79318de775'} Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:21:00.314942 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e1ed9ae-897c-40ae-b8e3-eb212aeb35bf'] Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e1ed9ae-897c-40ae-b8e3-eb212aeb35bf'] Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e1ed9ae-897c-40ae-b8e3-eb212aeb35bf'] Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e1ed9ae-897c-40ae-b8e3-eb212aeb35bf'] Jul 26 14:21:00.319819 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.327444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-40ba3d7a-3be9-4f7f-a154-7635e886a406 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:00.327444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-40ba3d7a-3be9-4f7f-a154-7635e886a406 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:00.327841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3e8b66b6-1f38-4a47-a392-28bb64d36105 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Security group a89b51da-1fd2-4f99-a369-1e79318de775 does not exist Jul 26 14:21:00.327841 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-1e1ed9ae-897c-40ae-b8e3-eb212aeb35bf'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:00.327841 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3e8b66b6-1f38-4a47-a392-28bb64d36105 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/a89b51da-1fd2-4f99-a369-1e79318de775" status: 404 len: 194 microversion: 2.1 time: 0.057518 Jul 26 14:21:00.330238 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1750/3368] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:21:00 2022] DELETE /compute/v2.1/os-security-groups/a89b51da-1fd2-4f99-a369-1e79318de775 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:00.336416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40ba3d7a-3be9-4f7f-a154-7635e886a406 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:00.337150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40ba3d7a-3be9-4f7f-a154-7635e886a406 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:00.338112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40ba3d7a-3be9-4f7f-a154-7635e886a406 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:00.338731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40ba3d7a-3be9-4f7f-a154-7635e886a406 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:00.338901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d3a8f4cd-28e8-4676-87a8-423c7f485357 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f87992c28b0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:00.366814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-d3a8f4cd-28e8-4676-87a8-423c7f485357 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:21:00.367861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-d3a8f4cd-28e8-4676-87a8-423c7f485357 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Neutron security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:21:00.369546 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d3a8f4cd-28e8-4676-87a8-423c7f485357 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:21:00.369546 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-0154a5e2-d10d-4c71-9ebd-1dc005458223'] Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d3a8f4cd-28e8-4676-87a8-423c7f485357 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-security-groups/ee79c273-b5fb-4a01-ac54-8d739f626ae7 HTTP/1.1 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-0154a5e2-d10d-4c71-9ebd-1dc005458223'] Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'ee79c273-b5fb-4a01-ac54-8d739f626ae7'} Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:21:00.371494 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0154a5e2-d10d-4c71-9ebd-1dc005458223'] Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0154a5e2-d10d-4c71-9ebd-1dc005458223'] Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0154a5e2-d10d-4c71-9ebd-1dc005458223'] Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0154a5e2-d10d-4c71-9ebd-1dc005458223'] Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d3a8f4cd-28e8-4676-87a8-423c7f485357 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Security group ee79c273-b5fb-4a01-ac54-8d739f626ae7 does not exist Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-0154a5e2-d10d-4c71-9ebd-1dc005458223'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d3a8f4cd-28e8-4676-87a8-423c7f485357 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/ee79c273-b5fb-4a01-ac54-8d739f626ae7" status: 404 len: 194 microversion: 2.1 time: 0.039115 Jul 26 14:21:00.382425 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1751/3369] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:21:00 2022] DELETE /compute/v2.1/os-security-groups/ee79c273-b5fb-4a01-ac54-8d739f626ae7 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:21:00.390578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f5fe4de1-51c2-456a-b51d-50a2f1e3c5dc tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8794061820>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:00.474819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-f5fe4de1-51c2-456a-b51d-50a2f1e3c5dc tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:21:00.478387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-40ba3d7a-3be9-4f7f-a154-7635e886a406 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:00.480218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-f5fe4de1-51c2-456a-b51d-50a2f1e3c5dc tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Neutron security group bb9e12cb-f023-470a-ba5e-7b4906832d17 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:21:00.481580 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-f5fe4de1-51c2-456a-b51d-50a2f1e3c5dc tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:21:00.481580 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-c7550d35-6dea-4bd3-8037-0a1a944c1917'] Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f5fe4de1-51c2-456a-b51d-50a2f1e3c5dc tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-security-groups/bb9e12cb-f023-470a-ba5e-7b4906832d17 HTTP/1.1 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-c7550d35-6dea-4bd3-8037-0a1a944c1917'] Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'bb9e12cb-f023-470a-ba5e-7b4906832d17'} Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:21:00.484461 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7550d35-6dea-4bd3-8037-0a1a944c1917'] Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7550d35-6dea-4bd3-8037-0a1a944c1917'] Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7550d35-6dea-4bd3-8037-0a1a944c1917'] Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7550d35-6dea-4bd3-8037-0a1a944c1917'] Jul 26 14:21:00.489668 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.492081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-40ba3d7a-3be9-4f7f-a154-7635e886a406 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:00.492081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-40ba3d7a-3be9-4f7f-a154-7635e886a406 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:00.492081 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-40ba3d7a-3be9-4f7f-a154-7635e886a406 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.179351 Jul 26 14:21:00.494466 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1619/3370] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:00 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:00.495425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f5fe4de1-51c2-456a-b51d-50a2f1e3c5dc tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Security group bb9e12cb-f023-470a-ba5e-7b4906832d17 does not exist Jul 26 14:21:00.495425 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-c7550d35-6dea-4bd3-8037-0a1a944c1917'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:00.496360 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f5fe4de1-51c2-456a-b51d-50a2f1e3c5dc tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/bb9e12cb-f023-470a-ba5e-7b4906832d17" status: 404 len: 194 microversion: 2.1 time: 0.118089 Jul 26 14:21:00.496923 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1752/3371] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:21:00 2022] DELETE /compute/v2.1/os-security-groups/bb9e12cb-f023-470a-ba5e-7b4906832d17 => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:00.512376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71594a25-306d-4e51-959f-3b2ad1bde6a4 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f8787610b80>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:00.539502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-71594a25-306d-4e51-959f-3b2ad1bde6a4 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:21:00.541674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.security_group_api [None req-71594a25-306d-4e51-959f-3b2ad1bde6a4 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Neutron security group c2977099-e7f4-4a6b-b79c-2051927eafa1 not found {{(pid=119478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:21:00.542582 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-71594a25-306d-4e51-959f-3b2ad1bde6a4 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:21:00.542582 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-de7fcdcd-be30-4a1e-b107-8a47cfca6f86'] Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71594a25-306d-4e51-959f-3b2ad1bde6a4 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-security-groups/c2977099-e7f4-4a6b-b79c-2051927eafa1 HTTP/1.1 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: exception: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-de7fcdcd-be30-4a1e-b107-8a47cfca6f86'] Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c2977099-e7f4-4a6b-b79c-2051927eafa1'} Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:21:00.545136 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de7fcdcd-be30-4a1e-b107-8a47cfca6f86'] Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de7fcdcd-be30-4a1e-b107-8a47cfca6f86'] Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de7fcdcd-be30-4a1e-b107-8a47cfca6f86'] Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de7fcdcd-be30-4a1e-b107-8a47cfca6f86'] Jul 26 14:21:00.549912 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:00.555477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71594a25-306d-4e51-959f-3b2ad1bde6a4 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Security group c2977099-e7f4-4a6b-b79c-2051927eafa1 does not exist Jul 26 14:21:00.555477 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-de7fcdcd-be30-4a1e-b107-8a47cfca6f86'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:00.555477 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-71594a25-306d-4e51-959f-3b2ad1bde6a4 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c2977099-e7f4-4a6b-b79c-2051927eafa1" status: 404 len: 194 microversion: 2.1 time: 0.043037 Jul 26 14:21:00.557104 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1620/3372] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:21:00 2022] DELETE /compute/v2.1/os-security-groups/c2977099-e7f4-4a6b-b79c-2051927eafa1 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:00.567916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-839e6b4c-6e61-4c56-ae6f-30cfccd95943 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:00.568542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-839e6b4c-6e61-4c56-ae6f-30cfccd95943 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:00.577272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-839e6b4c-6e61-4c56-ae6f-30cfccd95943 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:00.578131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-839e6b4c-6e61-4c56-ae6f-30cfccd95943 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:00.580098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-839e6b4c-6e61-4c56-ae6f-30cfccd95943 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:00.581005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-839e6b4c-6e61-4c56-ae6f-30cfccd95943 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:00.614300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-839e6b4c-6e61-4c56-ae6f-30cfccd95943 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:21:00.774369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea81398f-3549-4404-adcc-0807f8e955f7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:00.775143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ea81398f-3549-4404-adcc-0807f8e955f7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:00.794195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea81398f-3549-4404-adcc-0807f8e955f7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:00.794591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea81398f-3549-4404-adcc-0807f8e955f7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:00.795613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea81398f-3549-4404-adcc-0807f8e955f7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:00.796256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea81398f-3549-4404-adcc-0807f8e955f7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:00.797976 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-839e6b4c-6e61-4c56-ae6f-30cfccd95943 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 204 len: 0 microversion: 2.1 time: 0.239594 Jul 26 14:21:00.808314 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1753/3373] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:21:00 2022] DELETE /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:21:00.817606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a631aad9-ef0f-4b3d-b883-8f1c7a59eef9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:00.818901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a631aad9-ef0f-4b3d-b883-8f1c7a59eef9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:00.834173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a631aad9-ef0f-4b3d-b883-8f1c7a59eef9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:00.836271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a631aad9-ef0f-4b3d-b883-8f1c7a59eef9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:00.840568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a631aad9-ef0f-4b3d-b883-8f1c7a59eef9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:00.841440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a631aad9-ef0f-4b3d-b883-8f1c7a59eef9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:01.025922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ea81398f-3549-4404-adcc-0807f8e955f7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:01.048859 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ea81398f-3549-4404-adcc-0807f8e955f7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1452 microversion: 2.1 time: 0.269835 Jul 26 14:21:01.051633 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1621/3374] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:00 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1452 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:01.078008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a9ff00bd-f171-4c0a-a7bd-1a238d0eb3d1 req-8b392546-5315-4813-a8c4-083ab9ccc49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79a8dbc-470b-4488-aea7-124183a070dd", "name": "network-vif-deleted", "tag": "6c48c417-9053-4059-a30f-a2fba0f7ced1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:01.108999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a9ff00bd-f171-4c0a-a7bd-1a238d0eb3d1 req-8b392546-5315-4813-a8c4-083ab9ccc49f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:01.109497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a9ff00bd-f171-4c0a-a7bd-1a238d0eb3d1 req-8b392546-5315-4813-a8c4-083ab9ccc49f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:01.141654 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a9ff00bd-f171-4c0a-a7bd-1a238d0eb3d1 req-8b392546-5315-4813-a8c4-083ab9ccc49f service nova] Creating event network-vif-deleted:6c48c417-9053-4059-a30f-a2fba0f7ced1 for instance d79a8dbc-470b-4488-aea7-124183a070dd on n-h1-833090-9 Jul 26 14:21:01.150880 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a9ff00bd-f171-4c0a-a7bd-1a238d0eb3d1 req-8b392546-5315-4813-a8c4-083ab9ccc49f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095989 Jul 26 14:21:01.157871 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1622/3375] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:01.206887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a1ecddb1-ded4-4919-b93d-b567b217a656 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:01.211229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a1ecddb1-ded4-4919-b93d-b567b217a656 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:01.231293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1ecddb1-ded4-4919-b93d-b567b217a656 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:01.232023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1ecddb1-ded4-4919-b93d-b567b217a656 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:01.233031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1ecddb1-ded4-4919-b93d-b567b217a656 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:01.233664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1ecddb1-ded4-4919-b93d-b567b217a656 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:01.306418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a631aad9-ef0f-4b3d-b883-8f1c7a59eef9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:01.316633 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a631aad9-ef0f-4b3d-b883-8f1c7a59eef9 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1646 microversion: 2.1 time: 0.503969 Jul 26 14:21:01.318013 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1754/3376] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:00 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1646 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:01.361767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba462ef4-3a6d-4051-b96c-09402e16b0c5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:01.364697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba462ef4-3a6d-4051-b96c-09402e16b0c5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:01.377041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba462ef4-3a6d-4051-b96c-09402e16b0c5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:01.377867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba462ef4-3a6d-4051-b96c-09402e16b0c5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:01.378904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba462ef4-3a6d-4051-b96c-09402e16b0c5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:01.379561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba462ef4-3a6d-4051-b96c-09402e16b0c5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:01.557428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a1ecddb1-ded4-4919-b93d-b567b217a656 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:01.576416 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a1ecddb1-ded4-4919-b93d-b567b217a656 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1662 microversion: 2.1 time: 0.376647 Jul 26 14:21:01.595906 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1623/3377] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:01 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1662 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:01.601466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d5c189d8-ed3c-47d3-aca1-020340efcd90 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:01.602516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d5c189d8-ed3c-47d3-aca1-020340efcd90 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:01.611452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5c189d8-ed3c-47d3-aca1-020340efcd90 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:01.612640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5c189d8-ed3c-47d3-aca1-020340efcd90 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:01.614493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba462ef4-3a6d-4051-b96c-09402e16b0c5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:01.617186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5c189d8-ed3c-47d3-aca1-020340efcd90 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:01.617832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5c189d8-ed3c-47d3-aca1-020340efcd90 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:01.628002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba462ef4-3a6d-4051-b96c-09402e16b0c5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:01.628002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba462ef4-3a6d-4051-b96c-09402e16b0c5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:01.628388 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba462ef4-3a6d-4051-b96c-09402e16b0c5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.293536 Jul 26 14:21:01.628892 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1755/3378] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:01 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:01.726273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5c189d8-ed3c-47d3-aca1-020340efcd90 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:01.738002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5c189d8-ed3c-47d3-aca1-020340efcd90 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:01.739687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5c189d8-ed3c-47d3-aca1-020340efcd90 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:01.742743 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d5c189d8-ed3c-47d3-aca1-020340efcd90 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.145158 Jul 26 14:21:01.743671 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1624/3379] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:01 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:02.087865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4def63a-4b9a-4b7f-8b55-e0eef3684393 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:02.092021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e4def63a-4b9a-4b7f-8b55-e0eef3684393 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:02.109851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:02.112656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4def63a-4b9a-4b7f-8b55-e0eef3684393 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:02.113555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4def63a-4b9a-4b7f-8b55-e0eef3684393 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:02.114394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4def63a-4b9a-4b7f-8b55-e0eef3684393 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:02.114908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4def63a-4b9a-4b7f-8b55-e0eef3684393 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:02.311364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e4def63a-4b9a-4b7f-8b55-e0eef3684393 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:02.327358 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4def63a-4b9a-4b7f-8b55-e0eef3684393 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 200 len: 1452 microversion: 2.1 time: 0.249204 Jul 26 14:21:02.340654 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1756/3380] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:02 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 1452 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:02.355037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fb8efc9d-80d5-4d24-8daf-3c8ef96714a5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:02.357062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fb8efc9d-80d5-4d24-8daf-3c8ef96714a5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:02.373004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb8efc9d-80d5-4d24-8daf-3c8ef96714a5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:02.373823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb8efc9d-80d5-4d24-8daf-3c8ef96714a5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:02.375047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb8efc9d-80d5-4d24-8daf-3c8ef96714a5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:02.376057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb8efc9d-80d5-4d24-8daf-3c8ef96714a5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:02.601741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-52429d7d-be28-4b77-9773-d2d12147a473 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:02.602385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-52429d7d-be28-4b77-9773-d2d12147a473 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:02.619902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52429d7d-be28-4b77-9773-d2d12147a473 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:02.620518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52429d7d-be28-4b77-9773-d2d12147a473 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:02.621522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52429d7d-be28-4b77-9773-d2d12147a473 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:02.622136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52429d7d-be28-4b77-9773-d2d12147a473 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:02.714236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb8efc9d-80d5-4d24-8daf-3c8ef96714a5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:02.725454 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fb8efc9d-80d5-4d24-8daf-3c8ef96714a5 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1646 microversion: 2.1 time: 0.375042 Jul 26 14:21:02.740045 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1625/3381] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:02 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1646 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:02.740045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da2eb01f-5cc4-489f-948c-b6a358b846d7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:02.740045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-da2eb01f-5cc4-489f-948c-b6a358b846d7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:02.741006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da2eb01f-5cc4-489f-948c-b6a358b846d7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:02.741471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da2eb01f-5cc4-489f-948c-b6a358b846d7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:02.742364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da2eb01f-5cc4-489f-948c-b6a358b846d7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:02.742920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da2eb01f-5cc4-489f-948c-b6a358b846d7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:02.899124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-52429d7d-be28-4b77-9773-d2d12147a473 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:02.909204 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-52429d7d-be28-4b77-9773-d2d12147a473 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1662 microversion: 2.1 time: 0.311549 Jul 26 14:21:02.921036 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1757/3382] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:02 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1662 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:02.931429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2f878d07-69d8-485d-b358-041bc96a1894 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:02.932405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2f878d07-69d8-485d-b358-041bc96a1894 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:02.939774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f878d07-69d8-485d-b358-041bc96a1894 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:02.940392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f878d07-69d8-485d-b358-041bc96a1894 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:02.941005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-da2eb01f-5cc4-489f-948c-b6a358b846d7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:02.941686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f878d07-69d8-485d-b358-041bc96a1894 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:02.942174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f878d07-69d8-485d-b358-041bc96a1894 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:02.950396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-da2eb01f-5cc4-489f-948c-b6a358b846d7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:02.955226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-da2eb01f-5cc4-489f-948c-b6a358b846d7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:02.957530 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-da2eb01f-5cc4-489f-948c-b6a358b846d7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.229590 Jul 26 14:21:02.959288 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1626/3383] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:02 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:03.038410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2f878d07-69d8-485d-b358-041bc96a1894 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:03.052827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2f878d07-69d8-485d-b358-041bc96a1894 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:03.054434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2f878d07-69d8-485d-b358-041bc96a1894 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:03.055682 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2f878d07-69d8-485d-b358-041bc96a1894 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.133182 Jul 26 14:21:03.061969 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1758/3384] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:02 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:03.359219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a3338d0f-8bd4-47e6-bad1-115a0a93ef97 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:03.361087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a3338d0f-8bd4-47e6-bad1-115a0a93ef97 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:03.380999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3338d0f-8bd4-47e6-bad1-115a0a93ef97 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:03.385272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3338d0f-8bd4-47e6-bad1-115a0a93ef97 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:03.388644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3338d0f-8bd4-47e6-bad1-115a0a93ef97 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:03.389571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3338d0f-8bd4-47e6-bad1-115a0a93ef97 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:03.426454 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-a3338d0f-8bd4-47e6-bad1-115a0a93ef97 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a3338d0f-8bd4-47e6-bad1-115a0a93ef97 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd HTTP/1.1 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd79a8dbc-470b-4488-aea7-124183a070dd'} Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:03.428625 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:03.434929 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:03.434929 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:03.434929 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:03.434929 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:03.434929 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:21:03.434929 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:03.438606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a3338d0f-8bd4-47e6-bad1-115a0a93ef97 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:03.443745 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a3338d0f-8bd4-47e6-bad1-115a0a93ef97 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 404 len: 111 microversion: 2.1 time: 0.092746 Jul 26 14:21:03.449907 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1627/3385] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:03 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:03.455918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1288a37b-6179-4b0c-878e-e413fa1c7aa6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:03.459917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1288a37b-6179-4b0c-878e-e413fa1c7aa6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:03.482974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1288a37b-6179-4b0c-878e-e413fa1c7aa6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:03.492447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1288a37b-6179-4b0c-878e-e413fa1c7aa6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:03.493876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1288a37b-6179-4b0c-878e-e413fa1c7aa6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:03.494571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1288a37b-6179-4b0c-878e-e413fa1c7aa6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:03.574445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1288a37b-6179-4b0c-878e-e413fa1c7aa6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:21:03.756458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-df4998f2-fe60-4fed-8106-269001f99edd tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:03.757108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-df4998f2-fe60-4fed-8106-269001f99edd tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:03.779215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df4998f2-fe60-4fed-8106-269001f99edd tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:03.781453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df4998f2-fe60-4fed-8106-269001f99edd tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:03.785461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df4998f2-fe60-4fed-8106-269001f99edd tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:03.785951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df4998f2-fe60-4fed-8106-269001f99edd tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:03.815678 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1288a37b-6179-4b0c-878e-e413fa1c7aa6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 204 len: 0 microversion: 2.1 time: 0.365184 Jul 26 14:21:03.821256 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1759/3386] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:21:03 2022] DELETE /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:21:03.834133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-42936573-6ce4-402e-aecf-8b358a583f85 req-a521393d-54ef-49e9-b6ec-2705503fea5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9bd635b-0eae-4f59-8e28-d6d034cdb159", "name": "network-vif-deleted", "tag": "22a590f7-4427-4dc1-8d35-fc64edb623f6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:03.883109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-42936573-6ce4-402e-aecf-8b358a583f85 req-a521393d-54ef-49e9-b6ec-2705503fea5b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:03.886005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-42936573-6ce4-402e-aecf-8b358a583f85 req-a521393d-54ef-49e9-b6ec-2705503fea5b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:03.892792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-df4998f2-fe60-4fed-8106-269001f99edd tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16cfc68b1ac347fe95e06e60e8b5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e27de07dc204a298c0279a365842602', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:03.905209 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-df4998f2-fe60-4fed-8106-269001f99edd tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 200 len: 1467 microversion: 2.1 time: 0.159206 Jul 26 14:21:03.907733 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1628/3387] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:03 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 1467 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:03.920317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca9e3d9b-3c1b-40f4-b316-cb91a4bf6df9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:03.926681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ca9e3d9b-3c1b-40f4-b316-cb91a4bf6df9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:03.935811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca9e3d9b-3c1b-40f4-b316-cb91a4bf6df9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:03.936666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca9e3d9b-3c1b-40f4-b316-cb91a4bf6df9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:03.937835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca9e3d9b-3c1b-40f4-b316-cb91a4bf6df9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:03.938847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca9e3d9b-3c1b-40f4-b316-cb91a4bf6df9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:03.952761 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-42936573-6ce4-402e-aecf-8b358a583f85 req-a521393d-54ef-49e9-b6ec-2705503fea5b service nova] Creating event network-vif-deleted:22a590f7-4427-4dc1-8d35-fc64edb623f6 for instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 on n-h1-833090-9 Jul 26 14:21:03.991319 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-42936573-6ce4-402e-aecf-8b358a583f85 req-a521393d-54ef-49e9-b6ec-2705503fea5b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158347 Jul 26 14:21:03.994721 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1760/3388] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:04.033371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-40f8e34c-58e4-43e1-8b68-eca689667e58 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:04.039710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-40f8e34c-58e4-43e1-8b68-eca689667e58 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:04.065992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40f8e34c-58e4-43e1-8b68-eca689667e58 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:04.067137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40f8e34c-58e4-43e1-8b68-eca689667e58 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:04.069655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40f8e34c-58e4-43e1-8b68-eca689667e58 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:04.070751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40f8e34c-58e4-43e1-8b68-eca689667e58 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:04.435013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ca9e3d9b-3c1b-40f4-b316-cb91a4bf6df9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:04.446963 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ca9e3d9b-3c1b-40f4-b316-cb91a4bf6df9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1494 microversion: 2.1 time: 0.537310 Jul 26 14:21:04.447580 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1629/3389] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:03 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1494 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:04.454923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7bc51d46-f7d8-4547-808f-39c6dcf31186 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:04.455570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7bc51d46-f7d8-4547-808f-39c6dcf31186 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:04.463735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bc51d46-f7d8-4547-808f-39c6dcf31186 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:04.464739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bc51d46-f7d8-4547-808f-39c6dcf31186 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:04.465583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bc51d46-f7d8-4547-808f-39c6dcf31186 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:04.466252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bc51d46-f7d8-4547-808f-39c6dcf31186 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:04.594891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-40f8e34c-58e4-43e1-8b68-eca689667e58 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:04.617955 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-40f8e34c-58e4-43e1-8b68-eca689667e58 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1666 microversion: 2.1 time: 0.619182 Jul 26 14:21:04.632496 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1761/3390] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:03 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1666 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:04.658645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-311b12b9-d835-4f5e-9a9a-9c3127367ea2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:04.659781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-311b12b9-d835-4f5e-9a9a-9c3127367ea2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:04.669831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-311b12b9-d835-4f5e-9a9a-9c3127367ea2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:04.671012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-311b12b9-d835-4f5e-9a9a-9c3127367ea2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:04.672698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-311b12b9-d835-4f5e-9a9a-9c3127367ea2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:04.673292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-311b12b9-d835-4f5e-9a9a-9c3127367ea2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:04.772209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-311b12b9-d835-4f5e-9a9a-9c3127367ea2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:04.786904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-311b12b9-d835-4f5e-9a9a-9c3127367ea2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:04.789937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-311b12b9-d835-4f5e-9a9a-9c3127367ea2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:04.792079 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-311b12b9-d835-4f5e-9a9a-9c3127367ea2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.157294 Jul 26 14:21:04.793049 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1762/3391] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:04 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:04.800829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7bc51d46-f7d8-4547-808f-39c6dcf31186 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:04.801360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-707e78fc-da03-4e8c-856b-d5ae22673872 req-fd3e19b6-5718-4bd9-b378-2dffbc39e40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9c25cd-3b3d-4c48-b620-b7ea6101bf3e", "name": "network-vif-plugged", "status": "completed", "tag": "13068f91-4844-4f82-95a3-ee7530c55d60"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:04.806714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:04.814905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-707e78fc-da03-4e8c-856b-d5ae22673872 req-fd3e19b6-5718-4bd9-b378-2dffbc39e40d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:04.815358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-707e78fc-da03-4e8c-856b-d5ae22673872 req-fd3e19b6-5718-4bd9-b378-2dffbc39e40d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:04.824271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7bc51d46-f7d8-4547-808f-39c6dcf31186 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:04.827602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7bc51d46-f7d8-4547-808f-39c6dcf31186 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:04.830325 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7bc51d46-f7d8-4547-808f-39c6dcf31186 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 0.381281 Jul 26 14:21:04.830581 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-707e78fc-da03-4e8c-856b-d5ae22673872 req-fd3e19b6-5718-4bd9-b378-2dffbc39e40d service nova] Creating event network-vif-plugged:13068f91-4844-4f82-95a3-ee7530c55d60 for instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e on n-h1-833090-9 Jul 26 14:21:04.831895 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1630/3392] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:04 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:04.844826 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-707e78fc-da03-4e8c-856b-d5ae22673872 req-fd3e19b6-5718-4bd9-b378-2dffbc39e40d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047382 Jul 26 14:21:04.844826 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1763/3393] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:04.849912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2078645915", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "07889a08-85b2-40b9-923c-1a167cfebc11"}], "block_device_mapping_v2": [{"uuid": "f73892ed-7a77-4436-a77f-09cb9f92709a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:04.939043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf9bd88f-6d63-4115-bd96-8bbdb1b9f835 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:04.940358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bf9bd88f-6d63-4115-bd96-8bbdb1b9f835 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] [instance: e9bd635b-0eae-4f59-8e28-d6d034cdb159] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:04.949397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf9bd88f-6d63-4115-bd96-8bbdb1b9f835 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:04.950389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf9bd88f-6d63-4115-bd96-8bbdb1b9f835 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:04.952121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf9bd88f-6d63-4115-bd96-8bbdb1b9f835 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:04.953295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf9bd88f-6d63-4115-bd96-8bbdb1b9f835 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:04.959031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:04.980630 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-bf9bd88f-6d63-4115-bd96-8bbdb1b9f835 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] HTTP exception thrown: Instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 could not be found. Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf9bd88f-6d63-4115-bd96-8bbdb1b9f835 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Request method failure captured: Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 HTTP/1.1 Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_fx3YGNQJzo74kcOsrrv2kbB-XsSGuP2VO_4PsGNB4hSGh6hAgoveDNhrYKJvFBn8gH9cn_i6l_3enX6rVAZcSUAAqrVrsbNFoM6E35Dpdut_a4EIMupdo2oPJ9wQsrbf8Ay4giMECRLb_EtVA3FDwcYQTve5WEcSNILJscQOQHPEI Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8e27de07dc204a298c0279a365842602"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8e27de07dc204a298c0279a365842602", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8e27de07dc204a298c0279a365842602"}]}] Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8e27de07dc204a298c0279a365842602 Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-81036910 Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 16cfc68b1ac347fe95e06e60e8b5f681 Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsTestJSON-81036910-project Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 could not be found. Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e9bd635b-0eae-4f59-8e28-d6d034cdb159'} Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 could not be found. Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 could not be found. Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:04.983103 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:04.989559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:04.989559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:04.989559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:04.989559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:04.989559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:04.989559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 could not be found. Jul 26 14:21:04.989559 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:04.990162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] validate_networks() for [('07889a08-85b2-40b9-923c-1a167cfebc11', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:21:04.991283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf9bd88f-6d63-4115-bd96-8bbdb1b9f835 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Returning 404 to user: Instance e9bd635b-0eae-4f59-8e28-d6d034cdb159 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:04.992281 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bf9bd88f-6d63-4115-bd96-8bbdb1b9f835 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159" status: 404 len: 111 microversion: 2.1 time: 0.061896 Jul 26 14:21:04.993232 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1764/3394] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:04 2022] GET /compute/v2.1/servers/e9bd635b-0eae-4f59-8e28-d6d034cdb159 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:05.003607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5c7eda94-3778-466d-aeb9-1da37264807f tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f87876f4af0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:05.517502 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5c7eda94-3778-466d-aeb9-1da37264807f tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/9e5aba62-44f0-4c05-aa11-8a0564915ce5" status: 202 len: 0 microversion: 2.1 time: 0.518278 Jul 26 14:21:05.519254 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1765/3395] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:21:04 2022] DELETE /compute/v2.1/os-security-groups/9e5aba62-44f0-4c05-aa11-8a0564915ce5 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:21:05.530702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f717400-6b73-49ec-ba44-d31986efb34a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:05.532600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f717400-6b73-49ec-ba44-d31986efb34a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:05.543625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f717400-6b73-49ec-ba44-d31986efb34a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:05.544171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f717400-6b73-49ec-ba44-d31986efb34a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:05.545064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f717400-6b73-49ec-ba44-d31986efb34a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:05.545578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f717400-6b73-49ec-ba44-d31986efb34a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:05.835283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f717400-6b73-49ec-ba44-d31986efb34a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:05.844628 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f717400-6b73-49ec-ba44-d31986efb34a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1494 microversion: 2.1 time: 0.322627 Jul 26 14:21:05.845264 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1766/3396] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:05 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1494 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:05.851469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c232fb83-c409-49d2-a088-0df1d3368075 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] Calling method '.version_select at 0x7f87875c05e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:06.175651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:21:06.177126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:21:06.177806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:21:06.178418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:21:06.179129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:21:06.205263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:06.207717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:06.208640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:06.209188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:06.256557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Getting quotas for project 1976cab4a83747a68cadf5b4dc2dbef0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:21:06.264058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Getting quotas for user e35f47eb9e094bdc8d08ea4cf2970d8c and project 1976cab4a83747a68cadf5b4dc2dbef0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:21:06.353119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:21:06.367374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f73892ed-7a77-4436-a77f-09cb9f92709a',volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:21:06.465977 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c232fb83-c409-49d2-a088-0df1d3368075 tempest-SecurityGroupsTestJSON-81036910 tempest-SecurityGroupsTestJSON-81036910-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/94e8ed2a-97db-4980-afff-745afacc556f" status: 202 len: 0 microversion: 2.1 time: 0.618239 Jul 26 14:21:06.468190 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1767/3397] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:21:05 2022] DELETE /compute/v2.1/os-security-groups/94e8ed2a-97db-4980-afff-745afacc556f => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:21:06.479640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ea0d3945-c227-48b1-aa55-69b932941c08 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:06.484269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ea0d3945-c227-48b1-aa55-69b932941c08 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:06.503408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea0d3945-c227-48b1-aa55-69b932941c08 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:06.507095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea0d3945-c227-48b1-aa55-69b932941c08 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:06.513217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea0d3945-c227-48b1-aa55-69b932941c08 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:06.515427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea0d3945-c227-48b1-aa55-69b932941c08 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:06.755426 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5ec66c5b-df31-416b-8d81-089e2a35f587 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.918174 Jul 26 14:21:06.771359 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1631/3398] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:21:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:21:06.778029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b84c2ed1-3f13-48f4-af41-b16e0b00a342 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:06.778166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b84c2ed1-3f13-48f4-af41-b16e0b00a342 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:06.786880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84c2ed1-3f13-48f4-af41-b16e0b00a342 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:06.787342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84c2ed1-3f13-48f4-af41-b16e0b00a342 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:06.789175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84c2ed1-3f13-48f4-af41-b16e0b00a342 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:06.789477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b84c2ed1-3f13-48f4-af41-b16e0b00a342 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:07.241339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ea0d3945-c227-48b1-aa55-69b932941c08 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:07.268743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ea0d3945-c227-48b1-aa55-69b932941c08 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:07.276194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ea0d3945-c227-48b1-aa55-69b932941c08 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:07.286173 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ea0d3945-c227-48b1-aa55-69b932941c08 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.812626 Jul 26 14:21:07.314044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1768/3399] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:06 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:07.360977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-48a265ac-7daf-49b4-92d8-ecd6776f800d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:07.362167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-48a265ac-7daf-49b4-92d8-ecd6776f800d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:07.636277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-48a265ac-7daf-49b4-92d8-ecd6776f800d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:07.670219 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-48a265ac-7daf-49b4-92d8-ecd6776f800d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1053 microversion: 2.1 time: 0.351620 Jul 26 14:21:07.671734 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1769/3400] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:07 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1053 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:07.692884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64008b06-1d68-4a4e-bfa1-d8984b03b8d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:07.693431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-64008b06-1d68-4a4e-bfa1-d8984b03b8d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:07.713882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64008b06-1d68-4a4e-bfa1-d8984b03b8d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:07.714358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64008b06-1d68-4a4e-bfa1-d8984b03b8d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:07.715181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64008b06-1d68-4a4e-bfa1-d8984b03b8d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:07.715630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64008b06-1d68-4a4e-bfa1-d8984b03b8d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:08.081059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b84c2ed1-3f13-48f4-af41-b16e0b00a342 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:08.091462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b84c2ed1-3f13-48f4-af41-b16e0b00a342 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:08.108203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b84c2ed1-3f13-48f4-af41-b16e0b00a342 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:08.109853 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b84c2ed1-3f13-48f4-af41-b16e0b00a342 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1809 microversion: 2.20 time: 1.337264 Jul 26 14:21:08.110639 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1632/3401] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:06 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1809 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:08.301566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-64008b06-1d68-4a4e-bfa1-d8984b03b8d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:08.316377 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-64008b06-1d68-4a4e-bfa1-d8984b03b8d2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 200 len: 1494 microversion: 2.1 time: 0.640309 Jul 26 14:21:08.318192 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1770/3402] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:07 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 1494 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:08.378566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-db607a5e-2a95-43f8-bd37-1332b8851372 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:08.378566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-db607a5e-2a95-43f8-bd37-1332b8851372 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:08.386712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b659f792-faf8-47a8-90bd-a14fa0337d75 req-71136c05-18b9-4da6-9ba4-f1a1c4687bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a67171e-e026-4184-9b91-853e1ffb2256", "name": "network-vif-deleted", "tag": "a81928f0-301d-4bb7-a1fa-1bdecebfcf51"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:08.395548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db607a5e-2a95-43f8-bd37-1332b8851372 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:08.398381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db607a5e-2a95-43f8-bd37-1332b8851372 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:08.399458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db607a5e-2a95-43f8-bd37-1332b8851372 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:08.399919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db607a5e-2a95-43f8-bd37-1332b8851372 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:08.434192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b659f792-faf8-47a8-90bd-a14fa0337d75 req-71136c05-18b9-4da6-9ba4-f1a1c4687bd3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:08.436666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b659f792-faf8-47a8-90bd-a14fa0337d75 req-71136c05-18b9-4da6-9ba4-f1a1c4687bd3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:08.476039 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b659f792-faf8-47a8-90bd-a14fa0337d75 req-71136c05-18b9-4da6-9ba4-f1a1c4687bd3 service nova] Creating event network-vif-deleted:a81928f0-301d-4bb7-a1fa-1bdecebfcf51 for instance 0a67171e-e026-4184-9b91-853e1ffb2256 on n-h2-833090-9 Jul 26 14:21:08.489469 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b659f792-faf8-47a8-90bd-a14fa0337d75 req-71136c05-18b9-4da6-9ba4-f1a1c4687bd3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108269 Jul 26 14:21:08.498649 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1771/3403] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:08.528385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-5361d771-a60e-4f6c-96d0-da50ee5ca46a req-47afd290-d4cd-4c0c-bc1b-59c1d00a5873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c584bb0a-2fbb-4014-9f21-bcb83a0068c0", "name": "network-vif-plugged", "status": "completed", "tag": "3ba17f96-9407-49f5-8771-0ba49b9937c1"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:08.550984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5361d771-a60e-4f6c-96d0-da50ee5ca46a req-47afd290-d4cd-4c0c-bc1b-59c1d00a5873 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:08.551720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5361d771-a60e-4f6c-96d0-da50ee5ca46a req-47afd290-d4cd-4c0c-bc1b-59c1d00a5873 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:08.581763 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-5361d771-a60e-4f6c-96d0-da50ee5ca46a req-47afd290-d4cd-4c0c-bc1b-59c1d00a5873 service nova] Creating event network-vif-plugged:3ba17f96-9407-49f5-8771-0ba49b9937c1 for instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 on n-h1-833090-9 Jul 26 14:21:08.595791 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-5361d771-a60e-4f6c-96d0-da50ee5ca46a req-47afd290-d4cd-4c0c-bc1b-59c1d00a5873 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071934 Jul 26 14:21:08.599632 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1772/3404] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:08.697973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-11701647-903c-41a7-be12-fd28d72ddd8f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:08.705274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-11701647-903c-41a7-be12-fd28d72ddd8f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:08.710407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-db607a5e-2a95-43f8-bd37-1332b8851372 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:08.721227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11701647-903c-41a7-be12-fd28d72ddd8f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:08.724649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11701647-903c-41a7-be12-fd28d72ddd8f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:08.726002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11701647-903c-41a7-be12-fd28d72ddd8f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:08.726695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11701647-903c-41a7-be12-fd28d72ddd8f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:08.741514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-db607a5e-2a95-43f8-bd37-1332b8851372 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:08.749196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-db607a5e-2a95-43f8-bd37-1332b8851372 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:08.750714 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-db607a5e-2a95-43f8-bd37-1332b8851372 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.415269 Jul 26 14:21:08.754796 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1633/3405] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:08 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:08.981291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-11701647-903c-41a7-be12-fd28d72ddd8f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:08.998331 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-11701647-903c-41a7-be12-fd28d72ddd8f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1159 microversion: 2.1 time: 0.308460 Jul 26 14:21:09.000106 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1773/3406] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:08 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1159 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:09.143593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e96e6396-1642-43ea-94b8-35a124c27b6a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:09.144261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e96e6396-1642-43ea-94b8-35a124c27b6a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:09.171265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e96e6396-1642-43ea-94b8-35a124c27b6a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:09.172974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e96e6396-1642-43ea-94b8-35a124c27b6a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:09.174142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e96e6396-1642-43ea-94b8-35a124c27b6a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:09.174603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e96e6396-1642-43ea-94b8-35a124c27b6a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:09.353802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1d77118-2cb1-4057-8b09-e24b8ebbff16 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:09.354874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f1d77118-2cb1-4057-8b09-e24b8ebbff16 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:09.373212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1d77118-2cb1-4057-8b09-e24b8ebbff16 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:09.374837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1d77118-2cb1-4057-8b09-e24b8ebbff16 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:09.378737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1d77118-2cb1-4057-8b09-e24b8ebbff16 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:09.379242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1d77118-2cb1-4057-8b09-e24b8ebbff16 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:09.465886 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-f1d77118-2cb1-4057-8b09-e24b8ebbff16 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1d77118-2cb1-4057-8b09-e24b8ebbff16 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 HTTP/1.1 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '0a67171e-e026-4184-9b91-853e1ffb2256'} Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:09.467907 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:09.474003 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:09.474003 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:09.474003 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:09.474003 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:09.474003 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:21:09.474003 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:09.474003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1d77118-2cb1-4057-8b09-e24b8ebbff16 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:09.475070 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f1d77118-2cb1-4057-8b09-e24b8ebbff16 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 404 len: 111 microversion: 2.1 time: 0.138984 Jul 26 14:21:09.479035 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1774/3407] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:09 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:09.579166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-416761264", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "2dc9e1a8-4a4f-459a-8038-83a80381fb0e"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:09.629198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e96e6396-1642-43ea-94b8-35a124c27b6a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:09.661340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e96e6396-1642-43ea-94b8-35a124c27b6a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:09.666543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e96e6396-1642-43ea-94b8-35a124c27b6a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:09.670612 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e96e6396-1642-43ea-94b8-35a124c27b6a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1796 microversion: 2.20 time: 0.531394 Jul 26 14:21:09.674549 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1634/3408] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:09 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1796 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:09.695467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] validate_networks() for [('2dc9e1a8-4a4f-459a-8038-83a80381fb0e', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:21:09.786806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b7c7a74-7250-403a-ab89-89fe5c36a8e7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:09.787515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b7c7a74-7250-403a-ab89-89fe5c36a8e7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:09.799995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b7c7a74-7250-403a-ab89-89fe5c36a8e7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:09.800614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b7c7a74-7250-403a-ab89-89fe5c36a8e7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:09.802303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b7c7a74-7250-403a-ab89-89fe5c36a8e7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:09.803366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b7c7a74-7250-403a-ab89-89fe5c36a8e7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:09.975528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b7c7a74-7250-403a-ab89-89fe5c36a8e7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:09.992765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b7c7a74-7250-403a-ab89-89fe5c36a8e7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:09.995206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b7c7a74-7250-403a-ab89-89fe5c36a8e7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:10.006018 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b7c7a74-7250-403a-ab89-89fe5c36a8e7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.225949 Jul 26 14:21:10.017411 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1635/3409] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:09 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:10.029814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7e696dbc-d1a5-48cb-a9cd-26ac12b1fa43 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:10.030529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7e696dbc-d1a5-48cb-a9cd-26ac12b1fa43 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:10.040374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e696dbc-d1a5-48cb-a9cd-26ac12b1fa43 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:10.041411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e696dbc-d1a5-48cb-a9cd-26ac12b1fa43 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:10.044317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e696dbc-d1a5-48cb-a9cd-26ac12b1fa43 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:10.045421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e696dbc-d1a5-48cb-a9cd-26ac12b1fa43 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:10.193176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7e696dbc-d1a5-48cb-a9cd-26ac12b1fa43 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:10.232985 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7e696dbc-d1a5-48cb-a9cd-26ac12b1fa43 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1169 microversion: 2.1 time: 0.207480 Jul 26 14:21:10.239049 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1636/3410] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:10 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1169 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:11.036110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b6a294e5-a9a4-48a8-bdd8-5eef639009b6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:11.036895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b6a294e5-a9a4-48a8-bdd8-5eef639009b6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:11.060159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a294e5-a9a4-48a8-bdd8-5eef639009b6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:11.062232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a294e5-a9a4-48a8-bdd8-5eef639009b6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:11.063832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a294e5-a9a4-48a8-bdd8-5eef639009b6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:11.067173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a294e5-a9a4-48a8-bdd8-5eef639009b6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:11.808980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b6a294e5-a9a4-48a8-bdd8-5eef639009b6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:11.830082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b6a294e5-a9a4-48a8-bdd8-5eef639009b6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:11.839802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b6a294e5-a9a4-48a8-bdd8-5eef639009b6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:11.841678 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b6a294e5-a9a4-48a8-bdd8-5eef639009b6 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.811545 Jul 26 14:21:11.858580 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1637/3411] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:11 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:11.888690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-532aebca-67b2-48de-a3cf-f2c25335ac87 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:11.889906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-532aebca-67b2-48de-a3cf-f2c25335ac87 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:11.897043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:21:11.897605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:21:11.898078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:21:11.898507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:21:11.898932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:21:11.901176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-532aebca-67b2-48de-a3cf-f2c25335ac87 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:11.902780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-532aebca-67b2-48de-a3cf-f2c25335ac87 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:11.903844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-532aebca-67b2-48de-a3cf-f2c25335ac87 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:11.916795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-532aebca-67b2-48de-a3cf-f2c25335ac87 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:11.927026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:11.927647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:11.928715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:11.929264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:11.975493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:21:11.999748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for user 55daeaaa37a8498c9e540f5546277dc3 and project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:21:12.030629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:21:12.035862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:21:12.160171 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-79263eee-3a61-41a5-837c-11cb3aebdae5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.580364 Jul 26 14:21:12.160171 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1775/3412] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:21:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:21:12.167245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56bfef7e-a7ee-4837-a45f-99c8dc0c8fa9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:12.167864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56bfef7e-a7ee-4837-a45f-99c8dc0c8fa9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:12.402972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56bfef7e-a7ee-4837-a45f-99c8dc0c8fa9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:12.410366 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56bfef7e-a7ee-4837-a45f-99c8dc0c8fa9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1208 microversion: 2.1 time: 0.246974 Jul 26 14:21:12.431197 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1776/3413] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:12 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1208 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:12.505332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-532aebca-67b2-48de-a3cf-f2c25335ac87 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:12.517828 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-532aebca-67b2-48de-a3cf-f2c25335ac87 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1211 microversion: 2.1 time: 0.657220 Jul 26 14:21:12.518775 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1638/3414] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:11 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1211 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:12.888578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04743176-8751-45d8-9e38-a9ebf8011508 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:12.889854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-04743176-8751-45d8-9e38-a9ebf8011508 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:12.907577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04743176-8751-45d8-9e38-a9ebf8011508 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:12.909501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04743176-8751-45d8-9e38-a9ebf8011508 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:12.910739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04743176-8751-45d8-9e38-a9ebf8011508 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:12.911445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04743176-8751-45d8-9e38-a9ebf8011508 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:13.286111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-04743176-8751-45d8-9e38-a9ebf8011508 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:13.302096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-04743176-8751-45d8-9e38-a9ebf8011508 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:13.304021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-04743176-8751-45d8-9e38-a9ebf8011508 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:13.320133 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-04743176-8751-45d8-9e38-a9ebf8011508 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.422568 Jul 26 14:21:13.342957 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1777/3415] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:12 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:13.438116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cea6036c-771d-485d-b0c3-3d6297cf2414 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:13.438761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cea6036c-771d-485d-b0c3-3d6297cf2414 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:13.457820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cea6036c-771d-485d-b0c3-3d6297cf2414 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:13.459211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cea6036c-771d-485d-b0c3-3d6297cf2414 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:13.463974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cea6036c-771d-485d-b0c3-3d6297cf2414 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:13.464684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cea6036c-771d-485d-b0c3-3d6297cf2414 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:13.606539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3ce490d-8f47-4c67-be98-623a5cff8184 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:13.607168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b3ce490d-8f47-4c67-be98-623a5cff8184 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:13.623127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3ce490d-8f47-4c67-be98-623a5cff8184 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:13.623818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3ce490d-8f47-4c67-be98-623a5cff8184 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:13.625058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3ce490d-8f47-4c67-be98-623a5cff8184 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:13.626029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3ce490d-8f47-4c67-be98-623a5cff8184 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:13.663459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cea6036c-771d-485d-b0c3-3d6297cf2414 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:13.686130 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cea6036c-771d-485d-b0c3-3d6297cf2414 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1260 microversion: 2.1 time: 0.250591 Jul 26 14:21:13.705516 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1639/3416] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:13 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:14.349245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-41d8ce1e-8caf-469c-931f-388938691a5f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:14.367021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-41d8ce1e-8caf-469c-931f-388938691a5f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:14.376302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-41d8ce1e-8caf-469c-931f-388938691a5f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:14.377015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-41d8ce1e-8caf-469c-931f-388938691a5f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:14.378019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-41d8ce1e-8caf-469c-931f-388938691a5f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:14.382427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-41d8ce1e-8caf-469c-931f-388938691a5f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:14.679411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-41d8ce1e-8caf-469c-931f-388938691a5f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:14.689109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-41d8ce1e-8caf-469c-931f-388938691a5f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:14.691454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-41d8ce1e-8caf-469c-931f-388938691a5f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:14.693141 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-41d8ce1e-8caf-469c-931f-388938691a5f tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.348072 Jul 26 14:21:14.694321 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1640/3417] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:14 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:21:14.711711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-17c25004-359e-405b-b100-0dc779afa7db tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:14.714654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-17c25004-359e-405b-b100-0dc779afa7db tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:14.725261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17c25004-359e-405b-b100-0dc779afa7db tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:14.726514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17c25004-359e-405b-b100-0dc779afa7db tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:14.727691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17c25004-359e-405b-b100-0dc779afa7db tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:14.730011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17c25004-359e-405b-b100-0dc779afa7db tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:14.918914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-17c25004-359e-405b-b100-0dc779afa7db tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:14.933059 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-17c25004-359e-405b-b100-0dc779afa7db tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1266 microversion: 2.1 time: 0.226624 Jul 26 14:21:14.934196 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1641/3418] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:14 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:14.985552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3ce490d-8f47-4c67-be98-623a5cff8184 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:14.997362 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3ce490d-8f47-4c67-be98-623a5cff8184 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1211 microversion: 2.1 time: 1.394415 Jul 26 14:21:14.998666 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1778/3419] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:13 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1211 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:15.283906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-40ee7ec5-e057-4253-8f4f-cd2403ae6eea req-67f0fff2-06b4-4d2b-94e5-2f0a52afbcea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac73f48-8f28-404b-a928-b01a53e1b89d", "tag": "08901702-3c35-4c24-a89f-d6e4977720ff"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:15.334891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-40ee7ec5-e057-4253-8f4f-cd2403ae6eea req-67f0fff2-06b4-4d2b-94e5-2f0a52afbcea service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:15.334891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-40ee7ec5-e057-4253-8f4f-cd2403ae6eea req-67f0fff2-06b4-4d2b-94e5-2f0a52afbcea service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:15.390406 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-40ee7ec5-e057-4253-8f4f-cd2403ae6eea req-67f0fff2-06b4-4d2b-94e5-2f0a52afbcea service nova] Creating event network-changed:08901702-3c35-4c24-a89f-d6e4977720ff for instance 5ac73f48-8f28-404b-a928-b01a53e1b89d on n-h2-833090-9 Jul 26 14:21:15.420469 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-40ee7ec5-e057-4253-8f4f-cd2403ae6eea req-67f0fff2-06b4-4d2b-94e5-2f0a52afbcea service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139851 Jul 26 14:21:15.421761 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1642/3420] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:15.721720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00b77d80-e19a-46e7-a67d-5afe392ef069 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:15.722378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00b77d80-e19a-46e7-a67d-5afe392ef069 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:15.730357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00b77d80-e19a-46e7-a67d-5afe392ef069 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:15.730826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00b77d80-e19a-46e7-a67d-5afe392ef069 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:15.731655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00b77d80-e19a-46e7-a67d-5afe392ef069 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:15.732146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00b77d80-e19a-46e7-a67d-5afe392ef069 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:15.862245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-00b77d80-e19a-46e7-a67d-5afe392ef069 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:15.871477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-00b77d80-e19a-46e7-a67d-5afe392ef069 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:15.881503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-00b77d80-e19a-46e7-a67d-5afe392ef069 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:15.882788 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-00b77d80-e19a-46e7-a67d-5afe392ef069 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.165839 Jul 26 14:21:15.883753 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1779/3421] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:15 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:15.960732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-afbd9256-9cf1-4983-af58-51648d7b14fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:15.962741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-afbd9256-9cf1-4983-af58-51648d7b14fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:15.980612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afbd9256-9cf1-4983-af58-51648d7b14fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:15.982426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afbd9256-9cf1-4983-af58-51648d7b14fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:15.985822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afbd9256-9cf1-4983-af58-51648d7b14fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:15.990210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afbd9256-9cf1-4983-af58-51648d7b14fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:16.022972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-318729b4-56cd-45cb-88ec-ff699d58371e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:16.023648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-318729b4-56cd-45cb-88ec-ff699d58371e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:16.041113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-318729b4-56cd-45cb-88ec-ff699d58371e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:16.044736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-318729b4-56cd-45cb-88ec-ff699d58371e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:16.045849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-318729b4-56cd-45cb-88ec-ff699d58371e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:16.046477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-318729b4-56cd-45cb-88ec-ff699d58371e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:16.240782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:16.275542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:16.734810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-afbd9256-9cf1-4983-af58-51648d7b14fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:16.756215 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-afbd9256-9cf1-4983-af58-51648d7b14fd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1266 microversion: 2.1 time: 0.805007 Jul 26 14:21:16.757399 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1643/3422] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:15 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1266 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:16.917797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-06a77f72-8c5f-4bca-adbf-f260d68ac37d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:16.918698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-06a77f72-8c5f-4bca-adbf-f260d68ac37d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:16.928242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:16.932794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06a77f72-8c5f-4bca-adbf-f260d68ac37d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:16.933619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06a77f72-8c5f-4bca-adbf-f260d68ac37d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:16.934700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06a77f72-8c5f-4bca-adbf-f260d68ac37d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:16.938889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06a77f72-8c5f-4bca-adbf-f260d68ac37d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:17.371035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-06a77f72-8c5f-4bca-adbf-f260d68ac37d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:17.391447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-06a77f72-8c5f-4bca-adbf-f260d68ac37d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:17.393316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-06a77f72-8c5f-4bca-adbf-f260d68ac37d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:17.405444 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-06a77f72-8c5f-4bca-adbf-f260d68ac37d tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1365 microversion: 2.57 time: 0.491708 Jul 26 14:21:17.408872 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1644/3423] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:16 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1365 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:21:17.491823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-318729b4-56cd-45cb-88ec-ff699d58371e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:17.508450 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-318729b4-56cd-45cb-88ec-ff699d58371e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1211 microversion: 2.1 time: 1.489175 Jul 26 14:21:17.521949 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1780/3424] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:16 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1211 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:17.784312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6889ef1a-851e-4d72-9c83-dc9355bfd058 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:17.785017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6889ef1a-851e-4d72-9c83-dc9355bfd058 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:17.810052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6889ef1a-851e-4d72-9c83-dc9355bfd058 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:17.810526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6889ef1a-851e-4d72-9c83-dc9355bfd058 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:17.811333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6889ef1a-851e-4d72-9c83-dc9355bfd058 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:17.811783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6889ef1a-851e-4d72-9c83-dc9355bfd058 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:18.395688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6889ef1a-851e-4d72-9c83-dc9355bfd058 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:18.409979 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6889ef1a-851e-4d72-9c83-dc9355bfd058 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1308 microversion: 2.1 time: 0.630713 Jul 26 14:21:18.411193 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1645/3425] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:17 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1308 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:18.443076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3cf86b46-b1bd-4afb-b448-3f0d185a5abd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:18.444084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3cf86b46-b1bd-4afb-b448-3f0d185a5abd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:18.453261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cf86b46-b1bd-4afb-b448-3f0d185a5abd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:18.454200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cf86b46-b1bd-4afb-b448-3f0d185a5abd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:18.455448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cf86b46-b1bd-4afb-b448-3f0d185a5abd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:18.456168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cf86b46-b1bd-4afb-b448-3f0d185a5abd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:18.537239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bcd9cb19-a708-4654-a1b9-c9850f83986c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:18.538160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bcd9cb19-a708-4654-a1b9-c9850f83986c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:18.552597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcd9cb19-a708-4654-a1b9-c9850f83986c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:18.553389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcd9cb19-a708-4654-a1b9-c9850f83986c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:18.554393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcd9cb19-a708-4654-a1b9-c9850f83986c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:18.555032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcd9cb19-a708-4654-a1b9-c9850f83986c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:18.559444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3cf86b46-b1bd-4afb-b448-3f0d185a5abd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:18.598416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3cf86b46-b1bd-4afb-b448-3f0d185a5abd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:18.600815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3cf86b46-b1bd-4afb-b448-3f0d185a5abd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:18.603662 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3cf86b46-b1bd-4afb-b448-3f0d185a5abd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1371 microversion: 2.57 time: 0.165321 Jul 26 14:21:18.622888 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1781/3426] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:18 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:18.806835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bcd9cb19-a708-4654-a1b9-c9850f83986c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:18.824392 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bcd9cb19-a708-4654-a1b9-c9850f83986c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1211 microversion: 2.1 time: 0.293668 Jul 26 14:21:18.846593 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1646/3427] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:18 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1211 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:19.436521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5c551e3d-9fef-4386-aeb5-2433b3bb1ae2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:19.438912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5c551e3d-9fef-4386-aeb5-2433b3bb1ae2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:19.451579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c551e3d-9fef-4386-aeb5-2433b3bb1ae2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:19.452472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c551e3d-9fef-4386-aeb5-2433b3bb1ae2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:19.454142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c551e3d-9fef-4386-aeb5-2433b3bb1ae2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:19.455406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c551e3d-9fef-4386-aeb5-2433b3bb1ae2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:19.640500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-96299fbc-5789-4ee0-a71c-044561242796 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:19.640500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-96299fbc-5789-4ee0-a71c-044561242796 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:19.666128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96299fbc-5789-4ee0-a71c-044561242796 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:19.669400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96299fbc-5789-4ee0-a71c-044561242796 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:19.670296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96299fbc-5789-4ee0-a71c-044561242796 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:19.670750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96299fbc-5789-4ee0-a71c-044561242796 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:19.723260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5c551e3d-9fef-4386-aeb5-2433b3bb1ae2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:19.737542 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5c551e3d-9fef-4386-aeb5-2433b3bb1ae2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1308 microversion: 2.1 time: 0.308172 Jul 26 14:21:19.738528 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1782/3428] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:19 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:19.825575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-96299fbc-5789-4ee0-a71c-044561242796 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:19.837825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-96299fbc-5789-4ee0-a71c-044561242796 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:19.840538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-96299fbc-5789-4ee0-a71c-044561242796 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:19.842646 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-96299fbc-5789-4ee0-a71c-044561242796 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1371 microversion: 2.57 time: 0.214506 Jul 26 14:21:19.856758 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1647/3429] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:19 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:21:19.861112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0c616b1e-6881-4a7d-a203-010317a24b69 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:19.862026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0c616b1e-6881-4a7d-a203-010317a24b69 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:19.874125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c616b1e-6881-4a7d-a203-010317a24b69 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:19.875414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c616b1e-6881-4a7d-a203-010317a24b69 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:19.876572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c616b1e-6881-4a7d-a203-010317a24b69 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:19.877381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c616b1e-6881-4a7d-a203-010317a24b69 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:20.292643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0c616b1e-6881-4a7d-a203-010317a24b69 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:20.315598 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0c616b1e-6881-4a7d-a203-010317a24b69 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1199 microversion: 2.1 time: 0.463272 Jul 26 14:21:20.324653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b446f758-8797-490b-858c-73ed73683307 tempest-AZV2TestJSON-251035470 tempest-AZV2TestJSON-251035470-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:20.328236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b446f758-8797-490b-858c-73ed73683307 tempest-AZV2TestJSON-251035470 tempest-AZV2TestJSON-251035470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:20.331795 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1783/3430] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:19 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1199 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:20.334853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b446f758-8797-490b-858c-73ed73683307 tempest-AZV2TestJSON-251035470 tempest-AZV2TestJSON-251035470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:20.335876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b446f758-8797-490b-858c-73ed73683307 tempest-AZV2TestJSON-251035470 tempest-AZV2TestJSON-251035470-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:20.336362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b446f758-8797-490b-858c-73ed73683307 tempest-AZV2TestJSON-251035470 tempest-AZV2TestJSON-251035470-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:20.387812 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b446f758-8797-490b-858c-73ed73683307 tempest-AZV2TestJSON-251035470 tempest-AZV2TestJSON-251035470-project] 10.222.0.70 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.316027 Jul 26 14:21:20.388688 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1648/3431] 10.222.0.70 () {58 vars in 1164 bytes} [Tue Jul 26 14:21:20 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:21:20.548094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-00d8605e-1492-4fd5-8099-a06e49e78590 req-c882c1dd-04a8-4b9e-9288-697e9359fc50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c41b166-a794-4bdd-8cb7-8e66ddde04cb", "tag": "45dfe929-5688-4356-859e-7140ea2ecf5f"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:20.568955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-00d8605e-1492-4fd5-8099-a06e49e78590 req-c882c1dd-04a8-4b9e-9288-697e9359fc50 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:20.569778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-00d8605e-1492-4fd5-8099-a06e49e78590 req-c882c1dd-04a8-4b9e-9288-697e9359fc50 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:20.585493 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-00d8605e-1492-4fd5-8099-a06e49e78590 req-c882c1dd-04a8-4b9e-9288-697e9359fc50 service nova] Creating event network-changed:45dfe929-5688-4356-859e-7140ea2ecf5f for instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb on n-h1-833090-9 Jul 26 14:21:20.591651 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-00d8605e-1492-4fd5-8099-a06e49e78590 req-c882c1dd-04a8-4b9e-9288-697e9359fc50 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049401 Jul 26 14:21:20.593020 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1784/3432] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:20.762806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0a382385-2118-452c-b906-efc30895877c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:20.764249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0a382385-2118-452c-b906-efc30895877c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:20.774140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a382385-2118-452c-b906-efc30895877c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:20.774800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a382385-2118-452c-b906-efc30895877c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:20.775797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a382385-2118-452c-b906-efc30895877c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:20.779808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a382385-2118-452c-b906-efc30895877c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:20.831088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:20.872450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-10ff2302-8dd9-48b6-b0ce-cef81ed53295 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:20.874085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-10ff2302-8dd9-48b6-b0ce-cef81ed53295 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:20.895705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10ff2302-8dd9-48b6-b0ce-cef81ed53295 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:20.896476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10ff2302-8dd9-48b6-b0ce-cef81ed53295 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:20.897576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10ff2302-8dd9-48b6-b0ce-cef81ed53295 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:20.898192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10ff2302-8dd9-48b6-b0ce-cef81ed53295 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:21.081366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-10ff2302-8dd9-48b6-b0ce-cef81ed53295 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:21.090910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-10ff2302-8dd9-48b6-b0ce-cef81ed53295 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:21.093163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-10ff2302-8dd9-48b6-b0ce-cef81ed53295 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:21.095373 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-10ff2302-8dd9-48b6-b0ce-cef81ed53295 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1356 microversion: 2.57 time: 0.228444 Jul 26 14:21:21.114081 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1785/3433] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:20 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1356 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:21.148539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-37ac860e-1513-457a-95f6-f81459a90111 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:21.156208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-37ac860e-1513-457a-95f6-f81459a90111 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:21.167777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37ac860e-1513-457a-95f6-f81459a90111 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:21.168722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37ac860e-1513-457a-95f6-f81459a90111 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:21.170173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37ac860e-1513-457a-95f6-f81459a90111 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:21.171295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37ac860e-1513-457a-95f6-f81459a90111 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:21.209506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-37ac860e-1513-457a-95f6-f81459a90111 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:21:21.322297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0a382385-2118-452c-b906-efc30895877c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:21.360579 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-37ac860e-1513-457a-95f6-f81459a90111 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 204 len: 0 microversion: 2.57 time: 0.214736 Jul 26 14:21:21.368196 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1786/3434] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:21:21 2022] DELETE /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:21:21.402005 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0a382385-2118-452c-b906-efc30895877c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1308 microversion: 2.1 time: 0.638633 Jul 26 14:21:21.407088 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1649/3435] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:20 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1308 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:21.412484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09b15843-dee7-4c9e-9ed6-3be48e5045c7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:21.414244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-09b15843-dee7-4c9e-9ed6-3be48e5045c7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:21.458625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09b15843-dee7-4c9e-9ed6-3be48e5045c7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:21.459983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09b15843-dee7-4c9e-9ed6-3be48e5045c7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:21.467642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09b15843-dee7-4c9e-9ed6-3be48e5045c7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:21.475442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09b15843-dee7-4c9e-9ed6-3be48e5045c7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:21.488296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0203b63a-222f-49e6-8616-dc73be3214d2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:21.505424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0203b63a-222f-49e6-8616-dc73be3214d2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:21.535271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0203b63a-222f-49e6-8616-dc73be3214d2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:21.537556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0203b63a-222f-49e6-8616-dc73be3214d2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:21.545328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0203b63a-222f-49e6-8616-dc73be3214d2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:21.548451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0203b63a-222f-49e6-8616-dc73be3214d2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:21.611533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:21.796349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0203b63a-222f-49e6-8616-dc73be3214d2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:21.816914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0203b63a-222f-49e6-8616-dc73be3214d2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:21.820168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0203b63a-222f-49e6-8616-dc73be3214d2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:21.823347 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0203b63a-222f-49e6-8616-dc73be3214d2 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1362 microversion: 2.57 time: 0.391702 Jul 26 14:21:21.825178 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1650/3436] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:21 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:21.948830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:22.079013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-09b15843-dee7-4c9e-9ed6-3be48e5045c7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:22.091034 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-09b15843-dee7-4c9e-9ed6-3be48e5045c7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1199 microversion: 2.1 time: 0.701136 Jul 26 14:21:22.092083 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1787/3437] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:21 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1199 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:22.431587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32630caa-c624-444e-90ea-9dc6de4c6e62 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:22.432530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-32630caa-c624-444e-90ea-9dc6de4c6e62 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:22.451504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32630caa-c624-444e-90ea-9dc6de4c6e62 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:22.451996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32630caa-c624-444e-90ea-9dc6de4c6e62 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:22.453334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32630caa-c624-444e-90ea-9dc6de4c6e62 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:22.453791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32630caa-c624-444e-90ea-9dc6de4c6e62 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:22.776216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-32630caa-c624-444e-90ea-9dc6de4c6e62 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:22.792066 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32630caa-c624-444e-90ea-9dc6de4c6e62 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1308 microversion: 2.1 time: 0.365413 Jul 26 14:21:22.792977 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1651/3438] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:22 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:22.850324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f2ef7329-91b8-4242-b502-96248d153d1e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:22.851288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f2ef7329-91b8-4242-b502-96248d153d1e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:22.853183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=10 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:22.860992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2ef7329-91b8-4242-b502-96248d153d1e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:22.861413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2ef7329-91b8-4242-b502-96248d153d1e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:22.862465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2ef7329-91b8-4242-b502-96248d153d1e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:22.863113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2ef7329-91b8-4242-b502-96248d153d1e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:22.974990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f2ef7329-91b8-4242-b502-96248d153d1e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:22.985246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f2ef7329-91b8-4242-b502-96248d153d1e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:22.987598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f2ef7329-91b8-4242-b502-96248d153d1e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:22.989249 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f2ef7329-91b8-4242-b502-96248d153d1e tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1362 microversion: 2.57 time: 0.143313 Jul 26 14:21:22.990402 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1788/3439] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:22 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:21:23.120956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-73cc97e5-2550-4344-ac05-1092582970c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:23.122349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-73cc97e5-2550-4344-ac05-1092582970c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:23.132521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73cc97e5-2550-4344-ac05-1092582970c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:23.133300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73cc97e5-2550-4344-ac05-1092582970c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:23.134500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73cc97e5-2550-4344-ac05-1092582970c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:23.135162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73cc97e5-2550-4344-ac05-1092582970c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:23.341173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-73cc97e5-2550-4344-ac05-1092582970c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:23.354017 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-73cc97e5-2550-4344-ac05-1092582970c9 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1199 microversion: 2.1 time: 0.237043 Jul 26 14:21:23.355734 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1652/3440] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:23 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1199 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:23.817099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63fde384-b247-49d5-94a9-6a6262c6600c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:23.817742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63fde384-b247-49d5-94a9-6a6262c6600c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:23.837468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63fde384-b247-49d5-94a9-6a6262c6600c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:23.838010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63fde384-b247-49d5-94a9-6a6262c6600c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:23.838913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63fde384-b247-49d5-94a9-6a6262c6600c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:23.839370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63fde384-b247-49d5-94a9-6a6262c6600c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:24.024816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5e4c0e2e-1561-4e61-8893-f83062a20043 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:24.025511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5e4c0e2e-1561-4e61-8893-f83062a20043 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:24.034408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e4c0e2e-1561-4e61-8893-f83062a20043 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:24.034877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e4c0e2e-1561-4e61-8893-f83062a20043 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:24.035691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e4c0e2e-1561-4e61-8893-f83062a20043 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:24.036187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e4c0e2e-1561-4e61-8893-f83062a20043 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:24.083695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63fde384-b247-49d5-94a9-6a6262c6600c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:24.109152 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63fde384-b247-49d5-94a9-6a6262c6600c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1308 microversion: 2.1 time: 0.296787 Jul 26 14:21:24.117568 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1789/3441] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:23 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:24.146510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5e4c0e2e-1561-4e61-8893-f83062a20043 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:24.166571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5e4c0e2e-1561-4e61-8893-f83062a20043 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:24.174842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5e4c0e2e-1561-4e61-8893-f83062a20043 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:24.176252 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5e4c0e2e-1561-4e61-8893-f83062a20043 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1362 microversion: 2.57 time: 0.162044 Jul 26 14:21:24.177146 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1653/3442] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:24 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:24.376478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f6673e1-c04a-451c-93eb-fe850d7e30f3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:24.377089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f6673e1-c04a-451c-93eb-fe850d7e30f3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:24.386238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f6673e1-c04a-451c-93eb-fe850d7e30f3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:24.387112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f6673e1-c04a-451c-93eb-fe850d7e30f3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:24.388190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f6673e1-c04a-451c-93eb-fe850d7e30f3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:24.388841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f6673e1-c04a-451c-93eb-fe850d7e30f3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:24.620772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f6673e1-c04a-451c-93eb-fe850d7e30f3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:24.635025 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f6673e1-c04a-451c-93eb-fe850d7e30f3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1199 microversion: 2.1 time: 0.262352 Jul 26 14:21:24.636598 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1790/3443] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:24 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1199 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:25.144521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-def0c45f-2b1a-4b6a-b256-1eb516664ede tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:25.145452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-def0c45f-2b1a-4b6a-b256-1eb516664ede tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:25.155902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-def0c45f-2b1a-4b6a-b256-1eb516664ede tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:25.158314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-def0c45f-2b1a-4b6a-b256-1eb516664ede tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:25.159386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-def0c45f-2b1a-4b6a-b256-1eb516664ede tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:25.160752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-def0c45f-2b1a-4b6a-b256-1eb516664ede tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:25.217311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:25.218245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:25.261655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:25.264329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:25.269106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:25.271520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:25.358521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:25.360071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:25.375125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lazy-loading 'fault' on Instance uuid e7b0bf02-3955-45d3-9a46-763f3d65f561 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:21:25.377190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-def0c45f-2b1a-4b6a-b256-1eb516664ede tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:25.386793 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-def0c45f-2b1a-4b6a-b256-1eb516664ede tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1308 microversion: 2.1 time: 0.249080 Jul 26 14:21:25.388195 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1654/3444] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:25 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1308 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:25.451511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:25.462485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:25.465243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecd20d5086c64b609d3b7333ff3efa00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78d0fbb7b6164cabbb6c6fd53e3f48f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:25.467184 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9ce4ad46-43db-4adf-b8f1-2324d99c13b7 tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 200 len: 1367 microversion: 2.57 time: 0.268184 Jul 26 14:21:25.469172 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1791/3445] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:25 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:21:25.673995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-09ad92f1-d697-4c93-8f8d-033e6110642d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:25.675037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-09ad92f1-d697-4c93-8f8d-033e6110642d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:25.685080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09ad92f1-d697-4c93-8f8d-033e6110642d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:25.685939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09ad92f1-d697-4c93-8f8d-033e6110642d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:25.687370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09ad92f1-d697-4c93-8f8d-033e6110642d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:25.688712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09ad92f1-d697-4c93-8f8d-033e6110642d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:25.899559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3ce54772-b129-4672-9ee0-148e8c0a9fe6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:25.900235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3ce54772-b129-4672-9ee0-148e8c0a9fe6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:25.902241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:25.911772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ce54772-b129-4672-9ee0-148e8c0a9fe6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:25.913042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ce54772-b129-4672-9ee0-148e8c0a9fe6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:25.914965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ce54772-b129-4672-9ee0-148e8c0a9fe6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:25.915760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ce54772-b129-4672-9ee0-148e8c0a9fe6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:25.951096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-09ad92f1-d697-4c93-8f8d-033e6110642d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:25.967811 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-09ad92f1-d697-4c93-8f8d-033e6110642d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1199 microversion: 2.1 time: 0.298379 Jul 26 14:21:25.969380 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1655/3446] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:25 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1199 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:26.155355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3ce54772-b129-4672-9ee0-148e8c0a9fe6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:26.178236 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3ce54772-b129-4672-9ee0-148e8c0a9fe6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.273604 Jul 26 14:21:26.179854 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1792/3447] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:25 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:26.201866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-47d06a09-faf2-4a58-b081-c907e4f2d9be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-514510280"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:26.204585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-47d06a09-faf2-4a58-b081-c907e4f2d9be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:26.220846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47d06a09-faf2-4a58-b081-c907e4f2d9be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:26.221612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47d06a09-faf2-4a58-b081-c907e4f2d9be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:26.223458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47d06a09-faf2-4a58-b081-c907e4f2d9be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:26.224560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47d06a09-faf2-4a58-b081-c907e4f2d9be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:26.415471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95a90ced-d8fa-45fa-afaa-0c6ac7a3230b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:26.429284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95a90ced-d8fa-45fa-afaa-0c6ac7a3230b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:26.446824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95a90ced-d8fa-45fa-afaa-0c6ac7a3230b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:26.447592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95a90ced-d8fa-45fa-afaa-0c6ac7a3230b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:26.448981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95a90ced-d8fa-45fa-afaa-0c6ac7a3230b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:26.450003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95a90ced-d8fa-45fa-afaa-0c6ac7a3230b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:26.572695 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-47d06a09-faf2-4a58-b081-c907e4f2d9be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.374072 Jul 26 14:21:26.577294 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1656/3448] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:21:26 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 26 14:21:26.600368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86a53b6d-24d4-4a8f-929f-e5a8466405cd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:26.601589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-86a53b6d-24d4-4a8f-929f-e5a8466405cd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] [instance: e7b0bf02-3955-45d3-9a46-763f3d65f561] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:26.621513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86a53b6d-24d4-4a8f-929f-e5a8466405cd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:26.621977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86a53b6d-24d4-4a8f-929f-e5a8466405cd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:26.630767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86a53b6d-24d4-4a8f-929f-e5a8466405cd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:26.631546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86a53b6d-24d4-4a8f-929f-e5a8466405cd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:26.654541 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-86a53b6d-24d4-4a8f-929f-e5a8466405cd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] HTTP exception thrown: Instance e7b0bf02-3955-45d3-9a46-763f3d65f561 could not be found. Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86a53b6d-24d4-4a8f-929f-e5a8466405cd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Request method failure captured: Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 HTTP/1.1 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_gsNx2DQCkWhT-l018FAlTXrlSmENzTPgOKjztOkIUHPdtOJDkavzoLfmZBZU57gABhmjTvqXDn9fgMmtx17p_BBY5YLpsP__cGcCzeu6OIIe-PzXVIC2S3qvkbkgCzYxGzQxT4k3qremo0VGFK5J-lkETwbeX-Rki7errh4sEiGsY Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.57 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 78d0fbb7b6164cabbb6c6fd53e3f48f0 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerShowV257Test-1191714690 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/78d0fbb7b6164cabbb6c6fd53e3f48f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/78d0fbb7b6164cabbb6c6fd53e3f48f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_78d0fbb7b6164cabbb6c6fd53e3f48f0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/78d0fbb7b6164cabbb6c6fd53e3f48f0"}]}] Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerShowV257Test-1191714690 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 78d0fbb7b6164cabbb6c6fd53e3f48f0 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerShowV257Test-1191714690 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerShowV257Test-1191714690-project Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ecd20d5086c64b609d3b7333ff3efa00 Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerShowV257Test-1191714690-project Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance e7b0bf02-3955-45d3-9a46-763f3d65f561 could not be found. Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e7b0bf02-3955-45d3-9a46-763f3d65f561'} Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7b0bf02-3955-45d3-9a46-763f3d65f561 could not be found. Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7b0bf02-3955-45d3-9a46-763f3d65f561 could not be found. Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:26.656749 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:26.666079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:26.666079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:26.666079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:26.666079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:26.666079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:26.666079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7b0bf02-3955-45d3-9a46-763f3d65f561 could not be found. Jul 26 14:21:26.666079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:26.666079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86a53b6d-24d4-4a8f-929f-e5a8466405cd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] Returning 404 to user: Instance e7b0bf02-3955-45d3-9a46-763f3d65f561 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:26.667425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-95a90ced-d8fa-45fa-afaa-0c6ac7a3230b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:26.670537 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-86a53b6d-24d4-4a8f-929f-e5a8466405cd tempest-ServerShowV257Test-1191714690 tempest-ServerShowV257Test-1191714690-project] 10.222.0.70 "GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561" status: 404 len: 111 microversion: 2.57 time: 0.094293 Jul 26 14:21:26.672813 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1657/3449] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:21:26 2022] GET /compute/v2.1/servers/e7b0bf02-3955-45d3-9a46-763f3d65f561 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:21:26.699875 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95a90ced-d8fa-45fa-afaa-0c6ac7a3230b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1308 microversion: 2.1 time: 0.293744 Jul 26 14:21:26.712084 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1793/3450] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:26 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:26.993979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1cad94b2-7964-491d-a11d-f0a4ecbd0ab1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:26.994685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1cad94b2-7964-491d-a11d-f0a4ecbd0ab1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:27.006926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cad94b2-7964-491d-a11d-f0a4ecbd0ab1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:27.011201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cad94b2-7964-491d-a11d-f0a4ecbd0ab1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:27.012740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cad94b2-7964-491d-a11d-f0a4ecbd0ab1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:27.013398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cad94b2-7964-491d-a11d-f0a4ecbd0ab1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:27.385416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1cad94b2-7964-491d-a11d-f0a4ecbd0ab1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:27.401201 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1cad94b2-7964-491d-a11d-f0a4ecbd0ab1 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1199 microversion: 2.1 time: 0.412102 Jul 26 14:21:27.417142 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1658/3451] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:26 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1199 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:27.724351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7bb451cb-9b7a-4e6d-9345-7df60597167c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:27.725687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7bb451cb-9b7a-4e6d-9345-7df60597167c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:27.738013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7bb451cb-9b7a-4e6d-9345-7df60597167c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:27.738487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7bb451cb-9b7a-4e6d-9345-7df60597167c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:27.739496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7bb451cb-9b7a-4e6d-9345-7df60597167c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:27.740155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7bb451cb-9b7a-4e6d-9345-7df60597167c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:27.945919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7bb451cb-9b7a-4e6d-9345-7df60597167c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:27.973216 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7bb451cb-9b7a-4e6d-9345-7df60597167c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1308 microversion: 2.1 time: 0.253403 Jul 26 14:21:27.974100 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1794/3452] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:27 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1308 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:28.429737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9b65725a-69d5-40c3-862d-a130eaf6de14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:28.431133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9b65725a-69d5-40c3-862d-a130eaf6de14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:28.455421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b65725a-69d5-40c3-862d-a130eaf6de14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:28.456331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b65725a-69d5-40c3-862d-a130eaf6de14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:28.458372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b65725a-69d5-40c3-862d-a130eaf6de14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:28.459435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b65725a-69d5-40c3-862d-a130eaf6de14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:28.842627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9b65725a-69d5-40c3-862d-a130eaf6de14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:28.856777 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9b65725a-69d5-40c3-862d-a130eaf6de14 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1199 microversion: 2.1 time: 0.432028 Jul 26 14:21:28.858073 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1659/3453] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:28 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1199 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:28.995869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5b4625f8-a0d7-4951-b54a-21845ae43f28 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:28.997983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5b4625f8-a0d7-4951-b54a-21845ae43f28 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:29.004815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f7194b58-6ac8-475d-b195-07f1a11b7535 req-1cb95f3f-d6c4-4836-941a-4b28636c6f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c41b166-a794-4bdd-8cb7-8e66ddde04cb", "name": "network-vif-plugged", "status": "completed", "tag": "45dfe929-5688-4356-859e-7140ea2ecf5f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:29.016723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5b4625f8-a0d7-4951-b54a-21845ae43f28 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:29.018319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5b4625f8-a0d7-4951-b54a-21845ae43f28 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:29.021147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5b4625f8-a0d7-4951-b54a-21845ae43f28 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:29.028121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5b4625f8-a0d7-4951-b54a-21845ae43f28 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:29.054992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f7194b58-6ac8-475d-b195-07f1a11b7535 req-1cb95f3f-d6c4-4836-941a-4b28636c6f7a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:29.055452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f7194b58-6ac8-475d-b195-07f1a11b7535 req-1cb95f3f-d6c4-4836-941a-4b28636c6f7a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:29.099990 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f7194b58-6ac8-475d-b195-07f1a11b7535 req-1cb95f3f-d6c4-4836-941a-4b28636c6f7a service nova] Creating event network-vif-plugged:45dfe929-5688-4356-859e-7140ea2ecf5f for instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb on n-h1-833090-9 Jul 26 14:21:29.130657 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f7194b58-6ac8-475d-b195-07f1a11b7535 req-1cb95f3f-d6c4-4836-941a-4b28636c6f7a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124215 Jul 26 14:21:29.132023 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1660/3454] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:21:29.346193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5b4625f8-a0d7-4951-b54a-21845ae43f28 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:29.352751 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5b4625f8-a0d7-4951-b54a-21845ae43f28 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1308 microversion: 2.1 time: 0.361589 Jul 26 14:21:29.384534 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1795/3455] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:28 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:29.879898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8aad0c87-8292-4b89-85c9-b4ae3cddee41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:29.880568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8aad0c87-8292-4b89-85c9-b4ae3cddee41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:29.890401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8aad0c87-8292-4b89-85c9-b4ae3cddee41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:29.890872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8aad0c87-8292-4b89-85c9-b4ae3cddee41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:29.897664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8aad0c87-8292-4b89-85c9-b4ae3cddee41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:29.898406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8aad0c87-8292-4b89-85c9-b4ae3cddee41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:29.979730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e08d4097-8123-4b08-b354-b5d760640937 tempest-QuotasTestJSON-48514319 tempest-QuotasTestJSON-48514319-project] Calling method '.version_select at 0x7f8786fe8700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:30.109645 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e08d4097-8123-4b08-b354-b5d760640937 tempest-QuotasTestJSON-48514319 tempest-QuotasTestJSON-48514319-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/26d638b5cebd48ed8ffc851af3aa8e70/defaults" status: 200 len: 371 microversion: 2.1 time: 0.454955 Jul 26 14:21:30.111153 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1661/3456] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:21:29 2022] GET /compute/v2.1/os-quota-sets/26d638b5cebd48ed8ffc851af3aa8e70/defaults => generated 371 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:30.137267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d2ca62ed-569f-4efe-a8b5-17cdeb4fa299 tempest-QuotasTestJSON-48514319 tempest-QuotasTestJSON-48514319-project] Calling method '.version_select at 0x7f8786fe8ca0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:30.145116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8aad0c87-8292-4b89-85c9-b4ae3cddee41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:30.163885 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8aad0c87-8292-4b89-85c9-b4ae3cddee41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1199 microversion: 2.1 time: 0.286710 Jul 26 14:21:30.166965 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1796/3457] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:29 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1199 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:30.275053 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d2ca62ed-569f-4efe-a8b5-17cdeb4fa299 tempest-QuotasTestJSON-48514319 tempest-QuotasTestJSON-48514319-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/26d638b5cebd48ed8ffc851af3aa8e70" status: 200 len: 371 microversion: 2.1 time: 0.144900 Jul 26 14:21:30.276166 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1662/3458] 10.222.0.70 () {58 vars in 1242 bytes} [Tue Jul 26 14:21:30 2022] GET /compute/v2.1/os-quota-sets/26d638b5cebd48ed8ffc851af3aa8e70 => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:30.293027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fb38aa22-a91e-4cdf-93c0-72e120d0c692 tempest-QuotasTestJSON-48514319 tempest-QuotasTestJSON-48514319-project] Calling method '.version_select at 0x7f8786ffcca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:30.386767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c808939-0f7b-4ad8-9a4c-428fbe0ad012 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:30.387676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c808939-0f7b-4ad8-9a4c-428fbe0ad012 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:30.397643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:30.401446 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fb38aa22-a91e-4cdf-93c0-72e120d0c692 tempest-QuotasTestJSON-48514319 tempest-QuotasTestJSON-48514319-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/26d638b5cebd48ed8ffc851af3aa8e70/defaults" status: 200 len: 371 microversion: 2.1 time: 0.112435 Jul 26 14:21:30.404077 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1797/3459] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:21:30 2022] GET /compute/v2.1/os-quota-sets/26d638b5cebd48ed8ffc851af3aa8e70/defaults => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:30.408918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c808939-0f7b-4ad8-9a4c-428fbe0ad012 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:30.409635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c808939-0f7b-4ad8-9a4c-428fbe0ad012 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:30.410760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c808939-0f7b-4ad8-9a4c-428fbe0ad012 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:30.411363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c808939-0f7b-4ad8-9a4c-428fbe0ad012 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:30.420745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-13551d70-7f5c-43e7-9962-cb349b010106 tempest-QuotasTestJSON-48514319 tempest-QuotasTestJSON-48514319-project] Calling method '.version_select at 0x7f8787bd6280>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:30.545249 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-13551d70-7f5c-43e7-9962-cb349b010106 tempest-QuotasTestJSON-48514319 tempest-QuotasTestJSON-48514319-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/26d638b5cebd48ed8ffc851af3aa8e70" status: 200 len: 371 microversion: 2.1 time: 0.131541 Jul 26 14:21:30.553804 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1798/3460] 10.222.0.70 () {58 vars in 1242 bytes} [Tue Jul 26 14:21:30 2022] GET /compute/v2.1/os-quota-sets/26d638b5cebd48ed8ffc851af3aa8e70 => generated 371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:30.571365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a59d38a2-b8b1-46a6-be76-640224f56d41 tempest-QuotasTestJSON-48514319 tempest-QuotasTestJSON-48514319-project] Calling method '.version_select at 0x7f87876da700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:30.675045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c808939-0f7b-4ad8-9a4c-428fbe0ad012 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:30.688532 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c808939-0f7b-4ad8-9a4c-428fbe0ad012 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1308 microversion: 2.1 time: 0.304781 Jul 26 14:21:30.693071 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1663/3461] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:30 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1308 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:30.701227 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a59d38a2-b8b1-46a6-be76-640224f56d41 tempest-QuotasTestJSON-48514319 tempest-QuotasTestJSON-48514319-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/26d638b5cebd48ed8ffc851af3aa8e70?user_id=b72d45dbd071420e90c3c02b82610a7d" status: 200 len: 371 microversion: 2.1 time: 0.135526 Jul 26 14:21:30.703190 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1799/3462] 10.222.0.70 () {58 vars in 1323 bytes} [Tue Jul 26 14:21:30 2022] GET /compute/v2.1/os-quota-sets/26d638b5cebd48ed8ffc851af3aa8e70?user_id=b72d45dbd071420e90c3c02b82610a7d => generated 371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:31.194460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f4150c1a-e2b0-4a54-a7dd-b7e9994b0fba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:31.195096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f4150c1a-e2b0-4a54-a7dd-b7e9994b0fba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:31.207304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4150c1a-e2b0-4a54-a7dd-b7e9994b0fba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:31.207778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4150c1a-e2b0-4a54-a7dd-b7e9994b0fba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:31.214904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4150c1a-e2b0-4a54-a7dd-b7e9994b0fba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:31.215380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4150c1a-e2b0-4a54-a7dd-b7e9994b0fba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:31.235810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ff5341c9-3a5d-4308-8764-3e21a7395689 req-0e60e66d-d0d7-4cd6-a6e5-4dbaf02e49d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c584bb0a-2fbb-4014-9f21-bcb83a0068c0", "name": "network-vif-unplugged", "status": "completed", "tag": "3ba17f96-9407-49f5-8771-0ba49b9937c1"}, {"server_uuid": "5ac73f48-8f28-404b-a928-b01a53e1b89d", "name": "network-vif-plugged", "status": "completed", "tag": "08901702-3c35-4c24-a89f-d6e4977720ff"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:31.259574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ff5341c9-3a5d-4308-8764-3e21a7395689 req-0e60e66d-d0d7-4cd6-a6e5-4dbaf02e49d7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:31.260050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ff5341c9-3a5d-4308-8764-3e21a7395689 req-0e60e66d-d0d7-4cd6-a6e5-4dbaf02e49d7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:31.291310 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ff5341c9-3a5d-4308-8764-3e21a7395689 req-0e60e66d-d0d7-4cd6-a6e5-4dbaf02e49d7 service nova] Creating event network-vif-unplugged:3ba17f96-9407-49f5-8771-0ba49b9937c1 for instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 on n-h1-833090-9 Jul 26 14:21:31.293023 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ff5341c9-3a5d-4308-8764-3e21a7395689 req-0e60e66d-d0d7-4cd6-a6e5-4dbaf02e49d7 service nova] Creating event network-vif-plugged:08901702-3c35-4c24-a89f-d6e4977720ff for instance 5ac73f48-8f28-404b-a928-b01a53e1b89d on n-h2-833090-9 Jul 26 14:21:31.306105 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ff5341c9-3a5d-4308-8764-3e21a7395689 req-0e60e66d-d0d7-4cd6-a6e5-4dbaf02e49d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.074206 Jul 26 14:21:31.308867 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1800/3463] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:31.806932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1252655979", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "01fdab58-8c00-4787-8288-5206df456cd7"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:31.829412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4150c1a-e2b0-4a54-a7dd-b7e9994b0fba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:31.848379 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f4150c1a-e2b0-4a54-a7dd-b7e9994b0fba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1199 microversion: 2.1 time: 0.657754 Jul 26 14:21:31.851117 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1664/3464] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:31 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1199 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:31.863906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dfdad1d8-917e-4758-8303-37ee0fdaf6a0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:31.870526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dfdad1d8-917e-4758-8303-37ee0fdaf6a0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:31.885026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfdad1d8-917e-4758-8303-37ee0fdaf6a0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:31.885877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfdad1d8-917e-4758-8303-37ee0fdaf6a0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:31.887063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfdad1d8-917e-4758-8303-37ee0fdaf6a0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:31.887741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfdad1d8-917e-4758-8303-37ee0fdaf6a0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:31.952327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] validate_networks() for [('01fdab58-8c00-4787-8288-5206df456cd7', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:21:32.170712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dfdad1d8-917e-4758-8303-37ee0fdaf6a0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:32.190115 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dfdad1d8-917e-4758-8303-37ee0fdaf6a0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1489 microversion: 2.1 time: 0.329685 Jul 26 14:21:32.191080 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1665/3465] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:31 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1489 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:32.224252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de6b20f8-4617-42b7-97a6-f6ccfe544395 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:32.232971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-de6b20f8-4617-42b7-97a6-f6ccfe544395 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:32.244229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de6b20f8-4617-42b7-97a6-f6ccfe544395 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:32.244957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de6b20f8-4617-42b7-97a6-f6ccfe544395 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:32.246005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de6b20f8-4617-42b7-97a6-f6ccfe544395 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:32.246449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de6b20f8-4617-42b7-97a6-f6ccfe544395 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:32.402605 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-de6b20f8-4617-42b7-97a6-f6ccfe544395 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "PUT /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1084 microversion: 2.1 time: 0.182279 Jul 26 14:21:32.418511 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1666/3466] 10.222.0.70 () {60 vars in 1256 bytes} [Tue Jul 26 14:21:32 2022] PUT /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1084 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:32.425865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4a7d2f8-38b2-4f75-8324-12b41a135ee3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:32.426806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b4a7d2f8-38b2-4f75-8324-12b41a135ee3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:32.435198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4a7d2f8-38b2-4f75-8324-12b41a135ee3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:32.436042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4a7d2f8-38b2-4f75-8324-12b41a135ee3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:32.437079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4a7d2f8-38b2-4f75-8324-12b41a135ee3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:32.438442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4a7d2f8-38b2-4f75-8324-12b41a135ee3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:32.471519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:32.733542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4a7d2f8-38b2-4f75-8324-12b41a135ee3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:32.746768 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b4a7d2f8-38b2-4f75-8324-12b41a135ee3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1510 microversion: 2.1 time: 0.325926 Jul 26 14:21:32.748065 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1667/3467] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:32 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:32.790063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d5288aae-e0ae-4dbf-a195-2894d14584f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:32.795717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d5288aae-e0ae-4dbf-a195-2894d14584f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:32.812270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5288aae-e0ae-4dbf-a195-2894d14584f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:32.814150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5288aae-e0ae-4dbf-a195-2894d14584f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:32.816233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5288aae-e0ae-4dbf-a195-2894d14584f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:32.817385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5288aae-e0ae-4dbf-a195-2894d14584f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:32.855904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:21:32.856793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:21:32.857458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:21:32.858015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:21:32.858607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:21:32.888616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:32.888900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:32.894342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:32.895246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:32.925708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:21:32.942278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for user b1e46ed350fa42669bba323ef30b982d and project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:21:32.981456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:21:32.985046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:21:33.107333 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e8e6d2f1-f98f-493d-b88b-73c5c963c3f7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544732 Jul 26 14:21:33.112790 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1801/3468] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:21:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:21:33.119097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74cfd4ec-14ff-4cc6-9330-e43c616eabba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:33.126909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-74cfd4ec-14ff-4cc6-9330-e43c616eabba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:33.147260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5288aae-e0ae-4dbf-a195-2894d14584f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:33.152765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74cfd4ec-14ff-4cc6-9330-e43c616eabba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:33.158963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74cfd4ec-14ff-4cc6-9330-e43c616eabba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:33.164086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74cfd4ec-14ff-4cc6-9330-e43c616eabba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:33.165910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74cfd4ec-14ff-4cc6-9330-e43c616eabba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:33.186685 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d5288aae-e0ae-4dbf-a195-2894d14584f2 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1510 microversion: 2.1 time: 0.407936 Jul 26 14:21:33.192528 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1668/3469] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:32 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:33.222129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-249185fa-4d08-4614-b69e-91f5cd30cca4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:33.225141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-249185fa-4d08-4614-b69e-91f5cd30cca4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:33.517419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-249185fa-4d08-4614-b69e-91f5cd30cca4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:33.539535 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-249185fa-4d08-4614-b69e-91f5cd30cca4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1215 microversion: 2.1 time: 0.335902 Jul 26 14:21:33.540274 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1669/3470] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:33 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1215 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:33.552613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-caf009c0-4368-410b-a3bd-68a1bb1b3c1d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:33.553122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-caf009c0-4368-410b-a3bd-68a1bb1b3c1d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:33.602253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-caf009c0-4368-410b-a3bd-68a1bb1b3c1d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:33.602867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-caf009c0-4368-410b-a3bd-68a1bb1b3c1d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:33.603724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-caf009c0-4368-410b-a3bd-68a1bb1b3c1d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:33.608070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-caf009c0-4368-410b-a3bd-68a1bb1b3c1d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:33.715544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-caf009c0-4368-410b-a3bd-68a1bb1b3c1d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:21:33.749507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-74cfd4ec-14ff-4cc6-9330-e43c616eabba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:33.762576 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-74cfd4ec-14ff-4cc6-9330-e43c616eabba tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1199 microversion: 2.1 time: 0.648245 Jul 26 14:21:33.766536 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1802/3471] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:33 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1199 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:33.776747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-04e2b66c-34cb-46ec-bb42-228b4a1fca36 req-cd554b79-38a2-438d-98dc-eefd75aa5a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c584bb0a-2fbb-4014-9f21-bcb83a0068c0", "name": "network-vif-plugged", "status": "completed", "tag": "3ba17f96-9407-49f5-8771-0ba49b9937c1"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:33.811782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-04e2b66c-34cb-46ec-bb42-228b4a1fca36 req-cd554b79-38a2-438d-98dc-eefd75aa5a79 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:33.812336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-04e2b66c-34cb-46ec-bb42-228b4a1fca36 req-cd554b79-38a2-438d-98dc-eefd75aa5a79 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:33.862012 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-04e2b66c-34cb-46ec-bb42-228b4a1fca36 req-cd554b79-38a2-438d-98dc-eefd75aa5a79 service nova] Creating event network-vif-plugged:3ba17f96-9407-49f5-8771-0ba49b9937c1 for instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 on n-h1-833090-9 Jul 26 14:21:33.882866 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-04e2b66c-34cb-46ec-bb42-228b4a1fca36 req-cd554b79-38a2-438d-98dc-eefd75aa5a79 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106437 Jul 26 14:21:33.884777 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1803/3472] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:33.955792 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-caf009c0-4368-410b-a3bd-68a1bb1b3c1d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 204 len: 0 microversion: 2.1 time: 0.414129 Jul 26 14:21:33.956495 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1670/3473] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:21:33 2022] DELETE /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:21:33.967507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70a57580-769c-4dd4-ac33-5d42e4cd5040 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:33.968258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70a57580-769c-4dd4-ac33-5d42e4cd5040 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:33.999376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a57580-769c-4dd4-ac33-5d42e4cd5040 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:34.002784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a57580-769c-4dd4-ac33-5d42e4cd5040 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:34.003748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a57580-769c-4dd4-ac33-5d42e4cd5040 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:34.004239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a57580-769c-4dd4-ac33-5d42e4cd5040 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:34.395282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70a57580-769c-4dd4-ac33-5d42e4cd5040 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:34.408181 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70a57580-769c-4dd4-ac33-5d42e4cd5040 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1516 microversion: 2.1 time: 0.445926 Jul 26 14:21:34.409953 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1804/3474] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:33 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1516 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:34.546317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0956700a-ed8d-4821-92e5-c621a0f6b966 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Action: 'create', calling method: .version_select at 0x7f878705b9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1544576439"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:34.566909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df7f2ad0-ae10-4031-93b8-136538f316ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:34.572844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df7f2ad0-ae10-4031-93b8-136538f316ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:34.590553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df7f2ad0-ae10-4031-93b8-136538f316ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:34.591743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df7f2ad0-ae10-4031-93b8-136538f316ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:34.592977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df7f2ad0-ae10-4031-93b8-136538f316ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:34.593653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df7f2ad0-ae10-4031-93b8-136538f316ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:34.691424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df7f2ad0-ae10-4031-93b8-136538f316ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:34.701296 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df7f2ad0-ae10-4031-93b8-136538f316ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1219 microversion: 2.1 time: 0.142922 Jul 26 14:21:34.702448 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1805/3475] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:34 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:34.795633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-15830c8f-67b3-42f1-9334-412f721871f0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:34.796200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-15830c8f-67b3-42f1-9334-412f721871f0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:34.817780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15830c8f-67b3-42f1-9334-412f721871f0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:34.818381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15830c8f-67b3-42f1-9334-412f721871f0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:34.819267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15830c8f-67b3-42f1-9334-412f721871f0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:34.819856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15830c8f-67b3-42f1-9334-412f721871f0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:35.065281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-15830c8f-67b3-42f1-9334-412f721871f0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:35.092304 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-15830c8f-67b3-42f1-9334-412f721871f0 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1381 microversion: 2.1 time: 0.301370 Jul 26 14:21:35.096176 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1806/3476] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:34 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1381 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:35.229393 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0956700a-ed8d-4821-92e5-c621a0f6b966 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.014426 Jul 26 14:21:35.230066 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1671/3477] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Jul 26 14:21:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1018 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 26 14:21:35.261125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-54d2ba49-7e99-43de-a95b-2e0ac380854f tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f878704c4c0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:35.408326 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-54d2ba49-7e99-43de-a95b-2e0ac380854f tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 200 len: 345 microversion: 2.1 time: 0.167688 Jul 26 14:21:35.409281 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1672/3478] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:21:35 2022] GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:35.449071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71d71045-11d6-4251-a43d-5eaa002b64c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:35.449884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb62917d-7853-4e3e-bfc5-a8379f307545 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:35.450241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71d71045-11d6-4251-a43d-5eaa002b64c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:35.450835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bb62917d-7853-4e3e-bfc5-a8379f307545 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:35.467219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71d71045-11d6-4251-a43d-5eaa002b64c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:35.469995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb62917d-7853-4e3e-bfc5-a8379f307545 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:35.471054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb62917d-7853-4e3e-bfc5-a8379f307545 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:35.473007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71d71045-11d6-4251-a43d-5eaa002b64c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:35.474810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71d71045-11d6-4251-a43d-5eaa002b64c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:35.474993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb62917d-7853-4e3e-bfc5-a8379f307545 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:35.475269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb62917d-7853-4e3e-bfc5-a8379f307545 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:35.478728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71d71045-11d6-4251-a43d-5eaa002b64c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:36.055415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bb62917d-7853-4e3e-bfc5-a8379f307545 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:36.071432 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bb62917d-7853-4e3e-bfc5-a8379f307545 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1516 microversion: 2.1 time: 0.628865 Jul 26 14:21:36.091969 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1673/3479] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:35 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1516 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:36.101994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0aea2596-1f52-440b-8ff3-e63ec513ebc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:36.109206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0aea2596-1f52-440b-8ff3-e63ec513ebc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:36.123984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0aea2596-1f52-440b-8ff3-e63ec513ebc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:36.126053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0aea2596-1f52-440b-8ff3-e63ec513ebc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:36.128190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0aea2596-1f52-440b-8ff3-e63ec513ebc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:36.129049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0aea2596-1f52-440b-8ff3-e63ec513ebc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:36.179228 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71d71045-11d6-4251-a43d-5eaa002b64c4 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1532 microversion: 2.1 time: 1.051800 Jul 26 14:21:36.182841 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1807/3480] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:35 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1532 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:36.212441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3af28769-1df8-4c8d-b0f3-3511b35a20f6 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:36.214186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3af28769-1df8-4c8d-b0f3-3511b35a20f6 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:36.247662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3af28769-1df8-4c8d-b0f3-3511b35a20f6 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:36.254052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3af28769-1df8-4c8d-b0f3-3511b35a20f6 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:36.255419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3af28769-1df8-4c8d-b0f3-3511b35a20f6 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:36.261344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3af28769-1df8-4c8d-b0f3-3511b35a20f6 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:36.283768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0aea2596-1f52-440b-8ff3-e63ec513ebc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:36.301025 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0aea2596-1f52-440b-8ff3-e63ec513ebc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1267 microversion: 2.1 time: 0.206199 Jul 26 14:21:36.316820 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1674/3481] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:36 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:36.353295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:36.424529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-09902d3e-73e2-4ef6-b976-560c7c005cd3 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8786fe8430>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:36.582574 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-09902d3e-73e2-4ef6-b976-560c7c005cd3 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 200 len: 345 microversion: 2.1 time: 0.163406 Jul 26 14:21:36.590167 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1675/3482] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:21:36 2022] GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 345 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:21:36.769469 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3af28769-1df8-4c8d-b0f3-3511b35a20f6 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1532 microversion: 2.1 time: 0.563529 Jul 26 14:21:36.773609 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1808/3483] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:36 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1532 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:36.802093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a9dfe29c-3900-4a9b-a07c-6b7bddb42e44 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:36.807815 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:21:36.807815 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:21:36.813077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9dfe29c-3900-4a9b-a07c-6b7bddb42e44 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:36.813786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9dfe29c-3900-4a9b-a07c-6b7bddb42e44 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:36.817140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9dfe29c-3900-4a9b-a07c-6b7bddb42e44 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:36.817840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9dfe29c-3900-4a9b-a07c-6b7bddb42e44 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:36.902490 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a9dfe29c-3900-4a9b-a07c-6b7bddb42e44 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.107054 Jul 26 14:21:36.910651 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1676/3484] 10.222.0.70 () {58 vars in 1176 bytes} [Tue Jul 26 14:21:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:36.916388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fdb2ab3f-729d-4cd5-a30e-3c07960731a3 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-9", "block_migration": false, "disk_over_commit": false}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:36.920775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fdb2ab3f-729d-4cd5-a30e-3c07960731a3 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:36.938644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdb2ab3f-729d-4cd5-a30e-3c07960731a3 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:36.942380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdb2ab3f-729d-4cd5-a30e-3c07960731a3 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:36.948425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdb2ab3f-729d-4cd5-a30e-3c07960731a3 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:36.953086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fdb2ab3f-729d-4cd5-a30e-3c07960731a3 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:36.983443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-36fe0cf5-85b6-43fc-8c3d-b1f095a49ff0 req-fea4da4a-0fea-4cdf-bc30-d13a6fdd3796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c41b166-a794-4bdd-8cb7-8e66ddde04cb", "name": "network-vif-deleted", "tag": "45dfe929-5688-4356-859e-7140ea2ecf5f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:37.017644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-36fe0cf5-85b6-43fc-8c3d-b1f095a49ff0 req-fea4da4a-0fea-4cdf-bc30-d13a6fdd3796 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:37.017837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-36fe0cf5-85b6-43fc-8c3d-b1f095a49ff0 req-fea4da4a-0fea-4cdf-bc30-d13a6fdd3796 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:37.044978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-fdb2ab3f-729d-4cd5-a30e-3c07960731a3 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lazy-loading 'flavor' on Instance uuid 5ac73f48-8f28-404b-a928-b01a53e1b89d {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:21:37.050396 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-36fe0cf5-85b6-43fc-8c3d-b1f095a49ff0 req-fea4da4a-0fea-4cdf-bc30-d13a6fdd3796 service nova] Creating event network-vif-deleted:45dfe929-5688-4356-859e-7140ea2ecf5f for instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb on n-h1-833090-9 Jul 26 14:21:37.057466 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-36fe0cf5-85b6-43fc-8c3d-b1f095a49ff0 req-fea4da4a-0fea-4cdf-bc30-d13a6fdd3796 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077652 Jul 26 14:21:37.059217 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1677/3485] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:37.103741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fdb2ab3f-729d-4cd5-a30e-3c07960731a3 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Going to try to live migrate instance to n-h1-833090-9 {{(pid=119479) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 14:21:37.108043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f2d06c99-f357-45c2-9cb5-32f5ac190ee4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:37.109822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f2d06c99-f357-45c2-9cb5-32f5ac190ee4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:37.139649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2d06c99-f357-45c2-9cb5-32f5ac190ee4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:37.141011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2d06c99-f357-45c2-9cb5-32f5ac190ee4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:37.142454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2d06c99-f357-45c2-9cb5-32f5ac190ee4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:37.143365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2d06c99-f357-45c2-9cb5-32f5ac190ee4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:37.462970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f2d06c99-f357-45c2-9cb5-32f5ac190ee4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:37.474576 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f2d06c99-f357-45c2-9cb5-32f5ac190ee4 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 200 len: 1314 microversion: 2.1 time: 0.377680 Jul 26 14:21:37.495992 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1678/3486] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:37 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:37.511414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d78801f2-6537-4036-8399-d2775c863402 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:37.514530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d78801f2-6537-4036-8399-d2775c863402 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:37.535624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d78801f2-6537-4036-8399-d2775c863402 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:37.536553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d78801f2-6537-4036-8399-d2775c863402 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:37.540180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d78801f2-6537-4036-8399-d2775c863402 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:37.544929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d78801f2-6537-4036-8399-d2775c863402 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:37.672233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d78801f2-6537-4036-8399-d2775c863402 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:37.684462 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d78801f2-6537-4036-8399-d2775c863402 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1273 microversion: 2.1 time: 0.186916 Jul 26 14:21:37.688840 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1679/3487] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:37 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:37.707985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93ae73ab-b424-49fc-8adc-bb45f2d101a1 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8786f9e3a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:37.822685 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-93ae73ab-b424-49fc-8adc-bb45f2d101a1 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 200 len: 346 microversion: 2.1 time: 0.118541 Jul 26 14:21:37.823587 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1680/3488] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:21:37 2022] GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:37.838818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-24239a3b-d711-4043-8b1e-308c6db9e3ec tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Action: 'create', calling method: .version_select at 0x7f8786fe8d30>, body: {"snapshot": {"volume_id": "f980f837-f712-40c1-8125-80d48daff811", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1728354714"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:38.618318 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-24239a3b-d711-4043-8b1e-308c6db9e3ec tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.783861 Jul 26 14:21:38.619252 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1681/3489] 10.222.0.70 () {60 vars in 1162 bytes} [Tue Jul 26 14:21:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:21:38.642243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-188672ab-24ed-4fa8-b18f-17cc7b93dfce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:38.642889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-188672ab-24ed-4fa8-b18f-17cc7b93dfce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:38.651423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-188672ab-24ed-4fa8-b18f-17cc7b93dfce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:38.651885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-188672ab-24ed-4fa8-b18f-17cc7b93dfce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:38.652713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-188672ab-24ed-4fa8-b18f-17cc7b93dfce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:38.653719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-188672ab-24ed-4fa8-b18f-17cc7b93dfce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:38.674428 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-188672ab-24ed-4fa8-b18f-17cc7b93dfce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-188672ab-24ed-4fa8-b18f-17cc7b93dfce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb HTTP/1.1 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '6c41b166-a794-4bdd-8cb7-8e66ddde04cb'} Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:38.677587 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:38.682743 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:38.682743 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:38.682743 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:38.682743 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:38.682743 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:21:38.682743 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:38.684194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-188672ab-24ed-4fa8-b18f-17cc7b93dfce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:38.685261 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-188672ab-24ed-4fa8-b18f-17cc7b93dfce tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 404 len: 111 microversion: 2.1 time: 0.065089 Jul 26 14:21:38.686514 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1682/3490] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:38 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:38.692843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c202001b-24d6-4e53-aacc-8f3119800c22 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8786fe8ca0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:38.915937 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c202001b-24d6-4e53-aacc-8f3119800c22 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4" status: 200 len: 287 microversion: 2.1 time: 0.227258 Jul 26 14:21:38.917016 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1683/3491] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 14:21:38 2022] GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4 => generated 287 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:38.922451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-abd0b1ad-afc2-4ee5-b3a0-3eb77e3c18a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:38.923373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-abd0b1ad-afc2-4ee5-b3a0-3eb77e3c18a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:38.941528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abd0b1ad-afc2-4ee5-b3a0-3eb77e3c18a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:38.943034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abd0b1ad-afc2-4ee5-b3a0-3eb77e3c18a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:38.944113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abd0b1ad-afc2-4ee5-b3a0-3eb77e3c18a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:38.947889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abd0b1ad-afc2-4ee5-b3a0-3eb77e3c18a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:40.215203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-abd0b1ad-afc2-4ee5-b3a0-3eb77e3c18a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:40.228966 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-abd0b1ad-afc2-4ee5-b3a0-3eb77e3c18a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1315 microversion: 2.1 time: 1.310479 Jul 26 14:21:40.229824 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1684/3492] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:38 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1315 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:40.235254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-80103996-037f-4763-8d1b-bc67675b5277 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8786fe8e50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:40.358889 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-80103996-037f-4763-8d1b-bc67675b5277 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.127540 Jul 26 14:21:40.360439 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1685/3493] 10.222.0.70 () {58 vars in 1140 bytes} [Tue Jul 26 14:21:40 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:40.368407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-184033452", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "2dc9e1a8-4a4f-459a-8038-83a80381fb0e"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:40.518850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] validate_networks() for [('2dc9e1a8-4a4f-459a-8038-83a80381fb0e', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:21:41.332688 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fdb2ab3f-729d-4cd5-a30e-3c07960731a3 tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d/action" status: 202 len: 0 microversion: 2.1 time: 4.419639 Jul 26 14:21:41.334894 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1809/3494] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:21:36 2022] POST /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d/action => generated 0 bytes in 4423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:21:41.352018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d4a7286-5197-40cd-a3ff-448844f28fc5 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8786e0e1f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:41.488839 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d4a7286-5197-40cd-a3ff-448844f28fc5 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4" status: 200 len: 287 microversion: 2.1 time: 0.151677 Jul 26 14:21:41.489996 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1810/3495] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 14:21:41 2022] GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4 => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:41.505952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ebacf487-d8c1-4064-8656-2deb5a3439c8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:41.509862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ebacf487-d8c1-4064-8656-2deb5a3439c8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:41.540471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebacf487-d8c1-4064-8656-2deb5a3439c8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:41.542226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebacf487-d8c1-4064-8656-2deb5a3439c8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:41.545391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebacf487-d8c1-4064-8656-2deb5a3439c8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:41.548497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:21:41.549279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:21:41.549737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:21:41.550175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:21:41.550834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:21:41.552492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ebacf487-d8c1-4064-8656-2deb5a3439c8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:41.575919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:41.578269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:41.582944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:41.584222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:41.667450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:21:41.689338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Getting quotas for user 55daeaaa37a8498c9e540f5546277dc3 and project a7c6dd4463a34a61aeb33283ffdb5897. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:21:41.740118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:21:41.747779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:21:41.892095 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3eef3a31-dfe9-40e5-8246-e131058a64f0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.523705 Jul 26 14:21:41.892095 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1686/3496] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:21:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:21:41.920513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3ba0e9b7-2793-452a-b66b-a88c07398a41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:41.921159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3ba0e9b7-2793-452a-b66b-a88c07398a41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:41.934573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:41.940683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ba0e9b7-2793-452a-b66b-a88c07398a41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:41.941144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ba0e9b7-2793-452a-b66b-a88c07398a41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:41.942501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ba0e9b7-2793-452a-b66b-a88c07398a41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:41.942501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ba0e9b7-2793-452a-b66b-a88c07398a41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:42.330677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ebacf487-d8c1-4064-8656-2deb5a3439c8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:42.344743 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ebacf487-d8c1-4064-8656-2deb5a3439c8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1315 microversion: 2.1 time: 0.852285 Jul 26 14:21:42.363779 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1811/3497] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:41 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:42.388109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-8e718f60-41e8-4e5c-8e46-83d729b04eee req-5f0940d1-9746-4673-9caf-eeea58c5acad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6", "tag": "206b8fb3-1584-4dcf-8ed4-49f100c4e4ef"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:42.444088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8e718f60-41e8-4e5c-8e46-83d729b04eee req-5f0940d1-9746-4673-9caf-eeea58c5acad service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:42.444551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8e718f60-41e8-4e5c-8e46-83d729b04eee req-5f0940d1-9746-4673-9caf-eeea58c5acad service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:42.477689 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8e718f60-41e8-4e5c-8e46-83d729b04eee req-5f0940d1-9746-4673-9caf-eeea58c5acad service nova] Creating event network-changed:206b8fb3-1584-4dcf-8ed4-49f100c4e4ef for instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 on n-h1-833090-9 Jul 26 14:21:42.492090 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-8e718f60-41e8-4e5c-8e46-83d729b04eee req-5f0940d1-9746-4673-9caf-eeea58c5acad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126365 Jul 26 14:21:42.496894 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1812/3498] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:42.512214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cff89c05-4dbf-412b-bfb2-2bd6dc6ec2fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:42.514159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cff89c05-4dbf-412b-bfb2-2bd6dc6ec2fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:42.651686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cff89c05-4dbf-412b-bfb2-2bd6dc6ec2fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:42.663035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3ba0e9b7-2793-452a-b66b-a88c07398a41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:42.664208 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cff89c05-4dbf-412b-bfb2-2bd6dc6ec2fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1208 microversion: 2.1 time: 0.163487 Jul 26 14:21:42.667066 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1813/3499] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:42 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1208 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:42.681705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7d172081-56f0-4c57-933c-fb84571b1649 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8786e0e1f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:42.686685 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3ba0e9b7-2793-452a-b66b-a88c07398a41 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.788876 Jul 26 14:21:42.687851 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1687/3500] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:41 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:42.747303 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7d172081-56f0-4c57-933c-fb84571b1649 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4" status: 200 len: 288 microversion: 2.1 time: 0.078785 Jul 26 14:21:42.756546 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1814/3501] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 14:21:42 2022] GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4 => generated 288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:42.761921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-89379f3b-2b9f-46c7-a6fb-0a8ed23a4164 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8786fa5d30>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:42.931457 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-89379f3b-2b9f-46c7-a6fb-0a8ed23a4164 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4" status: 202 len: 0 microversion: 2.1 time: 0.173416 Jul 26 14:21:42.935312 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1688/3502] 10.222.0.70 () {58 vars in 1254 bytes} [Tue Jul 26 14:21:42 2022] DELETE /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:21:42.938300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:42.945550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ccedf98f-135e-4852-82a1-7752bd5f59c3 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f87875fd9d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:43.053931 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ccedf98f-135e-4852-82a1-7752bd5f59c3 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4" status: 200 len: 287 microversion: 2.1 time: 0.116490 Jul 26 14:21:43.054983 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1815/3503] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 14:21:42 2022] GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4 => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:43.371225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-441f3874-6dfe-48ca-80de-be391d3ec921 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:43.372149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-441f3874-6dfe-48ca-80de-be391d3ec921 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:43.384240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-441f3874-6dfe-48ca-80de-be391d3ec921 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:43.384697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-441f3874-6dfe-48ca-80de-be391d3ec921 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:43.385495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-441f3874-6dfe-48ca-80de-be391d3ec921 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:43.385940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-441f3874-6dfe-48ca-80de-be391d3ec921 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:43.645065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-441f3874-6dfe-48ca-80de-be391d3ec921 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:43.655134 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-441f3874-6dfe-48ca-80de-be391d3ec921 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1315 microversion: 2.1 time: 0.288224 Jul 26 14:21:43.657100 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1689/3504] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:43 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:43.693958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9206baa4-6186-448a-a9e5-dd8e629fcf6f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:43.695243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9206baa4-6186-448a-a9e5-dd8e629fcf6f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:43.712954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-008d5cae-fcf5-4593-b28d-907f05a27385 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:43.714390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-008d5cae-fcf5-4593-b28d-907f05a27385 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:43.740422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9206baa4-6186-448a-a9e5-dd8e629fcf6f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:43.741505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9206baa4-6186-448a-a9e5-dd8e629fcf6f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:43.743480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9206baa4-6186-448a-a9e5-dd8e629fcf6f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:43.744478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9206baa4-6186-448a-a9e5-dd8e629fcf6f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:43.758757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-008d5cae-fcf5-4593-b28d-907f05a27385 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:43.759714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-008d5cae-fcf5-4593-b28d-907f05a27385 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:43.760856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-008d5cae-fcf5-4593-b28d-907f05a27385 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:43.769197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-008d5cae-fcf5-4593-b28d-907f05a27385 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:43.868547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9206baa4-6186-448a-a9e5-dd8e629fcf6f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:43.882505 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9206baa4-6186-448a-a9e5-dd8e629fcf6f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1204 microversion: 2.1 time: 0.194344 Jul 26 14:21:43.884201 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1816/3505] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:43 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1204 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:44.072556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-07f278ce-cce4-4474-b7fe-bae8308eb398 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8786ffc700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:44.075887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-008d5cae-fcf5-4593-b28d-907f05a27385 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:44.091801 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-008d5cae-fcf5-4593-b28d-907f05a27385 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.383348 Jul 26 14:21:44.103988 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1690/3506] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:43 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:44.146273 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-07f278ce-cce4-4474-b7fe-bae8308eb398 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4" status: 200 len: 287 microversion: 2.1 time: 0.080944 Jul 26 14:21:44.146878 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1817/3507] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 14:21:44 2022] GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:21:44.694726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4f403335-1fcd-414a-ac07-72d7d362c82c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:44.695766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4f403335-1fcd-414a-ac07-72d7d362c82c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:44.715197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f403335-1fcd-414a-ac07-72d7d362c82c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:44.718326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f403335-1fcd-414a-ac07-72d7d362c82c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:44.720969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f403335-1fcd-414a-ac07-72d7d362c82c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:44.724674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f403335-1fcd-414a-ac07-72d7d362c82c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:44.926716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9d83b285-0f04-474d-84bb-5d17eaadeb20 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:44.927575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9d83b285-0f04-474d-84bb-5d17eaadeb20 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:44.949514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d83b285-0f04-474d-84bb-5d17eaadeb20 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:44.954258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d83b285-0f04-474d-84bb-5d17eaadeb20 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:44.959465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d83b285-0f04-474d-84bb-5d17eaadeb20 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:44.960435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d83b285-0f04-474d-84bb-5d17eaadeb20 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:45.398856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9d83b285-0f04-474d-84bb-5d17eaadeb20 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:45.417496 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9d83b285-0f04-474d-84bb-5d17eaadeb20 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1260 microversion: 2.1 time: 0.514585 Jul 26 14:21:45.421336 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1818/3508] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:44 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1260 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:45.442651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c4a30c73-77cc-46b3-98ee-c196c3be4b0a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:45.457450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c4a30c73-77cc-46b3-98ee-c196c3be4b0a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:45.488116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4a30c73-77cc-46b3-98ee-c196c3be4b0a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:45.497495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4a30c73-77cc-46b3-98ee-c196c3be4b0a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:45.503059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4a30c73-77cc-46b3-98ee-c196c3be4b0a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:45.513705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4a30c73-77cc-46b3-98ee-c196c3be4b0a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:45.544212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4f403335-1fcd-414a-ac07-72d7d362c82c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:45.565785 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4f403335-1fcd-414a-ac07-72d7d362c82c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1315 microversion: 2.1 time: 0.870032 Jul 26 14:21:45.566480 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1691/3509] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:44 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:45.596982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3ee8a148-35fe-490e-8919-548581646746 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f878704c1f0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:45.730855 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-3ee8a148-35fe-490e-8919-548581646746 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] HTTP exception thrown: Snapshot 181ee855-0fac-4d45-a2cf-abacd64d50a4 could not be found. Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3ee8a148-35fe-490e-8919-548581646746 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Request method failure captured: Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4 HTTP/1.1 Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_ht6_cYyMGRJ0HsmPp3NaIIyomDX8SX6MABZ2lEiLDcUq6RKsNQ0gyaUw9ADlypHUmm7nsJwpdHExrEbUQHwr4qLlBU37Ou-nV6PlqGkU4TqFb1bJyWjtxiYCWOWwnaeBJYLyiDfSWEtYDLgG5H3mJR_c6RbJ1ASlLEOp8vR1xXekk Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 788bc38c0e1e41d99079a95612a35edb Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/788bc38c0e1e41d99079a95612a35edb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/788bc38c0e1e41d99079a95612a35edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_788bc38c0e1e41d99079a95612a35edb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/788bc38c0e1e41d99079a95612a35edb"}]}] Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 788bc38c0e1e41d99079a95612a35edb Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-VolumesSnapshotsTestJSON-903960987-project Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6ffcb234627c443da106ddfe4405ce05 Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-VolumesSnapshotsTestJSON-903960987-project Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: exception: Snapshot 181ee855-0fac-4d45-a2cf-abacd64d50a4 could not be found. Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '181ee855-0fac-4d45-a2cf-abacd64d50a4'} Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 181ee855-0fac-4d45-a2cf-abacd64d50a4 could not be found. (HTTP 404) (Request-ID: req-ab8ea612-5337-4aad-93dd-d800a6236f6a) Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:21:45.746114 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 181ee855-0fac-4d45-a2cf-abacd64d50a4 could not be found. Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 181ee855-0fac-4d45-a2cf-abacd64d50a4 could not be found. Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 181ee855-0fac-4d45-a2cf-abacd64d50a4 could not be found. Jul 26 14:21:45.755062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:21:45.764795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3ee8a148-35fe-490e-8919-548581646746 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Returning 404 to user: Snapshot 181ee855-0fac-4d45-a2cf-abacd64d50a4 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:45.764795 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3ee8a148-35fe-490e-8919-548581646746 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4" status: 404 len: 111 microversion: 2.1 time: 0.178614 Jul 26 14:21:45.773047 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1692/3510] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 14:21:45 2022] GET /compute/v2.1/os-snapshots/181ee855-0fac-4d45-a2cf-abacd64d50a4 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:45.795647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f28a9b7d-0015-41ee-9ec2-fc35c7bc6dd0 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8786fe85e0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:46.026710 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f28a9b7d-0015-41ee-9ec2-fc35c7bc6dd0 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 202 len: 0 microversion: 2.1 time: 0.251740 Jul 26 14:21:46.027513 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1693/3511] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:21:45 2022] DELETE /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:21:46.036622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2d965cd3-af13-40c4-b650-afc67e939df4 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f878704cd30>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:46.083785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c4a30c73-77cc-46b3-98ee-c196c3be4b0a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:46.099549 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c4a30c73-77cc-46b3-98ee-c196c3be4b0a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.667001 Jul 26 14:21:46.115996 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1819/3512] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:45 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:46.222156 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2d965cd3-af13-40c4-b650-afc67e939df4 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 200 len: 345 microversion: 2.1 time: 0.188974 Jul 26 14:21:46.224217 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1694/3513] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:21:46 2022] GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 345 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:21:46.395679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-98ff844a-2619-401c-a3be-22b2c97dae09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:46.398395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-98ff844a-2619-401c-a3be-22b2c97dae09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:46.432612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98ff844a-2619-401c-a3be-22b2c97dae09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:46.433390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98ff844a-2619-401c-a3be-22b2c97dae09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:46.435297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98ff844a-2619-401c-a3be-22b2c97dae09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:46.436084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98ff844a-2619-401c-a3be-22b2c97dae09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:46.454662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bcfb4657-b674-4162-93d1-a0f501a9d8e5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:46.455794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bcfb4657-b674-4162-93d1-a0f501a9d8e5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:46.485173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcfb4657-b674-4162-93d1-a0f501a9d8e5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:46.490815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcfb4657-b674-4162-93d1-a0f501a9d8e5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:46.493242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcfb4657-b674-4162-93d1-a0f501a9d8e5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:46.501682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcfb4657-b674-4162-93d1-a0f501a9d8e5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:46.592355 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-98ff844a-2619-401c-a3be-22b2c97dae09 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.196899 Jul 26 14:21:46.596393 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1820/3514] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:21:46 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba/os-volume_attachments => generated 25 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:21:46.616061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e9f70335-8695-4512-b3e1-b8aca34b317c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:46.620522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e9f70335-8695-4512-b3e1-b8aca34b317c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:46.650517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9f70335-8695-4512-b3e1-b8aca34b317c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:46.654461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9f70335-8695-4512-b3e1-b8aca34b317c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:46.658082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9f70335-8695-4512-b3e1-b8aca34b317c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:46.659050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9f70335-8695-4512-b3e1-b8aca34b317c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:46.758258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bcfb4657-b674-4162-93d1-a0f501a9d8e5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:46.793302 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bcfb4657-b674-4162-93d1-a0f501a9d8e5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1266 microversion: 2.1 time: 0.345953 Jul 26 14:21:46.797251 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1695/3515] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:46 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:46.816592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a3a71dd0-efd2-4725-a66c-7045f4909791 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:46.826522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a3a71dd0-efd2-4725-a66c-7045f4909791 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:46.857549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a71dd0-efd2-4725-a66c-7045f4909791 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:46.858353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a71dd0-efd2-4725-a66c-7045f4909791 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:46.860790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a71dd0-efd2-4725-a66c-7045f4909791 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:46.861494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a71dd0-efd2-4725-a66c-7045f4909791 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:46.940398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a3a71dd0-efd2-4725-a66c-7045f4909791 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:21:47.010565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:47.087283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e9f70335-8695-4512-b3e1-b8aca34b317c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:47.106948 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e9f70335-8695-4512-b3e1-b8aca34b317c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1315 microversion: 2.1 time: 0.509010 Jul 26 14:21:47.119023 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1821/3516] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:46 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:47.151763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ab66ab2c-9b07-415c-a6ce-904351edb0e8 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:47.153288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ab66ab2c-9b07-415c-a6ce-904351edb0e8 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:47.195124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab66ab2c-9b07-415c-a6ce-904351edb0e8 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:47.200157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab66ab2c-9b07-415c-a6ce-904351edb0e8 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:47.204877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab66ab2c-9b07-415c-a6ce-904351edb0e8 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:47.211652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab66ab2c-9b07-415c-a6ce-904351edb0e8 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:47.319350 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a3a71dd0-efd2-4725-a66c-7045f4909791 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 204 len: 0 microversion: 2.1 time: 0.507720 Jul 26 14:21:47.325535 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1696/3517] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:21:46 2022] DELETE /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:21:47.354955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-61354160-15bc-45f0-90fc-500814bac557 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f879936f280>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:47.494185 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-61354160-15bc-45f0-90fc-500814bac557 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 200 len: 345 microversion: 2.1 time: 0.166427 Jul 26 14:21:47.495322 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1697/3518] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:21:47 2022] GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:47.506127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b2bfd792-2416-4da9-ab4b-ed2926ca0792 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:47.509525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b2bfd792-2416-4da9-ab4b-ed2926ca0792 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:47.528293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2bfd792-2416-4da9-ab4b-ed2926ca0792 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:47.532863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2bfd792-2416-4da9-ab4b-ed2926ca0792 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:47.534290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2bfd792-2416-4da9-ab4b-ed2926ca0792 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:47.536126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2bfd792-2416-4da9-ab4b-ed2926ca0792 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:47.572188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ab66ab2c-9b07-415c-a6ce-904351edb0e8 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:47.600131 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ab66ab2c-9b07-415c-a6ce-904351edb0e8 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.466113 Jul 26 14:21:47.602227 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1822/3519] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:47 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:47.822321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6520fef-f6ac-4159-ab24-ce15418e46b8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:47.822850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e6520fef-f6ac-4159-ab24-ce15418e46b8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:47.841993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6520fef-f6ac-4159-ab24-ce15418e46b8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:47.842458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6520fef-f6ac-4159-ab24-ce15418e46b8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:47.846710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6520fef-f6ac-4159-ab24-ce15418e46b8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:47.849154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6520fef-f6ac-4159-ab24-ce15418e46b8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:47.887981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b2bfd792-2416-4da9-ab4b-ed2926ca0792 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:47.901976 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b2bfd792-2416-4da9-ab4b-ed2926ca0792 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1672 microversion: 2.1 time: 0.405349 Jul 26 14:21:47.905594 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1698/3520] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:47 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1672 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:48.138895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ddb98cec-1574-40bb-8363-fae23d797215 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:48.140305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ddb98cec-1574-40bb-8363-fae23d797215 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:48.153861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddb98cec-1574-40bb-8363-fae23d797215 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:48.158758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddb98cec-1574-40bb-8363-fae23d797215 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:48.160069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddb98cec-1574-40bb-8363-fae23d797215 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:48.192741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddb98cec-1574-40bb-8363-fae23d797215 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:48.206437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e6520fef-f6ac-4159-ab24-ce15418e46b8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:48.227882 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e6520fef-f6ac-4159-ab24-ce15418e46b8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1308 microversion: 2.1 time: 0.410470 Jul 26 14:21:48.229942 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1823/3521] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:47 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:48.510779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57bec2b1-159f-4ae7-8d80-dba966b308b3 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8786e26b80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:48.514419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ddb98cec-1574-40bb-8363-fae23d797215 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:48.539599 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ddb98cec-1574-40bb-8363-fae23d797215 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1315 microversion: 2.1 time: 0.404423 Jul 26 14:21:48.540814 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1699/3522] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:48 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:48.600566 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57bec2b1-159f-4ae7-8d80-dba966b308b3 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 200 len: 345 microversion: 2.1 time: 0.094172 Jul 26 14:21:48.601837 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1824/3523] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:21:48 2022] GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:48.637445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0e23ea69-34f0-46ed-842d-3810266f759a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:48.638849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0e23ea69-34f0-46ed-842d-3810266f759a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:48.658402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e23ea69-34f0-46ed-842d-3810266f759a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:48.673072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e23ea69-34f0-46ed-842d-3810266f759a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:48.677603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e23ea69-34f0-46ed-842d-3810266f759a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:48.678443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e23ea69-34f0-46ed-842d-3810266f759a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:48.941252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b017209-f1a9-4ff0-b29b-56f2fb04d960 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:48.941886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4b017209-f1a9-4ff0-b29b-56f2fb04d960 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:48.960506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b017209-f1a9-4ff0-b29b-56f2fb04d960 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:48.961599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b017209-f1a9-4ff0-b29b-56f2fb04d960 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:48.962663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b017209-f1a9-4ff0-b29b-56f2fb04d960 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:48.963344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b017209-f1a9-4ff0-b29b-56f2fb04d960 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:49.073214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0e23ea69-34f0-46ed-842d-3810266f759a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:49.089932 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0e23ea69-34f0-46ed-842d-3810266f759a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.459178 Jul 26 14:21:49.095387 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1700/3524] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:48 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:49.251938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d1b05d1-7f6f-4cb6-bad2-81db191fed9e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:49.252951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6d1b05d1-7f6f-4cb6-bad2-81db191fed9e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:49.275275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d1b05d1-7f6f-4cb6-bad2-81db191fed9e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:49.276165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d1b05d1-7f6f-4cb6-bad2-81db191fed9e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:49.277277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d1b05d1-7f6f-4cb6-bad2-81db191fed9e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:49.277896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d1b05d1-7f6f-4cb6-bad2-81db191fed9e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:49.315418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4b017209-f1a9-4ff0-b29b-56f2fb04d960 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:49.326621 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4b017209-f1a9-4ff0-b29b-56f2fb04d960 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1672 microversion: 2.1 time: 0.389081 Jul 26 14:21:49.341295 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1825/3525] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:48 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1672 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:49.570788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0f963879-0209-48de-b2e8-e004dacc3591 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:49.572074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0f963879-0209-48de-b2e8-e004dacc3591 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:49.591776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f963879-0209-48de-b2e8-e004dacc3591 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:49.592485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f963879-0209-48de-b2e8-e004dacc3591 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:49.593938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f963879-0209-48de-b2e8-e004dacc3591 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:49.597812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f963879-0209-48de-b2e8-e004dacc3591 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:49.840335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d1b05d1-7f6f-4cb6-bad2-81db191fed9e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:49.859088 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6d1b05d1-7f6f-4cb6-bad2-81db191fed9e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1308 microversion: 2.1 time: 0.611905 Jul 26 14:21:49.871993 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1701/3526] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:49 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1308 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:49.878415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e5a6177f-c0ee-4e66-962a-9bd0a59361a1 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8787610700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:50.071309 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e5a6177f-c0ee-4e66-962a-9bd0a59361a1 tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 200 len: 345 microversion: 2.1 time: 0.203640 Jul 26 14:21:50.072424 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1702/3527] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:21:49 2022] GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 345 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:50.123735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ccf9b75c-daec-4364-8a1f-7c09b09fe43f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:50.130661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ccf9b75c-daec-4364-8a1f-7c09b09fe43f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:50.135384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0f963879-0209-48de-b2e8-e004dacc3591 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:50.143669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ccf9b75c-daec-4364-8a1f-7c09b09fe43f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:50.144212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ccf9b75c-daec-4364-8a1f-7c09b09fe43f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:50.150595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ccf9b75c-daec-4364-8a1f-7c09b09fe43f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:50.151057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ccf9b75c-daec-4364-8a1f-7c09b09fe43f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:50.179354 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0f963879-0209-48de-b2e8-e004dacc3591 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1315 microversion: 2.1 time: 0.613814 Jul 26 14:21:50.195978 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1826/3528] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:49 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:50.368349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-daeb9cfc-b3bc-4f56-8c99-28183e8cfddd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:50.373061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-daeb9cfc-b3bc-4f56-8c99-28183e8cfddd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:50.425924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-daeb9cfc-b3bc-4f56-8c99-28183e8cfddd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:50.429754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-daeb9cfc-b3bc-4f56-8c99-28183e8cfddd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:50.431919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-daeb9cfc-b3bc-4f56-8c99-28183e8cfddd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:50.434948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-daeb9cfc-b3bc-4f56-8c99-28183e8cfddd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:51.281754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-daeb9cfc-b3bc-4f56-8c99-28183e8cfddd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:51.301012 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-daeb9cfc-b3bc-4f56-8c99-28183e8cfddd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1672 microversion: 2.1 time: 0.946372 Jul 26 14:21:51.311051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ccf9b75c-daec-4364-8a1f-7c09b09fe43f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:51.323742 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1827/3529] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:50 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1672 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:51.338946 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ccf9b75c-daec-4364-8a1f-7c09b09fe43f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 1.218649 Jul 26 14:21:51.349057 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1703/3530] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:50 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:51.353140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-80a0d7df-51e2-44f9-8bfb-0fde0ec19740 req-19515427-cd2b-432b-b1cb-107dc4dc0505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfef27a2-6413-43bf-a500-383a0b9ab4be", "tag": "d3fb18d9-8b61-4fd8-9c02-be32d5d54031"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:51.370059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1a7e53e2-d58c-40b7-bcf2-974e0d8d0a08 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:51.370642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1a7e53e2-d58c-40b7-bcf2-974e0d8d0a08 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:51.392246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-80a0d7df-51e2-44f9-8bfb-0fde0ec19740 req-19515427-cd2b-432b-b1cb-107dc4dc0505 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:51.393152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-80a0d7df-51e2-44f9-8bfb-0fde0ec19740 req-19515427-cd2b-432b-b1cb-107dc4dc0505 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:51.408132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a7e53e2-d58c-40b7-bcf2-974e0d8d0a08 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:51.408921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a7e53e2-d58c-40b7-bcf2-974e0d8d0a08 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:51.410174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a7e53e2-d58c-40b7-bcf2-974e0d8d0a08 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:51.410892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a7e53e2-d58c-40b7-bcf2-974e0d8d0a08 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:51.450930 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-80a0d7df-51e2-44f9-8bfb-0fde0ec19740 req-19515427-cd2b-432b-b1cb-107dc4dc0505 service nova] Creating event network-changed:d3fb18d9-8b61-4fd8-9c02-be32d5d54031 for instance dfef27a2-6413-43bf-a500-383a0b9ab4be on n-h1-833090-9 Jul 26 14:21:51.472842 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-80a0d7df-51e2-44f9-8bfb-0fde0ec19740 req-19515427-cd2b-432b-b1cb-107dc4dc0505 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142709 Jul 26 14:21:51.485443 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1828/3531] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:51.506361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d1da875f-aac8-449b-8477-e95dd82d9bda req-df809a15-31da-4bb2-9ecb-0bd705d06e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6", "name": "network-vif-plugged", "status": "completed", "tag": "206b8fb3-1584-4dcf-8ed4-49f100c4e4ef"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:51.560225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d1da875f-aac8-449b-8477-e95dd82d9bda req-df809a15-31da-4bb2-9ecb-0bd705d06e3b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:51.561054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d1da875f-aac8-449b-8477-e95dd82d9bda req-df809a15-31da-4bb2-9ecb-0bd705d06e3b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:51.563252 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1a7e53e2-d58c-40b7-bcf2-974e0d8d0a08 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments/4f8c7dee-9958-4296-9b4e-90ba9fd2b40a" status: 200 len: 194 microversion: 2.20 time: 0.209589 Jul 26 14:21:51.568158 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1704/3532] 10.222.0.70 () {60 vars in 1454 bytes} [Tue Jul 26 14:21:51 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments/4f8c7dee-9958-4296-9b4e-90ba9fd2b40a => generated 194 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:21:51.607833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-09a18bcb-f411-4675-bda2-5774502410f1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:51.609950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-09a18bcb-f411-4675-bda2-5774502410f1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:51.621269 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d1da875f-aac8-449b-8477-e95dd82d9bda req-df809a15-31da-4bb2-9ecb-0bd705d06e3b service nova] Creating event network-vif-plugged:206b8fb3-1584-4dcf-8ed4-49f100c4e4ef for instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 on n-h1-833090-9 Jul 26 14:21:51.634282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:51.643226 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d1da875f-aac8-449b-8477-e95dd82d9bda req-df809a15-31da-4bb2-9ecb-0bd705d06e3b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154333 Jul 26 14:21:51.643770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09a18bcb-f411-4675-bda2-5774502410f1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:51.649535 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1829/3533] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:51.668077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ffd949a1-5165-42eb-9096-02ad0c153f8c tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f87943d8670>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:51.671898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09a18bcb-f411-4675-bda2-5774502410f1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:51.673455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09a18bcb-f411-4675-bda2-5774502410f1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:51.674230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09a18bcb-f411-4675-bda2-5774502410f1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:51.783091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:51.818425 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-ffd949a1-5165-42eb-9096-02ad0c153f8c tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] HTTP exception thrown: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ffd949a1-5165-42eb-9096-02ad0c153f8c tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Request method failure captured: Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 HTTP/1.1 Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ht6_cYyMGRJ0HsmPp3NaIIyomDX8SX6MABZ2lEiLDcUq6RKsNQ0gyaUw9ADlypHUmm7nsJwpdHExrEbUQHwr4qLlBU37Ou-nV6PlqGkU4TqFb1bJyWjtxiYCWOWwnaeBJYLyiDfSWEtYDLgG5H3mJR_c6RbJ1ASlLEOp8vR1xXekk Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 788bc38c0e1e41d99079a95612a35edb Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/788bc38c0e1e41d99079a95612a35edb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/788bc38c0e1e41d99079a95612a35edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_788bc38c0e1e41d99079a95612a35edb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/788bc38c0e1e41d99079a95612a35edb"}]}] Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 788bc38c0e1e41d99079a95612a35edb Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesSnapshotsTestJSON-903960987-project Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6ffcb234627c443da106ddfe4405ce05 Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesSnapshotsTestJSON-903960987-project Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: exception: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'f980f837-f712-40c1-8125-80d48daff811'} Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. (HTTP 404) (Request-ID: req-5b0a2b08-1a32-4e30-9717-2245d25fe99b) Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:21:51.823690 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:51.833405 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:51.840960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ffd949a1-5165-42eb-9096-02ad0c153f8c tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Returning 404 to user: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:51.844249 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ffd949a1-5165-42eb-9096-02ad0c153f8c tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 404 len: 109 microversion: 2.1 time: 0.190715 Jul 26 14:21:51.845577 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1830/3534] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:21:51 2022] GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 109 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:51.855418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-261fa9bc-767e-4dcb-be65-4ea97edd5fe5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:51.857228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-261fa9bc-767e-4dcb-be65-4ea97edd5fe5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:51.875712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-261fa9bc-767e-4dcb-be65-4ea97edd5fe5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:51.877469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-261fa9bc-767e-4dcb-be65-4ea97edd5fe5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:51.879232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-261fa9bc-767e-4dcb-be65-4ea97edd5fe5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:51.880932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-261fa9bc-767e-4dcb-be65-4ea97edd5fe5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:52.582406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-09a18bcb-f411-4675-bda2-5774502410f1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:52.645088 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-09a18bcb-f411-4675-bda2-5774502410f1 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1308 microversion: 2.1 time: 1.073165 Jul 26 14:21:52.661059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=14 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:52.662735 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1705/3535] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:51 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1308 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:52.681403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f11fcd78-b4cd-4bb1-92a2-649b08f45253 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:52.700375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f11fcd78-b4cd-4bb1-92a2-649b08f45253 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:52.719307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11fcd78-b4cd-4bb1-92a2-649b08f45253 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:52.720085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11fcd78-b4cd-4bb1-92a2-649b08f45253 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:52.721410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11fcd78-b4cd-4bb1-92a2-649b08f45253 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:52.722146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11fcd78-b4cd-4bb1-92a2-649b08f45253 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:52.971070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-261fa9bc-767e-4dcb-be65-4ea97edd5fe5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:53.029177 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-261fa9bc-767e-4dcb-be65-4ea97edd5fe5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1315 microversion: 2.1 time: 1.178203 Jul 26 14:21:53.037005 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1831/3536] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:51 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1315 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:53.060761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50187a96-d5a3-44d0-b8d5-62e49f45723d tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f87875fd160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:53.100339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-f11fcd78-b4cd-4bb1-92a2-649b08f45253 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lazy-loading 'services' on Instance uuid be9c25cd-3b3d-4c48-b620-b7ea6101bf3e {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:21:53.190956 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-50187a96-d5a3-44d0-b8d5-62e49f45723d tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] HTTP exception thrown: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50187a96-d5a3-44d0-b8d5-62e49f45723d tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Request method failure captured: Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 HTTP/1.1 Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ht6_cYyMGRJ0HsmPp3NaIIyomDX8SX6MABZ2lEiLDcUq6RKsNQ0gyaUw9ADlypHUmm7nsJwpdHExrEbUQHwr4qLlBU37Ou-nV6PlqGkU4TqFb1bJyWjtxiYCWOWwnaeBJYLyiDfSWEtYDLgG5H3mJR_c6RbJ1ASlLEOp8vR1xXekk Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 788bc38c0e1e41d99079a95612a35edb Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/788bc38c0e1e41d99079a95612a35edb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/788bc38c0e1e41d99079a95612a35edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_788bc38c0e1e41d99079a95612a35edb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/788bc38c0e1e41d99079a95612a35edb"}]}] Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 788bc38c0e1e41d99079a95612a35edb Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesSnapshotsTestJSON-903960987-project Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6ffcb234627c443da106ddfe4405ce05 Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesSnapshotsTestJSON-903960987-project Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: exception: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'f980f837-f712-40c1-8125-80d48daff811'} Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. (HTTP 404) (Request-ID: req-52ee7b35-ef9e-45ae-9b3b-d301bc57a061) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:21:53.200149 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.211917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50187a96-d5a3-44d0-b8d5-62e49f45723d tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Returning 404 to user: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:53.223788 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-50187a96-d5a3-44d0-b8d5-62e49f45723d tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 404 len: 109 microversion: 2.1 time: 0.167254 Jul 26 14:21:53.223788 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1832/3537] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:21:53 2022] DELETE /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 109 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:53.229589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-49a82dd2-60da-4832-ba31-39ee3b199fa1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:53.230351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-49a82dd2-60da-4832-ba31-39ee3b199fa1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:53.240344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49a82dd2-60da-4832-ba31-39ee3b199fa1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:53.240805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49a82dd2-60da-4832-ba31-39ee3b199fa1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:53.241939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49a82dd2-60da-4832-ba31-39ee3b199fa1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:53.242594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49a82dd2-60da-4832-ba31-39ee3b199fa1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:53.246247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:53.322668 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f11fcd78-b4cd-4bb1-92a2-649b08f45253 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "DELETE /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments/4f8c7dee-9958-4296-9b4e-90ba9fd2b40a" status: 202 len: 0 microversion: 2.20 time: 0.657704 Jul 26 14:21:53.323544 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1706/3538] 10.222.0.70 () {60 vars in 1457 bytes} [Tue Jul 26 14:21:52 2022] DELETE /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments/4f8c7dee-9958-4296-9b4e-90ba9fd2b40a => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:21:53.338936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aeb59cdd-f015-46c2-b79e-29fbada4c4f7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:53.339999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aeb59cdd-f015-46c2-b79e-29fbada4c4f7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:53.347739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeb59cdd-f015-46c2-b79e-29fbada4c4f7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:53.348578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeb59cdd-f015-46c2-b79e-29fbada4c4f7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:53.349611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeb59cdd-f015-46c2-b79e-29fbada4c4f7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:53.350365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeb59cdd-f015-46c2-b79e-29fbada4c4f7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:53.471350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-49a82dd2-60da-4832-ba31-39ee3b199fa1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:53.500054 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-49a82dd2-60da-4832-ba31-39ee3b199fa1 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1605 microversion: 2.1 time: 0.277522 Jul 26 14:21:53.501376 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1833/3539] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:53 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1605 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:53.509688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-87803c24-5885-44af-8bd6-46cb65314fed tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Calling method '.version_select at 0x7f8787bd69d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:53.569553 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-87803c24-5885-44af-8bd6-46cb65314fed tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] HTTP exception thrown: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-87803c24-5885-44af-8bd6-46cb65314fed tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Request method failure captured: Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 HTTP/1.1 Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_ht6_cYyMGRJ0HsmPp3NaIIyomDX8SX6MABZ2lEiLDcUq6RKsNQ0gyaUw9ADlypHUmm7nsJwpdHExrEbUQHwr4qLlBU37Ou-nV6PlqGkU4TqFb1bJyWjtxiYCWOWwnaeBJYLyiDfSWEtYDLgG5H3mJR_c6RbJ1ASlLEOp8vR1xXekk Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 788bc38c0e1e41d99079a95612a35edb Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/788bc38c0e1e41d99079a95612a35edb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/788bc38c0e1e41d99079a95612a35edb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_788bc38c0e1e41d99079a95612a35edb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/788bc38c0e1e41d99079a95612a35edb"}]}] Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 788bc38c0e1e41d99079a95612a35edb Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-903960987 Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesSnapshotsTestJSON-903960987-project Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6ffcb234627c443da106ddfe4405ce05 Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesSnapshotsTestJSON-903960987-project Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: exception: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'f980f837-f712-40c1-8125-80d48daff811'} Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. (HTTP 404) (Request-ID: req-f629dfa2-f607-44c3-ac74-836ada235602) Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:21:53.572019 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. Jul 26 14:21:53.576406 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:53.581144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-87803c24-5885-44af-8bd6-46cb65314fed tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] Returning 404 to user: Volume f980f837-f712-40c1-8125-80d48daff811 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:53.582373 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-87803c24-5885-44af-8bd6-46cb65314fed tempest-VolumesSnapshotsTestJSON-903960987 tempest-VolumesSnapshotsTestJSON-903960987-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811" status: 404 len: 109 microversion: 2.1 time: 0.079614 Jul 26 14:21:53.586564 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1834/3540] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:21:53 2022] GET /compute/v2.1/os-volumes/f980f837-f712-40c1-8125-80d48daff811 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:53.610675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db918e67-0bf1-4cd6-b661-c31f6a24576d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:53.620297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-db918e67-0bf1-4cd6-b661-c31f6a24576d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:53.661337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db918e67-0bf1-4cd6-b661-c31f6a24576d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:53.664301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db918e67-0bf1-4cd6-b661-c31f6a24576d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:53.665889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db918e67-0bf1-4cd6-b661-c31f6a24576d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:53.666373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db918e67-0bf1-4cd6-b661-c31f6a24576d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:53.771458 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db918e67-0bf1-4cd6-b661-c31f6a24576d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.183389 Jul 26 14:21:53.779124 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1835/3541] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:21:53 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:21:53.799167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-733293b0-7a3c-4540-8d84-e26a3fbdc06a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:53.801893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-733293b0-7a3c-4540-8d84-e26a3fbdc06a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:53.821565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-733293b0-7a3c-4540-8d84-e26a3fbdc06a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:53.824495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-733293b0-7a3c-4540-8d84-e26a3fbdc06a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:53.829716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-733293b0-7a3c-4540-8d84-e26a3fbdc06a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:53.830957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-733293b0-7a3c-4540-8d84-e26a3fbdc06a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:54.029818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aeb59cdd-f015-46c2-b79e-29fbada4c4f7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:54.059536 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aeb59cdd-f015-46c2-b79e-29fbada4c4f7 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.725118 Jul 26 14:21:54.063785 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1707/3542] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:53 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:54.085118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3768df7-23b0-449c-97bc-2c45cfd2e5cd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:54.090335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f3768df7-23b0-449c-97bc-2c45cfd2e5cd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:54.109041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3768df7-23b0-449c-97bc-2c45cfd2e5cd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:54.117484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3768df7-23b0-449c-97bc-2c45cfd2e5cd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:54.119285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3768df7-23b0-449c-97bc-2c45cfd2e5cd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:54.120466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3768df7-23b0-449c-97bc-2c45cfd2e5cd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:54.601240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-733293b0-7a3c-4540-8d84-e26a3fbdc06a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:54.634197 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-733293b0-7a3c-4540-8d84-e26a3fbdc06a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1308 microversion: 2.1 time: 0.838263 Jul 26 14:21:54.637416 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1836/3543] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:53 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1308 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:54.647969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4cec91d8-6c72-4365-8fd1-cfc01b17822f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:54.653370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4cec91d8-6c72-4365-8fd1-cfc01b17822f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:54.669883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cec91d8-6c72-4365-8fd1-cfc01b17822f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:54.673763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cec91d8-6c72-4365-8fd1-cfc01b17822f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:54.676778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cec91d8-6c72-4365-8fd1-cfc01b17822f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:54.679256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cec91d8-6c72-4365-8fd1-cfc01b17822f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:54.779560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f3768df7-23b0-449c-97bc-2c45cfd2e5cd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:54.835503 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f3768df7-23b0-449c-97bc-2c45cfd2e5cd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1315 microversion: 2.1 time: 0.763439 Jul 26 14:21:54.842362 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1708/3544] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:54 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:54.867267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-704d431b-c03b-4787-a08e-caffb0248d6f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:54.888477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-704d431b-c03b-4787-a08e-caffb0248d6f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:54.933690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-704d431b-c03b-4787-a08e-caffb0248d6f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:54.934528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-704d431b-c03b-4787-a08e-caffb0248d6f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:54.939733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-704d431b-c03b-4787-a08e-caffb0248d6f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:54.940490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-704d431b-c03b-4787-a08e-caffb0248d6f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:54.984312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4cec91d8-6c72-4365-8fd1-cfc01b17822f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:55.009590 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4cec91d8-6c72-4365-8fd1-cfc01b17822f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 200 len: 1605 microversion: 2.1 time: 0.368257 Jul 26 14:21:55.011719 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1837/3545] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:54 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 1605 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:55.021460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-8e142924-a573-40fa-ba7e-b232b75891e8 req-8227e57b-bac1-484e-90af-b53bb40ed0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b34e8fe-9a39-4c51-80fe-5f03e674baba", "name": "network-vif-deleted", "tag": "c858bc4b-8fd2-4f32-a3d5-177e57a448dd"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:21:55.048097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:55.052442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8e142924-a573-40fa-ba7e-b232b75891e8 req-8227e57b-bac1-484e-90af-b53bb40ed0e3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:55.053280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8e142924-a573-40fa-ba7e-b232b75891e8 req-8227e57b-bac1-484e-90af-b53bb40ed0e3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:55.058969 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-704d431b-c03b-4787-a08e-caffb0248d6f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.206749 Jul 26 14:21:55.061120 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1709/3546] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:21:54 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:21:55.103212 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8e142924-a573-40fa-ba7e-b232b75891e8 req-8227e57b-bac1-484e-90af-b53bb40ed0e3 service nova] Creating event network-vif-deleted:c858bc4b-8fd2-4f32-a3d5-177e57a448dd for instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba on n-h1-833090-9 Jul 26 14:21:55.104912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fc6efc87-61aa-4958-8ef5-55a1e11f91ec tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:55.105600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fc6efc87-61aa-4958-8ef5-55a1e11f91ec tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:55.123700 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-8e142924-a573-40fa-ba7e-b232b75891e8 req-8227e57b-bac1-484e-90af-b53bb40ed0e3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109193 Jul 26 14:21:55.125833 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1838/3547] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:21:55.128844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc6efc87-61aa-4958-8ef5-55a1e11f91ec tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:55.131351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc6efc87-61aa-4958-8ef5-55a1e11f91ec tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:55.134680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc6efc87-61aa-4958-8ef5-55a1e11f91ec tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:55.136372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc6efc87-61aa-4958-8ef5-55a1e11f91ec tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:55.660735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a80daffc-0246-4a1b-90de-fd95dc7825ec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:55.661529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a80daffc-0246-4a1b-90de-fd95dc7825ec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:55.710822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fc6efc87-61aa-4958-8ef5-55a1e11f91ec tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:55.716943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a80daffc-0246-4a1b-90de-fd95dc7825ec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:55.720435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a80daffc-0246-4a1b-90de-fd95dc7825ec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:55.726352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a80daffc-0246-4a1b-90de-fd95dc7825ec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:55.730205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a80daffc-0246-4a1b-90de-fd95dc7825ec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:55.733694 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fc6efc87-61aa-4958-8ef5-55a1e11f91ec tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.644862 Jul 26 14:21:55.737953 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1710/3548] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:55 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:55.872808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5817f448-41c9-4af8-937b-24bef64ca65d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:55.873765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5817f448-41c9-4af8-937b-24bef64ca65d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:55.902383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5817f448-41c9-4af8-937b-24bef64ca65d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:55.907922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5817f448-41c9-4af8-937b-24bef64ca65d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:55.909409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5817f448-41c9-4af8-937b-24bef64ca65d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:55.914179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5817f448-41c9-4af8-937b-24bef64ca65d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:56.685481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a80daffc-0246-4a1b-90de-fd95dc7825ec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:56.713160 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a80daffc-0246-4a1b-90de-fd95dc7825ec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1308 microversion: 2.1 time: 1.057959 Jul 26 14:21:56.719638 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1839/3549] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:55 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1308 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:56.732375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a531a1dd-3b58-4e9d-bda1-e60414955090 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:56.740595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a531a1dd-3b58-4e9d-bda1-e60414955090 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:56.764933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a531a1dd-3b58-4e9d-bda1-e60414955090 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:56.768229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a531a1dd-3b58-4e9d-bda1-e60414955090 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:56.772248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a531a1dd-3b58-4e9d-bda1-e60414955090 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:56.774633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a531a1dd-3b58-4e9d-bda1-e60414955090 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:56.846665 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a531a1dd-3b58-4e9d-bda1-e60414955090 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] HTTP exception thrown: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a531a1dd-3b58-4e9d-bda1-e60414955090 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Request method failure captured: Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba HTTP/1.1 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_d6T8VZKBb8m2yG8UhihAKahu2diKCDTqfV5O1nxR9IS_cNJHUVT9axTIwGI7toxkAmOzeU3-XMFyDzn4808gDiE04M5pY2yTs9RrVmh1DPWCHOTt8kcxLBeq8t9vx5sFeTwGODds0KleJ2s6kJJwuEE-XOS8u9YG22U1yxrO86JU4 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_36cdecfd17974d588bc69d8e369a7fd1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}] Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 0a19594a069a4981b97987a892d918e1 Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '0b34e8fe-9a39-4c51-80fe-5f03e674baba'} Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:21:56.851446 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:56.857415 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:21:56.857415 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:21:56.857415 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:21:56.857415 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:21:56.857415 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:21:56.857415 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:21:56.857415 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:21:56.867652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a531a1dd-3b58-4e9d-bda1-e60414955090 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Returning 404 to user: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:21:56.869824 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a531a1dd-3b58-4e9d-bda1-e60414955090 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 404 len: 111 microversion: 2.1 time: 0.146896 Jul 26 14:21:56.871099 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1840/3550] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:56 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:21:56.885781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d07ccc1-fa73-4b35-b780-9750d9c00e2f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:56.893663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2d07ccc1-fa73-4b35-b780-9750d9c00e2f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:56.940369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d07ccc1-fa73-4b35-b780-9750d9c00e2f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:56.941127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d07ccc1-fa73-4b35-b780-9750d9c00e2f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:56.944379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d07ccc1-fa73-4b35-b780-9750d9c00e2f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:56.946478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d07ccc1-fa73-4b35-b780-9750d9c00e2f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:57.064605 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d07ccc1-fa73-4b35-b780-9750d9c00e2f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.191901 Jul 26 14:21:57.065203 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1841/3551] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:21:56 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:21:57.071240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b5816e5d-5dca-41d3-817a-7eb69ad59dea tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:57.080241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b5816e5d-5dca-41d3-817a-7eb69ad59dea tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:57.091594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5816e5d-5dca-41d3-817a-7eb69ad59dea tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:57.092500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5816e5d-5dca-41d3-817a-7eb69ad59dea tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:57.097685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5816e5d-5dca-41d3-817a-7eb69ad59dea tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:57.098418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5816e5d-5dca-41d3-817a-7eb69ad59dea tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:58.264703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5817f448-41c9-4af8-937b-24bef64ca65d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:58.303151 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5817f448-41c9-4af8-937b-24bef64ca65d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1502 microversion: 2.1 time: 2.435428 Jul 26 14:21:58.305250 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1711/3552] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:55 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1502 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:21:58.312487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86001b7c-55c1-4f60-a9f3-005973fbd90d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '.version_select at 0x7f8794732e50>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:58.391814 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-86001b7c-55c1-4f60-a9f3-005973fbd90d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982894533" status: 202 len: 0 microversion: 2.1 time: 0.079627 Jul 26 14:21:58.396113 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1712/3553] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:21:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982894533 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:21:58.404754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0a0cf248-f903-4e86-9009-990fc7a43758 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:58.406474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0a0cf248-f903-4e86-9009-990fc7a43758 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:58.416961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a0cf248-f903-4e86-9009-990fc7a43758 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:58.418786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a0cf248-f903-4e86-9009-990fc7a43758 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:58.419911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a0cf248-f903-4e86-9009-990fc7a43758 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:58.420809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a0cf248-f903-4e86-9009-990fc7a43758 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:58.883638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0a0cf248-f903-4e86-9009-990fc7a43758 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:58.939417 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0a0cf248-f903-4e86-9009-990fc7a43758 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1308 microversion: 2.1 time: 0.535594 Jul 26 14:21:58.943883 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1713/3554] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:58 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:58.951258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b5816e5d-5dca-41d3-817a-7eb69ad59dea tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:58.980452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5e275375-a6e2-4983-b83c-25bc75ad4ae8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:58.987922 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b5816e5d-5dca-41d3-817a-7eb69ad59dea tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 1.913587 Jul 26 14:21:58.992731 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1842/3555] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:57 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:58.997253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5e275375-a6e2-4983-b83c-25bc75ad4ae8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:59.026178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb92766c-ef49-4791-b525-80f8e997c477 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:59.030760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cb92766c-ef49-4791-b525-80f8e997c477 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:59.053258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e275375-a6e2-4983-b83c-25bc75ad4ae8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:59.065902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e275375-a6e2-4983-b83c-25bc75ad4ae8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:59.070258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e275375-a6e2-4983-b83c-25bc75ad4ae8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:59.071415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e275375-a6e2-4983-b83c-25bc75ad4ae8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:59.088433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb92766c-ef49-4791-b525-80f8e997c477 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:59.092239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb92766c-ef49-4791-b525-80f8e997c477 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:59.099328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb92766c-ef49-4791-b525-80f8e997c477 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:59.106159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb92766c-ef49-4791-b525-80f8e997c477 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:59.173600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:21:59.268385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cb92766c-ef49-4791-b525-80f8e997c477 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:21:59.288712 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5e275375-a6e2-4983-b83c-25bc75ad4ae8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.340497 Jul 26 14:21:59.289687 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1714/3556] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:21:58 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments => generated 197 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:21:59.463788 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cb92766c-ef49-4791-b525-80f8e997c477 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 204 len: 0 microversion: 2.1 time: 0.468575 Jul 26 14:21:59.465283 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1843/3557] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:21:58 2022] DELETE /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:21:59.480646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ecd8dbac-2bfe-461e-baf9-a5f7a55ba9be tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:59.485863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ecd8dbac-2bfe-461e-baf9-a5f7a55ba9be tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:59.496660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecd8dbac-2bfe-461e-baf9-a5f7a55ba9be tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:59.497309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecd8dbac-2bfe-461e-baf9-a5f7a55ba9be tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:59.498736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecd8dbac-2bfe-461e-baf9-a5f7a55ba9be tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:59.499275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecd8dbac-2bfe-461e-baf9-a5f7a55ba9be tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:59.757361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ecd8dbac-2bfe-461e-baf9-a5f7a55ba9be tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:21:59.769014 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ecd8dbac-2bfe-461e-baf9-a5f7a55ba9be tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1508 microversion: 2.1 time: 0.293712 Jul 26 14:21:59.786602 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1715/3558] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:59 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:21:59.924417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eae8c161-c0af-41aa-8743-4f6e99e8b476 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:21:59.927524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eae8c161-c0af-41aa-8743-4f6e99e8b476 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:21:59.939595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eae8c161-c0af-41aa-8743-4f6e99e8b476 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:59.940610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eae8c161-c0af-41aa-8743-4f6e99e8b476 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:59.942609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eae8c161-c0af-41aa-8743-4f6e99e8b476 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:21:59.944312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eae8c161-c0af-41aa-8743-4f6e99e8b476 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:21:59.978401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0de61726-c3c6-4549-8e15-ca281445fcc5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'create', calling method: .version_select at 0x7f8786ff9ee0>, body: {"keypair": {"name": "tempest-keypair-1534818419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtrROwBF7sttrRJ69iU8NbPcl4vv7gmDQPH5LIQ9doODE1HSzVq+uWJAEvJM4RszF9BIyq2rzyTmyZDvdG9tx6FCg65LV12CcaymDwAFUp3q4pSV5xPu9vNCEzKN4fcDw=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:00.001758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0de61726-c3c6-4549-8e15-ca281445fcc5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Getting quotas for project 36cdecfd17974d588bc69d8e369a7fd1. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:22:00.024304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-0de61726-c3c6-4549-8e15-ca281445fcc5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Getting quotas for user 0a19594a069a4981b97987a892d918e1 and project 36cdecfd17974d588bc69d8e369a7fd1. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:22:00.050821 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0de61726-c3c6-4549-8e15-ca281445fcc5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077931 Jul 26 14:22:00.060381 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1716/3559] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:21:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:00.060381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-861d4cec-a46d-4368-9925-63403b3d3d79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:00.060381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-861d4cec-a46d-4368-9925-63403b3d3d79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:00.071019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-861d4cec-a46d-4368-9925-63403b3d3d79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:00.071019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-861d4cec-a46d-4368-9925-63403b3d3d79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:00.072383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-861d4cec-a46d-4368-9925-63403b3d3d79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:00.073391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-861d4cec-a46d-4368-9925-63403b3d3d79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:00.802018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eae8c161-c0af-41aa-8743-4f6e99e8b476 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:00.833209 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eae8c161-c0af-41aa-8743-4f6e99e8b476 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 0.912163 Jul 26 14:22:00.849002 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1844/3560] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:21:59 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:00.865456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-861d4cec-a46d-4368-9925-63403b3d3d79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:00.866858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e706862b-dacb-474a-8c53-2f29f488fa51 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:00.872405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e706862b-dacb-474a-8c53-2f29f488fa51 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:00.878819 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-861d4cec-a46d-4368-9925-63403b3d3d79 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1308 microversion: 2.1 time: 0.825888 Jul 26 14:22:00.880180 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1717/3561] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:00 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1308 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:00.886006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-889586dd-9589-45ef-be38-f9370b5dba1c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:00.888713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e706862b-dacb-474a-8c53-2f29f488fa51 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:00.889180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e706862b-dacb-474a-8c53-2f29f488fa51 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:00.890055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e706862b-dacb-474a-8c53-2f29f488fa51 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:00.891105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-889586dd-9589-45ef-be38-f9370b5dba1c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:00.899359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e706862b-dacb-474a-8c53-2f29f488fa51 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:00.912047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-889586dd-9589-45ef-be38-f9370b5dba1c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:00.913124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-889586dd-9589-45ef-be38-f9370b5dba1c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:00.916529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-889586dd-9589-45ef-be38-f9370b5dba1c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:00.917661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-889586dd-9589-45ef-be38-f9370b5dba1c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:00.967271 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-889586dd-9589-45ef-be38-f9370b5dba1c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.085628 Jul 26 14:22:00.973429 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1718/3562] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:22:00 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:22:00.979534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-444bd6fa-cf5c-4fb7-886d-772483335896 req-54e9abac-cc41-4fb1-b9e2-6a1db8013f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfef27a2-6413-43bf-a500-383a0b9ab4be", "name": "network-vif-plugged", "status": "completed", "tag": "d3fb18d9-8b61-4fd8-9c02-be32d5d54031"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:01.003059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-444bd6fa-cf5c-4fb7-886d-772483335896 req-54e9abac-cc41-4fb1-b9e2-6a1db8013f1f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:01.005381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-444bd6fa-cf5c-4fb7-886d-772483335896 req-54e9abac-cc41-4fb1-b9e2-6a1db8013f1f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:01.023596 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-444bd6fa-cf5c-4fb7-886d-772483335896 req-54e9abac-cc41-4fb1-b9e2-6a1db8013f1f service nova] Creating event network-vif-plugged:d3fb18d9-8b61-4fd8-9c02-be32d5d54031 for instance dfef27a2-6413-43bf-a500-383a0b9ab4be on n-h1-833090-9 Jul 26 14:22:01.033926 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-444bd6fa-cf5c-4fb7-886d-772483335896 req-54e9abac-cc41-4fb1-b9e2-6a1db8013f1f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058286 Jul 26 14:22:01.035044 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1719/3563] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:01.059584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9715d658-043a-46fd-a59f-5fa596ff1108 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:01.060769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9715d658-043a-46fd-a59f-5fa596ff1108 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:01.075723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9715d658-043a-46fd-a59f-5fa596ff1108 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:01.076820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9715d658-043a-46fd-a59f-5fa596ff1108 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:01.085165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9715d658-043a-46fd-a59f-5fa596ff1108 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:01.086333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9715d658-043a-46fd-a59f-5fa596ff1108 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:01.587122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e706862b-dacb-474a-8c53-2f29f488fa51 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:01.612177 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e706862b-dacb-474a-8c53-2f29f488fa51 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.758331 Jul 26 14:22:01.614828 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1845/3564] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:00 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:01.623631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a8e612c-aa45-45f2-b5a4-fed1fc3f45cc tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f8786e2bdc0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:01.720532 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a8e612c-aa45-45f2-b5a4-fed1fc3f45cc tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d10a26f0-97e9-4d67-8f88-961f3e5f5644" status: 200 len: 351 microversion: 2.1 time: 0.104052 Jul 26 14:22:01.721128 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1846/3565] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:22:01 2022] GET /compute/v2.1/os-volumes/d10a26f0-97e9-4d67-8f88-961f3e5f5644 => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:01.882065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fc329f76-f386-4d49-865f-cbbfebffda09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:01.883226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fc329f76-f386-4d49-865f-cbbfebffda09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:01.911308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc329f76-f386-4d49-865f-cbbfebffda09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:01.912154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc329f76-f386-4d49-865f-cbbfebffda09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:01.913572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc329f76-f386-4d49-865f-cbbfebffda09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:01.923645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc329f76-f386-4d49-865f-cbbfebffda09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:02.492251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9715d658-043a-46fd-a59f-5fa596ff1108 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:02.507250 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9715d658-043a-46fd-a59f-5fa596ff1108 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1508 microversion: 2.1 time: 1.463103 Jul 26 14:22:02.509745 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1720/3566] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:01 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1508 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:02.536888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0cdd5969-27cd-4945-ad46-ab7d99226f6b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:02.538116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0cdd5969-27cd-4945-ad46-ab7d99226f6b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:02.543534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fc329f76-f386-4d49-865f-cbbfebffda09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:02.556145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cdd5969-27cd-4945-ad46-ab7d99226f6b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:02.556796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cdd5969-27cd-4945-ad46-ab7d99226f6b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:02.559599 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fc329f76-f386-4d49-865f-cbbfebffda09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.686109 Jul 26 14:22:02.560386 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1847/3567] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:01 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:02.566464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cdd5969-27cd-4945-ad46-ab7d99226f6b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:02.567128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cdd5969-27cd-4945-ad46-ab7d99226f6b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:02.577216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7f479299-50c7-48a4-b6ca-44d4124ce324 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:02.585152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7f479299-50c7-48a4-b6ca-44d4124ce324 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:02.616290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f479299-50c7-48a4-b6ca-44d4124ce324 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:02.617476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f479299-50c7-48a4-b6ca-44d4124ce324 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:02.620372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f479299-50c7-48a4-b6ca-44d4124ce324 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:02.623116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f479299-50c7-48a4-b6ca-44d4124ce324 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:02.711165 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7f479299-50c7-48a4-b6ca-44d4124ce324 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148292 Jul 26 14:22:02.717554 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1848/3568] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:22:02 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:22:02.723727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f48a00c4-d419-4444-8ba9-999c2d0247d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-644358973"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:02.726828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f48a00c4-d419-4444-8ba9-999c2d0247d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:02.739266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f48a00c4-d419-4444-8ba9-999c2d0247d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:02.740518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f48a00c4-d419-4444-8ba9-999c2d0247d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:02.742275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f48a00c4-d419-4444-8ba9-999c2d0247d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:02.743647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f48a00c4-d419-4444-8ba9-999c2d0247d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:03.139593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0cdd5969-27cd-4945-ad46-ab7d99226f6b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:03.150060 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0cdd5969-27cd-4945-ad46-ab7d99226f6b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1308 microversion: 2.1 time: 0.633130 Jul 26 14:22:03.161521 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1721/3569] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:02 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1308 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:03.175815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e31d3260-a133-432f-a83d-3c319a95d071 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:03.177250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e31d3260-a133-432f-a83d-3c319a95d071 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:03.190402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31d3260-a133-432f-a83d-3c319a95d071 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:03.213504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31d3260-a133-432f-a83d-3c319a95d071 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:03.215497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31d3260-a133-432f-a83d-3c319a95d071 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:03.223473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31d3260-a133-432f-a83d-3c319a95d071 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:03.351227 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f48a00c4-d419-4444-8ba9-999c2d0247d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.631084 Jul 26 14:22:03.353350 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1849/3570] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:22:02 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 26 14:22:03.361694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1962314878", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d418b403-dd4d-4f55-89c9-6fcfc87770fa"}], "security_groups": [{"name": "tempest-securitygroup--1710889409"}], "key_name": "tempest-keypair-1534818419", "user_data": "}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:03.747434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e31d3260-a133-432f-a83d-3c319a95d071 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:03.769783 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e31d3260-a133-432f-a83d-3c319a95d071 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.606296 Jul 26 14:22:03.774543 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1722/3571] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:03 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:03.783619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e8afcf24-464c-4a8e-be76-dcf7443352d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:03.786005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e8afcf24-464c-4a8e-be76-dcf7443352d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:03.801005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8afcf24-464c-4a8e-be76-dcf7443352d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:03.813733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8afcf24-464c-4a8e-be76-dcf7443352d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:03.818575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8afcf24-464c-4a8e-be76-dcf7443352d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:03.819297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8afcf24-464c-4a8e-be76-dcf7443352d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:03.887788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] validate_networks() for [('d418b403-dd4d-4f55-89c9-6fcfc87770fa', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:22:04.259871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e8afcf24-464c-4a8e-be76-dcf7443352d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:04.287147 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e8afcf24-464c-4a8e-be76-dcf7443352d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.510987 Jul 26 14:22:04.287884 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1723/3572] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:03 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:04.292810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:04.293656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:04.304793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:04.306246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:04.308031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:04.309061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:04.378210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:04.379187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:04.379842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lazy-loading 'fault' on Instance uuid 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:22:04.447702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:04.460135 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-777aab3d-edf8-4a0a-b8a7-e215487c741e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 200 len: 1305 microversion: 2.1 time: 0.170916 Jul 26 14:22:04.477516 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1724/3573] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:04 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 1305 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:04.486586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-806dd11d-1135-487e-84ba-eaf043f8326c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:04.489965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-806dd11d-1135-487e-84ba-eaf043f8326c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:04.497636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-806dd11d-1135-487e-84ba-eaf043f8326c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:04.498383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-806dd11d-1135-487e-84ba-eaf043f8326c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:04.500678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-806dd11d-1135-487e-84ba-eaf043f8326c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:04.501320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-806dd11d-1135-487e-84ba-eaf043f8326c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:04.572988 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-806dd11d-1135-487e-84ba-eaf043f8326c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094146 Jul 26 14:22:04.581124 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1725/3574] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:22:04 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:22:04.595001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a6b8bcd5-cf51-4c99-b418-a1223ac2db36 req-b42cc878-62a9-4510-8650-f51591fbf911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6", "name": "network-vif-deleted", "tag": "206b8fb3-1584-4dcf-8ed4-49f100c4e4ef"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:04.626761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a6b8bcd5-cf51-4c99-b418-a1223ac2db36 req-b42cc878-62a9-4510-8650-f51591fbf911 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:04.628093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a6b8bcd5-cf51-4c99-b418-a1223ac2db36 req-b42cc878-62a9-4510-8650-f51591fbf911 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:04.685746 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a6b8bcd5-cf51-4c99-b418-a1223ac2db36 req-b42cc878-62a9-4510-8650-f51591fbf911 service nova] Creating event network-vif-deleted:206b8fb3-1584-4dcf-8ed4-49f100c4e4ef for instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 on n-h1-833090-9 Jul 26 14:22:04.707284 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a6b8bcd5-cf51-4c99-b418-a1223ac2db36 req-b42cc878-62a9-4510-8650-f51591fbf911 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121802 Jul 26 14:22:04.709344 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1726/3575] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:04.723134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c0b79613-e9b3-424e-bd3d-9f217c5f9699 req-b5bbb8b8-af86-4657-a8a8-856f7336be19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac73f48-8f28-404b-a928-b01a53e1b89d", "name": "network-vif-unplugged", "status": "completed", "tag": "08901702-3c35-4c24-a89f-d6e4977720ff"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:04.742726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c0b79613-e9b3-424e-bd3d-9f217c5f9699 req-b5bbb8b8-af86-4657-a8a8-856f7336be19 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:04.743453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c0b79613-e9b3-424e-bd3d-9f217c5f9699 req-b5bbb8b8-af86-4657-a8a8-856f7336be19 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:04.775215 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c0b79613-e9b3-424e-bd3d-9f217c5f9699 req-b5bbb8b8-af86-4657-a8a8-856f7336be19 service nova] Creating event network-vif-unplugged:08901702-3c35-4c24-a89f-d6e4977720ff for instance 5ac73f48-8f28-404b-a928-b01a53e1b89d on n-h2-833090-9 Jul 26 14:22:04.789397 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c0b79613-e9b3-424e-bd3d-9f217c5f9699 req-b5bbb8b8-af86-4657-a8a8-856f7336be19 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075449 Jul 26 14:22:04.793407 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1727/3576] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:04.815483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a112ecbf-d079-48cb-986a-b2df2b27425b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:04.821131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a112ecbf-d079-48cb-986a-b2df2b27425b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:04.836052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a112ecbf-d079-48cb-986a-b2df2b27425b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:04.837740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a112ecbf-d079-48cb-986a-b2df2b27425b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:04.839847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a112ecbf-d079-48cb-986a-b2df2b27425b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:04.841588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a112ecbf-d079-48cb-986a-b2df2b27425b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:05.262474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:22:05.263999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:22:05.264738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:22:05.265891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:22:05.268479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:22:05.282843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:05.284455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:05.285571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:05.286200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:05.288452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a112ecbf-d079-48cb-986a-b2df2b27425b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:05.297691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:05.299360 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a112ecbf-d079-48cb-986a-b2df2b27425b tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1488 microversion: 2.1 time: 0.503649 Jul 26 14:22:05.310117 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1728/3577] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:04 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1488 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:05.322122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Getting quotas for project 36cdecfd17974d588bc69d8e369a7fd1. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:22:05.323551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b997cf3e-970a-4b27-bf9f-90dd35071d1c tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f8786fe8c10>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:05.330583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Getting quotas for user 0a19594a069a4981b97987a892d918e1 and project 36cdecfd17974d588bc69d8e369a7fd1. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:22:05.353936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:22:05.357200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:22:05.431982 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b997cf3e-970a-4b27-bf9f-90dd35071d1c tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1a08e922-6bc1-4c82-a9fe-53b57a079967" status: 200 len: 351 microversion: 2.1 time: 0.119993 Jul 26 14:22:05.437721 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1729/3578] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:22:05 2022] GET /compute/v2.1/os-volumes/1a08e922-6bc1-4c82-a9fe-53b57a079967 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:05.451633 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6fcc4809-9436-459d-92a5-df5f1c90eabe tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.095698 Jul 26 14:22:05.454449 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1850/3579] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:22:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:22:05.464192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d0d9ee3-5cb8-4280-94bc-e3a91a9b546f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:05.465542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4d0d9ee3-5cb8-4280-94bc-e3a91a9b546f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:05.483178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7fd0c54f-18b5-4588-9b67-832bdede0d71 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:05.484911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7fd0c54f-18b5-4588-9b67-832bdede0d71 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:05.491544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d0d9ee3-5cb8-4280-94bc-e3a91a9b546f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:05.492262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d0d9ee3-5cb8-4280-94bc-e3a91a9b546f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:05.496202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d0d9ee3-5cb8-4280-94bc-e3a91a9b546f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:05.501937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d0d9ee3-5cb8-4280-94bc-e3a91a9b546f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:05.504308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fd0c54f-18b5-4588-9b67-832bdede0d71 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:05.505144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fd0c54f-18b5-4588-9b67-832bdede0d71 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:05.509173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fd0c54f-18b5-4588-9b67-832bdede0d71 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:05.509915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fd0c54f-18b5-4588-9b67-832bdede0d71 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:05.891715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4d0d9ee3-5cb8-4280-94bc-e3a91a9b546f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:05.895339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7fd0c54f-18b5-4588-9b67-832bdede0d71 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:05.905292 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d0d9ee3-5cb8-4280-94bc-e3a91a9b546f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1685 microversion: 2.1 time: 0.447844 Jul 26 14:22:05.905722 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7fd0c54f-18b5-4588-9b67-832bdede0d71 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.465342 Jul 26 14:22:05.906457 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1851/3580] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:05 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1685 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:05.915254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-82995dad-a72f-4334-b378-e1777313661d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1925958868"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:05.920431 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1730/3581] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:05 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:05.921697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-82995dad-a72f-4334-b378-e1777313661d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:05.933171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82995dad-a72f-4334-b378-e1777313661d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:05.933678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f4337dea-68c4-4b62-92c9-4262b1ded3b4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:05.934443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82995dad-a72f-4334-b378-e1777313661d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:05.934627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f4337dea-68c4-4b62-92c9-4262b1ded3b4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:05.935650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82995dad-a72f-4334-b378-e1777313661d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:05.936210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82995dad-a72f-4334-b378-e1777313661d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:06.025877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4337dea-68c4-4b62-92c9-4262b1ded3b4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:06.041329 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f4337dea-68c4-4b62-92c9-4262b1ded3b4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1238 microversion: 2.1 time: 0.119533 Jul 26 14:22:06.042480 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1731/3582] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:05 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:06.048349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4b8c59f5-5c1a-4609-8c87-743d692db2af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:06.050932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4b8c59f5-5c1a-4609-8c87-743d692db2af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:06.081590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b8c59f5-5c1a-4609-8c87-743d692db2af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:06.082262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b8c59f5-5c1a-4609-8c87-743d692db2af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:06.083266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b8c59f5-5c1a-4609-8c87-743d692db2af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:06.083923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b8c59f5-5c1a-4609-8c87-743d692db2af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:06.093700 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-82995dad-a72f-4334-b378-e1777313661d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "PUT /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1074 microversion: 2.1 time: 0.184860 Jul 26 14:22:06.095405 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1852/3583] 10.222.0.70 () {60 vars in 1256 bytes} [Tue Jul 26 14:22:05 2022] PUT /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1074 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:06.104822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-670dfb3a-fed3-455f-be42-8a75c609732c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:06.107338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-670dfb3a-fed3-455f-be42-8a75c609732c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:06.113350 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-4b8c59f5-5c1a-4609-8c87-743d692db2af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4b8c59f5-5c1a-4609-8c87-743d692db2af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 HTTP/1.1 Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6'} Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:06.115400 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:06.119838 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:06.119838 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:06.119838 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:06.119838 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:06.119838 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:06.119838 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:22:06.119838 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:06.119838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4b8c59f5-5c1a-4609-8c87-743d692db2af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:06.119838 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4b8c59f5-5c1a-4609-8c87-743d692db2af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 404 len: 111 microversion: 2.1 time: 0.074806 Jul 26 14:22:06.125476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-670dfb3a-fed3-455f-be42-8a75c609732c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:06.126580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-670dfb3a-fed3-455f-be42-8a75c609732c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:06.128197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-670dfb3a-fed3-455f-be42-8a75c609732c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:06.128334 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1732/3584] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:06 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:06.129359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-670dfb3a-fed3-455f-be42-8a75c609732c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:06.136490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c71e62fc-bc11-4966-94be-5bd682c0e635 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:06.137122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c71e62fc-bc11-4966-94be-5bd682c0e635 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:06.139213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:06.146954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c71e62fc-bc11-4966-94be-5bd682c0e635 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:06.147412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c71e62fc-bc11-4966-94be-5bd682c0e635 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:06.149325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c71e62fc-bc11-4966-94be-5bd682c0e635 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:06.150095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c71e62fc-bc11-4966-94be-5bd682c0e635 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:06.192473 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-670dfb3a-fed3-455f-be42-8a75c609732c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.095556 Jul 26 14:22:06.193507 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1853/3585] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:22:06 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:06.365999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-445673471", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "01fdab58-8c00-4787-8288-5206df456cd7"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:06.416169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c71e62fc-bc11-4966-94be-5bd682c0e635 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:06.439824 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c71e62fc-bc11-4966-94be-5bd682c0e635 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1500 microversion: 2.1 time: 0.307368 Jul 26 14:22:06.441551 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1733/3586] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:06 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1500 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:06.447850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-75baacb2-aa4f-44de-a256-7cdee9dc194f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:06.447850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-75baacb2-aa4f-44de-a256-7cdee9dc194f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:06.478771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75baacb2-aa4f-44de-a256-7cdee9dc194f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:06.479605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75baacb2-aa4f-44de-a256-7cdee9dc194f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:06.481740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75baacb2-aa4f-44de-a256-7cdee9dc194f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:06.483080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75baacb2-aa4f-44de-a256-7cdee9dc194f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:06.503701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] validate_networks() for [('01fdab58-8c00-4787-8288-5206df456cd7', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:22:06.553131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-75baacb2-aa4f-44de-a256-7cdee9dc194f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:22:06.770011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:06.891620 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-75baacb2-aa4f-44de-a256-7cdee9dc194f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "DELETE /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 204 len: 0 microversion: 2.20 time: 0.447122 Jul 26 14:22:06.898606 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1734/3587] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:22:06 2022] DELETE /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:22:06.909977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-59bbc762-4b93-47bf-8ae1-6f67d0339e11 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:06.911898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-59bbc762-4b93-47bf-8ae1-6f67d0339e11 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:06.923806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59bbc762-4b93-47bf-8ae1-6f67d0339e11 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:06.924631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59bbc762-4b93-47bf-8ae1-6f67d0339e11 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:06.926139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59bbc762-4b93-47bf-8ae1-6f67d0339e11 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:06.926928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59bbc762-4b93-47bf-8ae1-6f67d0339e11 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:07.377203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-59bbc762-4b93-47bf-8ae1-6f67d0339e11 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:07.389730 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-59bbc762-4b93-47bf-8ae1-6f67d0339e11 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1500 microversion: 2.1 time: 0.487868 Jul 26 14:22:07.391518 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1735/3588] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:06 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1500 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:07.397865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d50eb20d-704a-4906-9ca9-a1d6347502f2 req-e4b539ec-3124-4af8-ba0f-81771b45e57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c584bb0a-2fbb-4014-9f21-bcb83a0068c0", "name": "network-vif-unplugged", "status": "completed", "tag": "3ba17f96-9407-49f5-8771-0ba49b9937c1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:07.429243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d50eb20d-704a-4906-9ca9-a1d6347502f2 req-e4b539ec-3124-4af8-ba0f-81771b45e57e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:07.430316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d50eb20d-704a-4906-9ca9-a1d6347502f2 req-e4b539ec-3124-4af8-ba0f-81771b45e57e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:07.467669 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d50eb20d-704a-4906-9ca9-a1d6347502f2 req-e4b539ec-3124-4af8-ba0f-81771b45e57e service nova] Creating event network-vif-unplugged:3ba17f96-9407-49f5-8771-0ba49b9937c1 for instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 on n-h1-833090-9 Jul 26 14:22:07.474993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:22:07.476316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:22:07.476488 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d50eb20d-704a-4906-9ca9-a1d6347502f2 req-e4b539ec-3124-4af8-ba0f-81771b45e57e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083539 Jul 26 14:22:07.476678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:22:07.477959 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1736/3589] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:07.483164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:22:07.484816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:22:07.487091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4a283164-7e1a-4ae0-9c24-50017c5a72b1 req-ab198e05-91db-49f6-b700-626438e15fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ac73f48-8f28-404b-a928-b01a53e1b89d", "tag": "08901702-3c35-4c24-a89f-d6e4977720ff"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:07.504129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4a283164-7e1a-4ae0-9c24-50017c5a72b1 req-ab198e05-91db-49f6-b700-626438e15fc4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:07.504907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4a283164-7e1a-4ae0-9c24-50017c5a72b1 req-ab198e05-91db-49f6-b700-626438e15fc4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:07.513194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:07.513743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:07.515856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:07.516830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:07.533478 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4a283164-7e1a-4ae0-9c24-50017c5a72b1 req-ab198e05-91db-49f6-b700-626438e15fc4 service nova] Creating event network-changed:08901702-3c35-4c24-a89f-d6e4977720ff for instance 5ac73f48-8f28-404b-a928-b01a53e1b89d on n-h2-833090-9 Jul 26 14:22:07.542572 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4a283164-7e1a-4ae0-9c24-50017c5a72b1 req-ab198e05-91db-49f6-b700-626438e15fc4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062878 Jul 26 14:22:07.543894 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1737/3590] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:07.553303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2f743e37-7cfb-42ea-b246-f30adfda1e94 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:07.554479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2f743e37-7cfb-42ea-b246-f30adfda1e94 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:07.569856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:22:07.571279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f743e37-7cfb-42ea-b246-f30adfda1e94 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:07.572086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f743e37-7cfb-42ea-b246-f30adfda1e94 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:07.573402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f743e37-7cfb-42ea-b246-f30adfda1e94 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:07.574089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f743e37-7cfb-42ea-b246-f30adfda1e94 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:07.589305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for user b1e46ed350fa42669bba323ef30b982d and project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:22:07.615498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:22:07.618763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:22:07.738495 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f921256d-27c8-462b-959b-25741f0e851c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.386934 Jul 26 14:22:07.756283 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1854/3591] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:22:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:22:07.775676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3c496bdd-391a-4428-b2d4-e8ce5287f86c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:07.775676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3c496bdd-391a-4428-b2d4-e8ce5287f86c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:07.801941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c496bdd-391a-4428-b2d4-e8ce5287f86c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:07.806259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c496bdd-391a-4428-b2d4-e8ce5287f86c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:07.808875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c496bdd-391a-4428-b2d4-e8ce5287f86c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:07.812996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c496bdd-391a-4428-b2d4-e8ce5287f86c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:08.016373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2f743e37-7cfb-42ea-b246-f30adfda1e94 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:08.038344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2f743e37-7cfb-42ea-b246-f30adfda1e94 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:08.040112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2f743e37-7cfb-42ea-b246-f30adfda1e94 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:08.041610 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2f743e37-7cfb-42ea-b246-f30adfda1e94 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1724 microversion: 2.20 time: 0.496080 Jul 26 14:22:08.059180 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1738/3592] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:07 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1724 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:08.078347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-92415ce7-2c42-41e6-8309-e3ff4fbad7dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:08.079566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-92415ce7-2c42-41e6-8309-e3ff4fbad7dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:08.091016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92415ce7-2c42-41e6-8309-e3ff4fbad7dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:08.091632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92415ce7-2c42-41e6-8309-e3ff4fbad7dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:08.092575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92415ce7-2c42-41e6-8309-e3ff4fbad7dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:08.093679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92415ce7-2c42-41e6-8309-e3ff4fbad7dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:08.280278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3c496bdd-391a-4428-b2d4-e8ce5287f86c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:08.301312 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3c496bdd-391a-4428-b2d4-e8ce5287f86c tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.542692 Jul 26 14:22:08.304013 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1855/3593] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:07 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:08.315473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2aa1f0ee-aa62-4c75-83bf-d0d37a4e67f5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:08.316214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2aa1f0ee-aa62-4c75-83bf-d0d37a4e67f5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:08.325791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aa1f0ee-aa62-4c75-83bf-d0d37a4e67f5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:08.326599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aa1f0ee-aa62-4c75-83bf-d0d37a4e67f5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:08.327792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aa1f0ee-aa62-4c75-83bf-d0d37a4e67f5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:08.328520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aa1f0ee-aa62-4c75-83bf-d0d37a4e67f5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:08.411016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-92415ce7-2c42-41e6-8309-e3ff4fbad7dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:08.420780 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-92415ce7-2c42-41e6-8309-e3ff4fbad7dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1685 microversion: 2.1 time: 0.355575 Jul 26 14:22:08.425985 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1739/3594] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:08 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1685 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:08.435832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad767a41-1816-4ccc-91aa-5ce70dc8c7a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:08.467932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad767a41-1816-4ccc-91aa-5ce70dc8c7a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:08.473649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad767a41-1816-4ccc-91aa-5ce70dc8c7a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:08.511111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ad767a41-1816-4ccc-91aa-5ce70dc8c7a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Going to try to stop instance {{(pid=119478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:22:08.565348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2aa1f0ee-aa62-4c75-83bf-d0d37a4e67f5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:08.577955 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad767a41-1816-4ccc-91aa-5ce70dc8c7a8 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "POST /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be/action" status: 202 len: 0 microversion: 2.1 time: 0.150449 Jul 26 14:22:08.581754 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1740/3595] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:22:08 2022] POST /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:22:08.584860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9a5644e7-d282-4ad3-94cd-6f6ee19cce57 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:08.585596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9a5644e7-d282-4ad3-94cd-6f6ee19cce57 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:08.596414 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2aa1f0ee-aa62-4c75-83bf-d0d37a4e67f5 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1296 microversion: 2.1 time: 0.289987 Jul 26 14:22:08.597781 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1856/3596] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:08 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1296 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:08.607667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4eb877d3-f8dd-42f0-857e-30549737f0c8 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f8786df09d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:08.722968 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4eb877d3-f8dd-42f0-857e-30549737f0c8 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/6fcb5925-a232-47a8-8a61-ba7c8a750935" status: 200 len: 350 microversion: 2.1 time: 0.121032 Jul 26 14:22:08.724188 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1857/3597] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:22:08 2022] GET /compute/v2.1/os-volumes/6fcb5925-a232-47a8-8a61-ba7c8a750935 => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:08.741854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43252e0b-ae8a-423f-9beb-334ae306dce9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:08.745614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-43252e0b-ae8a-423f-9beb-334ae306dce9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:08.759399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43252e0b-ae8a-423f-9beb-334ae306dce9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:08.765926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43252e0b-ae8a-423f-9beb-334ae306dce9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:08.766994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43252e0b-ae8a-423f-9beb-334ae306dce9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:08.770987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43252e0b-ae8a-423f-9beb-334ae306dce9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:08.822655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a5644e7-d282-4ad3-94cd-6f6ee19cce57 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:08.835665 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9a5644e7-d282-4ad3-94cd-6f6ee19cce57 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1214 microversion: 2.1 time: 0.253674 Jul 26 14:22:08.838753 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1741/3598] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:08 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1214 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:08.844756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-31dcff2f-f6bf-4c60-8767-b217ca98f7af tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f8786f45430>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:09.020101 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-31dcff2f-f6bf-4c60-8767-b217ca98f7af tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.179976 Jul 26 14:22:09.032554 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1742/3599] 10.222.0.70 () {58 vars in 1134 bytes} [Tue Jul 26 14:22:08 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:09.037858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-642e8d10-7534-4806-8e8d-8d3983cabbcf tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f8786fb8d30>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:09.139512 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-642e8d10-7534-4806-8e8d-8d3983cabbcf tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.105477 Jul 26 14:22:09.151734 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1743/3600] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Jul 26 14:22:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:09.165004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-40491631-36b0-4ecf-b3da-ad49c39c6ed6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:09.172663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-40491631-36b0-4ecf-b3da-ad49c39c6ed6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:09.209357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40491631-36b0-4ecf-b3da-ad49c39c6ed6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:09.210507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40491631-36b0-4ecf-b3da-ad49c39c6ed6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:09.214925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40491631-36b0-4ecf-b3da-ad49c39c6ed6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:09.223303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40491631-36b0-4ecf-b3da-ad49c39c6ed6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:09.676600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43252e0b-ae8a-423f-9beb-334ae306dce9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:09.685476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-40491631-36b0-4ecf-b3da-ad49c39c6ed6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:09.693475 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43252e0b-ae8a-423f-9beb-334ae306dce9 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1510 microversion: 2.1 time: 0.967927 Jul 26 14:22:09.694374 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1858/3601] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:08 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1510 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:09.712099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-40491631-36b0-4ecf-b3da-ad49c39c6ed6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:09.712937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-039bd5c7-aa98-4c8e-b3aa-4e3de5b794dc tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f8786df93a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:09.714402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-40491631-36b0-4ecf-b3da-ad49c39c6ed6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:09.716000 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-40491631-36b0-4ecf-b3da-ad49c39c6ed6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 200 len: 1724 microversion: 2.20 time: 0.564273 Jul 26 14:22:09.720011 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1744/3602] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:09 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 1724 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:09.733570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22bb9711-f759-4f32-b507-4cd72db2ce02 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:09.735215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22bb9711-f759-4f32-b507-4cd72db2ce02 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:09.763178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22bb9711-f759-4f32-b507-4cd72db2ce02 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:09.766054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22bb9711-f759-4f32-b507-4cd72db2ce02 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:09.768968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22bb9711-f759-4f32-b507-4cd72db2ce02 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:09.771150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22bb9711-f759-4f32-b507-4cd72db2ce02 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:10.002422 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-039bd5c7-aa98-4c8e-b3aa-4e3de5b794dc tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.306525 Jul 26 14:22:10.003022 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1859/3603] 10.222.0.70 () {58 vars in 1134 bytes} [Tue Jul 26 14:22:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:10.012232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74a4094b-cdcf-4bff-9d5c-d7572f394f11 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:10.012985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-74a4094b-cdcf-4bff-9d5c-d7572f394f11 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:10.030047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74a4094b-cdcf-4bff-9d5c-d7572f394f11 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:10.030631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74a4094b-cdcf-4bff-9d5c-d7572f394f11 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:10.040388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74a4094b-cdcf-4bff-9d5c-d7572f394f11 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:10.041264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74a4094b-cdcf-4bff-9d5c-d7572f394f11 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:10.881448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22bb9711-f759-4f32-b507-4cd72db2ce02 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:10.905704 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22bb9711-f759-4f32-b507-4cd72db2ce02 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 1.184112 Jul 26 14:22:10.907377 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1745/3604] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:09 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:10.920676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-088b13e8-1023-4469-990c-ff4a19335903 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:10.922755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-088b13e8-1023-4469-990c-ff4a19335903 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:10.939383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-088b13e8-1023-4469-990c-ff4a19335903 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:10.943063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-088b13e8-1023-4469-990c-ff4a19335903 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:10.944141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-088b13e8-1023-4469-990c-ff4a19335903 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:10.945058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-088b13e8-1023-4469-990c-ff4a19335903 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:11.399301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-74a4094b-cdcf-4bff-9d5c-d7572f394f11 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:11.416167 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-74a4094b-cdcf-4bff-9d5c-d7572f394f11 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 1.411720 Jul 26 14:22:11.421918 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1860/3605] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:10 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:11.434069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dd7c9887-c98b-4754-90dc-5e307d801cfd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:11.435003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dd7c9887-c98b-4754-90dc-5e307d801cfd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:11.449361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd7c9887-c98b-4754-90dc-5e307d801cfd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:11.450229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd7c9887-c98b-4754-90dc-5e307d801cfd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:11.451508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd7c9887-c98b-4754-90dc-5e307d801cfd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:11.452252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd7c9887-c98b-4754-90dc-5e307d801cfd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:11.706478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dd7c9887-c98b-4754-90dc-5e307d801cfd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:11.726754 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dd7c9887-c98b-4754-90dc-5e307d801cfd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1272 microversion: 2.1 time: 0.303099 Jul 26 14:22:11.727997 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1861/3606] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:11 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1272 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:11.735834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-602f26fa-ae59-4b13-a707-c8924741f4b3 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f87943d81f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:11.840579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-088b13e8-1023-4469-990c-ff4a19335903 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:11.851632 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-088b13e8-1023-4469-990c-ff4a19335903 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1364 microversion: 2.1 time: 0.942906 Jul 26 14:22:11.856986 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1746/3607] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:10 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1364 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:11.863813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d9ee87ca-63a4-4cc3-8622-faf0fe9315ef req-727b96b3-d53d-49d7-8ae4-f25fe7bd2033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c584bb0a-2fbb-4014-9f21-bcb83a0068c0", "name": "network-vif-plugged", "status": "completed", "tag": "3ba17f96-9407-49f5-8771-0ba49b9937c1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:11.898218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d9ee87ca-63a4-4cc3-8622-faf0fe9315ef req-727b96b3-d53d-49d7-8ae4-f25fe7bd2033 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:11.899398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d9ee87ca-63a4-4cc3-8622-faf0fe9315ef req-727b96b3-d53d-49d7-8ae4-f25fe7bd2033 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:11.942922 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d9ee87ca-63a4-4cc3-8622-faf0fe9315ef req-727b96b3-d53d-49d7-8ae4-f25fe7bd2033 service nova] Creating event network-vif-plugged:3ba17f96-9407-49f5-8771-0ba49b9937c1 for instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 on n-h1-833090-9 Jul 26 14:22:11.970868 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d9ee87ca-63a4-4cc3-8622-faf0fe9315ef req-727b96b3-d53d-49d7-8ae4-f25fe7bd2033 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112185 Jul 26 14:22:11.975613 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1747/3608] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:11.986303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b6a67ba7-ee3e-4c38-9dd7-a0f92e307a25 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:12.002203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b6a67ba7-ee3e-4c38-9dd7-a0f92e307a25 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:12.024600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a67ba7-ee3e-4c38-9dd7-a0f92e307a25 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:12.025272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a67ba7-ee3e-4c38-9dd7-a0f92e307a25 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:12.027935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a67ba7-ee3e-4c38-9dd7-a0f92e307a25 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:12.030539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a67ba7-ee3e-4c38-9dd7-a0f92e307a25 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:12.048503 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-602f26fa-ae59-4b13-a707-c8924741f4b3 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.317081 Jul 26 14:22:12.049395 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1862/3609] 10.222.0.70 () {58 vars in 1167 bytes} [Tue Jul 26 14:22:11 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:12.081468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cdc760ad-a385-4dc9-b21a-f346ade91d9d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:12.085066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cdc760ad-a385-4dc9-b21a-f346ade91d9d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:12.129404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdc760ad-a385-4dc9-b21a-f346ade91d9d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:12.131694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdc760ad-a385-4dc9-b21a-f346ade91d9d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:12.134059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdc760ad-a385-4dc9-b21a-f346ade91d9d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:12.139212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdc760ad-a385-4dc9-b21a-f346ade91d9d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:12.184438 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-cdc760ad-a385-4dc9-b21a-f346ade91d9d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] HTTP exception thrown: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cdc760ad-a385-4dc9-b21a-f346ade91d9d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Request method failure captured: Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e HTTP/1.1 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_emer31WJRgz1Hz7IpB8GyV1XoR6442Jyo-MFrCPV5O3Drqot8ZJ9SJ5-4noShgqUws1D9ByuHE-EYyJnlKllg46ni0t7dQ7ygndoOmnLeT4tRge06-lvTcURP8Efj31V_CdocTge7aBnVzyORZjj0Qkl8VsyaATYS8tAEN4nZPoDQ Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: eaa556625719414283409d2773814cf7 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eaa556625719414283409d2773814cf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eaa556625719414283409d2773814cf7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}] Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: eaa556625719414283409d2773814cf7 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8d9d1bc9d8e44404a6bf64e912fbe562 Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'be9c25cd-3b3d-4c48-b620-b7ea6101bf3e'} Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:12.193262 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:12.199493 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:12.199493 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:12.199493 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:12.199493 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:12.199493 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:12.199493 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:12.199493 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:22:12.199493 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:12.199493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cdc760ad-a385-4dc9-b21a-f346ade91d9d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Returning 404 to user: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:12.199493 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cdc760ad-a385-4dc9-b21a-f346ade91d9d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 404 len: 111 microversion: 2.20 time: 0.130843 Jul 26 14:22:12.201454 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1863/3610] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:12 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:22:12.220277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ea6902ff-06da-49ab-9034-813f94f9105d req-946dea4e-1766-42bd-9113-b5c7427cd793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9c25cd-3b3d-4c48-b620-b7ea6101bf3e", "name": "network-vif-deleted", "tag": "13068f91-4844-4f82-95a3-ee7530c55d60"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:12.241167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ea6902ff-06da-49ab-9034-813f94f9105d req-946dea4e-1766-42bd-9113-b5c7427cd793 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:12.241923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ea6902ff-06da-49ab-9034-813f94f9105d req-946dea4e-1766-42bd-9113-b5c7427cd793 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:12.261868 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ea6902ff-06da-49ab-9034-813f94f9105d req-946dea4e-1766-42bd-9113-b5c7427cd793 service nova] Creating event network-vif-deleted:13068f91-4844-4f82-95a3-ee7530c55d60 for instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e on n-h1-833090-9 Jul 26 14:22:12.269714 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ea6902ff-06da-49ab-9034-813f94f9105d req-946dea4e-1766-42bd-9113-b5c7427cd793 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067881 Jul 26 14:22:12.271014 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1864/3611] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:12.279166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e81f625d-1293-4ba0-9de3-bcc96ebbb600 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:12.280256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e81f625d-1293-4ba0-9de3-bcc96ebbb600 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:12.291648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e81f625d-1293-4ba0-9de3-bcc96ebbb600 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:12.292346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e81f625d-1293-4ba0-9de3-bcc96ebbb600 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:12.294043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e81f625d-1293-4ba0-9de3-bcc96ebbb600 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:12.294696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e81f625d-1293-4ba0-9de3-bcc96ebbb600 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:12.680399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b6a67ba7-ee3e-4c38-9dd7-a0f92e307a25 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:12.699865 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b6a67ba7-ee3e-4c38-9dd7-a0f92e307a25 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1510 microversion: 2.1 time: 0.722054 Jul 26 14:22:12.700645 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1748/3612] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:11 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1510 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:12.721171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86273f67-f951-40be-915d-bad491297649 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f87944c40d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:12.857742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e81f625d-1293-4ba0-9de3-bcc96ebbb600 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:12.882337 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e81f625d-1293-4ba0-9de3-bcc96ebbb600 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 0.601567 Jul 26 14:22:12.888530 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1865/3613] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:12 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:12.905324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-22f6e7d0-6fb3-4f74-b094-39e770c5b17b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '.version_select at 0x7f87876daca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:12.956822 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-22f6e7d0-6fb3-4f74-b094-39e770c5b17b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061777975" status: 204 len: 0 microversion: 2.20 time: 0.065661 Jul 26 14:22:12.958114 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1866/3614] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Jul 26 14:22:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061777975 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:22:12.969878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-20b5db7c-b7cc-4ad4-a665-9f4c0d4bc526 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:12.971754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-20b5db7c-b7cc-4ad4-a665-9f4c0d4bc526 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:12.994653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20b5db7c-b7cc-4ad4-a665-9f4c0d4bc526 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:12.995203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20b5db7c-b7cc-4ad4-a665-9f4c0d4bc526 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:12.996158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20b5db7c-b7cc-4ad4-a665-9f4c0d4bc526 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:12.997331 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-86273f67-f951-40be-915d-bad491297649 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.283657 Jul 26 14:22:12.997823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20b5db7c-b7cc-4ad4-a665-9f4c0d4bc526 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:12.998974 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1749/3615] 10.222.0.70 () {58 vars in 1170 bytes} [Tue Jul 26 14:22:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:13.012632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fde1e386-d208-471f-b39f-6de51dcb3087 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:13.013741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fde1e386-d208-471f-b39f-6de51dcb3087 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:13.034395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fde1e386-d208-471f-b39f-6de51dcb3087 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:13.035518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fde1e386-d208-471f-b39f-6de51dcb3087 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:13.037116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fde1e386-d208-471f-b39f-6de51dcb3087 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:13.038113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fde1e386-d208-471f-b39f-6de51dcb3087 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:13.458759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fde1e386-d208-471f-b39f-6de51dcb3087 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:13.472384 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fde1e386-d208-471f-b39f-6de51dcb3087 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1272 microversion: 2.1 time: 0.471102 Jul 26 14:22:13.485510 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1750/3616] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:12 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1272 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:13.493927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-69a910cb-b2a1-4595-a90e-f3ce6d987c93 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:13.495351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-69a910cb-b2a1-4595-a90e-f3ce6d987c93 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:13.504796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69a910cb-b2a1-4595-a90e-f3ce6d987c93 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:13.505754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69a910cb-b2a1-4595-a90e-f3ce6d987c93 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:13.507661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69a910cb-b2a1-4595-a90e-f3ce6d987c93 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:13.508571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69a910cb-b2a1-4595-a90e-f3ce6d987c93 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:13.840875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-20b5db7c-b7cc-4ad4-a665-9f4c0d4bc526 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:13.851910 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-20b5db7c-b7cc-4ad4-a665-9f4c0d4bc526 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 0.892370 Jul 26 14:22:13.852738 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1867/3617] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:12 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:13.866344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4eeebc9-ebab-4adb-b4b6-93e3fb9ab102 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f8786df0700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:13.994635 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4eeebc9-ebab-4adb-b4b6-93e3fb9ab102 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.140258 Jul 26 14:22:13.995330 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1868/3618] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:22:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:14.002779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6f40dbd7-c76a-4aca-9879-23d3368db2dd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:14.006193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6f40dbd7-c76a-4aca-9879-23d3368db2dd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:14.033511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f40dbd7-c76a-4aca-9879-23d3368db2dd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:14.036608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f40dbd7-c76a-4aca-9879-23d3368db2dd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:14.037477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f40dbd7-c76a-4aca-9879-23d3368db2dd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:14.037998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f40dbd7-c76a-4aca-9879-23d3368db2dd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:14.165649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-69a910cb-b2a1-4595-a90e-f3ce6d987c93 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:14.190917 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-69a910cb-b2a1-4595-a90e-f3ce6d987c93 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1364 microversion: 2.1 time: 0.704108 Jul 26 14:22:14.191534 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1751/3619] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:13 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1364 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:14.222344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b0f6007-ba33-4d0e-9c0c-9e28e92c471e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:14.223512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b0f6007-ba33-4d0e-9c0c-9e28e92c471e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:14.246469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0f6007-ba33-4d0e-9c0c-9e28e92c471e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:14.247230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0f6007-ba33-4d0e-9c0c-9e28e92c471e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:14.258425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0f6007-ba33-4d0e-9c0c-9e28e92c471e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:14.259160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0f6007-ba33-4d0e-9c0c-9e28e92c471e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:15.020295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6f40dbd7-c76a-4aca-9879-23d3368db2dd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:15.037262 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6f40dbd7-c76a-4aca-9879-23d3368db2dd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1510 microversion: 2.1 time: 1.040215 Jul 26 14:22:15.039223 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1869/3620] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:13 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1510 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:15.050173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b5524a47-d221-4c2a-a0e1-9e01749cabb6 req-8d6e3d40-6d92-4197-86c2-9257ad7f08e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac73f48-8f28-404b-a928-b01a53e1b89d", "name": "network-vif-unplugged", "status": "completed", "tag": "08901702-3c35-4c24-a89f-d6e4977720ff"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:15.070828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b5524a47-d221-4c2a-a0e1-9e01749cabb6 req-8d6e3d40-6d92-4197-86c2-9257ad7f08e3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:15.071713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b5524a47-d221-4c2a-a0e1-9e01749cabb6 req-8d6e3d40-6d92-4197-86c2-9257ad7f08e3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:15.087587 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b5524a47-d221-4c2a-a0e1-9e01749cabb6 req-8d6e3d40-6d92-4197-86c2-9257ad7f08e3 service nova] Creating event network-vif-unplugged:08901702-3c35-4c24-a89f-d6e4977720ff for instance 5ac73f48-8f28-404b-a928-b01a53e1b89d on n-h1-833090-9 Jul 26 14:22:15.096480 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b5524a47-d221-4c2a-a0e1-9e01749cabb6 req-8d6e3d40-6d92-4197-86c2-9257ad7f08e3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054672 Jul 26 14:22:15.105105 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1870/3621] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:15.114359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9223f37c-8806-47f7-a17d-4a80264410c3 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f87876a78b0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:15.221644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b0f6007-ba33-4d0e-9c0c-9e28e92c471e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:15.250720 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b0f6007-ba33-4d0e-9c0c-9e28e92c471e tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1391 microversion: 2.1 time: 1.047828 Jul 26 14:22:15.255501 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1752/3622] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:14 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1391 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:15.288930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9cfd3d8f-d70e-491d-9057-2b1c116229da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:15.292434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9cfd3d8f-d70e-491d-9057-2b1c116229da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:15.310897 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9223f37c-8806-47f7-a17d-4a80264410c3 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.203603 Jul 26 14:22:15.313007 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1871/3623] 10.222.0.70 () {58 vars in 1188 bytes} [Tue Jul 26 14:22:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:15.325157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c687808b-5f3a-4d69-89f2-20fe9560c3d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:15.326012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c687808b-5f3a-4d69-89f2-20fe9560c3d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:15.344304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9cfd3d8f-d70e-491d-9057-2b1c116229da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:15.351729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9cfd3d8f-d70e-491d-9057-2b1c116229da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:15.360104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9cfd3d8f-d70e-491d-9057-2b1c116229da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:15.367360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9cfd3d8f-d70e-491d-9057-2b1c116229da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:15.395200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c687808b-5f3a-4d69-89f2-20fe9560c3d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:15.407721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c687808b-5f3a-4d69-89f2-20fe9560c3d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:15.411057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c687808b-5f3a-4d69-89f2-20fe9560c3d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:15.411634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c687808b-5f3a-4d69-89f2-20fe9560c3d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:16.453761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9cfd3d8f-d70e-491d-9057-2b1c116229da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:16.496480 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9cfd3d8f-d70e-491d-9057-2b1c116229da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1314 microversion: 2.1 time: 1.229761 Jul 26 14:22:16.503561 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1753/3624] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:15 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:16.511005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-545e3a0b-99fb-4ca6-90cb-6a9bf40ec34b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:16.511861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-545e3a0b-99fb-4ca6-90cb-6a9bf40ec34b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:16.544681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-545e3a0b-99fb-4ca6-90cb-6a9bf40ec34b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:16.547857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-545e3a0b-99fb-4ca6-90cb-6a9bf40ec34b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:16.548957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-545e3a0b-99fb-4ca6-90cb-6a9bf40ec34b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:16.549792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-545e3a0b-99fb-4ca6-90cb-6a9bf40ec34b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:16.571166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c687808b-5f3a-4d69-89f2-20fe9560c3d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:16.595009 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c687808b-5f3a-4d69-89f2-20fe9560c3d5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 1.280612 Jul 26 14:22:16.611562 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1872/3625] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:15 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:16.622153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a4d4b42f-68fa-47b0-a740-592bbfe75e69 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] Calling method '.version_select at 0x7f8786df03a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:16.760387 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a4d4b42f-68fa-47b0-a740-592bbfe75e69 tempest-VolumesTestJSON-258531112 tempest-VolumesTestJSON-258531112-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.147310 Jul 26 14:22:16.761266 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1873/3626] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:22:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:16.771975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ae399344-7480-47f6-b6e2-d6c7f764344d req-9e635c9b-b31b-47b1-bc6d-8c747e129269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049", "tag": "586f4682-9ae3-4429-bffc-65da24439ea0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:16.792635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ae399344-7480-47f6-b6e2-d6c7f764344d req-9e635c9b-b31b-47b1-bc6d-8c747e129269 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:16.810501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ae399344-7480-47f6-b6e2-d6c7f764344d req-9e635c9b-b31b-47b1-bc6d-8c747e129269 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:16.810501 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ae399344-7480-47f6-b6e2-d6c7f764344d req-9e635c9b-b31b-47b1-bc6d-8c747e129269 service nova] Creating event network-changed:586f4682-9ae3-4429-bffc-65da24439ea0 for instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 on n-h2-833090-9 Jul 26 14:22:16.823760 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ae399344-7480-47f6-b6e2-d6c7f764344d req-9e635c9b-b31b-47b1-bc6d-8c747e129269 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060080 Jul 26 14:22:16.824979 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1874/3627] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:16.835734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a8b8e51e-3ca5-41d7-82dc-09727866f425 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:16.836776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a8b8e51e-3ca5-41d7-82dc-09727866f425 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:16.851741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8b8e51e-3ca5-41d7-82dc-09727866f425 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:16.856534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8b8e51e-3ca5-41d7-82dc-09727866f425 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:16.859268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8b8e51e-3ca5-41d7-82dc-09727866f425 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:16.862163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8b8e51e-3ca5-41d7-82dc-09727866f425 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:17.270692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-545e3a0b-99fb-4ca6-90cb-6a9bf40ec34b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:17.292740 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-545e3a0b-99fb-4ca6-90cb-6a9bf40ec34b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1364 microversion: 2.1 time: 0.787926 Jul 26 14:22:17.294752 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1754/3628] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:16 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1364 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:17.305661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-69e5e271-0a56-4c72-a227-fa95113d80bf tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:17.307280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-69e5e271-0a56-4c72-a227-fa95113d80bf tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:17.324237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69e5e271-0a56-4c72-a227-fa95113d80bf tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:17.324958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69e5e271-0a56-4c72-a227-fa95113d80bf tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:17.326316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69e5e271-0a56-4c72-a227-fa95113d80bf tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:17.326974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69e5e271-0a56-4c72-a227-fa95113d80bf tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:17.541222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:17.603229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:17.657122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a8b8e51e-3ca5-41d7-82dc-09727866f425 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:17.676858 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a8b8e51e-3ca5-41d7-82dc-09727866f425 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1510 microversion: 2.1 time: 0.845171 Jul 26 14:22:17.691238 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1875/3629] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:16 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1510 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:17.698939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d73589e0-a5c7-4772-ba57-886e6af04911 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Action: 'create', calling method: .version_select at 0x7f8786df9af0>, body: {"keypair": {"name": "tempest-keypair-207836996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUss0l85VO1se6h/+s4vSfhvH3vAOsGYgXJxYpsj1Wepz3ETHHyDxOaI1xFk798nPOmfT9cx5swrbu176/lTlZfRZUb6sHL3p9kHoM4ve3jGVQCBnD67QIPWIYqh3pTtQ=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:17.708854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:17.731186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d73589e0-a5c7-4772-ba57-886e6af04911 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Getting quotas for project eaa556625719414283409d2773814cf7. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:22:17.739124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d73589e0-a5c7-4772-ba57-886e6af04911 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Getting quotas for user 8d9d1bc9d8e44404a6bf64e912fbe562 and project eaa556625719414283409d2773814cf7. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:22:17.790632 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d73589e0-a5c7-4772-ba57-886e6af04911 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.099343 Jul 26 14:22:17.800764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-69e5e271-0a56-4c72-a227-fa95113d80bf tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:17.810997 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1876/3630] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Jul 26 14:22:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 14:22:17.812834 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-69e5e271-0a56-4c72-a227-fa95113d80bf tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1381 microversion: 2.1 time: 0.512411 Jul 26 14:22:17.826670 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1755/3631] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:17 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1381 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:17.839580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-12253225-12cd-47b4-bbda-2ec571009bbc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:17.840256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-12253225-12cd-47b4-bbda-2ec571009bbc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:17.842283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-90a3abed-f35b-4a98-bca1-577fe4b0058a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:17.844782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-90a3abed-f35b-4a98-bca1-577fe4b0058a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:17.857626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12253225-12cd-47b4-bbda-2ec571009bbc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:17.858542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12253225-12cd-47b4-bbda-2ec571009bbc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:17.860426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12253225-12cd-47b4-bbda-2ec571009bbc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:17.861076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12253225-12cd-47b4-bbda-2ec571009bbc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:17.878733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90a3abed-f35b-4a98-bca1-577fe4b0058a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:17.879902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90a3abed-f35b-4a98-bca1-577fe4b0058a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:17.880761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90a3abed-f35b-4a98-bca1-577fe4b0058a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:17.881202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90a3abed-f35b-4a98-bca1-577fe4b0058a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:17.948280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:18.300369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-12253225-12cd-47b4-bbda-2ec571009bbc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:18.320020 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-12253225-12cd-47b4-bbda-2ec571009bbc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1314 microversion: 2.1 time: 0.505424 Jul 26 14:22:18.322588 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1877/3632] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:17 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:18.339811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-55faf6ac-6b49-4aa6-9621-9905e9d6658d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '.version_select at 0x7f8794540550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:18.364454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-55faf6ac-6b49-4aa6-9621-9905e9d6658d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:18.366446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-55faf6ac-6b49-4aa6-9621-9905e9d6658d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:18.386367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:18.399638 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-55faf6ac-6b49-4aa6-9621-9905e9d6658d tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1555 microversion: 2.1 time: 0.075533 Jul 26 14:22:18.402679 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1878/3633] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:22:18 2022] GET /compute/v2.1/os-migrations => generated 1555 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:18.430337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-90a3abed-f35b-4a98-bca1-577fe4b0058a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:18.448048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b1bde0e-57bc-4964-a1c5-106a1588d982 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:18.452015 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-90a3abed-f35b-4a98-bca1-577fe4b0058a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 0.622259 Jul 26 14:22:18.455244 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1756/3634] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:17 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:18.456554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7b1bde0e-57bc-4964-a1c5-106a1588d982 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:18.477270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1b7ee7e2-75b6-418c-b0ae-bce772d6565e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:18.479687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1b7ee7e2-75b6-418c-b0ae-bce772d6565e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:18.488702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b1bde0e-57bc-4964-a1c5-106a1588d982 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:18.489307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b1bde0e-57bc-4964-a1c5-106a1588d982 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:18.490010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b1bde0e-57bc-4964-a1c5-106a1588d982 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:18.494512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b1bde0e-57bc-4964-a1c5-106a1588d982 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:18.506410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b7ee7e2-75b6-418c-b0ae-bce772d6565e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:18.506954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b7ee7e2-75b6-418c-b0ae-bce772d6565e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:18.507789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b7ee7e2-75b6-418c-b0ae-bce772d6565e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:18.512752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b7ee7e2-75b6-418c-b0ae-bce772d6565e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:18.831403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:19.041443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b1bde0e-57bc-4964-a1c5-106a1588d982 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:19.053423 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b1bde0e-57bc-4964-a1c5-106a1588d982 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1364 microversion: 2.1 time: 0.633025 Jul 26 14:22:19.072776 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1879/3635] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:18 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1364 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:19.081857 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1b7ee7e2-75b6-418c-b0ae-bce772d6565e tempest-LiveMigrationTest-193814521 tempest-LiveMigrationTest-193814521-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1532 microversion: 2.1 time: 0.621828 Jul 26 14:22:19.082455 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1757/3636] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:18 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1532 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:19.090876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5e3a73c0-849f-44ef-a5a1-acbe4feb23d6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:19.090876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5e3a73c0-849f-44ef-a5a1-acbe4feb23d6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:19.116079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e3a73c0-849f-44ef-a5a1-acbe4feb23d6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:19.118597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e3a73c0-849f-44ef-a5a1-acbe4feb23d6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:19.124415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e3a73c0-849f-44ef-a5a1-acbe4feb23d6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:19.125568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e3a73c0-849f-44ef-a5a1-acbe4feb23d6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:19.146731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e9798d0f-16bb-480d-b256-138b248018d6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:19.152681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e9798d0f-16bb-480d-b256-138b248018d6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:19.207603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9798d0f-16bb-480d-b256-138b248018d6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:19.208613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9798d0f-16bb-480d-b256-138b248018d6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:19.209921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9798d0f-16bb-480d-b256-138b248018d6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:19.211404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9798d0f-16bb-480d-b256-138b248018d6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:19.305366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e9798d0f-16bb-480d-b256-138b248018d6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:22:19.541319 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e9798d0f-16bb-480d-b256-138b248018d6 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 204 len: 0 microversion: 2.1 time: 0.407304 Jul 26 14:22:19.543347 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1758/3637] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:19 2022] DELETE /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:22:19.558222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-dfb78791-b0ea-4fd1-9f10-9759a642a5c1 req-3e64e711-cd34-4ebb-ac43-f7a7f91e722f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35be98ed-040c-424a-ba1f-945630e1de71", "tag": "40755b30-ef72-4e58-a2d2-9f02f4d4250d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:19.570726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-dfb78791-b0ea-4fd1-9f10-9759a642a5c1 req-3e64e711-cd34-4ebb-ac43-f7a7f91e722f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:19.572792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-dfb78791-b0ea-4fd1-9f10-9759a642a5c1 req-3e64e711-cd34-4ebb-ac43-f7a7f91e722f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:19.610731 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-dfb78791-b0ea-4fd1-9f10-9759a642a5c1 req-3e64e711-cd34-4ebb-ac43-f7a7f91e722f service nova] Creating event network-changed:40755b30-ef72-4e58-a2d2-9f02f4d4250d for instance 35be98ed-040c-424a-ba1f-945630e1de71 on n-h1-833090-9 Jul 26 14:22:19.616412 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-dfb78791-b0ea-4fd1-9f10-9759a642a5c1 req-3e64e711-cd34-4ebb-ac43-f7a7f91e722f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070864 Jul 26 14:22:19.617761 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1759/3638] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:19.623520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bc34d33b-e4d8-4498-8427-0841641abbd9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:19.624695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bc34d33b-e4d8-4498-8427-0841641abbd9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:19.632294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc34d33b-e4d8-4498-8427-0841641abbd9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:19.633210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc34d33b-e4d8-4498-8427-0841641abbd9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:19.634435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc34d33b-e4d8-4498-8427-0841641abbd9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:19.635360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc34d33b-e4d8-4498-8427-0841641abbd9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:19.825383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5e3a73c0-849f-44ef-a5a1-acbe4feb23d6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:19.837859 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5e3a73c0-849f-44ef-a5a1-acbe4feb23d6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1510 microversion: 2.1 time: 0.762136 Jul 26 14:22:19.856378 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1880/3639] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:19 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1510 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:19.864926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2bf189cb-cf6f-4936-87dd-d3863e1d1816 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:19.866336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2bf189cb-cf6f-4936-87dd-d3863e1d1816 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:19.874008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bf189cb-cf6f-4936-87dd-d3863e1d1816 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:19.876099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bf189cb-cf6f-4936-87dd-d3863e1d1816 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:19.880319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bf189cb-cf6f-4936-87dd-d3863e1d1816 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:19.881295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bf189cb-cf6f-4936-87dd-d3863e1d1816 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:20.463125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bc34d33b-e4d8-4498-8427-0841641abbd9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:20.484887 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bc34d33b-e4d8-4498-8427-0841641abbd9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1314 microversion: 2.1 time: 0.864513 Jul 26 14:22:20.485387 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1760/3640] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:19 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:20.496894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eaf0a843-96c0-40c7-b562-52c7c8f99202 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:20.497512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eaf0a843-96c0-40c7-b562-52c7c8f99202 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:20.544075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaf0a843-96c0-40c7-b562-52c7c8f99202 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:20.545771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaf0a843-96c0-40c7-b562-52c7c8f99202 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:20.549413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaf0a843-96c0-40c7-b562-52c7c8f99202 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:20.551716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaf0a843-96c0-40c7-b562-52c7c8f99202 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:21.284768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2bf189cb-cf6f-4936-87dd-d3863e1d1816 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:21.288115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-eaf0a843-96c0-40c7-b562-52c7c8f99202 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:21.307351 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2bf189cb-cf6f-4936-87dd-d3863e1d1816 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 1.449197 Jul 26 14:22:21.324811 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1881/3641] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:19 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:21.357793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db8c63ae-b68c-4c98-8da2-74b9458e6922 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:21.360173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-db8c63ae-b68c-4c98-8da2-74b9458e6922 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:21.362159 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eaf0a843-96c0-40c7-b562-52c7c8f99202 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1345 microversion: 2.1 time: 0.868749 Jul 26 14:22:21.376099 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1761/3642] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:20 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1345 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:21.410690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db8c63ae-b68c-4c98-8da2-74b9458e6922 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:21.433640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db8c63ae-b68c-4c98-8da2-74b9458e6922 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:21.434497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db8c63ae-b68c-4c98-8da2-74b9458e6922 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:21.434947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db8c63ae-b68c-4c98-8da2-74b9458e6922 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:22.067313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8209c2d1-518e-4097-8e04-1698a88dee24 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:22.070749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8209c2d1-518e-4097-8e04-1698a88dee24 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:22.085907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8209c2d1-518e-4097-8e04-1698a88dee24 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:22.093594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8209c2d1-518e-4097-8e04-1698a88dee24 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:22.094907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8209c2d1-518e-4097-8e04-1698a88dee24 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:22.095989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8209c2d1-518e-4097-8e04-1698a88dee24 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:22.174201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8209c2d1-518e-4097-8e04-1698a88dee24 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:22:22.486831 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8209c2d1-518e-4097-8e04-1698a88dee24 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 204 len: 0 microversion: 2.32 time: 1.119874 Jul 26 14:22:22.487858 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1762/3643] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:22:21 2022] DELETE /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 0 bytes in 1124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:22:22.525586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae17c496-1236-42f8-b47e-6df82008818e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:22.528496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ae17c496-1236-42f8-b47e-6df82008818e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:22.558096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae17c496-1236-42f8-b47e-6df82008818e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:22.560725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae17c496-1236-42f8-b47e-6df82008818e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:22.569552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae17c496-1236-42f8-b47e-6df82008818e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:22.572843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae17c496-1236-42f8-b47e-6df82008818e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:23.551302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-db8c63ae-b68c-4c98-8da2-74b9458e6922 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:23.576568 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db8c63ae-b68c-4c98-8da2-74b9458e6922 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1364 microversion: 2.1 time: 2.250817 Jul 26 14:22:23.577188 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1882/3644] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:21 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1364 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:23.599915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1e15edd0-01a8-4009-b816-32b32f5e8248 req-797a0e6c-f243-42a6-b80a-b22dd56cc4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ac73f48-8f28-404b-a928-b01a53e1b89d", "name": "network-vif-deleted", "tag": "08901702-3c35-4c24-a89f-d6e4977720ff"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:23.627033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1e15edd0-01a8-4009-b816-32b32f5e8248 req-797a0e6c-f243-42a6-b80a-b22dd56cc4ef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:23.627505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1e15edd0-01a8-4009-b816-32b32f5e8248 req-797a0e6c-f243-42a6-b80a-b22dd56cc4ef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:23.664659 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1e15edd0-01a8-4009-b816-32b32f5e8248 req-797a0e6c-f243-42a6-b80a-b22dd56cc4ef service nova] Creating event network-vif-deleted:08901702-3c35-4c24-a89f-d6e4977720ff for instance 5ac73f48-8f28-404b-a928-b01a53e1b89d on n-h1-833090-9 Jul 26 14:22:23.684714 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1e15edd0-01a8-4009-b816-32b32f5e8248 req-797a0e6c-f243-42a6-b80a-b22dd56cc4ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104632 Jul 26 14:22:23.685876 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1883/3645] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:23.695783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27a4c782-d515-4360-b981-ccd2e9840b6a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:23.696570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27a4c782-d515-4360-b981-ccd2e9840b6a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:23.717825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27a4c782-d515-4360-b981-ccd2e9840b6a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:23.718912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27a4c782-d515-4360-b981-ccd2e9840b6a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:23.720177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27a4c782-d515-4360-b981-ccd2e9840b6a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:23.721066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27a4c782-d515-4360-b981-ccd2e9840b6a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:23.879935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ae17c496-1236-42f8-b47e-6df82008818e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:23.919785 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ae17c496-1236-42f8-b47e-6df82008818e tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1510 microversion: 2.1 time: 1.430504 Jul 26 14:22:23.922407 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1763/3646] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:22 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1510 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:23.958445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1b6d4617-4a7b-4a9a-9791-8a0f03541ced tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:23.959137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1b6d4617-4a7b-4a9a-9791-8a0f03541ced tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:24.005001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b6d4617-4a7b-4a9a-9791-8a0f03541ced tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:24.005666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b6d4617-4a7b-4a9a-9791-8a0f03541ced tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:24.006743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b6d4617-4a7b-4a9a-9791-8a0f03541ced tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:24.007366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b6d4617-4a7b-4a9a-9791-8a0f03541ced tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:24.618044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27a4c782-d515-4360-b981-ccd2e9840b6a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:24.653860 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27a4c782-d515-4360-b981-ccd2e9840b6a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1314 microversion: 2.1 time: 0.965396 Jul 26 14:22:24.657299 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1884/3647] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:23 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1314 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:24.667397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-19cc1600-316e-4d79-8cc4-406c378ac72f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:24.669994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-19cc1600-316e-4d79-8cc4-406c378ac72f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:24.685331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19cc1600-316e-4d79-8cc4-406c378ac72f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:24.685849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19cc1600-316e-4d79-8cc4-406c378ac72f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:24.686652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19cc1600-316e-4d79-8cc4-406c378ac72f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:24.689271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19cc1600-316e-4d79-8cc4-406c378ac72f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:24.755116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1b6d4617-4a7b-4a9a-9791-8a0f03541ced tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:24.771656 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1b6d4617-4a7b-4a9a-9791-8a0f03541ced tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 0.847034 Jul 26 14:22:24.772721 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1764/3648] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:23 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:24.777698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6d1c53b-e977-47be-bee5-d490626aed9c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:24.786736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e6d1c53b-e977-47be-bee5-d490626aed9c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:24.806770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6d1c53b-e977-47be-bee5-d490626aed9c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:24.807583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6d1c53b-e977-47be-bee5-d490626aed9c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:24.823374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6d1c53b-e977-47be-bee5-d490626aed9c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:24.823883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6d1c53b-e977-47be-bee5-d490626aed9c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:24.830971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-19cc1600-316e-4d79-8cc4-406c378ac72f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:24.850494 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-19cc1600-316e-4d79-8cc4-406c378ac72f tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1184 microversion: 2.1 time: 0.190745 Jul 26 14:22:24.861094 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1885/3649] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:24 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1184 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:24.866304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ed84796b-c670-4ddb-9880-8fdb6fd78f44 req-1ff6986a-13bc-4d3d-a152-cf0fcfdd50f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049", "name": "network-vif-plugged", "status": "completed", "tag": "586f4682-9ae3-4429-bffc-65da24439ea0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:24.887249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ed84796b-c670-4ddb-9880-8fdb6fd78f44 req-1ff6986a-13bc-4d3d-a152-cf0fcfdd50f5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:24.888042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ed84796b-c670-4ddb-9880-8fdb6fd78f44 req-1ff6986a-13bc-4d3d-a152-cf0fcfdd50f5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:24.908426 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ed84796b-c670-4ddb-9880-8fdb6fd78f44 req-1ff6986a-13bc-4d3d-a152-cf0fcfdd50f5 service nova] Creating event network-vif-plugged:586f4682-9ae3-4429-bffc-65da24439ea0 for instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 on n-h2-833090-9 Jul 26 14:22:24.913914 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ed84796b-c670-4ddb-9880-8fdb6fd78f44 req-1ff6986a-13bc-4d3d-a152-cf0fcfdd50f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051218 Jul 26 14:22:24.918620 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1886/3650] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:24.932575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5cffb29-61d5-4d8d-b937-5b9d906b916d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:24.933298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d5cffb29-61d5-4d8d-b937-5b9d906b916d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:24.943410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5cffb29-61d5-4d8d-b937-5b9d906b916d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:24.944223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5cffb29-61d5-4d8d-b937-5b9d906b916d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:24.945353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5cffb29-61d5-4d8d-b937-5b9d906b916d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:24.945837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5cffb29-61d5-4d8d-b937-5b9d906b916d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:25.297692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6d1c53b-e977-47be-bee5-d490626aed9c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:25.318951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6d1c53b-e977-47be-bee5-d490626aed9c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:25.321942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6d1c53b-e977-47be-bee5-d490626aed9c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:25.324881 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6d1c53b-e977-47be-bee5-d490626aed9c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 2948 microversion: 2.32 time: 0.551013 Jul 26 14:22:25.331618 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1765/3651] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:24 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 2948 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:25.345872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7d3342e-15f0-4e29-bb84-244b4f127a35 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:25.346990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c7d3342e-15f0-4e29-bb84-244b4f127a35 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:25.362950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7d3342e-15f0-4e29-bb84-244b4f127a35 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:25.364217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7d3342e-15f0-4e29-bb84-244b4f127a35 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:25.368151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7d3342e-15f0-4e29-bb84-244b4f127a35 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:25.369319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7d3342e-15f0-4e29-bb84-244b4f127a35 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:25.753538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d5cffb29-61d5-4d8d-b937-5b9d906b916d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:25.770490 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5cffb29-61d5-4d8d-b937-5b9d906b916d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1364 microversion: 2.1 time: 0.849633 Jul 26 14:22:25.774291 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1887/3652] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:24 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1364 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:25.792641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29345c63-93be-4ac7-9ce8-8c85afef0f9c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:25.793603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-29345c63-93be-4ac7-9ce8-8c85afef0f9c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:25.810438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29345c63-93be-4ac7-9ce8-8c85afef0f9c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:25.811211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29345c63-93be-4ac7-9ce8-8c85afef0f9c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:25.812384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29345c63-93be-4ac7-9ce8-8c85afef0f9c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:25.813020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29345c63-93be-4ac7-9ce8-8c85afef0f9c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:26.244870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c7d3342e-15f0-4e29-bb84-244b4f127a35 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:26.293227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-29345c63-93be-4ac7-9ce8-8c85afef0f9c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:26.306966 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c7d3342e-15f0-4e29-bb84-244b4f127a35 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1510 microversion: 2.1 time: 0.973431 Jul 26 14:22:26.308064 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1766/3653] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:25 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1510 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:26.326090 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-29345c63-93be-4ac7-9ce8-8c85afef0f9c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1314 microversion: 2.1 time: 0.549649 Jul 26 14:22:26.336475 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1888/3654] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:25 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:26.339218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a80aa4cc-8525-4758-9822-725300d7d8f1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:26.361265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a80aa4cc-8525-4758-9822-725300d7d8f1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:26.377754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a80aa4cc-8525-4758-9822-725300d7d8f1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:26.378977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d8d9807-293f-4586-a9a5-aaee621a0007 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:26.380180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2d8d9807-293f-4586-a9a5-aaee621a0007 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:26.384262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a80aa4cc-8525-4758-9822-725300d7d8f1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:26.386393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a80aa4cc-8525-4758-9822-725300d7d8f1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:26.387454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a80aa4cc-8525-4758-9822-725300d7d8f1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:26.423903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d8d9807-293f-4586-a9a5-aaee621a0007 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:26.424639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d8d9807-293f-4586-a9a5-aaee621a0007 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:26.425904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d8d9807-293f-4586-a9a5-aaee621a0007 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:26.426612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d8d9807-293f-4586-a9a5-aaee621a0007 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:26.641906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2d8d9807-293f-4586-a9a5-aaee621a0007 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:26.666430 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d8d9807-293f-4586-a9a5-aaee621a0007 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1184 microversion: 2.1 time: 0.328293 Jul 26 14:22:26.678641 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1889/3655] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:26 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1184 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:26.699634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f4d7b801-b891-47af-a766-c7a3c52bf1dc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:26.700612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f4d7b801-b891-47af-a766-c7a3c52bf1dc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:26.734188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4d7b801-b891-47af-a766-c7a3c52bf1dc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:26.734936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4d7b801-b891-47af-a766-c7a3c52bf1dc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:26.736172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4d7b801-b891-47af-a766-c7a3c52bf1dc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:26.736642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4d7b801-b891-47af-a766-c7a3c52bf1dc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:26.789752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a80aa4cc-8525-4758-9822-725300d7d8f1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:26.805745 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a80aa4cc-8525-4758-9822-725300d7d8f1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 0.488512 Jul 26 14:22:26.829108 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1767/3656] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:26 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:26.857428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1320263528", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04761f16-862f-4701-bf1c-36d698a99d99"}], "security_groups": [{"name": "tempest-securitygroup--1132221850"}], "key_name": "tempest-keypair-207836996", "user_data": "}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:27.217454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] validate_networks() for [('04761f16-862f-4701-bf1c-36d698a99d99', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:22:27.503644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f4d7b801-b891-47af-a766-c7a3c52bf1dc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:27.527664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f4d7b801-b891-47af-a766-c7a3c52bf1dc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:27.538039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f4d7b801-b891-47af-a766-c7a3c52bf1dc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:27.539549 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f4d7b801-b891-47af-a766-c7a3c52bf1dc tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 2948 microversion: 2.32 time: 0.859930 Jul 26 14:22:27.544692 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1890/3657] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:26 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 2948 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:27.575329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f29351c2-cd34-4fa7-b5a6-31973dc02baf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:27.576177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f29351c2-cd34-4fa7-b5a6-31973dc02baf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:27.601607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f29351c2-cd34-4fa7-b5a6-31973dc02baf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:27.602168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f29351c2-cd34-4fa7-b5a6-31973dc02baf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:27.604586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f29351c2-cd34-4fa7-b5a6-31973dc02baf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:27.604586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f29351c2-cd34-4fa7-b5a6-31973dc02baf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:27.753703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:27.939628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f29351c2-cd34-4fa7-b5a6-31973dc02baf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:27.965463 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f29351c2-cd34-4fa7-b5a6-31973dc02baf tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1364 microversion: 2.1 time: 0.418150 Jul 26 14:22:27.982925 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1891/3658] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:27 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1364 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:27.982925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8d8be9f3-a6a4-4425-b3bc-f41cf947530a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:27.984076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8d8be9f3-a6a4-4425-b3bc-f41cf947530a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:28.013535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d8be9f3-a6a4-4425-b3bc-f41cf947530a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:28.015792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d8be9f3-a6a4-4425-b3bc-f41cf947530a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:28.018380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d8be9f3-a6a4-4425-b3bc-f41cf947530a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:28.021391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d8be9f3-a6a4-4425-b3bc-f41cf947530a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:29.164251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8d8be9f3-a6a4-4425-b3bc-f41cf947530a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:29.185006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:22:29.186121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:22:29.188219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:22:29.188722 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8d8be9f3-a6a4-4425-b3bc-f41cf947530a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1510 microversion: 2.1 time: 1.218988 Jul 26 14:22:29.190161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:22:29.191151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:22:29.203922 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1892/3659] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:27 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1510 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:29.223927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b5e7bc1b-a842-4202-b49a-9074f24e1782 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:29.225518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b5e7bc1b-a842-4202-b49a-9074f24e1782 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:29.231699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:29.233389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:29.236675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:29.240883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:29.282630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5e7bc1b-a842-4202-b49a-9074f24e1782 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:29.283346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5e7bc1b-a842-4202-b49a-9074f24e1782 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:29.284168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Getting quotas for project eaa556625719414283409d2773814cf7. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:22:29.284807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5e7bc1b-a842-4202-b49a-9074f24e1782 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:29.285625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5e7bc1b-a842-4202-b49a-9074f24e1782 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:29.306369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Getting quotas for user 8d9d1bc9d8e44404a6bf64e912fbe562 and project eaa556625719414283409d2773814cf7. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:22:29.345481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:22:29.348199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:22:29.397347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:29.474600 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a23a9800-65a8-4131-bacc-3fd67752da9c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.642221 Jul 26 14:22:29.476967 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1768/3660] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:22:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:22:29.495647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dfce4df9-5ff4-465f-ad12-8dfa5c7c4ba4 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:29.496383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dfce4df9-5ff4-465f-ad12-8dfa5c7c4ba4 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:29.521618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfce4df9-5ff4-465f-ad12-8dfa5c7c4ba4 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:29.522085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfce4df9-5ff4-465f-ad12-8dfa5c7c4ba4 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:29.525636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfce4df9-5ff4-465f-ad12-8dfa5c7c4ba4 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:29.526173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfce4df9-5ff4-465f-ad12-8dfa5c7c4ba4 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:29.743426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dfce4df9-5ff4-465f-ad12-8dfa5c7c4ba4 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:29.769774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b5e7bc1b-a842-4202-b49a-9074f24e1782 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:29.779299 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b5e7bc1b-a842-4202-b49a-9074f24e1782 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1314 microversion: 2.1 time: 0.573151 Jul 26 14:22:29.779905 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1893/3661] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:29 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:29.784241 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dfce4df9-5ff4-465f-ad12-8dfa5c7c4ba4 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1184 microversion: 2.1 time: 0.305660 Jul 26 14:22:29.785279 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1769/3662] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:29 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1184 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:29.811016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b92eda9a-8490-40df-bc51-efd35903b03f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:29.812297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b92eda9a-8490-40df-bc51-efd35903b03f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:29.820186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b73b6a5-b065-4e93-9a86-5b8935a0c837 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:29.820851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4b73b6a5-b065-4e93-9a86-5b8935a0c837 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:29.834479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b73b6a5-b065-4e93-9a86-5b8935a0c837 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:29.834954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b73b6a5-b065-4e93-9a86-5b8935a0c837 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:29.835763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b73b6a5-b065-4e93-9a86-5b8935a0c837 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:29.837929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b92eda9a-8490-40df-bc51-efd35903b03f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:29.838584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b73b6a5-b065-4e93-9a86-5b8935a0c837 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:29.840374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b92eda9a-8490-40df-bc51-efd35903b03f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:29.848221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b92eda9a-8490-40df-bc51-efd35903b03f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:29.849754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b92eda9a-8490-40df-bc51-efd35903b03f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:30.645932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b92eda9a-8490-40df-bc51-efd35903b03f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:30.666284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b92eda9a-8490-40df-bc51-efd35903b03f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:30.678547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b92eda9a-8490-40df-bc51-efd35903b03f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:30.685597 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b92eda9a-8490-40df-bc51-efd35903b03f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 2906 microversion: 2.32 time: 0.897501 Jul 26 14:22:30.688146 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1770/3663] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:29 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 2906 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:30.705203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2739c8b0-4a79-4830-ba27-f2ca1e005f1e req-02aada5e-3ee4-4d2c-b8af-fba4798d4a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35be98ed-040c-424a-ba1f-945630e1de71", "name": "network-vif-plugged", "status": "completed", "tag": "40755b30-ef72-4e58-a2d2-9f02f4d4250d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:30.723446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4b73b6a5-b065-4e93-9a86-5b8935a0c837 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:30.732037 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4b73b6a5-b065-4e93-9a86-5b8935a0c837 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 0.930170 Jul 26 14:22:30.732644 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1894/3664] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:29 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:30.761568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bd1e44eb-10f1-40be-a961-ce352309dadb tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:30.762485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bd1e44eb-10f1-40be-a961-ce352309dadb tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:30.770415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd1e44eb-10f1-40be-a961-ce352309dadb tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:30.770934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2739c8b0-4a79-4830-ba27-f2ca1e005f1e req-02aada5e-3ee4-4d2c-b8af-fba4798d4a6f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:30.771372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd1e44eb-10f1-40be-a961-ce352309dadb tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:30.771662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2739c8b0-4a79-4830-ba27-f2ca1e005f1e req-02aada5e-3ee4-4d2c-b8af-fba4798d4a6f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:30.772818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd1e44eb-10f1-40be-a961-ce352309dadb tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:30.774102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd1e44eb-10f1-40be-a961-ce352309dadb tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:30.791521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:30.822548 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2739c8b0-4a79-4830-ba27-f2ca1e005f1e req-02aada5e-3ee4-4d2c-b8af-fba4798d4a6f service nova] Creating event network-vif-plugged:40755b30-ef72-4e58-a2d2-9f02f4d4250d for instance 35be98ed-040c-424a-ba1f-945630e1de71 on n-h1-833090-9 Jul 26 14:22:30.856848 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2739c8b0-4a79-4830-ba27-f2ca1e005f1e req-02aada5e-3ee4-4d2c-b8af-fba4798d4a6f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143390 Jul 26 14:22:30.860500 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1771/3665] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:30.895030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fb0b0f73-3301-47ed-8f42-01808c337b00 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:30.910443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fb0b0f73-3301-47ed-8f42-01808c337b00 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:30.957199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb0b0f73-3301-47ed-8f42-01808c337b00 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:30.957694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb0b0f73-3301-47ed-8f42-01808c337b00 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:30.960644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb0b0f73-3301-47ed-8f42-01808c337b00 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:30.961105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb0b0f73-3301-47ed-8f42-01808c337b00 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:31.563293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb0b0f73-3301-47ed-8f42-01808c337b00 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:31.593996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb0b0f73-3301-47ed-8f42-01808c337b00 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:31.598278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb0b0f73-3301-47ed-8f42-01808c337b00 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:31.605198 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fb0b0f73-3301-47ed-8f42-01808c337b00 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1285 microversion: 2.20 time: 0.741744 Jul 26 14:22:31.606260 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1772/3666] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:30 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1285 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:31.632177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fdab00bd-db3b-4b86-a289-c7592eb1e8fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:31.633208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fdab00bd-db3b-4b86-a289-c7592eb1e8fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:31.645243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdab00bd-db3b-4b86-a289-c7592eb1e8fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:31.646456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdab00bd-db3b-4b86-a289-c7592eb1e8fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:31.649872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdab00bd-db3b-4b86-a289-c7592eb1e8fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:31.653265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdab00bd-db3b-4b86-a289-c7592eb1e8fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:31.885052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bd1e44eb-10f1-40be-a961-ce352309dadb tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:31.908042 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bd1e44eb-10f1-40be-a961-ce352309dadb tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1549 microversion: 2.1 time: 1.151535 Jul 26 14:22:31.913782 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1895/3667] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:30 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1549 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:31.927535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ba44b4a-79f9-44f9-a54d-33734fd908ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:31.939107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4ba44b4a-79f9-44f9-a54d-33734fd908ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:31.972422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ba44b4a-79f9-44f9-a54d-33734fd908ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:31.979050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ba44b4a-79f9-44f9-a54d-33734fd908ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:31.987841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ba44b4a-79f9-44f9-a54d-33734fd908ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:31.992812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ba44b4a-79f9-44f9-a54d-33734fd908ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:32.697702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fdab00bd-db3b-4b86-a289-c7592eb1e8fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:32.714932 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fdab00bd-db3b-4b86-a289-c7592eb1e8fe tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1510 microversion: 2.1 time: 1.105258 Jul 26 14:22:32.715786 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1773/3668] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:31 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1510 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:32.759342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1ff6caa6-9c91-4901-9e7a-df3774405e32 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:32.770239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1ff6caa6-9c91-4901-9e7a-df3774405e32 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:32.802216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ff6caa6-9c91-4901-9e7a-df3774405e32 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:32.803233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ff6caa6-9c91-4901-9e7a-df3774405e32 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:32.804355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ff6caa6-9c91-4901-9e7a-df3774405e32 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:32.805171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ff6caa6-9c91-4901-9e7a-df3774405e32 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:33.099189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4ba44b4a-79f9-44f9-a54d-33734fd908ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:33.104093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:33.133063 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4ba44b4a-79f9-44f9-a54d-33734fd908ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1314 microversion: 2.1 time: 1.217010 Jul 26 14:22:33.138740 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1896/3669] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:31 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1314 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:33.147845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e9006664-105c-4b16-9266-27806524c683 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:33.169067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e9006664-105c-4b16-9266-27806524c683 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:33.188513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9006664-105c-4b16-9266-27806524c683 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:33.196738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9006664-105c-4b16-9266-27806524c683 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:33.197860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9006664-105c-4b16-9266-27806524c683 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:33.198480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9006664-105c-4b16-9266-27806524c683 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:33.279227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ff6caa6-9c91-4901-9e7a-df3774405e32 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:33.324465 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1ff6caa6-9c91-4901-9e7a-df3774405e32 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 200 len: 1184 microversion: 2.1 time: 0.587205 Jul 26 14:22:33.331210 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1774/3670] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:32 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 1184 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:33.350940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6f5c843-e859-4de5-837b-bcede7b6fd0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:33.354367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e6f5c843-e859-4de5-837b-bcede7b6fd0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:33.375972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6f5c843-e859-4de5-837b-bcede7b6fd0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:33.377627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6f5c843-e859-4de5-837b-bcede7b6fd0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:33.378811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6f5c843-e859-4de5-837b-bcede7b6fd0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:33.382739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6f5c843-e859-4de5-837b-bcede7b6fd0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:33.675840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e9006664-105c-4b16-9266-27806524c683 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:33.706960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e9006664-105c-4b16-9266-27806524c683 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:33.712867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e9006664-105c-4b16-9266-27806524c683 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:33.719238 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e9006664-105c-4b16-9266-27806524c683 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 2860 microversion: 2.32 time: 0.575248 Jul 26 14:22:33.724489 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1897/3671] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:33 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 2860 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:34.101565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6f5c843-e859-4de5-837b-bcede7b6fd0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:34.117554 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6f5c843-e859-4de5-837b-bcede7b6fd0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 0.784942 Jul 26 14:22:34.133841 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1775/3672] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:33 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:34.161020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-66e9712c-b455-4e17-b4ae-0907d0b46363 req-54c6a027-dcc0-4cc2-ab01-be0200882a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-deleted", "tag": "238ee548-dff9-412c-84cd-2631e15a0247"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:34.191104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-66e9712c-b455-4e17-b4ae-0907d0b46363 req-54c6a027-dcc0-4cc2-ab01-be0200882a62 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:34.192245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-66e9712c-b455-4e17-b4ae-0907d0b46363 req-54c6a027-dcc0-4cc2-ab01-be0200882a62 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:34.223525 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-66e9712c-b455-4e17-b4ae-0907d0b46363 req-54c6a027-dcc0-4cc2-ab01-be0200882a62 service nova] Creating event network-vif-deleted:238ee548-dff9-412c-84cd-2631e15a0247 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:22:34.301379 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-66e9712c-b455-4e17-b4ae-0907d0b46363 req-54c6a027-dcc0-4cc2-ab01-be0200882a62 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117749 Jul 26 14:22:34.310235 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1776/3673] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:34.334337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-648b69a9-adbf-480b-a2f9-e8e70f180475 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:34.341654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-648b69a9-adbf-480b-a2f9-e8e70f180475 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:34.379391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-648b69a9-adbf-480b-a2f9-e8e70f180475 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:34.379881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-648b69a9-adbf-480b-a2f9-e8e70f180475 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:34.382970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-648b69a9-adbf-480b-a2f9-e8e70f180475 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:34.387777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-648b69a9-adbf-480b-a2f9-e8e70f180475 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:34.692823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95cb6aa5-2665-4d20-bdf6-72559332f263 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:34.693818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-648b69a9-adbf-480b-a2f9-e8e70f180475 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:34.694111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95cb6aa5-2665-4d20-bdf6-72559332f263 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:34.707251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95cb6aa5-2665-4d20-bdf6-72559332f263 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:34.708140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95cb6aa5-2665-4d20-bdf6-72559332f263 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:34.715026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-648b69a9-adbf-480b-a2f9-e8e70f180475 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:34.716440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95cb6aa5-2665-4d20-bdf6-72559332f263 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:34.717162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95cb6aa5-2665-4d20-bdf6-72559332f263 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:34.725813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-648b69a9-adbf-480b-a2f9-e8e70f180475 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:34.728242 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-648b69a9-adbf-480b-a2f9-e8e70f180475 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1339 microversion: 2.20 time: 0.413682 Jul 26 14:22:34.732526 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1777/3674] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:34 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1339 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:34.772992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2647d99a-dbb3-4ae0-8ed0-166d4a07ca29 req-cd77b001-78ca-44bc-a975-58843a59836d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-unplugged", "status": "completed", "tag": "f6ef9b57-da48-4401-878d-831cea8a8c9f"}, {"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-unplugged", "status": "completed", "tag": "238ee548-dff9-412c-84cd-2631e15a0247"}, {"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-unplugged", "status": "completed", "tag": "725e91c3-1621-400a-b82a-3ec7c07edfc6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:34.802535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2647d99a-dbb3-4ae0-8ed0-166d4a07ca29 req-cd77b001-78ca-44bc-a975-58843a59836d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:34.803197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2647d99a-dbb3-4ae0-8ed0-166d4a07ca29 req-cd77b001-78ca-44bc-a975-58843a59836d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:34.837939 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2647d99a-dbb3-4ae0-8ed0-166d4a07ca29 req-cd77b001-78ca-44bc-a975-58843a59836d service nova] Creating event network-vif-unplugged:f6ef9b57-da48-4401-878d-831cea8a8c9f for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:22:34.838576 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2647d99a-dbb3-4ae0-8ed0-166d4a07ca29 req-cd77b001-78ca-44bc-a975-58843a59836d service nova] Creating event network-vif-unplugged:238ee548-dff9-412c-84cd-2631e15a0247 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:22:34.839290 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2647d99a-dbb3-4ae0-8ed0-166d4a07ca29 req-cd77b001-78ca-44bc-a975-58843a59836d service nova] Creating event network-vif-unplugged:725e91c3-1621-400a-b82a-3ec7c07edfc6 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:22:34.853034 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2647d99a-dbb3-4ae0-8ed0-166d4a07ca29 req-cd77b001-78ca-44bc-a975-58843a59836d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.105130 Jul 26 14:22:34.861911 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1778/3675] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:34.872903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b3beb58f-fd54-4f39-af2d-d128ce79a898 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:34.875269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b3beb58f-fd54-4f39-af2d-d128ce79a898 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:34.894048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3beb58f-fd54-4f39-af2d-d128ce79a898 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:34.894973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3beb58f-fd54-4f39-af2d-d128ce79a898 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:34.895986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3beb58f-fd54-4f39-af2d-d128ce79a898 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:34.896602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b3beb58f-fd54-4f39-af2d-d128ce79a898 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:35.140929 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95cb6aa5-2665-4d20-bdf6-72559332f263 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.414030 Jul 26 14:22:35.142125 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1898/3676] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:22:33 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-interface => generated 284 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:35.149632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-77cf4cb1-409a-420b-8c4b-065b9790f55f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:35.150565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-77cf4cb1-409a-420b-8c4b-065b9790f55f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:35.181932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77cf4cb1-409a-420b-8c4b-065b9790f55f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:35.182445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77cf4cb1-409a-420b-8c4b-065b9790f55f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:35.183305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77cf4cb1-409a-420b-8c4b-065b9790f55f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:35.183787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77cf4cb1-409a-420b-8c4b-065b9790f55f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:35.744717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b3beb58f-fd54-4f39-af2d-d128ce79a898 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:35.770777 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b3beb58f-fd54-4f39-af2d-d128ce79a898 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1487 microversion: 2.1 time: 0.907014 Jul 26 14:22:35.784630 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1779/3677] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:34 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1487 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:35.797661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7eb82313-4f16-49fe-b5e7-620e45bee16a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:35.798742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7eb82313-4f16-49fe-b5e7-620e45bee16a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 5ac73f48-8f28-404b-a928-b01a53e1b89d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:35.806830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eb82313-4f16-49fe-b5e7-620e45bee16a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:35.807977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eb82313-4f16-49fe-b5e7-620e45bee16a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:35.809627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eb82313-4f16-49fe-b5e7-620e45bee16a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:35.810621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7eb82313-4f16-49fe-b5e7-620e45bee16a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:35.833373 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-7eb82313-4f16-49fe-b5e7-620e45bee16a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] HTTP exception thrown: Instance 5ac73f48-8f28-404b-a928-b01a53e1b89d could not be found. Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7eb82313-4f16-49fe-b5e7-620e45bee16a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Request method failure captured: Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d HTTP/1.1 Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_bvG1FS6NvZSlKtBQTMGRmXZvPS2Rc5ma32tvFmKFggy6_eixXcQC9F0iQaU63II5FqkNN4nt8XOqDelpvSzhiXVKROWCDMeIkZmGu4xEXtQzOOkPMwy9Sdne-j-xaCGxccRjPTAbkKKk4P2qbGyKuRxR_5LB_SYg-DyyTEerNsSfM Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 1976cab4a83747a68cadf5b4dc2dbef0 Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-LiveMigrationTest-898292491 Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1976cab4a83747a68cadf5b4dc2dbef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1976cab4a83747a68cadf5b4dc2dbef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1976cab4a83747a68cadf5b4dc2dbef0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1976cab4a83747a68cadf5b4dc2dbef0"}]}] Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-LiveMigrationTest-898292491 Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 1976cab4a83747a68cadf5b4dc2dbef0 Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-LiveMigrationTest-898292491 Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-LiveMigrationTest-898292491-project Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: e35f47eb9e094bdc8d08ea4cf2970d8c Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-LiveMigrationTest-898292491-project Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 5ac73f48-8f28-404b-a928-b01a53e1b89d could not be found. Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '5ac73f48-8f28-404b-a928-b01a53e1b89d'} Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ac73f48-8f28-404b-a928-b01a53e1b89d could not be found. Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ac73f48-8f28-404b-a928-b01a53e1b89d could not be found. Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:35.836710 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:35.842085 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:35.842085 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:35.842085 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:35.842085 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:35.842085 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ac73f48-8f28-404b-a928-b01a53e1b89d could not be found. Jul 26 14:22:35.842085 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:35.844309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7eb82313-4f16-49fe-b5e7-620e45bee16a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Returning 404 to user: Instance 5ac73f48-8f28-404b-a928-b01a53e1b89d could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:35.845638 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7eb82313-4f16-49fe-b5e7-620e45bee16a tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d" status: 404 len: 111 microversion: 2.1 time: 0.060073 Jul 26 14:22:35.846888 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1780/3678] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:35 2022] GET /compute/v2.1/servers/5ac73f48-8f28-404b-a928-b01a53e1b89d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:35.852844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4125a5f7-9fcd-46b2-8266-15c544a4a834 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:35.853659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4125a5f7-9fcd-46b2-8266-15c544a4a834 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:35.861739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4125a5f7-9fcd-46b2-8266-15c544a4a834 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:35.862562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4125a5f7-9fcd-46b2-8266-15c544a4a834 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:35.865830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4125a5f7-9fcd-46b2-8266-15c544a4a834 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:35.866525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4125a5f7-9fcd-46b2-8266-15c544a4a834 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:36.060293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-77cf4cb1-409a-420b-8c4b-065b9790f55f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:36.075123 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-77cf4cb1-409a-420b-8c4b-065b9790f55f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1501 microversion: 2.1 time: 0.931262 Jul 26 14:22:36.076082 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1899/3679] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:35 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1501 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:36.092640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5741083a-9085-48ff-a3b0-e679dca7fcd8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:36.098297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5741083a-9085-48ff-a3b0-e679dca7fcd8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:36.148576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5741083a-9085-48ff-a3b0-e679dca7fcd8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:36.160733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5741083a-9085-48ff-a3b0-e679dca7fcd8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:36.161949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5741083a-9085-48ff-a3b0-e679dca7fcd8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:36.162620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5741083a-9085-48ff-a3b0-e679dca7fcd8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:38.400469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5741083a-9085-48ff-a3b0-e679dca7fcd8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:38.423563 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5741083a-9085-48ff-a3b0-e679dca7fcd8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 2.342920 Jul 26 14:22:38.437850 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1900/3680] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:36 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 2360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:38.476203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af6827b9-e3a7-46cb-869a-0c35f96a91d8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:38.477595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af6827b9-e3a7-46cb-869a-0c35f96a91d8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:38.535231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af6827b9-e3a7-46cb-869a-0c35f96a91d8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:38.538350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af6827b9-e3a7-46cb-869a-0c35f96a91d8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:38.542328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af6827b9-e3a7-46cb-869a-0c35f96a91d8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:38.551817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af6827b9-e3a7-46cb-869a-0c35f96a91d8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:38.555329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4125a5f7-9fcd-46b2-8266-15c544a4a834 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:38.570630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4125a5f7-9fcd-46b2-8266-15c544a4a834 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:38.579736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4125a5f7-9fcd-46b2-8266-15c544a4a834 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:38.585489 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4125a5f7-9fcd-46b2-8266-15c544a4a834 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 2700 microversion: 2.32 time: 2.737320 Jul 26 14:22:38.591305 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1781/3681] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:35 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 2700 bytes in 2744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:38.622713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9539ddb6-dfaf-4ff8-a57c-6d72238ade39 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-95025307"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:38.649281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9539ddb6-dfaf-4ff8-a57c-6d72238ade39 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:38.695380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9539ddb6-dfaf-4ff8-a57c-6d72238ade39 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:38.696074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9539ddb6-dfaf-4ff8-a57c-6d72238ade39 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:38.697422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9539ddb6-dfaf-4ff8-a57c-6d72238ade39 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:38.698174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9539ddb6-dfaf-4ff8-a57c-6d72238ade39 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:39.017649 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9539ddb6-dfaf-4ff8-a57c-6d72238ade39 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "PUT /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1058 microversion: 2.1 time: 0.417119 Jul 26 14:22:39.026316 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1782/3682] 10.222.0.70 () {60 vars in 1256 bytes} [Tue Jul 26 14:22:38 2022] PUT /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1058 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:39.036286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-25512c66-3249-439d-944f-6f20c0c92826 req-007ad0e2-9362-4d5a-925d-b67d29e3c97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-unplugged", "status": "completed", "tag": "94991b0a-9173-43b7-afe8-7a5e6b1a961e"}, {"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-unplugged", "status": "completed", "tag": "1caf9c4e-e16d-4c2d-b589-6ae470a2ecc0"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:39.079596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-25512c66-3249-439d-944f-6f20c0c92826 req-007ad0e2-9362-4d5a-925d-b67d29e3c97f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:39.080087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-25512c66-3249-439d-944f-6f20c0c92826 req-007ad0e2-9362-4d5a-925d-b67d29e3c97f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:39.112302 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-25512c66-3249-439d-944f-6f20c0c92826 req-007ad0e2-9362-4d5a-925d-b67d29e3c97f service nova] Creating event network-vif-unplugged:94991b0a-9173-43b7-afe8-7a5e6b1a961e for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:22:39.112828 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-25512c66-3249-439d-944f-6f20c0c92826 req-007ad0e2-9362-4d5a-925d-b67d29e3c97f service nova] Creating event network-vif-unplugged:1caf9c4e-e16d-4c2d-b589-6ae470a2ecc0 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:22:39.148030 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-25512c66-3249-439d-944f-6f20c0c92826 req-007ad0e2-9362-4d5a-925d-b67d29e3c97f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.125452 Jul 26 14:22:39.152184 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1783/3683] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:39.187066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-66f8cbb7-62c7-488a-a668-678388e2aa12 req-cd357d73-a50f-4ce7-be1e-c974c9e26261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-deleted", "tag": "725e91c3-1621-400a-b82a-3ec7c07edfc6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:39.215706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-66f8cbb7-62c7-488a-a668-678388e2aa12 req-cd357d73-a50f-4ce7-be1e-c974c9e26261 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:39.220957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-66f8cbb7-62c7-488a-a668-678388e2aa12 req-cd357d73-a50f-4ce7-be1e-c974c9e26261 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:39.255151 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-66f8cbb7-62c7-488a-a668-678388e2aa12 req-cd357d73-a50f-4ce7-be1e-c974c9e26261 service nova] Creating event network-vif-deleted:725e91c3-1621-400a-b82a-3ec7c07edfc6 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:22:39.280020 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-66f8cbb7-62c7-488a-a668-678388e2aa12 req-cd357d73-a50f-4ce7-be1e-c974c9e26261 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125517 Jul 26 14:22:39.289407 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1784/3684] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:39.338463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b35c3bd5-85cb-4a14-966b-c7d9975b8eb6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:39.339448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b35c3bd5-85cb-4a14-966b-c7d9975b8eb6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:39.341605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:39.359555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:39.397293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b35c3bd5-85cb-4a14-966b-c7d9975b8eb6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:39.397758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b35c3bd5-85cb-4a14-966b-c7d9975b8eb6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:39.398559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b35c3bd5-85cb-4a14-966b-c7d9975b8eb6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:39.399005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b35c3bd5-85cb-4a14-966b-c7d9975b8eb6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:39.613542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af6827b9-e3a7-46cb-869a-0c35f96a91d8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:39.629031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af6827b9-e3a7-46cb-869a-0c35f96a91d8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:39.635116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af6827b9-e3a7-46cb-869a-0c35f96a91d8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:39.643474 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af6827b9-e3a7-46cb-869a-0c35f96a91d8 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1407 microversion: 2.20 time: 1.193992 Jul 26 14:22:39.666664 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1901/3685] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:38 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1407 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:39.676562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-607f1ce7-2dfd-459f-b5c3-8b107d18372d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:39.683194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-607f1ce7-2dfd-459f-b5c3-8b107d18372d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:39.716528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-607f1ce7-2dfd-459f-b5c3-8b107d18372d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:39.717291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-607f1ce7-2dfd-459f-b5c3-8b107d18372d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:39.719013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-607f1ce7-2dfd-459f-b5c3-8b107d18372d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:39.719664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-607f1ce7-2dfd-459f-b5c3-8b107d18372d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:40.672260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-607f1ce7-2dfd-459f-b5c3-8b107d18372d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:40.685981 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-607f1ce7-2dfd-459f-b5c3-8b107d18372d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1680 microversion: 2.1 time: 1.017311 Jul 26 14:22:40.700345 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1902/3686] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:39 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1680 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:40.717324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5911ee14-6387-42c1-9764-be7cf0c3cb11 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:40.719557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5911ee14-6387-42c1-9764-be7cf0c3cb11 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:40.728683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5911ee14-6387-42c1-9764-be7cf0c3cb11 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:40.729556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5911ee14-6387-42c1-9764-be7cf0c3cb11 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:40.730686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5911ee14-6387-42c1-9764-be7cf0c3cb11 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:40.731389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5911ee14-6387-42c1-9764-be7cf0c3cb11 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:40.795068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b35c3bd5-85cb-4a14-966b-c7d9975b8eb6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:40.812861 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b35c3bd5-85cb-4a14-966b-c7d9975b8eb6 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1485 microversion: 2.1 time: 1.520513 Jul 26 14:22:40.818823 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1785/3687] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:39 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1485 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:40.830951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-279a179e-eb28-42cf-927a-a0bdfd31db99 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:40.831790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-279a179e-eb28-42cf-927a-a0bdfd31db99 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:40.851770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-279a179e-eb28-42cf-927a-a0bdfd31db99 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:40.855007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-279a179e-eb28-42cf-927a-a0bdfd31db99 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:40.861893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-279a179e-eb28-42cf-927a-a0bdfd31db99 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:40.862975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-279a179e-eb28-42cf-927a-a0bdfd31db99 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:42.464728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5911ee14-6387-42c1-9764-be7cf0c3cb11 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:42.503738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5911ee14-6387-42c1-9764-be7cf0c3cb11 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:42.521421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5911ee14-6387-42c1-9764-be7cf0c3cb11 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:42.538635 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5911ee14-6387-42c1-9764-be7cf0c3cb11 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 2323 microversion: 2.32 time: 1.834118 Jul 26 14:22:42.558716 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1903/3688] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:40 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 2323 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:42.598413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b46dfa77-ad21-47cf-8158-d3ab40920d66 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:42.601573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b46dfa77-ad21-47cf-8158-d3ab40920d66 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:42.642332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b46dfa77-ad21-47cf-8158-d3ab40920d66 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:42.645144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b46dfa77-ad21-47cf-8158-d3ab40920d66 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:42.646089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b46dfa77-ad21-47cf-8158-d3ab40920d66 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:42.651241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b46dfa77-ad21-47cf-8158-d3ab40920d66 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:42.902545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-279a179e-eb28-42cf-927a-a0bdfd31db99 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:42.944470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-279a179e-eb28-42cf-927a-a0bdfd31db99 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:42.956996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-279a179e-eb28-42cf-927a-a0bdfd31db99 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:42.963526 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-279a179e-eb28-42cf-927a-a0bdfd31db99 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1407 microversion: 2.20 time: 2.142844 Jul 26 14:22:42.968524 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1786/3689] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:40 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1407 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:42.988708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a7b86036-2aeb-4438-bfe3-931e7dbfac3a req-b0398551-5a43-4092-a08d-95192976afc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-deleted", "tag": "94991b0a-9173-43b7-afe8-7a5e6b1a961e"}, {"name": "network-changed", "server_uuid": "cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049", "tag": "586f4682-9ae3-4429-bffc-65da24439ea0"}, {"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-deleted", "tag": "f6ef9b57-da48-4401-878d-831cea8a8c9f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:43.031469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a7b86036-2aeb-4438-bfe3-931e7dbfac3a req-b0398551-5a43-4092-a08d-95192976afc9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:43.032133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a7b86036-2aeb-4438-bfe3-931e7dbfac3a req-b0398551-5a43-4092-a08d-95192976afc9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:43.055702 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a7b86036-2aeb-4438-bfe3-931e7dbfac3a req-b0398551-5a43-4092-a08d-95192976afc9 service nova] Creating event network-vif-deleted:94991b0a-9173-43b7-afe8-7a5e6b1a961e for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:22:43.056584 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a7b86036-2aeb-4438-bfe3-931e7dbfac3a req-b0398551-5a43-4092-a08d-95192976afc9 service nova] Creating event network-changed:586f4682-9ae3-4429-bffc-65da24439ea0 for instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 on n-h2-833090-9 Jul 26 14:22:43.057400 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a7b86036-2aeb-4438-bfe3-931e7dbfac3a req-b0398551-5a43-4092-a08d-95192976afc9 service nova] Creating event network-vif-deleted:f6ef9b57-da48-4401-878d-831cea8a8c9f for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:22:43.067714 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a7b86036-2aeb-4438-bfe3-931e7dbfac3a req-b0398551-5a43-4092-a08d-95192976afc9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.096378 Jul 26 14:22:43.077653 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1787/3690] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:43.087000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cc975fed-a103-4f93-8d52-e92ca20bb39a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:43.088649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cc975fed-a103-4f93-8d52-e92ca20bb39a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:43.100011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cc975fed-a103-4f93-8d52-e92ca20bb39a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:43.101130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cc975fed-a103-4f93-8d52-e92ca20bb39a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:43.102711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cc975fed-a103-4f93-8d52-e92ca20bb39a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:43.103991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cc975fed-a103-4f93-8d52-e92ca20bb39a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:44.080651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b46dfa77-ad21-47cf-8158-d3ab40920d66 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:44.107175 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b46dfa77-ad21-47cf-8158-d3ab40920d66 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1485 microversion: 2.1 time: 1.529561 Jul 26 14:22:44.115011 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1904/3691] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:42 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1485 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:44.139462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-399a73a8-a582-4dfd-87b6-2a39a8ba77af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3e7a9a4-8e40-467a-9df8-b11056999199"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:44.155572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-399a73a8-a582-4dfd-87b6-2a39a8ba77af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:44.190137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-399a73a8-a582-4dfd-87b6-2a39a8ba77af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:44.190579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-399a73a8-a582-4dfd-87b6-2a39a8ba77af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:44.191336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-399a73a8-a582-4dfd-87b6-2a39a8ba77af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:44.191786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-399a73a8-a582-4dfd-87b6-2a39a8ba77af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:44.314327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cc975fed-a103-4f93-8d52-e92ca20bb39a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:44.335016 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cc975fed-a103-4f93-8d52-e92ca20bb39a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.254978 Jul 26 14:22:44.335627 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1788/3692] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:43 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:44.353066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-61b99607-70a4-44bd-bf69-21cdf1d73a7b req-b5cb0d81-4bfa-435a-9218-a3171b1b4765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7576357-b5e0-45fb-9641-d397a6b3faf2", "tag": "f88eaeb3-e484-4f96-b4ba-99b8b947950a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:44.398231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-61b99607-70a4-44bd-bf69-21cdf1d73a7b req-b5cb0d81-4bfa-435a-9218-a3171b1b4765 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:44.419644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-61b99607-70a4-44bd-bf69-21cdf1d73a7b req-b5cb0d81-4bfa-435a-9218-a3171b1b4765 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:44.491820 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-61b99607-70a4-44bd-bf69-21cdf1d73a7b req-b5cb0d81-4bfa-435a-9218-a3171b1b4765 service nova] Creating event network-changed:f88eaeb3-e484-4f96-b4ba-99b8b947950a for instance d7576357-b5e0-45fb-9641-d397a6b3faf2 on n-h2-833090-9 Jul 26 14:22:44.521996 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-61b99607-70a4-44bd-bf69-21cdf1d73a7b req-b5cb0d81-4bfa-435a-9218-a3171b1b4765 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184802 Jul 26 14:22:44.522689 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1789/3693] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:44.562928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-117cb9bb-7e37-4cfb-85a1-4578286fb68d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:44.563648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-117cb9bb-7e37-4cfb-85a1-4578286fb68d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:44.597214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-117cb9bb-7e37-4cfb-85a1-4578286fb68d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:44.599312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-117cb9bb-7e37-4cfb-85a1-4578286fb68d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:44.606276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-117cb9bb-7e37-4cfb-85a1-4578286fb68d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:44.607034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-117cb9bb-7e37-4cfb-85a1-4578286fb68d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:44.969110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-117cb9bb-7e37-4cfb-85a1-4578286fb68d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:44.986595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-117cb9bb-7e37-4cfb-85a1-4578286fb68d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:44.996617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-117cb9bb-7e37-4cfb-85a1-4578286fb68d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:44.998851 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-117cb9bb-7e37-4cfb-85a1-4578286fb68d tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.465568 Jul 26 14:22:45.011570 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1790/3694] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:44 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:45.017840 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-399a73a8-a582-4dfd-87b6-2a39a8ba77af tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.894260 Jul 26 14:22:45.018710 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1905/3695] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:22:44 2022] POST /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:45.041314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6df0b1df-c06f-48c5-bec7-7ee6942e672d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:45.044854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6df0b1df-c06f-48c5-bec7-7ee6942e672d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:45.047449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f83fb14a-5525-4c82-bc37-5adf7854c241 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:45.056293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f83fb14a-5525-4c82-bc37-5adf7854c241 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:45.058144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6df0b1df-c06f-48c5-bec7-7ee6942e672d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:45.061695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6df0b1df-c06f-48c5-bec7-7ee6942e672d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:45.068100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6df0b1df-c06f-48c5-bec7-7ee6942e672d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:45.068970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6df0b1df-c06f-48c5-bec7-7ee6942e672d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:45.090272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f83fb14a-5525-4c82-bc37-5adf7854c241 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:45.091809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f83fb14a-5525-4c82-bc37-5adf7854c241 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:45.093965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f83fb14a-5525-4c82-bc37-5adf7854c241 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:45.094778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f83fb14a-5525-4c82-bc37-5adf7854c241 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:45.157725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6df0b1df-c06f-48c5-bec7-7ee6942e672d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:22:45.398868 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6df0b1df-c06f-48c5-bec7-7ee6942e672d tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 204 len: 0 microversion: 2.1 time: 0.377925 Jul 26 14:22:45.402458 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1906/3696] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:45 2022] DELETE /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:22:45.416681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1d081eb8-4c1f-4855-8621-77a2f7d1f3e7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:45.425175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1d081eb8-4c1f-4855-8621-77a2f7d1f3e7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:45.447617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d081eb8-4c1f-4855-8621-77a2f7d1f3e7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:45.449443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d081eb8-4c1f-4855-8621-77a2f7d1f3e7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:45.451561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d081eb8-4c1f-4855-8621-77a2f7d1f3e7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:45.464781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d081eb8-4c1f-4855-8621-77a2f7d1f3e7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:46.018991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1d081eb8-4c1f-4855-8621-77a2f7d1f3e7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:46.028690 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1d081eb8-4c1f-4855-8621-77a2f7d1f3e7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.624461 Jul 26 14:22:46.053136 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1907/3697] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:45 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:46.067983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f83fb14a-5525-4c82-bc37-5adf7854c241 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:46.080772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-c757fb5e-a03a-47f2-b9bb-29ed3243154d req-7f01fcbf-6362-441f-a051-1d87ecd4ecf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c584bb0a-2fbb-4014-9f21-bcb83a0068c0", "name": "network-vif-unplugged", "status": "completed", "tag": "3ba17f96-9407-49f5-8771-0ba49b9937c1"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:46.111279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f83fb14a-5525-4c82-bc37-5adf7854c241 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:46.114344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f83fb14a-5525-4c82-bc37-5adf7854c241 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:46.123589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c757fb5e-a03a-47f2-b9bb-29ed3243154d req-7f01fcbf-6362-441f-a051-1d87ecd4ecf7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:46.125121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c757fb5e-a03a-47f2-b9bb-29ed3243154d req-7f01fcbf-6362-441f-a051-1d87ecd4ecf7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:46.134882 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f83fb14a-5525-4c82-bc37-5adf7854c241 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1407 microversion: 2.20 time: 1.120750 Jul 26 14:22:46.140869 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1791/3698] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:45 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1407 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:46.161680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-8758e79a-6078-46ea-b935-aac9c039ca02 req-e51ccfeb-3d5e-4313-819b-e21df5eb231c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb", "name": "network-vif-deleted", "tag": "1caf9c4e-e16d-4c2d-b589-6ae470a2ecc0"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:46.189883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-8758e79a-6078-46ea-b935-aac9c039ca02 req-e51ccfeb-3d5e-4313-819b-e21df5eb231c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:46.195017 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-c757fb5e-a03a-47f2-b9bb-29ed3243154d req-7f01fcbf-6362-441f-a051-1d87ecd4ecf7 service nova] Creating event network-vif-unplugged:3ba17f96-9407-49f5-8771-0ba49b9937c1 for instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 on n-h1-833090-9 Jul 26 14:22:46.196410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-8758e79a-6078-46ea-b935-aac9c039ca02 req-e51ccfeb-3d5e-4313-819b-e21df5eb231c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:46.216956 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-c757fb5e-a03a-47f2-b9bb-29ed3243154d req-7f01fcbf-6362-441f-a051-1d87ecd4ecf7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149948 Jul 26 14:22:46.225447 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-8758e79a-6078-46ea-b935-aac9c039ca02 req-e51ccfeb-3d5e-4313-819b-e21df5eb231c service nova] Creating event network-vif-deleted:1caf9c4e-e16d-4c2d-b589-6ae470a2ecc0 for instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb on n-h2-833090-9 Jul 26 14:22:46.230419 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1908/3699] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:46.250155 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-8758e79a-6078-46ea-b935-aac9c039ca02 req-e51ccfeb-3d5e-4313-819b-e21df5eb231c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101250 Jul 26 14:22:46.251572 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1792/3700] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:46.257605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-791aa5e2-49a6-4046-bf7d-6c49b42ae2a7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:46.261765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-791aa5e2-49a6-4046-bf7d-6c49b42ae2a7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:46.269187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f76ca7e0-d7c0-41c3-8d96-4150829b9028 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:46.276474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f76ca7e0-d7c0-41c3-8d96-4150829b9028 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:46.286186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-791aa5e2-49a6-4046-bf7d-6c49b42ae2a7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:46.297285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f76ca7e0-d7c0-41c3-8d96-4150829b9028 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:46.298085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-791aa5e2-49a6-4046-bf7d-6c49b42ae2a7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:46.298611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f76ca7e0-d7c0-41c3-8d96-4150829b9028 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:46.299998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-791aa5e2-49a6-4046-bf7d-6c49b42ae2a7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:46.301016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-791aa5e2-49a6-4046-bf7d-6c49b42ae2a7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:46.301219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f76ca7e0-d7c0-41c3-8d96-4150829b9028 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:46.302001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f76ca7e0-d7c0-41c3-8d96-4150829b9028 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:46.322852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:46.558447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f76ca7e0-d7c0-41c3-8d96-4150829b9028 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:46.585943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f76ca7e0-d7c0-41c3-8d96-4150829b9028 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:46.602091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f76ca7e0-d7c0-41c3-8d96-4150829b9028 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:46.611858 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f76ca7e0-d7c0-41c3-8d96-4150829b9028 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.350208 Jul 26 14:22:46.613157 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1793/3701] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:46 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:46.803562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-791aa5e2-49a6-4046-bf7d-6c49b42ae2a7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:46.824719 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-791aa5e2-49a6-4046-bf7d-6c49b42ae2a7 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1491 microversion: 2.1 time: 0.591633 Jul 26 14:22:46.828756 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1909/3702] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:46 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1491 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:47.177194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4483c60c-6889-41e9-b1a6-d70744128221 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:47.177909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4483c60c-6889-41e9-b1a6-d70744128221 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:47.203802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4483c60c-6889-41e9-b1a6-d70744128221 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:47.208944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4483c60c-6889-41e9-b1a6-d70744128221 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:47.209853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4483c60c-6889-41e9-b1a6-d70744128221 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:47.210383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4483c60c-6889-41e9-b1a6-d70744128221 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:47.657849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bdd2b667-30e7-4d9e-b05d-3326e8d7c171 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:47.659378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bdd2b667-30e7-4d9e-b05d-3326e8d7c171 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:47.674813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdd2b667-30e7-4d9e-b05d-3326e8d7c171 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:47.682718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdd2b667-30e7-4d9e-b05d-3326e8d7c171 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:47.684090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdd2b667-30e7-4d9e-b05d-3326e8d7c171 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:47.685911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bdd2b667-30e7-4d9e-b05d-3326e8d7c171 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:48.223640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bdd2b667-30e7-4d9e-b05d-3326e8d7c171 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:48.239802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bdd2b667-30e7-4d9e-b05d-3326e8d7c171 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:48.248398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bdd2b667-30e7-4d9e-b05d-3326e8d7c171 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:48.250232 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bdd2b667-30e7-4d9e-b05d-3326e8d7c171 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.600750 Jul 26 14:22:48.253793 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1910/3703] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:47 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:22:48.263504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a404857-5f33-4c1b-a946-7b72269adbcf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:48.266850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0a404857-5f33-4c1b-a946-7b72269adbcf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:48.279034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:48.289084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a404857-5f33-4c1b-a946-7b72269adbcf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:48.290653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a404857-5f33-4c1b-a946-7b72269adbcf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:48.292531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a404857-5f33-4c1b-a946-7b72269adbcf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:48.293710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a404857-5f33-4c1b-a946-7b72269adbcf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:48.370182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:48.735999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4483c60c-6889-41e9-b1a6-d70744128221 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:48.746070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4483c60c-6889-41e9-b1a6-d70744128221 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:48.748388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4483c60c-6889-41e9-b1a6-d70744128221 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:48.751244 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4483c60c-6889-41e9-b1a6-d70744128221 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1407 microversion: 2.20 time: 1.582396 Jul 26 14:22:48.753352 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1794/3704] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:47 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1407 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:49.180622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0a404857-5f33-4c1b-a946-7b72269adbcf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:49.206165 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0a404857-5f33-4c1b-a946-7b72269adbcf tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 200 len: 1491 microversion: 2.1 time: 0.950324 Jul 26 14:22:49.209343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-df9056c8-05aa-4b03-a077-6dd416e8e55a req-5bb5e2b2-49c4-48a7-a928-cb87356aafc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfef27a2-6413-43bf-a500-383a0b9ab4be", "name": "network-vif-deleted", "tag": "d3fb18d9-8b61-4fd8-9c02-be32d5d54031"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:49.242111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-df9056c8-05aa-4b03-a077-6dd416e8e55a req-5bb5e2b2-49c4-48a7-a928-cb87356aafc1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:49.244796 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1911/3705] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:48 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 1491 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:49.250604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-df9056c8-05aa-4b03-a077-6dd416e8e55a req-5bb5e2b2-49c4-48a7-a928-cb87356aafc1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:49.288915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cab2b6db-0641-4307-8982-a08b4c945c06 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:49.290153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cab2b6db-0641-4307-8982-a08b4c945c06 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:49.322285 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-df9056c8-05aa-4b03-a077-6dd416e8e55a req-5bb5e2b2-49c4-48a7-a928-cb87356aafc1 service nova] Creating event network-vif-deleted:d3fb18d9-8b61-4fd8-9c02-be32d5d54031 for instance dfef27a2-6413-43bf-a500-383a0b9ab4be on n-h1-833090-9 Jul 26 14:22:49.329612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cab2b6db-0641-4307-8982-a08b4c945c06 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:49.334045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cab2b6db-0641-4307-8982-a08b4c945c06 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:49.337398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cab2b6db-0641-4307-8982-a08b4c945c06 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:49.339412 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-df9056c8-05aa-4b03-a077-6dd416e8e55a req-5bb5e2b2-49c4-48a7-a928-cb87356aafc1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132655 Jul 26 14:22:49.341848 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1795/3706] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:22:49.345092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cab2b6db-0641-4307-8982-a08b4c945c06 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:49.557050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cab2b6db-0641-4307-8982-a08b4c945c06 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:49.571191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cab2b6db-0641-4307-8982-a08b4c945c06 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:49.583803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cab2b6db-0641-4307-8982-a08b4c945c06 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:49.586125 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cab2b6db-0641-4307-8982-a08b4c945c06 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.301929 Jul 26 14:22:49.587381 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1912/3707] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:49 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:49.596888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6255aa0d-1bee-4167-9d86-d87e440988d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:49.598489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6255aa0d-1bee-4167-9d86-d87e440988d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:49.608814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6255aa0d-1bee-4167-9d86-d87e440988d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:49.619918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6255aa0d-1bee-4167-9d86-d87e440988d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:49.622797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6255aa0d-1bee-4167-9d86-d87e440988d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:49.623917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6255aa0d-1bee-4167-9d86-d87e440988d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:49.787095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bb7acaa8-2508-47be-80fb-c4ff44c3b9e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:49.788170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bb7acaa8-2508-47be-80fb-c4ff44c3b9e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:49.799803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb7acaa8-2508-47be-80fb-c4ff44c3b9e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:49.800723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb7acaa8-2508-47be-80fb-c4ff44c3b9e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:49.802596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb7acaa8-2508-47be-80fb-c4ff44c3b9e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:49.803274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb7acaa8-2508-47be-80fb-c4ff44c3b9e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:49.958256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6255aa0d-1bee-4167-9d86-d87e440988d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:49.976082 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6255aa0d-1bee-4167-9d86-d87e440988d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.380859 Jul 26 14:22:49.992047 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1796/3708] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:49 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:50.010930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d1581889-778e-4300-9902-3ff07f33fe7e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.017803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d1581889-778e-4300-9902-3ff07f33fe7e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.036633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1581889-778e-4300-9902-3ff07f33fe7e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.037090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1581889-778e-4300-9902-3ff07f33fe7e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.040808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1581889-778e-4300-9902-3ff07f33fe7e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.044300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1581889-778e-4300-9902-3ff07f33fe7e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.205451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bb7acaa8-2508-47be-80fb-c4ff44c3b9e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:50.217173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bb7acaa8-2508-47be-80fb-c4ff44c3b9e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:50.219283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bb7acaa8-2508-47be-80fb-c4ff44c3b9e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:50.223382 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bb7acaa8-2508-47be-80fb-c4ff44c3b9e9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1407 microversion: 2.20 time: 0.441317 Jul 26 14:22:50.224020 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1913/3709] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:49 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:22:50.245866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d8155da-b984-4ddc-84c3-7a648b7aa5ab tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.247505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d8155da-b984-4ddc-84c3-7a648b7aa5ab tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.270917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d8155da-b984-4ddc-84c3-7a648b7aa5ab tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.276906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d8155da-b984-4ddc-84c3-7a648b7aa5ab tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.278464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d8155da-b984-4ddc-84c3-7a648b7aa5ab tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.279609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d8155da-b984-4ddc-84c3-7a648b7aa5ab tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.330528 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-6d8155da-b984-4ddc-84c3-7a648b7aa5ab tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d8155da-b984-4ddc-84c3-7a648b7aa5ab tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be HTTP/1.1 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'dfef27a2-6413-43bf-a500-383a0b9ab4be'} Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.337510 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.346605 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.346605 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.346605 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:50.346605 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:50.346605 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.346605 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.346605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d8155da-b984-4ddc-84c3-7a648b7aa5ab tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:50.352847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d1581889-778e-4300-9902-3ff07f33fe7e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:50.361319 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d8155da-b984-4ddc-84c3-7a648b7aa5ab tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 404 len: 111 microversion: 2.1 time: 0.122262 Jul 26 14:22:50.361922 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1914/3710] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:50 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:50.381127 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d1581889-778e-4300-9902-3ff07f33fe7e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.378292 Jul 26 14:22:50.394530 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1797/3711] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:49 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:50.394787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c4133f6a-3e8c-4ac7-8ee3-2fab8a5068c5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.394787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c4133f6a-3e8c-4ac7-8ee3-2fab8a5068c5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.397121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4133f6a-3e8c-4ac7-8ee3-2fab8a5068c5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.398343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4133f6a-3e8c-4ac7-8ee3-2fab8a5068c5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.399972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4133f6a-3e8c-4ac7-8ee3-2fab8a5068c5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.400945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4133f6a-3e8c-4ac7-8ee3-2fab8a5068c5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.414132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-560799f9-468b-4dea-9763-fe00a2c02b3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.414944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-560799f9-468b-4dea-9763-fe00a2c02b3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.424231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-560799f9-468b-4dea-9763-fe00a2c02b3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.424695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-560799f9-468b-4dea-9763-fe00a2c02b3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.425558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-560799f9-468b-4dea-9763-fe00a2c02b3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.426058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-560799f9-468b-4dea-9763-fe00a2c02b3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.433224 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c4133f6a-3e8c-4ac7-8ee3-2fab8a5068c5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c4133f6a-3e8c-4ac7-8ee3-2fab8a5068c5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be HTTP/1.1 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'dfef27a2-6413-43bf-a500-383a0b9ab4be'} Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:50.438344 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.443312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.443312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.443312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.443312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.443312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.443312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.443312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:50.443312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:50.443312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.443312 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.445280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c4133f6a-3e8c-4ac7-8ee3-2fab8a5068c5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:50.447077 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c4133f6a-3e8c-4ac7-8ee3-2fab8a5068c5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 404 len: 111 microversion: 2.1 time: 0.074298 Jul 26 14:22:50.451862 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1915/3712] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:50 2022] DELETE /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:22:50.461509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d24f4857-9856-4974-b03d-03a503bb8367 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.462806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d24f4857-9856-4974-b03d-03a503bb8367 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: dfef27a2-6413-43bf-a500-383a0b9ab4be] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.476131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d24f4857-9856-4974-b03d-03a503bb8367 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.476757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d24f4857-9856-4974-b03d-03a503bb8367 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.477704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d24f4857-9856-4974-b03d-03a503bb8367 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.478270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d24f4857-9856-4974-b03d-03a503bb8367 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.502302 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d24f4857-9856-4974-b03d-03a503bb8367 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d24f4857-9856-4974-b03d-03a503bb8367 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be HTTP/1.1 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'dfef27a2-6413-43bf-a500-383a0b9ab4be'} Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.506630 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.511286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.511286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.511286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:50.511286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:50.511286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. Jul 26 14:22:50.511286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.511286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d24f4857-9856-4974-b03d-03a503bb8367 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance dfef27a2-6413-43bf-a500-383a0b9ab4be could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:50.511783 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d24f4857-9856-4974-b03d-03a503bb8367 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be" status: 404 len: 111 microversion: 2.1 time: 0.057743 Jul 26 14:22:50.515867 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1916/3713] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:50 2022] GET /compute/v2.1/servers/dfef27a2-6413-43bf-a500-383a0b9ab4be => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:50.526749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ee402b3-4bbc-4809-800c-41a12f4bca31 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.528330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ee402b3-4bbc-4809-800c-41a12f4bca31 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.538272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ee402b3-4bbc-4809-800c-41a12f4bca31 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.539040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ee402b3-4bbc-4809-800c-41a12f4bca31 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.540384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ee402b3-4bbc-4809-800c-41a12f4bca31 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.541138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ee402b3-4bbc-4809-800c-41a12f4bca31 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.570444 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-7ee402b3-4bbc-4809-800c-41a12f4bca31 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ee402b3-4bbc-4809-800c-41a12f4bca31 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb HTTP/1.1 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '6c41b166-a794-4bdd-8cb7-8e66ddde04cb'} Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:50.574077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ee402b3-4bbc-4809-800c-41a12f4bca31 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ee402b3-4bbc-4809-800c-41a12f4bca31 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 404 len: 111 microversion: 2.1 time: 0.056174 Jul 26 14:22:50.581955 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1917/3714] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:50 2022] DELETE /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:22:50.599094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-22f235b9-7411-44f2-bd4d-51328367e803 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.600128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-22f235b9-7411-44f2-bd4d-51328367e803 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 6c41b166-a794-4bdd-8cb7-8e66ddde04cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.611076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22f235b9-7411-44f2-bd4d-51328367e803 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.612732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22f235b9-7411-44f2-bd4d-51328367e803 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.614695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22f235b9-7411-44f2-bd4d-51328367e803 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.616217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22f235b9-7411-44f2-bd4d-51328367e803 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.644869 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-22f235b9-7411-44f2-bd4d-51328367e803 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-22f235b9-7411-44f2-bd4d-51328367e803 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb HTTP/1.1 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '6c41b166-a794-4bdd-8cb7-8e66ddde04cb'} Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.648436 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.653243 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.653243 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.653243 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:50.653243 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:50.653243 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. Jul 26 14:22:50.653243 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.658814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-22f235b9-7411-44f2-bd4d-51328367e803 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 6c41b166-a794-4bdd-8cb7-8e66ddde04cb could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:50.660774 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-22f235b9-7411-44f2-bd4d-51328367e803 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb" status: 404 len: 111 microversion: 2.1 time: 0.070194 Jul 26 14:22:50.662013 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1918/3715] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:50 2022] GET /compute/v2.1/servers/6c41b166-a794-4bdd-8cb7-8e66ddde04cb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:50.670506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b45c169f-df45-4d28-8274-f0a05d232960 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.672467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b45c169f-df45-4d28-8274-f0a05d232960 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.682804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-560799f9-468b-4dea-9763-fe00a2c02b3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:50.685813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b45c169f-df45-4d28-8274-f0a05d232960 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.687301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b45c169f-df45-4d28-8274-f0a05d232960 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.689280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b45c169f-df45-4d28-8274-f0a05d232960 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.690363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b45c169f-df45-4d28-8274-f0a05d232960 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.694780 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-560799f9-468b-4dea-9763-fe00a2c02b3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.289372 Jul 26 14:22:50.696561 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1798/3716] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:50 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:22:50.710553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-023e10cb-8276-4add-aafd-1f028d881fec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.711269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-023e10cb-8276-4add-aafd-1f028d881fec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.721176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-023e10cb-8276-4add-aafd-1f028d881fec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.721842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-023e10cb-8276-4add-aafd-1f028d881fec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.722707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-023e10cb-8276-4add-aafd-1f028d881fec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.723071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-023e10cb-8276-4add-aafd-1f028d881fec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.742357 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-023e10cb-8276-4add-aafd-1f028d881fec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-023e10cb-8276-4add-aafd-1f028d881fec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd HTTP/1.1 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd79a8dbc-470b-4488-aea7-124183a070dd'} Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:50.746090 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:22:50.751497 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.751497 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.751497 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.751497 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.751497 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.751497 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.751497 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:50.751497 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:50.751497 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:22:50.751497 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.755090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-023e10cb-8276-4add-aafd-1f028d881fec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:50.756778 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-023e10cb-8276-4add-aafd-1f028d881fec tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 404 len: 111 microversion: 2.1 time: 0.058729 Jul 26 14:22:50.758102 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1799/3717] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:50 2022] DELETE /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:50.765893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3bc4c26b-a367-43ef-85de-73d35ccf4356 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:50.769110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3bc4c26b-a367-43ef-85de-73d35ccf4356 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.786631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bc4c26b-a367-43ef-85de-73d35ccf4356 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.787102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bc4c26b-a367-43ef-85de-73d35ccf4356 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.787976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bc4c26b-a367-43ef-85de-73d35ccf4356 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.788434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bc4c26b-a367-43ef-85de-73d35ccf4356 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.822688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b45c169f-df45-4d28-8274-f0a05d232960 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:50.845515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b45c169f-df45-4d28-8274-f0a05d232960 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:50.850413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b45c169f-df45-4d28-8274-f0a05d232960 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:50.852261 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b45c169f-df45-4d28-8274-f0a05d232960 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.188637 Jul 26 14:22:50.853088 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1919/3718] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:50 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:50.861247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7013513d-2459-45a1-a86c-cbb7111841bd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.862178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7013513d-2459-45a1-a86c-cbb7111841bd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: d79a8dbc-470b-4488-aea7-124183a070dd] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.871370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7013513d-2459-45a1-a86c-cbb7111841bd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.872593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7013513d-2459-45a1-a86c-cbb7111841bd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.874036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7013513d-2459-45a1-a86c-cbb7111841bd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.874976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7013513d-2459-45a1-a86c-cbb7111841bd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.898311 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-7013513d-2459-45a1-a86c-cbb7111841bd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7013513d-2459-45a1-a86c-cbb7111841bd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd HTTP/1.1 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd79a8dbc-470b-4488-aea7-124183a070dd'} Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.903127 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.909604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.909604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.909604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:50.909604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:50.909604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. Jul 26 14:22:50.909604 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.911309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7013513d-2459-45a1-a86c-cbb7111841bd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance d79a8dbc-470b-4488-aea7-124183a070dd could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:50.912835 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7013513d-2459-45a1-a86c-cbb7111841bd tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd" status: 404 len: 111 microversion: 2.1 time: 0.058580 Jul 26 14:22:50.914655 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1920/3719] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:50 2022] GET /compute/v2.1/servers/d79a8dbc-470b-4488-aea7-124183a070dd => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:50.930499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1d594929-7271-4899-ba7b-e0f664a1987a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.931224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1d594929-7271-4899-ba7b-e0f664a1987a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:50.941411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d594929-7271-4899-ba7b-e0f664a1987a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.942038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d594929-7271-4899-ba7b-e0f664a1987a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.942856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d594929-7271-4899-ba7b-e0f664a1987a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:50.943354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d594929-7271-4899-ba7b-e0f664a1987a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:50.967591 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-1d594929-7271-4899-ba7b-e0f664a1987a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1d594929-7271-4899-ba7b-e0f664a1987a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 HTTP/1.1 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '0a67171e-e026-4184-9b91-853e1ffb2256'} Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:50.971144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:50.976321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1d594929-7271-4899-ba7b-e0f664a1987a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:50.977165 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3bc4c26b-a367-43ef-85de-73d35ccf4356 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.208459 Jul 26 14:22:50.977799 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1d594929-7271-4899-ba7b-e0f664a1987a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 404 len: 111 microversion: 2.1 time: 0.052532 Jul 26 14:22:50.977946 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1800/3720] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:22:50 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:22:50.979838 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1921/3721] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:50 2022] DELETE /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:50.995749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6cc6c37-38bc-44a9-a5f3-a9ceb5e6dbc3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:50.996929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e6cc6c37-38bc-44a9-a5f3-a9ceb5e6dbc3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0a67171e-e026-4184-9b91-853e1ffb2256] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.002238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e163372b-2927-47b5-9c2f-1c4766ae5d92 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:51.003799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e163372b-2927-47b5-9c2f-1c4766ae5d92 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.007074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6cc6c37-38bc-44a9-a5f3-a9ceb5e6dbc3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.007744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6cc6c37-38bc-44a9-a5f3-a9ceb5e6dbc3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.009135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6cc6c37-38bc-44a9-a5f3-a9ceb5e6dbc3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.009994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6cc6c37-38bc-44a9-a5f3-a9ceb5e6dbc3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.027560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e163372b-2927-47b5-9c2f-1c4766ae5d92 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.028422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e163372b-2927-47b5-9c2f-1c4766ae5d92 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.029653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e163372b-2927-47b5-9c2f-1c4766ae5d92 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.031632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e163372b-2927-47b5-9c2f-1c4766ae5d92 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.051937 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e6cc6c37-38bc-44a9-a5f3-a9ceb5e6dbc3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6cc6c37-38bc-44a9-a5f3-a9ceb5e6dbc3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 HTTP/1.1 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '0a67171e-e026-4184-9b91-853e1ffb2256'} Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.057462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.063220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.063220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.063220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:51.063220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:51.063220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. Jul 26 14:22:51.063220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.067074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6cc6c37-38bc-44a9-a5f3-a9ceb5e6dbc3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 0a67171e-e026-4184-9b91-853e1ffb2256 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:51.068254 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e6cc6c37-38bc-44a9-a5f3-a9ceb5e6dbc3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256" status: 404 len: 111 microversion: 2.1 time: 0.078471 Jul 26 14:22:51.069392 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1922/3722] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:50 2022] GET /compute/v2.1/servers/0a67171e-e026-4184-9b91-853e1ffb2256 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:51.084313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-69fbecc5-c56a-4d7f-a524-9ca6bbdc3df3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:51.085261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-69fbecc5-c56a-4d7f-a524-9ca6bbdc3df3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.100958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69fbecc5-c56a-4d7f-a524-9ca6bbdc3df3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.101632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69fbecc5-c56a-4d7f-a524-9ca6bbdc3df3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.102707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69fbecc5-c56a-4d7f-a524-9ca6bbdc3df3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.103414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69fbecc5-c56a-4d7f-a524-9ca6bbdc3df3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.130167 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-69fbecc5-c56a-4d7f-a524-9ca6bbdc3df3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-69fbecc5-c56a-4d7f-a524-9ca6bbdc3df3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 HTTP/1.1 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'a407c385-cada-449e-9963-366c564180b4'} Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:51.133425 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:22:51.142893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.142893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.142893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.142893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.142893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.142893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.142893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:51.142893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:51.142893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:22:51.142893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.146198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-69fbecc5-c56a-4d7f-a524-9ca6bbdc3df3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:51.148157 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-69fbecc5-c56a-4d7f-a524-9ca6bbdc3df3 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 404 len: 111 microversion: 2.1 time: 0.072375 Jul 26 14:22:51.150332 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1923/3723] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:51 2022] DELETE /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:22:51.163151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d327f9d4-fcda-4051-aad7-c172d27c3c2c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:51.164378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d327f9d4-fcda-4051-aad7-c172d27c3c2c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: a407c385-cada-449e-9963-366c564180b4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.174141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d327f9d4-fcda-4051-aad7-c172d27c3c2c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.174917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d327f9d4-fcda-4051-aad7-c172d27c3c2c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.176260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d327f9d4-fcda-4051-aad7-c172d27c3c2c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.176885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d327f9d4-fcda-4051-aad7-c172d27c3c2c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.207890 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d327f9d4-fcda-4051-aad7-c172d27c3c2c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d327f9d4-fcda-4051-aad7-c172d27c3c2c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 HTTP/1.1 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'a407c385-cada-449e-9963-366c564180b4'} Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.210106 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.221900 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.221900 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.221900 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:51.221900 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:51.221900 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. Jul 26 14:22:51.221900 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.221900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d327f9d4-fcda-4051-aad7-c172d27c3c2c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance a407c385-cada-449e-9963-366c564180b4 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:51.221900 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d327f9d4-fcda-4051-aad7-c172d27c3c2c tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4" status: 404 len: 111 microversion: 2.1 time: 0.056617 Jul 26 14:22:51.221900 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1924/3724] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:51 2022] GET /compute/v2.1/servers/a407c385-cada-449e-9963-366c564180b4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:51.228221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04271556-17e0-4316-8ff1-44cf2bdfd350 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:51.228221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-04271556-17e0-4316-8ff1-44cf2bdfd350 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.247007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04271556-17e0-4316-8ff1-44cf2bdfd350 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.248336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04271556-17e0-4316-8ff1-44cf2bdfd350 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.250150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04271556-17e0-4316-8ff1-44cf2bdfd350 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.251590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04271556-17e0-4316-8ff1-44cf2bdfd350 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.277946 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-04271556-17e0-4316-8ff1-44cf2bdfd350 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04271556-17e0-4316-8ff1-44cf2bdfd350 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a HTTP/1.1 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '0ccb0c1e-a856-4624-8324-90163926e89a'} Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:51.279802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:22:51.288648 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.288648 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.288648 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.288648 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.288648 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.288648 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.288648 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:51.288648 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:51.288648 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:22:51.288648 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.293688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04271556-17e0-4316-8ff1-44cf2bdfd350 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:51.296181 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-04271556-17e0-4316-8ff1-44cf2bdfd350 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 404 len: 111 microversion: 2.1 time: 0.074116 Jul 26 14:22:51.297291 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1925/3725] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:51 2022] DELETE /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:51.310729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-550f03d5-a99f-4cb5-85b9-97183b16a3dd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:51.313059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-550f03d5-a99f-4cb5-85b9-97183b16a3dd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.321151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-550f03d5-a99f-4cb5-85b9-97183b16a3dd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.321785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-550f03d5-a99f-4cb5-85b9-97183b16a3dd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.322869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-550f03d5-a99f-4cb5-85b9-97183b16a3dd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.323323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-550f03d5-a99f-4cb5-85b9-97183b16a3dd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.406988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e163372b-2927-47b5-9c2f-1c4766ae5d92 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:51.427024 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e163372b-2927-47b5-9c2f-1c4766ae5d92 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1669 microversion: 2.1 time: 0.437337 Jul 26 14:22:51.434027 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1801/3726] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:50 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1669 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:51.450007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5060602b-b3fc-495a-b57d-75b0eaf91e9a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:51.450933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5060602b-b3fc-495a-b57d-75b0eaf91e9a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 0ccb0c1e-a856-4624-8324-90163926e89a] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.463389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5060602b-b3fc-495a-b57d-75b0eaf91e9a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.465571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5060602b-b3fc-495a-b57d-75b0eaf91e9a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.466805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5060602b-b3fc-495a-b57d-75b0eaf91e9a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.467529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5060602b-b3fc-495a-b57d-75b0eaf91e9a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.492013 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-5060602b-b3fc-495a-b57d-75b0eaf91e9a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5060602b-b3fc-495a-b57d-75b0eaf91e9a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a HTTP/1.1 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '0ccb0c1e-a856-4624-8324-90163926e89a'} Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.497431 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.514323 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.514323 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.514323 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:51.514323 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:51.514323 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. Jul 26 14:22:51.514323 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.514323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5060602b-b3fc-495a-b57d-75b0eaf91e9a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 0ccb0c1e-a856-4624-8324-90163926e89a could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:51.514323 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5060602b-b3fc-495a-b57d-75b0eaf91e9a tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a" status: 404 len: 111 microversion: 2.1 time: 0.068466 Jul 26 14:22:51.514323 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1802/3727] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:51 2022] GET /compute/v2.1/servers/0ccb0c1e-a856-4624-8324-90163926e89a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:51.528509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-39d35478-7662-4e0e-8924-2b32efcbcd1f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:51.528509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-39d35478-7662-4e0e-8924-2b32efcbcd1f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.536619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39d35478-7662-4e0e-8924-2b32efcbcd1f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.537083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39d35478-7662-4e0e-8924-2b32efcbcd1f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.537852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39d35478-7662-4e0e-8924-2b32efcbcd1f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.538292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39d35478-7662-4e0e-8924-2b32efcbcd1f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.581777 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-39d35478-7662-4e0e-8924-2b32efcbcd1f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-39d35478-7662-4e0e-8924-2b32efcbcd1f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 HTTP/1.1 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '1e83cb5b-8fa8-46d3-98f2-7dc424b164f3'} Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:51.583689 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:22:51.588928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.588928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.588928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.588928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.588928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.588928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.588928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:51.588928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:51.588928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:22:51.588928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.591577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-39d35478-7662-4e0e-8924-2b32efcbcd1f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:51.593892 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-39d35478-7662-4e0e-8924-2b32efcbcd1f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3" status: 404 len: 111 microversion: 2.1 time: 0.082585 Jul 26 14:22:51.594946 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1803/3728] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:51 2022] DELETE /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:22:51.606302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e3eafec-3589-4dd2-a93f-3c9837ccb9da tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:51.607311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e3eafec-3589-4dd2-a93f-3c9837ccb9da tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.623414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e3eafec-3589-4dd2-a93f-3c9837ccb9da tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.625636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e3eafec-3589-4dd2-a93f-3c9837ccb9da tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.629682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e3eafec-3589-4dd2-a93f-3c9837ccb9da tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.632310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e3eafec-3589-4dd2-a93f-3c9837ccb9da tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.660441 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-2e3eafec-3589-4dd2-a93f-3c9837ccb9da tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e3eafec-3589-4dd2-a93f-3c9837ccb9da tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 HTTP/1.1 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '1e83cb5b-8fa8-46d3-98f2-7dc424b164f3'} Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.663476 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:51.669773 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:51.669773 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:51.669773 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:51.669773 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:51.669773 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. Jul 26 14:22:51.669773 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:51.673385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e3eafec-3589-4dd2-a93f-3c9837ccb9da tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:51.674640 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e3eafec-3589-4dd2-a93f-3c9837ccb9da tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3" status: 404 len: 111 microversion: 2.1 time: 0.075429 Jul 26 14:22:51.676496 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1804/3729] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:51 2022] GET /compute/v2.1/servers/1e83cb5b-8fa8-46d3-98f2-7dc424b164f3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:22:51.690711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b14eb08e-1b69-4620-ba1f-9ee37b7250ad tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:51.691856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b14eb08e-1b69-4620-ba1f-9ee37b7250ad tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.712012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b14eb08e-1b69-4620-ba1f-9ee37b7250ad tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.712239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-550f03d5-a99f-4cb5-85b9-97183b16a3dd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:51.712668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b14eb08e-1b69-4620-ba1f-9ee37b7250ad tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.715080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b14eb08e-1b69-4620-ba1f-9ee37b7250ad tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.716243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b14eb08e-1b69-4620-ba1f-9ee37b7250ad tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.756249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-550f03d5-a99f-4cb5-85b9-97183b16a3dd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:51.760001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-550f03d5-a99f-4cb5-85b9-97183b16a3dd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:51.761898 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-550f03d5-a99f-4cb5-85b9-97183b16a3dd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1407 microversion: 2.20 time: 0.463159 Jul 26 14:22:51.762795 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1926/3730] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:51 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:51.807625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b14eb08e-1b69-4620-ba1f-9ee37b7250ad tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:22:51.893030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9f4d985-c1f8-4c72-a83d-6aed1d8741be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:51.894645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b9f4d985-c1f8-4c72-a83d-6aed1d8741be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:51.928054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9f4d985-c1f8-4c72-a83d-6aed1d8741be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.929140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9f4d985-c1f8-4c72-a83d-6aed1d8741be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:51.931988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9f4d985-c1f8-4c72-a83d-6aed1d8741be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:51.945783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9f4d985-c1f8-4c72-a83d-6aed1d8741be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.014254 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b14eb08e-1b69-4620-ba1f-9ee37b7250ad tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "DELETE /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 204 len: 0 microversion: 2.1 time: 0.331290 Jul 26 14:22:52.015772 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1805/3731] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:51 2022] DELETE /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:22:52.031926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2ee39622-4624-4ff7-a724-86328912d99f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:52.033211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2ee39622-4624-4ff7-a724-86328912d99f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:52.047263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ee39622-4624-4ff7-a724-86328912d99f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.048523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ee39622-4624-4ff7-a724-86328912d99f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.050398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ee39622-4624-4ff7-a724-86328912d99f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.053909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ee39622-4624-4ff7-a724-86328912d99f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.073408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b9f4d985-c1f8-4c72-a83d-6aed1d8741be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:52.109650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b9f4d985-c1f8-4c72-a83d-6aed1d8741be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:52.117863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b9f4d985-c1f8-4c72-a83d-6aed1d8741be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:52.121985 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b9f4d985-c1f8-4c72-a83d-6aed1d8741be tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.243838 Jul 26 14:22:52.158602 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1927/3732] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:51 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:52.215739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cbf899d0-c4e7-4c82-9398-e79345186527 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:52.216400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cbf899d0-c4e7-4c82-9398-e79345186527 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:52.231565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cbf899d0-c4e7-4c82-9398-e79345186527 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.232421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cbf899d0-c4e7-4c82-9398-e79345186527 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.235687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cbf899d0-c4e7-4c82-9398-e79345186527 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.237378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cbf899d0-c4e7-4c82-9398-e79345186527 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.291289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cbf899d0-c4e7-4c82-9398-e79345186527 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:22:52.419511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2ee39622-4624-4ff7-a724-86328912d99f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:52.438852 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2ee39622-4624-4ff7-a724-86328912d99f tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1478 microversion: 2.1 time: 0.417643 Jul 26 14:22:52.443376 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1806/3733] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:52 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1478 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:22:52.461737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4afe6d19-dd10-419c-a15f-d49873c43a53 req-8700309c-3f39-45af-a242-f7dc8de65cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7576357-b5e0-45fb-9641-d397a6b3faf2", "name": "network-vif-plugged", "status": "completed", "tag": "f88eaeb3-e484-4f96-b4ba-99b8b947950a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:52.481273 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cbf899d0-c4e7-4c82-9398-e79345186527 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 204 len: 0 microversion: 2.1 time: 0.267569 Jul 26 14:22:52.482565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4afe6d19-dd10-419c-a15f-d49873c43a53 req-8700309c-3f39-45af-a242-f7dc8de65cae service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.483090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4afe6d19-dd10-419c-a15f-d49873c43a53 req-8700309c-3f39-45af-a242-f7dc8de65cae service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.488012 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1928/3734] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:22:52 2022] DELETE /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:22:52.497318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cd5d64b6-129d-4a8e-82dc-02c4560d0ea7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:52.498896 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4afe6d19-dd10-419c-a15f-d49873c43a53 req-8700309c-3f39-45af-a242-f7dc8de65cae service nova] Creating event network-vif-plugged:f88eaeb3-e484-4f96-b4ba-99b8b947950a for instance d7576357-b5e0-45fb-9641-d397a6b3faf2 on n-h2-833090-9 Jul 26 14:22:52.500242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cd5d64b6-129d-4a8e-82dc-02c4560d0ea7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:52.506821 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4afe6d19-dd10-419c-a15f-d49873c43a53 req-8700309c-3f39-45af-a242-f7dc8de65cae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057210 Jul 26 14:22:52.508547 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1807/3735] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:52.520067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f9244681-d082-4dd8-aa81-19e347fc2433 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:52.520636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd5d64b6-129d-4a8e-82dc-02c4560d0ea7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.521110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd5d64b6-129d-4a8e-82dc-02c4560d0ea7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.521911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd5d64b6-129d-4a8e-82dc-02c4560d0ea7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.522667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f9244681-d082-4dd8-aa81-19e347fc2433 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:52.524986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd5d64b6-129d-4a8e-82dc-02c4560d0ea7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.533550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9244681-d082-4dd8-aa81-19e347fc2433 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.534517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9244681-d082-4dd8-aa81-19e347fc2433 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.535704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9244681-d082-4dd8-aa81-19e347fc2433 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.536387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9244681-d082-4dd8-aa81-19e347fc2433 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.854339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f9244681-d082-4dd8-aa81-19e347fc2433 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:52.863356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cd5d64b6-129d-4a8e-82dc-02c4560d0ea7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:52.866501 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f9244681-d082-4dd8-aa81-19e347fc2433 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1667 microversion: 2.1 time: 0.355262 Jul 26 14:22:52.868195 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1808/3736] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:52 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1667 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:52.873704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6b6f32d3-fe5b-45b2-aeb2-e27bb70aaea6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:52.875271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6b6f32d3-fe5b-45b2-aeb2-e27bb70aaea6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:52.883639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b6f32d3-fe5b-45b2-aeb2-e27bb70aaea6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.885238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b6f32d3-fe5b-45b2-aeb2-e27bb70aaea6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.886038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b6f32d3-fe5b-45b2-aeb2-e27bb70aaea6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:52.886457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b6f32d3-fe5b-45b2-aeb2-e27bb70aaea6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:52.892228 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cd5d64b6-129d-4a8e-82dc-02c4560d0ea7 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1669 microversion: 2.1 time: 0.401877 Jul 26 14:22:52.909234 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1929/3737] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:52 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1669 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:53.139034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6b6f32d3-fe5b-45b2-aeb2-e27bb70aaea6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:53.150277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6b6f32d3-fe5b-45b2-aeb2-e27bb70aaea6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:53.152391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6b6f32d3-fe5b-45b2-aeb2-e27bb70aaea6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:53.153940 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6b6f32d3-fe5b-45b2-aeb2-e27bb70aaea6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1407 microversion: 2.20 time: 0.284418 Jul 26 14:22:53.154835 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1809/3738] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:52 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:53.170556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ac4eabe-5db2-4050-ae9b-df2e4eecf78f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:53.172964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4ac4eabe-5db2-4050-ae9b-df2e4eecf78f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:53.180843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ac4eabe-5db2-4050-ae9b-df2e4eecf78f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:53.181858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ac4eabe-5db2-4050-ae9b-df2e4eecf78f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:53.183500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ac4eabe-5db2-4050-ae9b-df2e4eecf78f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:53.184359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ac4eabe-5db2-4050-ae9b-df2e4eecf78f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:53.295801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4ac4eabe-5db2-4050-ae9b-df2e4eecf78f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:53.306835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4ac4eabe-5db2-4050-ae9b-df2e4eecf78f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:53.308885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4ac4eabe-5db2-4050-ae9b-df2e4eecf78f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:53.310187 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4ac4eabe-5db2-4050-ae9b-df2e4eecf78f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.149646 Jul 26 14:22:53.310774 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1930/3739] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:53 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:22:53.476228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cd05030b-d919-45e6-b02c-2facf70d05c0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:53.477071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cd05030b-d919-45e6-b02c-2facf70d05c0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:53.492432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd05030b-d919-45e6-b02c-2facf70d05c0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:53.493670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd05030b-d919-45e6-b02c-2facf70d05c0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:53.495023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd05030b-d919-45e6-b02c-2facf70d05c0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:53.495864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd05030b-d919-45e6-b02c-2facf70d05c0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:53.783501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cd05030b-d919-45e6-b02c-2facf70d05c0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:53.801538 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cd05030b-d919-45e6-b02c-2facf70d05c0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1478 microversion: 2.1 time: 0.332896 Jul 26 14:22:53.802540 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1810/3740] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:53 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1478 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:22:53.897486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76c083e7-150f-48e4-97ea-1579bc06e327 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:53.898462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-76c083e7-150f-48e4-97ea-1579bc06e327 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:53.909347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76c083e7-150f-48e4-97ea-1579bc06e327 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:53.909839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76c083e7-150f-48e4-97ea-1579bc06e327 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:53.911548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76c083e7-150f-48e4-97ea-1579bc06e327 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:53.911548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76c083e7-150f-48e4-97ea-1579bc06e327 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:53.927985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-73721523-dd5c-4a4a-920f-efd8a89d07a2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:53.930057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-73721523-dd5c-4a4a-920f-efd8a89d07a2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:53.947358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73721523-dd5c-4a4a-920f-efd8a89d07a2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:53.948755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73721523-dd5c-4a4a-920f-efd8a89d07a2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:53.950533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73721523-dd5c-4a4a-920f-efd8a89d07a2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:53.951864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73721523-dd5c-4a4a-920f-efd8a89d07a2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:53.962857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:54.254733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-76c083e7-150f-48e4-97ea-1579bc06e327 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:54.265046 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76c083e7-150f-48e4-97ea-1579bc06e327 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1667 microversion: 2.1 time: 0.372105 Jul 26 14:22:54.266430 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1931/3741] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:53 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1667 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:54.284123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4835b02a-fd16-4e9e-979c-e00467c2e2cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:54.285505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4835b02a-fd16-4e9e-979c-e00467c2e2cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:54.308460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4835b02a-fd16-4e9e-979c-e00467c2e2cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:54.312887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4835b02a-fd16-4e9e-979c-e00467c2e2cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:54.313944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4835b02a-fd16-4e9e-979c-e00467c2e2cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:54.315850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4835b02a-fd16-4e9e-979c-e00467c2e2cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:54.320640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-73721523-dd5c-4a4a-920f-efd8a89d07a2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:54.343654 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-73721523-dd5c-4a4a-920f-efd8a89d07a2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.426181 Jul 26 14:22:54.345427 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1811/3742] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:53 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:54.354168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2de08635-e5c4-49b7-b4b1-de02c93a0fa7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:54.355569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2de08635-e5c4-49b7-b4b1-de02c93a0fa7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:54.370574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2de08635-e5c4-49b7-b4b1-de02c93a0fa7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:54.372083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2de08635-e5c4-49b7-b4b1-de02c93a0fa7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:54.374324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2de08635-e5c4-49b7-b4b1-de02c93a0fa7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:54.375404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2de08635-e5c4-49b7-b4b1-de02c93a0fa7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:54.587987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2de08635-e5c4-49b7-b4b1-de02c93a0fa7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:54.616793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2de08635-e5c4-49b7-b4b1-de02c93a0fa7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:54.622956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2de08635-e5c4-49b7-b4b1-de02c93a0fa7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:54.631069 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2de08635-e5c4-49b7-b4b1-de02c93a0fa7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.283292 Jul 26 14:22:54.652657 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1812/3743] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:54 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:54.675862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f62a8df3-ecce-40ef-8b65-839b26d94dfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:54.690013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f62a8df3-ecce-40ef-8b65-839b26d94dfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:54.699680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f62a8df3-ecce-40ef-8b65-839b26d94dfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:54.700822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f62a8df3-ecce-40ef-8b65-839b26d94dfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:54.702727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f62a8df3-ecce-40ef-8b65-839b26d94dfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:54.703735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f62a8df3-ecce-40ef-8b65-839b26d94dfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:54.771107 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f62a8df3-ecce-40ef-8b65-839b26d94dfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 200 len: 322 microversion: 2.1 time: 0.116236 Jul 26 14:22:54.772408 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1813/3744] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:22:54 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 322 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:54.785842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1264d39-6147-4e3a-93df-0be988c79808 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:54.787056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b1264d39-6147-4e3a-93df-0be988c79808 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:54.799557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1264d39-6147-4e3a-93df-0be988c79808 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:54.801058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1264d39-6147-4e3a-93df-0be988c79808 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:54.804379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1264d39-6147-4e3a-93df-0be988c79808 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:54.805592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1264d39-6147-4e3a-93df-0be988c79808 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:55.467063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4835b02a-fd16-4e9e-979c-e00467c2e2cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:55.490935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4835b02a-fd16-4e9e-979c-e00467c2e2cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:55.493349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4835b02a-fd16-4e9e-979c-e00467c2e2cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:55.495569 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4835b02a-fd16-4e9e-979c-e00467c2e2cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1407 microversion: 2.20 time: 1.227548 Jul 26 14:22:55.497019 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1932/3745] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:54 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1407 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:55.505618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d6f5376c-efdd-41ce-899d-651130c1a1b0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:55.507187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d6f5376c-efdd-41ce-899d-651130c1a1b0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:55.531688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f5376c-efdd-41ce-899d-651130c1a1b0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:55.532375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f5376c-efdd-41ce-899d-651130c1a1b0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:55.533455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f5376c-efdd-41ce-899d-651130c1a1b0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:55.534087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f5376c-efdd-41ce-899d-651130c1a1b0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:55.717459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b1264d39-6147-4e3a-93df-0be988c79808 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:55.733639 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b1264d39-6147-4e3a-93df-0be988c79808 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.952897 Jul 26 14:22:55.735066 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1814/3746] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:54 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:22:55.752255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-411c0275-51f7-41da-952e-ba70c6fc0c80 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:55.755492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-411c0275-51f7-41da-952e-ba70c6fc0c80 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:55.781736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:55.785082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d6f5376c-efdd-41ce-899d-651130c1a1b0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:55.788046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:22:55.801845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-411c0275-51f7-41da-952e-ba70c6fc0c80 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:55.803539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-411c0275-51f7-41da-952e-ba70c6fc0c80 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:55.804795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-411c0275-51f7-41da-952e-ba70c6fc0c80 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:55.805533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-411c0275-51f7-41da-952e-ba70c6fc0c80 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:55.815824 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d6f5376c-efdd-41ce-899d-651130c1a1b0 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1436 microversion: 2.1 time: 0.317398 Jul 26 14:22:55.818698 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1933/3747] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:55 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1436 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:55.845216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ee84c651-dc77-4565-aa8f-d6989fe14c53 req-bb3c1713-ffed-4f8b-b554-d22409717c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26e6716b-8039-48ec-9e12-fb154188021f", "name": "network-vif-deleted", "tag": "13953793-6bfa-4e86-a84a-bcaecb648e87"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:55.868320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ee84c651-dc77-4565-aa8f-d6989fe14c53 req-bb3c1713-ffed-4f8b-b554-d22409717c9f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:55.869156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ee84c651-dc77-4565-aa8f-d6989fe14c53 req-bb3c1713-ffed-4f8b-b554-d22409717c9f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:55.895426 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ee84c651-dc77-4565-aa8f-d6989fe14c53 req-bb3c1713-ffed-4f8b-b554-d22409717c9f service nova] Creating event network-vif-deleted:13953793-6bfa-4e86-a84a-bcaecb648e87 for instance 26e6716b-8039-48ec-9e12-fb154188021f on n-h2-833090-9 Jul 26 14:22:55.904974 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ee84c651-dc77-4565-aa8f-d6989fe14c53 req-bb3c1713-ffed-4f8b-b554-d22409717c9f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083551 Jul 26 14:22:55.906043 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1934/3748] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:22:55.924919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9d9cbb1b-3311-4d3d-af1e-73ae90fbe3a8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:55.927304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9d9cbb1b-3311-4d3d-af1e-73ae90fbe3a8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:55.940226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d9cbb1b-3311-4d3d-af1e-73ae90fbe3a8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:55.941297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d9cbb1b-3311-4d3d-af1e-73ae90fbe3a8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:55.943391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d9cbb1b-3311-4d3d-af1e-73ae90fbe3a8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:55.945025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d9cbb1b-3311-4d3d-af1e-73ae90fbe3a8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:56.124251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9d9cbb1b-3311-4d3d-af1e-73ae90fbe3a8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:56.146619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9d9cbb1b-3311-4d3d-af1e-73ae90fbe3a8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:56.157921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9d9cbb1b-3311-4d3d-af1e-73ae90fbe3a8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:56.159652 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9d9cbb1b-3311-4d3d-af1e-73ae90fbe3a8 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.251274 Jul 26 14:22:56.160809 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1935/3749] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:55 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:56.166846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-89561a67-366b-48a8-92ad-6a02af0f3ca9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:56.167782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-89561a67-366b-48a8-92ad-6a02af0f3ca9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:56.177908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89561a67-366b-48a8-92ad-6a02af0f3ca9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:56.178947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89561a67-366b-48a8-92ad-6a02af0f3ca9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:56.180042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89561a67-366b-48a8-92ad-6a02af0f3ca9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:56.181416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89561a67-366b-48a8-92ad-6a02af0f3ca9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:56.425868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-411c0275-51f7-41da-952e-ba70c6fc0c80 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:56.462987 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-411c0275-51f7-41da-952e-ba70c6fc0c80 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1667 microversion: 2.1 time: 0.722347 Jul 26 14:22:56.464876 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1815/3750] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:55 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1667 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:56.540877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1f713d42-6234-4c7d-a6b7-32b279453635 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:56.542195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f713d42-6234-4c7d-a6b7-32b279453635 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:56.565501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f713d42-6234-4c7d-a6b7-32b279453635 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:56.571398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f713d42-6234-4c7d-a6b7-32b279453635 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:56.573201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f713d42-6234-4c7d-a6b7-32b279453635 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:56.574348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f713d42-6234-4c7d-a6b7-32b279453635 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:56.597948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-89561a67-366b-48a8-92ad-6a02af0f3ca9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:56.622647 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-89561a67-366b-48a8-92ad-6a02af0f3ca9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.460415 Jul 26 14:22:56.625727 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1936/3751] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:56 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:56.667756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f84e5bce-badd-4c7a-9175-509046203520 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:56.668537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f84e5bce-badd-4c7a-9175-509046203520 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:56.694444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f84e5bce-badd-4c7a-9175-509046203520 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:56.695230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f84e5bce-badd-4c7a-9175-509046203520 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:56.703080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f84e5bce-badd-4c7a-9175-509046203520 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:56.705859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f84e5bce-badd-4c7a-9175-509046203520 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:57.152351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1f713d42-6234-4c7d-a6b7-32b279453635 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:57.195681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1f713d42-6234-4c7d-a6b7-32b279453635 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:57.199903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1f713d42-6234-4c7d-a6b7-32b279453635 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:57.202390 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1f713d42-6234-4c7d-a6b7-32b279453635 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1407 microversion: 2.20 time: 0.670098 Jul 26 14:22:57.209332 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1816/3752] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:56 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1407 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:57.217517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:57.234196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:57.245810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:57.250752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:57.262977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:57.262977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:57.392929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:57.395221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:57.396704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lazy-loading 'fault' on Instance uuid 26e6716b-8039-48ec-9e12-fb154188021f {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:22:57.428080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f84e5bce-badd-4c7a-9175-509046203520 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:57.446019 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f84e5bce-badd-4c7a-9175-509046203520 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.782541 Jul 26 14:22:57.447557 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1937/3753] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:56 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:57.458037 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-52554a7a-754a-470e-b1fe-72e5d8c21a12 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:57.459346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-52554a7a-754a-470e-b1fe-72e5d8c21a12 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:57.469870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52554a7a-754a-470e-b1fe-72e5d8c21a12 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:57.471574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52554a7a-754a-470e-b1fe-72e5d8c21a12 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:57.472713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52554a7a-754a-470e-b1fe-72e5d8c21a12 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:57.473537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52554a7a-754a-470e-b1fe-72e5d8c21a12 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:57.558751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55daeaaa37a8498c9e540f5546277dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c6dd4463a34a61aeb33283ffdb5897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:57.567469 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a3a2a9c7-c96a-44b8-b1fe-726a827529d5 tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 200 len: 1282 microversion: 2.1 time: 0.356336 Jul 26 14:22:57.572073 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1817/3754] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:57 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 1282 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:57.577059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e7827381-3fc0-4849-9ffb-2f43e26e434d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:57.578320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e7827381-3fc0-4849-9ffb-2f43e26e434d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:57.589628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7827381-3fc0-4849-9ffb-2f43e26e434d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:57.590859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7827381-3fc0-4849-9ffb-2f43e26e434d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:57.593201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7827381-3fc0-4849-9ffb-2f43e26e434d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:57.594237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7827381-3fc0-4849-9ffb-2f43e26e434d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:57.620867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-52554a7a-754a-470e-b1fe-72e5d8c21a12 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:57.634670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-52554a7a-754a-470e-b1fe-72e5d8c21a12 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:57.636888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-52554a7a-754a-470e-b1fe-72e5d8c21a12 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:57.639691 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-52554a7a-754a-470e-b1fe-72e5d8c21a12 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.189208 Jul 26 14:22:57.639691 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1938/3755] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:57 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:57.650485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f86816a0-48c6-4169-9138-7f2a39c19f60 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:57.651707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f86816a0-48c6-4169-9138-7f2a39c19f60 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:57.662701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f86816a0-48c6-4169-9138-7f2a39c19f60 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:57.665057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f86816a0-48c6-4169-9138-7f2a39c19f60 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:57.666090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f86816a0-48c6-4169-9138-7f2a39c19f60 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:57.666889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f86816a0-48c6-4169-9138-7f2a39c19f60 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:57.869463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f86816a0-48c6-4169-9138-7f2a39c19f60 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:57.887158 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f86816a0-48c6-4169-9138-7f2a39c19f60 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 200 len: 1599 microversion: 2.1 time: 0.245781 Jul 26 14:22:57.888410 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1939/3756] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:57 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 1599 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:58.134003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e7827381-3fc0-4849-9ffb-2f43e26e434d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:58.152078 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e7827381-3fc0-4849-9ffb-2f43e26e434d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.581720 Jul 26 14:22:58.153384 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1818/3757] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:57 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:22:58.219583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b62de21f-6461-49e5-bf90-b2894f8a8c45 req-25649582-3c11-44ad-9505-e9c7fa5b8c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a900e83e-11a0-4cd4-85c0-c09b6e4da5c7", "name": "network-vif-deleted", "tag": "e7e7e1e8-b611-45a9-ab4b-a0bf0c504929"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:58.240025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dfb66405-5357-4467-a640-144e1dc12a77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:58.241715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dfb66405-5357-4467-a640-144e1dc12a77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:58.275396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfb66405-5357-4467-a640-144e1dc12a77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:58.277898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfb66405-5357-4467-a640-144e1dc12a77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:58.278129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b62de21f-6461-49e5-bf90-b2894f8a8c45 req-25649582-3c11-44ad-9505-e9c7fa5b8c94 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:58.283580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfb66405-5357-4467-a640-144e1dc12a77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:58.286546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dfb66405-5357-4467-a640-144e1dc12a77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:58.287402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b62de21f-6461-49e5-bf90-b2894f8a8c45 req-25649582-3c11-44ad-9505-e9c7fa5b8c94 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:58.321936 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b62de21f-6461-49e5-bf90-b2894f8a8c45 req-25649582-3c11-44ad-9505-e9c7fa5b8c94 service nova] Creating event network-vif-deleted:e7e7e1e8-b611-45a9-ab4b-a0bf0c504929 for instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 on n-h2-833090-9 Jul 26 14:22:58.328937 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b62de21f-6461-49e5-bf90-b2894f8a8c45 req-25649582-3c11-44ad-9505-e9c7fa5b8c94 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117188 Jul 26 14:22:58.329905 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1940/3758] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:22:58.525282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-649932672", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "57ac168b-59fa-4a44-88ec-5fbc6a23582a"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:22:58.706035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] validate_networks() for [('57ac168b-59fa-4a44-88ec-5fbc6a23582a', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:22:59.155120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dfb66405-5357-4467-a640-144e1dc12a77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:59.192954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dfb66405-5357-4467-a640-144e1dc12a77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:59.205208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dfb66405-5357-4467-a640-144e1dc12a77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:22:59.206723 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dfb66405-5357-4467-a640-144e1dc12a77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1598 microversion: 2.20 time: 0.976089 Jul 26 14:22:59.207582 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1819/3759] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:58 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1598 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:22:59.213639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d29b06c9-dddd-4ac0-b833-a3fb083e2beb tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:59.214511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d29b06c9-dddd-4ac0-b833-a3fb083e2beb tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] [instance: 26e6716b-8039-48ec-9e12-fb154188021f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:59.223610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d29b06c9-dddd-4ac0-b833-a3fb083e2beb tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:59.224588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d29b06c9-dddd-4ac0-b833-a3fb083e2beb tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:59.225735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d29b06c9-dddd-4ac0-b833-a3fb083e2beb tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:59.226364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d29b06c9-dddd-4ac0-b833-a3fb083e2beb tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:59.253185 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d29b06c9-dddd-4ac0-b833-a3fb083e2beb tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] HTTP exception thrown: Instance 26e6716b-8039-48ec-9e12-fb154188021f could not be found. Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d29b06c9-dddd-4ac0-b833-a3fb083e2beb tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Request method failure captured: Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f HTTP/1.1 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_e1bVpWZsMXTf5UHP3QUlgeZMmKQ03Lk2ejS8NWduPzReEBezbJck2lkkid9xoyyrN1wLsTQAaWOowc4xG30JXVuF0jfqcjq5LIyBHv6hKw5AdSpNS5Wye2a6tEzy2VGgZpGITp4PebmRxbhurct2Q-u9FV6UQDoEmJwhTD1KkkVw8 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a7c6dd4463a34a61aeb33283ffdb5897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a7c6dd4463a34a61aeb33283ffdb5897", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a7c6dd4463a34a61aeb33283ffdb5897"}]}] Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestJSON-301447634 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a7c6dd4463a34a61aeb33283ffdb5897 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestJSON-301447634 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestJSON-301447634-project Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 55daeaaa37a8498c9e540f5546277dc3 Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestJSON-301447634-project Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 26e6716b-8039-48ec-9e12-fb154188021f could not be found. Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '26e6716b-8039-48ec-9e12-fb154188021f'} Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26e6716b-8039-48ec-9e12-fb154188021f could not be found. Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26e6716b-8039-48ec-9e12-fb154188021f could not be found. Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:59.255484 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:22:59.263669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:22:59.263669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:22:59.263669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:22:59.263669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:22:59.263669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26e6716b-8039-48ec-9e12-fb154188021f could not be found. Jul 26 14:22:59.263669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:22:59.268090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d29b06c9-dddd-4ac0-b833-a3fb083e2beb tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] Returning 404 to user: Instance 26e6716b-8039-48ec-9e12-fb154188021f could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:22:59.269698 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d29b06c9-dddd-4ac0-b833-a3fb083e2beb tempest-ServersTestJSON-301447634 tempest-ServersTestJSON-301447634-project] 10.222.0.70 "GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f" status: 404 len: 111 microversion: 2.1 time: 0.060748 Jul 26 14:22:59.271481 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1820/3760] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:22:59 2022] GET /compute/v2.1/servers/26e6716b-8039-48ec-9e12-fb154188021f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:22:59.300877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b0ef90e-6885-409a-b93e-00808912b87c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:22:59.302611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b0ef90e-6885-409a-b93e-00808912b87c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:22:59.326168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0ef90e-6885-409a-b93e-00808912b87c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:59.326638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0ef90e-6885-409a-b93e-00808912b87c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:22:59.327687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0ef90e-6885-409a-b93e-00808912b87c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:22:59.328181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0ef90e-6885-409a-b93e-00808912b87c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:00.158615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b0ef90e-6885-409a-b93e-00808912b87c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:00.193280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b0ef90e-6885-409a-b93e-00808912b87c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:00.198607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b0ef90e-6885-409a-b93e-00808912b87c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:00.200185 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b0ef90e-6885-409a-b93e-00808912b87c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.926679 Jul 26 14:23:00.203730 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1821/3761] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:22:59 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:00.212065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bc93db29-969b-4a55-9a98-93b0353a6b31 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:00.216188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bc93db29-969b-4a55-9a98-93b0353a6b31 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: a900e83e-11a0-4cd4-85c0-c09b6e4da5c7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:00.231500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc93db29-969b-4a55-9a98-93b0353a6b31 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:00.234443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc93db29-969b-4a55-9a98-93b0353a6b31 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:00.237724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc93db29-969b-4a55-9a98-93b0353a6b31 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:00.238527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc93db29-969b-4a55-9a98-93b0353a6b31 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:00.279522 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-bc93db29-969b-4a55-9a98-93b0353a6b31 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] HTTP exception thrown: Instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 could not be found. Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bc93db29-969b-4a55-9a98-93b0353a6b31 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Request method failure captured: Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 HTTP/1.1 Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_bvG1FS6NvZSlKtBQTMGRmXZvPS2Rc5ma32tvFmKFggy6_eixXcQC9F0iQaU63II5FqkNN4nt8XOqDelpvSzhiXVKROWCDMeIkZmGu4xEXtQzOOkPMwy9Sdne-j-xaCGxccRjPTAbkKKk4P2qbGyKuRxR_5LB_SYg-DyyTEerNsSfM Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 1976cab4a83747a68cadf5b4dc2dbef0 Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-LiveMigrationTest-898292491 Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1976cab4a83747a68cadf5b4dc2dbef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1976cab4a83747a68cadf5b4dc2dbef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1976cab4a83747a68cadf5b4dc2dbef0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1976cab4a83747a68cadf5b4dc2dbef0"}]}] Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-LiveMigrationTest-898292491 Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 1976cab4a83747a68cadf5b4dc2dbef0 Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-LiveMigrationTest-898292491 Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-LiveMigrationTest-898292491-project Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: e35f47eb9e094bdc8d08ea4cf2970d8c Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-LiveMigrationTest-898292491-project Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 could not be found. Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'a900e83e-11a0-4cd4-85c0-c09b6e4da5c7'} Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 could not be found. Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 could not be found. Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:00.282133 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:00.287612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:00.287612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:00.287612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:00.287612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:00.287612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 could not be found. Jul 26 14:23:00.287612 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:00.288527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:23:00.289292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:23:00.289757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bc93db29-969b-4a55-9a98-93b0353a6b31 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Returning 404 to user: Instance a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:00.290159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:23:00.290925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:23:00.291307 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bc93db29-969b-4a55-9a98-93b0353a6b31 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7" status: 404 len: 111 microversion: 2.1 time: 0.085965 Jul 26 14:23:00.291712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:23:00.292280 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1822/3762] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:00 2022] GET /compute/v2.1/servers/a900e83e-11a0-4cd4-85c0-c09b6e4da5c7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:23:00.301106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-388583ac-9a07-411f-8c95-9b290c9257a0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:00.302065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-388583ac-9a07-411f-8c95-9b290c9257a0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:00.313644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-388583ac-9a07-411f-8c95-9b290c9257a0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:00.317479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-388583ac-9a07-411f-8c95-9b290c9257a0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:00.318582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-388583ac-9a07-411f-8c95-9b290c9257a0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:00.320583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-388583ac-9a07-411f-8c95-9b290c9257a0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:00.344394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:00.344863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:00.345882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:00.346636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:00.429445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for project 991c7f82c09446409408ca9d0638fcba. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:23:00.454081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for user 7b5b7e30e280492b85d9c8f98fe09e43 and project 991c7f82c09446409408ca9d0638fcba. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:23:00.477408 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-388583ac-9a07-411f-8c95-9b290c9257a0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.183591 Jul 26 14:23:00.486244 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1823/3763] 10.222.0.70 () {60 vars in 1316 bytes} [Tue Jul 26 14:23:00 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:23:00.491734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d419d06-18ae-4b2f-9d10-a7b6976bee11 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '.version_select at 0x7f8786ede4c0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:00.496004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:23:00.501434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:23:00.520281 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3d419d06-18ae-4b2f-9d10-a7b6976bee11 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-875563219" status: 202 len: 0 microversion: 2.1 time: 0.040975 Jul 26 14:23:00.524015 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1824/3764] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Jul 26 14:23:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-875563219 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:23:00.638143 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6f965e8b-f5f9-4451-b06f-6e50f313f1d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.119772 Jul 26 14:23:00.647255 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1941/3765] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:22:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:23:00.654877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-030e3f71-f623-4f24-a73f-ac4ee14b0468 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:00.656803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-030e3f71-f623-4f24-a73f-ac4ee14b0468 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:00.848937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-030e3f71-f623-4f24-a73f-ac4ee14b0468 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:00.860251 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-030e3f71-f623-4f24-a73f-ac4ee14b0468 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1214 microversion: 2.1 time: 0.210809 Jul 26 14:23:00.876353 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1825/3766] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:00 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1214 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:01.257571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0ae6c083-48b8-496a-9bd8-65f92a746f6e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:01.263936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0ae6c083-48b8-496a-9bd8-65f92a746f6e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:01.285463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae6c083-48b8-496a-9bd8-65f92a746f6e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:01.286533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae6c083-48b8-496a-9bd8-65f92a746f6e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:01.288032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae6c083-48b8-496a-9bd8-65f92a746f6e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:01.290763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae6c083-48b8-496a-9bd8-65f92a746f6e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:01.443870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ae6c083-48b8-496a-9bd8-65f92a746f6e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:01.466351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ae6c083-48b8-496a-9bd8-65f92a746f6e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:01.468681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ae6c083-48b8-496a-9bd8-65f92a746f6e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:01.470397 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0ae6c083-48b8-496a-9bd8-65f92a746f6e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.222286 Jul 26 14:23:01.496233 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1942/3767] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:01 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:01.889134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c45a221e-22f5-4030-8a62-6575fd37692b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:01.890842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c45a221e-22f5-4030-8a62-6575fd37692b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:01.908749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c45a221e-22f5-4030-8a62-6575fd37692b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:01.909260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c45a221e-22f5-4030-8a62-6575fd37692b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:01.910229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c45a221e-22f5-4030-8a62-6575fd37692b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:01.910891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c45a221e-22f5-4030-8a62-6575fd37692b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:01.991779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c45a221e-22f5-4030-8a62-6575fd37692b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:02.003888 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c45a221e-22f5-4030-8a62-6575fd37692b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1266 microversion: 2.1 time: 0.123833 Jul 26 14:23:02.015998 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1826/3768] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:01 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:02.510853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e090dd94-4943-4469-8ee4-87ce346a17eb tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:02.511752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e090dd94-4943-4469-8ee4-87ce346a17eb tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:02.526537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e090dd94-4943-4469-8ee4-87ce346a17eb tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:02.527261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e090dd94-4943-4469-8ee4-87ce346a17eb tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:02.535550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e090dd94-4943-4469-8ee4-87ce346a17eb tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:02.536605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e090dd94-4943-4469-8ee4-87ce346a17eb tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:02.735153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e090dd94-4943-4469-8ee4-87ce346a17eb tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:02.745264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e090dd94-4943-4469-8ee4-87ce346a17eb tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:02.754086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e090dd94-4943-4469-8ee4-87ce346a17eb tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:02.761753 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e090dd94-4943-4469-8ee4-87ce346a17eb tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.254593 Jul 26 14:23:02.772833 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1943/3769] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:02 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:03.041666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a41892ff-f845-4004-9e75-7809cd06e16a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:03.042315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a41892ff-f845-4004-9e75-7809cd06e16a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:03.050378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a41892ff-f845-4004-9e75-7809cd06e16a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:03.051101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a41892ff-f845-4004-9e75-7809cd06e16a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:03.052446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a41892ff-f845-4004-9e75-7809cd06e16a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:03.053220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a41892ff-f845-4004-9e75-7809cd06e16a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:03.250009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a41892ff-f845-4004-9e75-7809cd06e16a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:03.311533 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a41892ff-f845-4004-9e75-7809cd06e16a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1272 microversion: 2.1 time: 0.273884 Jul 26 14:23:03.315138 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1827/3770] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:03 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:03.499743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f96473c6-c30e-4ef8-a89c-b8f2c4e54022 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:03.501941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f96473c6-c30e-4ef8-a89c-b8f2c4e54022 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:03.539210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f96473c6-c30e-4ef8-a89c-b8f2c4e54022 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:03.541328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f96473c6-c30e-4ef8-a89c-b8f2c4e54022 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:03.543266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f96473c6-c30e-4ef8-a89c-b8f2c4e54022 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:03.544791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f96473c6-c30e-4ef8-a89c-b8f2c4e54022 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:03.595704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f96473c6-c30e-4ef8-a89c-b8f2c4e54022 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:23:03.753988 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f96473c6-c30e-4ef8-a89c-b8f2c4e54022 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 204 len: 0 microversion: 2.1 time: 0.259625 Jul 26 14:23:03.755460 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1944/3771] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:23:03 2022] DELETE /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:23:03.771709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-252b8188-d045-492a-a29d-177f6c6bf1ca tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:03.777548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-252b8188-d045-492a-a29d-177f6c6bf1ca tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:03.798450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-646bb426-77d0-48e2-9b20-4c14e13267ee tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:03.799528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-252b8188-d045-492a-a29d-177f6c6bf1ca tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:03.799942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-646bb426-77d0-48e2-9b20-4c14e13267ee tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:03.800666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-252b8188-d045-492a-a29d-177f6c6bf1ca tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:03.801740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-252b8188-d045-492a-a29d-177f6c6bf1ca tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:03.802600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-252b8188-d045-492a-a29d-177f6c6bf1ca tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:03.834882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-646bb426-77d0-48e2-9b20-4c14e13267ee tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:03.835701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-646bb426-77d0-48e2-9b20-4c14e13267ee tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:03.837330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-646bb426-77d0-48e2-9b20-4c14e13267ee tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:03.838151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-646bb426-77d0-48e2-9b20-4c14e13267ee tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:04.018068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-646bb426-77d0-48e2-9b20-4c14e13267ee tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:04.034201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-646bb426-77d0-48e2-9b20-4c14e13267ee tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:04.040684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-646bb426-77d0-48e2-9b20-4c14e13267ee tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:04.044958 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-646bb426-77d0-48e2-9b20-4c14e13267ee tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.252701 Jul 26 14:23:04.049245 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1945/3772] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:03 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:23:04.346598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0aa42ec9-1769-4b0e-9c25-9e73d342b5df tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:04.347654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0aa42ec9-1769-4b0e-9c25-9e73d342b5df tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:04.377517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0aa42ec9-1769-4b0e-9c25-9e73d342b5df tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:04.378696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0aa42ec9-1769-4b0e-9c25-9e73d342b5df tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:04.386095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0aa42ec9-1769-4b0e-9c25-9e73d342b5df tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:04.388171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0aa42ec9-1769-4b0e-9c25-9e73d342b5df tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:04.768381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-252b8188-d045-492a-a29d-177f6c6bf1ca tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:04.810128 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-252b8188-d045-492a-a29d-177f6c6bf1ca tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1484 microversion: 2.1 time: 1.045810 Jul 26 14:23:04.812135 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1828/3773] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:03 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1484 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:05.090394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6dc43205-07f2-4f82-b73f-5325c4ec68c7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:05.091349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6dc43205-07f2-4f82-b73f-5325c4ec68c7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:05.122984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dc43205-07f2-4f82-b73f-5325c4ec68c7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:05.123524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dc43205-07f2-4f82-b73f-5325c4ec68c7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:05.124984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dc43205-07f2-4f82-b73f-5325c4ec68c7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:05.126242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dc43205-07f2-4f82-b73f-5325c4ec68c7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:05.469366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6dc43205-07f2-4f82-b73f-5325c4ec68c7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:05.507527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6dc43205-07f2-4f82-b73f-5325c4ec68c7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:05.510765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6dc43205-07f2-4f82-b73f-5325c4ec68c7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:05.512995 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6dc43205-07f2-4f82-b73f-5325c4ec68c7 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.426426 Jul 26 14:23:05.545274 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1829/3774] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:05 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:05.649376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7d03b409-ed12-4d6e-863e-dfa072fb7a50 req-3a453105-6c7a-48f3-b68d-86c346626a22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7576357-b5e0-45fb-9641-d397a6b3faf2", "tag": "f88eaeb3-e484-4f96-b4ba-99b8b947950a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:05.682609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7d03b409-ed12-4d6e-863e-dfa072fb7a50 req-3a453105-6c7a-48f3-b68d-86c346626a22 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:05.683277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7d03b409-ed12-4d6e-863e-dfa072fb7a50 req-3a453105-6c7a-48f3-b68d-86c346626a22 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:05.700188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0aa42ec9-1769-4b0e-9c25-9e73d342b5df tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:05.711608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0aa42ec9-1769-4b0e-9c25-9e73d342b5df tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1314 microversion: 2.1 time: 1.377492 Jul 26 14:23:05.724737 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7d03b409-ed12-4d6e-863e-dfa072fb7a50 req-3a453105-6c7a-48f3-b68d-86c346626a22 service nova] Creating event network-changed:f88eaeb3-e484-4f96-b4ba-99b8b947950a for instance d7576357-b5e0-45fb-9641-d397a6b3faf2 on n-h2-833090-9 Jul 26 14:23:05.736661 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1946/3775] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:04 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1314 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:05.741285 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7d03b409-ed12-4d6e-863e-dfa072fb7a50 req-3a453105-6c7a-48f3-b68d-86c346626a22 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098995 Jul 26 14:23:05.745179 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1830/3776] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:05.847146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fca43385-2f77-4675-b8a7-5f96ba5c35b2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:05.851758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fca43385-2f77-4675-b8a7-5f96ba5c35b2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:05.866944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fca43385-2f77-4675-b8a7-5f96ba5c35b2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:05.881380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fca43385-2f77-4675-b8a7-5f96ba5c35b2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:05.883347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fca43385-2f77-4675-b8a7-5f96ba5c35b2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:05.884700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fca43385-2f77-4675-b8a7-5f96ba5c35b2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:06.596889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a930150c-984d-4d4a-bda4-6d2315c47c1c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:06.610001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a930150c-984d-4d4a-bda4-6d2315c47c1c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:06.639059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a930150c-984d-4d4a-bda4-6d2315c47c1c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:06.641041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a930150c-984d-4d4a-bda4-6d2315c47c1c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:06.643567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a930150c-984d-4d4a-bda4-6d2315c47c1c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:06.645112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a930150c-984d-4d4a-bda4-6d2315c47c1c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:07.033018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a930150c-984d-4d4a-bda4-6d2315c47c1c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:07.036354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fca43385-2f77-4675-b8a7-5f96ba5c35b2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:07.056322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a930150c-984d-4d4a-bda4-6d2315c47c1c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:07.064331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a930150c-984d-4d4a-bda4-6d2315c47c1c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:07.064703 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fca43385-2f77-4675-b8a7-5f96ba5c35b2 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1484 microversion: 2.1 time: 1.224660 Jul 26 14:23:07.066401 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a930150c-984d-4d4a-bda4-6d2315c47c1c tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.506140 Jul 26 14:23:07.067560 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1831/3777] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:06 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:07.076915 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1947/3778] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:05 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1484 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:07.081188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-53aa8a35-674f-4226-bdd6-49a0f1aa7f19 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:07.082547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-53aa8a35-674f-4226-bdd6-49a0f1aa7f19 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:07.099158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53aa8a35-674f-4226-bdd6-49a0f1aa7f19 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:07.099939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53aa8a35-674f-4226-bdd6-49a0f1aa7f19 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:07.104969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53aa8a35-674f-4226-bdd6-49a0f1aa7f19 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:07.106187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53aa8a35-674f-4226-bdd6-49a0f1aa7f19 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:07.123412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:07.914710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-53aa8a35-674f-4226-bdd6-49a0f1aa7f19 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:07.958890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-193f7c35-ee19-44a4-b9a4-8533fdac9b59 req-b11558c4-c43a-4136-ae1e-2e09396f3b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f48b35a-d0b1-4601-a9d6-1af81d99f6b6", "name": "network-vif-deleted", "tag": "824da495-3034-4a08-821e-b7d317b4eb25"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:07.988333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:07.993609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-193f7c35-ee19-44a4-b9a4-8533fdac9b59 req-b11558c4-c43a-4136-ae1e-2e09396f3b1c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:07.994031 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-53aa8a35-674f-4226-bdd6-49a0f1aa7f19 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1314 microversion: 2.1 time: 0.901892 Jul 26 14:23:07.995767 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1832/3779] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:07 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1314 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:08.011790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-193f7c35-ee19-44a4-b9a4-8533fdac9b59 req-b11558c4-c43a-4136-ae1e-2e09396f3b1c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:08.098333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fa8b838a-f9e2-45c5-99ac-5c688df71b8d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:08.099396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fa8b838a-f9e2-45c5-99ac-5c688df71b8d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:08.114154 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-193f7c35-ee19-44a4-b9a4-8533fdac9b59 req-b11558c4-c43a-4136-ae1e-2e09396f3b1c service nova] Creating event network-vif-deleted:824da495-3034-4a08-821e-b7d317b4eb25 for instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 on n-h2-833090-9 Jul 26 14:23:08.115002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa8b838a-f9e2-45c5-99ac-5c688df71b8d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:08.115768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa8b838a-f9e2-45c5-99ac-5c688df71b8d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:08.129928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa8b838a-f9e2-45c5-99ac-5c688df71b8d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:08.130512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa8b838a-f9e2-45c5-99ac-5c688df71b8d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:08.142851 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-193f7c35-ee19-44a4-b9a4-8533fdac9b59 req-b11558c4-c43a-4136-ae1e-2e09396f3b1c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187116 Jul 26 14:23:08.148667 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1948/3780] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:08.166753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-28c6887d-fd63-4f41-982a-22693c4dc431 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:08.168941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-28c6887d-fd63-4f41-982a-22693c4dc431 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:08.212510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c6887d-fd63-4f41-982a-22693c4dc431 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:08.213294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c6887d-fd63-4f41-982a-22693c4dc431 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:08.214840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c6887d-fd63-4f41-982a-22693c4dc431 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:08.218083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28c6887d-fd63-4f41-982a-22693c4dc431 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:08.514017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fa8b838a-f9e2-45c5-99ac-5c688df71b8d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:08.527034 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fa8b838a-f9e2-45c5-99ac-5c688df71b8d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 200 len: 1281 microversion: 2.1 time: 0.437385 Jul 26 14:23:08.531806 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1833/3781] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:08 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 1281 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:08.537408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-28c6887d-fd63-4f41-982a-22693c4dc431 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:08.574395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-28c6887d-fd63-4f41-982a-22693c4dc431 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:08.579779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-28c6887d-fd63-4f41-982a-22693c4dc431 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:08.586753 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-28c6887d-fd63-4f41-982a-22693c4dc431 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.435155 Jul 26 14:23:08.588430 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1949/3782] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:08 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:09.027624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fda314a6-17d6-4e5b-b55c-6631ffe64edf tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:09.029717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fda314a6-17d6-4e5b-b55c-6631ffe64edf tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:09.055417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fda314a6-17d6-4e5b-b55c-6631ffe64edf tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:09.057276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fda314a6-17d6-4e5b-b55c-6631ffe64edf tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:09.059985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fda314a6-17d6-4e5b-b55c-6631ffe64edf tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:09.062055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fda314a6-17d6-4e5b-b55c-6631ffe64edf tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:09.577558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-efbcac2d-477d-4c63-802d-1476999d1dc3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:09.578695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-efbcac2d-477d-4c63-802d-1476999d1dc3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:09.608981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efbcac2d-477d-4c63-802d-1476999d1dc3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:09.610567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efbcac2d-477d-4c63-802d-1476999d1dc3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:09.611429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efbcac2d-477d-4c63-802d-1476999d1dc3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:09.613606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efbcac2d-477d-4c63-802d-1476999d1dc3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:09.691382 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-efbcac2d-477d-4c63-802d-1476999d1dc3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] HTTP exception thrown: Instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 could not be found. Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-efbcac2d-477d-4c63-802d-1476999d1dc3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Request method failure captured: Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 HTTP/1.1 Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_bvG1FS6NvZSlKtBQTMGRmXZvPS2Rc5ma32tvFmKFggy6_eixXcQC9F0iQaU63II5FqkNN4nt8XOqDelpvSzhiXVKROWCDMeIkZmGu4xEXtQzOOkPMwy9Sdne-j-xaCGxccRjPTAbkKKk4P2qbGyKuRxR_5LB_SYg-DyyTEerNsSfM Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 1976cab4a83747a68cadf5b4dc2dbef0 Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-LiveMigrationTest-898292491 Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1976cab4a83747a68cadf5b4dc2dbef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1976cab4a83747a68cadf5b4dc2dbef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1976cab4a83747a68cadf5b4dc2dbef0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1976cab4a83747a68cadf5b4dc2dbef0"}]}] Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-LiveMigrationTest-898292491 Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 1976cab4a83747a68cadf5b4dc2dbef0 Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-LiveMigrationTest-898292491 Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-LiveMigrationTest-898292491-project Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: e35f47eb9e094bdc8d08ea4cf2970d8c Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-LiveMigrationTest-898292491-project Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 could not be found. Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '1f48b35a-d0b1-4601-a9d6-1af81d99f6b6'} Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 could not be found. Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 could not be found. Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:09.693150 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:09.701351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:09.701351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:09.701351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:09.701351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:09.701351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 could not be found. Jul 26 14:23:09.701351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:09.701351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-efbcac2d-477d-4c63-802d-1476999d1dc3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Returning 404 to user: Instance 1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:09.706167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fda314a6-17d6-4e5b-b55c-6631ffe64edf tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:09.707538 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-efbcac2d-477d-4c63-802d-1476999d1dc3 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6" status: 404 len: 111 microversion: 2.1 time: 0.133672 Jul 26 14:23:09.708530 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1950/3783] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:09 2022] GET /compute/v2.1/servers/1f48b35a-d0b1-4601-a9d6-1af81d99f6b6 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:23:09.727276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6b5c2e1b-09df-4265-84ab-2cc96e639530 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:09.727276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6b5c2e1b-09df-4265-84ab-2cc96e639530 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:09.737407 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fda314a6-17d6-4e5b-b55c-6631ffe64edf tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1314 microversion: 2.1 time: 0.715238 Jul 26 14:23:09.738388 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1834/3784] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:09 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:09.756924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b5c2e1b-09df-4265-84ab-2cc96e639530 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:09.757690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b5c2e1b-09df-4265-84ab-2cc96e639530 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:09.771063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-885a57cb-9944-467d-bd41-9eddb9fc7714 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:09.771904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-885a57cb-9944-467d-bd41-9eddb9fc7714 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:09.773232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b5c2e1b-09df-4265-84ab-2cc96e639530 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:09.773996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b5c2e1b-09df-4265-84ab-2cc96e639530 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:09.801845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-885a57cb-9944-467d-bd41-9eddb9fc7714 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:09.802945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-885a57cb-9944-467d-bd41-9eddb9fc7714 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:09.804566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-885a57cb-9944-467d-bd41-9eddb9fc7714 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:09.805599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-885a57cb-9944-467d-bd41-9eddb9fc7714 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:09.857939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-885a57cb-9944-467d-bd41-9eddb9fc7714 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:23:09.990960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6b5c2e1b-09df-4265-84ab-2cc96e639530 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:10.019884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6b5c2e1b-09df-4265-84ab-2cc96e639530 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:10.027306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6b5c2e1b-09df-4265-84ab-2cc96e639530 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:10.035130 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6b5c2e1b-09df-4265-84ab-2cc96e639530 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.325596 Jul 26 14:23:10.041730 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1951/3785] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:09 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:10.087115 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-885a57cb-9944-467d-bd41-9eddb9fc7714 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "DELETE /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 204 len: 0 microversion: 2.1 time: 0.347056 Jul 26 14:23:10.088749 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1835/3786] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:23:09 2022] DELETE /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:23:10.100198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a75281ba-d5a3-4f0b-952c-37483d349321 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:10.101277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a75281ba-d5a3-4f0b-952c-37483d349321 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:10.109545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a75281ba-d5a3-4f0b-952c-37483d349321 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:10.110490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a75281ba-d5a3-4f0b-952c-37483d349321 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:10.112419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a75281ba-d5a3-4f0b-952c-37483d349321 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:10.113865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a75281ba-d5a3-4f0b-952c-37483d349321 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:10.129568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:10.374694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:10.448778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-10ddc607-77b0-4e2b-b982-09035861fe80 req-2bc660a0-bff3-488f-8edb-253da66eb36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08201385-1b2e-4fcd-95d4-ae2473256860", "tag": "34ec0ab6-21f2-4baa-b538-eeee85ef60cc"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:10.482066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:10.493409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-10ddc607-77b0-4e2b-b982-09035861fe80 req-2bc660a0-bff3-488f-8edb-253da66eb36e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:10.496759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-10ddc607-77b0-4e2b-b982-09035861fe80 req-2bc660a0-bff3-488f-8edb-253da66eb36e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:10.542842 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-10ddc607-77b0-4e2b-b982-09035861fe80 req-2bc660a0-bff3-488f-8edb-253da66eb36e service nova] Creating event network-changed:34ec0ab6-21f2-4baa-b538-eeee85ef60cc for instance 08201385-1b2e-4fcd-95d4-ae2473256860 on n-h1-833090-9 Jul 26 14:23:10.563047 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-10ddc607-77b0-4e2b-b982-09035861fe80 req-2bc660a0-bff3-488f-8edb-253da66eb36e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118520 Jul 26 14:23:10.567797 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1836/3787] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:23:10.658178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a75281ba-d5a3-4f0b-952c-37483d349321 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:10.671579 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a75281ba-d5a3-4f0b-952c-37483d349321 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1500 microversion: 2.1 time: 0.576627 Jul 26 14:23:10.674058 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1952/3788] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:10 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1500 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:10.785905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-909694eb-c5f8-4f77-8f9d-2e57dba2c1cd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:10.787501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-909694eb-c5f8-4f77-8f9d-2e57dba2c1cd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:10.806279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-909694eb-c5f8-4f77-8f9d-2e57dba2c1cd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:10.806757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-909694eb-c5f8-4f77-8f9d-2e57dba2c1cd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:10.808117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-909694eb-c5f8-4f77-8f9d-2e57dba2c1cd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:10.808923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-909694eb-c5f8-4f77-8f9d-2e57dba2c1cd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:10.855369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:11.075150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-77f186e2-cfa7-4121-a703-fbf91f569c4e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:11.076287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-77f186e2-cfa7-4121-a703-fbf91f569c4e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:11.101771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77f186e2-cfa7-4121-a703-fbf91f569c4e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:11.102229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77f186e2-cfa7-4121-a703-fbf91f569c4e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:11.104778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77f186e2-cfa7-4121-a703-fbf91f569c4e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:11.106123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77f186e2-cfa7-4121-a703-fbf91f569c4e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:11.380321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-77f186e2-cfa7-4121-a703-fbf91f569c4e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:11.405742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-77f186e2-cfa7-4121-a703-fbf91f569c4e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:11.410589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-77f186e2-cfa7-4121-a703-fbf91f569c4e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:11.413394 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-77f186e2-cfa7-4121-a703-fbf91f569c4e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.344863 Jul 26 14:23:11.429450 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1953/3789] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:11 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:23:11.511463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-909694eb-c5f8-4f77-8f9d-2e57dba2c1cd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:11.531379 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-909694eb-c5f8-4f77-8f9d-2e57dba2c1cd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1314 microversion: 2.1 time: 0.759255 Jul 26 14:23:11.552022 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1837/3790] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:10 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:11.705568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a15f68e0-3f1e-4605-b4ba-0437e87fd991 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:11.707121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a15f68e0-3f1e-4605-b4ba-0437e87fd991 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:11.724940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a15f68e0-3f1e-4605-b4ba-0437e87fd991 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:11.726119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a15f68e0-3f1e-4605-b4ba-0437e87fd991 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:11.727616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a15f68e0-3f1e-4605-b4ba-0437e87fd991 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:11.729308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a15f68e0-3f1e-4605-b4ba-0437e87fd991 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:12.043689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a15f68e0-3f1e-4605-b4ba-0437e87fd991 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:12.058635 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a15f68e0-3f1e-4605-b4ba-0437e87fd991 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1500 microversion: 2.1 time: 0.359583 Jul 26 14:23:12.059921 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1954/3791] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:11 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1500 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:12.083648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-cc06c455-46ed-4525-8e8e-bb040ccc9b80 req-7a6da575-045c-4bc8-b750-fc4ea12b1a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66a91319-e533-46c4-988e-f7480ff27ba4", "name": "network-vif-deleted", "tag": "0ab4988a-bac5-4440-ac27-184f1fcd12b8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:12.100492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cc06c455-46ed-4525-8e8e-bb040ccc9b80 req-7a6da575-045c-4bc8-b750-fc4ea12b1a9a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:12.100943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cc06c455-46ed-4525-8e8e-bb040ccc9b80 req-7a6da575-045c-4bc8-b750-fc4ea12b1a9a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:12.128291 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-cc06c455-46ed-4525-8e8e-bb040ccc9b80 req-7a6da575-045c-4bc8-b750-fc4ea12b1a9a service nova] Creating event network-vif-deleted:0ab4988a-bac5-4440-ac27-184f1fcd12b8 for instance 66a91319-e533-46c4-988e-f7480ff27ba4 on n-h1-833090-9 Jul 26 14:23:12.135181 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-cc06c455-46ed-4525-8e8e-bb040ccc9b80 req-7a6da575-045c-4bc8-b750-fc4ea12b1a9a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058645 Jul 26 14:23:12.136326 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1838/3792] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:12.451622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1f941213-f643-4388-a4f0-8f5c3d6c3b8f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:12.453190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1f941213-f643-4388-a4f0-8f5c3d6c3b8f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:12.489256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f941213-f643-4388-a4f0-8f5c3d6c3b8f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:12.505355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f941213-f643-4388-a4f0-8f5c3d6c3b8f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:12.512438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f941213-f643-4388-a4f0-8f5c3d6c3b8f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:12.513440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f941213-f643-4388-a4f0-8f5c3d6c3b8f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:12.572694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-60540aad-08b1-4b20-9f2d-bee70df1240e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:12.576533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-60540aad-08b1-4b20-9f2d-bee70df1240e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:12.599965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60540aad-08b1-4b20-9f2d-bee70df1240e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:12.600830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60540aad-08b1-4b20-9f2d-bee70df1240e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:12.602020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60540aad-08b1-4b20-9f2d-bee70df1240e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:12.602586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60540aad-08b1-4b20-9f2d-bee70df1240e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:12.699555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1f941213-f643-4388-a4f0-8f5c3d6c3b8f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:12.742638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1f941213-f643-4388-a4f0-8f5c3d6c3b8f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:12.745475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1f941213-f643-4388-a4f0-8f5c3d6c3b8f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:12.746779 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1f941213-f643-4388-a4f0-8f5c3d6c3b8f tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.303608 Jul 26 14:23:12.768780 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1955/3793] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:12 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:12.915514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-60540aad-08b1-4b20-9f2d-bee70df1240e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:12.929160 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-60540aad-08b1-4b20-9f2d-bee70df1240e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1314 microversion: 2.1 time: 0.363962 Jul 26 14:23:12.930629 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1839/3794] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:12 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:13.096951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:13.097940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:13.105726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:13.107669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:13.109963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:13.110813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:13.175835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:13.177242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:13.195720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lazy-loading 'fault' on Instance uuid 66a91319-e533-46c4-988e-f7480ff27ba4 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:23:13.283262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35f47eb9e094bdc8d08ea4cf2970d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1976cab4a83747a68cadf5b4dc2dbef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:13.293009 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-97d7f51d-f1d9-4bdf-871f-139df2587d58 tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 200 len: 1301 microversion: 2.1 time: 0.200750 Jul 26 14:23:13.293853 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1956/3795] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:13 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 1301 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:13.566786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d6f14a99-4edb-46ad-ad27-b3a80ac3031c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:13.567312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d6f14a99-4edb-46ad-ad27-b3a80ac3031c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:13.576276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f14a99-4edb-46ad-ad27-b3a80ac3031c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:13.577536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f14a99-4edb-46ad-ad27-b3a80ac3031c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:13.580932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f14a99-4edb-46ad-ad27-b3a80ac3031c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:13.581827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f14a99-4edb-46ad-ad27-b3a80ac3031c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:13.623066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d6f14a99-4edb-46ad-ad27-b3a80ac3031c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:23:13.764543 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d6f14a99-4edb-46ad-ad27-b3a80ac3031c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 204 len: 0 microversion: 2.1 time: 0.202925 Jul 26 14:23:13.768462 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1957/3796] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:23:13 2022] DELETE /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:23:13.788333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-81fbf616-f3d2-479a-87a2-9eb3d94a2828 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:13.792972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-81fbf616-f3d2-479a-87a2-9eb3d94a2828 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:13.803163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81fbf616-f3d2-479a-87a2-9eb3d94a2828 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:13.804045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81fbf616-f3d2-479a-87a2-9eb3d94a2828 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:13.805091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81fbf616-f3d2-479a-87a2-9eb3d94a2828 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:13.805707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81fbf616-f3d2-479a-87a2-9eb3d94a2828 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:13.828683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-746ea774-0171-4de5-9d5d-e649053f2227 tempest-ExtensionsTest-1364305625 tempest-ExtensionsTest-1364305625-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:13.831533 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-746ea774-0171-4de5-9d5d-e649053f2227 tempest-ExtensionsTest-1364305625 tempest-ExtensionsTest-1364305625-project] 10.222.0.70 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.345158 Jul 26 14:23:13.832486 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1840/3797] 10.222.0.70 () {58 vars in 1170 bytes} [Tue Jul 26 14:23:13 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:13.856466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0668886c-2f86-46a9-81ec-9ad871f964c1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:13.859683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0668886c-2f86-46a9-81ec-9ad871f964c1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:13.886047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0668886c-2f86-46a9-81ec-9ad871f964c1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:13.886515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0668886c-2f86-46a9-81ec-9ad871f964c1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:13.887317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0668886c-2f86-46a9-81ec-9ad871f964c1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:13.887803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0668886c-2f86-46a9-81ec-9ad871f964c1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:13.915144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-81fbf616-f3d2-479a-87a2-9eb3d94a2828 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:13.927852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-81fbf616-f3d2-479a-87a2-9eb3d94a2828 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:13.930969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-81fbf616-f3d2-479a-87a2-9eb3d94a2828 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:13.934901 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-81fbf616-f3d2-479a-87a2-9eb3d94a2828 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.163333 Jul 26 14:23:13.937940 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1958/3798] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:13 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:13.947079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-88c58753-d49b-4ad9-8bdb-ed82ec73157f tempest-ExtensionsTest-1364305625 tempest-ExtensionsTest-1364305625-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:13.953404 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-88c58753-d49b-4ad9-8bdb-ed82ec73157f tempest-ExtensionsTest-1364305625 tempest-ExtensionsTest-1364305625-project] 10.222.0.70 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.012801 Jul 26 14:23:13.969268 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1959/3799] 10.222.0.70 () {58 vars in 1134 bytes} [Tue Jul 26 14:23:13 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:23:13.972746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ec457785-3e5d-4c12-9d12-1825e6776b43 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:13.978122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ec457785-3e5d-4c12-9d12-1825e6776b43 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:14.003614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec457785-3e5d-4c12-9d12-1825e6776b43 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:14.007355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec457785-3e5d-4c12-9d12-1825e6776b43 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:14.009757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec457785-3e5d-4c12-9d12-1825e6776b43 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:14.015183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec457785-3e5d-4c12-9d12-1825e6776b43 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:14.261558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0668886c-2f86-46a9-81ec-9ad871f964c1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:14.287534 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0668886c-2f86-46a9-81ec-9ad871f964c1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1553 microversion: 2.1 time: 0.447052 Jul 26 14:23:14.289516 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1841/3800] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:13 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1553 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:14.322737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8285e01f-50dd-4da1-803b-67198bfdd81d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:14.323573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8285e01f-50dd-4da1-803b-67198bfdd81d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] [instance: 66a91319-e533-46c4-988e-f7480ff27ba4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:14.332296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ec457785-3e5d-4c12-9d12-1825e6776b43 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:14.344470 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ec457785-3e5d-4c12-9d12-1825e6776b43 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1314 microversion: 2.1 time: 0.386125 Jul 26 14:23:14.348785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8285e01f-50dd-4da1-803b-67198bfdd81d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:14.349306 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1960/3801] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:13 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:14.349927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8285e01f-50dd-4da1-803b-67198bfdd81d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:14.355381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8285e01f-50dd-4da1-803b-67198bfdd81d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:14.356246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8285e01f-50dd-4da1-803b-67198bfdd81d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:14.383818 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8285e01f-50dd-4da1-803b-67198bfdd81d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] HTTP exception thrown: Instance 66a91319-e533-46c4-988e-f7480ff27ba4 could not be found. Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8285e01f-50dd-4da1-803b-67198bfdd81d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Request method failure captured: Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 HTTP/1.1 Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_bvG1FS6NvZSlKtBQTMGRmXZvPS2Rc5ma32tvFmKFggy6_eixXcQC9F0iQaU63II5FqkNN4nt8XOqDelpvSzhiXVKROWCDMeIkZmGu4xEXtQzOOkPMwy9Sdne-j-xaCGxccRjPTAbkKKk4P2qbGyKuRxR_5LB_SYg-DyyTEerNsSfM Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 1976cab4a83747a68cadf5b4dc2dbef0 Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-LiveMigrationTest-898292491 Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1976cab4a83747a68cadf5b4dc2dbef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1976cab4a83747a68cadf5b4dc2dbef0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1976cab4a83747a68cadf5b4dc2dbef0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1976cab4a83747a68cadf5b4dc2dbef0"}]}] Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-LiveMigrationTest-898292491 Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 1976cab4a83747a68cadf5b4dc2dbef0 Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-LiveMigrationTest-898292491 Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-LiveMigrationTest-898292491-project Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: e35f47eb9e094bdc8d08ea4cf2970d8c Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-LiveMigrationTest-898292491-project Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 66a91319-e533-46c4-988e-f7480ff27ba4 could not be found. Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '66a91319-e533-46c4-988e-f7480ff27ba4'} Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66a91319-e533-46c4-988e-f7480ff27ba4 could not be found. Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66a91319-e533-46c4-988e-f7480ff27ba4 could not be found. Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:14.386470 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:14.398626 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:14.398626 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:14.398626 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:14.398626 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:14.398626 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66a91319-e533-46c4-988e-f7480ff27ba4 could not be found. Jul 26 14:23:14.398626 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:14.398626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8285e01f-50dd-4da1-803b-67198bfdd81d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] Returning 404 to user: Instance 66a91319-e533-46c4-988e-f7480ff27ba4 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:14.398626 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8285e01f-50dd-4da1-803b-67198bfdd81d tempest-LiveMigrationTest-898292491 tempest-LiveMigrationTest-898292491-project] 10.222.0.70 "GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4" status: 404 len: 111 microversion: 2.1 time: 0.080967 Jul 26 14:23:14.398626 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1842/3802] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:14 2022] GET /compute/v2.1/servers/66a91319-e533-46c4-988e-f7480ff27ba4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:23:14.979075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-059122e3-5320-4882-b8bf-b9c8bace4e73 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:14.985514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-059122e3-5320-4882-b8bf-b9c8bace4e73 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:15.003374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-059122e3-5320-4882-b8bf-b9c8bace4e73 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:15.017658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-059122e3-5320-4882-b8bf-b9c8bace4e73 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:15.020194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-059122e3-5320-4882-b8bf-b9c8bace4e73 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:15.021247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-059122e3-5320-4882-b8bf-b9c8bace4e73 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:15.197429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-059122e3-5320-4882-b8bf-b9c8bace4e73 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:15.216568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-059122e3-5320-4882-b8bf-b9c8bace4e73 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:15.220817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-059122e3-5320-4882-b8bf-b9c8bace4e73 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a72611cad5b0425a9fe7111c923db0f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff150afe7324391a987f18a674d3240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:15.223647 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-059122e3-5320-4882-b8bf-b9c8bace4e73 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 200 len: 1604 microversion: 2.32 time: 0.253527 Jul 26 14:23:15.228777 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1961/3803] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:14 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:15.317525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-860c1b1f-3f8b-4e99-b7a3-1bc52deab788 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:15.318423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-860c1b1f-3f8b-4e99-b7a3-1bc52deab788 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:15.326295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-860c1b1f-3f8b-4e99-b7a3-1bc52deab788 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:15.326932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-860c1b1f-3f8b-4e99-b7a3-1bc52deab788 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:15.327824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-860c1b1f-3f8b-4e99-b7a3-1bc52deab788 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:15.328442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-860c1b1f-3f8b-4e99-b7a3-1bc52deab788 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:15.376295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-306b0860-b6ca-4a83-904e-ad6758a7c471 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:15.377255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-306b0860-b6ca-4a83-904e-ad6758a7c471 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:15.388558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-306b0860-b6ca-4a83-904e-ad6758a7c471 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:15.392728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-306b0860-b6ca-4a83-904e-ad6758a7c471 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:15.392728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-306b0860-b6ca-4a83-904e-ad6758a7c471 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:15.392728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-306b0860-b6ca-4a83-904e-ad6758a7c471 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:15.911146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-306b0860-b6ca-4a83-904e-ad6758a7c471 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:15.920572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-860c1b1f-3f8b-4e99-b7a3-1bc52deab788 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:15.951702 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-860c1b1f-3f8b-4e99-b7a3-1bc52deab788 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1553 microversion: 2.1 time: 0.637593 Jul 26 14:23:15.955154 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-306b0860-b6ca-4a83-904e-ad6758a7c471 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1314 microversion: 2.1 time: 0.584614 Jul 26 14:23:15.956592 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1843/3804] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:15 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1553 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:15.958223 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1962/3805] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:15 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:16.259339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-634493cb-9e70-4383-97fe-d166ec724e63 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:16.260428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-634493cb-9e70-4383-97fe-d166ec724e63 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:16.270358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-634493cb-9e70-4383-97fe-d166ec724e63 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:16.271227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-634493cb-9e70-4383-97fe-d166ec724e63 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:16.272318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-634493cb-9e70-4383-97fe-d166ec724e63 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:16.272990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-634493cb-9e70-4383-97fe-d166ec724e63 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:16.291474 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-634493cb-9e70-4383-97fe-d166ec724e63 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] HTTP exception thrown: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-634493cb-9e70-4383-97fe-d166ec724e63 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Request method failure captured: Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb HTTP/1.1 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_cIihuqBF5zxTNPb1iGKj1WY2mDZ1ZW_OjoCsSmbuKmljAIn3Bjqzr8zdOscCEcLg9OwU_kSVJKqc2_V5FKHWISHul62vvhyEUgh1fol2m70vcoVcBxWzDLTVGgXYaAJo2xDouix1q-K1a5M4ttLPvoy17x-VblXhSZuMulJBtPdaQ Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.32 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2ff150afe7324391a987f18a674d3240 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TaggedBootDevicesTest-1130656708 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2ff150afe7324391a987f18a674d3240"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2ff150afe7324391a987f18a674d3240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2ff150afe7324391a987f18a674d3240", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2ff150afe7324391a987f18a674d3240"}]}] Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TaggedBootDevicesTest-1130656708 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2ff150afe7324391a987f18a674d3240 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1130656708 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TaggedBootDevicesTest-1130656708-project Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: a72611cad5b0425a9fe7111c923db0f9 Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TaggedBootDevicesTest-1130656708-project Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb'} Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:16.293542 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:16.298349 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:16.298349 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:16.298349 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:16.298349 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:16.298349 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:16.298349 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:16.298349 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:16.298349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-634493cb-9e70-4383-97fe-d166ec724e63 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Returning 404 to user: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:16.298349 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-634493cb-9e70-4383-97fe-d166ec724e63 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 404 len: 111 microversion: 2.32 time: 0.039776 Jul 26 14:23:16.298349 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1844/3806] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:16 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 14:23:16.311548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-24f3cc0a-8260-4b45-bed7-005f3d61bb0e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '.version_select at 0x7f8786d98430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:16.343835 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-24f3cc0a-8260-4b45-bed7-005f3d61bb0e tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-656765471" status: 204 len: 0 microversion: 2.32 time: 0.038213 Jul 26 14:23:16.346950 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1963/3807] 10.222.0.70 () {60 vars in 1259 bytes} [Tue Jul 26 14:23:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-656765471 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:23:16.667577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7cfd9694-66c8-43db-93d0-79481237d498 req-5f04e8b4-17b3-4a7c-98c6-cfd29ac0bc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35be98ed-040c-424a-ba1f-945630e1de71", "name": "network-vif-deleted", "tag": "40755b30-ef72-4e58-a2d2-9f02f4d4250d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:16.685914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7cfd9694-66c8-43db-93d0-79481237d498 req-5f04e8b4-17b3-4a7c-98c6-cfd29ac0bc4f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:16.688111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7cfd9694-66c8-43db-93d0-79481237d498 req-5f04e8b4-17b3-4a7c-98c6-cfd29ac0bc4f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:16.728272 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7cfd9694-66c8-43db-93d0-79481237d498 req-5f04e8b4-17b3-4a7c-98c6-cfd29ac0bc4f service nova] Creating event network-vif-deleted:40755b30-ef72-4e58-a2d2-9f02f4d4250d for instance 35be98ed-040c-424a-ba1f-945630e1de71 on n-h1-833090-9 Jul 26 14:23:16.743471 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7cfd9694-66c8-43db-93d0-79481237d498 req-5f04e8b4-17b3-4a7c-98c6-cfd29ac0bc4f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079354 Jul 26 14:23:16.745399 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1845/3808] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:16.985730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:16.986753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:16.998506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-38d9d9e1-004a-48d3-b16b-1ff1055f44a1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:17.000413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-38d9d9e1-004a-48d3-b16b-1ff1055f44a1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:17.005450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:17.006062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:17.007130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:17.007520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:17.023637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38d9d9e1-004a-48d3-b16b-1ff1055f44a1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:17.035585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38d9d9e1-004a-48d3-b16b-1ff1055f44a1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:17.037891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38d9d9e1-004a-48d3-b16b-1ff1055f44a1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:17.041843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38d9d9e1-004a-48d3-b16b-1ff1055f44a1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:17.833593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-38d9d9e1-004a-48d3-b16b-1ff1055f44a1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:17.861946 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-38d9d9e1-004a-48d3-b16b-1ff1055f44a1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1345 microversion: 2.1 time: 0.873395 Jul 26 14:23:17.863284 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1846/3809] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:16 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1345 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:17.894189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-0164194e-ee14-48f5-9424-b5e3b0614cb0 req-b2c3b8ae-9ffa-4d4b-9583-670e6c52e561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08201385-1b2e-4fcd-95d4-ae2473256860", "name": "network-vif-plugged", "status": "completed", "tag": "34ec0ab6-21f2-4baa-b538-eeee85ef60cc"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:17.911137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:17.913916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0164194e-ee14-48f5-9424-b5e3b0614cb0 req-b2c3b8ae-9ffa-4d4b-9583-670e6c52e561 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:17.914922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0164194e-ee14-48f5-9424-b5e3b0614cb0 req-b2c3b8ae-9ffa-4d4b-9583-670e6c52e561 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:17.926699 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1314 microversion: 2.1 time: 0.947190 Jul 26 14:23:17.933740 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1964/3810] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:16 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:17.935429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:17.937628 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001981 Jul 26 14:23:17.938551 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1965/3811] 10.222.0.70 () {56 vars in 886 bytes} [Tue Jul 26 14:23:17 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 14:23:17.939346 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-0164194e-ee14-48f5-9424-b5e3b0614cb0 req-b2c3b8ae-9ffa-4d4b-9583-670e6c52e561 service nova] Creating event network-vif-plugged:34ec0ab6-21f2-4baa-b538-eeee85ef60cc for instance 08201385-1b2e-4fcd-95d4-ae2473256860 on n-h1-833090-9 Jul 26 14:23:17.948182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:17.950325 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002827 Jul 26 14:23:17.951520 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1966/3812] 10.222.0.70 () {54 vars in 1035 bytes} [Tue Jul 26 14:23:17 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Jul 26 14:23:17.951986 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-0164194e-ee14-48f5-9424-b5e3b0614cb0 req-b2c3b8ae-9ffa-4d4b-9583-670e6c52e561 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071566 Jul 26 14:23:17.953505 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1847/3813] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:17.965851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:17.967493 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fed27896-1806-4b4f-b66e-0632eebaec6b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002118 Jul 26 14:23:17.968723 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1967/3814] 10.222.0.70 () {54 vars in 1041 bytes} [Tue Jul 26 14:23:17 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:17.982006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-0164194e-ee14-48f5-9424-b5e3b0614cb0 req-b2c3b8ae-9ffa-4d4b-9583-670e6c52e561 service nova] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:17.984031 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-0164194e-ee14-48f5-9424-b5e3b0614cb0 req-b2c3b8ae-9ffa-4d4b-9583-670e6c52e561 service nova] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001898 Jul 26 14:23:17.985691 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1848/3815] 10.222.0.70 () {56 vars in 886 bytes} [Tue Jul 26 14:23:17 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 14:23:18.885211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b5a31667-c728-47ae-a047-1794bc791acc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:18.886512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b5a31667-c728-47ae-a047-1794bc791acc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:18.904785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5a31667-c728-47ae-a047-1794bc791acc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:18.905944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5a31667-c728-47ae-a047-1794bc791acc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:18.907633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5a31667-c728-47ae-a047-1794bc791acc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:18.908728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b5a31667-c728-47ae-a047-1794bc791acc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:18.966234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-04f10a9f-6b57-45ef-960b-98b02557cfa9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:18.966956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-04f10a9f-6b57-45ef-960b-98b02557cfa9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:18.990021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04f10a9f-6b57-45ef-960b-98b02557cfa9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:18.991288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04f10a9f-6b57-45ef-960b-98b02557cfa9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:18.993488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04f10a9f-6b57-45ef-960b-98b02557cfa9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:18.994444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04f10a9f-6b57-45ef-960b-98b02557cfa9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:19.074473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b5a31667-c728-47ae-a047-1794bc791acc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:19.089888 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b5a31667-c728-47ae-a047-1794bc791acc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1345 microversion: 2.1 time: 0.208920 Jul 26 14:23:19.096310 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1968/3816] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:18 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1345 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:19.505602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-39166e4f-7e6e-4353-a541-d87047b11eb4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:19.506251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-39166e4f-7e6e-4353-a541-d87047b11eb4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:19.543712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39166e4f-7e6e-4353-a541-d87047b11eb4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:19.544492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39166e4f-7e6e-4353-a541-d87047b11eb4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:19.545466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39166e4f-7e6e-4353-a541-d87047b11eb4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:19.546618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39166e4f-7e6e-4353-a541-d87047b11eb4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:19.660588 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-39166e4f-7e6e-4353-a541-d87047b11eb4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/ips" status: 200 len: 145 microversion: 2.1 time: 0.162585 Jul 26 14:23:19.673195 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1969/3817] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:23:19 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/ips => generated 145 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:23:19.923680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-04f10a9f-6b57-45ef-960b-98b02557cfa9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:19.951208 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-04f10a9f-6b57-45ef-960b-98b02557cfa9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1314 microversion: 2.1 time: 0.990788 Jul 26 14:23:19.955187 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1849/3818] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:18 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:20.124764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eb38050f-a065-4a63-898e-d0c4c8653b27 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:20.137295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eb38050f-a065-4a63-898e-d0c4c8653b27 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:20.176733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb38050f-a065-4a63-898e-d0c4c8653b27 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:20.177594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb38050f-a065-4a63-898e-d0c4c8653b27 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:20.181745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb38050f-a065-4a63-898e-d0c4c8653b27 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:20.182247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb38050f-a065-4a63-898e-d0c4c8653b27 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:20.755145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb38050f-a065-4a63-898e-d0c4c8653b27 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:20.792422 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eb38050f-a065-4a63-898e-d0c4c8653b27 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1345 microversion: 2.1 time: 0.673964 Jul 26 14:23:20.795273 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1970/3819] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:20 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1345 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:20.992394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0487a854-5594-4242-b603-8a0c3ef3cd3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:20.994760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0487a854-5594-4242-b603-8a0c3ef3cd3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:21.029415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0487a854-5594-4242-b603-8a0c3ef3cd3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:21.033807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0487a854-5594-4242-b603-8a0c3ef3cd3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:21.037491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0487a854-5594-4242-b603-8a0c3ef3cd3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:21.038940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0487a854-5594-4242-b603-8a0c3ef3cd3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:21.826520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-65acba30-666a-4ab3-a918-d13b31c25376 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:21.829452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-65acba30-666a-4ab3-a918-d13b31c25376 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:21.858789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65acba30-666a-4ab3-a918-d13b31c25376 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:21.868196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65acba30-666a-4ab3-a918-d13b31c25376 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:21.871145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65acba30-666a-4ab3-a918-d13b31c25376 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:21.874705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65acba30-666a-4ab3-a918-d13b31c25376 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:22.227130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-65acba30-666a-4ab3-a918-d13b31c25376 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:22.266356 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-65acba30-666a-4ab3-a918-d13b31c25376 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1345 microversion: 2.1 time: 0.439929 Jul 26 14:23:22.267744 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1971/3820] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:21 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1345 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:22.677716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64eaac59-9f19-49af-ae71-297558eca7ee tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Action: 'create', calling method: .version_select at 0x7f8786df03a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1081043083", "metadata": {"Type": "work"}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64eaac59-9f19-49af-ae71-297558eca7ee tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Request method failure captured: Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 122 Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_jZM3xZmxwLtQAXe0o2UqRfc8GtI_m6EdXAiuxLviisK6Js3GviWLkrAfZz2Ekf_rChfN-9ZzRjQzVSgFxv_pOqMuiC00gZndSgCnkOC8hV2GqSQsqOwi_x3yzweze6p6xR6nVQ6t9nwnsZu5m-KmMcx0IpTqgARVlajsB3aQlxJoY Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6389b77b787e469b8a02eeda58da25a3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}] Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7712c073177e4cb1b3b0ad412b2d0994 Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1081043083", "metadata": {"Type": "work"}}} Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1081043083', 'metadata': {'Type': 'work'}}}} Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:23:22.683334 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 14:23:22.689273 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.693729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64eaac59-9f19-49af-ae71-297558eca7ee tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:22.695278 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-64eaac59-9f19-49af-ae71-297558eca7ee tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.408409 Jul 26 14:23:22.697339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0487a854-5594-4242-b603-8a0c3ef3cd3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:22.701613 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1972/3821] 10.222.0.70 () {60 vars in 1156 bytes} [Tue Jul 26 14:23:22 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 415 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:23:22.716513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f462f831-2e6d-426a-8d9f-2420f3b2776c tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Action: 'create', calling method: .version_select at 0x7f8786d579d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1843483178", "metadata": {"Type": "work"}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f462f831-2e6d-426a-8d9f-2420f3b2776c tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Request method failure captured: Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 120 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_jZM3xZmxwLtQAXe0o2UqRfc8GtI_m6EdXAiuxLviisK6Js3GviWLkrAfZz2Ekf_rChfN-9ZzRjQzVSgFxv_pOqMuiC00gZndSgCnkOC8hV2GqSQsqOwi_x3yzweze6p6xR6nVQ6t9nwnsZu5m-KmMcx0IpTqgARVlajsB3aQlxJoY Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6389b77b787e469b8a02eeda58da25a3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}] Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7712c073177e4cb1b3b0ad412b2d0994 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1843483178", "metadata": {"Type": "work"}}} Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1843483178', 'metadata': {'Type': 'work'}}}} Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi '0' Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:23:22.726829 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 14:23:22.732952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.743401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f462f831-2e6d-426a-8d9f-2420f3b2776c tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:22.745484 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f462f831-2e6d-426a-8d9f-2420f3b2776c tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037992 Jul 26 14:23:22.748376 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0487a854-5594-4242-b603-8a0c3ef3cd3c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1500 microversion: 2.1 time: 1.759687 Jul 26 14:23:22.753712 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1973/3822] 10.222.0.70 () {60 vars in 1156 bytes} [Tue Jul 26 14:23:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:23:22.755062 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1850/3823] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:20 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1500 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:22.785604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9d27811-241a-4c0d-aa3e-1742f1727d4f tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Action: 'create', calling method: .version_select at 0x7f8786d57160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-655881030", "metadata": {"Type": "work"}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:22.793818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b838299f-c66f-4644-8232-dbb27214257a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9d27811-241a-4c0d-aa3e-1742f1727d4f tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Request method failure captured: Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 118 Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_jZM3xZmxwLtQAXe0o2UqRfc8GtI_m6EdXAiuxLviisK6Js3GviWLkrAfZz2Ekf_rChfN-9ZzRjQzVSgFxv_pOqMuiC00gZndSgCnkOC8hV2GqSQsqOwi_x3yzweze6p6xR6nVQ6t9nwnsZu5m-KmMcx0IpTqgARVlajsB3aQlxJoY Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6389b77b787e469b8a02eeda58da25a3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}] Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7712c073177e4cb1b3b0ad412b2d0994 Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-655881030", "metadata": {"Type": "work"}}} Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-655881030', 'metadata': {'Type': 'work'}}}} Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi '' Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:23:22.803108 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.810378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9d27811-241a-4c0d-aa3e-1742f1727d4f tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:22.814670 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d9d27811-241a-4c0d-aa3e-1742f1727d4f tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.040288 Jul 26 14:23:22.822626 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1974/3824] 10.222.0.70 () {60 vars in 1156 bytes} [Tue Jul 26 14:23:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:23:22.824675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b838299f-c66f-4644-8232-dbb27214257a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:22.826137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b838299f-c66f-4644-8232-dbb27214257a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:22.836576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6767ec83-d256-4f49-9b4c-76fa4be320dd tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Calling method '.version_select at 0x7f8786e1eb80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:22.901089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b838299f-c66f-4644-8232-dbb27214257a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Going to try to stop instance {{(pid=119478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:23:22.934398 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-6767ec83-d256-4f49-9b4c-76fa4be320dd tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] HTTP exception thrown: Volume tempest-invalid-1055938370 could not be found. Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6767ec83-d256-4f49-9b4c-76fa4be320dd tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Request method failure captured: Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1055938370 HTTP/1.1 Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_jZM3xZmxwLtQAXe0o2UqRfc8GtI_m6EdXAiuxLviisK6Js3GviWLkrAfZz2Ekf_rChfN-9ZzRjQzVSgFxv_pOqMuiC00gZndSgCnkOC8hV2GqSQsqOwi_x3yzweze6p6xR6nVQ6t9nwnsZu5m-KmMcx0IpTqgARVlajsB3aQlxJoY Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6389b77b787e469b8a02eeda58da25a3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}] Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7712c073177e4cb1b3b0ad412b2d0994 Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: exception: Volume tempest-invalid-1055938370 could not be found. Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'tempest-invalid-1055938370'} Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1055938370 could not be found. (HTTP 404) (Request-ID: req-aa198c54-c085-4563-9b2d-ca68619937a4) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:23:22.939130 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1055938370 could not be found. Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1055938370 could not be found. Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1055938370 could not be found. Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:22.943750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6767ec83-d256-4f49-9b4c-76fa4be320dd tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Returning 404 to user: Volume tempest-invalid-1055938370 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:22.949207 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6767ec83-d256-4f49-9b4c-76fa4be320dd tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1055938370" status: 404 len: 99 microversion: 2.1 time: 0.122056 Jul 26 14:23:22.953612 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1975/3825] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Jul 26 14:23:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1055938370 => generated 99 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:23:22.963147 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-45fbc84e-33f7-48c2-a851-8814a2233657 tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007812 Jul 26 14:23:22.970438 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1976/3826] 10.222.0.70 () {58 vars in 1140 bytes} [Tue Jul 26 14:23:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 14:23:22.979105 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-04cfce74-ff2f-4160-a14e-3f4fb1a6cab4 tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006722 Jul 26 14:23:22.979540 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1977/3827] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:23:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 14:23:22.996701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04406782-f43b-4600-9c79-9dd23193e273 tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Calling method '.version_select at 0x7f8786d575e0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:23.039016 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-04406782-f43b-4600-9c79-9dd23193e273 tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] HTTP exception thrown: Volume 36325ff2-4c79-4fe0-9be1-b6de36a1ceda could not be found. Jul 26 14:23:23.039863 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b838299f-c66f-4644-8232-dbb27214257a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860/action" status: 202 len: 0 microversion: 2.1 time: 0.251588 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04406782-f43b-4600-9c79-9dd23193e273 tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Request method failure captured: Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-volumes/36325ff2-4c79-4fe0-9be1-b6de36a1ceda HTTP/1.1 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_jZM3xZmxwLtQAXe0o2UqRfc8GtI_m6EdXAiuxLviisK6Js3GviWLkrAfZz2Ekf_rChfN-9ZzRjQzVSgFxv_pOqMuiC00gZndSgCnkOC8hV2GqSQsqOwi_x3yzweze6p6xR6nVQ6t9nwnsZu5m-KmMcx0IpTqgARVlajsB3aQlxJoY Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6389b77b787e469b8a02eeda58da25a3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}] Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7712c073177e4cb1b3b0ad412b2d0994 Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: exception: Volume 36325ff2-4c79-4fe0-9be1-b6de36a1ceda could not be found. Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '36325ff2-4c79-4fe0-9be1-b6de36a1ceda'} Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36325ff2-4c79-4fe0-9be1-b6de36a1ceda could not be found. (HTTP 404) (Request-ID: req-d17591b1-d7e0-466b-8d50-f5593c2b05b9) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:23:23.041633 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36325ff2-4c79-4fe0-9be1-b6de36a1ceda could not be found. Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36325ff2-4c79-4fe0-9be1-b6de36a1ceda could not be found. Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36325ff2-4c79-4fe0-9be1-b6de36a1ceda could not be found. Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04406782-f43b-4600-9c79-9dd23193e273 tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Returning 404 to user: Volume 36325ff2-4c79-4fe0-9be1-b6de36a1ceda could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:23.048330 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-04406782-f43b-4600-9c79-9dd23193e273 tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/36325ff2-4c79-4fe0-9be1-b6de36a1ceda" status: 404 len: 109 microversion: 2.1 time: 0.053911 Jul 26 14:23:23.054040 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1851/3828] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:23:22 2022] POST /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:23:23.055448 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1978/3829] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:23:22 2022] DELETE /compute/v2.1/os-volumes/36325ff2-4c79-4fe0-9be1-b6de36a1ceda => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:23:23.058879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58addb89-c95b-4405-b011-e6b6c5ef6d1e tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Calling method '.version_select at 0x7f87946a19d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:23.074479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c39a0380-6c51-4c82-aecd-8ce5e506451d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:23.083706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c39a0380-6c51-4c82-aecd-8ce5e506451d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:23.098234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c39a0380-6c51-4c82-aecd-8ce5e506451d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:23.098868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c39a0380-6c51-4c82-aecd-8ce5e506451d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:23.099740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c39a0380-6c51-4c82-aecd-8ce5e506451d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:23.100336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c39a0380-6c51-4c82-aecd-8ce5e506451d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:23.113340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:23.132323 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-58addb89-c95b-4405-b011-e6b6c5ef6d1e tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] HTTP exception thrown: Volume be483a58-d950-44fd-85f4-c66429ded407 could not be found. Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58addb89-c95b-4405-b011-e6b6c5ef6d1e tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Request method failure captured: Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-volumes/be483a58-d950-44fd-85f4-c66429ded407 HTTP/1.1 Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_jZM3xZmxwLtQAXe0o2UqRfc8GtI_m6EdXAiuxLviisK6Js3GviWLkrAfZz2Ekf_rChfN-9ZzRjQzVSgFxv_pOqMuiC00gZndSgCnkOC8hV2GqSQsqOwi_x3yzweze6p6xR6nVQ6t9nwnsZu5m-KmMcx0IpTqgARVlajsB3aQlxJoY Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6389b77b787e469b8a02eeda58da25a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6389b77b787e469b8a02eeda58da25a3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6389b77b787e469b8a02eeda58da25a3"}]}] Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 6389b77b787e469b8a02eeda58da25a3 Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesNegativeTest-1355312000 Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7712c073177e4cb1b3b0ad412b2d0994 Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesNegativeTest-1355312000-project Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: exception: Volume be483a58-d950-44fd-85f4-c66429ded407 could not be found. Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'be483a58-d950-44fd-85f4-c66429ded407'} Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be483a58-d950-44fd-85f4-c66429ded407 could not be found. (HTTP 404) (Request-ID: req-60812535-e740-4994-91da-8e0614d672bc) Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:23:23.136639 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be483a58-d950-44fd-85f4-c66429ded407 could not be found. Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be483a58-d950-44fd-85f4-c66429ded407 could not be found. Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be483a58-d950-44fd-85f4-c66429ded407 could not be found. Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58addb89-c95b-4405-b011-e6b6c5ef6d1e tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] Returning 404 to user: Volume be483a58-d950-44fd-85f4-c66429ded407 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-58addb89-c95b-4405-b011-e6b6c5ef6d1e tempest-VolumesNegativeTest-1355312000 tempest-VolumesNegativeTest-1355312000-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/be483a58-d950-44fd-85f4-c66429ded407" status: 404 len: 109 microversion: 2.1 time: 0.085805 Jul 26 14:23:23.146190 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1979/3830] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:23:23 2022] GET /compute/v2.1/os-volumes/be483a58-d950-44fd-85f4-c66429ded407 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:23:23.296752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed2e151e-8e66-4706-9a52-7858fdeac3a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:23.296752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ed2e151e-8e66-4706-9a52-7858fdeac3a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:23.314445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed2e151e-8e66-4706-9a52-7858fdeac3a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:23.317426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed2e151e-8e66-4706-9a52-7858fdeac3a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:23.321586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed2e151e-8e66-4706-9a52-7858fdeac3a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:23.324600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed2e151e-8e66-4706-9a52-7858fdeac3a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:23.408142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:23.523936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ed2e151e-8e66-4706-9a52-7858fdeac3a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:23.551896 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed2e151e-8e66-4706-9a52-7858fdeac3a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1345 microversion: 2.1 time: 0.265151 Jul 26 14:23:23.554629 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1980/3831] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:23 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1345 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:23.782140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c39a0380-6c51-4c82-aecd-8ce5e506451d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:23.801636 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c39a0380-6c51-4c82-aecd-8ce5e506451d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.753921 Jul 26 14:23:23.817061 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1852/3832] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:23 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:23.953334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-573bf375-c6e7-49ca-beda-9babab5fc362 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10d91645-35a7-4939-a224-8778ccc7e792"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:23.957693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-573bf375-c6e7-49ca-beda-9babab5fc362 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:23.966655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573bf375-c6e7-49ca-beda-9babab5fc362 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:23.967547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573bf375-c6e7-49ca-beda-9babab5fc362 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:23.968970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573bf375-c6e7-49ca-beda-9babab5fc362 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:23.969685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573bf375-c6e7-49ca-beda-9babab5fc362 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:24.583038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-667ae402-2f5a-4def-8528-1aed8e8fc350 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:24.586116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-667ae402-2f5a-4def-8528-1aed8e8fc350 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:24.603377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-667ae402-2f5a-4def-8528-1aed8e8fc350 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:24.609617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-667ae402-2f5a-4def-8528-1aed8e8fc350 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:24.611153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-667ae402-2f5a-4def-8528-1aed8e8fc350 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:24.612019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-667ae402-2f5a-4def-8528-1aed8e8fc350 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:24.847156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-667ae402-2f5a-4def-8528-1aed8e8fc350 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:24.882195 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-667ae402-2f5a-4def-8528-1aed8e8fc350 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1345 microversion: 2.1 time: 0.307075 Jul 26 14:23:24.882798 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1853/3833] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:24 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1345 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:24.901736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1b117640-2e33-439b-aed0-26de8fd44abd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:24.907500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1b117640-2e33-439b-aed0-26de8fd44abd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:24.934307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b117640-2e33-439b-aed0-26de8fd44abd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:24.934765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b117640-2e33-439b-aed0-26de8fd44abd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:24.937745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b117640-2e33-439b-aed0-26de8fd44abd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:24.939419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b117640-2e33-439b-aed0-26de8fd44abd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:25.166242 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-573bf375-c6e7-49ca-beda-9babab5fc362 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.217747 Jul 26 14:23:25.167884 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1981/3834] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:23:23 2022] POST /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments => generated 194 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:23:25.766030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1b117640-2e33-439b-aed0-26de8fd44abd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:25.814052 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1b117640-2e33-439b-aed0-26de8fd44abd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.911618 Jul 26 14:23:25.814945 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1854/3835] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:24 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:25.918977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b366997e-9451-458c-b331-550f8d02ca43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:25.928029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b366997e-9451-458c-b331-550f8d02ca43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:25.951262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b366997e-9451-458c-b331-550f8d02ca43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:25.961657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b366997e-9451-458c-b331-550f8d02ca43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:25.963552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b366997e-9451-458c-b331-550f8d02ca43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:25.964566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b366997e-9451-458c-b331-550f8d02ca43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:26.160685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca931a39-360f-4f1e-ba93-53e08e7f1e70 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:26.161938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ca931a39-360f-4f1e-ba93-53e08e7f1e70 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:26.173301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:26.190406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca931a39-360f-4f1e-ba93-53e08e7f1e70 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:26.196466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca931a39-360f-4f1e-ba93-53e08e7f1e70 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:26.200074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca931a39-360f-4f1e-ba93-53e08e7f1e70 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:26.205251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca931a39-360f-4f1e-ba93-53e08e7f1e70 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:26.256983 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ca931a39-360f-4f1e-ba93-53e08e7f1e70 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] HTTP exception thrown: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca931a39-360f-4f1e-ba93-53e08e7f1e70 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Request method failure captured: Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb HTTP/1.1 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_cIihuqBF5zxTNPb1iGKj1WY2mDZ1ZW_OjoCsSmbuKmljAIn3Bjqzr8zdOscCEcLg9OwU_kSVJKqc2_V5FKHWISHul62vvhyEUgh1fol2m70vcoVcBxWzDLTVGgXYaAJo2xDouix1q-K1a5M4ttLPvoy17x-VblXhSZuMulJBtPdaQ Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.32 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2ff150afe7324391a987f18a674d3240 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TaggedBootDevicesTest-1130656708 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2ff150afe7324391a987f18a674d3240"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2ff150afe7324391a987f18a674d3240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2ff150afe7324391a987f18a674d3240", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2ff150afe7324391a987f18a674d3240"}]}] Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TaggedBootDevicesTest-1130656708 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2ff150afe7324391a987f18a674d3240 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1130656708 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TaggedBootDevicesTest-1130656708-project Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: a72611cad5b0425a9fe7111c923db0f9 Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TaggedBootDevicesTest-1130656708-project Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb'} Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:23:26.261858 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:26.267162 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:26.274319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca931a39-360f-4f1e-ba93-53e08e7f1e70 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Returning 404 to user: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:26.275684 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ca931a39-360f-4f1e-ba93-53e08e7f1e70 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 404 len: 111 microversion: 2.32 time: 0.123145 Jul 26 14:23:26.276801 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1855/3836] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:23:26 2022] DELETE /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:23:26.294712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-19ad775b-c6dc-418c-9db1-680a5630a359 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:26.297154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-19ad775b-c6dc-418c-9db1-680a5630a359 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] [instance: f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:26.314635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19ad775b-c6dc-418c-9db1-680a5630a359 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:26.316710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19ad775b-c6dc-418c-9db1-680a5630a359 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:26.320767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19ad775b-c6dc-418c-9db1-680a5630a359 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:26.322830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19ad775b-c6dc-418c-9db1-680a5630a359 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:26.370886 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-19ad775b-c6dc-418c-9db1-680a5630a359 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] HTTP exception thrown: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-19ad775b-c6dc-418c-9db1-680a5630a359 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Request method failure captured: Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb HTTP/1.1 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_cIihuqBF5zxTNPb1iGKj1WY2mDZ1ZW_OjoCsSmbuKmljAIn3Bjqzr8zdOscCEcLg9OwU_kSVJKqc2_V5FKHWISHul62vvhyEUgh1fol2m70vcoVcBxWzDLTVGgXYaAJo2xDouix1q-K1a5M4ttLPvoy17x-VblXhSZuMulJBtPdaQ Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.32 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2ff150afe7324391a987f18a674d3240 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TaggedBootDevicesTest-1130656708 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2ff150afe7324391a987f18a674d3240"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2ff150afe7324391a987f18a674d3240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2ff150afe7324391a987f18a674d3240", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2ff150afe7324391a987f18a674d3240"}]}] Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TaggedBootDevicesTest-1130656708 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2ff150afe7324391a987f18a674d3240 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1130656708 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TaggedBootDevicesTest-1130656708-project Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: a72611cad5b0425a9fe7111c923db0f9 Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TaggedBootDevicesTest-1130656708-project Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb'} Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:26.376294 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:26.383569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:26.383569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:26.383569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:26.383569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:26.383569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:26.383569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. Jul 26 14:23:26.383569 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:26.383569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-19ad775b-c6dc-418c-9db1-680a5630a359 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] Returning 404 to user: Instance f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:26.383569 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-19ad775b-c6dc-418c-9db1-680a5630a359 tempest-TaggedBootDevicesTest-1130656708 tempest-TaggedBootDevicesTest-1130656708-project] 10.222.0.70 "GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb" status: 404 len: 111 microversion: 2.32 time: 0.095392 Jul 26 14:23:26.383569 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1856/3837] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:26 2022] GET /compute/v2.1/servers/f5383cb5-2efb-44b5-9eb9-ed72b4a1b8eb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:23:26.744828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b366997e-9451-458c-b331-550f8d02ca43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:26.761589 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b366997e-9451-458c-b331-550f8d02ca43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1345 microversion: 2.1 time: 0.845569 Jul 26 14:23:26.772356 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1982/3838] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:25 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1345 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:26.868592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-25791029-5810-425c-b197-114b258769f5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:26.870888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-25791029-5810-425c-b197-114b258769f5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:26.899329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25791029-5810-425c-b197-114b258769f5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:26.901655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25791029-5810-425c-b197-114b258769f5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:26.903907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25791029-5810-425c-b197-114b258769f5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:26.904759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25791029-5810-425c-b197-114b258769f5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:27.202701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-25791029-5810-425c-b197-114b258769f5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:27.244429 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-25791029-5810-425c-b197-114b258769f5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.391077 Jul 26 14:23:27.245280 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1857/3839] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:26 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:27.778909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:27.779748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:27.793601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:27.794083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:27.800148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:27.800813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:27.870354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:27.871894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:27.872920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lazy-loading 'fault' on Instance uuid 35be98ed-040c-424a-ba1f-945630e1de71 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:23:27.997122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:28.030167 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6c2b1d68-0685-4a53-9996-949ccf828099 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 200 len: 1350 microversion: 2.1 time: 0.255561 Jul 26 14:23:28.035138 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1983/3840] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:27 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 1350 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:28.275552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d174e7c-36dc-40c5-a904-dcae1fad331b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:28.276283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7d174e7c-36dc-40c5-a904-dcae1fad331b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:28.291337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d174e7c-36dc-40c5-a904-dcae1fad331b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:28.291927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d174e7c-36dc-40c5-a904-dcae1fad331b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:28.297375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d174e7c-36dc-40c5-a904-dcae1fad331b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:28.298314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d174e7c-36dc-40c5-a904-dcae1fad331b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:28.717352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d174e7c-36dc-40c5-a904-dcae1fad331b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:28.737386 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7d174e7c-36dc-40c5-a904-dcae1fad331b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.466304 Jul 26 14:23:28.750393 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1858/3841] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:28 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:29.065305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e1c5bac7-9da2-4d9f-a407-e638de89f2fb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:29.070625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e1c5bac7-9da2-4d9f-a407-e638de89f2fb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:29.086275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1c5bac7-9da2-4d9f-a407-e638de89f2fb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:29.087295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1c5bac7-9da2-4d9f-a407-e638de89f2fb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:29.088383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1c5bac7-9da2-4d9f-a407-e638de89f2fb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:29.089046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1c5bac7-9da2-4d9f-a407-e638de89f2fb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:29.106333 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e1c5bac7-9da2-4d9f-a407-e638de89f2fb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e1c5bac7-9da2-4d9f-a407-e638de89f2fb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 HTTP/1.1 Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '35be98ed-040c-424a-ba1f-945630e1de71'} Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:29.112586 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:29.119640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:29.119640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:29.119640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:29.119640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:29.119640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:29.119640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:23:29.119640 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:29.123282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e1c5bac7-9da2-4d9f-a407-e638de89f2fb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:29.127380 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e1c5bac7-9da2-4d9f-a407-e638de89f2fb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 404 len: 111 microversion: 2.1 time: 0.067976 Jul 26 14:23:29.129293 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1984/3842] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:29 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:23:29.418810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d6113313-486a-4abf-889d-927253aa2220 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:29.422326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d6113313-486a-4abf-889d-927253aa2220 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:29.446864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6113313-486a-4abf-889d-927253aa2220 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:29.451859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6113313-486a-4abf-889d-927253aa2220 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:29.455274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6113313-486a-4abf-889d-927253aa2220 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:29.461867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6113313-486a-4abf-889d-927253aa2220 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:29.506788 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d6113313-486a-4abf-889d-927253aa2220 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d6113313-486a-4abf-889d-927253aa2220 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71/os-volume_attachments HTTP/1.1 Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': '35be98ed-040c-424a-ba1f-945630e1de71'} Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:29.521573 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:23:29.526299 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:29.526299 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:29.526299 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:29.526299 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:29.526299 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:29.526299 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:29.526299 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:29.526299 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:29.526299 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:23:29.526299 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:23:29.531007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d6113313-486a-4abf-889d-927253aa2220 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:29.533842 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d6113313-486a-4abf-889d-927253aa2220 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.118421 Jul 26 14:23:29.535269 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1859/3843] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:23:29 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71/os-volume_attachments => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:23:29.766057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-411a7aa7-b6d6-4bc1-93c9-e7eb0dfe6dc6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:29.767212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-411a7aa7-b6d6-4bc1-93c9-e7eb0dfe6dc6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:29.787502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-411a7aa7-b6d6-4bc1-93c9-e7eb0dfe6dc6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:29.789125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-411a7aa7-b6d6-4bc1-93c9-e7eb0dfe6dc6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:29.791579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-411a7aa7-b6d6-4bc1-93c9-e7eb0dfe6dc6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:29.793652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-411a7aa7-b6d6-4bc1-93c9-e7eb0dfe6dc6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:29.893380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-255268192", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "01fdab58-8c00-4787-8288-5206df456cd7"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:30.054596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] validate_networks() for [('01fdab58-8c00-4787-8288-5206df456cd7', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:23:30.304736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-411a7aa7-b6d6-4bc1-93c9-e7eb0dfe6dc6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:30.319603 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-411a7aa7-b6d6-4bc1-93c9-e7eb0dfe6dc6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.558297 Jul 26 14:23:30.337578 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1985/3844] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:29 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:31.101008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:23:31.101758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:23:31.102095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:23:31.102527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:23:31.102951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:23:31.133682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:31.136179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:31.137725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:31.138240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:31.213024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:23:31.226346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for user b1e46ed350fa42669bba323ef30b982d and project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:23:31.257049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:23:31.270949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: ea891fb6-6a01-4dd6-a433-49ec45d593ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:23:31.358406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-12dac0fe-19a2-4822-8a04-25e2792dd0f4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:31.360195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-12dac0fe-19a2-4822-8a04-25e2792dd0f4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:31.391667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dac0fe-19a2-4822-8a04-25e2792dd0f4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:31.392533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dac0fe-19a2-4822-8a04-25e2792dd0f4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:31.402775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dac0fe-19a2-4822-8a04-25e2792dd0f4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:31.403258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12dac0fe-19a2-4822-8a04-25e2792dd0f4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:31.484360 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e6eac13-2687-4fe8-8aeb-e8fad1557dfa tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603044 Jul 26 14:23:31.485258 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1860/3845] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:23:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:23:31.519576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6932b790-3293-40fe-b9fb-2b47358d806d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:31.522100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6932b790-3293-40fe-b9fb-2b47358d806d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: ea891fb6-6a01-4dd6-a433-49ec45d593ca] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:31.866806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6932b790-3293-40fe-b9fb-2b47358d806d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:31.888216 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6932b790-3293-40fe-b9fb-2b47358d806d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca" status: 200 len: 1214 microversion: 2.1 time: 0.386845 Jul 26 14:23:31.890595 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1861/3846] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:31 2022] GET /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca => generated 1214 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:31.930170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-278e2cdd-9894-42c5-8df4-954f3c1b6362 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:31.930889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-278e2cdd-9894-42c5-8df4-954f3c1b6362 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: ea891fb6-6a01-4dd6-a433-49ec45d593ca] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:31.960993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-12dac0fe-19a2-4822-8a04-25e2792dd0f4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:31.975014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-278e2cdd-9894-42c5-8df4-954f3c1b6362 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: ea891fb6-6a01-4dd6-a433-49ec45d593ca] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:23:31.975315 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-12dac0fe-19a2-4822-8a04-25e2792dd0f4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.625426 Jul 26 14:23:31.977849 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1986/3847] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:31 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:33.008197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b217bc16-24dc-4033-bda2-2872a13d7fcc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:33.009073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b217bc16-24dc-4033-bda2-2872a13d7fcc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:33.024838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b217bc16-24dc-4033-bda2-2872a13d7fcc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:33.033431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b217bc16-24dc-4033-bda2-2872a13d7fcc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:33.035670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b217bc16-24dc-4033-bda2-2872a13d7fcc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:33.040220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b217bc16-24dc-4033-bda2-2872a13d7fcc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:33.497603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b217bc16-24dc-4033-bda2-2872a13d7fcc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:33.513171 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b217bc16-24dc-4033-bda2-2872a13d7fcc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.509717 Jul 26 14:23:33.531192 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1987/3848] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:33 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:33.635797 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.compute.api [None req-278e2cdd-9894-42c5-8df4-954f3c1b6362 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: ea891fb6-6a01-4dd6-a433-49ec45d593ca] Instance Mapping does not exist while attempting local delete cleanup. Jul 26 14:23:33.640204 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-278e2cdd-9894-42c5-8df4-954f3c1b6362 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca" status: 204 len: 0 microversion: 2.1 time: 1.715413 Jul 26 14:23:33.647221 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1862/3849] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:23:31 2022] DELETE /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca => generated 0 bytes in 1719 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:23:33.653068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ddb242ad-43a6-4cfe-a4a9-795f92d794bc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:33.654133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ddb242ad-43a6-4cfe-a4a9-795f92d794bc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: ea891fb6-6a01-4dd6-a433-49ec45d593ca] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:33.664737 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-ddb242ad-43a6-4cfe-a4a9-795f92d794bc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ddb242ad-43a6-4cfe-a4a9-795f92d794bc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca HTTP/1.1 Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'ea891fb6-6a01-4dd6-a433-49ec45d593ca'} Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:23:33.668606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:23:33.675193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:23:33.675193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:23:33.675193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:23:33.675193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:23:33.675193 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:23:33.676238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ddb242ad-43a6-4cfe-a4a9-795f92d794bc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:23:33.678527 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ddb242ad-43a6-4cfe-a4a9-795f92d794bc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca" status: 404 len: 111 microversion: 2.1 time: 0.031129 Jul 26 14:23:33.690964 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1988/3850] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:33 2022] GET /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:23:33.847786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1570068986", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "01fdab58-8c00-4787-8288-5206df456cd7"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:33.970904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] validate_networks() for [('01fdab58-8c00-4787-8288-5206df456cd7', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:23:34.548895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e87ff2ae-fd54-4648-bf4e-6e23e63a640e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:34.549609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e87ff2ae-fd54-4648-bf4e-6e23e63a640e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:34.578166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e87ff2ae-fd54-4648-bf4e-6e23e63a640e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:34.578675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e87ff2ae-fd54-4648-bf4e-6e23e63a640e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:34.579551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e87ff2ae-fd54-4648-bf4e-6e23e63a640e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:34.586682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e87ff2ae-fd54-4648-bf4e-6e23e63a640e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:35.008363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e87ff2ae-fd54-4648-bf4e-6e23e63a640e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:35.017599 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e87ff2ae-fd54-4648-bf4e-6e23e63a640e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.473943 Jul 26 14:23:35.032906 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1989/3851] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:34 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:35.066548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:23:35.067112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:23:35.067459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:23:35.067882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:23:35.068338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:23:35.083708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:35.086768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:35.086768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:35.086768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:35.157453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:23:35.186805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for user b1e46ed350fa42669bba323ef30b982d and project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:23:35.234426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:23:35.239208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:23:35.355040 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8995a9f9-7c6a-46cf-8795-79a22639e335 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.514032 Jul 26 14:23:35.362495 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1863/3852] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:23:35.368095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c26f162c-fbc8-427e-9b54-24ee7ddd9be6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:35.368745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c26f162c-fbc8-427e-9b54-24ee7ddd9be6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:35.489608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c26f162c-fbc8-427e-9b54-24ee7ddd9be6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:35.501834 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c26f162c-fbc8-427e-9b54-24ee7ddd9be6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1215 microversion: 2.1 time: 0.137824 Jul 26 14:23:35.503715 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1990/3853] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:35 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:36.046946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-36e1e130-41f8-4b16-bedd-36097a7c8a67 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:36.052369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-36e1e130-41f8-4b16-bedd-36097a7c8a67 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:36.084727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e1e130-41f8-4b16-bedd-36097a7c8a67 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:36.086819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e1e130-41f8-4b16-bedd-36097a7c8a67 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:36.093743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e1e130-41f8-4b16-bedd-36097a7c8a67 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:36.095123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e1e130-41f8-4b16-bedd-36097a7c8a67 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:36.529219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-be587bc3-2fcb-4127-ac3a-5ec8c43c6916 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:36.530032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-be587bc3-2fcb-4127-ac3a-5ec8c43c6916 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:36.547348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be587bc3-2fcb-4127-ac3a-5ec8c43c6916 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:36.548184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be587bc3-2fcb-4127-ac3a-5ec8c43c6916 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:36.549049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be587bc3-2fcb-4127-ac3a-5ec8c43c6916 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:36.549666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be587bc3-2fcb-4127-ac3a-5ec8c43c6916 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:36.760096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-36e1e130-41f8-4b16-bedd-36097a7c8a67 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:36.782343 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-36e1e130-41f8-4b16-bedd-36097a7c8a67 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.740435 Jul 26 14:23:36.783200 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1864/3854] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:36 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:36.844119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-be587bc3-2fcb-4127-ac3a-5ec8c43c6916 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:36.918496 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-be587bc3-2fcb-4127-ac3a-5ec8c43c6916 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1211 microversion: 2.1 time: 0.391608 Jul 26 14:23:36.924851 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1991/3855] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:36 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1211 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:37.816974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6673c281-9632-4585-9a00-1254d498b6cb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:37.817756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6673c281-9632-4585-9a00-1254d498b6cb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:37.839283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6673c281-9632-4585-9a00-1254d498b6cb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:37.841902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6673c281-9632-4585-9a00-1254d498b6cb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:37.844928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6673c281-9632-4585-9a00-1254d498b6cb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:37.846471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6673c281-9632-4585-9a00-1254d498b6cb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:37.951549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23a5997d-5dba-4575-975f-b22cbd868c2a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:37.954145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-23a5997d-5dba-4575-975f-b22cbd868c2a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:37.966982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23a5997d-5dba-4575-975f-b22cbd868c2a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:37.968995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23a5997d-5dba-4575-975f-b22cbd868c2a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:37.970684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23a5997d-5dba-4575-975f-b22cbd868c2a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:37.971734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23a5997d-5dba-4575-975f-b22cbd868c2a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:38.309378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23a5997d-5dba-4575-975f-b22cbd868c2a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:38.322516 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23a5997d-5dba-4575-975f-b22cbd868c2a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1273 microversion: 2.1 time: 0.375854 Jul 26 14:23:38.348155 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1992/3856] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:37 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1273 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:38.558830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6673c281-9632-4585-9a00-1254d498b6cb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:38.574236 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6673c281-9632-4585-9a00-1254d498b6cb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.763603 Jul 26 14:23:38.590490 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1865/3857] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:37 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:39.350728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c10b5b66-f8f5-4d11-afce-621028589ea4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:39.351481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c10b5b66-f8f5-4d11-afce-621028589ea4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:39.369109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:39.400310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c10b5b66-f8f5-4d11-afce-621028589ea4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:39.400310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c10b5b66-f8f5-4d11-afce-621028589ea4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:39.406276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c10b5b66-f8f5-4d11-afce-621028589ea4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:39.407313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c10b5b66-f8f5-4d11-afce-621028589ea4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:39.599899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9239a853-f348-4463-ae13-72b8ed3a40db tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:39.601082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9239a853-f348-4463-ae13-72b8ed3a40db tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:39.623102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9239a853-f348-4463-ae13-72b8ed3a40db tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:39.623590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9239a853-f348-4463-ae13-72b8ed3a40db tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:39.624599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9239a853-f348-4463-ae13-72b8ed3a40db tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:39.630408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9239a853-f348-4463-ae13-72b8ed3a40db tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:40.348823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c10b5b66-f8f5-4d11-afce-621028589ea4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:40.364738 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c10b5b66-f8f5-4d11-afce-621028589ea4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1315 microversion: 2.1 time: 1.022968 Jul 26 14:23:40.372375 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1993/3858] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:39 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1315 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:40.386506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9239a853-f348-4463-ae13-72b8ed3a40db tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:40.398973 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9239a853-f348-4463-ae13-72b8ed3a40db tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.802616 Jul 26 14:23:40.399717 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1866/3859] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:39 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:41.396704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-78df8bc6-ee9f-4761-b0d3-c64ddae17254 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:41.398136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-78df8bc6-ee9f-4761-b0d3-c64ddae17254 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:41.412016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78df8bc6-ee9f-4761-b0d3-c64ddae17254 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:41.414225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78df8bc6-ee9f-4761-b0d3-c64ddae17254 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:41.415468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78df8bc6-ee9f-4761-b0d3-c64ddae17254 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:41.426201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78df8bc6-ee9f-4761-b0d3-c64ddae17254 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:41.537516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-321350185", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": "none"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:41.688901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:23:41.689565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:23:41.690047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:23:41.690957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:23:41.691546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:23:41.722349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:41.724502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:41.726743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:41.727491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:41.833310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Getting quotas for project 3be3a6dbafcc476ba5c59ad294371d42. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:23:41.840853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-78df8bc6-ee9f-4761-b0d3-c64ddae17254 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:41.861567 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-78df8bc6-ee9f-4761-b0d3-c64ddae17254 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1315 microversion: 2.1 time: 0.465613 Jul 26 14:23:41.870119 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1867/3860] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:41 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:41.882435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6b2a8da7-dfe3-4a42-87a6-3a492cdb836b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:41.885271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Getting quotas for user ffdb0dc0b95942f0bdf2827a7e5d90ec and project 3be3a6dbafcc476ba5c59ad294371d42. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:23:41.891527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6b2a8da7-dfe3-4a42-87a6-3a492cdb836b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:41.914931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b2a8da7-dfe3-4a42-87a6-3a492cdb836b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:41.915202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b2a8da7-dfe3-4a42-87a6-3a492cdb836b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:41.919331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b2a8da7-dfe3-4a42-87a6-3a492cdb836b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:41.922591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6b2a8da7-dfe3-4a42-87a6-3a492cdb836b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:41.941164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:23:41.947072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:23:42.078335 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8470c9d1-f9c8-40e8-8ec3-82a9c843ffa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.373905 Jul 26 14:23:42.087234 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1994/3861] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:23:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:23:42.099822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-26b3f751-db8e-4395-b299-e9e48f23af3a req-48afc572-4129-4a66-b65e-f887d42607a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45fbc4fe-2ffa-4211-8d46-1d6b4102b429", "tag": "2854b13d-1a74-4af9-bd59-e28bac482f54"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:42.139331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-26b3f751-db8e-4395-b299-e9e48f23af3a req-48afc572-4129-4a66-b65e-f887d42607a4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:42.144626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-26b3f751-db8e-4395-b299-e9e48f23af3a req-48afc572-4129-4a66-b65e-f887d42607a4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:42.165901 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-26b3f751-db8e-4395-b299-e9e48f23af3a req-48afc572-4129-4a66-b65e-f887d42607a4 service nova] Creating event network-changed:2854b13d-1a74-4af9-bd59-e28bac482f54 for instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 on n-h2-833090-9 Jul 26 14:23:42.178022 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-26b3f751-db8e-4395-b299-e9e48f23af3a req-48afc572-4129-4a66-b65e-f887d42607a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087273 Jul 26 14:23:42.184534 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1995/3862] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:42.203581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-13ad9818-2e81-484c-ab47-f993d9b40460 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:42.221235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-13ad9818-2e81-484c-ab47-f993d9b40460 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:42.532651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-13ad9818-2e81-484c-ab47-f993d9b40460 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:42.542821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-13ad9818-2e81-484c-ab47-f993d9b40460 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:42.544412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-13ad9818-2e81-484c-ab47-f993d9b40460 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:42.564779 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-13ad9818-2e81-484c-ab47-f993d9b40460 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "PUT /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1358 microversion: 2.75 time: 0.377897 Jul 26 14:23:42.588421 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1996/3863] 10.222.0.70 () {62 vars in 1297 bytes} [Tue Jul 26 14:23:42 2022] PUT /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1358 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:42.597526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b0a606f-dbfa-4a00-8a0f-c443deedcfb0 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:42.598164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4b0a606f-dbfa-4a00-8a0f-c443deedcfb0 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:42.868729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4b0a606f-dbfa-4a00-8a0f-c443deedcfb0 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:42.877552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4b0a606f-dbfa-4a00-8a0f-c443deedcfb0 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:42.879242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4b0a606f-dbfa-4a00-8a0f-c443deedcfb0 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:42.885492 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4b0a606f-dbfa-4a00-8a0f-c443deedcfb0 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1358 microversion: 2.75 time: 0.295807 Jul 26 14:23:42.900822 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1997/3864] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:42 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:42.912712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6b2a8da7-dfe3-4a42-87a6-3a492cdb836b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:42.919469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1e411efe-76fd-46e5-acbd-bfae853856a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:42.920344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1e411efe-76fd-46e5-acbd-bfae853856a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:42.930747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e411efe-76fd-46e5-acbd-bfae853856a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:42.931633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e411efe-76fd-46e5-acbd-bfae853856a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:42.933122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e411efe-76fd-46e5-acbd-bfae853856a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:42.933854 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6b2a8da7-dfe3-4a42-87a6-3a492cdb836b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 1.062441 Jul 26 14:23:42.934396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e411efe-76fd-46e5-acbd-bfae853856a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:42.937488 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1868/3865] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:41 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:43.258893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1e411efe-76fd-46e5-acbd-bfae853856a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:43.274062 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1e411efe-76fd-46e5-acbd-bfae853856a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1315 microversion: 2.1 time: 0.371303 Jul 26 14:23:43.275436 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1998/3866] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:42 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:43.922543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3dca12bc-0c2d-44f2-a9ff-b0b4e0d2d7e4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:43.923510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3dca12bc-0c2d-44f2-a9ff-b0b4e0d2d7e4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:43.956182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3dca12bc-0c2d-44f2-a9ff-b0b4e0d2d7e4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:43.957263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3dca12bc-0c2d-44f2-a9ff-b0b4e0d2d7e4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:43.959364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3dca12bc-0c2d-44f2-a9ff-b0b4e0d2d7e4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:43.961774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3dca12bc-0c2d-44f2-a9ff-b0b4e0d2d7e4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:43.969108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-14cb2eff-f75a-4665-9397-d76c3fb872fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:43.969842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-14cb2eff-f75a-4665-9397-d76c3fb872fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:43.988453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14cb2eff-f75a-4665-9397-d76c3fb872fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:43.989569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14cb2eff-f75a-4665-9397-d76c3fb872fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:43.990733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14cb2eff-f75a-4665-9397-d76c3fb872fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:43.991371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14cb2eff-f75a-4665-9397-d76c3fb872fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:44.265801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3dca12bc-0c2d-44f2-a9ff-b0b4e0d2d7e4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:44.286209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3dca12bc-0c2d-44f2-a9ff-b0b4e0d2d7e4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:44.290093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3dca12bc-0c2d-44f2-a9ff-b0b4e0d2d7e4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:44.315650 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3dca12bc-0c2d-44f2-a9ff-b0b4e0d2d7e4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1418 microversion: 2.75 time: 0.397951 Jul 26 14:23:44.317963 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1869/3867] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:43 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1418 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:44.349306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce863171-3b90-4ada-b663-c6c9f787f2ba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:44.351153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce863171-3b90-4ada-b663-c6c9f787f2ba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:44.359661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce863171-3b90-4ada-b663-c6c9f787f2ba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:44.361202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce863171-3b90-4ada-b663-c6c9f787f2ba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:44.363415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce863171-3b90-4ada-b663-c6c9f787f2ba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:44.364437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce863171-3b90-4ada-b663-c6c9f787f2ba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:44.370386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-14cb2eff-f75a-4665-9397-d76c3fb872fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:44.383514 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-14cb2eff-f75a-4665-9397-d76c3fb872fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.420369 Jul 26 14:23:44.386154 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 1999/3868] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:43 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:44.635510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ce863171-3b90-4ada-b663-c6c9f787f2ba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:44.680455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce863171-3b90-4ada-b663-c6c9f787f2ba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1315 microversion: 2.1 time: 0.338160 Jul 26 14:23:44.687930 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1870/3869] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:44 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:44.872582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56fbc9bb-0164-435d-99fd-4f7ed45025b0 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:44.879634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56fbc9bb-0164-435d-99fd-4f7ed45025b0 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:44.897449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56fbc9bb-0164-435d-99fd-4f7ed45025b0 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:44.898780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56fbc9bb-0164-435d-99fd-4f7ed45025b0 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:44.900330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56fbc9bb-0164-435d-99fd-4f7ed45025b0 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:44.904867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56fbc9bb-0164-435d-99fd-4f7ed45025b0 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:44.997585 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56fbc9bb-0164-435d-99fd-4f7ed45025b0 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131286 Jul 26 14:23:45.006497 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2000/3870] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:23:44 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:45.016973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-debe5d26-c364-4a5e-b360-2b0aee8927e4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:45.017820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-debe5d26-c364-4a5e-b360-2b0aee8927e4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:45.052401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-debe5d26-c364-4a5e-b360-2b0aee8927e4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:45.053019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-debe5d26-c364-4a5e-b360-2b0aee8927e4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:45.061075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-debe5d26-c364-4a5e-b360-2b0aee8927e4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:45.062377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-debe5d26-c364-4a5e-b360-2b0aee8927e4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:45.129940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:45.161610 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-debe5d26-c364-4a5e-b360-2b0aee8927e4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments/10d91645-35a7-4939-a224-8778ccc7e792" status: 200 len: 194 microversion: 2.1 time: 0.155510 Jul 26 14:23:45.165029 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1871/3871] 10.222.0.70 () {58 vars in 1413 bytes} [Tue Jul 26 14:23:45 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments/10d91645-35a7-4939-a224-8778ccc7e792 => generated 194 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:23:45.352108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f531bc3c-2889-4f6c-9806-1bca78019538 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:45.352791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f531bc3c-2889-4f6c-9806-1bca78019538 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:45.384495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f531bc3c-2889-4f6c-9806-1bca78019538 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:45.388545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f531bc3c-2889-4f6c-9806-1bca78019538 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:45.390151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f531bc3c-2889-4f6c-9806-1bca78019538 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:45.400384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f531bc3c-2889-4f6c-9806-1bca78019538 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:45.409990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:45.416627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eaaec4cc-086e-418b-8312-1445b0e2f31b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:45.417287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eaaec4cc-086e-418b-8312-1445b0e2f31b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:45.424977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=16 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:45.454535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaaec4cc-086e-418b-8312-1445b0e2f31b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:45.454997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaaec4cc-086e-418b-8312-1445b0e2f31b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:45.471151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaaec4cc-086e-418b-8312-1445b0e2f31b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:45.471539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaaec4cc-086e-418b-8312-1445b0e2f31b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:45.961120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f531bc3c-2889-4f6c-9806-1bca78019538 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:46.000329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f531bc3c-2889-4f6c-9806-1bca78019538 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:46.006870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f531bc3c-2889-4f6c-9806-1bca78019538 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:46.020477 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f531bc3c-2889-4f6c-9806-1bca78019538 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1416 microversion: 2.75 time: 0.673064 Jul 26 14:23:46.033594 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2001/3872] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:45 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1416 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:23:46.051536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0754a8a6-e390-4743-9988-74678e9c7e25 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:46.052455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0754a8a6-e390-4743-9988-74678e9c7e25 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:46.063338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0754a8a6-e390-4743-9988-74678e9c7e25 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:46.063829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0754a8a6-e390-4743-9988-74678e9c7e25 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:46.064954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0754a8a6-e390-4743-9988-74678e9c7e25 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:46.065524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0754a8a6-e390-4743-9988-74678e9c7e25 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:46.283152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-eaaec4cc-086e-418b-8312-1445b0e2f31b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:46.310553 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eaaec4cc-086e-418b-8312-1445b0e2f31b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.886948 Jul 26 14:23:46.311891 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1872/3873] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:45 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:46.791399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0754a8a6-e390-4743-9988-74678e9c7e25 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:46.805467 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0754a8a6-e390-4743-9988-74678e9c7e25 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1315 microversion: 2.1 time: 0.770578 Jul 26 14:23:46.813937 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2002/3874] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:46 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:47.061847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-23a9efb4-ceee-416d-b13a-fb0ba2d92d3e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:47.063423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-23a9efb4-ceee-416d-b13a-fb0ba2d92d3e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:47.087522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-23a9efb4-ceee-416d-b13a-fb0ba2d92d3e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:47.091101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-23a9efb4-ceee-416d-b13a-fb0ba2d92d3e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:47.093604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-23a9efb4-ceee-416d-b13a-fb0ba2d92d3e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:47.094281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-23a9efb4-ceee-416d-b13a-fb0ba2d92d3e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:47.316115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-23a9efb4-ceee-416d-b13a-fb0ba2d92d3e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:47.344829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-23a9efb4-ceee-416d-b13a-fb0ba2d92d3e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:47.347117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bcfe6c88-9379-4940-a1ee-a45d6d856a30 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:47.347916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bcfe6c88-9379-4940-a1ee-a45d6d856a30 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:47.350723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-23a9efb4-ceee-416d-b13a-fb0ba2d92d3e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:47.372766 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-23a9efb4-ceee-416d-b13a-fb0ba2d92d3e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1437 microversion: 2.75 time: 0.327018 Jul 26 14:23:47.375745 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1873/3875] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:47 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1437 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:47.383916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bcfe6c88-9379-4940-a1ee-a45d6d856a30 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:47.385473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bcfe6c88-9379-4940-a1ee-a45d6d856a30 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:47.387801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bcfe6c88-9379-4940-a1ee-a45d6d856a30 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:47.390258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bcfe6c88-9379-4940-a1ee-a45d6d856a30 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:47.446109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:47.454092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:47.494814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:47.495350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:47.497037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:47.497697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:47.501701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:47.746091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:23:47.746946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:23:47.747817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:23:47.751454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:23:47.752317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:23:47.802349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bcfe6c88-9379-4940-a1ee-a45d6d856a30 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:47.814265 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bcfe6c88-9379-4940-a1ee-a45d6d856a30 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.471156 Jul 26 14:23:47.815617 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2003/3876] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:47 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:47.847165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e168101e-30f6-4c4b-8490-79fe6e645b5c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:47.848667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e168101e-30f6-4c4b-8490-79fe6e645b5c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:47.871621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e168101e-30f6-4c4b-8490-79fe6e645b5c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:47.876957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e168101e-30f6-4c4b-8490-79fe6e645b5c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:47.879265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e168101e-30f6-4c4b-8490-79fe6e645b5c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:47.882766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e168101e-30f6-4c4b-8490-79fe6e645b5c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:47.968567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:48.013341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:48.020372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:48.021767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:48.022517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:48.394075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:48.403508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e168101e-30f6-4c4b-8490-79fe6e645b5c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:48.439756 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e168101e-30f6-4c4b-8490-79fe6e645b5c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1315 microversion: 2.1 time: 0.598009 Jul 26 14:23:48.444396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:48.445008 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2004/3877] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:47 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:48.450538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:48.470056 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9481d0ca-e4b2-4c13-a113-5da5e1036779 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "POST /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b/action" status: 202 len: 1494 microversion: 2.75 time: 1.035501 Jul 26 14:23:48.472649 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1874/3878] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:23:47 2022] POST /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b/action => generated 1494 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 14:23:48.505228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9e7aaee2-7a09-42ba-8824-cd896c1fcf66 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:48.507207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9e7aaee2-7a09-42ba-8824-cd896c1fcf66 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:48.527477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9e7aaee2-7a09-42ba-8824-cd896c1fcf66 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:48.527979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9e7aaee2-7a09-42ba-8824-cd896c1fcf66 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:48.534716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9e7aaee2-7a09-42ba-8824-cd896c1fcf66 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:48.535447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9e7aaee2-7a09-42ba-8824-cd896c1fcf66 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:48.694128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9e7aaee2-7a09-42ba-8824-cd896c1fcf66 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:48.716460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9e7aaee2-7a09-42ba-8824-cd896c1fcf66 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:48.722126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9e7aaee2-7a09-42ba-8824-cd896c1fcf66 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:48.761255 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9e7aaee2-7a09-42ba-8824-cd896c1fcf66 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.262067 Jul 26 14:23:48.764330 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2005/3879] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:48 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:48.855220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-105bfe76-0df5-4ffb-8624-173be3962ec1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:48.856546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-105bfe76-0df5-4ffb-8624-173be3962ec1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:48.863068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-105bfe76-0df5-4ffb-8624-173be3962ec1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:48.864159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-105bfe76-0df5-4ffb-8624-173be3962ec1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:48.865309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-105bfe76-0df5-4ffb-8624-173be3962ec1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:48.865988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-105bfe76-0df5-4ffb-8624-173be3962ec1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.110740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a604660b-5d6b-4751-afd4-7af370afda49 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:49.111721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a604660b-5d6b-4751-afd4-7af370afda49 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:49.122099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a604660b-5d6b-4751-afd4-7af370afda49 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:49.123151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a604660b-5d6b-4751-afd4-7af370afda49 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.125540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a604660b-5d6b-4751-afd4-7af370afda49 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:49.126969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a604660b-5d6b-4751-afd4-7af370afda49 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.161166 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a604660b-5d6b-4751-afd4-7af370afda49 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/ips" status: 200 len: 150 microversion: 2.20 time: 0.516789 Jul 26 14:23:49.161733 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1875/3880] 10.222.0.70 () {60 vars in 1289 bytes} [Tue Jul 26 14:23:48 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/ips => generated 150 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:23:49.196352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-105bfe76-0df5-4ffb-8624-173be3962ec1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:49.212671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-105bfe76-0df5-4ffb-8624-173be3962ec1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.360677 Jul 26 14:23:49.212996 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2006/3881] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:48 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:49.300352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-037e09e4-e36b-419a-98e9-f75abfc4c720 req-e9d35dc9-2730-4ae9-a52f-7a0e61e5a638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fbc4fe-2ffa-4211-8d46-1d6b4102b429", "name": "network-vif-plugged", "status": "completed", "tag": "2854b13d-1a74-4af9-bd59-e28bac482f54"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:49.330593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-037e09e4-e36b-419a-98e9-f75abfc4c720 req-e9d35dc9-2730-4ae9-a52f-7a0e61e5a638 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:49.335837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-037e09e4-e36b-419a-98e9-f75abfc4c720 req-e9d35dc9-2730-4ae9-a52f-7a0e61e5a638 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.368871 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-037e09e4-e36b-419a-98e9-f75abfc4c720 req-e9d35dc9-2730-4ae9-a52f-7a0e61e5a638 service nova] Creating event network-vif-plugged:2854b13d-1a74-4af9-bd59-e28bac482f54 for instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 on n-h2-833090-9 Jul 26 14:23:49.375715 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-037e09e4-e36b-419a-98e9-f75abfc4c720 req-e9d35dc9-2730-4ae9-a52f-7a0e61e5a638 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212195 Jul 26 14:23:49.383352 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1876/3882] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:49.432736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c07f601d-c1da-45d0-b145-f14825758a79 tempest-PortsAdminExtendedAttrsTestJSON-265698299 tempest-PortsAdminExtendedAttrsTestJSON-265698299-project-admin] Calling method '.version_select at 0x7f87876398b0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:49.434164 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:23:49.434164 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:23:49.435626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c07f601d-c1da-45d0-b145-f14825758a79 tempest-PortsAdminExtendedAttrsTestJSON-265698299 tempest-PortsAdminExtendedAttrsTestJSON-265698299-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:49.437784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c07f601d-c1da-45d0-b145-f14825758a79 tempest-PortsAdminExtendedAttrsTestJSON-265698299 tempest-PortsAdminExtendedAttrsTestJSON-265698299-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.457153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c07f601d-c1da-45d0-b145-f14825758a79 tempest-PortsAdminExtendedAttrsTestJSON-265698299 tempest-PortsAdminExtendedAttrsTestJSON-265698299-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:49.457830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c07f601d-c1da-45d0-b145-f14825758a79 tempest-PortsAdminExtendedAttrsTestJSON-265698299 tempest-PortsAdminExtendedAttrsTestJSON-265698299-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.462328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d49e6be-a901-49ac-a5e3-a3e9116e0a01 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51196a2f-2fbf-4eaa-a5cb-dc57212d170d"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:49.469126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d49e6be-a901-49ac-a5e3-a3e9116e0a01 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:49.474790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c07f601d-c1da-45d0-b145-f14825758a79 tempest-PortsAdminExtendedAttrsTestJSON-265698299 tempest-PortsAdminExtendedAttrsTestJSON-265698299-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:49.475417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c07f601d-c1da-45d0-b145-f14825758a79 tempest-PortsAdminExtendedAttrsTestJSON-265698299 tempest-PortsAdminExtendedAttrsTestJSON-265698299-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.485203 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c07f601d-c1da-45d0-b145-f14825758a79 tempest-PortsAdminExtendedAttrsTestJSON-265698299 tempest-PortsAdminExtendedAttrsTestJSON-265698299-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.268192 Jul 26 14:23:49.485836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d49e6be-a901-49ac-a5e3-a3e9116e0a01 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:49.486349 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2007/3883] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:23:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:49.486658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d49e6be-a901-49ac-a5e3-a3e9116e0a01 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.487517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d49e6be-a901-49ac-a5e3-a3e9116e0a01 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:49.488038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d49e6be-a901-49ac-a5e3-a3e9116e0a01 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.505845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3ff7934b-439b-43d4-bf58-415166bb0307 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:49.506655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3ff7934b-439b-43d4-bf58-415166bb0307 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:49.522657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ff7934b-439b-43d4-bf58-415166bb0307 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:49.523508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ff7934b-439b-43d4-bf58-415166bb0307 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.524565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ff7934b-439b-43d4-bf58-415166bb0307 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:49.525095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ff7934b-439b-43d4-bf58-415166bb0307 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:49.958394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3ff7934b-439b-43d4-bf58-415166bb0307 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:50.004946 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3ff7934b-439b-43d4-bf58-415166bb0307 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1315 microversion: 2.1 time: 0.515306 Jul 26 14:23:50.011297 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2008/3884] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:49 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:50.031535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9902636e-f91a-4620-aaf5-a120aa913005 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:50.032912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9902636e-f91a-4620-aaf5-a120aa913005 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:50.045392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9902636e-f91a-4620-aaf5-a120aa913005 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:50.046224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9902636e-f91a-4620-aaf5-a120aa913005 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:50.048433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9902636e-f91a-4620-aaf5-a120aa913005 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:50.049562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9902636e-f91a-4620-aaf5-a120aa913005 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:50.102639 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d49e6be-a901-49ac-a5e3-a3e9116e0a01 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "POST /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.662071 Jul 26 14:23:50.108857 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1877/3885] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:23:49 2022] POST /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:50.245073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f144e6aa-3c9d-4a64-8f37-1616f0ea9cfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:50.245985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f144e6aa-3c9d-4a64-8f37-1616f0ea9cfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:50.277222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f144e6aa-3c9d-4a64-8f37-1616f0ea9cfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:50.279492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f144e6aa-3c9d-4a64-8f37-1616f0ea9cfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:50.283672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9902636e-f91a-4620-aaf5-a120aa913005 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:50.284149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f144e6aa-3c9d-4a64-8f37-1616f0ea9cfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:50.286497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f144e6aa-3c9d-4a64-8f37-1616f0ea9cfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:50.318868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9902636e-f91a-4620-aaf5-a120aa913005 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:50.323414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9902636e-f91a-4620-aaf5-a120aa913005 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:50.341710 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9902636e-f91a-4620-aaf5-a120aa913005 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.328401 Jul 26 14:23:50.343628 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2009/3886] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:50 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:50.608781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f144e6aa-3c9d-4a64-8f37-1616f0ea9cfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:50.630539 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f144e6aa-3c9d-4a64-8f37-1616f0ea9cfe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.391681 Jul 26 14:23:50.633070 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1878/3887] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:50 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:51.035321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aa51c930-d3dd-4281-96c6-a75cb9cc08ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:51.036558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aa51c930-d3dd-4281-96c6-a75cb9cc08ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:51.120123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa51c930-d3dd-4281-96c6-a75cb9cc08ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:51.121150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa51c930-d3dd-4281-96c6-a75cb9cc08ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:51.122657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa51c930-d3dd-4281-96c6-a75cb9cc08ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:51.123534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa51c930-d3dd-4281-96c6-a75cb9cc08ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:51.376879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1d1766db-633f-487e-ab97-bdd2a8e3df3f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:51.380237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1d1766db-633f-487e-ab97-bdd2a8e3df3f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:51.396292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d1766db-633f-487e-ab97-bdd2a8e3df3f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:51.443664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d1766db-633f-487e-ab97-bdd2a8e3df3f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:51.445528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d1766db-633f-487e-ab97-bdd2a8e3df3f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:51.448570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d1766db-633f-487e-ab97-bdd2a8e3df3f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:51.678753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa51c930-d3dd-4281-96c6-a75cb9cc08ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:51.710510 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aa51c930-d3dd-4281-96c6-a75cb9cc08ca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1315 microversion: 2.1 time: 0.683282 Jul 26 14:23:51.711116 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2010/3888] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:51 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:51.758099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a08978ce-785c-444f-937f-189b7f43b457 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:51.771906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a08978ce-785c-444f-937f-189b7f43b457 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:51.800494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:51.811709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a08978ce-785c-444f-937f-189b7f43b457 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:51.812670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a08978ce-785c-444f-937f-189b7f43b457 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:51.820760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a08978ce-785c-444f-937f-189b7f43b457 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:51.821338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a08978ce-785c-444f-937f-189b7f43b457 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:51.867640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d1766db-633f-487e-ab97-bdd2a8e3df3f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:51.907676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d1766db-633f-487e-ab97-bdd2a8e3df3f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:51.914331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d1766db-633f-487e-ab97-bdd2a8e3df3f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:51.948833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:51.950721 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1d1766db-633f-487e-ab97-bdd2a8e3df3f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.582951 Jul 26 14:23:51.956841 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1879/3889] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:51 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:23:52.285940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a08978ce-785c-444f-937f-189b7f43b457 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:52.311895 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a08978ce-785c-444f-937f-189b7f43b457 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.599121 Jul 26 14:23:52.313716 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2011/3890] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:51 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:52.734400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20e9310a-650c-4277-bf0e-1578bbfc8412 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:52.735021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-20e9310a-650c-4277-bf0e-1578bbfc8412 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:52.746784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20e9310a-650c-4277-bf0e-1578bbfc8412 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:52.747250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20e9310a-650c-4277-bf0e-1578bbfc8412 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:52.759510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20e9310a-650c-4277-bf0e-1578bbfc8412 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:52.760004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20e9310a-650c-4277-bf0e-1578bbfc8412 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:52.985424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b23b7b76-d15d-4c5e-ac64-81212b53cc2f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:52.986542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b23b7b76-d15d-4c5e-ac64-81212b53cc2f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:53.001071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:53.007572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b23b7b76-d15d-4c5e-ac64-81212b53cc2f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:53.008166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b23b7b76-d15d-4c5e-ac64-81212b53cc2f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:53.012057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b23b7b76-d15d-4c5e-ac64-81212b53cc2f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:53.013366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b23b7b76-d15d-4c5e-ac64-81212b53cc2f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:53.162608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-20e9310a-650c-4277-bf0e-1578bbfc8412 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:53.175576 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-20e9310a-650c-4277-bf0e-1578bbfc8412 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1502 microversion: 2.1 time: 0.444897 Jul 26 14:23:53.180311 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1880/3891] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:52 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1502 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:53.189861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b23b7b76-d15d-4c5e-ac64-81212b53cc2f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:53.202399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b23b7b76-d15d-4c5e-ac64-81212b53cc2f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:53.214947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-38681a67-d83f-45fb-911d-820f0629591b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:53.215799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-38681a67-d83f-45fb-911d-820f0629591b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:53.226245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b23b7b76-d15d-4c5e-ac64-81212b53cc2f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:53.240112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38681a67-d83f-45fb-911d-820f0629591b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:53.240869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38681a67-d83f-45fb-911d-820f0629591b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:53.241584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38681a67-d83f-45fb-911d-820f0629591b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:53.242039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38681a67-d83f-45fb-911d-820f0629591b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:53.247659 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b23b7b76-d15d-4c5e-ac64-81212b53cc2f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.267855 Jul 26 14:23:53.251378 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2012/3892] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:52 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:23:53.344466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-39d33c10-1e68-4f07-ae09-0e3b62722f20 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:53.345826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-39d33c10-1e68-4f07-ae09-0e3b62722f20 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:53.387844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39d33c10-1e68-4f07-ae09-0e3b62722f20 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:53.392208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39d33c10-1e68-4f07-ae09-0e3b62722f20 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:53.395745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39d33c10-1e68-4f07-ae09-0e3b62722f20 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:53.396291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39d33c10-1e68-4f07-ae09-0e3b62722f20 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:53.492327 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-38681a67-d83f-45fb-911d-820f0629591b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429/action" status: 202 len: 0 microversion: 2.1 time: 0.284046 Jul 26 14:23:53.505204 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1881/3893] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:23:53 2022] POST /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:23:53.538593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-372134a9-e469-4f09-b555-6085204af203 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:53.540708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-372134a9-e469-4f09-b555-6085204af203 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:53.555019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-372134a9-e469-4f09-b555-6085204af203 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:53.555483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-372134a9-e469-4f09-b555-6085204af203 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:53.567920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-372134a9-e469-4f09-b555-6085204af203 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:53.568461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-372134a9-e469-4f09-b555-6085204af203 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:54.031287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-372134a9-e469-4f09-b555-6085204af203 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:54.038203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-39d33c10-1e68-4f07-ae09-0e3b62722f20 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:54.047166 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-372134a9-e469-4f09-b555-6085204af203 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1507 microversion: 2.1 time: 0.535549 Jul 26 14:23:54.048403 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1882/3894] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:53 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1507 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:54.058283 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-39d33c10-1e68-4f07-ae09-0e3b62722f20 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1510 microversion: 2.1 time: 0.722226 Jul 26 14:23:54.060417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c07cc28d-4b84-4049-943d-0f08437ecac9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:54.061400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c07cc28d-4b84-4049-943d-0f08437ecac9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:54.077785 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2013/3895] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:53 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1510 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:54.078189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c07cc28d-4b84-4049-943d-0f08437ecac9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:54.078772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c07cc28d-4b84-4049-943d-0f08437ecac9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:54.079682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c07cc28d-4b84-4049-943d-0f08437ecac9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:54.082816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c07cc28d-4b84-4049-943d-0f08437ecac9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:54.150834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-c07cc28d-4b84-4049-943d-0f08437ecac9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lazy-loading 'flavor' on Instance uuid d7576357-b5e0-45fb-9641-d397a6b3faf2 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:23:54.290615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90325ff7-6e68-45d1-8a6c-3c8645f3854e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:54.291498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-90325ff7-6e68-45d1-8a6c-3c8645f3854e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:54.311271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90325ff7-6e68-45d1-8a6c-3c8645f3854e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:54.312551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90325ff7-6e68-45d1-8a6c-3c8645f3854e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:54.314347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90325ff7-6e68-45d1-8a6c-3c8645f3854e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:54.315147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90325ff7-6e68-45d1-8a6c-3c8645f3854e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:54.537463 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c07cc28d-4b84-4049-943d-0f08437ecac9 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "POST /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/action" status: 202 len: 0 microversion: 2.20 time: 0.481194 Jul 26 14:23:54.537463 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1883/3896] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:23:54 2022] POST /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:23:54.576514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22c141dd-b529-475a-9ad9-25d0037b0e39 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:54.577566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22c141dd-b529-475a-9ad9-25d0037b0e39 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:54.586642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22c141dd-b529-475a-9ad9-25d0037b0e39 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:54.587350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22c141dd-b529-475a-9ad9-25d0037b0e39 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:54.588506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22c141dd-b529-475a-9ad9-25d0037b0e39 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:54.589295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22c141dd-b529-475a-9ad9-25d0037b0e39 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:54.781524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90325ff7-6e68-45d1-8a6c-3c8645f3854e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:54.792585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90325ff7-6e68-45d1-8a6c-3c8645f3854e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:54.797106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90325ff7-6e68-45d1-8a6c-3c8645f3854e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:54.805033 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90325ff7-6e68-45d1-8a6c-3c8645f3854e tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.521447 Jul 26 14:23:54.809126 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2014/3897] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:54 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:23:54.975516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22c141dd-b529-475a-9ad9-25d0037b0e39 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:54.985025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22c141dd-b529-475a-9ad9-25d0037b0e39 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:54.986935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22c141dd-b529-475a-9ad9-25d0037b0e39 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:54.988543 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22c141dd-b529-475a-9ad9-25d0037b0e39 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.434159 Jul 26 14:23:55.004385 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1884/3898] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:54 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:55.074268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a6cde3a2-66e6-40b4-b5b0-8401fc402b51 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:55.075771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a6cde3a2-66e6-40b4-b5b0-8401fc402b51 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:55.113648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d1bdb32-c9ab-48db-9ff0-5c726e19aaf5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:55.114194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6cde3a2-66e6-40b4-b5b0-8401fc402b51 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.114597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8d1bdb32-c9ab-48db-9ff0-5c726e19aaf5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:55.115223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6cde3a2-66e6-40b4-b5b0-8401fc402b51 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.116744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6cde3a2-66e6-40b4-b5b0-8401fc402b51 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.117561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6cde3a2-66e6-40b4-b5b0-8401fc402b51 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.121650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d1bdb32-c9ab-48db-9ff0-5c726e19aaf5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.122108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d1bdb32-c9ab-48db-9ff0-5c726e19aaf5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.122887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d1bdb32-c9ab-48db-9ff0-5c726e19aaf5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.123326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d1bdb32-c9ab-48db-9ff0-5c726e19aaf5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.126303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:55.508137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d1bdb32-c9ab-48db-9ff0-5c726e19aaf5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:55.523760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a6cde3a2-66e6-40b4-b5b0-8401fc402b51 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:55.584327 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d1bdb32-c9ab-48db-9ff0-5c726e19aaf5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1487 microversion: 2.1 time: 0.499669 Jul 26 14:23:55.590245 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a6cde3a2-66e6-40b4-b5b0-8401fc402b51 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1487 microversion: 2.1 time: 0.514051 Jul 26 14:23:55.604612 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1885/3899] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:55 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1487 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:55.608695 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2015/3900] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:55 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1487 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:55.635977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-59315bb3-1555-40be-8479-8db25a7c822f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:55.638406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-59315bb3-1555-40be-8479-8db25a7c822f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:55.640837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64956ec6-9798-45af-bdea-b36b53919fb1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:55.641925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-64956ec6-9798-45af-bdea-b36b53919fb1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:55.663028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64956ec6-9798-45af-bdea-b36b53919fb1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.663433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59315bb3-1555-40be-8479-8db25a7c822f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.663909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59315bb3-1555-40be-8479-8db25a7c822f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.664071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64956ec6-9798-45af-bdea-b36b53919fb1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.666241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64956ec6-9798-45af-bdea-b36b53919fb1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.667079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64956ec6-9798-45af-bdea-b36b53919fb1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.669515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59315bb3-1555-40be-8479-8db25a7c822f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.670001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59315bb3-1555-40be-8479-8db25a7c822f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.739360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-64956ec6-9798-45af-bdea-b36b53919fb1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:23:55.772931 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-59315bb3-1555-40be-8479-8db25a7c822f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 200 len: 144 microversion: 2.1 time: 0.141473 Jul 26 14:23:55.778368 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1886/3901] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:23:55 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 144 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:23:55.785305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c55f2e1-207c-42ee-94bf-bd0448333844 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:55.786032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c55f2e1-207c-42ee-94bf-bd0448333844 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:55.806116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c55f2e1-207c-42ee-94bf-bd0448333844 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.807263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c55f2e1-207c-42ee-94bf-bd0448333844 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.814254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c55f2e1-207c-42ee-94bf-bd0448333844 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.815572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c55f2e1-207c-42ee-94bf-bd0448333844 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.834405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:55.947610 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-64956ec6-9798-45af-bdea-b36b53919fb1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 204 len: 0 microversion: 2.1 time: 0.315007 Jul 26 14:23:55.950754 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2016/3902] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:23:55 2022] DELETE /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:23:55.969805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da738022-fea2-498d-9ec0-54383da93aa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:55.970633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-da738022-fea2-498d-9ec0-54383da93aa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:55.985982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da738022-fea2-498d-9ec0-54383da93aa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.986780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da738022-fea2-498d-9ec0-54383da93aa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:55.987883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da738022-fea2-498d-9ec0-54383da93aa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:55.989503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da738022-fea2-498d-9ec0-54383da93aa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:56.167186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da738022-fea2-498d-9ec0-54383da93aa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:56.178245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da738022-fea2-498d-9ec0-54383da93aa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:56.179967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da738022-fea2-498d-9ec0-54383da93aa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:56.186220 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-da738022-fea2-498d-9ec0-54383da93aa8 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.233464 Jul 26 14:23:56.187142 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2017/3903] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:55 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:56.205542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-731b2d35-d72e-498a-a3d5-d30d70e9b2a5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:56.205883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-731b2d35-d72e-498a-a3d5-d30d70e9b2a5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:56.224518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-731b2d35-d72e-498a-a3d5-d30d70e9b2a5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:56.225045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-731b2d35-d72e-498a-a3d5-d30d70e9b2a5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:56.226406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-731b2d35-d72e-498a-a3d5-d30d70e9b2a5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:56.226406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-731b2d35-d72e-498a-a3d5-d30d70e9b2a5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:56.458977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c55f2e1-207c-42ee-94bf-bd0448333844 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:56.475281 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c55f2e1-207c-42ee-94bf-bd0448333844 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.695318 Jul 26 14:23:56.480529 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1887/3904] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:55 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:56.487182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22b9f3b0-2f9a-4274-8ccc-d0bce6630bc6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:56.488139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22b9f3b0-2f9a-4274-8ccc-d0bce6630bc6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:56.498551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22b9f3b0-2f9a-4274-8ccc-d0bce6630bc6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:56.501057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22b9f3b0-2f9a-4274-8ccc-d0bce6630bc6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:56.502716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22b9f3b0-2f9a-4274-8ccc-d0bce6630bc6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:56.504741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22b9f3b0-2f9a-4274-8ccc-d0bce6630bc6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:57.052101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-731b2d35-d72e-498a-a3d5-d30d70e9b2a5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:57.068133 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-731b2d35-d72e-498a-a3d5-d30d70e9b2a5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1493 microversion: 2.1 time: 0.875051 Jul 26 14:23:57.069125 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2018/3905] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:56 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1493 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:57.095308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-989b92c7-c4fd-4069-9942-c3c759385d4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:57.095984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-989b92c7-c4fd-4069-9942-c3c759385d4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:57.122698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-989b92c7-c4fd-4069-9942-c3c759385d4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:57.123179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-989b92c7-c4fd-4069-9942-c3c759385d4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:57.124745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-989b92c7-c4fd-4069-9942-c3c759385d4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:57.125379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-989b92c7-c4fd-4069-9942-c3c759385d4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:57.238580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22b9f3b0-2f9a-4274-8ccc-d0bce6630bc6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:57.259286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22b9f3b0-2f9a-4274-8ccc-d0bce6630bc6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:57.263052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22b9f3b0-2f9a-4274-8ccc-d0bce6630bc6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:57.267216 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22b9f3b0-2f9a-4274-8ccc-d0bce6630bc6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.783524 Jul 26 14:23:57.282845 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1888/3906] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:56 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:57.298286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1252e99a-96a0-4664-93f2-bf4378baa5f1 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:57.298828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1252e99a-96a0-4664-93f2-bf4378baa5f1 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:57.327397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1252e99a-96a0-4664-93f2-bf4378baa5f1 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:57.327927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1252e99a-96a0-4664-93f2-bf4378baa5f1 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:57.329680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1252e99a-96a0-4664-93f2-bf4378baa5f1 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:57.333162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1252e99a-96a0-4664-93f2-bf4378baa5f1 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:57.468306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-989b92c7-c4fd-4069-9942-c3c759385d4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:57.484431 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-989b92c7-c4fd-4069-9942-c3c759385d4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.414028 Jul 26 14:23:57.529213 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2019/3907] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:57 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:57.538023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9f89234-d3f6-4f5a-b224-946aecd231af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:57.538680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a9f89234-d3f6-4f5a-b224-946aecd231af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:57.544330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:23:57.555693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1252e99a-96a0-4664-93f2-bf4378baa5f1 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:57.573177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9f89234-d3f6-4f5a-b224-946aecd231af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:57.573667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9f89234-d3f6-4f5a-b224-946aecd231af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:57.576338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9f89234-d3f6-4f5a-b224-946aecd231af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:57.576946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9f89234-d3f6-4f5a-b224-946aecd231af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:57.589147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1252e99a-96a0-4664-93f2-bf4378baa5f1 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:57.593580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1252e99a-96a0-4664-93f2-bf4378baa5f1 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:57.618400 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1252e99a-96a0-4664-93f2-bf4378baa5f1 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.325524 Jul 26 14:23:57.640192 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1889/3908] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:57 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:58.082257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a9f89234-d3f6-4f5a-b224-946aecd231af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:58.095276 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a9f89234-d3f6-4f5a-b224-946aecd231af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.563342 Jul 26 14:23:58.095891 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2020/3909] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:57 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:58.103284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-76b7ad8e-2adb-4751-98b3-01775f093f15 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:58.104489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76b7ad8e-2adb-4751-98b3-01775f093f15 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:58.119634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76b7ad8e-2adb-4751-98b3-01775f093f15 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:58.120905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76b7ad8e-2adb-4751-98b3-01775f093f15 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:58.122168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-884c2d0b-259f-43f5-867f-f002017f9cd2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:58.122843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76b7ad8e-2adb-4751-98b3-01775f093f15 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:58.123048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-884c2d0b-259f-43f5-867f-f002017f9cd2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:58.124890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76b7ad8e-2adb-4751-98b3-01775f093f15 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:58.135336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-884c2d0b-259f-43f5-867f-f002017f9cd2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:58.135809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-884c2d0b-259f-43f5-867f-f002017f9cd2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:58.138922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-884c2d0b-259f-43f5-867f-f002017f9cd2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:58.144066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-884c2d0b-259f-43f5-867f-f002017f9cd2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:58.860945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-76b7ad8e-2adb-4751-98b3-01775f093f15 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:58.871799 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-76b7ad8e-2adb-4751-98b3-01775f093f15 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1493 microversion: 2.1 time: 0.776965 Jul 26 14:23:58.874321 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1890/3910] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:58 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1493 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:23:58.888458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-19186eb0-ac76-4891-980e-88d2fe08cfcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:58.890403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-19186eb0-ac76-4891-980e-88d2fe08cfcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:58.898312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19186eb0-ac76-4891-980e-88d2fe08cfcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:58.899064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19186eb0-ac76-4891-980e-88d2fe08cfcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:58.900534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19186eb0-ac76-4891-980e-88d2fe08cfcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:58.900987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19186eb0-ac76-4891-980e-88d2fe08cfcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:58.901625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-884c2d0b-259f-43f5-867f-f002017f9cd2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:58.927126 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-884c2d0b-259f-43f5-867f-f002017f9cd2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.810600 Jul 26 14:23:58.927731 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2021/3911] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:58 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:23:58.945360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d66bdf8-2e44-4591-9e12-267155a246ca tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:58.946406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d66bdf8-2e44-4591-9e12-267155a246ca tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:58.971466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d66bdf8-2e44-4591-9e12-267155a246ca tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:58.971931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d66bdf8-2e44-4591-9e12-267155a246ca tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:58.972802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d66bdf8-2e44-4591-9e12-267155a246ca tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:58.973251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d66bdf8-2e44-4591-9e12-267155a246ca tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:59.190385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d66bdf8-2e44-4591-9e12-267155a246ca tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:59.213604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d66bdf8-2e44-4591-9e12-267155a246ca tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:59.218479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d66bdf8-2e44-4591-9e12-267155a246ca tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:59.242550 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d66bdf8-2e44-4591-9e12-267155a246ca tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.308958 Jul 26 14:23:59.249434 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2022/3912] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:58 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:59.269946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1305918779", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "57ac168b-59fa-4a44-88ec-5fbc6a23582a"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:23:59.363878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] validate_networks() for [('57ac168b-59fa-4a44-88ec-5fbc6a23582a', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:23:59.696330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-19186eb0-ac76-4891-980e-88d2fe08cfcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:59.737423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-19186eb0-ac76-4891-980e-88d2fe08cfcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:59.742918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-19186eb0-ac76-4891-980e-88d2fe08cfcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:23:59.749842 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-19186eb0-ac76-4891-980e-88d2fe08cfcc tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.869953 Jul 26 14:23:59.751490 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1891/3913] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:23:58 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:23:59.896706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-db5a1553-314a-47ae-88ee-12446bb2c67d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:23:59.897488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-db5a1553-314a-47ae-88ee-12446bb2c67d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:23:59.914215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db5a1553-314a-47ae-88ee-12446bb2c67d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:59.915072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db5a1553-314a-47ae-88ee-12446bb2c67d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:23:59.916228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db5a1553-314a-47ae-88ee-12446bb2c67d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:23:59.916916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db5a1553-314a-47ae-88ee-12446bb2c67d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:00.340878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-db5a1553-314a-47ae-88ee-12446bb2c67d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:00.375381 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-db5a1553-314a-47ae-88ee-12446bb2c67d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1493 microversion: 2.1 time: 0.480430 Jul 26 14:24:00.393199 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1892/3914] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:23:59 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1493 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:24:00.414171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-80aa1950-9527-4a48-b49a-45e73feca989 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:00.415297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-80aa1950-9527-4a48-b49a-45e73feca989 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:00.428306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80aa1950-9527-4a48-b49a-45e73feca989 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:00.431830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80aa1950-9527-4a48-b49a-45e73feca989 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:00.433361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80aa1950-9527-4a48-b49a-45e73feca989 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:00.434783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80aa1950-9527-4a48-b49a-45e73feca989 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:00.440355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:24:00.441177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:24:00.445547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:24:00.446494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:24:00.453649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:24:00.500749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:00.503066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:00.504874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:00.507160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:00.568858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for project 991c7f82c09446409408ca9d0638fcba. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:24:00.590071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for user 7b5b7e30e280492b85d9c8f98fe09e43 and project 991c7f82c09446409408ca9d0638fcba. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:24:00.626650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:24:00.633283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:24:00.712561 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80aa1950-9527-4a48-b49a-45e73feca989 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:00.740918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80aa1950-9527-4a48-b49a-45e73feca989 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:00.747423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80aa1950-9527-4a48-b49a-45e73feca989 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:00.774729 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-80aa1950-9527-4a48-b49a-45e73feca989 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.367590 Jul 26 14:24:00.793089 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1893/3915] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:00 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:00.793089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-0c44452b-ef76-4811-8ef1-747c4d6179cc req-33919a28-eb7f-4f8b-8dc5-fd44a415d0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fbc4fe-2ffa-4211-8d46-1d6b4102b429", "name": "network-vif-deleted", "tag": "2854b13d-1a74-4af9-bd59-e28bac482f54"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:00.825462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0c44452b-ef76-4811-8ef1-747c4d6179cc req-33919a28-eb7f-4f8b-8dc5-fd44a415d0d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:00.829149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0c44452b-ef76-4811-8ef1-747c4d6179cc req-33919a28-eb7f-4f8b-8dc5-fd44a415d0d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:00.847237 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-0c44452b-ef76-4811-8ef1-747c4d6179cc req-33919a28-eb7f-4f8b-8dc5-fd44a415d0d4 service nova] Creating event network-vif-deleted:2854b13d-1a74-4af9-bd59-e28bac482f54 for instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 on n-h2-833090-9 Jul 26 14:24:00.856200 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-523dd9e3-131b-4526-b919-2158ac0d3666 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.604207 Jul 26 14:24:00.861489 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-0c44452b-ef76-4811-8ef1-747c4d6179cc req-33919a28-eb7f-4f8b-8dc5-fd44a415d0d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082782 Jul 26 14:24:00.862378 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1894/3916] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:00.868981 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2023/3917] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:24:00.870585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-89cdcbda-3e70-4a46-bd6a-e331c33d0e57 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:00.871436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-89cdcbda-3e70-4a46-bd6a-e331c33d0e57 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:00.880633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89cdcbda-3e70-4a46-bd6a-e331c33d0e57 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:00.881127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89cdcbda-3e70-4a46-bd6a-e331c33d0e57 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:00.881936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89cdcbda-3e70-4a46-bd6a-e331c33d0e57 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:00.882580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89cdcbda-3e70-4a46-bd6a-e331c33d0e57 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:00.891362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ef3b5144-9d32-462a-b70d-e8f6ee971f4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:00.894966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef3b5144-9d32-462a-b70d-e8f6ee971f4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:01.101322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ef3b5144-9d32-462a-b70d-e8f6ee971f4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:01.109109 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ef3b5144-9d32-462a-b70d-e8f6ee971f4d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1215 microversion: 2.1 time: 0.237355 Jul 26 14:24:01.124456 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2024/3918] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:00 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:01.190855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-89cdcbda-3e70-4a46-bd6a-e331c33d0e57 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:01.200583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-89cdcbda-3e70-4a46-bd6a-e331c33d0e57 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:01.202235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-89cdcbda-3e70-4a46-bd6a-e331c33d0e57 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:01.203463 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-89cdcbda-3e70-4a46-bd6a-e331c33d0e57 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.339250 Jul 26 14:24:01.204065 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1895/3919] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:00 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:01.407325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:01.408513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:01.432220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:01.438168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:01.443754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:01.446085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:01.558973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:01.559408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:01.559890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lazy-loading 'fault' on Instance uuid 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:01.805797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-511e3733-f186-4c20-a7da-e937fd8c850f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:01.806984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-511e3733-f186-4c20-a7da-e937fd8c850f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:01.823056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-511e3733-f186-4c20-a7da-e937fd8c850f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:01.828875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-511e3733-f186-4c20-a7da-e937fd8c850f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:01.831048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-511e3733-f186-4c20-a7da-e937fd8c850f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:01.832578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-511e3733-f186-4c20-a7da-e937fd8c850f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:02.233601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:02.233965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-511e3733-f186-4c20-a7da-e937fd8c850f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:02.245187 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6faff5be-bdd0-4355-8a4b-322a34c7ebe8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 200 len: 1305 microversion: 2.1 time: 0.842770 Jul 26 14:24:02.246649 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2025/3920] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:01 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 1305 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:02.251572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-511e3733-f186-4c20-a7da-e937fd8c850f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:02.254061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-55e4164a-0e8b-4dd2-a4b2-a57edd0931d9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:02.254983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-55e4164a-0e8b-4dd2-a4b2-a57edd0931d9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:02.256373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-511e3733-f186-4c20-a7da-e937fd8c850f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:02.267733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-55e4164a-0e8b-4dd2-a4b2-a57edd0931d9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:02.269271 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-511e3733-f186-4c20-a7da-e937fd8c850f tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.471404 Jul 26 14:24:02.269878 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1896/3921] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:01 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:02.272058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-55e4164a-0e8b-4dd2-a4b2-a57edd0931d9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:02.274207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-55e4164a-0e8b-4dd2-a4b2-a57edd0931d9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:02.275625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-55e4164a-0e8b-4dd2-a4b2-a57edd0931d9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:02.293579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ff2ec99-0796-494c-9d36-1ea4ed5b0f98 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:02.294514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4ff2ec99-0796-494c-9d36-1ea4ed5b0f98 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:02.310390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ff2ec99-0796-494c-9d36-1ea4ed5b0f98 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:02.311412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ff2ec99-0796-494c-9d36-1ea4ed5b0f98 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:02.312516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ff2ec99-0796-494c-9d36-1ea4ed5b0f98 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:02.313147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ff2ec99-0796-494c-9d36-1ea4ed5b0f98 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:02.384494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-55e4164a-0e8b-4dd2-a4b2-a57edd0931d9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:02.397846 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-55e4164a-0e8b-4dd2-a4b2-a57edd0931d9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1267 microversion: 2.1 time: 0.149227 Jul 26 14:24:02.416483 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2026/3922] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:02 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:02.737085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ff2ec99-0796-494c-9d36-1ea4ed5b0f98 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:02.752506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ff2ec99-0796-494c-9d36-1ea4ed5b0f98 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:02.754859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ff2ec99-0796-494c-9d36-1ea4ed5b0f98 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:02.760809 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ff2ec99-0796-494c-9d36-1ea4ed5b0f98 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.485976 Jul 26 14:24:02.761643 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1897/3923] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:02 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:03.270784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db81e9f0-059f-4560-87be-f57f476d0f9e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:03.273038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-db81e9f0-059f-4560-87be-f57f476d0f9e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:03.285792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db81e9f0-059f-4560-87be-f57f476d0f9e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:03.291243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db81e9f0-059f-4560-87be-f57f476d0f9e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:03.292853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db81e9f0-059f-4560-87be-f57f476d0f9e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:03.293788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db81e9f0-059f-4560-87be-f57f476d0f9e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:03.294984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5bef8d5a-5d06-416f-9b1b-fb86bdec5eac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:03.296802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5bef8d5a-5d06-416f-9b1b-fb86bdec5eac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:03.306722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bef8d5a-5d06-416f-9b1b-fb86bdec5eac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:03.308512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bef8d5a-5d06-416f-9b1b-fb86bdec5eac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:03.313970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bef8d5a-5d06-416f-9b1b-fb86bdec5eac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:03.314718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5bef8d5a-5d06-416f-9b1b-fb86bdec5eac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:03.335969 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-db81e9f0-059f-4560-87be-f57f476d0f9e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db81e9f0-059f-4560-87be-f57f476d0f9e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 HTTP/1.1 Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '45fbc4fe-2ffa-4211-8d46-1d6b4102b429'} Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:24:03.338556 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:24:03.344158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:03.344158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:24:03.344158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:24:03.344158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:24:03.344158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:24:03.344158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:24:03.344158 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:24:03.347027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db81e9f0-059f-4560-87be-f57f476d0f9e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:24:03.347027 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db81e9f0-059f-4560-87be-f57f476d0f9e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 404 len: 111 microversion: 2.1 time: 0.080012 Jul 26 14:24:03.351266 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2027/3924] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:03 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:24:03.423937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-81658958-c74c-48f2-91df-097b8db1326e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:03.424944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-81658958-c74c-48f2-91df-097b8db1326e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:03.440517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81658958-c74c-48f2-91df-097b8db1326e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:03.441355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81658958-c74c-48f2-91df-097b8db1326e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:03.442470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81658958-c74c-48f2-91df-097b8db1326e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:03.443169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81658958-c74c-48f2-91df-097b8db1326e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:03.644958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5bef8d5a-5d06-416f-9b1b-fb86bdec5eac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:03.656832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5bef8d5a-5d06-416f-9b1b-fb86bdec5eac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:03.661511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5bef8d5a-5d06-416f-9b1b-fb86bdec5eac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:03.676095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-81658958-c74c-48f2-91df-097b8db1326e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:03.687671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-81658958-c74c-48f2-91df-097b8db1326e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1273 microversion: 2.1 time: 0.268883 Jul 26 14:24:03.688461 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5bef8d5a-5d06-416f-9b1b-fb86bdec5eac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.390329 Jul 26 14:24:03.705765 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2028/3925] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:03 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:03.714287 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1898/3926] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:03 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:24:03.729952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2133410555", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "01fdab58-8c00-4787-8288-5206df456cd7"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:03.799191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9579cb63-3d73-459c-8a71-da2f511259f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:03.800468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9579cb63-3d73-459c-8a71-da2f511259f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:03.820555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] validate_networks() for [('01fdab58-8c00-4787-8288-5206df456cd7', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:24:03.832106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9579cb63-3d73-459c-8a71-da2f511259f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:03.833240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9579cb63-3d73-459c-8a71-da2f511259f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:03.834431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9579cb63-3d73-459c-8a71-da2f511259f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:03.835062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9579cb63-3d73-459c-8a71-da2f511259f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:04.419241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9579cb63-3d73-459c-8a71-da2f511259f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:04.433451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9579cb63-3d73-459c-8a71-da2f511259f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:04.438519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9579cb63-3d73-459c-8a71-da2f511259f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:04.440111 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9579cb63-3d73-459c-8a71-da2f511259f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.656080 Jul 26 14:24:04.458140 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2029/3927] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:03 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:04.742529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3b054735-3264-4628-818d-c907e11ebc09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:04.743683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3b054735-3264-4628-818d-c907e11ebc09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:04.757263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b054735-3264-4628-818d-c907e11ebc09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:04.758086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b054735-3264-4628-818d-c907e11ebc09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:04.759796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b054735-3264-4628-818d-c907e11ebc09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:04.760648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b054735-3264-4628-818d-c907e11ebc09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:05.417663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3b054735-3264-4628-818d-c907e11ebc09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:05.452060 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3b054735-3264-4628-818d-c907e11ebc09 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 0.718298 Jul 26 14:24:05.459585 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2030/3928] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:04 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:05.485722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2bbe31be-b87f-4349-b498-bb70154b62f6 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:05.489382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2bbe31be-b87f-4349-b498-bb70154b62f6 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:05.502329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bbe31be-b87f-4349-b498-bb70154b62f6 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:05.503069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bbe31be-b87f-4349-b498-bb70154b62f6 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:05.504217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bbe31be-b87f-4349-b498-bb70154b62f6 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:05.504847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bbe31be-b87f-4349-b498-bb70154b62f6 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:05.518953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:24:05.520187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:24:05.521307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:24:05.522125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:24:05.522868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:24:05.547922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:05.549196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:05.553319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:05.554210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:05.606824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:24:05.632634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for user b1e46ed350fa42669bba323ef30b982d and project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:24:05.663496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:24:05.667121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:24:05.744208 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-62bcce8f-7ac9-4926-a49a-6ea2e909c048 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.028138 Jul 26 14:24:05.753164 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1899/3929] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:24:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:24:05.759389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d26edbb-8a0c-409c-9c5b-2cf5b66e2d77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:05.760275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8d26edbb-8a0c-409c-9c5b-2cf5b66e2d77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:05.769460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d26edbb-8a0c-409c-9c5b-2cf5b66e2d77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:05.770379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d26edbb-8a0c-409c-9c5b-2cf5b66e2d77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:05.771568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d26edbb-8a0c-409c-9c5b-2cf5b66e2d77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:05.772306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d26edbb-8a0c-409c-9c5b-2cf5b66e2d77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:05.916529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2bbe31be-b87f-4349-b498-bb70154b62f6 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:05.938593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2bbe31be-b87f-4349-b498-bb70154b62f6 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:05.942040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2bbe31be-b87f-4349-b498-bb70154b62f6 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:05.951313 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2bbe31be-b87f-4349-b498-bb70154b62f6 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.489878 Jul 26 14:24:05.955380 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2031/3930] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:05 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:05.976739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b0bf4f13-bcde-49ee-989e-43d70cccea11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:05.978451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b0bf4f13-bcde-49ee-989e-43d70cccea11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:06.157908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b0bf4f13-bcde-49ee-989e-43d70cccea11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:06.190780 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b0bf4f13-bcde-49ee-989e-43d70cccea11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1215 microversion: 2.1 time: 0.232790 Jul 26 14:24:06.205446 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2032/3931] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:05 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:06.430067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d26edbb-8a0c-409c-9c5b-2cf5b66e2d77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:06.446332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d26edbb-8a0c-409c-9c5b-2cf5b66e2d77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:06.448903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d26edbb-8a0c-409c-9c5b-2cf5b66e2d77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:06.450326 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d26edbb-8a0c-409c-9c5b-2cf5b66e2d77 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.695729 Jul 26 14:24:06.473042 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1900/3932] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:05 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:06.501690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3683bc9b-fd43-4f43-bac1-aa7ede80f3a8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:06.504156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3683bc9b-fd43-4f43-bac1-aa7ede80f3a8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:06.534531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3683bc9b-fd43-4f43-bac1-aa7ede80f3a8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:06.549687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3683bc9b-fd43-4f43-bac1-aa7ede80f3a8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:06.551424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3683bc9b-fd43-4f43-bac1-aa7ede80f3a8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:06.552343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3683bc9b-fd43-4f43-bac1-aa7ede80f3a8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:06.987224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-80a148af-87e5-4339-9542-8f1bde56d0b3 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:06.988326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-80a148af-87e5-4339-9542-8f1bde56d0b3 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:07.007652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80a148af-87e5-4339-9542-8f1bde56d0b3 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:07.008679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80a148af-87e5-4339-9542-8f1bde56d0b3 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:07.011605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80a148af-87e5-4339-9542-8f1bde56d0b3 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:07.012586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80a148af-87e5-4339-9542-8f1bde56d0b3 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:07.434949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80a148af-87e5-4339-9542-8f1bde56d0b3 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:07.455170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80a148af-87e5-4339-9542-8f1bde56d0b3 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:07.475542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80a148af-87e5-4339-9542-8f1bde56d0b3 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:07.497560 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-80a148af-87e5-4339-9542-8f1bde56d0b3 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.521031 Jul 26 14:24:07.518522 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1901/3933] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:06 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:24:07.527161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a355b5ee-730a-4bbe-994e-8cdc41854821 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:07.535042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a355b5ee-730a-4bbe-994e-8cdc41854821 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:07.549374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a355b5ee-730a-4bbe-994e-8cdc41854821 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:07.550255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a355b5ee-730a-4bbe-994e-8cdc41854821 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:07.553239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a355b5ee-730a-4bbe-994e-8cdc41854821 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:07.556299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a355b5ee-730a-4bbe-994e-8cdc41854821 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:07.832596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a355b5ee-730a-4bbe-994e-8cdc41854821 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:07.882359 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a355b5ee-730a-4bbe-994e-8cdc41854821 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1275 microversion: 2.1 time: 0.360719 Jul 26 14:24:07.887161 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1902/3934] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:07 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1275 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:07.919615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f47ce8fd-805e-4aa9-8195-f20f8a3db1a4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:07.924871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f47ce8fd-805e-4aa9-8195-f20f8a3db1a4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:07.934756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f47ce8fd-805e-4aa9-8195-f20f8a3db1a4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:07.935255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f47ce8fd-805e-4aa9-8195-f20f8a3db1a4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:07.938773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f47ce8fd-805e-4aa9-8195-f20f8a3db1a4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:07.939574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f47ce8fd-805e-4aa9-8195-f20f8a3db1a4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:07.988725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:08.042881 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f47ce8fd-805e-4aa9-8195-f20f8a3db1a4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.127733 Jul 26 14:24:08.052712 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1903/3935] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:24:07 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:08.066205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3683bc9b-fd43-4f43-bac1-aa7ede80f3a8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:08.088744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a15c8e85-99c7-434c-ba17-cb3de98b8755 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:08.091157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a15c8e85-99c7-434c-ba17-cb3de98b8755 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:08.095545 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3683bc9b-fd43-4f43-bac1-aa7ede80f3a8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 1.606520 Jul 26 14:24:08.098332 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2033/3936] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:06 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:08.106729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a15c8e85-99c7-434c-ba17-cb3de98b8755 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:08.107385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a15c8e85-99c7-434c-ba17-cb3de98b8755 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:08.123262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a15c8e85-99c7-434c-ba17-cb3de98b8755 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:08.124505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a15c8e85-99c7-434c-ba17-cb3de98b8755 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:08.213544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4e9aceed-8b86-4752-9854-a7fb7849ee8e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:08.214102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4e9aceed-8b86-4752-9854-a7fb7849ee8e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:08.224758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e9aceed-8b86-4752-9854-a7fb7849ee8e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:08.225798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e9aceed-8b86-4752-9854-a7fb7849ee8e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:08.226814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e9aceed-8b86-4752-9854-a7fb7849ee8e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:08.227453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e9aceed-8b86-4752-9854-a7fb7849ee8e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:08.270288 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4e9aceed-8b86-4752-9854-a7fb7849ee8e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments/10d91645-35a7-4939-a224-8778ccc7e792" status: 200 len: 194 microversion: 2.1 time: 0.063222 Jul 26 14:24:08.277352 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2034/3937] 10.222.0.70 () {58 vars in 1413 bytes} [Tue Jul 26 14:24:08 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments/10d91645-35a7-4939-a224-8778ccc7e792 => generated 194 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:08.288615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-719499c1-e44d-47b2-969f-153248b62050 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:08.289611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-719499c1-e44d-47b2-969f-153248b62050 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:08.298541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-719499c1-e44d-47b2-969f-153248b62050 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:08.299459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-719499c1-e44d-47b2-969f-153248b62050 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:08.301221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-719499c1-e44d-47b2-969f-153248b62050 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:08.301995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-719499c1-e44d-47b2-969f-153248b62050 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:08.442097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:08.443810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-719499c1-e44d-47b2-969f-153248b62050 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lazy-loading 'services' on Instance uuid cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:08.610714 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-719499c1-e44d-47b2-969f-153248b62050 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments/10d91645-35a7-4939-a224-8778ccc7e792" status: 202 len: 0 microversion: 2.1 time: 0.331213 Jul 26 14:24:08.614999 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2035/3938] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:24:08 2022] DELETE /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments/10d91645-35a7-4939-a224-8778ccc7e792 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:24:08.630875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58cba073-14dd-4644-aabb-d1d02cb42d96 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:08.632137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-58cba073-14dd-4644-aabb-d1d02cb42d96 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:08.646990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58cba073-14dd-4644-aabb-d1d02cb42d96 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:08.648301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58cba073-14dd-4644-aabb-d1d02cb42d96 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:08.649737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58cba073-14dd-4644-aabb-d1d02cb42d96 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:08.650830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58cba073-14dd-4644-aabb-d1d02cb42d96 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:08.833261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a15c8e85-99c7-434c-ba17-cb3de98b8755 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:08.848090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a15c8e85-99c7-434c-ba17-cb3de98b8755 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:08.848090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a15c8e85-99c7-434c-ba17-cb3de98b8755 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:08.849899 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a15c8e85-99c7-434c-ba17-cb3de98b8755 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.793596 Jul 26 14:24:08.850545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1904/3939] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:08 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:08.913532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-58cba073-14dd-4644-aabb-d1d02cb42d96 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:08.920316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d50e190-906b-45ba-a2c5-2fd5f5a00301 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:08.921172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6d50e190-906b-45ba-a2c5-2fd5f5a00301 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:08.932360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-58cba073-14dd-4644-aabb-d1d02cb42d96 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:08.937637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d50e190-906b-45ba-a2c5-2fd5f5a00301 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:08.937982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-58cba073-14dd-4644-aabb-d1d02cb42d96 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:08.938181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d50e190-906b-45ba-a2c5-2fd5f5a00301 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:08.944311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d50e190-906b-45ba-a2c5-2fd5f5a00301 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:08.946844 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-58cba073-14dd-4644-aabb-d1d02cb42d96 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.328213 Jul 26 14:24:08.947068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d50e190-906b-45ba-a2c5-2fd5f5a00301 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:08.948020 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2036/3940] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:08 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:09.119396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d50e190-906b-45ba-a2c5-2fd5f5a00301 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:09.126393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-231462f4-9483-4d7d-b632-8f26f60a3618 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:09.127935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-231462f4-9483-4d7d-b632-8f26f60a3618 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:09.136324 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6d50e190-906b-45ba-a2c5-2fd5f5a00301 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1273 microversion: 2.1 time: 0.222882 Jul 26 14:24:09.137222 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1905/3941] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:08 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:24:09.156869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-231462f4-9483-4d7d-b632-8f26f60a3618 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:09.157354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-231462f4-9483-4d7d-b632-8f26f60a3618 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:09.158433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-231462f4-9483-4d7d-b632-8f26f60a3618 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:09.158637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-231462f4-9483-4d7d-b632-8f26f60a3618 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:09.876938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7672a856-eb1c-427b-b2c2-72f1b9707a89 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:09.877988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7672a856-eb1c-427b-b2c2-72f1b9707a89 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:09.898578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7672a856-eb1c-427b-b2c2-72f1b9707a89 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:09.899538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7672a856-eb1c-427b-b2c2-72f1b9707a89 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:09.901253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7672a856-eb1c-427b-b2c2-72f1b9707a89 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:09.902373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7672a856-eb1c-427b-b2c2-72f1b9707a89 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:10.284685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-231462f4-9483-4d7d-b632-8f26f60a3618 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:10.300245 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-231462f4-9483-4d7d-b632-8f26f60a3618 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 1.181199 Jul 26 14:24:10.324178 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2037/3942] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:09 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:10.372400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7672a856-eb1c-427b-b2c2-72f1b9707a89 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:10.391535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7672a856-eb1c-427b-b2c2-72f1b9707a89 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:10.408861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7672a856-eb1c-427b-b2c2-72f1b9707a89 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:10.410305 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7672a856-eb1c-427b-b2c2-72f1b9707a89 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.537398 Jul 26 14:24:10.411427 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1906/3943] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:09 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:10.428666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d25d4fa3-2680-4550-88b6-52565d175fac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:10.430161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d25d4fa3-2680-4550-88b6-52565d175fac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:10.453486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d25d4fa3-2680-4550-88b6-52565d175fac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:10.454205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d25d4fa3-2680-4550-88b6-52565d175fac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:10.457803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d25d4fa3-2680-4550-88b6-52565d175fac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:10.458603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d25d4fa3-2680-4550-88b6-52565d175fac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:10.549991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:10.705695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d25d4fa3-2680-4550-88b6-52565d175fac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:10.719708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d25d4fa3-2680-4550-88b6-52565d175fac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:10.729746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d25d4fa3-2680-4550-88b6-52565d175fac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:10.746600 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d25d4fa3-2680-4550-88b6-52565d175fac tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.333460 Jul 26 14:24:10.747488 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1907/3944] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:10 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:10.759021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-678d0490-78d3-4d54-af4d-42a6484feeca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:10.763191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-678d0490-78d3-4d54-af4d-42a6484feeca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:10.775370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-678d0490-78d3-4d54-af4d-42a6484feeca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:10.775834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-678d0490-78d3-4d54-af4d-42a6484feeca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:10.781583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-678d0490-78d3-4d54-af4d-42a6484feeca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:10.781963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-678d0490-78d3-4d54-af4d-42a6484feeca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:10.988379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-130e4b32-02f5-4e64-abf8-725b89f94e81 req-91c3980a-ffbf-44c3-81f9-504772a5122d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ae26a2-843c-41a1-81e3-6a3f68715198", "tag": "f78e74aa-99f8-48f8-9979-6215ff449103"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:11.008345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-130e4b32-02f5-4e64-abf8-725b89f94e81 req-91c3980a-ffbf-44c3-81f9-504772a5122d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:11.010086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-130e4b32-02f5-4e64-abf8-725b89f94e81 req-91c3980a-ffbf-44c3-81f9-504772a5122d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:11.047327 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-130e4b32-02f5-4e64-abf8-725b89f94e81 req-91c3980a-ffbf-44c3-81f9-504772a5122d service nova] Creating event network-changed:f78e74aa-99f8-48f8-9979-6215ff449103 for instance 71ae26a2-843c-41a1-81e3-6a3f68715198 on n-h2-833090-9 Jul 26 14:24:11.056966 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-130e4b32-02f5-4e64-abf8-725b89f94e81 req-91c3980a-ffbf-44c3-81f9-504772a5122d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.728695 Jul 26 14:24:11.062733 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2038/3945] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:11.331995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-388a46a2-cf90-4c7b-8d0a-aed044588ff5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:11.334309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-388a46a2-cf90-4c7b-8d0a-aed044588ff5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:11.345455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-388a46a2-cf90-4c7b-8d0a-aed044588ff5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:11.346329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-388a46a2-cf90-4c7b-8d0a-aed044588ff5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:11.347564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-388a46a2-cf90-4c7b-8d0a-aed044588ff5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:11.348268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-388a46a2-cf90-4c7b-8d0a-aed044588ff5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:11.593798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-678d0490-78d3-4d54-af4d-42a6484feeca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:11.610653 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-678d0490-78d3-4d54-af4d-42a6484feeca tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 0.861769 Jul 26 14:24:11.611892 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1908/3946] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:10 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:11.627571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-29c117d6-2ede-440e-9221-2f719042ca59 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:11.628576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-29c117d6-2ede-440e-9221-2f719042ca59 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:11.646233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29c117d6-2ede-440e-9221-2f719042ca59 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:11.647017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29c117d6-2ede-440e-9221-2f719042ca59 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:11.648561 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29c117d6-2ede-440e-9221-2f719042ca59 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:11.649384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29c117d6-2ede-440e-9221-2f719042ca59 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:12.574725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-29c117d6-2ede-440e-9221-2f719042ca59 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:12.586211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-29c117d6-2ede-440e-9221-2f719042ca59 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:12.592798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-29c117d6-2ede-440e-9221-2f719042ca59 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:12.594925 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-29c117d6-2ede-440e-9221-2f719042ca59 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.981730 Jul 26 14:24:12.596773 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1909/3947] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:11 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:12.604373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-388a46a2-cf90-4c7b-8d0a-aed044588ff5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:12.626209 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-388a46a2-cf90-4c7b-8d0a-aed044588ff5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 1.301060 Jul 26 14:24:12.627274 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2039/3948] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:11 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:12.632735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c8dbda65-1641-4020-beae-ffbc568dce91 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:12.636187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c8dbda65-1641-4020-beae-ffbc568dce91 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:12.642080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b7945c37-64b9-4d00-8c3d-1cc201e4db7a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:12.643117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b7945c37-64b9-4d00-8c3d-1cc201e4db7a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:12.646496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8dbda65-1641-4020-beae-ffbc568dce91 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:12.647297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8dbda65-1641-4020-beae-ffbc568dce91 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:12.648326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8dbda65-1641-4020-beae-ffbc568dce91 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:12.648895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8dbda65-1641-4020-beae-ffbc568dce91 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:12.664536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b7945c37-64b9-4d00-8c3d-1cc201e4db7a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:12.667252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b7945c37-64b9-4d00-8c3d-1cc201e4db7a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:12.668204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b7945c37-64b9-4d00-8c3d-1cc201e4db7a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:12.668670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b7945c37-64b9-4d00-8c3d-1cc201e4db7a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:12.944631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c8dbda65-1641-4020-beae-ffbc568dce91 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:12.987354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c8dbda65-1641-4020-beae-ffbc568dce91 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:12.990456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c8dbda65-1641-4020-beae-ffbc568dce91 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:13.006886 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c8dbda65-1641-4020-beae-ffbc568dce91 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.407782 Jul 26 14:24:13.008594 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1910/3949] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:12 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:13.198232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b7945c37-64b9-4d00-8c3d-1cc201e4db7a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:13.209860 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b7945c37-64b9-4d00-8c3d-1cc201e4db7a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 0.577183 Jul 26 14:24:13.221283 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2040/3950] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:12 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:24:13.635458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ac14787c-9273-48ef-b1d0-4e54ccbad0cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:13.636523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ac14787c-9273-48ef-b1d0-4e54ccbad0cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:13.650729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-35270e17-98cd-40aa-9365-1cfc4aae3960 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:13.651324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac14787c-9273-48ef-b1d0-4e54ccbad0cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:13.651475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-35270e17-98cd-40aa-9365-1cfc4aae3960 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:13.652169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac14787c-9273-48ef-b1d0-4e54ccbad0cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:13.653172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac14787c-9273-48ef-b1d0-4e54ccbad0cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:13.653692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac14787c-9273-48ef-b1d0-4e54ccbad0cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:13.674621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35270e17-98cd-40aa-9365-1cfc4aae3960 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:13.675485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35270e17-98cd-40aa-9365-1cfc4aae3960 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:13.682812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35270e17-98cd-40aa-9365-1cfc4aae3960 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:13.683309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35270e17-98cd-40aa-9365-1cfc4aae3960 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:14.324975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35270e17-98cd-40aa-9365-1cfc4aae3960 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:14.337929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ac14787c-9273-48ef-b1d0-4e54ccbad0cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:14.346507 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-35270e17-98cd-40aa-9365-1cfc4aae3960 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 0.699587 Jul 26 14:24:14.347477 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2041/3951] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:13 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:14.360688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-49716f03-1698-42d2-a441-c0478f394e86 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:14.361453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-49716f03-1698-42d2-a441-c0478f394e86 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:14.364292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ac14787c-9273-48ef-b1d0-4e54ccbad0cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:14.366517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ac14787c-9273-48ef-b1d0-4e54ccbad0cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:14.369689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49716f03-1698-42d2-a441-c0478f394e86 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:14.370150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49716f03-1698-42d2-a441-c0478f394e86 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:14.371378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49716f03-1698-42d2-a441-c0478f394e86 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:14.372096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49716f03-1698-42d2-a441-c0478f394e86 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:14.373978 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ac14787c-9273-48ef-b1d0-4e54ccbad0cf tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.745043 Jul 26 14:24:14.393069 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1911/3952] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:13 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:14.413885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f19695d4-342a-43f7-be87-041b002e3576 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:14.414870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f19695d4-342a-43f7-be87-041b002e3576 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:14.437740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f19695d4-342a-43f7-be87-041b002e3576 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:14.438722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f19695d4-342a-43f7-be87-041b002e3576 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:14.441363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f19695d4-342a-43f7-be87-041b002e3576 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:14.444630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f19695d4-342a-43f7-be87-041b002e3576 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:14.711034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-49716f03-1698-42d2-a441-c0478f394e86 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:14.726447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-49716f03-1698-42d2-a441-c0478f394e86 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:14.729014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-49716f03-1698-42d2-a441-c0478f394e86 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:14.740833 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-49716f03-1698-42d2-a441-c0478f394e86 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1446 microversion: 2.75 time: 0.392053 Jul 26 14:24:14.742054 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2042/3953] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:14 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1446 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:15.070635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-975a4197-d078-4848-bb22-2c5c1b01dfd6 req-6f6941dc-eda9-449c-80a5-fba1f65f17cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a3e2faf-7a49-47df-886a-ef79f5fbe3b8", "tag": "85c04f3c-08b1-4c72-b7f3-94af7af851f7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:15.095370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f19695d4-342a-43f7-be87-041b002e3576 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:15.111044 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f19695d4-342a-43f7-be87-041b002e3576 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 0.715351 Jul 26 14:24:15.124604 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1912/3954] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:14 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:15.144937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-975a4197-d078-4848-bb22-2c5c1b01dfd6 req-6f6941dc-eda9-449c-80a5-fba1f65f17cc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:15.147773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-975a4197-d078-4848-bb22-2c5c1b01dfd6 req-6f6941dc-eda9-449c-80a5-fba1f65f17cc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:15.204800 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-975a4197-d078-4848-bb22-2c5c1b01dfd6 req-6f6941dc-eda9-449c-80a5-fba1f65f17cc service nova] Creating event network-changed:85c04f3c-08b1-4c72-b7f3-94af7af851f7 for instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 on n-h2-833090-9 Jul 26 14:24:15.221067 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-975a4197-d078-4848-bb22-2c5c1b01dfd6 req-6f6941dc-eda9-449c-80a5-fba1f65f17cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160852 Jul 26 14:24:15.222916 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2043/3955] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:15.373033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1e01ae37-1c9d-480f-93a5-6176f5c5b52f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:15.379670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1e01ae37-1c9d-480f-93a5-6176f5c5b52f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:15.401504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eaf27914-46b9-4449-b4b3-edb85f077fae tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:15.403900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eaf27914-46b9-4449-b4b3-edb85f077fae tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:15.414441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e01ae37-1c9d-480f-93a5-6176f5c5b52f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:15.415025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e01ae37-1c9d-480f-93a5-6176f5c5b52f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:15.415996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e01ae37-1c9d-480f-93a5-6176f5c5b52f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:15.416569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e01ae37-1c9d-480f-93a5-6176f5c5b52f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:15.423073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eaf27914-46b9-4449-b4b3-edb85f077fae tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:15.423921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eaf27914-46b9-4449-b4b3-edb85f077fae tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:15.425072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eaf27914-46b9-4449-b4b3-edb85f077fae tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:15.425731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eaf27914-46b9-4449-b4b3-edb85f077fae tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:15.589291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:15.644978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:16.031707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eaf27914-46b9-4449-b4b3-edb85f077fae tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:16.043092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eaf27914-46b9-4449-b4b3-edb85f077fae tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:16.054148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eaf27914-46b9-4449-b4b3-edb85f077fae tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:16.056624 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eaf27914-46b9-4449-b4b3-edb85f077fae tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1743 microversion: 2.20 time: 0.661330 Jul 26 14:24:16.062624 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2044/3956] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:15 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1743 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:24:16.080133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d4893f8c-bbbd-4bd3-b371-3713cbba1d68 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:16.081949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d4893f8c-bbbd-4bd3-b371-3713cbba1d68 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:16.106268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4893f8c-bbbd-4bd3-b371-3713cbba1d68 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:16.106940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4893f8c-bbbd-4bd3-b371-3713cbba1d68 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:16.108115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4893f8c-bbbd-4bd3-b371-3713cbba1d68 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:16.111259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4893f8c-bbbd-4bd3-b371-3713cbba1d68 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:16.189541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=10 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:16.266837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1e01ae37-1c9d-480f-93a5-6176f5c5b52f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:16.301558 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1e01ae37-1c9d-480f-93a5-6176f5c5b52f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 0.936138 Jul 26 14:24:16.302298 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1913/3957] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:15 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:16.323911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7cb9c35-7317-43cc-abc7-ef3a2f9c7171 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:16.330734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c7cb9c35-7317-43cc-abc7-ef3a2f9c7171 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:16.351174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7cb9c35-7317-43cc-abc7-ef3a2f9c7171 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:16.353934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7cb9c35-7317-43cc-abc7-ef3a2f9c7171 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:16.356605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7cb9c35-7317-43cc-abc7-ef3a2f9c7171 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:16.360414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7cb9c35-7317-43cc-abc7-ef3a2f9c7171 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:16.437012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d4893f8c-bbbd-4bd3-b371-3713cbba1d68 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:16.451322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d4893f8c-bbbd-4bd3-b371-3713cbba1d68 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:16.457945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d4893f8c-bbbd-4bd3-b371-3713cbba1d68 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:16.476520 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d4893f8c-bbbd-4bd3-b371-3713cbba1d68 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1452 microversion: 2.75 time: 0.406394 Jul 26 14:24:16.478569 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2045/3958] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:16 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1452 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:16.836297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c7cb9c35-7317-43cc-abc7-ef3a2f9c7171 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:16.860277 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c7cb9c35-7317-43cc-abc7-ef3a2f9c7171 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 0.551565 Jul 26 14:24:16.861462 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1914/3959] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:16 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:17.087213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cab0cbc8-c004-4c33-ae29-7a148e456d01 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:17.089212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cab0cbc8-c004-4c33-ae29-7a148e456d01 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:17.107078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cab0cbc8-c004-4c33-ae29-7a148e456d01 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:17.108568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cab0cbc8-c004-4c33-ae29-7a148e456d01 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:17.109437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cab0cbc8-c004-4c33-ae29-7a148e456d01 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:17.109889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cab0cbc8-c004-4c33-ae29-7a148e456d01 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:17.337416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ebd13ca9-1489-46a5-bde1-249933ea594e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:17.343387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ebd13ca9-1489-46a5-bde1-249933ea594e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:17.353418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:17.368047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd13ca9-1489-46a5-bde1-249933ea594e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:17.369144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd13ca9-1489-46a5-bde1-249933ea594e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:17.371542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd13ca9-1489-46a5-bde1-249933ea594e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:17.373529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd13ca9-1489-46a5-bde1-249933ea594e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:17.861728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cab0cbc8-c004-4c33-ae29-7a148e456d01 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:17.872963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cab0cbc8-c004-4c33-ae29-7a148e456d01 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:17.884528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cab0cbc8-c004-4c33-ae29-7a148e456d01 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:17.887035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ebd13ca9-1489-46a5-bde1-249933ea594e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:17.888773 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cab0cbc8-c004-4c33-ae29-7a148e456d01 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1743 microversion: 2.20 time: 0.805242 Jul 26 14:24:17.893574 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2046/3960] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:17 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1743 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:17.899374 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ebd13ca9-1489-46a5-bde1-249933ea594e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 0.574002 Jul 26 14:24:17.903352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-12af6770-496c-44d6-ab1f-2b6ed855e3fb tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:17.906466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-12af6770-496c-44d6-ab1f-2b6ed855e3fb tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:17.925399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12af6770-496c-44d6-ab1f-2b6ed855e3fb tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:17.925943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12af6770-496c-44d6-ab1f-2b6ed855e3fb tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:17.926775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12af6770-496c-44d6-ab1f-2b6ed855e3fb tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:17.927234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12af6770-496c-44d6-ab1f-2b6ed855e3fb tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:17.929745 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1915/3961] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:17 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:17.948461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0be8c610-8c8e-4dbe-bd28-0add972f29bd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:17.949307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0be8c610-8c8e-4dbe-bd28-0add972f29bd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:17.969815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0be8c610-8c8e-4dbe-bd28-0add972f29bd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:17.970934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0be8c610-8c8e-4dbe-bd28-0add972f29bd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:17.972983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0be8c610-8c8e-4dbe-bd28-0add972f29bd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:17.974520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0be8c610-8c8e-4dbe-bd28-0add972f29bd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:18.090570 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0be8c610-8c8e-4dbe-bd28-0add972f29bd tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments/51196a2f-2fbf-4eaa-a5cb-dc57212d170d" status: 200 len: 194 microversion: 2.1 time: 0.154483 Jul 26 14:24:18.095073 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1916/3962] 10.222.0.70 () {58 vars in 1413 bytes} [Tue Jul 26 14:24:17 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments/51196a2f-2fbf-4eaa-a5cb-dc57212d170d => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:18.106202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d2f3cd3d-142a-4806-8cce-598e700916e6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:18.112701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-12af6770-496c-44d6-ab1f-2b6ed855e3fb tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:18.122988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d2f3cd3d-142a-4806-8cce-598e700916e6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:18.128814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-12af6770-496c-44d6-ab1f-2b6ed855e3fb tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:18.130818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-12af6770-496c-44d6-ab1f-2b6ed855e3fb tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:18.138353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2f3cd3d-142a-4806-8cce-598e700916e6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:18.138353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2f3cd3d-142a-4806-8cce-598e700916e6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:18.139771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2f3cd3d-142a-4806-8cce-598e700916e6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:18.143054 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-12af6770-496c-44d6-ab1f-2b6ed855e3fb tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1437 microversion: 2.75 time: 0.248029 Jul 26 14:24:18.144304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2f3cd3d-142a-4806-8cce-598e700916e6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:18.148098 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2047/3963] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:17 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1437 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:18.162817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2bcea749-cb75-4444-bb54-4f976793717f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:18.163485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2bcea749-cb75-4444-bb54-4f976793717f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:18.193199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bcea749-cb75-4444-bb54-4f976793717f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:18.194057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bcea749-cb75-4444-bb54-4f976793717f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:18.195452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bcea749-cb75-4444-bb54-4f976793717f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:18.208482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2bcea749-cb75-4444-bb54-4f976793717f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:18.471212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-2bcea749-cb75-4444-bb54-4f976793717f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lazy-loading 'services' on Instance uuid cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:18.586431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d2f3cd3d-142a-4806-8cce-598e700916e6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:18.608702 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d2f3cd3d-142a-4806-8cce-598e700916e6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 0.503198 Jul 26 14:24:18.609655 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1917/3964] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:18 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:18.733811 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2bcea749-cb75-4444-bb54-4f976793717f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments/51196a2f-2fbf-4eaa-a5cb-dc57212d170d" status: 202 len: 0 microversion: 2.1 time: 0.581158 Jul 26 14:24:18.734567 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2048/3965] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:24:18 2022] DELETE /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments/51196a2f-2fbf-4eaa-a5cb-dc57212d170d => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:24:18.940036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d1eacbb-1195-4907-826e-b5220ed05d43 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:18.946822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d1eacbb-1195-4907-826e-b5220ed05d43 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:19.002522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d1eacbb-1195-4907-826e-b5220ed05d43 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:19.012833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d1eacbb-1195-4907-826e-b5220ed05d43 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:19.014897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d1eacbb-1195-4907-826e-b5220ed05d43 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:19.032187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d1eacbb-1195-4907-826e-b5220ed05d43 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:19.394372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:19.399873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:19.446032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:19.446923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:19.448163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:19.448937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:19.696777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:24:19.700768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:24:19.703111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:24:19.703726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:24:19.704439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:24:19.878358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:19.920926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:19.938923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:19.941184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:19.943486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:19.944231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:20.562932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:20.624078 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3b121255-c363-4eca-bdc2-af0a14590c7f tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b/action" status: 202 len: 1940 microversion: 2.75 time: 2.009835 Jul 26 14:24:20.625802 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1918/3966] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:24:18 2022] POST /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b/action => generated 1940 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 14:24:20.636895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44d3d5a8-4adf-41df-8e25-c27094fad953 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:20.640818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44d3d5a8-4adf-41df-8e25-c27094fad953 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:20.663703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44d3d5a8-4adf-41df-8e25-c27094fad953 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:20.664996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44d3d5a8-4adf-41df-8e25-c27094fad953 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:20.667614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44d3d5a8-4adf-41df-8e25-c27094fad953 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:20.668333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44d3d5a8-4adf-41df-8e25-c27094fad953 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:20.833481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d1eacbb-1195-4907-826e-b5220ed05d43 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:20.857092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d1eacbb-1195-4907-826e-b5220ed05d43 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:20.884313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d1eacbb-1195-4907-826e-b5220ed05d43 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:20.890313 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d1eacbb-1195-4907-826e-b5220ed05d43 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 1.966430 Jul 26 14:24:20.899330 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2049/3967] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:18 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:24:20.925514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0aa77b8b-3c87-4d4a-be16-b7799f368b0a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:20.928822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0aa77b8b-3c87-4d4a-be16-b7799f368b0a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:20.952514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0aa77b8b-3c87-4d4a-be16-b7799f368b0a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:20.953102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0aa77b8b-3c87-4d4a-be16-b7799f368b0a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:20.953966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0aa77b8b-3c87-4d4a-be16-b7799f368b0a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:20.959728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0aa77b8b-3c87-4d4a-be16-b7799f368b0a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:23.008074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0aa77b8b-3c87-4d4a-be16-b7799f368b0a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:23.023855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-44d3d5a8-4adf-41df-8e25-c27094fad953 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:23.028175 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0aa77b8b-3c87-4d4a-be16-b7799f368b0a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 2.122221 Jul 26 14:24:23.036630 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-44d3d5a8-4adf-41df-8e25-c27094fad953 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 2.406327 Jul 26 14:24:23.039333 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1919/3968] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:20 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 2413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:23.047202 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2050/3969] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:20 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:23.052670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ddcf5b35-aed3-4ead-bdfc-ef2443f18bff tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:23.058545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ddcf5b35-aed3-4ead-bdfc-ef2443f18bff tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:23.058880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b1bd1dc2-af6d-42c6-becc-b6095376d630 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:23.064975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b1bd1dc2-af6d-42c6-becc-b6095376d630 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:23.074904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddcf5b35-aed3-4ead-bdfc-ef2443f18bff tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:23.075683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddcf5b35-aed3-4ead-bdfc-ef2443f18bff tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:23.077349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddcf5b35-aed3-4ead-bdfc-ef2443f18bff tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:23.080285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddcf5b35-aed3-4ead-bdfc-ef2443f18bff tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:23.088597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1bd1dc2-af6d-42c6-becc-b6095376d630 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:23.089119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1bd1dc2-af6d-42c6-becc-b6095376d630 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:23.090589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1bd1dc2-af6d-42c6-becc-b6095376d630 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:23.091043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1bd1dc2-af6d-42c6-becc-b6095376d630 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:23.412913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-ddcf5b35-aed3-4ead-bdfc-ef2443f18bff tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:23.478596 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ddcf5b35-aed3-4ead-bdfc-ef2443f18bff tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1927 microversion: 2.75 time: 0.436364 Jul 26 14:24:23.481996 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1920/3970] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:23 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1927 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:24.056317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-388f9db9-e7e8-44b6-9a83-a812e967f6d2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:24.059971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-388f9db9-e7e8-44b6-9a83-a812e967f6d2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:24.073359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1bd1dc2-af6d-42c6-becc-b6095376d630 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:24.101283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-388f9db9-e7e8-44b6-9a83-a812e967f6d2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:24.103794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-388f9db9-e7e8-44b6-9a83-a812e967f6d2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:24.104719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-388f9db9-e7e8-44b6-9a83-a812e967f6d2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:24.110241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-388f9db9-e7e8-44b6-9a83-a812e967f6d2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:24.117499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1bd1dc2-af6d-42c6-becc-b6095376d630 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:24.134473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1bd1dc2-af6d-42c6-becc-b6095376d630 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:24.145785 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b1bd1dc2-af6d-42c6-becc-b6095376d630 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 1.094163 Jul 26 14:24:24.147795 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2051/3971] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:23 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:24.177261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9f17954d-0c67-445d-b6fc-1fe09a0f4e5e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:24.178794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9f17954d-0c67-445d-b6fc-1fe09a0f4e5e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:24.212125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f17954d-0c67-445d-b6fc-1fe09a0f4e5e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:24.219238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f17954d-0c67-445d-b6fc-1fe09a0f4e5e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:24.220678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f17954d-0c67-445d-b6fc-1fe09a0f4e5e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:24.222446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f17954d-0c67-445d-b6fc-1fe09a0f4e5e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:24.275243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:25.095882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-388f9db9-e7e8-44b6-9a83-a812e967f6d2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:25.121985 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-388f9db9-e7e8-44b6-9a83-a812e967f6d2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 1.070760 Jul 26 14:24:25.137645 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1921/3972] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:24 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:25.150969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-920001ed-9236-49b6-b7e5-5cc27dd72941 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:25.152499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-920001ed-9236-49b6-b7e5-5cc27dd72941 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:25.183116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-920001ed-9236-49b6-b7e5-5cc27dd72941 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:25.184504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-920001ed-9236-49b6-b7e5-5cc27dd72941 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:25.191317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-920001ed-9236-49b6-b7e5-5cc27dd72941 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:25.192551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-920001ed-9236-49b6-b7e5-5cc27dd72941 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:25.646699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9f17954d-0c67-445d-b6fc-1fe09a0f4e5e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:25.681309 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9f17954d-0c67-445d-b6fc-1fe09a0f4e5e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 1.530533 Jul 26 14:24:25.693673 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2052/3973] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:24 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:25.715741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a50ea51c-f551-4a7d-8ddf-9feced4614f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:25.718580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-920001ed-9236-49b6-b7e5-5cc27dd72941 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:25.720528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a50ea51c-f551-4a7d-8ddf-9feced4614f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:25.741722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a50ea51c-f551-4a7d-8ddf-9feced4614f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:25.748471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a50ea51c-f551-4a7d-8ddf-9feced4614f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:25.750610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a50ea51c-f551-4a7d-8ddf-9feced4614f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:25.751282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a50ea51c-f551-4a7d-8ddf-9feced4614f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:25.816186 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-920001ed-9236-49b6-b7e5-5cc27dd72941 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1927 microversion: 2.75 time: 0.684851 Jul 26 14:24:25.832006 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1922/3974] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:25 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1927 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:26.113915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e9a77584-643e-402b-aeaa-a685117945c2 req-30b94559-a9ea-4063-b51d-063896211585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7576357-b5e0-45fb-9641-d397a6b3faf2", "name": "network-vif-plugged", "status": "completed", "tag": "f88eaeb3-e484-4f96-b4ba-99b8b947950a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:26.166174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e9a77584-643e-402b-aeaa-a685117945c2 req-30b94559-a9ea-4063-b51d-063896211585 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:26.176485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e9a77584-643e-402b-aeaa-a685117945c2 req-30b94559-a9ea-4063-b51d-063896211585 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:26.205415 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e9a77584-643e-402b-aeaa-a685117945c2 req-30b94559-a9ea-4063-b51d-063896211585 service nova] Creating event network-vif-plugged:f88eaeb3-e484-4f96-b4ba-99b8b947950a for instance d7576357-b5e0-45fb-9641-d397a6b3faf2 on n-h2-833090-9 Jul 26 14:24:26.226765 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e9a77584-643e-402b-aeaa-a685117945c2 req-30b94559-a9ea-4063-b51d-063896211585 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114534 Jul 26 14:24:26.234241 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1923/3975] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:26.247653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ac9cb87e-f9d4-41d6-9858-3082ff0d05d1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:26.249502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ac9cb87e-f9d4-41d6-9858-3082ff0d05d1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:26.266154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac9cb87e-f9d4-41d6-9858-3082ff0d05d1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:26.267226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac9cb87e-f9d4-41d6-9858-3082ff0d05d1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:26.268596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac9cb87e-f9d4-41d6-9858-3082ff0d05d1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:26.269601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac9cb87e-f9d4-41d6-9858-3082ff0d05d1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:26.893378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a50ea51c-f551-4a7d-8ddf-9feced4614f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:26.923933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a50ea51c-f551-4a7d-8ddf-9feced4614f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:26.941904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a50ea51c-f551-4a7d-8ddf-9feced4614f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:26.945962 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a50ea51c-f551-4a7d-8ddf-9feced4614f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 1.249754 Jul 26 14:24:26.946573 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2053/3976] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:25 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:26.971773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af286da7-6454-4915-9939-2d2beabc5d9e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:26.977966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af286da7-6454-4915-9939-2d2beabc5d9e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:26.987619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:27.007253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af286da7-6454-4915-9939-2d2beabc5d9e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:27.007794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af286da7-6454-4915-9939-2d2beabc5d9e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:27.022879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af286da7-6454-4915-9939-2d2beabc5d9e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:27.025748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af286da7-6454-4915-9939-2d2beabc5d9e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:27.394772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ac9cb87e-f9d4-41d6-9858-3082ff0d05d1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:27.440982 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ac9cb87e-f9d4-41d6-9858-3082ff0d05d1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 1.204994 Jul 26 14:24:27.444260 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1924/3977] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:26 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:27.458489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a3713621-c59b-4702-bade-9481983af416 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:27.459435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a3713621-c59b-4702-bade-9481983af416 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:27.477815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3713621-c59b-4702-bade-9481983af416 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:27.478625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3713621-c59b-4702-bade-9481983af416 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:27.485760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3713621-c59b-4702-bade-9481983af416 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:27.486854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a3713621-c59b-4702-bade-9481983af416 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:27.834747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af286da7-6454-4915-9939-2d2beabc5d9e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:27.846201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-a3713621-c59b-4702-bade-9481983af416 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:27.854982 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af286da7-6454-4915-9939-2d2beabc5d9e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 0.902786 Jul 26 14:24:27.855787 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2054/3978] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:26 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:27.920437 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a3713621-c59b-4702-bade-9481983af416 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1927 microversion: 2.75 time: 0.474142 Jul 26 14:24:27.924108 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1925/3979] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:27 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1927 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:27.976014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-56b2ebb0-0ef6-405c-801b-696d4b0e14bb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:27.977080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-56b2ebb0-0ef6-405c-801b-696d4b0e14bb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:27.992128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-56b2ebb0-0ef6-405c-801b-696d4b0e14bb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:27.995867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-56b2ebb0-0ef6-405c-801b-696d4b0e14bb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:28.006027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-56b2ebb0-0ef6-405c-801b-696d4b0e14bb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:28.006493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-56b2ebb0-0ef6-405c-801b-696d4b0e14bb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:28.337568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1718510703", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "1e1c7e35-16bc-4bef-80ea-3c836e95638f"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:28.508604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] validate_networks() for [('1e1c7e35-16bc-4bef-80ea-3c836e95638f', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:24:28.550527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-56b2ebb0-0ef6-405c-801b-696d4b0e14bb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:28.563991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-56b2ebb0-0ef6-405c-801b-696d4b0e14bb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:28.578298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-56b2ebb0-0ef6-405c-801b-696d4b0e14bb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:28.585328 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-56b2ebb0-0ef6-405c-801b-696d4b0e14bb tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 0.614051 Jul 26 14:24:28.585936 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1926/3980] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:27 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:24:28.602455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b6feefff-eacc-4896-945a-7d044df90382 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:28.603398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b6feefff-eacc-4896-945a-7d044df90382 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:28.648684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6feefff-eacc-4896-945a-7d044df90382 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:28.649893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6feefff-eacc-4896-945a-7d044df90382 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:28.655429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6feefff-eacc-4896-945a-7d044df90382 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:28.656940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6feefff-eacc-4896-945a-7d044df90382 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:29.468012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b6feefff-eacc-4896-945a-7d044df90382 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:29.489559 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b6feefff-eacc-4896-945a-7d044df90382 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 0.901392 Jul 26 14:24:29.506792 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1927/3981] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:28 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:29.556784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e1fab8da-fdbc-45a1-8503-fb4d6bd371bc req-257283bd-21a2-445a-a094-6efcd7748167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ae26a2-843c-41a1-81e3-6a3f68715198", "name": "network-vif-plugged", "status": "completed", "tag": "f78e74aa-99f8-48f8-9979-6215ff449103"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:29.607222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e1fab8da-fdbc-45a1-8503-fb4d6bd371bc req-257283bd-21a2-445a-a094-6efcd7748167 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:29.609645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e1fab8da-fdbc-45a1-8503-fb4d6bd371bc req-257283bd-21a2-445a-a094-6efcd7748167 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:29.637436 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e1fab8da-fdbc-45a1-8503-fb4d6bd371bc req-257283bd-21a2-445a-a094-6efcd7748167 service nova] Creating event network-vif-plugged:f78e74aa-99f8-48f8-9979-6215ff449103 for instance 71ae26a2-843c-41a1-81e3-6a3f68715198 on n-h2-833090-9 Jul 26 14:24:29.651541 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e1fab8da-fdbc-45a1-8503-fb4d6bd371bc req-257283bd-21a2-445a-a094-6efcd7748167 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142942 Jul 26 14:24:29.659465 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1928/3982] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:29.687847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-465e58ea-b28f-4487-a6d0-abb3c5046d33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:29.710971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-465e58ea-b28f-4487-a6d0-abb3c5046d33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:29.754457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-465e58ea-b28f-4487-a6d0-abb3c5046d33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:29.754911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-465e58ea-b28f-4487-a6d0-abb3c5046d33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:29.763205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-465e58ea-b28f-4487-a6d0-abb3c5046d33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:29.769234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-465e58ea-b28f-4487-a6d0-abb3c5046d33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:30.538420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:24:30.547234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:24:30.548468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:24:30.553086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:24:30.553968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:24:30.616526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:30.625023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:30.626614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:30.634519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:30.734974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Getting quotas for project e7f0a862c2bf490886e8a6bb2411a29e. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:24:30.753304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Getting quotas for user 9fe21380ccc24827b47f5d5c199fc114 and project e7f0a862c2bf490886e8a6bb2411a29e. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:24:30.791453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Going to run 2 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:24:30.797944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 9bbfc464-3e82-4491-9b12-5d5043d07faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:24:30.910316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-465e58ea-b28f-4487-a6d0-abb3c5046d33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:30.929486 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-465e58ea-b28f-4487-a6d0-abb3c5046d33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1315 microversion: 2.1 time: 1.266744 Jul 26 14:24:30.933235 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1929/3983] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:29 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1315 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:30.948988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1c71bb1a-cec0-47f9-b669-577f0e0e039a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:30.958640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1c71bb1a-cec0-47f9-b669-577f0e0e039a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:30.981264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=9bbfc464-3e82-4491-9b12-5d5043d07faf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:24:30.996963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1c71bb1a-cec0-47f9-b669-577f0e0e039a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:31.001018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1c71bb1a-cec0-47f9-b669-577f0e0e039a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:31.003507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1c71bb1a-cec0-47f9-b669-577f0e0e039a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:31.007196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1c71bb1a-cec0-47f9-b669-577f0e0e039a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:31.258366 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c0c59771-e87d-4b95-bb3c-745db78c6c7c tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.400590 Jul 26 14:24:31.259083 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2055/3984] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:24:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:24:31.317548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-75f7ff4c-cb9f-483f-99a0-6f388d20ca80 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:31.329417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-75f7ff4c-cb9f-483f-99a0-6f388d20ca80 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:31.362280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-1c71bb1a-cec0-47f9-b669-577f0e0e039a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:31.367777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75f7ff4c-cb9f-483f-99a0-6f388d20ca80 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:31.368709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75f7ff4c-cb9f-483f-99a0-6f388d20ca80 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:31.378949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75f7ff4c-cb9f-483f-99a0-6f388d20ca80 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:31.380601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75f7ff4c-cb9f-483f-99a0-6f388d20ca80 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:31.406976 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1c71bb1a-cec0-47f9-b669-577f0e0e039a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1927 microversion: 2.75 time: 0.472291 Jul 26 14:24:31.419319 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1930/3985] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:30 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1927 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:31.433648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fa203bd9-8f3c-4c79-af58-6dbf88ae6dde tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:31.434693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fa203bd9-8f3c-4c79-af58-6dbf88ae6dde tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:31.445651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa203bd9-8f3c-4c79-af58-6dbf88ae6dde tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:31.446570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa203bd9-8f3c-4c79-af58-6dbf88ae6dde tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:31.447662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa203bd9-8f3c-4c79-af58-6dbf88ae6dde tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:31.448443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa203bd9-8f3c-4c79-af58-6dbf88ae6dde tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:32.786174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-75f7ff4c-cb9f-483f-99a0-6f388d20ca80 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:32.841364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-75f7ff4c-cb9f-483f-99a0-6f388d20ca80 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:32.857534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-75f7ff4c-cb9f-483f-99a0-6f388d20ca80 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:32.861968 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-75f7ff4c-cb9f-483f-99a0-6f388d20ca80 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 1.580664 Jul 26 14:24:32.868370 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2056/3986] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:31 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:32.885927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-710891e4-37ad-41b5-9d56-1a06f6ec5e5b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:32.916758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-710891e4-37ad-41b5-9d56-1a06f6ec5e5b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:32.934084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-710891e4-37ad-41b5-9d56-1a06f6ec5e5b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Searching by: {'deleted': False, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:24:33.013674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-710891e4-37ad-41b5-9d56-1a06f6ec5e5b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:33.022071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-710891e4-37ad-41b5-9d56-1a06f6ec5e5b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:33.024210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-710891e4-37ad-41b5-9d56-1a06f6ec5e5b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:33.025374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-710891e4-37ad-41b5-9d56-1a06f6ec5e5b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:33.167140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-710891e4-37ad-41b5-9d56-1a06f6ec5e5b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:24:33.282878 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-710891e4-37ad-41b5-9d56-1a06f6ec5e5b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.412596 Jul 26 14:24:33.295757 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2057/3987] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:24:32 2022] GET /compute/v2.1/servers => generated 677 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:33.301945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1683e438-c9c4-49a1-b218-ed8772f7db1c req-95fa75c7-45ec-4c4c-b64d-14d788d4dd41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3e2faf-7a49-47df-886a-ef79f5fbe3b8", "name": "network-vif-plugged", "status": "completed", "tag": "85c04f3c-08b1-4c72-b7f3-94af7af851f7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:33.357435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1683e438-c9c4-49a1-b218-ed8772f7db1c req-95fa75c7-45ec-4c4c-b64d-14d788d4dd41 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:33.359730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1683e438-c9c4-49a1-b218-ed8772f7db1c req-95fa75c7-45ec-4c4c-b64d-14d788d4dd41 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:33.390363 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1683e438-c9c4-49a1-b218-ed8772f7db1c req-95fa75c7-45ec-4c4c-b64d-14d788d4dd41 service nova] Creating event network-vif-plugged:85c04f3c-08b1-4c72-b7f3-94af7af851f7 for instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 on n-h2-833090-9 Jul 26 14:24:33.409433 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1683e438-c9c4-49a1-b218-ed8772f7db1c req-95fa75c7-45ec-4c4c-b64d-14d788d4dd41 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109393 Jul 26 14:24:33.411531 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2058/3988] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:33.453226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-31517b07-eec7-4270-8f91-d078f1e54b74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:33.454257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-31517b07-eec7-4270-8f91-d078f1e54b74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:33.502473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31517b07-eec7-4270-8f91-d078f1e54b74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:33.503080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31517b07-eec7-4270-8f91-d078f1e54b74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:33.510250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31517b07-eec7-4270-8f91-d078f1e54b74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:33.513364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31517b07-eec7-4270-8f91-d078f1e54b74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:33.640519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fa203bd9-8f3c-4c79-af58-6dbf88ae6dde tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:33.678336 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fa203bd9-8f3c-4c79-af58-6dbf88ae6dde tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 2.250042 Jul 26 14:24:33.685570 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1931/3989] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:31 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:33.705892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7056cd83-b55e-43c6-920b-c6b3b6b91063 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:33.725133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7056cd83-b55e-43c6-920b-c6b3b6b91063 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:33.753471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7056cd83-b55e-43c6-920b-c6b3b6b91063 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:33.754253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7056cd83-b55e-43c6-920b-c6b3b6b91063 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:33.755836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7056cd83-b55e-43c6-920b-c6b3b6b91063 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:33.756710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7056cd83-b55e-43c6-920b-c6b3b6b91063 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:33.960463 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7056cd83-b55e-43c6-920b-c6b3b6b91063 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.268114 Jul 26 14:24:33.968239 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1932/3990] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:24:33 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments => generated 25 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:24:33.978915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7f8df62c-78fb-42d6-ae37-fc0d765df48c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:33.984305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7f8df62c-78fb-42d6-ae37-fc0d765df48c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:34.020995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f8df62c-78fb-42d6-ae37-fc0d765df48c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:34.021795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f8df62c-78fb-42d6-ae37-fc0d765df48c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:34.031815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f8df62c-78fb-42d6-ae37-fc0d765df48c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:34.032421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f8df62c-78fb-42d6-ae37-fc0d765df48c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:34.403719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-7f8df62c-78fb-42d6-ae37-fc0d765df48c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:34.409280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:34.462740 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7f8df62c-78fb-42d6-ae37-fc0d765df48c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1927 microversion: 2.75 time: 0.491232 Jul 26 14:24:34.464737 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1933/3991] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:33 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1927 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:34.511247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-254e6f6d-6cb4-4155-aa6a-10db6dc44c28 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:34.512191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-254e6f6d-6cb4-4155-aa6a-10db6dc44c28 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:34.528567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-31517b07-eec7-4270-8f91-d078f1e54b74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:34.539319 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-31517b07-eec7-4270-8f91-d078f1e54b74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1501 microversion: 2.1 time: 1.119493 Jul 26 14:24:34.549223 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2059/3992] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:33 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1501 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:34.559439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-254e6f6d-6cb4-4155-aa6a-10db6dc44c28 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:34.564494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-254e6f6d-6cb4-4155-aa6a-10db6dc44c28 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:34.565733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-254e6f6d-6cb4-4155-aa6a-10db6dc44c28 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:34.567988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-254e6f6d-6cb4-4155-aa6a-10db6dc44c28 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:34.570268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-20740553-f2d2-4648-9b4b-3473b771672f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:34.575965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-20740553-f2d2-4648-9b4b-3473b771672f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:34.619161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20740553-f2d2-4648-9b4b-3473b771672f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:34.619635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20740553-f2d2-4648-9b4b-3473b771672f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:34.620522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20740553-f2d2-4648-9b4b-3473b771672f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:34.620972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20740553-f2d2-4648-9b4b-3473b771672f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:34.904258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-254e6f6d-6cb4-4155-aa6a-10db6dc44c28 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:34.929679 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-254e6f6d-6cb4-4155-aa6a-10db6dc44c28 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1272 microversion: 2.1 time: 0.462391 Jul 26 14:24:34.953053 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1934/3993] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:34 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1272 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:34.962354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c68c1c0-0f6e-4749-95be-6c5369be616e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:34.967869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5c68c1c0-0f6e-4749-95be-6c5369be616e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:34.985841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c68c1c0-0f6e-4749-95be-6c5369be616e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:34.986655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c68c1c0-0f6e-4749-95be-6c5369be616e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:34.987678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c68c1c0-0f6e-4749-95be-6c5369be616e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:34.988384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c68c1c0-0f6e-4749-95be-6c5369be616e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:35.069118 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5c68c1c0-0f6e-4749-95be-6c5369be616e tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112075 Jul 26 14:24:35.073577 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1935/3994] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:24:34 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:24:35.100605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c80aa421-cc45-469b-937b-bd308eb04ff4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:35.109495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c80aa421-cc45-469b-937b-bd308eb04ff4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:35.126370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c80aa421-cc45-469b-937b-bd308eb04ff4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:35.129454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c80aa421-cc45-469b-937b-bd308eb04ff4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:35.132475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c80aa421-cc45-469b-937b-bd308eb04ff4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:35.134525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c80aa421-cc45-469b-937b-bd308eb04ff4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:35.424680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-20740553-f2d2-4648-9b4b-3473b771672f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:35.445470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-20740553-f2d2-4648-9b4b-3473b771672f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:35.448654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-20740553-f2d2-4648-9b4b-3473b771672f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:35.450739 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-20740553-f2d2-4648-9b4b-3473b771672f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 0.899563 Jul 26 14:24:35.468832 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2060/3995] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:34 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:35.474859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3e736b85-b235-41fe-bf37-44969fbcf4da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:35.485177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3e736b85-b235-41fe-bf37-44969fbcf4da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:35.492290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e736b85-b235-41fe-bf37-44969fbcf4da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:35.492290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e736b85-b235-41fe-bf37-44969fbcf4da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:35.493063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e736b85-b235-41fe-bf37-44969fbcf4da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:35.493515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e736b85-b235-41fe-bf37-44969fbcf4da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:35.668001 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c80aa421-cc45-469b-937b-bd308eb04ff4 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action" status: 200 len: 14 microversion: 2.1 time: 0.587781 Jul 26 14:24:35.669818 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1936/3996] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:35 2022] POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action => generated 14 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:24:35.679103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f698f1ff-c796-401f-b66b-5be291ccfd5c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:35.688977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f698f1ff-c796-401f-b66b-5be291ccfd5c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:35.714070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f698f1ff-c796-401f-b66b-5be291ccfd5c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:35.720308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f698f1ff-c796-401f-b66b-5be291ccfd5c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:35.722330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f698f1ff-c796-401f-b66b-5be291ccfd5c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:35.723822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f698f1ff-c796-401f-b66b-5be291ccfd5c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:35.818358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f698f1ff-c796-401f-b66b-5be291ccfd5c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:24:36.085515 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f698f1ff-c796-401f-b66b-5be291ccfd5c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 204 len: 0 microversion: 2.1 time: 0.412133 Jul 26 14:24:36.098053 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1937/3997] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:24:35 2022] DELETE /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:24:36.106225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d54c9f3-3cb9-42d7-98ed-cb67db4aa055 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:36.106965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8d54c9f3-3cb9-42d7-98ed-cb67db4aa055 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:36.132698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d54c9f3-3cb9-42d7-98ed-cb67db4aa055 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:36.133025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d54c9f3-3cb9-42d7-98ed-cb67db4aa055 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:36.133862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d54c9f3-3cb9-42d7-98ed-cb67db4aa055 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:36.134295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d54c9f3-3cb9-42d7-98ed-cb67db4aa055 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:36.334215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3e736b85-b235-41fe-bf37-44969fbcf4da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:36.339708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-8d54c9f3-3cb9-42d7-98ed-cb67db4aa055 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:36.365256 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3e736b85-b235-41fe-bf37-44969fbcf4da tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 0.894168 Jul 26 14:24:36.385296 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2061/3998] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:35 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:36.408039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5018810-8390-4dd8-96c7-8541abbb49ca tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:36.409573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a5018810-8390-4dd8-96c7-8541abbb49ca tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:36.420380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5018810-8390-4dd8-96c7-8541abbb49ca tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:36.421470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5018810-8390-4dd8-96c7-8541abbb49ca tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:36.423198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5018810-8390-4dd8-96c7-8541abbb49ca tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:36.423424 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d54c9f3-3cb9-42d7-98ed-cb67db4aa055 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1927 microversion: 2.75 time: 0.321940 Jul 26 14:24:36.424462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5018810-8390-4dd8-96c7-8541abbb49ca tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:36.426402 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1938/3999] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:36 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1927 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:36.444034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-39322681-1a11-48ec-b56e-4485f1748c67 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:36.445919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-39322681-1a11-48ec-b56e-4485f1748c67 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:36.471874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39322681-1a11-48ec-b56e-4485f1748c67 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:36.475109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39322681-1a11-48ec-b56e-4485f1748c67 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:36.476686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39322681-1a11-48ec-b56e-4485f1748c67 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:36.479061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39322681-1a11-48ec-b56e-4485f1748c67 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:36.966565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a5018810-8390-4dd8-96c7-8541abbb49ca tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:37.009542 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a5018810-8390-4dd8-96c7-8541abbb49ca tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1278 microversion: 2.1 time: 0.622054 Jul 26 14:24:37.023517 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2062/4000] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:36 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1278 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:37.098356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a8610a50-b48a-44b7-886e-a3467c642dd3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:37.100858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a8610a50-b48a-44b7-886e-a3467c642dd3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:37.130632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8610a50-b48a-44b7-886e-a3467c642dd3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:37.132061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8610a50-b48a-44b7-886e-a3467c642dd3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:37.136389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8610a50-b48a-44b7-886e-a3467c642dd3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:37.137553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8610a50-b48a-44b7-886e-a3467c642dd3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:37.969199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-39322681-1a11-48ec-b56e-4485f1748c67 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:37.981204 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-39322681-1a11-48ec-b56e-4485f1748c67 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1674 microversion: 2.1 time: 1.552917 Jul 26 14:24:37.997832 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1939/4001] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:36 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1674 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:38.008154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb8f03ca-17c4-4f91-944a-b4f0d7775999 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:38.010437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bb8f03ca-17c4-4f91-944a-b4f0d7775999 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:38.045786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb8f03ca-17c4-4f91-944a-b4f0d7775999 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:38.053349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb8f03ca-17c4-4f91-944a-b4f0d7775999 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:38.054688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb8f03ca-17c4-4f91-944a-b4f0d7775999 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:38.059304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb8f03ca-17c4-4f91-944a-b4f0d7775999 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:38.535972 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bb8f03ca-17c4-4f91-944a-b4f0d7775999 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action" status: 200 len: 14 microversion: 2.1 time: 0.536957 Jul 26 14:24:38.538128 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1940/4002] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:37 2022] POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action => generated 14 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:24:38.553535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f628e7c3-a2e8-448b-a372-7964bf45b965 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:38.558101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f628e7c3-a2e8-448b-a372-7964bf45b965 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:38.581200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f628e7c3-a2e8-448b-a372-7964bf45b965 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:38.583074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f628e7c3-a2e8-448b-a372-7964bf45b965 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:38.585611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f628e7c3-a2e8-448b-a372-7964bf45b965 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:38.586857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f628e7c3-a2e8-448b-a372-7964bf45b965 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:38.745098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a8610a50-b48a-44b7-886e-a3467c642dd3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:38.770465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a8610a50-b48a-44b7-886e-a3467c642dd3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:38.777538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a8610a50-b48a-44b7-886e-a3467c642dd3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:38.781613 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a8610a50-b48a-44b7-886e-a3467c642dd3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 1.742242 Jul 26 14:24:38.797932 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2063/4003] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:37 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:38.827298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ee1f4b54-a05c-4679-8899-971bbd7939bf tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:38.828449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ee1f4b54-a05c-4679-8899-971bbd7939bf tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:38.839607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee1f4b54-a05c-4679-8899-971bbd7939bf tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:38.841252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee1f4b54-a05c-4679-8899-971bbd7939bf tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:38.842906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee1f4b54-a05c-4679-8899-971bbd7939bf tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:38.844849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee1f4b54-a05c-4679-8899-971bbd7939bf tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:39.485681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-ee1f4b54-a05c-4679-8899-971bbd7939bf tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:39.585917 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ee1f4b54-a05c-4679-8899-971bbd7939bf tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1927 microversion: 2.75 time: 0.785805 Jul 26 14:24:39.587461 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2064/4004] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:38 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1927 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:39.605376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-741bb655-2a23-49cb-a8ac-3075fb38a142 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:39.613261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-741bb655-2a23-49cb-a8ac-3075fb38a142 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:39.641760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-741bb655-2a23-49cb-a8ac-3075fb38a142 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:39.647804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-741bb655-2a23-49cb-a8ac-3075fb38a142 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:39.651425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-741bb655-2a23-49cb-a8ac-3075fb38a142 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:39.658017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-741bb655-2a23-49cb-a8ac-3075fb38a142 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:39.832439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-741bb655-2a23-49cb-a8ac-3075fb38a142 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:39.845204 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-741bb655-2a23-49cb-a8ac-3075fb38a142 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1278 microversion: 2.1 time: 0.255791 Jul 26 14:24:39.869445 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2065/4005] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:39 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1278 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:39.878820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cdf05ff2-73ed-45d1-8a4d-93c984a38bd4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:39.890148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cdf05ff2-73ed-45d1-8a4d-93c984a38bd4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:39.905331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdf05ff2-73ed-45d1-8a4d-93c984a38bd4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:39.908813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdf05ff2-73ed-45d1-8a4d-93c984a38bd4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:39.913534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdf05ff2-73ed-45d1-8a4d-93c984a38bd4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:39.914241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdf05ff2-73ed-45d1-8a4d-93c984a38bd4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:40.153445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f628e7c3-a2e8-448b-a372-7964bf45b965 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:40.205702 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f628e7c3-a2e8-448b-a372-7964bf45b965 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1315 microversion: 2.1 time: 1.663498 Jul 26 14:24:40.221837 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1941/4006] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:38 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1315 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:40.237702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6dd2347-aad8-440d-be4c-9fb30c2a0c29 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:40.240612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e6dd2347-aad8-440d-be4c-9fb30c2a0c29 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:40.259160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6dd2347-aad8-440d-be4c-9fb30c2a0c29 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:40.260725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6dd2347-aad8-440d-be4c-9fb30c2a0c29 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:40.264779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6dd2347-aad8-440d-be4c-9fb30c2a0c29 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:40.265485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6dd2347-aad8-440d-be4c-9fb30c2a0c29 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:40.338162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6dd2347-aad8-440d-be4c-9fb30c2a0c29 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action" status: 200 len: 14 microversion: 2.1 time: 0.109484 Jul 26 14:24:40.339444 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1942/4007] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:40 2022] POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:24:40.347870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3680f308-46f7-4427-bbd6-96969dfc28cd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:40.349489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3680f308-46f7-4427-bbd6-96969dfc28cd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:40.360740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3680f308-46f7-4427-bbd6-96969dfc28cd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:40.361446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3680f308-46f7-4427-bbd6-96969dfc28cd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:40.362460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3680f308-46f7-4427-bbd6-96969dfc28cd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:40.363422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3680f308-46f7-4427-bbd6-96969dfc28cd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:40.692641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cdf05ff2-73ed-45d1-8a4d-93c984a38bd4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:40.731892 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cdf05ff2-73ed-45d1-8a4d-93c984a38bd4 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1674 microversion: 2.1 time: 0.860123 Jul 26 14:24:40.744541 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2066/4008] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:39 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1674 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:40.753137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-22160abf-cfb9-4c33-af4a-17bde49a9b51 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:40.754167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-22160abf-cfb9-4c33-af4a-17bde49a9b51 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:40.776950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:40.785496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22160abf-cfb9-4c33-af4a-17bde49a9b51 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:40.786276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22160abf-cfb9-4c33-af4a-17bde49a9b51 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:40.787576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22160abf-cfb9-4c33-af4a-17bde49a9b51 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:40.788354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22160abf-cfb9-4c33-af4a-17bde49a9b51 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:41.074859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3680f308-46f7-4427-bbd6-96969dfc28cd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:41.102137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-22160abf-cfb9-4c33-af4a-17bde49a9b51 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:41.117566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3680f308-46f7-4427-bbd6-96969dfc28cd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:41.119264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3680f308-46f7-4427-bbd6-96969dfc28cd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:41.137429 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3680f308-46f7-4427-bbd6-96969dfc28cd tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 0.781594 Jul 26 14:24:41.138206 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1943/4009] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:40 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:41.177472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1df1303e-8ad0-4d0e-afd3-c7355a6204da tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:41.180079 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-22160abf-cfb9-4c33-af4a-17bde49a9b51 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1927 microversion: 2.75 time: 0.419712 Jul 26 14:24:41.186885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1df1303e-8ad0-4d0e-afd3-c7355a6204da tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:41.188203 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2067/4010] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:40 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1927 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:41.223666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1df1303e-8ad0-4d0e-afd3-c7355a6204da tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:41.228579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1df1303e-8ad0-4d0e-afd3-c7355a6204da tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:41.230626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1df1303e-8ad0-4d0e-afd3-c7355a6204da tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:41.231849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1df1303e-8ad0-4d0e-afd3-c7355a6204da tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:41.288882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7797179c-d31c-4987-ae24-0a6059f04ee6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:41.290576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7797179c-d31c-4987-ae24-0a6059f04ee6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:41.302732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7797179c-d31c-4987-ae24-0a6059f04ee6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:41.303389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7797179c-d31c-4987-ae24-0a6059f04ee6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:41.304634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7797179c-d31c-4987-ae24-0a6059f04ee6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:41.305261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7797179c-d31c-4987-ae24-0a6059f04ee6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:41.937988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1df1303e-8ad0-4d0e-afd3-c7355a6204da tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:41.948790 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1df1303e-8ad0-4d0e-afd3-c7355a6204da tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1320 microversion: 2.1 time: 0.808778 Jul 26 14:24:41.958635 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1944/4011] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:41 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1320 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:41.967707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-69f4de70-8648-4204-9cb7-83c9dbdd5634 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:41.972725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-69f4de70-8648-4204-9cb7-83c9dbdd5634 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:41.987057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7797179c-d31c-4987-ae24-0a6059f04ee6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:42.013236 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7797179c-d31c-4987-ae24-0a6059f04ee6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1502 microversion: 2.1 time: 0.727135 Jul 26 14:24:42.018547 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2068/4012] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:41 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1502 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:42.021285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69f4de70-8648-4204-9cb7-83c9dbdd5634 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:42.022990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69f4de70-8648-4204-9cb7-83c9dbdd5634 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:42.024853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69f4de70-8648-4204-9cb7-83c9dbdd5634 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:42.026077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69f4de70-8648-4204-9cb7-83c9dbdd5634 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:42.041307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-35cf720e-05e6-4736-8d1a-73a30c37fc8c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:42.045746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-35cf720e-05e6-4736-8d1a-73a30c37fc8c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:42.071932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35cf720e-05e6-4736-8d1a-73a30c37fc8c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:42.074625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35cf720e-05e6-4736-8d1a-73a30c37fc8c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:42.076752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35cf720e-05e6-4736-8d1a-73a30c37fc8c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:42.080516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35cf720e-05e6-4736-8d1a-73a30c37fc8c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:42.148346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:42.194024 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-69f4de70-8648-4204-9cb7-83c9dbdd5634 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action" status: 200 len: 14 microversion: 2.1 time: 0.233438 Jul 26 14:24:42.199199 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1945/4013] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:41 2022] POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action => generated 14 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:24:42.211472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c503158-142f-4e74-a2c7-db423ce7c0fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:42.213483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0c503158-142f-4e74-a2c7-db423ce7c0fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:42.249476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c503158-142f-4e74-a2c7-db423ce7c0fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:42.253227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c503158-142f-4e74-a2c7-db423ce7c0fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:42.254408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c503158-142f-4e74-a2c7-db423ce7c0fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:42.256380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c503158-142f-4e74-a2c7-db423ce7c0fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:42.316473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-0c503158-142f-4e74-a2c7-db423ce7c0fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lazy-loading 'flavor' on Instance uuid 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:42.507067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35cf720e-05e6-4736-8d1a-73a30c37fc8c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:42.523183 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-35cf720e-05e6-4736-8d1a-73a30c37fc8c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1606 microversion: 2.1 time: 0.503060 Jul 26 14:24:42.536545 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2069/4014] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:42 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1606 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:42.543817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b4bbd800-c65e-4ebd-ba82-d5bf7199414b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:42.558304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b4bbd800-c65e-4ebd-ba82-d5bf7199414b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:42.597751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4bbd800-c65e-4ebd-ba82-d5bf7199414b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:42.598197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4bbd800-c65e-4ebd-ba82-d5bf7199414b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:42.599005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4bbd800-c65e-4ebd-ba82-d5bf7199414b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:42.599452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4bbd800-c65e-4ebd-ba82-d5bf7199414b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:43.045862 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c503158-142f-4e74-a2c7-db423ce7c0fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8/action" status: 202 len: 0 microversion: 2.1 time: 0.843308 Jul 26 14:24:43.047390 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1946/4015] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:42 2022] POST /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8/action => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:24:43.063997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3444e0dd-34fa-499a-bdd1-19952e9a7f8c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:43.064753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3444e0dd-34fa-499a-bdd1-19952e9a7f8c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:43.075839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:43.084484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3444e0dd-34fa-499a-bdd1-19952e9a7f8c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:43.085193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3444e0dd-34fa-499a-bdd1-19952e9a7f8c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:43.086615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3444e0dd-34fa-499a-bdd1-19952e9a7f8c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:43.087391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3444e0dd-34fa-499a-bdd1-19952e9a7f8c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:44.015267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:44.037587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-3444e0dd-34fa-499a-bdd1-19952e9a7f8c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:44.083044 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3444e0dd-34fa-499a-bdd1-19952e9a7f8c tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1927 microversion: 2.75 time: 1.033162 Jul 26 14:24:44.128197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b4bbd800-c65e-4ebd-ba82-d5bf7199414b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:44.136714 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1947/4016] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:43 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1927 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:44.145843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-17717652-d864-49c7-beab-53480a71bef7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:44.146980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-17717652-d864-49c7-beab-53480a71bef7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:44.162260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b4bbd800-c65e-4ebd-ba82-d5bf7199414b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:44.167561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b4bbd800-c65e-4ebd-ba82-d5bf7199414b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:44.175674 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b4bbd800-c65e-4ebd-ba82-d5bf7199414b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 1.637537 Jul 26 14:24:44.199227 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2070/4017] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:42 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:44.214020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17717652-d864-49c7-beab-53480a71bef7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:44.218678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17717652-d864-49c7-beab-53480a71bef7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:44.223752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17717652-d864-49c7-beab-53480a71bef7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:44.224875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17717652-d864-49c7-beab-53480a71bef7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:44.234845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0199a99c-3a96-44e6-8e0d-15c509de32f6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:44.236383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0199a99c-3a96-44e6-8e0d-15c509de32f6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:44.263612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0199a99c-3a96-44e6-8e0d-15c509de32f6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:44.268095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0199a99c-3a96-44e6-8e0d-15c509de32f6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:44.270287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0199a99c-3a96-44e6-8e0d-15c509de32f6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:44.274733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0199a99c-3a96-44e6-8e0d-15c509de32f6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:45.658194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0199a99c-3a96-44e6-8e0d-15c509de32f6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:45.679266 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0199a99c-3a96-44e6-8e0d-15c509de32f6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 1.477469 Jul 26 14:24:45.712779 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2071/4018] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:44 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:45.733513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-62cb9cbf-3d36-4679-929f-1322f31be420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:45.739358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-62cb9cbf-3d36-4679-929f-1322f31be420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:45.755062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62cb9cbf-3d36-4679-929f-1322f31be420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:45.756353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62cb9cbf-3d36-4679-929f-1322f31be420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:45.759181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62cb9cbf-3d36-4679-929f-1322f31be420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:45.761683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62cb9cbf-3d36-4679-929f-1322f31be420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:45.865862 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-62cb9cbf-3d36-4679-929f-1322f31be420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action" status: 200 len: 14 microversion: 2.1 time: 0.150223 Jul 26 14:24:45.870995 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2072/4019] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:45 2022] POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:24:45.883247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:45.884380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:45.906234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-17717652-d864-49c7-beab-53480a71bef7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:45.914068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:45.916888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:45.919373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:45.922231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:45.929875 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-17717652-d864-49c7-beab-53480a71bef7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1320 microversion: 2.1 time: 1.790401 Jul 26 14:24:45.956087 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1948/4020] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:44 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1320 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:46.077750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:46.080465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:46.082093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lazy-loading 'fault' on Instance uuid cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:46.268667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19594a069a4981b97987a892d918e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cdecfd17974d588bc69d8e369a7fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:46.282677 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08614f64-a251-454d-bc60-f19e07db2e3c tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 200 len: 1328 microversion: 2.1 time: 0.409116 Jul 26 14:24:46.283561 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2073/4021] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:45 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 1328 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:46.291883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-575f4926-84fb-425c-ad3a-a6e7419f861a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:46.297246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-575f4926-84fb-425c-ad3a-a6e7419f861a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:46.310793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-575f4926-84fb-425c-ad3a-a6e7419f861a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:46.311927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-575f4926-84fb-425c-ad3a-a6e7419f861a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:46.316446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-575f4926-84fb-425c-ad3a-a6e7419f861a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:46.317769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-575f4926-84fb-425c-ad3a-a6e7419f861a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:46.494484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-575f4926-84fb-425c-ad3a-a6e7419f861a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:46.536059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f70e322b-2c08-4f85-8b4a-bf86957bf410 req-fadc44d9-815a-4554-b2bb-2a37c0efe514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bbfc464-3e82-4491-9b12-5d5043d07faf", "tag": "ef85d382-c184-4c9f-80cd-d658e04e7494"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:46.562055 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-575f4926-84fb-425c-ad3a-a6e7419f861a tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1927 microversion: 2.75 time: 0.275104 Jul 26 14:24:46.565097 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2074/4022] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:46 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1927 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:46.575404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eb44c5be-d968-4d29-af3d-5021e94f44a2 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:46.582822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eb44c5be-d968-4d29-af3d-5021e94f44a2 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:46.602474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f70e322b-2c08-4f85-8b4a-bf86957bf410 req-fadc44d9-815a-4554-b2bb-2a37c0efe514 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:46.603249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f70e322b-2c08-4f85-8b4a-bf86957bf410 req-fadc44d9-815a-4554-b2bb-2a37c0efe514 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:46.612165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb44c5be-d968-4d29-af3d-5021e94f44a2 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:46.619285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb44c5be-d968-4d29-af3d-5021e94f44a2 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:46.622644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb44c5be-d968-4d29-af3d-5021e94f44a2 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:46.629138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb44c5be-d968-4d29-af3d-5021e94f44a2 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:46.637278 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f70e322b-2c08-4f85-8b4a-bf86957bf410 req-fadc44d9-815a-4554-b2bb-2a37c0efe514 service nova] Creating event network-changed:ef85d382-c184-4c9f-80cd-d658e04e7494 for instance 9bbfc464-3e82-4491-9b12-5d5043d07faf on n-h1-833090-9 Jul 26 14:24:46.660326 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f70e322b-2c08-4f85-8b4a-bf86957bf410 req-fadc44d9-815a-4554-b2bb-2a37c0efe514 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.700546 Jul 26 14:24:46.661368 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1949/4023] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:46.682766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-adf03742-086d-4657-b8a9-e3836bb0d7a3 req-efe3aa54-9418-4ae5-a370-3c9a0143b7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049", "name": "network-vif-deleted", "tag": "586f4682-9ae3-4429-bffc-65da24439ea0"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:46.737223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-adf03742-086d-4657-b8a9-e3836bb0d7a3 req-efe3aa54-9418-4ae5-a370-3c9a0143b7d9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:46.738539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-adf03742-086d-4657-b8a9-e3836bb0d7a3 req-efe3aa54-9418-4ae5-a370-3c9a0143b7d9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:46.772839 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-adf03742-086d-4657-b8a9-e3836bb0d7a3 req-efe3aa54-9418-4ae5-a370-3c9a0143b7d9 service nova] Creating event network-vif-deleted:586f4682-9ae3-4429-bffc-65da24439ea0 for instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 on n-h2-833090-9 Jul 26 14:24:46.786743 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-adf03742-086d-4657-b8a9-e3836bb0d7a3 req-efe3aa54-9418-4ae5-a370-3c9a0143b7d9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120569 Jul 26 14:24:46.794336 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1950/4024] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:46.801834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e8cfe54-2c2f-4aa2-aec6-8f8c4ebc3681 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:46.806949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e8cfe54-2c2f-4aa2-aec6-8f8c4ebc3681 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:46.831035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e8cfe54-2c2f-4aa2-aec6-8f8c4ebc3681 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:46.833765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e8cfe54-2c2f-4aa2-aec6-8f8c4ebc3681 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:46.835198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e8cfe54-2c2f-4aa2-aec6-8f8c4ebc3681 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:46.839985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e8cfe54-2c2f-4aa2-aec6-8f8c4ebc3681 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:47.446839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2e8cfe54-2c2f-4aa2-aec6-8f8c4ebc3681 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:47.474965 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e8cfe54-2c2f-4aa2-aec6-8f8c4ebc3681 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.678092 Jul 26 14:24:47.498038 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1951/4025] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:46 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:47.527386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cb770c27-1089-4cc7-8e20-9d85dcaeb11a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:47.530231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cb770c27-1089-4cc7-8e20-9d85dcaeb11a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:47.534047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:47.546815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb770c27-1089-4cc7-8e20-9d85dcaeb11a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:47.547206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb770c27-1089-4cc7-8e20-9d85dcaeb11a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:47.552591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb770c27-1089-4cc7-8e20-9d85dcaeb11a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:47.562929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb770c27-1089-4cc7-8e20-9d85dcaeb11a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:47.604380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb44c5be-d968-4d29-af3d-5021e94f44a2 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:47.634873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb44c5be-d968-4d29-af3d-5021e94f44a2 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:47.639667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb44c5be-d968-4d29-af3d-5021e94f44a2 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:47.647743 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eb44c5be-d968-4d29-af3d-5021e94f44a2 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 1.080681 Jul 26 14:24:47.653603 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2075/4026] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:46 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:47.674678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56902c5d-4f68-41aa-bd74-fe355794e7c8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:47.675075 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cb770c27-1089-4cc7-8e20-9d85dcaeb11a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action" status: 200 len: 14 microversion: 2.1 time: 0.173623 Jul 26 14:24:47.675838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56902c5d-4f68-41aa-bd74-fe355794e7c8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:47.680250 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1952/4027] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:47 2022] POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:24:47.694531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56902c5d-4f68-41aa-bd74-fe355794e7c8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:47.696447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56902c5d-4f68-41aa-bd74-fe355794e7c8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:47.697540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a951afbf-c1c4-44d7-8030-2da55ffa29b8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:47.698881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a951afbf-c1c4-44d7-8030-2da55ffa29b8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:47.700371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56902c5d-4f68-41aa-bd74-fe355794e7c8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:47.701083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56902c5d-4f68-41aa-bd74-fe355794e7c8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:47.737528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a951afbf-c1c4-44d7-8030-2da55ffa29b8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:47.739722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a951afbf-c1c4-44d7-8030-2da55ffa29b8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:47.741551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a951afbf-c1c4-44d7-8030-2da55ffa29b8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:47.742597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a951afbf-c1c4-44d7-8030-2da55ffa29b8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:47.800966 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-a951afbf-c1c4-44d7-8030-2da55ffa29b8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] HTTP exception thrown: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a951afbf-c1c4-44d7-8030-2da55ffa29b8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Request method failure captured: Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 HTTP/1.1 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_d6T8VZKBb8m2yG8UhihAKahu2diKCDTqfV5O1nxR9IS_cNJHUVT9axTIwGI7toxkAmOzeU3-XMFyDzn4808gDiE04M5pY2yTs9RrVmh1DPWCHOTt8kcxLBeq8t9vx5sFeTwGODds0KleJ2s6kJJwuEE-XOS8u9YG22U1yxrO86JU4 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_36cdecfd17974d588bc69d8e369a7fd1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}] Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 0a19594a069a4981b97987a892d918e1 Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049'} Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:24:47.814207 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:24:47.822676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:47.822676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:24:47.822676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:24:47.822676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:24:47.822676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:24:47.822676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:24:47.822676 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:24:47.829026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a951afbf-c1c4-44d7-8030-2da55ffa29b8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Returning 404 to user: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:24:47.830244 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a951afbf-c1c4-44d7-8030-2da55ffa29b8 tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 404 len: 111 microversion: 2.1 time: 0.148145 Jul 26 14:24:47.832393 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1953/4028] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:47 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:24:47.847943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-773fa90b-5f73-420f-9ff5-79d86f22a1fa tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:47.861442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-773fa90b-5f73-420f-9ff5-79d86f22a1fa tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:47.900029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-773fa90b-5f73-420f-9ff5-79d86f22a1fa tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:47.900799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-773fa90b-5f73-420f-9ff5-79d86f22a1fa tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:47.901870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-773fa90b-5f73-420f-9ff5-79d86f22a1fa tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:47.905364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-773fa90b-5f73-420f-9ff5-79d86f22a1fa tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:48.312675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-773fa90b-5f73-420f-9ff5-79d86f22a1fa tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:48.380592 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-773fa90b-5f73-420f-9ff5-79d86f22a1fa tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1933 microversion: 2.75 time: 0.541866 Jul 26 14:24:48.405193 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1954/4029] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:47 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1933 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:48.418279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cb3e03fd-2e13-4613-93c2-838c3a43765b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '.version_select at 0x7f87949e7940>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:48.447827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56902c5d-4f68-41aa-bd74-fe355794e7c8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:48.460755 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cb3e03fd-2e13-4613-93c2-838c3a43765b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534818419" status: 202 len: 0 microversion: 2.1 time: 0.054003 Jul 26 14:24:48.464682 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1955/4030] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534818419 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:24:48.477828 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56902c5d-4f68-41aa-bd74-fe355794e7c8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1320 microversion: 2.1 time: 0.821776 Jul 26 14:24:48.478897 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2076/4031] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:47 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1320 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:48.518352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-192327a0-ae11-4e2f-99c7-8c96c983dff0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:48.522420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-192327a0-ae11-4e2f-99c7-8c96c983dff0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:48.541050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-192327a0-ae11-4e2f-99c7-8c96c983dff0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:48.548025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-192327a0-ae11-4e2f-99c7-8c96c983dff0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:48.549342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-192327a0-ae11-4e2f-99c7-8c96c983dff0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:48.550093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-192327a0-ae11-4e2f-99c7-8c96c983dff0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:48.684325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6c94344a-69b5-4c7c-b368-1415d6448823 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:48.688726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6c94344a-69b5-4c7c-b368-1415d6448823 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:48.703057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c94344a-69b5-4c7c-b368-1415d6448823 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:48.705025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c94344a-69b5-4c7c-b368-1415d6448823 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:48.707217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c94344a-69b5-4c7c-b368-1415d6448823 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:48.708484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c94344a-69b5-4c7c-b368-1415d6448823 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:49.117099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-192327a0-ae11-4e2f-99c7-8c96c983dff0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:49.134991 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-192327a0-ae11-4e2f-99c7-8c96c983dff0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.629814 Jul 26 14:24:49.141982 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1956/4032] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:48 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:49.253547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6c94344a-69b5-4c7c-b368-1415d6448823 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:49.282887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6c94344a-69b5-4c7c-b368-1415d6448823 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:49.287569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6c94344a-69b5-4c7c-b368-1415d6448823 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:49.299557 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6c94344a-69b5-4c7c-b368-1415d6448823 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 0.624003 Jul 26 14:24:49.301880 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2077/4033] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:48 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:24:49.310480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4c09a65b-2062-47d9-9cef-184a1e7d29d1 req-8c9a7057-920f-464f-810c-c8273923bbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e99675-d665-4660-aaf6-3e955d7bff55", "tag": "49a7674c-84cb-432f-bf7d-4ecd0d03924c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:49.330735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4c09a65b-2062-47d9-9cef-184a1e7d29d1 req-8c9a7057-920f-464f-810c-c8273923bbe6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:49.331601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4c09a65b-2062-47d9-9cef-184a1e7d29d1 req-8c9a7057-920f-464f-810c-c8273923bbe6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:49.351671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4c09a65b-2062-47d9-9cef-184a1e7d29d1 req-8c9a7057-920f-464f-810c-c8273923bbe6 service nova] Creating event network-changed:49a7674c-84cb-432f-bf7d-4ecd0d03924c for instance 27e99675-d665-4660-aaf6-3e955d7bff55 on n-h2-833090-9 Jul 26 14:24:49.365711 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4c09a65b-2062-47d9-9cef-184a1e7d29d1 req-8c9a7057-920f-464f-810c-c8273923bbe6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061888 Jul 26 14:24:49.366792 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2078/4034] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:49.416367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-241cc2c9-33ce-40b4-bbe9-f68ebca4bc79 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:49.418761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-241cc2c9-33ce-40b4-bbe9-f68ebca4bc79 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:49.448457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-241cc2c9-33ce-40b4-bbe9-f68ebca4bc79 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:49.450309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-241cc2c9-33ce-40b4-bbe9-f68ebca4bc79 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:49.452903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-241cc2c9-33ce-40b4-bbe9-f68ebca4bc79 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:49.457052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-241cc2c9-33ce-40b4-bbe9-f68ebca4bc79 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:49.466913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-edd3f89e-c945-4953-83ab-ee2f9ed82b3d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:49.471715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-edd3f89e-c945-4953-83ab-ee2f9ed82b3d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:49.500277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edd3f89e-c945-4953-83ab-ee2f9ed82b3d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:49.501145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edd3f89e-c945-4953-83ab-ee2f9ed82b3d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:49.502516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edd3f89e-c945-4953-83ab-ee2f9ed82b3d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:49.509780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edd3f89e-c945-4953-83ab-ee2f9ed82b3d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:49.750541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-241cc2c9-33ce-40b4-bbe9-f68ebca4bc79 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:49.825622 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-241cc2c9-33ce-40b4-bbe9-f68ebca4bc79 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1933 microversion: 2.75 time: 0.415568 Jul 26 14:24:49.850484 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2079/4035] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:49 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1933 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:49.876443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95fb3e32-76e1-47fd-9573-74b99682c319 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:49.877367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95fb3e32-76e1-47fd-9573-74b99682c319 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:49.895340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95fb3e32-76e1-47fd-9573-74b99682c319 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:49.909157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95fb3e32-76e1-47fd-9573-74b99682c319 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:49.911270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95fb3e32-76e1-47fd-9573-74b99682c319 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:49.912532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95fb3e32-76e1-47fd-9573-74b99682c319 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:50.407069 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-edd3f89e-c945-4953-83ab-ee2f9ed82b3d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action" status: 200 len: 14 microversion: 2.1 time: 1.262805 Jul 26 14:24:50.412482 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1957/4036] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:49 2022] POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action => generated 14 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:24:50.423683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84cabe80-768a-4a6a-8211-88d08a0a1bdb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:50.431008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-84cabe80-768a-4a6a-8211-88d08a0a1bdb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:50.461105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84cabe80-768a-4a6a-8211-88d08a0a1bdb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:50.464549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84cabe80-768a-4a6a-8211-88d08a0a1bdb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:50.466059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84cabe80-768a-4a6a-8211-88d08a0a1bdb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:50.466848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84cabe80-768a-4a6a-8211-88d08a0a1bdb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:50.646757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-95fb3e32-76e1-47fd-9573-74b99682c319 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:50.661301 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95fb3e32-76e1-47fd-9573-74b99682c319 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1320 microversion: 2.1 time: 0.799942 Jul 26 14:24:50.662928 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2080/4037] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:49 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1320 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:50.684250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a543fc4-f571-499a-b197-42aa6ef9c9b0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:50.689311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1a543fc4-f571-499a-b197-42aa6ef9c9b0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:50.715498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a543fc4-f571-499a-b197-42aa6ef9c9b0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:50.719924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a543fc4-f571-499a-b197-42aa6ef9c9b0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:50.722633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a543fc4-f571-499a-b197-42aa6ef9c9b0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:50.723742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a543fc4-f571-499a-b197-42aa6ef9c9b0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:51.564582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-84cabe80-768a-4a6a-8211-88d08a0a1bdb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:51.577497 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-84cabe80-768a-4a6a-8211-88d08a0a1bdb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 1.161524 Jul 26 14:24:51.581268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1a543fc4-f571-499a-b197-42aa6ef9c9b0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:51.585028 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1958/4038] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:50 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:51.612613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dcb6201b-0f50-4d60-a297-be646f9b6106 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:51.613630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dcb6201b-0f50-4d60-a297-be646f9b6106 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:51.629693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1a543fc4-f571-499a-b197-42aa6ef9c9b0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:51.632737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1a543fc4-f571-499a-b197-42aa6ef9c9b0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:51.634892 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1a543fc4-f571-499a-b197-42aa6ef9c9b0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 0.970310 Jul 26 14:24:51.642287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcb6201b-0f50-4d60-a297-be646f9b6106 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:51.653612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcb6201b-0f50-4d60-a297-be646f9b6106 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:51.670203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcb6201b-0f50-4d60-a297-be646f9b6106 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:51.670203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcb6201b-0f50-4d60-a297-be646f9b6106 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:51.684730 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2081/4039] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:50 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:51.726247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5747747d-155e-4ba1-b437-63ac972c35fc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:51.753162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5747747d-155e-4ba1-b437-63ac972c35fc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:51.792583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5747747d-155e-4ba1-b437-63ac972c35fc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:51.814814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5747747d-155e-4ba1-b437-63ac972c35fc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:51.816395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5747747d-155e-4ba1-b437-63ac972c35fc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:51.817110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5747747d-155e-4ba1-b437-63ac972c35fc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:51.986754 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5747747d-155e-4ba1-b437-63ac972c35fc tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action" status: 200 len: 8205 microversion: 2.1 time: 0.299063 Jul 26 14:24:51.987844 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2082/4040] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:51 2022] POST /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198/action => generated 8205 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:52.009165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-96b70dc5-1bc9-480e-804d-4ddc00c308b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:52.013760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-96b70dc5-1bc9-480e-804d-4ddc00c308b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:52.058851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96b70dc5-1bc9-480e-804d-4ddc00c308b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:52.066854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96b70dc5-1bc9-480e-804d-4ddc00c308b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:52.067898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96b70dc5-1bc9-480e-804d-4ddc00c308b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:52.068505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96b70dc5-1bc9-480e-804d-4ddc00c308b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:52.104844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-dcb6201b-0f50-4d60-a297-be646f9b6106 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] Lazy-loading 'services' on Instance uuid 04986f19-0c0f-40ae-8da7-edca3919ff7b {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:24:52.208595 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dcb6201b-0f50-4d60-a297-be646f9b6106 tempest-ServersAdmin275Test-331318159 tempest-ServersAdmin275Test-331318159-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1918 microversion: 2.75 time: 0.616355 Jul 26 14:24:52.223794 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1959/4041] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:51 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1918 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:52.240665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d2ed4042-436a-4567-b0c0-bf0f511dc162 req-6ce9e9b7-3183-419d-9ed4-eef4b94f0904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bbfc464-3e82-4491-9b12-5d5043d07faf", "name": "network-vif-plugged", "status": "completed", "tag": "ef85d382-c184-4c9f-80cd-d658e04e7494"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:52.274836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d2ed4042-436a-4567-b0c0-bf0f511dc162 req-6ce9e9b7-3183-419d-9ed4-eef4b94f0904 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:52.275629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d2ed4042-436a-4567-b0c0-bf0f511dc162 req-6ce9e9b7-3183-419d-9ed4-eef4b94f0904 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:52.303271 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d2ed4042-436a-4567-b0c0-bf0f511dc162 req-6ce9e9b7-3183-419d-9ed4-eef4b94f0904 service nova] Creating event network-vif-plugged:ef85d382-c184-4c9f-80cd-d658e04e7494 for instance 9bbfc464-3e82-4491-9b12-5d5043d07faf on n-h1-833090-9 Jul 26 14:24:52.331385 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d2ed4042-436a-4567-b0c0-bf0f511dc162 req-6ce9e9b7-3183-419d-9ed4-eef4b94f0904 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105578 Jul 26 14:24:52.332566 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1960/4042] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:52.339722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee572d07-8e76-43d6-ad0f-bb6944ff42b9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:52.341151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ee572d07-8e76-43d6-ad0f-bb6944ff42b9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:52.355702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee572d07-8e76-43d6-ad0f-bb6944ff42b9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:52.360428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee572d07-8e76-43d6-ad0f-bb6944ff42b9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:52.367035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee572d07-8e76-43d6-ad0f-bb6944ff42b9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:52.367859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee572d07-8e76-43d6-ad0f-bb6944ff42b9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:53.141165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-96b70dc5-1bc9-480e-804d-4ddc00c308b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:53.175793 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-96b70dc5-1bc9-480e-804d-4ddc00c308b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1320 microversion: 2.1 time: 1.186052 Jul 26 14:24:53.176724 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2083/4043] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:51 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1320 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:53.198327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32e7f745-24cc-4da7-af1a-64ccb7eb2d22 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:53.213071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32e7f745-24cc-4da7-af1a-64ccb7eb2d22 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:53.236079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32e7f745-24cc-4da7-af1a-64ccb7eb2d22 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:53.242047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32e7f745-24cc-4da7-af1a-64ccb7eb2d22 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:53.243482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32e7f745-24cc-4da7-af1a-64ccb7eb2d22 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:53.244429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32e7f745-24cc-4da7-af1a-64ccb7eb2d22 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:53.368091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32e7f745-24cc-4da7-af1a-64ccb7eb2d22 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:24:53.401076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ee572d07-8e76-43d6-ad0f-bb6944ff42b9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:53.429061 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ee572d07-8e76-43d6-ad0f-bb6944ff42b9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.094917 Jul 26 14:24:53.432862 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1961/4044] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:52 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:53.444666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-edc9168c-5999-456e-9d55-d305e7ed7afe tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:53.445678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-edc9168c-5999-456e-9d55-d305e7ed7afe tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:53.463659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edc9168c-5999-456e-9d55-d305e7ed7afe tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:53.469571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edc9168c-5999-456e-9d55-d305e7ed7afe tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:53.471489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edc9168c-5999-456e-9d55-d305e7ed7afe tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:53.474724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-edc9168c-5999-456e-9d55-d305e7ed7afe tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:53.573544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:53.649920 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-32e7f745-24cc-4da7-af1a-64ccb7eb2d22 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "DELETE /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 204 len: 0 microversion: 2.75 time: 0.471418 Jul 26 14:24:53.650625 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2084/4045] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:24:53 2022] DELETE /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:24:53.671696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-79254461-cf68-4494-84ad-60c44aa77f79 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:53.672469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79254461-cf68-4494-84ad-60c44aa77f79 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:53.689849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79254461-cf68-4494-84ad-60c44aa77f79 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:53.695411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79254461-cf68-4494-84ad-60c44aa77f79 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:53.697349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79254461-cf68-4494-84ad-60c44aa77f79 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:53.698390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79254461-cf68-4494-84ad-60c44aa77f79 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:54.007173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-edc9168c-5999-456e-9d55-d305e7ed7afe tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:54.031761 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-edc9168c-5999-456e-9d55-d305e7ed7afe tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.597094 Jul 26 14:24:54.033646 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1962/4046] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:53 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:54.042432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c1f22b19-1430-4e18-9b38-2f0bf944fd42 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:54.043476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c1f22b19-1430-4e18-9b38-2f0bf944fd42 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:54.060045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1f22b19-1430-4e18-9b38-2f0bf944fd42 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:54.064265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1f22b19-1430-4e18-9b38-2f0bf944fd42 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:54.065757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1f22b19-1430-4e18-9b38-2f0bf944fd42 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:54.066479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1f22b19-1430-4e18-9b38-2f0bf944fd42 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:54.503827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-79254461-cf68-4494-84ad-60c44aa77f79 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:54.544168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-79254461-cf68-4494-84ad-60c44aa77f79 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:54.550599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-79254461-cf68-4494-84ad-60c44aa77f79 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:54.552661 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-79254461-cf68-4494-84ad-60c44aa77f79 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 0.892528 Jul 26 14:24:54.560662 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2085/4047] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:53 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:54.594568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-407c469c-8c9b-4470-9bf5-93b84c686de4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:54.595306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-407c469c-8c9b-4470-9bf5-93b84c686de4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:54.616635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-407c469c-8c9b-4470-9bf5-93b84c686de4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:54.624811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-407c469c-8c9b-4470-9bf5-93b84c686de4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:54.625973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-407c469c-8c9b-4470-9bf5-93b84c686de4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:54.632993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-407c469c-8c9b-4470-9bf5-93b84c686de4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:54.723182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c1f22b19-1430-4e18-9b38-2f0bf944fd42 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:54.740380 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c1f22b19-1430-4e18-9b38-2f0bf944fd42 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.699781 Jul 26 14:24:54.755987 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1963/4048] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:54 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:54.768529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7b292a3-1008-4561-9a4c-8c10d7263f55 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:54.769282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f7b292a3-1008-4561-9a4c-8c10d7263f55 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:54.785352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7b292a3-1008-4561-9a4c-8c10d7263f55 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:54.785897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7b292a3-1008-4561-9a4c-8c10d7263f55 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:54.787122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7b292a3-1008-4561-9a4c-8c10d7263f55 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:54.787720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7b292a3-1008-4561-9a4c-8c10d7263f55 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:54.812517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-407c469c-8c9b-4470-9bf5-93b84c686de4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:54.823495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-407c469c-8c9b-4470-9bf5-93b84c686de4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:54.825773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-407c469c-8c9b-4470-9bf5-93b84c686de4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:54.831863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:54.836451 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-407c469c-8c9b-4470-9bf5-93b84c686de4 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1443 microversion: 2.75 time: 0.255164 Jul 26 14:24:54.837877 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2086/4049] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:54 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1443 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:54.848173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-be8c291e-6166-4fd2-9264-fb74f41f3859 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:54.849820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-be8c291e-6166-4fd2-9264-fb74f41f3859 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:54.862409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be8c291e-6166-4fd2-9264-fb74f41f3859 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:54.863251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be8c291e-6166-4fd2-9264-fb74f41f3859 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:54.865756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be8c291e-6166-4fd2-9264-fb74f41f3859 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:54.866381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be8c291e-6166-4fd2-9264-fb74f41f3859 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:55.626830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f7b292a3-1008-4561-9a4c-8c10d7263f55 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:55.642239 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7b292a3-1008-4561-9a4c-8c10d7263f55 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1320 microversion: 2.1 time: 0.897966 Jul 26 14:24:55.643418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-be8c291e-6166-4fd2-9264-fb74f41f3859 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:55.645458 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1964/4050] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:54 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1320 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:55.657948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c589b4b4-bcc2-4982-910e-810677ea3803 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:55.659787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c589b4b4-bcc2-4982-910e-810677ea3803 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:55.665052 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-be8c291e-6166-4fd2-9264-fb74f41f3859 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.825369 Jul 26 14:24:55.673974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c589b4b4-bcc2-4982-910e-810677ea3803 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:55.675280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c589b4b4-bcc2-4982-910e-810677ea3803 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:55.677590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c589b4b4-bcc2-4982-910e-810677ea3803 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:55.678838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c589b4b4-bcc2-4982-910e-810677ea3803 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:55.683539 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2087/4051] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:54 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:55.692393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d186853f-a93c-431d-b701-b9974d789470 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:55.693817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d186853f-a93c-431d-b701-b9974d789470 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:55.705956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d186853f-a93c-431d-b701-b9974d789470 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:55.707088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d186853f-a93c-431d-b701-b9974d789470 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:55.708739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d186853f-a93c-431d-b701-b9974d789470 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:55.709542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d186853f-a93c-431d-b701-b9974d789470 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:56.099071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d186853f-a93c-431d-b701-b9974d789470 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:56.104415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c589b4b4-bcc2-4982-910e-810677ea3803 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:56.116024 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c589b4b4-bcc2-4982-910e-810677ea3803 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.468556 Jul 26 14:24:56.117282 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1965/4052] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:55 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:56.122425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-39a55966-1f76-417a-8f0d-e2ddcd4f926d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:56.123827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-39a55966-1f76-417a-8f0d-e2ddcd4f926d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:56.133455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d186853f-a93c-431d-b701-b9974d789470 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:56.138075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d186853f-a93c-431d-b701-b9974d789470 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:56.139613 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d186853f-a93c-431d-b701-b9974d789470 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1738 microversion: 2.20 time: 0.454602 Jul 26 14:24:56.150845 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2088/4053] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:55 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1738 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:56.150845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-03be0685-f3d5-4ee7-a1f6-f61c70c54d4a tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:56.150845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-03be0685-f3d5-4ee7-a1f6-f61c70c54d4a tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:56.157780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39a55966-1f76-417a-8f0d-e2ddcd4f926d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:56.160780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39a55966-1f76-417a-8f0d-e2ddcd4f926d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:56.163159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39a55966-1f76-417a-8f0d-e2ddcd4f926d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:56.164969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39a55966-1f76-417a-8f0d-e2ddcd4f926d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:56.166886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03be0685-f3d5-4ee7-a1f6-f61c70c54d4a tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:56.172370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03be0685-f3d5-4ee7-a1f6-f61c70c54d4a tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:56.174158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03be0685-f3d5-4ee7-a1f6-f61c70c54d4a tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:56.174931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03be0685-f3d5-4ee7-a1f6-f61c70c54d4a tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:56.459715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-03be0685-f3d5-4ee7-a1f6-f61c70c54d4a tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:56.478145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-03be0685-f3d5-4ee7-a1f6-f61c70c54d4a tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:56.481884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-03be0685-f3d5-4ee7-a1f6-f61c70c54d4a tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ffdb0dc0b95942f0bdf2827a7e5d90ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be3a6dbafcc476ba5c59ad294371d42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:56.497046 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-03be0685-f3d5-4ee7-a1f6-f61c70c54d4a tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 200 len: 1443 microversion: 2.75 time: 0.355106 Jul 26 14:24:56.503070 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2089/4054] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:56 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 1443 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:56.683475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-51f4fa94-2908-4c78-b44a-5f5e223fefe5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:56.686533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-51f4fa94-2908-4c78-b44a-5f5e223fefe5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:56.698187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51f4fa94-2908-4c78-b44a-5f5e223fefe5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:56.702987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51f4fa94-2908-4c78-b44a-5f5e223fefe5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:56.704194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51f4fa94-2908-4c78-b44a-5f5e223fefe5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:56.704820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51f4fa94-2908-4c78-b44a-5f5e223fefe5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:57.022683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-39a55966-1f76-417a-8f0d-e2ddcd4f926d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:57.043015 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-39a55966-1f76-417a-8f0d-e2ddcd4f926d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.923232 Jul 26 14:24:57.061012 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1966/4055] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:56 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:57.089313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c3122d1-47f9-46db-bd62-1fbab7352a06 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:57.090533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c3122d1-47f9-46db-bd62-1fbab7352a06 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:57.110581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c3122d1-47f9-46db-bd62-1fbab7352a06 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:57.111578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c3122d1-47f9-46db-bd62-1fbab7352a06 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:57.112320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c3122d1-47f9-46db-bd62-1fbab7352a06 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:57.112969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c3122d1-47f9-46db-bd62-1fbab7352a06 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:57.193385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:24:57.231284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c3122d1-47f9-46db-bd62-1fbab7352a06 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Locking {{(pid=119478) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 26 14:24:57.329363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-51f4fa94-2908-4c78-b44a-5f5e223fefe5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:57.361634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-51f4fa94-2908-4c78-b44a-5f5e223fefe5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1320 microversion: 2.1 time: 0.681925 Jul 26 14:24:57.373111 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2090/4056] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:56 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1320 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:24:57.382092 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2c3122d1-47f9-46db-bd62-1fbab7352a06 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.312290 Jul 26 14:24:57.389360 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1967/4057] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:57 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:24:57.396717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4299ecc7-9f88-44ea-9fdd-204cc2bd3b1c req-5bf4a174-965b-453e-a34a-0f9e508870e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e99675-d665-4660-aaf6-3e955d7bff55", "name": "network-vif-plugged", "status": "completed", "tag": "49a7674c-84cb-432f-bf7d-4ecd0d03924c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:57.401949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b0af64cc-d08b-4e8a-964c-3c487a25af09 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:57.403332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b0af64cc-d08b-4e8a-964c-3c487a25af09 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:57.414284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0af64cc-d08b-4e8a-964c-3c487a25af09 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:57.420737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0af64cc-d08b-4e8a-964c-3c487a25af09 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:57.422635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0af64cc-d08b-4e8a-964c-3c487a25af09 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:57.429901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0af64cc-d08b-4e8a-964c-3c487a25af09 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:57.473654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4299ecc7-9f88-44ea-9fdd-204cc2bd3b1c req-5bf4a174-965b-453e-a34a-0f9e508870e1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:57.477365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4299ecc7-9f88-44ea-9fdd-204cc2bd3b1c req-5bf4a174-965b-453e-a34a-0f9e508870e1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:57.508796 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4299ecc7-9f88-44ea-9fdd-204cc2bd3b1c req-5bf4a174-965b-453e-a34a-0f9e508870e1 service nova] Creating event network-vif-plugged:49a7674c-84cb-432f-bf7d-4ecd0d03924c for instance 27e99675-d665-4660-aaf6-3e955d7bff55 on n-h2-833090-9 Jul 26 14:24:57.533206 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4299ecc7-9f88-44ea-9fdd-204cc2bd3b1c req-5bf4a174-965b-453e-a34a-0f9e508870e1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157096 Jul 26 14:24:57.539205 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2091/4058] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:24:57.568138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ad5beb02-16cc-4738-abf3-7409bd712f76 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:57.569260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ad5beb02-16cc-4738-abf3-7409bd712f76 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:57.581669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad5beb02-16cc-4738-abf3-7409bd712f76 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:57.582442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad5beb02-16cc-4738-abf3-7409bd712f76 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:57.583686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad5beb02-16cc-4738-abf3-7409bd712f76 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:57.584474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad5beb02-16cc-4738-abf3-7409bd712f76 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:57.776625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b0af64cc-d08b-4e8a-964c-3c487a25af09 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:57.787621 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b0af64cc-d08b-4e8a-964c-3c487a25af09 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.395027 Jul 26 14:24:57.801004 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1968/4059] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:57 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:57.813022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-be5d1a56-efa8-4cb2-8878-9ad5ad425148 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:57.813706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-be5d1a56-efa8-4cb2-8878-9ad5ad425148 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:57.834079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be5d1a56-efa8-4cb2-8878-9ad5ad425148 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:57.834617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be5d1a56-efa8-4cb2-8878-9ad5ad425148 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:57.843635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be5d1a56-efa8-4cb2-8878-9ad5ad425148 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:57.844237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be5d1a56-efa8-4cb2-8878-9ad5ad425148 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:58.978243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-be5d1a56-efa8-4cb2-8878-9ad5ad425148 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:58.988514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-be5d1a56-efa8-4cb2-8878-9ad5ad425148 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.188109 Jul 26 14:24:59.001512 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1969/4060] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:57 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:59.009859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6310f052-ed14-4ad4-9aef-d96f3e10b104 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:59.021293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6310f052-ed14-4ad4-9aef-d96f3e10b104 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] [instance: 04986f19-0c0f-40ae-8da7-edca3919ff7b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:59.028128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6310f052-ed14-4ad4-9aef-d96f3e10b104 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:59.028590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6310f052-ed14-4ad4-9aef-d96f3e10b104 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:59.029391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6310f052-ed14-4ad4-9aef-d96f3e10b104 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:59.030695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6310f052-ed14-4ad4-9aef-d96f3e10b104 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:59.038831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ad5beb02-16cc-4738-abf3-7409bd712f76 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:59.057536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ad5beb02-16cc-4738-abf3-7409bd712f76 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:59.081757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ad5beb02-16cc-4738-abf3-7409bd712f76 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:59.083635 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ad5beb02-16cc-4738-abf3-7409bd712f76 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1720 microversion: 2.20 time: 1.540298 Jul 26 14:24:59.085762 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2092/4061] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:57 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1720 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:24:59.097055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-371e54a3-0d72-4788-9d15-3bd9bedd6bf5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:59.097957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-371e54a3-0d72-4788-9d15-3bd9bedd6bf5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:59.101829 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-6310f052-ed14-4ad4-9aef-d96f3e10b104 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] HTTP exception thrown: Instance 04986f19-0c0f-40ae-8da7-edca3919ff7b could not be found. Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6310f052-ed14-4ad4-9aef-d96f3e10b104 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Request method failure captured: Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b HTTP/1.1 Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_jqJyriyrZYMM7MUl2bfTANGUhFTpxtBGu2Q3fRFEDOHmsC4ky-JaDXLcTaYf3kM9qSYC3KOurqpL4_atXphGeS4uWyRrgSylhteqS00CpiLpXI9x-XTF2nKg1yJMXlPbOW1jef8BzaB9bT_kMXqagsf5n9QVZ3yNOphLxxreNajfw Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.75 Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3be3a6dbafcc476ba5c59ad294371d42 Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersAdmin275Test-1065487677 Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3be3a6dbafcc476ba5c59ad294371d42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3be3a6dbafcc476ba5c59ad294371d42"}]}, {"type": "tempest-type-1820505470", "name": "tempest-service-552232119", "endpoints": []}, {"type": "tempest-type-1341791494", "name": "tempest-service-1636622198", "endpoints": []}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3be3a6dbafcc476ba5c59ad294371d42", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3be3a6dbafcc476ba5c59ad294371d42"}]}] Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersAdmin275Test-1065487677 Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3be3a6dbafcc476ba5c59ad294371d42 Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersAdmin275Test-1065487677 Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersAdmin275Test-1065487677-project Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ffdb0dc0b95942f0bdf2827a7e5d90ec Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersAdmin275Test-1065487677-project Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 04986f19-0c0f-40ae-8da7-edca3919ff7b could not be found. Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '04986f19-0c0f-40ae-8da7-edca3919ff7b'} Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04986f19-0c0f-40ae-8da7-edca3919ff7b could not be found. Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:24:59.105956 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04986f19-0c0f-40ae-8da7-edca3919ff7b could not be found. Jul 26 14:24:59.119791 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:24:59.119791 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:24:59.119791 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:24:59.119791 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:59.119791 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:24:59.119791 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:24:59.119791 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:24:59.119791 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:24:59.119791 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04986f19-0c0f-40ae-8da7-edca3919ff7b could not be found. Jul 26 14:24:59.119791 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:24:59.122356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6310f052-ed14-4ad4-9aef-d96f3e10b104 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] Returning 404 to user: Instance 04986f19-0c0f-40ae-8da7-edca3919ff7b could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:24:59.125777 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6310f052-ed14-4ad4-9aef-d96f3e10b104 tempest-ServersAdmin275Test-1065487677 tempest-ServersAdmin275Test-1065487677-project] 10.222.0.70 "GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b" status: 404 len: 111 microversion: 2.75 time: 0.119472 Jul 26 14:24:59.127482 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1970/4062] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:24:59 2022] GET /compute/v2.1/servers/04986f19-0c0f-40ae-8da7-edca3919ff7b => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:24:59.164659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a72c7601-b68e-4a7c-8383-42a6e9b59980 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:24:59.165470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-371e54a3-0d72-4788-9d15-3bd9bedd6bf5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:59.166455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a72c7601-b68e-4a7c-8383-42a6e9b59980 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:24:59.178422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a72c7601-b68e-4a7c-8383-42a6e9b59980 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:59.179205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a72c7601-b68e-4a7c-8383-42a6e9b59980 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:59.180305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a72c7601-b68e-4a7c-8383-42a6e9b59980 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:59.181013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a72c7601-b68e-4a7c-8383-42a6e9b59980 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:59.183050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-371e54a3-0d72-4788-9d15-3bd9bedd6bf5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:59.184310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-371e54a3-0d72-4788-9d15-3bd9bedd6bf5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:59.184924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-371e54a3-0d72-4788-9d15-3bd9bedd6bf5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:59.789073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-371e54a3-0d72-4788-9d15-3bd9bedd6bf5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:24:59.815856 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-371e54a3-0d72-4788-9d15-3bd9bedd6bf5 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1320 microversion: 2.1 time: 0.720575 Jul 26 14:24:59.817208 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2093/4063] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:59 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1320 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:24:59.825435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-093f6a1f-06ae-41a9-9ee8-f20382662712 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:24:59.852703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-093f6a1f-06ae-41a9-9ee8-f20382662712 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:24:59.870254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-093f6a1f-06ae-41a9-9ee8-f20382662712 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:24:59.963442 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-093f6a1f-06ae-41a9-9ee8-f20382662712 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] HTTP exception thrown: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 is locked Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-093f6a1f-06ae-41a9-9ee8-f20382662712 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Request method failure captured: Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action HTTP/1.1 Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 15 Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_gD_hLe4yYjyVRRD_eA6GVhdkfPxR8QWOGH5r8qlmzIDnMNdav7H6cyUjImiXrhQxfxZUH7cQ6O-Q_HjYXSEPjTnvG-AJV6AUujNzHf_5Z-iAfA8ca1KbgHCM97U_us5Qw6rHC7uf5VCZWiCK90aIkJmCVd8nu-zDxyCpI_B9PliI4 Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_991c7f82c09446409408ca9d0638fcba", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}] Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-472121431 Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7b5b7e30e280492b85d9c8f98fe09e43 Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: {"os-stop": {}} Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 is locked Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c584bb0a-2fbb-4014-9f21-bcb83a0068c0', 'body': {'os-stop': {}}} Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 is locked Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 is locked Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 is locked Jul 26 14:24:59.969972 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:24:59.984225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-093f6a1f-06ae-41a9-9ee8-f20382662712 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Returning 409 to user: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 is locked {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:24:59.984225 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-093f6a1f-06ae-41a9-9ee8-f20382662712 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 409 len: 107 microversion: 2.1 time: 0.153298 Jul 26 14:24:59.984225 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2094/4064] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:59 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 107 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:25:00.009547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-504492c1-db57-4b5a-a19f-dc56b7c055fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:00.010633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-504492c1-db57-4b5a-a19f-dc56b7c055fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:00.026779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-504492c1-db57-4b5a-a19f-dc56b7c055fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:00.027321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-504492c1-db57-4b5a-a19f-dc56b7c055fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:00.028892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-504492c1-db57-4b5a-a19f-dc56b7c055fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:00.031018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-504492c1-db57-4b5a-a19f-dc56b7c055fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:00.072230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a72c7601-b68e-4a7c-8383-42a6e9b59980 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:00.100345 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a72c7601-b68e-4a7c-8383-42a6e9b59980 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.970430 Jul 26 14:25:00.103527 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1971/4065] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:24:59 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:00.157531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b154b366-8dcc-447f-8a7c-a6c126fd027c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:00.161519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b154b366-8dcc-447f-8a7c-a6c126fd027c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:00.194424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-504492c1-db57-4b5a-a19f-dc56b7c055fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Unlocking {{(pid=119479) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 26 14:25:00.198986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b154b366-8dcc-447f-8a7c-a6c126fd027c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:00.199594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b154b366-8dcc-447f-8a7c-a6c126fd027c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:00.202389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b154b366-8dcc-447f-8a7c-a6c126fd027c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:00.205801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b154b366-8dcc-447f-8a7c-a6c126fd027c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:00.444458 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-504492c1-db57-4b5a-a19f-dc56b7c055fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.462214 Jul 26 14:25:00.453421 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2095/4066] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:24:59 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:25:00.486026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-16253dfc-de71-4c51-88ef-da7b33c996de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:00.504219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16253dfc-de71-4c51-88ef-da7b33c996de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:00.509195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16253dfc-de71-4c51-88ef-da7b33c996de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:00.703306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-16253dfc-de71-4c51-88ef-da7b33c996de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Going to try to stop instance {{(pid=119479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:25:00.875452 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-16253dfc-de71-4c51-88ef-da7b33c996de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.419356 Jul 26 14:25:00.882778 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2096/4067] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:25:00 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:25:00.922745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bd646f25-ffe6-4754-a52c-d36638997513 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:00.924133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bd646f25-ffe6-4754-a52c-d36638997513 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:00.952290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd646f25-ffe6-4754-a52c-d36638997513 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:00.956471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd646f25-ffe6-4754-a52c-d36638997513 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:00.976161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd646f25-ffe6-4754-a52c-d36638997513 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:00.984476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd646f25-ffe6-4754-a52c-d36638997513 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:01.032318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b154b366-8dcc-447f-8a7c-a6c126fd027c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:01.118027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b154b366-8dcc-447f-8a7c-a6c126fd027c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:01.157578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b154b366-8dcc-447f-8a7c-a6c126fd027c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:01.173528 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b154b366-8dcc-447f-8a7c-a6c126fd027c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1720 microversion: 2.20 time: 1.046281 Jul 26 14:25:01.178943 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1972/4068] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:00 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1720 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:01.206803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fab881ae-8c9d-446b-aae4-97ab2d3d1ac1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:01.220158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fab881ae-8c9d-446b-aae4-97ab2d3d1ac1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:01.269704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fab881ae-8c9d-446b-aae4-97ab2d3d1ac1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:01.270963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fab881ae-8c9d-446b-aae4-97ab2d3d1ac1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:01.285614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fab881ae-8c9d-446b-aae4-97ab2d3d1ac1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:01.286393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fab881ae-8c9d-446b-aae4-97ab2d3d1ac1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:01.872856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bd646f25-ffe6-4754-a52c-d36638997513 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:01.886143 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bd646f25-ffe6-4754-a52c-d36638997513 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1320 microversion: 2.1 time: 0.999867 Jul 26 14:25:01.909782 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2097/4069] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:00 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1320 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:01.930714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-237e71bb-2810-4fb5-9def-b06b3d44ee54 req-4a5e5bdd-bfb4-427d-be14-82ddc5be9441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7576357-b5e0-45fb-9641-d397a6b3faf2", "name": "network-vif-unplugged", "status": "completed", "tag": "f88eaeb3-e484-4f96-b4ba-99b8b947950a"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:01.959350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-237e71bb-2810-4fb5-9def-b06b3d44ee54 req-4a5e5bdd-bfb4-427d-be14-82ddc5be9441 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:01.959968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-237e71bb-2810-4fb5-9def-b06b3d44ee54 req-4a5e5bdd-bfb4-427d-be14-82ddc5be9441 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:01.995680 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-237e71bb-2810-4fb5-9def-b06b3d44ee54 req-4a5e5bdd-bfb4-427d-be14-82ddc5be9441 service nova] Creating event network-vif-unplugged:f88eaeb3-e484-4f96-b4ba-99b8b947950a for instance d7576357-b5e0-45fb-9641-d397a6b3faf2 on n-h2-833090-9 Jul 26 14:25:02.011341 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-237e71bb-2810-4fb5-9def-b06b3d44ee54 req-4a5e5bdd-bfb4-427d-be14-82ddc5be9441 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092582 Jul 26 14:25:02.012856 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2098/4070] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:02.027603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1703c8c0-0cec-4236-9763-0354a029cf95 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:02.028370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1703c8c0-0cec-4236-9763-0354a029cf95 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:02.054671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1703c8c0-0cec-4236-9763-0354a029cf95 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:02.055770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1703c8c0-0cec-4236-9763-0354a029cf95 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:02.062053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1703c8c0-0cec-4236-9763-0354a029cf95 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:02.062940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1703c8c0-0cec-4236-9763-0354a029cf95 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:02.116134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fab881ae-8c9d-446b-aae4-97ab2d3d1ac1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:02.131570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=91,nova_cell1:UPDATE=5 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:02.135748 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fab881ae-8c9d-446b-aae4-97ab2d3d1ac1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.954927 Jul 26 14:25:02.146405 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1973/4071] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:01 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:02.218394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fea37041-64ac-4ec8-8c4a-7272d7ed5c70 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:02.239078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fea37041-64ac-4ec8-8c4a-7272d7ed5c70 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:02.261598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fea37041-64ac-4ec8-8c4a-7272d7ed5c70 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:02.263109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fea37041-64ac-4ec8-8c4a-7272d7ed5c70 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:02.265805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fea37041-64ac-4ec8-8c4a-7272d7ed5c70 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:02.266792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fea37041-64ac-4ec8-8c4a-7272d7ed5c70 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:02.936335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1703c8c0-0cec-4236-9763-0354a029cf95 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:02.949657 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1703c8c0-0cec-4236-9763-0354a029cf95 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.934362 Jul 26 14:25:02.981882 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2099/4072] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:02 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:02.993864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90f583e6-9c28-4e78-8397-c5102bbc1503 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:02.995095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-90f583e6-9c28-4e78-8397-c5102bbc1503 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:03.005913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90f583e6-9c28-4e78-8397-c5102bbc1503 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:03.006330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90f583e6-9c28-4e78-8397-c5102bbc1503 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:03.007394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90f583e6-9c28-4e78-8397-c5102bbc1503 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:03.008004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90f583e6-9c28-4e78-8397-c5102bbc1503 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:03.010266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fea37041-64ac-4ec8-8c4a-7272d7ed5c70 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:03.059413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fea37041-64ac-4ec8-8c4a-7272d7ed5c70 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:03.069671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fea37041-64ac-4ec8-8c4a-7272d7ed5c70 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:03.087068 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fea37041-64ac-4ec8-8c4a-7272d7ed5c70 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1720 microversion: 2.20 time: 0.875564 Jul 26 14:25:03.088768 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1974/4073] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:02 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1720 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:25:03.184424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d1908fa8-7517-4f8f-b117-480bbbf831fd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:03.193918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d1908fa8-7517-4f8f-b117-480bbbf831fd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:03.218552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1908fa8-7517-4f8f-b117-480bbbf831fd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:03.219844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1908fa8-7517-4f8f-b117-480bbbf831fd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:03.221186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1908fa8-7517-4f8f-b117-480bbbf831fd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:03.222002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1908fa8-7517-4f8f-b117-480bbbf831fd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:03.945855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90f583e6-9c28-4e78-8397-c5102bbc1503 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:03.968088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d1908fa8-7517-4f8f-b117-480bbbf831fd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:04.007398 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90f583e6-9c28-4e78-8397-c5102bbc1503 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1320 microversion: 2.1 time: 1.015262 Jul 26 14:25:04.008913 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2100/4074] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:02 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1320 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:04.019030 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d1908fa8-7517-4f8f-b117-480bbbf831fd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.840354 Jul 26 14:25:04.022747 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1975/4075] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:03 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:04.057930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-adcce1e3-ef5b-40cf-a8b2-bcbc2a178676 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:04.068382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-adcce1e3-ef5b-40cf-a8b2-bcbc2a178676 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:04.116859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adcce1e3-ef5b-40cf-a8b2-bcbc2a178676 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:04.117987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adcce1e3-ef5b-40cf-a8b2-bcbc2a178676 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:04.123042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adcce1e3-ef5b-40cf-a8b2-bcbc2a178676 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:04.123995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adcce1e3-ef5b-40cf-a8b2-bcbc2a178676 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:04.150281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff921d80-75e7-4ab4-9472-9ffd86aecd9f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:04.153648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ff921d80-75e7-4ab4-9472-9ffd86aecd9f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:04.192345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff921d80-75e7-4ab4-9472-9ffd86aecd9f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:04.193376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff921d80-75e7-4ab4-9472-9ffd86aecd9f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:04.203244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff921d80-75e7-4ab4-9472-9ffd86aecd9f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:04.204146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff921d80-75e7-4ab4-9472-9ffd86aecd9f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:04.792088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-adcce1e3-ef5b-40cf-a8b2-bcbc2a178676 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:04.816844 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-adcce1e3-ef5b-40cf-a8b2-bcbc2a178676 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.804386 Jul 26 14:25:04.817587 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2101/4076] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:04 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:04.834722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ff921d80-75e7-4ab4-9472-9ffd86aecd9f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:04.849149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ff921d80-75e7-4ab4-9472-9ffd86aecd9f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:04.850702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ff921d80-75e7-4ab4-9472-9ffd86aecd9f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:04.851930 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff921d80-75e7-4ab4-9472-9ffd86aecd9f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1723 microversion: 2.20 time: 0.711930 Jul 26 14:25:04.856354 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1976/4077] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:04 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1723 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:04.886322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-49899919-1f8a-4842-996f-715735f7cf1d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fa1cdba-c82c-4391-bbac-3b0bc8fb0d54"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:04.890612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-49899919-1f8a-4842-996f-715735f7cf1d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:04.899272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49899919-1f8a-4842-996f-715735f7cf1d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:04.900506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49899919-1f8a-4842-996f-715735f7cf1d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:04.901862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49899919-1f8a-4842-996f-715735f7cf1d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:04.908296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49899919-1f8a-4842-996f-715735f7cf1d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:05.052174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e711b3e5-71aa-41d2-990c-6c0de7bd43a7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:05.053640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e711b3e5-71aa-41d2-990c-6c0de7bd43a7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:05.097933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e711b3e5-71aa-41d2-990c-6c0de7bd43a7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:05.099094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e711b3e5-71aa-41d2-990c-6c0de7bd43a7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:05.105420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e711b3e5-71aa-41d2-990c-6c0de7bd43a7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:05.106999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e711b3e5-71aa-41d2-990c-6c0de7bd43a7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:05.562915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e711b3e5-71aa-41d2-990c-6c0de7bd43a7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:05.577413 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e711b3e5-71aa-41d2-990c-6c0de7bd43a7 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 200 len: 1509 microversion: 2.1 time: 0.529264 Jul 26 14:25:05.579050 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1977/4078] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:05 2022] GET /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 1509 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:05.599640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4f1c4bea-50cd-4a9a-81c9-c840e4298a10 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:05.601203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4f1c4bea-50cd-4a9a-81c9-c840e4298a10 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:05.611085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f1c4bea-50cd-4a9a-81c9-c840e4298a10 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:05.611556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f1c4bea-50cd-4a9a-81c9-c840e4298a10 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:05.612557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f1c4bea-50cd-4a9a-81c9-c840e4298a10 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:05.613362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f1c4bea-50cd-4a9a-81c9-c840e4298a10 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:05.859132 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-49899919-1f8a-4842-996f-715735f7cf1d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "POST /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.976361 Jul 26 14:25:05.870225 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2102/4079] 10.222.0.70 () {62 vars in 1364 bytes} [Tue Jul 26 14:25:04 2022] POST /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/os-volume_attachments => generated 188 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:25:05.885974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b0c7971-21c5-41ce-96f7-3fb7cfef9034 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:05.887083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7b0c7971-21c5-41ce-96f7-3fb7cfef9034 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 9bbfc464-3e82-4491-9b12-5d5043d07faf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:05.901004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b0c7971-21c5-41ce-96f7-3fb7cfef9034 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:05.901637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b0c7971-21c5-41ce-96f7-3fb7cfef9034 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:05.903002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b0c7971-21c5-41ce-96f7-3fb7cfef9034 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:05.904134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b0c7971-21c5-41ce-96f7-3fb7cfef9034 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:05.917997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4f1c4bea-50cd-4a9a-81c9-c840e4298a10 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:05.954043 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4f1c4bea-50cd-4a9a-81c9-c840e4298a10 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.373014 Jul 26 14:25:05.965476 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1978/4080] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:05 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:05.985423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0847a20f-bfb5-478b-831c-784c40f11011 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:05.986556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0847a20f-bfb5-478b-831c-784c40f11011 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:06.022384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0847a20f-bfb5-478b-831c-784c40f11011 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:06.023605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0847a20f-bfb5-478b-831c-784c40f11011 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:06.025298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0847a20f-bfb5-478b-831c-784c40f11011 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:06.026280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0847a20f-bfb5-478b-831c-784c40f11011 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:06.505626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b0c7971-21c5-41ce-96f7-3fb7cfef9034 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:06.521955 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b0c7971-21c5-41ce-96f7-3fb7cfef9034 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/9bbfc464-3e82-4491-9b12-5d5043d07faf" status: 200 len: 1508 microversion: 2.1 time: 0.649492 Jul 26 14:25:06.523139 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2103/4081] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:05 2022] GET /compute/v2.1/servers/9bbfc464-3e82-4491-9b12-5d5043d07faf => generated 1508 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:06.572661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f113a93-3249-4d92-a06a-7cb668c963c0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:06.575482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f113a93-3249-4d92-a06a-7cb668c963c0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:06.597333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f113a93-3249-4d92-a06a-7cb668c963c0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:06.599805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f113a93-3249-4d92-a06a-7cb668c963c0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:06.600981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f113a93-3249-4d92-a06a-7cb668c963c0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:06.604367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f113a93-3249-4d92-a06a-7cb668c963c0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:06.682989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0847a20f-bfb5-478b-831c-784c40f11011 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:06.698046 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0847a20f-bfb5-478b-831c-784c40f11011 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.730544 Jul 26 14:25:06.700280 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1979/4082] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:05 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:06.714903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1a900d0c-2c30-4a10-95a2-282576add13b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:06.716119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1a900d0c-2c30-4a10-95a2-282576add13b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 9bbfc464-3e82-4491-9b12-5d5043d07faf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:06.744081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a900d0c-2c30-4a10-95a2-282576add13b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:06.744882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a900d0c-2c30-4a10-95a2-282576add13b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:06.748678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a900d0c-2c30-4a10-95a2-282576add13b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:06.750078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a900d0c-2c30-4a10-95a2-282576add13b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:06.831477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1a900d0c-2c30-4a10-95a2-282576add13b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 9bbfc464-3e82-4491-9b12-5d5043d07faf] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:25:06.945139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=92,nova_cell1:UPDATE=5 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:07.032748 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1a900d0c-2c30-4a10-95a2-282576add13b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9bbfc464-3e82-4491-9b12-5d5043d07faf" status: 204 len: 0 microversion: 2.1 time: 0.326234 Jul 26 14:25:07.034591 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1980/4083] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:25:06 2022] DELETE /compute/v2.1/servers/9bbfc464-3e82-4491-9b12-5d5043d07faf => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:25:07.051013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7f50f4ad-04a0-4195-ba87-ef5961dc5345 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:07.052134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7f50f4ad-04a0-4195-ba87-ef5961dc5345 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:07.059879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f50f4ad-04a0-4195-ba87-ef5961dc5345 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:07.061524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f50f4ad-04a0-4195-ba87-ef5961dc5345 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:07.062739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f50f4ad-04a0-4195-ba87-ef5961dc5345 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:07.063399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f50f4ad-04a0-4195-ba87-ef5961dc5345 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:07.318123 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f113a93-3249-4d92-a06a-7cb668c963c0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/os-volume_attachments/9fa1cdba-c82c-4391-bbac-3b0bc8fb0d54" status: 202 len: 0 microversion: 2.20 time: 0.781026 Jul 26 14:25:07.321588 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2104/4084] 10.222.0.70 () {60 vars in 1457 bytes} [Tue Jul 26 14:25:06 2022] DELETE /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/os-volume_attachments/9fa1cdba-c82c-4391-bbac-3b0bc8fb0d54 => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:25:07.363879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a43a0781-cfd5-4732-8571-f317ee8df47a tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:07.364533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a43a0781-cfd5-4732-8571-f317ee8df47a tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:07.382763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a43a0781-cfd5-4732-8571-f317ee8df47a tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:07.383393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a43a0781-cfd5-4732-8571-f317ee8df47a tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:07.384284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a43a0781-cfd5-4732-8571-f317ee8df47a tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:07.384748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a43a0781-cfd5-4732-8571-f317ee8df47a tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:07.471405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a43a0781-cfd5-4732-8571-f317ee8df47a tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 27e99675-d665-4660-aaf6-3e955d7bff55] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:25:07.554427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7f50f4ad-04a0-4195-ba87-ef5961dc5345 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:07.566172 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7f50f4ad-04a0-4195-ba87-ef5961dc5345 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.527049 Jul 26 14:25:07.567010 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1981/4085] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:07 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:07.573332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05634a06-5254-41f5-bdd3-40358157daa6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:07.575969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05634a06-5254-41f5-bdd3-40358157daa6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:07.590045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05634a06-5254-41f5-bdd3-40358157daa6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:07.592882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05634a06-5254-41f5-bdd3-40358157daa6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:07.596563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05634a06-5254-41f5-bdd3-40358157daa6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:07.601032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05634a06-5254-41f5-bdd3-40358157daa6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:07.723155 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a43a0781-cfd5-4732-8571-f317ee8df47a tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "DELETE /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55" status: 204 len: 0 microversion: 2.1 time: 0.393393 Jul 26 14:25:07.727445 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2105/4086] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:25:07 2022] DELETE /compute/v2.1/servers/27e99675-d665-4660-aaf6-3e955d7bff55 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:25:07.754915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a4d23ad1-40a5-4359-b03e-db1e01995455 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:07.760334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a4d23ad1-40a5-4359-b03e-db1e01995455 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:07.768715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4d23ad1-40a5-4359-b03e-db1e01995455 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:07.769173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4d23ad1-40a5-4359-b03e-db1e01995455 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:07.778706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4d23ad1-40a5-4359-b03e-db1e01995455 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:07.779229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4d23ad1-40a5-4359-b03e-db1e01995455 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:07.787074 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05634a06-5254-41f5-bdd3-40358157daa6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "POST /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/action" status: 202 len: 0 microversion: 2.20 time: 0.218751 Jul 26 14:25:07.799668 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1982/4087] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:25:07 2022] POST /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:25:07.805817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d769d7f5-0a8f-4160-b2ec-d3beed02b3f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:07.806611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d769d7f5-0a8f-4160-b2ec-d3beed02b3f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:07.831923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d769d7f5-0a8f-4160-b2ec-d3beed02b3f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:07.835729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d769d7f5-0a8f-4160-b2ec-d3beed02b3f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:07.836763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d769d7f5-0a8f-4160-b2ec-d3beed02b3f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:07.840868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d769d7f5-0a8f-4160-b2ec-d3beed02b3f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:08.470205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d769d7f5-0a8f-4160-b2ec-d3beed02b3f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:08.503251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d769d7f5-0a8f-4160-b2ec-d3beed02b3f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:08.507583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d769d7f5-0a8f-4160-b2ec-d3beed02b3f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:08.513043 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d769d7f5-0a8f-4160-b2ec-d3beed02b3f5 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1671 microversion: 2.20 time: 0.711720 Jul 26 14:25:08.514522 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1983/4088] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:07 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1671 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:08.535892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-06d944c5-b2b0-47db-8c4e-8bf1966ba6db tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:08.541217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-06d944c5-b2b0-47db-8c4e-8bf1966ba6db tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:08.564161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06d944c5-b2b0-47db-8c4e-8bf1966ba6db tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:08.565414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06d944c5-b2b0-47db-8c4e-8bf1966ba6db tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:08.566996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06d944c5-b2b0-47db-8c4e-8bf1966ba6db tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:08.572453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06d944c5-b2b0-47db-8c4e-8bf1966ba6db tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:08.575028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a4d23ad1-40a5-4359-b03e-db1e01995455 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:08.585946 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a4d23ad1-40a5-4359-b03e-db1e01995455 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.844012 Jul 26 14:25:08.590987 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2106/4089] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:07 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:08.605165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1181424909", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "1e1c7e35-16bc-4bef-80ea-3c836e95638f"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:08.640941 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-06d944c5-b2b0-47db-8c4e-8bf1966ba6db tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] HTTP exception thrown: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-06d944c5-b2b0-47db-8c4e-8bf1966ba6db tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Request method failure captured: Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 HTTP/1.1 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_d6T8VZKBb8m2yG8UhihAKahu2diKCDTqfV5O1nxR9IS_cNJHUVT9axTIwGI7toxkAmOzeU3-XMFyDzn4808gDiE04M5pY2yTs9RrVmh1DPWCHOTt8kcxLBeq8t9vx5sFeTwGODds0KleJ2s6kJJwuEE-XOS8u9YG22U1yxrO86JU4 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_36cdecfd17974d588bc69d8e369a7fd1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}] Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 0a19594a069a4981b97987a892d918e1 Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049'} Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:25:08.650194 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:25:08.658199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:08.663459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-06d944c5-b2b0-47db-8c4e-8bf1966ba6db tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Returning 404 to user: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:25:08.665810 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-06d944c5-b2b0-47db-8c4e-8bf1966ba6db tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 404 len: 111 microversion: 2.1 time: 0.146381 Jul 26 14:25:08.673058 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1984/4090] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:25:08 2022] DELETE /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:25:08.694067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c8a5713f-7ea5-4b91-b910-8abb8bdeb22b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:08.694067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c8a5713f-7ea5-4b91-b910-8abb8bdeb22b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:08.725388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8a5713f-7ea5-4b91-b910-8abb8bdeb22b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:08.727519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8a5713f-7ea5-4b91-b910-8abb8bdeb22b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:08.745621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8a5713f-7ea5-4b91-b910-8abb8bdeb22b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:08.748731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8a5713f-7ea5-4b91-b910-8abb8bdeb22b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:08.754790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] validate_networks() for [('1e1c7e35-16bc-4bef-80ea-3c836e95638f', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:25:09.506090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c8a5713f-7ea5-4b91-b910-8abb8bdeb22b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:09.533984 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c8a5713f-7ea5-4b91-b910-8abb8bdeb22b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.858365 Jul 26 14:25:09.536854 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1985/4091] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:08 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:09.546442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-352dd974-dded-428e-9084-954a551b8d4b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:09.547409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-352dd974-dded-428e-9084-954a551b8d4b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:09.558080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-352dd974-dded-428e-9084-954a551b8d4b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:09.559100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-352dd974-dded-428e-9084-954a551b8d4b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:09.560434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-352dd974-dded-428e-9084-954a551b8d4b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:09.561086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-352dd974-dded-428e-9084-954a551b8d4b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:09.587549 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-352dd974-dded-428e-9084-954a551b8d4b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] HTTP exception thrown: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-352dd974-dded-428e-9084-954a551b8d4b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Request method failure captured: Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 HTTP/1.1 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_d6T8VZKBb8m2yG8UhihAKahu2diKCDTqfV5O1nxR9IS_cNJHUVT9axTIwGI7toxkAmOzeU3-XMFyDzn4808gDiE04M5pY2yTs9RrVmh1DPWCHOTt8kcxLBeq8t9vx5sFeTwGODds0KleJ2s6kJJwuEE-XOS8u9YG22U1yxrO86JU4 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_36cdecfd17974d588bc69d8e369a7fd1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}] Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 0a19594a069a4981b97987a892d918e1 Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049'} Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:09.591169 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:09.598994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:09.598994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:09.598994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:09.598994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:25:09.598994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:25:09.598994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. Jul 26 14:25:09.598994 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:09.601772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-352dd974-dded-428e-9084-954a551b8d4b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Returning 404 to user: Instance cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:25:09.603426 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-352dd974-dded-428e-9084-954a551b8d4b tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049" status: 404 len: 111 microversion: 2.1 time: 0.064648 Jul 26 14:25:09.604574 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1986/4092] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:09 2022] GET /compute/v2.1/servers/cc3d7bb5-6680-4c35-a0a4-1e57d3c3b049 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:25:09.775102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1285790333", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:09.953428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:25:10.239681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:25:10.244822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:25:10.249940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:25:10.251151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:25:10.253761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:25:10.277188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:10.277992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:10.279777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:10.280685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:10.336557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Getting quotas for project e7f0a862c2bf490886e8a6bb2411a29e. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:25:10.346163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Getting quotas for user 9fe21380ccc24827b47f5d5c199fc114 and project e7f0a862c2bf490886e8a6bb2411a29e. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:25:10.376852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Going to run 2 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:25:10.381369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:25:10.453553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: da3c31ea-55d3-4814-9883-6544bd8c7f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=944efc3d-093a-44a9-b7e6-ddd2083f6f88,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:25:10.626386 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7f9ec236-dbb9-47c9-8459-0ca693d07796 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.033976 Jul 26 14:25:10.627030 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2107/4093] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:25:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 2035 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 26 14:25:10.641951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eb3952f0-9a5d-49bc-9a3f-66cdd06288e1 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:10.643368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eb3952f0-9a5d-49bc-9a3f-66cdd06288e1 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:10.661375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb3952f0-9a5d-49bc-9a3f-66cdd06288e1 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:10.662100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb3952f0-9a5d-49bc-9a3f-66cdd06288e1 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:10.663281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb3952f0-9a5d-49bc-9a3f-66cdd06288e1 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:10.664175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb3952f0-9a5d-49bc-9a3f-66cdd06288e1 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:11.208344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb3952f0-9a5d-49bc-9a3f-66cdd06288e1 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:11.229559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb3952f0-9a5d-49bc-9a3f-66cdd06288e1 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:11.231165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb3952f0-9a5d-49bc-9a3f-66cdd06288e1 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:11.233281 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eb3952f0-9a5d-49bc-9a3f-66cdd06288e1 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1673 microversion: 2.20 time: 0.601648 Jul 26 14:25:11.243124 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2108/4094] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:10 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1673 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:11.257660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-52cffd4c-a060-499b-86f7-44506b837190 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:11.258322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-52cffd4c-a060-499b-86f7-44506b837190 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:11.283294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52cffd4c-a060-499b-86f7-44506b837190 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:11.284492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52cffd4c-a060-499b-86f7-44506b837190 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:11.286875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52cffd4c-a060-499b-86f7-44506b837190 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:11.287505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52cffd4c-a060-499b-86f7-44506b837190 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:11.802980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:25:11.803674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:25:11.804323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:25:11.805727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:25:11.806438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:25:11.831319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:11.832251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:11.833342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:11.835512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:11.866491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Getting quotas for project d2cac47fd5cf4c93a0ea6ee5b1d41642. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:25:11.879336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Getting quotas for user 8589a1f1945945cc91bdf4485a9dde53 and project d2cac47fd5cf4c93a0ea6ee5b1d41642. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:25:11.923924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:25:11.933314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:25:12.016986 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e73737d1-7d1b-4702-8b87-761b273c366d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.410491 Jul 26 14:25:12.018444 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1987/4095] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:25:12.028791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f84258ea-68b3-4e99-884a-babebf712a13 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:12.038897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f84258ea-68b3-4e99-884a-babebf712a13 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:12.057451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:12.080527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f84258ea-68b3-4e99-884a-babebf712a13 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:12.090656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f84258ea-68b3-4e99-884a-babebf712a13 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:12.096304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f84258ea-68b3-4e99-884a-babebf712a13 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:12.097192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f84258ea-68b3-4e99-884a-babebf712a13 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:12.737230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-52cffd4c-a060-499b-86f7-44506b837190 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:12.748946 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-52cffd4c-a060-499b-86f7-44506b837190 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 1.494764 Jul 26 14:25:12.769352 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2109/4096] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:11 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:12.775630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ad243190-6569-4642-9368-8a8873b32dcb tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:12.782787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ad243190-6569-4642-9368-8a8873b32dcb tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:12.784580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ad243190-6569-4642-9368-8a8873b32dcb tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Searching by: {'deleted': False, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:25:12.796128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad243190-6569-4642-9368-8a8873b32dcb tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:12.799162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad243190-6569-4642-9368-8a8873b32dcb tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:12.801139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad243190-6569-4642-9368-8a8873b32dcb tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:12.803773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad243190-6569-4642-9368-8a8873b32dcb tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:12.849271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:12.854630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-ad243190-6569-4642-9368-8a8873b32dcb tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:25:12.927100 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ad243190-6569-4642-9368-8a8873b32dcb tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1005 microversion: 2.1 time: 0.156095 Jul 26 14:25:12.928911 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2110/4097] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:25:12 2022] GET /compute/v2.1/servers => generated 1005 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:12.936938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f133eaca-50fb-4a83-8456-af4df4c47b06 req-db9ce305-90f3-4f8a-8a01-02fb7ba69886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bbfc464-3e82-4491-9b12-5d5043d07faf", "name": "network-vif-deleted", "tag": "ef85d382-c184-4c9f-80cd-d658e04e7494"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:12.959260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f133eaca-50fb-4a83-8456-af4df4c47b06 req-db9ce305-90f3-4f8a-8a01-02fb7ba69886 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:12.960353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f133eaca-50fb-4a83-8456-af4df4c47b06 req-db9ce305-90f3-4f8a-8a01-02fb7ba69886 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:12.986359 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f133eaca-50fb-4a83-8456-af4df4c47b06 req-db9ce305-90f3-4f8a-8a01-02fb7ba69886 service nova] Creating event network-vif-deleted:ef85d382-c184-4c9f-80cd-d658e04e7494 for instance 9bbfc464-3e82-4491-9b12-5d5043d07faf on n-h1-833090-9 Jul 26 14:25:12.993935 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f133eaca-50fb-4a83-8456-af4df4c47b06 req-db9ce305-90f3-4f8a-8a01-02fb7ba69886 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062890 Jul 26 14:25:12.995318 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2111/4098] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:13.027286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b3a02f38-767b-4c69-8e21-f41288c18aa9 req-ba79696b-8288-462f-b3fd-b43266881777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e99675-d665-4660-aaf6-3e955d7bff55", "name": "network-vif-deleted", "tag": "49a7674c-84cb-432f-bf7d-4ecd0d03924c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:13.058007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b3a02f38-767b-4c69-8e21-f41288c18aa9 req-ba79696b-8288-462f-b3fd-b43266881777 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:13.058534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b3a02f38-767b-4c69-8e21-f41288c18aa9 req-ba79696b-8288-462f-b3fd-b43266881777 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:13.096313 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b3a02f38-767b-4c69-8e21-f41288c18aa9 req-ba79696b-8288-462f-b3fd-b43266881777 service nova] Creating event network-vif-deleted:49a7674c-84cb-432f-bf7d-4ecd0d03924c for instance 27e99675-d665-4660-aaf6-3e955d7bff55 on n-h2-833090-9 Jul 26 14:25:13.125192 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b3a02f38-767b-4c69-8e21-f41288c18aa9 req-ba79696b-8288-462f-b3fd-b43266881777 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123997 Jul 26 14:25:13.127643 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2112/4099] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:13.159005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d92c8f7-b973-4366-93e0-a7e832ae9018 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:13.166242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d92c8f7-b973-4366-93e0-a7e832ae9018 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:13.194288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d92c8f7-b973-4366-93e0-a7e832ae9018 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:13.195082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d92c8f7-b973-4366-93e0-a7e832ae9018 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:13.201380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d92c8f7-b973-4366-93e0-a7e832ae9018 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:13.206902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d92c8f7-b973-4366-93e0-a7e832ae9018 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:13.417438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f84258ea-68b3-4e99-884a-babebf712a13 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:13.447003 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f84258ea-68b3-4e99-884a-babebf712a13 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1654 microversion: 2.1 time: 1.427027 Jul 26 14:25:13.448243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d92c8f7-b973-4366-93e0-a7e832ae9018 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:13.452755 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1988/4100] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:12 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1654 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:13.464703 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d92c8f7-b973-4366-93e0-a7e832ae9018 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1226 microversion: 2.1 time: 0.335382 Jul 26 14:25:13.465846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-056108d9-a667-4ada-b5b5-70d7f0d7712f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:13.466245 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2113/4101] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:13 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1226 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:13.477065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-056108d9-a667-4ada-b5b5-70d7f0d7712f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:13.492526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-560578ec-03ff-4a18-958f-a49a3aee3ef8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:13.495141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-560578ec-03ff-4a18-958f-a49a3aee3ef8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:13.504630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-056108d9-a667-4ada-b5b5-70d7f0d7712f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:13.505634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-056108d9-a667-4ada-b5b5-70d7f0d7712f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:13.508495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-056108d9-a667-4ada-b5b5-70d7f0d7712f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:13.509208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-056108d9-a667-4ada-b5b5-70d7f0d7712f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:13.534498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-560578ec-03ff-4a18-958f-a49a3aee3ef8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:13.536078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-560578ec-03ff-4a18-958f-a49a3aee3ef8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:13.541896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-560578ec-03ff-4a18-958f-a49a3aee3ef8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:13.542783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-560578ec-03ff-4a18-958f-a49a3aee3ef8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:13.844605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-560578ec-03ff-4a18-958f-a49a3aee3ef8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:13.858632 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-560578ec-03ff-4a18-958f-a49a3aee3ef8 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1278 microversion: 2.1 time: 0.389637 Jul 26 14:25:13.863078 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2114/4102] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:13 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1278 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:13.877035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-020168f1-7970-4fd3-8337-bdd406ffaac5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:13.893271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-020168f1-7970-4fd3-8337-bdd406ffaac5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:13.894026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-020168f1-7970-4fd3-8337-bdd406ffaac5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:13.951347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-020168f1-7970-4fd3-8337-bdd406ffaac5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Going to try to start instance {{(pid=119479) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 14:25:14.066339 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-020168f1-7970-4fd3-8337-bdd406ffaac5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.200907 Jul 26 14:25:14.071264 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2115/4103] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:25:13 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:25:14.080593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-333c4003-f34a-4985-befa-f2723fb02ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:14.082865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-333c4003-f34a-4985-befa-f2723fb02ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:14.094515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-333c4003-f34a-4985-befa-f2723fb02ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:14.095781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-333c4003-f34a-4985-befa-f2723fb02ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:14.097954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-333c4003-f34a-4985-befa-f2723fb02ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:14.099035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-333c4003-f34a-4985-befa-f2723fb02ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:15.245591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-056108d9-a667-4ada-b5b5-70d7f0d7712f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:15.273108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-056108d9-a667-4ada-b5b5-70d7f0d7712f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:15.276093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-056108d9-a667-4ada-b5b5-70d7f0d7712f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:15.278053 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-056108d9-a667-4ada-b5b5-70d7f0d7712f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 1.823057 Jul 26 14:25:15.279479 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1989/4104] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:13 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:15.286624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7fcec789-4ad4-4a25-843a-98c208becb9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:15.287728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7fcec789-4ad4-4a25-843a-98c208becb9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:15.296677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fcec789-4ad4-4a25-843a-98c208becb9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:15.297549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fcec789-4ad4-4a25-843a-98c208becb9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:15.298777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fcec789-4ad4-4a25-843a-98c208becb9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:15.299571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fcec789-4ad4-4a25-843a-98c208becb9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:15.366207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-333c4003-f34a-4985-befa-f2723fb02ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:15.386604 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-333c4003-f34a-4985-befa-f2723fb02ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 1.312342 Jul 26 14:25:15.389431 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2116/4105] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:14 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:15.413939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c31f0d42-6f4e-4c1f-ac9f-60f30e9415fe tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:15.416312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c31f0d42-6f4e-4c1f-ac9f-60f30e9415fe tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:15.440463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c31f0d42-6f4e-4c1f-ac9f-60f30e9415fe tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:15.441356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c31f0d42-6f4e-4c1f-ac9f-60f30e9415fe tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:15.443075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c31f0d42-6f4e-4c1f-ac9f-60f30e9415fe tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:15.444273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c31f0d42-6f4e-4c1f-ac9f-60f30e9415fe tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:15.683937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c31f0d42-6f4e-4c1f-ac9f-60f30e9415fe tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:15.700885 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c31f0d42-6f4e-4c1f-ac9f-60f30e9415fe tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1280 microversion: 2.1 time: 0.306464 Jul 26 14:25:15.702219 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2117/4106] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:15 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1280 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:15.726681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-67fa41ee-0c35-4a71-83f9-d01ee19a0539 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:15.727803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-67fa41ee-0c35-4a71-83f9-d01ee19a0539 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:15.748741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67fa41ee-0c35-4a71-83f9-d01ee19a0539 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:15.753133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67fa41ee-0c35-4a71-83f9-d01ee19a0539 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:15.754157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67fa41ee-0c35-4a71-83f9-d01ee19a0539 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:15.754636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67fa41ee-0c35-4a71-83f9-d01ee19a0539 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:16.172807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-67fa41ee-0c35-4a71-83f9-d01ee19a0539 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:16.187115 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-67fa41ee-0c35-4a71-83f9-d01ee19a0539 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1276 microversion: 2.1 time: 0.482293 Jul 26 14:25:16.188063 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2118/4107] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:15 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1276 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:16.197119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1695c145-7186-4671-b8f9-3658dc512d63 req-9364eafb-e9f8-41e0-9cdb-37107b0502d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7576357-b5e0-45fb-9641-d397a6b3faf2", "tag": "f88eaeb3-e484-4f96-b4ba-99b8b947950a"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:16.218825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1695c145-7186-4671-b8f9-3658dc512d63 req-9364eafb-e9f8-41e0-9cdb-37107b0502d9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:16.220081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1695c145-7186-4671-b8f9-3658dc512d63 req-9364eafb-e9f8-41e0-9cdb-37107b0502d9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:16.254729 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1695c145-7186-4671-b8f9-3658dc512d63 req-9364eafb-e9f8-41e0-9cdb-37107b0502d9 service nova] Creating event network-changed:f88eaeb3-e484-4f96-b4ba-99b8b947950a for instance d7576357-b5e0-45fb-9641-d397a6b3faf2 on n-h1-833090-9 Jul 26 14:25:16.262949 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1695c145-7186-4671-b8f9-3658dc512d63 req-9364eafb-e9f8-41e0-9cdb-37107b0502d9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073195 Jul 26 14:25:16.264449 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2119/4108] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:16.272327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b05a6bd3-41fc-467a-be2e-36152a19f43f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:16.273473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b05a6bd3-41fc-467a-be2e-36152a19f43f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:16.291037 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b05a6bd3-41fc-467a-be2e-36152a19f43f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:16.291897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b05a6bd3-41fc-467a-be2e-36152a19f43f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:16.292958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b05a6bd3-41fc-467a-be2e-36152a19f43f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:16.293649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b05a6bd3-41fc-467a-be2e-36152a19f43f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:16.325266 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-b05a6bd3-41fc-467a-be2e-36152a19f43f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] HTTP exception thrown: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b05a6bd3-41fc-467a-be2e-36152a19f43f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Request method failure captured: Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba HTTP/1.1 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_d6T8VZKBb8m2yG8UhihAKahu2diKCDTqfV5O1nxR9IS_cNJHUVT9axTIwGI7toxkAmOzeU3-XMFyDzn4808gDiE04M5pY2yTs9RrVmh1DPWCHOTt8kcxLBeq8t9vx5sFeTwGODds0KleJ2s6kJJwuEE-XOS8u9YG22U1yxrO86JU4 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_36cdecfd17974d588bc69d8e369a7fd1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}] Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 0a19594a069a4981b97987a892d918e1 Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '0b34e8fe-9a39-4c51-80fe-5f03e674baba'} Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:25:16.327855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:25:16.330875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b05a6bd3-41fc-467a-be2e-36152a19f43f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Returning 404 to user: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:25:16.332722 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b05a6bd3-41fc-467a-be2e-36152a19f43f tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 404 len: 111 microversion: 2.1 time: 0.064082 Jul 26 14:25:16.332722 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2120/4109] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:25:16 2022] DELETE /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:25:16.340103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f39d5723-957c-4e00-80e8-125901d9dd0b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:16.340288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f39d5723-957c-4e00-80e8-125901d9dd0b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:16.350504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f39d5723-957c-4e00-80e8-125901d9dd0b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:16.351346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f39d5723-957c-4e00-80e8-125901d9dd0b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:16.352144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f39d5723-957c-4e00-80e8-125901d9dd0b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:16.352251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f39d5723-957c-4e00-80e8-125901d9dd0b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:16.450453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7fcec789-4ad4-4a25-843a-98c208becb9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:16.463734 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7fcec789-4ad4-4a25-843a-98c208becb9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1663 microversion: 2.1 time: 1.181828 Jul 26 14:25:16.487324 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1990/4110] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:15 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1663 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:16.499064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c62f2609-c534-4c44-8952-744d294fa00d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:16.499708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c62f2609-c534-4c44-8952-744d294fa00d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] [instance: 0b34e8fe-9a39-4c51-80fe-5f03e674baba] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:16.512662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c62f2609-c534-4c44-8952-744d294fa00d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:16.513170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c62f2609-c534-4c44-8952-744d294fa00d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:16.514559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c62f2609-c534-4c44-8952-744d294fa00d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:16.518228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c62f2609-c534-4c44-8952-744d294fa00d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:16.549358 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c62f2609-c534-4c44-8952-744d294fa00d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] HTTP exception thrown: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c62f2609-c534-4c44-8952-744d294fa00d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Request method failure captured: Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba HTTP/1.1 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_d6T8VZKBb8m2yG8UhihAKahu2diKCDTqfV5O1nxR9IS_cNJHUVT9axTIwGI7toxkAmOzeU3-XMFyDzn4808gDiE04M5pY2yTs9RrVmh1DPWCHOTt8kcxLBeq8t9vx5sFeTwGODds0KleJ2s6kJJwuEE-XOS8u9YG22U1yxrO86JU4 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/36cdecfd17974d588bc69d8e369a7fd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_36cdecfd17974d588bc69d8e369a7fd1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/36cdecfd17974d588bc69d8e369a7fd1"}]}] Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 36cdecfd17974d588bc69d8e369a7fd1 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1400276866 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 0a19594a069a4981b97987a892d918e1 Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeTestJSON-1400276866-project Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '0b34e8fe-9a39-4c51-80fe-5f03e674baba'} Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:16.551196 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:16.554879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:16.554879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:16.554879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:16.554879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:25:16.554879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:25:16.554879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. Jul 26 14:25:16.554879 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:16.556284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c62f2609-c534-4c44-8952-744d294fa00d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] Returning 404 to user: Instance 0b34e8fe-9a39-4c51-80fe-5f03e674baba could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:25:16.557683 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c62f2609-c534-4c44-8952-744d294fa00d tempest-AttachVolumeTestJSON-1400276866 tempest-AttachVolumeTestJSON-1400276866-project] 10.222.0.70 "GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba" status: 404 len: 111 microversion: 2.1 time: 0.070610 Jul 26 14:25:16.558421 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1991/4111] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:16 2022] GET /compute/v2.1/servers/0b34e8fe-9a39-4c51-80fe-5f03e674baba => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:25:16.570435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-794d5799-c0a1-426e-b50f-556a2d4b32f3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:16.571296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-794d5799-c0a1-426e-b50f-556a2d4b32f3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:16.578000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-794d5799-c0a1-426e-b50f-556a2d4b32f3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:16.578665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-794d5799-c0a1-426e-b50f-556a2d4b32f3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:16.579628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-794d5799-c0a1-426e-b50f-556a2d4b32f3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:16.580330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-794d5799-c0a1-426e-b50f-556a2d4b32f3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:17.164155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f39d5723-957c-4e00-80e8-125901d9dd0b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:17.194411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f39d5723-957c-4e00-80e8-125901d9dd0b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:17.213814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f39d5723-957c-4e00-80e8-125901d9dd0b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:17.215866 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f39d5723-957c-4e00-80e8-125901d9dd0b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 0.882417 Jul 26 14:25:17.232259 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2121/4112] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:16 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:17.241264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-11c21f59-b10b-4e00-859b-b499c11e5301 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:17.242586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-11c21f59-b10b-4e00-859b-b499c11e5301 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:17.257012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11c21f59-b10b-4e00-859b-b499c11e5301 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:17.257489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11c21f59-b10b-4e00-859b-b499c11e5301 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:17.258678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11c21f59-b10b-4e00-859b-b499c11e5301 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:17.259403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11c21f59-b10b-4e00-859b-b499c11e5301 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:17.333916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-794d5799-c0a1-426e-b50f-556a2d4b32f3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:17.355258 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-794d5799-c0a1-426e-b50f-556a2d4b32f3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1508 microversion: 2.1 time: 0.790916 Jul 26 14:25:17.359275 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1992/4113] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:16 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1508 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:17.391764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9e71171c-b772-45e8-9f05-cbf2fc8bf7ee tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:17.396330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9e71171c-b772-45e8-9f05-cbf2fc8bf7ee tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:17.429286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e71171c-b772-45e8-9f05-cbf2fc8bf7ee tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:17.440745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e71171c-b772-45e8-9f05-cbf2fc8bf7ee tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:17.443577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e71171c-b772-45e8-9f05-cbf2fc8bf7ee tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:17.444102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e71171c-b772-45e8-9f05-cbf2fc8bf7ee tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:17.566946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-11c21f59-b10b-4e00-859b-b499c11e5301 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:17.579016 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-11c21f59-b10b-4e00-859b-b499c11e5301 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1280 microversion: 2.1 time: 0.349436 Jul 26 14:25:17.587916 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2122/4114] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:17 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1280 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:17.596010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e85231a9-cd9a-483c-9e66-6d74136851d3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:17.604036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e85231a9-cd9a-483c-9e66-6d74136851d3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:17.610197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:17.627414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e85231a9-cd9a-483c-9e66-6d74136851d3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:17.632583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e85231a9-cd9a-483c-9e66-6d74136851d3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:17.634121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e85231a9-cd9a-483c-9e66-6d74136851d3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:17.635793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e85231a9-cd9a-483c-9e66-6d74136851d3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:17.983256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9e71171c-b772-45e8-9f05-cbf2fc8bf7ee tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:18.014994 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9e71171c-b772-45e8-9f05-cbf2fc8bf7ee tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1276 microversion: 2.1 time: 0.644544 Jul 26 14:25:18.019151 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1993/4115] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:17 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1276 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:18.253892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2edc1a45-82ca-46de-bfb8-f73f13817eb6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:18.256237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2edc1a45-82ca-46de-bfb8-f73f13817eb6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:18.290180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2edc1a45-82ca-46de-bfb8-f73f13817eb6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:18.292495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2edc1a45-82ca-46de-bfb8-f73f13817eb6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:18.298123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2edc1a45-82ca-46de-bfb8-f73f13817eb6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:18.299582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2edc1a45-82ca-46de-bfb8-f73f13817eb6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:19.110204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e85231a9-cd9a-483c-9e66-6d74136851d3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:19.135614 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e85231a9-cd9a-483c-9e66-6d74136851d3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1663 microversion: 2.1 time: 1.544650 Jul 26 14:25:19.141369 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2123/4116] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:17 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1663 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:19.165106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85f7f035-1daf-4157-864b-fd1bc9b10d11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:19.169379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85f7f035-1daf-4157-864b-fd1bc9b10d11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:19.200498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f7f035-1daf-4157-864b-fd1bc9b10d11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:19.203501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f7f035-1daf-4157-864b-fd1bc9b10d11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:19.204596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f7f035-1daf-4157-864b-fd1bc9b10d11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:19.211834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f7f035-1daf-4157-864b-fd1bc9b10d11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:20.080591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2edc1a45-82ca-46de-bfb8-f73f13817eb6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:20.104033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2edc1a45-82ca-46de-bfb8-f73f13817eb6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:20.105839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2edc1a45-82ca-46de-bfb8-f73f13817eb6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:20.111318 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2edc1a45-82ca-46de-bfb8-f73f13817eb6 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 1.871708 Jul 26 14:25:20.132918 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1994/4117] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:18 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:20.143559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9319b460-ad6f-4503-9f77-de4f7643c7e7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:20.144875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9319b460-ad6f-4503-9f77-de4f7643c7e7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:20.157323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9319b460-ad6f-4503-9f77-de4f7643c7e7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:20.158627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9319b460-ad6f-4503-9f77-de4f7643c7e7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:20.160834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9319b460-ad6f-4503-9f77-de4f7643c7e7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:20.161516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9319b460-ad6f-4503-9f77-de4f7643c7e7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:20.286467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-85f7f035-1daf-4157-864b-fd1bc9b10d11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:20.305792 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85f7f035-1daf-4157-864b-fd1bc9b10d11 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1529 microversion: 2.1 time: 1.157593 Jul 26 14:25:20.307329 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2124/4118] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:19 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1529 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:20.319539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ade6f58-a826-4c20-8dcd-91bf6c127b67 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:20.320852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5ade6f58-a826-4c20-8dcd-91bf6c127b67 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:20.334086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ade6f58-a826-4c20-8dcd-91bf6c127b67 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:20.334863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ade6f58-a826-4c20-8dcd-91bf6c127b67 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:20.336478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ade6f58-a826-4c20-8dcd-91bf6c127b67 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:20.337313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ade6f58-a826-4c20-8dcd-91bf6c127b67 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:20.424839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:21.799445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9319b460-ad6f-4503-9f77-de4f7643c7e7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:21.808289 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9319b460-ad6f-4503-9f77-de4f7643c7e7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 1.673773 Jul 26 14:25:21.817722 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1995/4119] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:20 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:21.847310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3df4e05c-71a7-4720-b4dc-1e97fd83028e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:21.857379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3df4e05c-71a7-4720-b4dc-1e97fd83028e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:21.872867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:21.876084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3df4e05c-71a7-4720-b4dc-1e97fd83028e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:21.881165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3df4e05c-71a7-4720-b4dc-1e97fd83028e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:21.882883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3df4e05c-71a7-4720-b4dc-1e97fd83028e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:21.883896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3df4e05c-71a7-4720-b4dc-1e97fd83028e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:21.964662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:22.198517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5ade6f58-a826-4c20-8dcd-91bf6c127b67 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:22.229059 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ade6f58-a826-4c20-8dcd-91bf6c127b67 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1318 microversion: 2.1 time: 1.917875 Jul 26 14:25:22.236903 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2125/4120] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:20 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1318 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:22.267733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-12667610-4277-4195-9fd8-1ce400b7ceb3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:22.274236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-12667610-4277-4195-9fd8-1ce400b7ceb3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:22.307452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12667610-4277-4195-9fd8-1ce400b7ceb3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:22.321122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12667610-4277-4195-9fd8-1ce400b7ceb3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:22.322905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12667610-4277-4195-9fd8-1ce400b7ceb3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:22.323981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12667610-4277-4195-9fd8-1ce400b7ceb3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:22.814670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:23.151151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3df4e05c-71a7-4720-b4dc-1e97fd83028e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:23.163351 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3df4e05c-71a7-4720-b4dc-1e97fd83028e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.329466 Jul 26 14:25:23.167297 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1996/4121] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:21 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:23.199806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1d8b3034-f153-4033-8590-7310cbdc8d3c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:23.200463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1d8b3034-f153-4033-8590-7310cbdc8d3c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:23.248734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d8b3034-f153-4033-8590-7310cbdc8d3c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:23.261161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d8b3034-f153-4033-8590-7310cbdc8d3c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:23.264853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d8b3034-f153-4033-8590-7310cbdc8d3c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:23.265478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d8b3034-f153-4033-8590-7310cbdc8d3c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:24.678810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d8b3034-f153-4033-8590-7310cbdc8d3c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:24.695038 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1d8b3034-f153-4033-8590-7310cbdc8d3c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1524 microversion: 2.1 time: 1.524450 Jul 26 14:25:24.695774 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1997/4122] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:23 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1524 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:24.720074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-254f0513-6ded-4d99-8b16-b29f0a9f0a1d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:24.731851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-254f0513-6ded-4d99-8b16-b29f0a9f0a1d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:24.749414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-254f0513-6ded-4d99-8b16-b29f0a9f0a1d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:24.749908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-254f0513-6ded-4d99-8b16-b29f0a9f0a1d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:24.750683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-254f0513-6ded-4d99-8b16-b29f0a9f0a1d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:24.751312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-254f0513-6ded-4d99-8b16-b29f0a9f0a1d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:25.160371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-12667610-4277-4195-9fd8-1ce400b7ceb3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:25.222851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-12667610-4277-4195-9fd8-1ce400b7ceb3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:25.239401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-12667610-4277-4195-9fd8-1ce400b7ceb3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:25.241672 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-12667610-4277-4195-9fd8-1ce400b7ceb3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 3.001918 Jul 26 14:25:25.242859 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2126/4123] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:22 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 3005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:25.271516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c2d51733-4af2-496f-a3e1-561291e7221f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:25.273231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c2d51733-4af2-496f-a3e1-561291e7221f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:25.293630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2d51733-4af2-496f-a3e1-561291e7221f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:25.294908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2d51733-4af2-496f-a3e1-561291e7221f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:25.301045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2d51733-4af2-496f-a3e1-561291e7221f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:25.302181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2d51733-4af2-496f-a3e1-561291e7221f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:25.967649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-254f0513-6ded-4d99-8b16-b29f0a9f0a1d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:25.994680 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-254f0513-6ded-4d99-8b16-b29f0a9f0a1d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 1.297371 Jul 26 14:25:26.015654 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1998/4124] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:24 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:26.047051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d9d767d8-017a-4708-9886-ee74108ad4e4 req-f1e51188-2140-4c68-9878-10dd1cbc5249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a3e2faf-7a49-47df-886a-ef79f5fbe3b8", "name": "network-vif-plugged", "status": "completed", "tag": "85c04f3c-08b1-4c72-b7f3-94af7af851f7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:26.093113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d9d767d8-017a-4708-9886-ee74108ad4e4 req-f1e51188-2140-4c68-9878-10dd1cbc5249 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:26.099714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d9d767d8-017a-4708-9886-ee74108ad4e4 req-f1e51188-2140-4c68-9878-10dd1cbc5249 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:26.150977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:26.156641 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d9d767d8-017a-4708-9886-ee74108ad4e4 req-f1e51188-2140-4c68-9878-10dd1cbc5249 service nova] Creating event network-vif-plugged:85c04f3c-08b1-4c72-b7f3-94af7af851f7 for instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 on n-h2-833090-9 Jul 26 14:25:26.179837 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d9d767d8-017a-4708-9886-ee74108ad4e4 req-f1e51188-2140-4c68-9878-10dd1cbc5249 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159877 Jul 26 14:25:26.199457 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 1999/4125] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:26.222550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-43403283-9fe8-4a48-bd94-04d612085128 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:26.224250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-43403283-9fe8-4a48-bd94-04d612085128 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:26.257112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43403283-9fe8-4a48-bd94-04d612085128 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:26.258101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43403283-9fe8-4a48-bd94-04d612085128 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:26.267174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43403283-9fe8-4a48-bd94-04d612085128 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:26.267647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43403283-9fe8-4a48-bd94-04d612085128 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:26.702349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c2d51733-4af2-496f-a3e1-561291e7221f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:26.716338 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c2d51733-4af2-496f-a3e1-561291e7221f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.469542 Jul 26 14:25:26.720545 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2127/4126] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:25 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:26.726962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e19d1f7f-1caa-4ec6-b22d-c23aecd0899e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:26.733911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e19d1f7f-1caa-4ec6-b22d-c23aecd0899e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:26.753210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e19d1f7f-1caa-4ec6-b22d-c23aecd0899e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:26.757052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e19d1f7f-1caa-4ec6-b22d-c23aecd0899e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:26.759366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e19d1f7f-1caa-4ec6-b22d-c23aecd0899e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:26.759993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e19d1f7f-1caa-4ec6-b22d-c23aecd0899e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:26.766507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:28.447990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43403283-9fe8-4a48-bd94-04d612085128 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:28.474307 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-43403283-9fe8-4a48-bd94-04d612085128 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1318 microversion: 2.1 time: 2.272704 Jul 26 14:25:28.491429 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2000/4127] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:26 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1318 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:28.515169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e95ca5e5-df5e-4e1c-b419-43e8773d460d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:28.522144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e95ca5e5-df5e-4e1c-b419-43e8773d460d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:28.560683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e95ca5e5-df5e-4e1c-b419-43e8773d460d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:28.566366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e95ca5e5-df5e-4e1c-b419-43e8773d460d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:28.567292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e95ca5e5-df5e-4e1c-b419-43e8773d460d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:28.567767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e95ca5e5-df5e-4e1c-b419-43e8773d460d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:28.665275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e19d1f7f-1caa-4ec6-b22d-c23aecd0899e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:28.678891 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e19d1f7f-1caa-4ec6-b22d-c23aecd0899e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1524 microversion: 2.1 time: 1.954541 Jul 26 14:25:28.681189 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2128/4128] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:26 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1524 bytes in 1960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:28.698484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0811dd45-7e90-4de3-a84d-ec364bc1514e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:28.699478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0811dd45-7e90-4de3-a84d-ec364bc1514e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:28.715345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0811dd45-7e90-4de3-a84d-ec364bc1514e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:28.719040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0811dd45-7e90-4de3-a84d-ec364bc1514e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:28.720174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0811dd45-7e90-4de3-a84d-ec364bc1514e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:28.721290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0811dd45-7e90-4de3-a84d-ec364bc1514e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:28.824597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0811dd45-7e90-4de3-a84d-ec364bc1514e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Unlocking {{(pid=119479) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 26 14:25:29.038852 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0811dd45-7e90-4de3-a84d-ec364bc1514e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.350695 Jul 26 14:25:29.049239 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2129/4129] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:25:28 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:25:29.089716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-87a3d151-56ee-4589-beed-121cf0d9c2db tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:29.090647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-87a3d151-56ee-4589-beed-121cf0d9c2db tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:29.130853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-87a3d151-56ee-4589-beed-121cf0d9c2db tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:29.131414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-87a3d151-56ee-4589-beed-121cf0d9c2db tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:29.132329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-87a3d151-56ee-4589-beed-121cf0d9c2db tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:29.133047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-87a3d151-56ee-4589-beed-121cf0d9c2db tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:31.065732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-87a3d151-56ee-4589-beed-121cf0d9c2db tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:31.089827 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-87a3d151-56ee-4589-beed-121cf0d9c2db tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 2.044501 Jul 26 14:25:31.108819 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2130/4130] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:29 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:31.114986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-8a7ebd8e-299a-4ce2-9877-aea7a86a0005 req-ba87a803-11ea-4e22-b03d-1a11b51596dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3c31ea-55d3-4814-9883-6544bd8c7f0e", "tag": "79e2c4c8-c4e4-401d-b78b-198c84b13ef7"}, {"name": "network-changed", "server_uuid": "944efc3d-093a-44a9-b7e6-ddd2083f6f88", "tag": "54fffc38-8257-4447-991f-098ca2b1059b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:31.151110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8a7ebd8e-299a-4ce2-9877-aea7a86a0005 req-ba87a803-11ea-4e22-b03d-1a11b51596dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:31.151801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8a7ebd8e-299a-4ce2-9877-aea7a86a0005 req-ba87a803-11ea-4e22-b03d-1a11b51596dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:31.208802 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8a7ebd8e-299a-4ce2-9877-aea7a86a0005 req-ba87a803-11ea-4e22-b03d-1a11b51596dd service nova] Creating event network-changed:79e2c4c8-c4e4-401d-b78b-198c84b13ef7 for instance da3c31ea-55d3-4814-9883-6544bd8c7f0e on n-h2-833090-9 Jul 26 14:25:31.209990 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8a7ebd8e-299a-4ce2-9877-aea7a86a0005 req-ba87a803-11ea-4e22-b03d-1a11b51596dd service nova] Creating event network-changed:54fffc38-8257-4447-991f-098ca2b1059b for instance 944efc3d-093a-44a9-b7e6-ddd2083f6f88 on n-h1-833090-9 Jul 26 14:25:31.246391 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-8a7ebd8e-299a-4ce2-9877-aea7a86a0005 req-ba87a803-11ea-4e22-b03d-1a11b51596dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.132174 Jul 26 14:25:31.256504 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2131/4131] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:31.267839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-51317454-078f-46f2-a79f-a4e0053bfd6c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:31.274328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-51317454-078f-46f2-a79f-a4e0053bfd6c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:31.294573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51317454-078f-46f2-a79f-a4e0053bfd6c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:31.295103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51317454-078f-46f2-a79f-a4e0053bfd6c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:31.307701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51317454-078f-46f2-a79f-a4e0053bfd6c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:31.317607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51317454-078f-46f2-a79f-a4e0053bfd6c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:31.652458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e95ca5e5-df5e-4e1c-b419-43e8773d460d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:31.689897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e95ca5e5-df5e-4e1c-b419-43e8773d460d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:31.692399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e95ca5e5-df5e-4e1c-b419-43e8773d460d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:31.702261 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e95ca5e5-df5e-4e1c-b419-43e8773d460d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 3.206769 Jul 26 14:25:31.713128 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2001/4132] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:28 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 3221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:31.728875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-35c57f2f-d7ea-4380-9eab-673c9e1792de tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:31.732417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-35c57f2f-d7ea-4380-9eab-673c9e1792de tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:31.764822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35c57f2f-d7ea-4380-9eab-673c9e1792de tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:31.767628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35c57f2f-d7ea-4380-9eab-673c9e1792de tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:31.773211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35c57f2f-d7ea-4380-9eab-673c9e1792de tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:31.781547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35c57f2f-d7ea-4380-9eab-673c9e1792de tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:32.918634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-51317454-078f-46f2-a79f-a4e0053bfd6c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:32.950000 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-51317454-078f-46f2-a79f-a4e0053bfd6c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.690428 Jul 26 14:25:32.958201 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2132/4133] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:31 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:32.963311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0d8ab7c3-891c-42c0-b397-5dc2cc29863a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:32.964672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0d8ab7c3-891c-42c0-b397-5dc2cc29863a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:32.984716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d8ab7c3-891c-42c0-b397-5dc2cc29863a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:32.986721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d8ab7c3-891c-42c0-b397-5dc2cc29863a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:32.992606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d8ab7c3-891c-42c0-b397-5dc2cc29863a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:32.993373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0d8ab7c3-891c-42c0-b397-5dc2cc29863a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:33.261987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-35c57f2f-d7ea-4380-9eab-673c9e1792de tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:33.351067 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-35c57f2f-d7ea-4380-9eab-673c9e1792de tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1318 microversion: 2.1 time: 1.635907 Jul 26 14:25:33.359699 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2002/4134] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:31 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1318 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:33.400378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d058236-6334-44e8-a86d-ced9fa5eb272 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:33.403839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3d058236-6334-44e8-a86d-ced9fa5eb272 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:33.448422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d058236-6334-44e8-a86d-ced9fa5eb272 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:33.453878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d058236-6334-44e8-a86d-ced9fa5eb272 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:33.460465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d058236-6334-44e8-a86d-ced9fa5eb272 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:33.463921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d058236-6334-44e8-a86d-ced9fa5eb272 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:34.024494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0d8ab7c3-891c-42c0-b397-5dc2cc29863a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:34.036204 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0d8ab7c3-891c-42c0-b397-5dc2cc29863a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1524 microversion: 2.1 time: 1.076550 Jul 26 14:25:34.040711 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2133/4135] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:32 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1524 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:34.059867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-44e41cfa-90d2-4ec5-95d1-43d4e996b07a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:34.060888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-44e41cfa-90d2-4ec5-95d1-43d4e996b07a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:34.075427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44e41cfa-90d2-4ec5-95d1-43d4e996b07a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:34.076113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44e41cfa-90d2-4ec5-95d1-43d4e996b07a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:34.077635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44e41cfa-90d2-4ec5-95d1-43d4e996b07a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:34.083167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44e41cfa-90d2-4ec5-95d1-43d4e996b07a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:35.440025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3d058236-6334-44e8-a86d-ced9fa5eb272 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:35.462066 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3d058236-6334-44e8-a86d-ced9fa5eb272 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 2.087266 Jul 26 14:25:35.465924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-44e41cfa-90d2-4ec5-95d1-43d4e996b07a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:35.467696 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2003/4136] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:33 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:35.493734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-44e41cfa-90d2-4ec5-95d1-43d4e996b07a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:35.497295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0e28a4a4-cf34-460a-a668-7418cff64831 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:35.499470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0e28a4a4-cf34-460a-a668-7418cff64831 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:35.508100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-44e41cfa-90d2-4ec5-95d1-43d4e996b07a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:35.513838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e28a4a4-cf34-460a-a668-7418cff64831 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:35.514834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e28a4a4-cf34-460a-a668-7418cff64831 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:35.515456 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-44e41cfa-90d2-4ec5-95d1-43d4e996b07a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 1.471748 Jul 26 14:25:35.516382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e28a4a4-cf34-460a-a668-7418cff64831 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:35.525297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e28a4a4-cf34-460a-a668-7418cff64831 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:35.525599 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2134/4137] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:34 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:35.549510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c84eb06d-9f0d-49b7-acb7-f555fe7c8ffa tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:35.556176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c84eb06d-9f0d-49b7-acb7-f555fe7c8ffa tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:35.573845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c84eb06d-9f0d-49b7-acb7-f555fe7c8ffa tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:35.575111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c84eb06d-9f0d-49b7-acb7-f555fe7c8ffa tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:35.577479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c84eb06d-9f0d-49b7-acb7-f555fe7c8ffa tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:35.578778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c84eb06d-9f0d-49b7-acb7-f555fe7c8ffa tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:36.305888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0e28a4a4-cf34-460a-a668-7418cff64831 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:36.346861 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0e28a4a4-cf34-460a-a668-7418cff64831 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.858317 Jul 26 14:25:36.375982 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2004/4138] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:35 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:36.388745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ce9f4ca1-8b95-4975-a202-cda3d6309254 req-fbad24ca-1682-40c9-b270-195022219364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c24f3d4-2732-40cf-94d4-6155480bd7c0", "tag": "5fb3e9ca-f414-4968-9e9a-8117f469969d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:36.447680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ce9f4ca1-8b95-4975-a202-cda3d6309254 req-fbad24ca-1682-40c9-b270-195022219364 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:36.448417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ce9f4ca1-8b95-4975-a202-cda3d6309254 req-fbad24ca-1682-40c9-b270-195022219364 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:36.492616 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ce9f4ca1-8b95-4975-a202-cda3d6309254 req-fbad24ca-1682-40c9-b270-195022219364 service nova] Creating event network-changed:5fb3e9ca-f414-4968-9e9a-8117f469969d for instance 3c24f3d4-2732-40cf-94d4-6155480bd7c0 on n-h2-833090-9 Jul 26 14:25:36.504576 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ce9f4ca1-8b95-4975-a202-cda3d6309254 req-fbad24ca-1682-40c9-b270-195022219364 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137431 Jul 26 14:25:36.505795 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2005/4139] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:36.520406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b913fa41-5715-429d-8dc2-f403386e96f4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:36.526735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b913fa41-5715-429d-8dc2-f403386e96f4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:36.548794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b913fa41-5715-429d-8dc2-f403386e96f4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:36.549720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b913fa41-5715-429d-8dc2-f403386e96f4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:36.559249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b913fa41-5715-429d-8dc2-f403386e96f4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:36.562373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b913fa41-5715-429d-8dc2-f403386e96f4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:36.582459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c84eb06d-9f0d-49b7-acb7-f555fe7c8ffa tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:36.598576 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c84eb06d-9f0d-49b7-acb7-f555fe7c8ffa tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1318 microversion: 2.1 time: 1.071837 Jul 26 14:25:36.632149 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2135/4140] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:35 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1318 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:36.640487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-54b02d6d-3333-4ffb-a8a0-cb5b197a8472 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:36.644772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-54b02d6d-3333-4ffb-a8a0-cb5b197a8472 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:36.654196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54b02d6d-3333-4ffb-a8a0-cb5b197a8472 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:36.656438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54b02d6d-3333-4ffb-a8a0-cb5b197a8472 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:36.657652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54b02d6d-3333-4ffb-a8a0-cb5b197a8472 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:36.658365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54b02d6d-3333-4ffb-a8a0-cb5b197a8472 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:39.105527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b913fa41-5715-429d-8dc2-f403386e96f4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:39.125162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b913fa41-5715-429d-8dc2-f403386e96f4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1524 microversion: 2.1 time: 2.617723 Jul 26 14:25:39.125774 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2006/4141] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:36 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1524 bytes in 2619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:39.139928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-17af942d-d312-4fd2-a537-0d600c2d55cd tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:39.163507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-17af942d-d312-4fd2-a537-0d600c2d55cd tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:39.182731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17af942d-d312-4fd2-a537-0d600c2d55cd tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:39.183180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17af942d-d312-4fd2-a537-0d600c2d55cd tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:39.184003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17af942d-d312-4fd2-a537-0d600c2d55cd tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:39.184468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-17af942d-d312-4fd2-a537-0d600c2d55cd tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:40.234648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-54b02d6d-3333-4ffb-a8a0-cb5b197a8472 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:40.256684 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-54b02d6d-3333-4ffb-a8a0-cb5b197a8472 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 3.622361 Jul 26 14:25:40.262434 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2136/4142] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:36 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 3628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:40.278657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-efe54332-0d25-4b23-9974-4c514bd1a1a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:40.284787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-efe54332-0d25-4b23-9974-4c514bd1a1a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:40.308445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efe54332-0d25-4b23-9974-4c514bd1a1a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:40.310362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efe54332-0d25-4b23-9974-4c514bd1a1a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:40.317094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efe54332-0d25-4b23-9974-4c514bd1a1a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:40.317934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-efe54332-0d25-4b23-9974-4c514bd1a1a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:40.877717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-17af942d-d312-4fd2-a537-0d600c2d55cd tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:40.886976 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-17af942d-d312-4fd2-a537-0d600c2d55cd tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 1.757377 Jul 26 14:25:40.888336 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2007/4143] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:39 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:40.894861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bf3eda11-b449-4552-ae2d-a8c5adf53300 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:40.895810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bf3eda11-b449-4552-ae2d-a8c5adf53300 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:40.915730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf3eda11-b449-4552-ae2d-a8c5adf53300 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:40.918132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf3eda11-b449-4552-ae2d-a8c5adf53300 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:40.921924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf3eda11-b449-4552-ae2d-a8c5adf53300 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:40.922670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf3eda11-b449-4552-ae2d-a8c5adf53300 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:41.018299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-efe54332-0d25-4b23-9974-4c514bd1a1a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:41.029490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-efe54332-0d25-4b23-9974-4c514bd1a1a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:41.032417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-efe54332-0d25-4b23-9974-4c514bd1a1a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:41.034309 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-efe54332-0d25-4b23-9974-4c514bd1a1a3 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 0.768064 Jul 26 14:25:41.036062 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2137/4144] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:40 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:41.041782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c169f7ff-f3c5-47b9-9af2-642cb8ef81a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:41.042816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c169f7ff-f3c5-47b9-9af2-642cb8ef81a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:41.073825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c169f7ff-f3c5-47b9-9af2-642cb8ef81a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:41.080602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c169f7ff-f3c5-47b9-9af2-642cb8ef81a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:41.084184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c169f7ff-f3c5-47b9-9af2-642cb8ef81a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:41.085314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c169f7ff-f3c5-47b9-9af2-642cb8ef81a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:41.687069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c169f7ff-f3c5-47b9-9af2-642cb8ef81a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:41.748715 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c169f7ff-f3c5-47b9-9af2-642cb8ef81a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1524 microversion: 2.1 time: 0.704851 Jul 26 14:25:41.752926 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2138/4145] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:41 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1524 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:41.791522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ff17040-7d29-46fc-b063-f75ae8190ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:41.797158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4ff17040-7d29-46fc-b063-f75ae8190ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:41.855792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ff17040-7d29-46fc-b063-f75ae8190ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:41.856624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ff17040-7d29-46fc-b063-f75ae8190ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:41.872323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ff17040-7d29-46fc-b063-f75ae8190ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:41.879618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ff17040-7d29-46fc-b063-f75ae8190ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:41.944708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bf3eda11-b449-4552-ae2d-a8c5adf53300 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:41.967630 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bf3eda11-b449-4552-ae2d-a8c5adf53300 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1318 microversion: 2.1 time: 1.076975 Jul 26 14:25:42.022967 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2008/4146] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:40 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1318 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:42.046940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c0a7dd9-b996-455f-874c-e695cbdf4b91 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:42.047992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c0a7dd9-b996-455f-874c-e695cbdf4b91 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:42.068783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c0a7dd9-b996-455f-874c-e695cbdf4b91 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:42.074731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c0a7dd9-b996-455f-874c-e695cbdf4b91 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:42.076488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c0a7dd9-b996-455f-874c-e695cbdf4b91 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:42.079583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c0a7dd9-b996-455f-874c-e695cbdf4b91 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:42.308499 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4ff17040-7d29-46fc-b063-f75ae8190ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.548364 Jul 26 14:25:42.309336 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2139/4147] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:25:41 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:25:42.331121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ef80aaff-ac80-49f9-95f6-c76dba7cba5d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:42.332295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef80aaff-ac80-49f9-95f6-c76dba7cba5d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:42.353277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef80aaff-ac80-49f9-95f6-c76dba7cba5d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:42.354145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef80aaff-ac80-49f9-95f6-c76dba7cba5d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:42.355202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef80aaff-ac80-49f9-95f6-c76dba7cba5d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:42.355878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef80aaff-ac80-49f9-95f6-c76dba7cba5d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:43.299943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c0a7dd9-b996-455f-874c-e695cbdf4b91 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:43.315044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ef80aaff-ac80-49f9-95f6-c76dba7cba5d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:43.320468 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c0a7dd9-b996-455f-874c-e695cbdf4b91 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 1.294722 Jul 26 14:25:43.331984 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2009/4148] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:42 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:43.333291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-721665c8-d121-4e9f-89f4-477fc5a7162c req-297d55d5-3ab8-4687-a126-b613b5d0b541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944efc3d-093a-44a9-b7e6-ddd2083f6f88", "name": "network-vif-plugged", "status": "completed", "tag": "54fffc38-8257-4447-991f-098ca2b1059b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:43.335913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ef80aaff-ac80-49f9-95f6-c76dba7cba5d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:43.337574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ef80aaff-ac80-49f9-95f6-c76dba7cba5d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:43.338880 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ef80aaff-ac80-49f9-95f6-c76dba7cba5d tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 1.027915 Jul 26 14:25:43.339469 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2140/4149] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:42 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:43.345546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d438994f-0ed5-47ef-ad2e-c6a6a6154b78 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:43.355934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=44 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:43.357353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d438994f-0ed5-47ef-ad2e-c6a6a6154b78 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:43.363344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-721665c8-d121-4e9f-89f4-477fc5a7162c req-297d55d5-3ab8-4687-a126-b613b5d0b541 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:43.363817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-721665c8-d121-4e9f-89f4-477fc5a7162c req-297d55d5-3ab8-4687-a126-b613b5d0b541 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:43.377564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d438994f-0ed5-47ef-ad2e-c6a6a6154b78 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:43.378040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d438994f-0ed5-47ef-ad2e-c6a6a6154b78 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:43.378838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d438994f-0ed5-47ef-ad2e-c6a6a6154b78 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:43.379281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d438994f-0ed5-47ef-ad2e-c6a6a6154b78 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:43.402631 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-721665c8-d121-4e9f-89f4-477fc5a7162c req-297d55d5-3ab8-4687-a126-b613b5d0b541 service nova] Creating event network-vif-plugged:54fffc38-8257-4447-991f-098ca2b1059b for instance 944efc3d-093a-44a9-b7e6-ddd2083f6f88 on n-h1-833090-9 Jul 26 14:25:43.413867 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-721665c8-d121-4e9f-89f4-477fc5a7162c req-297d55d5-3ab8-4687-a126-b613b5d0b541 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090174 Jul 26 14:25:43.418223 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2010/4150] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:43.437851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-91561e58-1a5f-4ecd-aa9a-4994b7cbc9a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:43.438629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-91561e58-1a5f-4ecd-aa9a-4994b7cbc9a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:43.458776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91561e58-1a5f-4ecd-aa9a-4994b7cbc9a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:43.459940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91561e58-1a5f-4ecd-aa9a-4994b7cbc9a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:43.463051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91561e58-1a5f-4ecd-aa9a-4994b7cbc9a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:43.465288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91561e58-1a5f-4ecd-aa9a-4994b7cbc9a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:43.919203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d438994f-0ed5-47ef-ad2e-c6a6a6154b78 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:43.929338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:43.932057 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d438994f-0ed5-47ef-ad2e-c6a6a6154b78 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1652 microversion: 2.1 time: 0.591237 Jul 26 14:25:43.934435 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2141/4151] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:43 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1652 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:43.949659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56ccd3be-3161-4b8e-9413-0bbba33a4007 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:43.950777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56ccd3be-3161-4b8e-9413-0bbba33a4007 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:43.959442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56ccd3be-3161-4b8e-9413-0bbba33a4007 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:43.960077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56ccd3be-3161-4b8e-9413-0bbba33a4007 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:43.961263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56ccd3be-3161-4b8e-9413-0bbba33a4007 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:43.961995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56ccd3be-3161-4b8e-9413-0bbba33a4007 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:44.003833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-91561e58-1a5f-4ecd-aa9a-4994b7cbc9a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:44.012630 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-91561e58-1a5f-4ecd-aa9a-4994b7cbc9a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1524 microversion: 2.1 time: 0.593030 Jul 26 14:25:44.013843 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2011/4152] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:43 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1524 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:44.032291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1663304e-db60-4d33-a3da-0e477bae0b9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:44.034173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1663304e-db60-4d33-a3da-0e477bae0b9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:44.046210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1663304e-db60-4d33-a3da-0e477bae0b9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:44.046831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1663304e-db60-4d33-a3da-0e477bae0b9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:44.047818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1663304e-db60-4d33-a3da-0e477bae0b9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:44.048542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1663304e-db60-4d33-a3da-0e477bae0b9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:44.137962 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1663304e-db60-4d33-a3da-0e477bae0b9f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.116044 Jul 26 14:25:44.138619 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2012/4153] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:25:44 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:25:44.149168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b0691877-c5a7-47d4-a118-8339982e522e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:44.150685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b0691877-c5a7-47d4-a118-8339982e522e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:44.160257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0691877-c5a7-47d4-a118-8339982e522e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:44.161085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0691877-c5a7-47d4-a118-8339982e522e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:44.162736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0691877-c5a7-47d4-a118-8339982e522e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:44.163446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0691877-c5a7-47d4-a118-8339982e522e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:44.865163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56ccd3be-3161-4b8e-9413-0bbba33a4007 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:44.899136 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56ccd3be-3161-4b8e-9413-0bbba33a4007 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1318 microversion: 2.1 time: 0.962693 Jul 26 14:25:44.916797 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2142/4154] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:43 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1318 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:44.923113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71db42b4-4d27-41cc-8301-58f485200813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:44.924065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71db42b4-4d27-41cc-8301-58f485200813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:44.933157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71db42b4-4d27-41cc-8301-58f485200813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:44.934092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71db42b4-4d27-41cc-8301-58f485200813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:44.935383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71db42b4-4d27-41cc-8301-58f485200813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:44.938299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71db42b4-4d27-41cc-8301-58f485200813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:45.010748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b0691877-c5a7-47d4-a118-8339982e522e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:45.041118 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b0691877-c5a7-47d4-a118-8339982e522e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1659 microversion: 2.1 time: 0.890979 Jul 26 14:25:45.041806 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2013/4155] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:44 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1659 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:25:45.047943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-76b70c6d-677b-481a-bc76-672330aa0668 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:45.049924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76b70c6d-677b-481a-bc76-672330aa0668 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:45.078745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76b70c6d-677b-481a-bc76-672330aa0668 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:45.081272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76b70c6d-677b-481a-bc76-672330aa0668 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:45.085601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76b70c6d-677b-481a-bc76-672330aa0668 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:45.086070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76b70c6d-677b-481a-bc76-672330aa0668 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:46.000908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-76b70c6d-677b-481a-bc76-672330aa0668 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:46.005019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-71db42b4-4d27-41cc-8301-58f485200813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:46.020413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-76b70c6d-677b-481a-bc76-672330aa0668 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:46.020958 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71db42b4-4d27-41cc-8301-58f485200813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 1.102245 Jul 26 14:25:46.029232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-76b70c6d-677b-481a-bc76-672330aa0668 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:46.030647 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2143/4156] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:44 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:46.042121 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-76b70c6d-677b-481a-bc76-672330aa0668 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 0.990962 Jul 26 14:25:46.044759 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2014/4157] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:45 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:46.050520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-10e81ddb-f27d-482d-8dda-14845d99f74e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:46.054528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-10e81ddb-f27d-482d-8dda-14845d99f74e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:46.059574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-991180eb-eca7-49ac-a750-20e4244c8ac1 req-e3e64ee5-5c02-48d6-bd78-8a610d03b8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3c31ea-55d3-4814-9883-6544bd8c7f0e", "name": "network-vif-plugged", "status": "completed", "tag": "79e2c4c8-c4e4-401d-b78b-198c84b13ef7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:46.073948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10e81ddb-f27d-482d-8dda-14845d99f74e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:46.074854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10e81ddb-f27d-482d-8dda-14845d99f74e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:46.075915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10e81ddb-f27d-482d-8dda-14845d99f74e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:46.077185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10e81ddb-f27d-482d-8dda-14845d99f74e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:46.089240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-991180eb-eca7-49ac-a750-20e4244c8ac1 req-e3e64ee5-5c02-48d6-bd78-8a610d03b8b7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:46.090671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-991180eb-eca7-49ac-a750-20e4244c8ac1 req-e3e64ee5-5c02-48d6-bd78-8a610d03b8b7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:46.121099 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-991180eb-eca7-49ac-a750-20e4244c8ac1 req-e3e64ee5-5c02-48d6-bd78-8a610d03b8b7 service nova] Creating event network-vif-plugged:79e2c4c8-c4e4-401d-b78b-198c84b13ef7 for instance da3c31ea-55d3-4814-9883-6544bd8c7f0e on n-h2-833090-9 Jul 26 14:25:46.129321 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-991180eb-eca7-49ac-a750-20e4244c8ac1 req-e3e64ee5-5c02-48d6-bd78-8a610d03b8b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082449 Jul 26 14:25:46.130559 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2015/4158] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:46.151078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44313c55-0528-43d0-9725-825429fa2197 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:46.158753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44313c55-0528-43d0-9725-825429fa2197 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:46.170963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44313c55-0528-43d0-9725-825429fa2197 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:46.171720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44313c55-0528-43d0-9725-825429fa2197 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:46.172866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44313c55-0528-43d0-9725-825429fa2197 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:46.173458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44313c55-0528-43d0-9725-825429fa2197 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:46.801868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-44313c55-0528-43d0-9725-825429fa2197 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:46.813968 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-44313c55-0528-43d0-9725-825429fa2197 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1318 microversion: 2.1 time: 0.681341 Jul 26 14:25:46.817350 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2016/4159] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:46 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:46.836622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-be27af0d-d9df-431b-aece-00de3eb98259 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:46.838108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-be27af0d-d9df-431b-aece-00de3eb98259 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:46.874220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be27af0d-d9df-431b-aece-00de3eb98259 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:46.877275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be27af0d-d9df-431b-aece-00de3eb98259 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:46.878417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be27af0d-d9df-431b-aece-00de3eb98259 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:46.882398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be27af0d-d9df-431b-aece-00de3eb98259 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:46.923170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:46.929710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-10e81ddb-f27d-482d-8dda-14845d99f74e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:46.964531 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-10e81ddb-f27d-482d-8dda-14845d99f74e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1506 microversion: 2.1 time: 0.929985 Jul 26 14:25:46.970981 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2144/4160] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:46 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1506 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:47.054859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-884464a0-8256-40d1-b57f-a5f14949040d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:47.055760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-884464a0-8256-40d1-b57f-a5f14949040d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:47.138438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-884464a0-8256-40d1-b57f-a5f14949040d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:47.139140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-884464a0-8256-40d1-b57f-a5f14949040d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:47.144142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-884464a0-8256-40d1-b57f-a5f14949040d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:47.144883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-884464a0-8256-40d1-b57f-a5f14949040d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:47.509589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-be27af0d-d9df-431b-aece-00de3eb98259 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:47.523007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-884464a0-8256-40d1-b57f-a5f14949040d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:47.530638 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-be27af0d-d9df-431b-aece-00de3eb98259 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.711538 Jul 26 14:25:47.532341 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2017/4161] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:46 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:47.547095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2ec56501-8681-46f5-a29c-e4560a45dc05 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:47.549753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2ec56501-8681-46f5-a29c-e4560a45dc05 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:47.558458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ec56501-8681-46f5-a29c-e4560a45dc05 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:47.562852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ec56501-8681-46f5-a29c-e4560a45dc05 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:47.564415 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-884464a0-8256-40d1-b57f-a5f14949040d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 0.515922 Jul 26 14:25:47.566224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ec56501-8681-46f5-a29c-e4560a45dc05 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:47.567020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2ec56501-8681-46f5-a29c-e4560a45dc05 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:47.572722 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2145/4162] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:47 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:47.584840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a8e1acb7-3d26-4d00-afc0-4e4c99ed4ead tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:47.585825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a8e1acb7-3d26-4d00-afc0-4e4c99ed4ead tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:47.599729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8e1acb7-3d26-4d00-afc0-4e4c99ed4ead tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:47.602654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8e1acb7-3d26-4d00-afc0-4e4c99ed4ead tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:47.604785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8e1acb7-3d26-4d00-afc0-4e4c99ed4ead tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:47.609176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8e1acb7-3d26-4d00-afc0-4e4c99ed4ead tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:47.892487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2ec56501-8681-46f5-a29c-e4560a45dc05 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:47.911574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2ec56501-8681-46f5-a29c-e4560a45dc05 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:47.925059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2ec56501-8681-46f5-a29c-e4560a45dc05 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:47.928253 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2ec56501-8681-46f5-a29c-e4560a45dc05 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 0.394452 Jul 26 14:25:47.933715 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2018/4163] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:47 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:47.949751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-df696a01-181d-4cc9-b118-ef1430b81605 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:47.950825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-df696a01-181d-4cc9-b118-ef1430b81605 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:47.964310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df696a01-181d-4cc9-b118-ef1430b81605 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:47.965092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df696a01-181d-4cc9-b118-ef1430b81605 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:47.966947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df696a01-181d-4cc9-b118-ef1430b81605 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:47.967810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df696a01-181d-4cc9-b118-ef1430b81605 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:48.165606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a8e1acb7-3d26-4d00-afc0-4e4c99ed4ead tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:48.184001 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a8e1acb7-3d26-4d00-afc0-4e4c99ed4ead tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.609617 Jul 26 14:25:48.198917 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2146/4164] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:47 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:48.216018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08e68ad6-34ac-4413-9253-588b26566ed4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:48.227775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08e68ad6-34ac-4413-9253-588b26566ed4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:48.242857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=48 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:48.251983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e68ad6-34ac-4413-9253-588b26566ed4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:48.252725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e68ad6-34ac-4413-9253-588b26566ed4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:48.255728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e68ad6-34ac-4413-9253-588b26566ed4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:48.259311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e68ad6-34ac-4413-9253-588b26566ed4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:48.282528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-df696a01-181d-4cc9-b118-ef1430b81605 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:48.296445 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-df696a01-181d-4cc9-b118-ef1430b81605 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 200 len: 1507 microversion: 2.1 time: 0.357652 Jul 26 14:25:48.297580 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2019/4165] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:47 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:48.312064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-13bc8d23-6227-4dfd-96a2-e2442e1e3444 req-56d17b77-2175-4071-8f80-6b3999bc6846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c24f3d4-2732-40cf-94d4-6155480bd7c0", "name": "network-vif-plugged", "status": "completed", "tag": "5fb3e9ca-f414-4968-9e9a-8117f469969d"}, {"server_uuid": "0a3e2faf-7a49-47df-886a-ef79f5fbe3b8", "name": "network-vif-unplugged", "status": "completed", "tag": "85c04f3c-08b1-4c72-b7f3-94af7af851f7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:48.343664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-13bc8d23-6227-4dfd-96a2-e2442e1e3444 req-56d17b77-2175-4071-8f80-6b3999bc6846 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:48.344437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-13bc8d23-6227-4dfd-96a2-e2442e1e3444 req-56d17b77-2175-4071-8f80-6b3999bc6846 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:48.377506 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-13bc8d23-6227-4dfd-96a2-e2442e1e3444 req-56d17b77-2175-4071-8f80-6b3999bc6846 service nova] Creating event network-vif-plugged:5fb3e9ca-f414-4968-9e9a-8117f469969d for instance 3c24f3d4-2732-40cf-94d4-6155480bd7c0 on n-h2-833090-9 Jul 26 14:25:48.378175 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-13bc8d23-6227-4dfd-96a2-e2442e1e3444 req-56d17b77-2175-4071-8f80-6b3999bc6846 service nova] Creating event network-vif-unplugged:85c04f3c-08b1-4c72-b7f3-94af7af851f7 for instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 on n-h2-833090-9 Jul 26 14:25:48.415322 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-13bc8d23-6227-4dfd-96a2-e2442e1e3444 req-56d17b77-2175-4071-8f80-6b3999bc6846 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.110897 Jul 26 14:25:48.417948 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2020/4166] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:48.444234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6e66bc31-fbd1-4f90-ad95-457d04492c53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:48.445019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6e66bc31-fbd1-4f90-ad95-457d04492c53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:48.457837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e66bc31-fbd1-4f90-ad95-457d04492c53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:48.458967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e66bc31-fbd1-4f90-ad95-457d04492c53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:48.460071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e66bc31-fbd1-4f90-ad95-457d04492c53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:48.460807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e66bc31-fbd1-4f90-ad95-457d04492c53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:48.739243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-08e68ad6-34ac-4413-9253-588b26566ed4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:48.755484 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08e68ad6-34ac-4413-9253-588b26566ed4 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1506 microversion: 2.1 time: 0.554400 Jul 26 14:25:48.775485 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2147/4167] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:48 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:48.811914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-69e3b3a6-8add-41e4-ba6c-cc8bc52744c6 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:48.814208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6e66bc31-fbd1-4f90-ad95-457d04492c53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:48.816040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-69e3b3a6-8add-41e4-ba6c-cc8bc52744c6 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: da3c31ea-55d3-4814-9883-6544bd8c7f0e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:48.823602 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6e66bc31-fbd1-4f90-ad95-457d04492c53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.400577 Jul 26 14:25:48.834668 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2021/4168] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:48 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:48.834891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69e3b3a6-8add-41e4-ba6c-cc8bc52744c6 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:48.835466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69e3b3a6-8add-41e4-ba6c-cc8bc52744c6 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:48.836731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69e3b3a6-8add-41e4-ba6c-cc8bc52744c6 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:48.839171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-69e3b3a6-8add-41e4-ba6c-cc8bc52744c6 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:48.840018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c098d38-d0e9-458e-9e5c-98d40fa37d94 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:48.840663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c098d38-d0e9-458e-9e5c-98d40fa37d94 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:48.859389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c098d38-d0e9-458e-9e5c-98d40fa37d94 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:48.859982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c098d38-d0e9-458e-9e5c-98d40fa37d94 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:48.860812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c098d38-d0e9-458e-9e5c-98d40fa37d94 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:48.861375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c098d38-d0e9-458e-9e5c-98d40fa37d94 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:49.322098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-69e3b3a6-8add-41e4-ba6c-cc8bc52744c6 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:49.335593 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-69e3b3a6-8add-41e4-ba6c-cc8bc52744c6 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e" status: 200 len: 1318 microversion: 2.1 time: 0.558118 Jul 26 14:25:49.347993 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2148/4169] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:48 2022] GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:49.347993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-890af9f4-28d2-40fa-9909-2e6e02c7e67e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:49.352000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-890af9f4-28d2-40fa-9909-2e6e02c7e67e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:49.365701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-890af9f4-28d2-40fa-9909-2e6e02c7e67e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:49.366256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-890af9f4-28d2-40fa-9909-2e6e02c7e67e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:49.367405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-890af9f4-28d2-40fa-9909-2e6e02c7e67e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:49.368035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-890af9f4-28d2-40fa-9909-2e6e02c7e67e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:49.386226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c098d38-d0e9-458e-9e5c-98d40fa37d94 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:49.395999 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c098d38-d0e9-458e-9e5c-98d40fa37d94 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 0.559726 Jul 26 14:25:49.397058 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2022/4170] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:48 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:49.417464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9ffb969b-c5e7-435f-a93b-5784b6374d40 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:49.418321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9ffb969b-c5e7-435f-a93b-5784b6374d40 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:49.427895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ffb969b-c5e7-435f-a93b-5784b6374d40 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:49.428706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ffb969b-c5e7-435f-a93b-5784b6374d40 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:49.429505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ffb969b-c5e7-435f-a93b-5784b6374d40 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:49.430345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9ffb969b-c5e7-435f-a93b-5784b6374d40 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:49.799487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-890af9f4-28d2-40fa-9909-2e6e02c7e67e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:49.825631 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-890af9f4-28d2-40fa-9909-2e6e02c7e67e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.485806 Jul 26 14:25:49.832985 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2149/4171] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:49 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:49.846138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abd97eb9-46e3-4d2b-b0eb-3e1948b8963a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:49.848426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-abd97eb9-46e3-4d2b-b0eb-3e1948b8963a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:49.881069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abd97eb9-46e3-4d2b-b0eb-3e1948b8963a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:49.883389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abd97eb9-46e3-4d2b-b0eb-3e1948b8963a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:49.892356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abd97eb9-46e3-4d2b-b0eb-3e1948b8963a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:49.893669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abd97eb9-46e3-4d2b-b0eb-3e1948b8963a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:49.928759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ffb969b-c5e7-435f-a93b-5784b6374d40 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:49.940666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ffb969b-c5e7-435f-a93b-5784b6374d40 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:49.948934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9ffb969b-c5e7-435f-a93b-5784b6374d40 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:49.951879 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9ffb969b-c5e7-435f-a93b-5784b6374d40 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 0.551352 Jul 26 14:25:49.957955 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2023/4172] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:49 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:49.972394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1fe6ae38-e756-4d11-b2f1-72b1e8276c86 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:49.973451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1fe6ae38-e756-4d11-b2f1-72b1e8276c86 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:49.995496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1fe6ae38-e756-4d11-b2f1-72b1e8276c86 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:49.999581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1fe6ae38-e756-4d11-b2f1-72b1e8276c86 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:50.026275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1fe6ae38-e756-4d11-b2f1-72b1e8276c86 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:50.026896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1fe6ae38-e756-4d11-b2f1-72b1e8276c86 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:50.450214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1fe6ae38-e756-4d11-b2f1-72b1e8276c86 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:50.464382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-abd97eb9-46e3-4d2b-b0eb-3e1948b8963a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:50.473838 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-abd97eb9-46e3-4d2b-b0eb-3e1948b8963a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1506 microversion: 2.1 time: 0.638560 Jul 26 14:25:50.474680 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2150/4173] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:49 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1506 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:50.477120 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1fe6ae38-e756-4d11-b2f1-72b1e8276c86 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.514250 Jul 26 14:25:50.479630 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2024/4174] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:49 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:50.494758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0f6bba5-b9c3-4c8e-bad6-a3a317e434b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:50.495665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0f6bba5-b9c3-4c8e-bad6-a3a317e434b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: da3c31ea-55d3-4814-9883-6544bd8c7f0e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:50.496611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9b5d5c76-f3f8-47e8-bdb9-e84cf1cfeb76 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:50.499916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9b5d5c76-f3f8-47e8-bdb9-e84cf1cfeb76 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:50.503632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0f6bba5-b9c3-4c8e-bad6-a3a317e434b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:50.504550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0f6bba5-b9c3-4c8e-bad6-a3a317e434b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:50.505516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0f6bba5-b9c3-4c8e-bad6-a3a317e434b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:50.506124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0f6bba5-b9c3-4c8e-bad6-a3a317e434b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:50.512419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b5d5c76-f3f8-47e8-bdb9-e84cf1cfeb76 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:50.513605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b5d5c76-f3f8-47e8-bdb9-e84cf1cfeb76 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:50.516086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b5d5c76-f3f8-47e8-bdb9-e84cf1cfeb76 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:50.516953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b5d5c76-f3f8-47e8-bdb9-e84cf1cfeb76 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:50.725822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0f6bba5-b9c3-4c8e-bad6-a3a317e434b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:50.741312 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0f6bba5-b9c3-4c8e-bad6-a3a317e434b0 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e" status: 200 len: 1506 microversion: 2.1 time: 0.255549 Jul 26 14:25:50.744754 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2151/4175] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:50 2022] GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:50.758935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6787e0c-4b95-4ff6-86b3-ca642d95c491 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:50.760514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e6787e0c-4b95-4ff6-86b3-ca642d95c491 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:50.782643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6787e0c-4b95-4ff6-86b3-ca642d95c491 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:50.783799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6787e0c-4b95-4ff6-86b3-ca642d95c491 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:50.786732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6787e0c-4b95-4ff6-86b3-ca642d95c491 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:50.787905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6787e0c-4b95-4ff6-86b3-ca642d95c491 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:50.815264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9b5d5c76-f3f8-47e8-bdb9-e84cf1cfeb76 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:50.856268 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9b5d5c76-f3f8-47e8-bdb9-e84cf1cfeb76 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 0.371758 Jul 26 14:25:50.858763 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2025/4176] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:50 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:50.887333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d0e6351-a934-43f6-9722-04549e2ba678 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:50.890451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3d0e6351-a934-43f6-9722-04549e2ba678 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: da3c31ea-55d3-4814-9883-6544bd8c7f0e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:50.930324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d0e6351-a934-43f6-9722-04549e2ba678 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:50.933336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d0e6351-a934-43f6-9722-04549e2ba678 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:50.943115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d0e6351-a934-43f6-9722-04549e2ba678 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:50.948294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d0e6351-a934-43f6-9722-04549e2ba678 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:51.087562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3d0e6351-a934-43f6-9722-04549e2ba678 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: da3c31ea-55d3-4814-9883-6544bd8c7f0e] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:25:51.179887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e6787e0c-4b95-4ff6-86b3-ca642d95c491 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:51.193942 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e6787e0c-4b95-4ff6-86b3-ca642d95c491 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.446805 Jul 26 14:25:51.194602 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2152/4177] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:50 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:51.219116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9552778c-c109-44bf-aee3-9d87f2207aa0 req-215cf9eb-84e9-444e-a813-f9bd4b0a7274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7576357-b5e0-45fb-9641-d397a6b3faf2", "name": "network-vif-plugged", "status": "completed", "tag": "f88eaeb3-e484-4f96-b4ba-99b8b947950a"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:51.250582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9552778c-c109-44bf-aee3-9d87f2207aa0 req-215cf9eb-84e9-444e-a813-f9bd4b0a7274 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:51.251083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9552778c-c109-44bf-aee3-9d87f2207aa0 req-215cf9eb-84e9-444e-a813-f9bd4b0a7274 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:51.281565 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9552778c-c109-44bf-aee3-9d87f2207aa0 req-215cf9eb-84e9-444e-a813-f9bd4b0a7274 service nova] Creating event network-vif-plugged:f88eaeb3-e484-4f96-b4ba-99b8b947950a for instance d7576357-b5e0-45fb-9641-d397a6b3faf2 on n-h1-833090-9 Jul 26 14:25:51.299906 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9552778c-c109-44bf-aee3-9d87f2207aa0 req-215cf9eb-84e9-444e-a813-f9bd4b0a7274 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104039 Jul 26 14:25:51.303303 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2153/4178] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:51.306503 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3d0e6351-a934-43f6-9722-04549e2ba678 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "DELETE /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e" status: 204 len: 0 microversion: 2.1 time: 0.444053 Jul 26 14:25:51.310503 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2026/4179] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:25:50 2022] DELETE /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:25:51.315436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9ecd70bf-46f2-49cc-b21a-78b97d86849b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:51.320985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9ecd70bf-46f2-49cc-b21a-78b97d86849b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:51.323123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-584d93d3-7afa-435f-8bee-4d2c5bf9b974 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:51.325146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-584d93d3-7afa-435f-8bee-4d2c5bf9b974 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:51.338746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ecd70bf-46f2-49cc-b21a-78b97d86849b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:51.339464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ecd70bf-46f2-49cc-b21a-78b97d86849b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:51.340443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ecd70bf-46f2-49cc-b21a-78b97d86849b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:51.340897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ecd70bf-46f2-49cc-b21a-78b97d86849b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:51.362095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-584d93d3-7afa-435f-8bee-4d2c5bf9b974 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:51.364593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-584d93d3-7afa-435f-8bee-4d2c5bf9b974 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:51.369789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-584d93d3-7afa-435f-8bee-4d2c5bf9b974 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:51.372292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-584d93d3-7afa-435f-8bee-4d2c5bf9b974 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:51.472696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-584d93d3-7afa-435f-8bee-4d2c5bf9b974 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:25:51.754343 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-584d93d3-7afa-435f-8bee-4d2c5bf9b974 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "DELETE /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 204 len: 0 microversion: 2.1 time: 0.438044 Jul 26 14:25:51.759678 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2027/4180] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:25:51 2022] DELETE /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:25:51.785537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5f9b3a1d-69f9-4efe-b7e2-725f4adf3d9f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:51.786636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5f9b3a1d-69f9-4efe-b7e2-725f4adf3d9f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:51.800157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f9b3a1d-69f9-4efe-b7e2-725f4adf3d9f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:51.801260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f9b3a1d-69f9-4efe-b7e2-725f4adf3d9f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:51.803144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f9b3a1d-69f9-4efe-b7e2-725f4adf3d9f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:51.804068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f9b3a1d-69f9-4efe-b7e2-725f4adf3d9f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:52.169797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ecd70bf-46f2-49cc-b21a-78b97d86849b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:52.188441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ecd70bf-46f2-49cc-b21a-78b97d86849b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:52.190285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ecd70bf-46f2-49cc-b21a-78b97d86849b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:52.192300 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9ecd70bf-46f2-49cc-b21a-78b97d86849b tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 0.886056 Jul 26 14:25:52.205177 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2154/4181] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:51 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:52.222563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3b0722d-1cdf-462a-8570-38c800244791 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:52.223590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3b0722d-1cdf-462a-8570-38c800244791 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: da3c31ea-55d3-4814-9883-6544bd8c7f0e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:52.234498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3b0722d-1cdf-462a-8570-38c800244791 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:52.235773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3b0722d-1cdf-462a-8570-38c800244791 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:52.236829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3b0722d-1cdf-462a-8570-38c800244791 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:52.237470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3b0722d-1cdf-462a-8570-38c800244791 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:52.380613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5f9b3a1d-69f9-4efe-b7e2-725f4adf3d9f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:52.397458 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5f9b3a1d-69f9-4efe-b7e2-725f4adf3d9f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 200 len: 1449 microversion: 2.1 time: 0.633221 Jul 26 14:25:52.398453 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2028/4182] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:51 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 1449 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:52.411599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c479691f-fbfb-402b-afe4-5227046cd3a8 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:52.414630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c479691f-fbfb-402b-afe4-5227046cd3a8 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:52.425985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c479691f-fbfb-402b-afe4-5227046cd3a8 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:52.426888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c479691f-fbfb-402b-afe4-5227046cd3a8 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:52.428428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c479691f-fbfb-402b-afe4-5227046cd3a8 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:52.429615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c479691f-fbfb-402b-afe4-5227046cd3a8 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:52.594724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a3b0722d-1cdf-462a-8570-38c800244791 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:52.613832 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a3b0722d-1cdf-462a-8570-38c800244791 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e" status: 200 len: 1512 microversion: 2.1 time: 0.407121 Jul 26 14:25:52.615473 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2155/4183] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:52 2022] GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:52.648992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:52.651768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:52.669306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:52.669801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:52.673367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:52.674965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:52.731356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c479691f-fbfb-402b-afe4-5227046cd3a8 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:52.736457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:25:52.742573 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c479691f-fbfb-402b-afe4-5227046cd3a8 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1322 microversion: 2.1 time: 0.342344 Jul 26 14:25:52.743719 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2029/4184] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:52 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:52.760870 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.compute.api [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Working on deleting snapshot 6bd5e72f-ae9d-4668-84fd-0f82a6ea9b0e from shelved instance... Jul 26 14:25:53.237495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4f7f32b-1a0c-4698-97a5-13909e78bc6c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:53.239451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b4f7f32b-1a0c-4698-97a5-13909e78bc6c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:53.278224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4f7f32b-1a0c-4698-97a5-13909e78bc6c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:53.281529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4f7f32b-1a0c-4698-97a5-13909e78bc6c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:53.283349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4f7f32b-1a0c-4698-97a5-13909e78bc6c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:53.289249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4f7f32b-1a0c-4698-97a5-13909e78bc6c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:53.721415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4f7f32b-1a0c-4698-97a5-13909e78bc6c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:53.733867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4f7f32b-1a0c-4698-97a5-13909e78bc6c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:53.737475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4f7f32b-1a0c-4698-97a5-13909e78bc6c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:53.741162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b4f7f32b-1a0c-4698-97a5-13909e78bc6c tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1729 microversion: 2.20 time: 0.510977 Jul 26 14:25:53.757627 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2030/4185] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:53 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1729 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:53.786796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce43c6c2-6268-455e-956a-d57405b742d3 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:53.787692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce43c6c2-6268-455e-956a-d57405b742d3 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: da3c31ea-55d3-4814-9883-6544bd8c7f0e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:53.794497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce43c6c2-6268-455e-956a-d57405b742d3 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:53.795887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce43c6c2-6268-455e-956a-d57405b742d3 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:53.797073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce43c6c2-6268-455e-956a-d57405b742d3 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:53.797549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce43c6c2-6268-455e-956a-d57405b742d3 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:53.897822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:54.305301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Doing local delete in cell b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) {{(pid=119479) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 26 14:25:54.315041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:54.315939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:54.318947 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.compute.api [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 26 14:25:54.327181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] deallocate_for_instance() {{(pid=119479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 26 14:25:54.489807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ce43c6c2-6268-455e-956a-d57405b742d3 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:54.508558 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce43c6c2-6268-455e-956a-d57405b742d3 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e" status: 200 len: 1512 microversion: 2.1 time: 0.743181 Jul 26 14:25:54.509785 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2031/4186] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:53 2022] GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e => generated 1512 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:54.518175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-150a72ce-439a-4306-957e-129ac3b03276 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:54.523705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-150a72ce-439a-4306-957e-129ac3b03276 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:54.545711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-150a72ce-439a-4306-957e-129ac3b03276 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:54.546608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-150a72ce-439a-4306-957e-129ac3b03276 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:54.551577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-150a72ce-439a-4306-957e-129ac3b03276 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:54.552474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-150a72ce-439a-4306-957e-129ac3b03276 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:55.796425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-150a72ce-439a-4306-957e-129ac3b03276 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:55.804922 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-150a72ce-439a-4306-957e-129ac3b03276 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1471 microversion: 2.1 time: 1.293756 Jul 26 14:25:55.808843 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2032/4187] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:54 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1471 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:55.828737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bd0c1be3-e7f0-47a0-a85b-f701dc7a4657 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:55.829682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bd0c1be3-e7f0-47a0-a85b-f701dc7a4657 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:55.850099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd0c1be3-e7f0-47a0-a85b-f701dc7a4657 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:55.850924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd0c1be3-e7f0-47a0-a85b-f701dc7a4657 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:55.851997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd0c1be3-e7f0-47a0-a85b-f701dc7a4657 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:55.852635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd0c1be3-e7f0-47a0-a85b-f701dc7a4657 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:56.254515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bd0c1be3-e7f0-47a0-a85b-f701dc7a4657 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:56.271323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bd0c1be3-e7f0-47a0-a85b-f701dc7a4657 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:56.274134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bd0c1be3-e7f0-47a0-a85b-f701dc7a4657 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:56.279855 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bd0c1be3-e7f0-47a0-a85b-f701dc7a4657 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1716 microversion: 2.20 time: 0.468690 Jul 26 14:25:56.284688 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2033/4188] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:25:55 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1716 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:25:56.297598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d024e53-7ea4-4a71-9dd8-a599d6019d1b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:56.298517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4d024e53-7ea4-4a71-9dd8-a599d6019d1b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: da3c31ea-55d3-4814-9883-6544bd8c7f0e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:56.311448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d024e53-7ea4-4a71-9dd8-a599d6019d1b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:56.327081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d024e53-7ea4-4a71-9dd8-a599d6019d1b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:56.328311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d024e53-7ea4-4a71-9dd8-a599d6019d1b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:56.328988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d024e53-7ea4-4a71-9dd8-a599d6019d1b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:56.854764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4d024e53-7ea4-4a71-9dd8-a599d6019d1b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:56.872633 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4d024e53-7ea4-4a71-9dd8-a599d6019d1b tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e" status: 200 len: 1512 microversion: 2.1 time: 0.586422 Jul 26 14:25:56.873784 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2034/4189] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:56 2022] GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e => generated 1512 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:57.406352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Updating instance_info_cache with network_info: [] {{(pid=119479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:25:57.470504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:25:57.591175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-462026f3-bfe2-4ff2-958f-db1ed9c612f5 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:57.602055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-462026f3-bfe2-4ff2-958f-db1ed9c612f5 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] [instance: e5fd6292-f9bd-476f-8136-fc7ad5318dc4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:57.628823 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-462026f3-bfe2-4ff2-958f-db1ed9c612f5 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] HTTP exception thrown: Instance e5fd6292-f9bd-476f-8136-fc7ad5318dc4 could not be found. Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-462026f3-bfe2-4ff2-958f-db1ed9c612f5 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Request method failure captured: Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/e5fd6292-f9bd-476f-8136-fc7ad5318dc4/action HTTP/1.1 Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 15 Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_lEHjiPqOk1XMAwlmEywJYpywHzA_HkDcpvH_ofj5OWeGV8CTPIKA2fFVzsI75bmtE0ei1RrgxKaBAn9F3zYJhzCPF9_7N_ssSsilRFEt4JpCliaMHNhPtXPsMjk8_Moz7gXA-P4GpfEmCtH6ecChgTDVg3CwXLksht-Mf3tN4qxdE Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 967d3bbe82384d7c99a848d8beccc940 Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/967d3bbe82384d7c99a848d8beccc940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/967d3bbe82384d7c99a848d8beccc940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_967d3bbe82384d7c99a848d8beccc940", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/967d3bbe82384d7c99a848d8beccc940"}]}] Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 967d3bbe82384d7c99a848d8beccc940 Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersAdminNegativeTestJSON-426556569-project-admin Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: c6130345b01a47b1aeeee25cdaa6972c Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersAdminNegativeTestJSON-426556569-project-admin Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: {"migrate": {}} Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance e5fd6292-f9bd-476f-8136-fc7ad5318dc4 could not be found. Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e5fd6292-f9bd-476f-8136-fc7ad5318dc4', 'body': {'migrate': {}}} Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5fd6292-f9bd-476f-8136-fc7ad5318dc4 could not be found. Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5fd6292-f9bd-476f-8136-fc7ad5318dc4 could not be found. Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:57.633011 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:57.643909 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:57.643909 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:57.643909 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:25:57.643909 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:25:57.643909 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5fd6292-f9bd-476f-8136-fc7ad5318dc4 could not be found. Jul 26 14:25:57.643909 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:25:57.648861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-462026f3-bfe2-4ff2-958f-db1ed9c612f5 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Returning 404 to user: Instance e5fd6292-f9bd-476f-8136-fc7ad5318dc4 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:25:57.650693 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-462026f3-bfe2-4ff2-958f-db1ed9c612f5 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/e5fd6292-f9bd-476f-8136-fc7ad5318dc4/action" status: 404 len: 111 microversion: 2.1 time: 0.775110 Jul 26 14:25:57.652860 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2035/4190] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:25:56 2022] POST /compute/v2.1/servers/e5fd6292-f9bd-476f-8136-fc7ad5318dc4/action => generated 111 bytes in 778 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:25:57.665613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-299451e0-c547-4f25-8ed7-fe60e3231689 req-7b737a66-567e-4867-b651-79babf0c7b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3c31ea-55d3-4814-9883-6544bd8c7f0e", "name": "network-vif-deleted", "tag": "79e2c4c8-c4e4-401d-b78b-198c84b13ef7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:57.700876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-299451e0-c547-4f25-8ed7-fe60e3231689 req-7b737a66-567e-4867-b651-79babf0c7b08 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:57.702461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-299451e0-c547-4f25-8ed7-fe60e3231689 req-7b737a66-567e-4867-b651-79babf0c7b08 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:57.751714 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-299451e0-c547-4f25-8ed7-fe60e3231689 req-7b737a66-567e-4867-b651-79babf0c7b08 service nova] Creating event network-vif-deleted:79e2c4c8-c4e4-401d-b78b-198c84b13ef7 for instance da3c31ea-55d3-4814-9883-6544bd8c7f0e on n-h2-833090-9 Jul 26 14:25:57.766963 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-299451e0-c547-4f25-8ed7-fe60e3231689 req-7b737a66-567e-4867-b651-79babf0c7b08 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111198 Jul 26 14:25:57.770470 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2036/4191] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:25:57.899382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:57.901217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: da3c31ea-55d3-4814-9883-6544bd8c7f0e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:57.912038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:57.915711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:57.915711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:57.915711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:57.958852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:57.959291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:57.960290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lazy-loading 'fault' on Instance uuid da3c31ea-55d3-4814-9883-6544bd8c7f0e {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:25:58.040995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe21380ccc24827b47f5d5c199fc114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f0a862c2bf490886e8a6bb2411a29e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:25:58.049909 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-87372e80-be9b-40b8-8509-00e5f15f0911 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e" status: 200 len: 1308 microversion: 2.1 time: 0.157095 Jul 26 14:25:58.050787 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2037/4192] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:57 2022] GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:25:58.111348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1542206639", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:58.209808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:25:58.235049 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8c43744b-620a-4967-bea2-1a6ecb74be61 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 204 len: 0 microversion: 2.1 time: 5.617910 Jul 26 14:25:58.240859 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2156/4193] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:25:52 2022] DELETE /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 0 bytes in 5621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:25:58.247470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cf0be386-ccf1-4b2a-9a30-c6e4b6ef537a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:58.251652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cf0be386-ccf1-4b2a-9a30-c6e4b6ef537a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:58.260308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf0be386-ccf1-4b2a-9a30-c6e4b6ef537a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:58.261391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf0be386-ccf1-4b2a-9a30-c6e4b6ef537a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:58.263455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf0be386-ccf1-4b2a-9a30-c6e4b6ef537a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:58.265121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cf0be386-ccf1-4b2a-9a30-c6e4b6ef537a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:58.433971 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cf0be386-ccf1-4b2a-9a30-c6e4b6ef537a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.191151 Jul 26 14:25:58.437727 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2157/4194] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:25:58 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:25:58.452445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5efe7ea-289a-47f4-b04f-9b932240ccc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:58.456962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a5efe7ea-289a-47f4-b04f-9b932240ccc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:58.465449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5efe7ea-289a-47f4-b04f-9b932240ccc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:58.466493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5efe7ea-289a-47f4-b04f-9b932240ccc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:58.468343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5efe7ea-289a-47f4-b04f-9b932240ccc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:58.470667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5efe7ea-289a-47f4-b04f-9b932240ccc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:58.513023 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a5efe7ea-289a-47f4-b04f-9b932240ccc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5efe7ea-289a-47f4-b04f-9b932240ccc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 HTTP/1.1 Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '0a3e2faf-7a49-47df-886a-ef79f5fbe3b8'} Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:25:58.519402 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:25:58.527187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:25:58.527187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:25:58.527187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:25:58.527187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:25:58.527187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:25:58.527187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:25:58.527187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:25:58.527187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5efe7ea-289a-47f4-b04f-9b932240ccc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:25:58.530499 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a5efe7ea-289a-47f4-b04f-9b932240ccc0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 404 len: 111 microversion: 2.1 time: 0.082696 Jul 26 14:25:58.532130 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2158/4195] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:58 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:25:58.555325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5c3612f1-7a91-454f-8b47-5626b541923b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:25:58.556237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5c3612f1-7a91-454f-8b47-5626b541923b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:25:58.568307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c3612f1-7a91-454f-8b47-5626b541923b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:58.570384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c3612f1-7a91-454f-8b47-5626b541923b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:58.572644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c3612f1-7a91-454f-8b47-5626b541923b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:58.575394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c3612f1-7a91-454f-8b47-5626b541923b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:58.650258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:25:58.650643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:25:58.651152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:25:58.651530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:25:58.652020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:25:58.684894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:58.685360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:58.687002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:25:58.687450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:25:58.739093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Getting quotas for project d2cac47fd5cf4c93a0ea6ee5b1d41642. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:25:58.760597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Getting quotas for user 8589a1f1945945cc91bdf4485a9dde53 and project d2cac47fd5cf4c93a0ea6ee5b1d41642. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:25:58.785551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:25:58.790941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:25:58.862291 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5d4a490f-1608-42a8-909b-747ab97ad100 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754066 Jul 26 14:25:58.862999 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2038/4196] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:25:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:25:58.874480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1743377096", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "01fdab58-8c00-4787-8288-5206df456cd7"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:25:59.006077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] validate_networks() for [('01fdab58-8c00-4787-8288-5206df456cd7', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:26:00.087085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5c3612f1-7a91-454f-8b47-5626b541923b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:00.104897 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5c3612f1-7a91-454f-8b47-5626b541923b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1669 microversion: 2.1 time: 1.560278 Jul 26 14:26:00.106181 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2159/4197] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:25:58 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1669 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:00.122347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9139fdc5-776a-475f-bc76-404c1b6ba242 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:00.123445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9139fdc5-776a-475f-bc76-404c1b6ba242 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:00.137995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9139fdc5-776a-475f-bc76-404c1b6ba242 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:00.138532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9139fdc5-776a-475f-bc76-404c1b6ba242 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:00.140220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9139fdc5-776a-475f-bc76-404c1b6ba242 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:00.140914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9139fdc5-776a-475f-bc76-404c1b6ba242 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:00.344124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9139fdc5-776a-475f-bc76-404c1b6ba242 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:00.354378 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9139fdc5-776a-475f-bc76-404c1b6ba242 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1218 microversion: 2.1 time: 0.246205 Jul 26 14:26:00.360063 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2160/4198] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:00 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1218 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:00.376397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c863915a-d92e-4cc3-866b-f1d4bf664188 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:00.378994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c863915a-d92e-4cc3-866b-f1d4bf664188 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: da3c31ea-55d3-4814-9883-6544bd8c7f0e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:00.398429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c863915a-d92e-4cc3-866b-f1d4bf664188 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:00.399126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c863915a-d92e-4cc3-866b-f1d4bf664188 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:00.400115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c863915a-d92e-4cc3-866b-f1d4bf664188 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:00.401536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c863915a-d92e-4cc3-866b-f1d4bf664188 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:00.434769 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c863915a-d92e-4cc3-866b-f1d4bf664188 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] HTTP exception thrown: Instance da3c31ea-55d3-4814-9883-6544bd8c7f0e could not be found. Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c863915a-d92e-4cc3-866b-f1d4bf664188 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Request method failure captured: Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e HTTP/1.1 Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_kaB-mkrxiKSMvP0FCBQK0rhnuk4t2UbsBSpPct3ILKVooJ7l1dDGsVklC3vl0o-HT1SqM-tqgeXKJFdzPrIaxUzmQnkI3J1iRVr6TkGUsc8mACIg6HRuUlidepLiZXjDKl2n95BSnerYINZ1fXGMSrj1s1RB8csOW30ugchuHxXmw Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: e7f0a862c2bf490886e8a6bb2411a29e Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-MultipleCreateTestJSON-1264210576 Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e7f0a862c2bf490886e8a6bb2411a29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e7f0a862c2bf490886e8a6bb2411a29e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e7f0a862c2bf490886e8a6bb2411a29e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e7f0a862c2bf490886e8a6bb2411a29e"}]}] Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-MultipleCreateTestJSON-1264210576 Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: e7f0a862c2bf490886e8a6bb2411a29e Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1264210576 Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-MultipleCreateTestJSON-1264210576-project Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 9fe21380ccc24827b47f5d5c199fc114 Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-MultipleCreateTestJSON-1264210576-project Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance da3c31ea-55d3-4814-9883-6544bd8c7f0e could not be found. Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'da3c31ea-55d3-4814-9883-6544bd8c7f0e'} Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3c31ea-55d3-4814-9883-6544bd8c7f0e could not be found. Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3c31ea-55d3-4814-9883-6544bd8c7f0e could not be found. Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:00.444606 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:00.448240 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:00.448240 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:00.448240 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:00.448240 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:00.448240 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:00.448240 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3c31ea-55d3-4814-9883-6544bd8c7f0e could not be found. Jul 26 14:26:00.448240 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:00.449625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c863915a-d92e-4cc3-866b-f1d4bf664188 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Returning 404 to user: Instance da3c31ea-55d3-4814-9883-6544bd8c7f0e could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:00.450693 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c863915a-d92e-4cc3-866b-f1d4bf664188 tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e" status: 404 len: 111 microversion: 2.1 time: 0.089370 Jul 26 14:26:00.452699 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2161/4199] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:00 2022] GET /compute/v2.1/servers/da3c31ea-55d3-4814-9883-6544bd8c7f0e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:26:00.459024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-dbf17e85-b893-4067-af4e-da1a69326b4c req-6dde0ae1-facc-4de1-9c70-93fadf2ef17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944efc3d-093a-44a9-b7e6-ddd2083f6f88", "name": "network-vif-deleted", "tag": "54fffc38-8257-4447-991f-098ca2b1059b"}, {"server_uuid": "0a3e2faf-7a49-47df-886a-ef79f5fbe3b8", "name": "network-vif-deleted", "tag": "85c04f3c-08b1-4c72-b7f3-94af7af851f7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:00.484575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-dbf17e85-b893-4067-af4e-da1a69326b4c req-6dde0ae1-facc-4de1-9c70-93fadf2ef17c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:00.496770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-dbf17e85-b893-4067-af4e-da1a69326b4c req-6dde0ae1-facc-4de1-9c70-93fadf2ef17c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:00.524183 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-dbf17e85-b893-4067-af4e-da1a69326b4c req-6dde0ae1-facc-4de1-9c70-93fadf2ef17c service nova] Creating event network-vif-deleted:54fffc38-8257-4447-991f-098ca2b1059b for instance 944efc3d-093a-44a9-b7e6-ddd2083f6f88 on n-h1-833090-9 Jul 26 14:26:00.525071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.server_external_events [req-dbf17e85-b893-4067-af4e-da1a69326b4c req-6dde0ae1-facc-4de1-9c70-93fadf2ef17c service nova] Unable to find a host for instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8. Dropping event network-vif-deleted {{(pid=119479) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 14:26:00.539306 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-dbf17e85-b893-4067-af4e-da1a69326b4c req-6dde0ae1-facc-4de1-9c70-93fadf2ef17c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 351 microversion: 2.1 time: 0.081743 Jul 26 14:26:00.540727 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2162/4200] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 351 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 14:26:00.550807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-46ecacf6-65ff-4c7a-a6f5-7c0084efc70d tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:00.553014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-46ecacf6-65ff-4c7a-a6f5-7c0084efc70d tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] [instance: 944efc3d-093a-44a9-b7e6-ddd2083f6f88] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:00.562159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46ecacf6-65ff-4c7a-a6f5-7c0084efc70d tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:00.562865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46ecacf6-65ff-4c7a-a6f5-7c0084efc70d tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:00.564417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46ecacf6-65ff-4c7a-a6f5-7c0084efc70d tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:00.565351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-46ecacf6-65ff-4c7a-a6f5-7c0084efc70d tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:00.586406 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-46ecacf6-65ff-4c7a-a6f5-7c0084efc70d tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] HTTP exception thrown: Instance 944efc3d-093a-44a9-b7e6-ddd2083f6f88 could not be found. Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-46ecacf6-65ff-4c7a-a6f5-7c0084efc70d tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Request method failure captured: Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 HTTP/1.1 Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_kaB-mkrxiKSMvP0FCBQK0rhnuk4t2UbsBSpPct3ILKVooJ7l1dDGsVklC3vl0o-HT1SqM-tqgeXKJFdzPrIaxUzmQnkI3J1iRVr6TkGUsc8mACIg6HRuUlidepLiZXjDKl2n95BSnerYINZ1fXGMSrj1s1RB8csOW30ugchuHxXmw Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: e7f0a862c2bf490886e8a6bb2411a29e Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-MultipleCreateTestJSON-1264210576 Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e7f0a862c2bf490886e8a6bb2411a29e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e7f0a862c2bf490886e8a6bb2411a29e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e7f0a862c2bf490886e8a6bb2411a29e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e7f0a862c2bf490886e8a6bb2411a29e"}]}] Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-MultipleCreateTestJSON-1264210576 Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: e7f0a862c2bf490886e8a6bb2411a29e Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1264210576 Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-MultipleCreateTestJSON-1264210576-project Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 9fe21380ccc24827b47f5d5c199fc114 Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-MultipleCreateTestJSON-1264210576-project Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 944efc3d-093a-44a9-b7e6-ddd2083f6f88 could not be found. Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '944efc3d-093a-44a9-b7e6-ddd2083f6f88'} Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 944efc3d-093a-44a9-b7e6-ddd2083f6f88 could not be found. Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 944efc3d-093a-44a9-b7e6-ddd2083f6f88 could not be found. Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:00.589004 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:00.597351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:00.597351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:00.597351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:00.597351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:00.597351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:00.597351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 944efc3d-093a-44a9-b7e6-ddd2083f6f88 could not be found. Jul 26 14:26:00.597351 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:00.597351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-46ecacf6-65ff-4c7a-a6f5-7c0084efc70d tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] Returning 404 to user: Instance 944efc3d-093a-44a9-b7e6-ddd2083f6f88 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:00.597351 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-46ecacf6-65ff-4c7a-a6f5-7c0084efc70d tempest-MultipleCreateTestJSON-1264210576 tempest-MultipleCreateTestJSON-1264210576-project] 10.222.0.70 "GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88" status: 404 len: 111 microversion: 2.1 time: 0.050655 Jul 26 14:26:00.598668 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2163/4201] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:00 2022] GET /compute/v2.1/servers/944efc3d-093a-44a9-b7e6-ddd2083f6f88 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:26:01.133011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a79750a-d21e-4471-a867-07f74c79d04f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:01.134554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a79750a-d21e-4471-a867-07f74c79d04f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:01.157250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a79750a-d21e-4471-a867-07f74c79d04f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:01.157811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a79750a-d21e-4471-a867-07f74c79d04f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:01.158709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a79750a-d21e-4471-a867-07f74c79d04f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:01.164445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a79750a-d21e-4471-a867-07f74c79d04f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:01.977334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:26:01.979896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:26:01.980967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:26:01.982101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:26:01.983649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:26:02.026370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:02.031522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:02.035023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:02.037261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:02.101030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a79750a-d21e-4471-a867-07f74c79d04f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:02.111846 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a79750a-d21e-4471-a867-07f74c79d04f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1669 microversion: 2.1 time: 0.985111 Jul 26 14:26:02.116666 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2164/4202] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:01 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1669 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:02.117586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:26:02.141284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-81803a92-8c0e-45a7-a9ed-f8868e1d2a35 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:02.153722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-81803a92-8c0e-45a7-a9ed-f8868e1d2a35 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:02.176731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for user b1e46ed350fa42669bba323ef30b982d and project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:26:02.185347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81803a92-8c0e-45a7-a9ed-f8868e1d2a35 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:02.185990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81803a92-8c0e-45a7-a9ed-f8868e1d2a35 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:02.186881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81803a92-8c0e-45a7-a9ed-f8868e1d2a35 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:02.187386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81803a92-8c0e-45a7-a9ed-f8868e1d2a35 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:02.230712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:26:02.238907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:26:02.287140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:02.329501 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3a09f103-d1d7-4dbe-bc70-443d34445afb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.460747 Jul 26 14:26:02.340172 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2039/4203] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:25:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:26:02.349243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0aeb7916-490e-4322-9043-fd59886c14e1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:02.350907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0aeb7916-490e-4322-9043-fd59886c14e1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:02.487783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-81803a92-8c0e-45a7-a9ed-f8868e1d2a35 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:02.524650 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-81803a92-8c0e-45a7-a9ed-f8868e1d2a35 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1280 microversion: 2.1 time: 0.405514 Jul 26 14:26:02.529027 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2165/4204] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:02 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1280 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:02.698350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0aeb7916-490e-4322-9043-fd59886c14e1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:02.726081 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0aeb7916-490e-4322-9043-fd59886c14e1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1215 microversion: 2.1 time: 0.384292 Jul 26 14:26:02.731635 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2040/4205] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:02 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:03.138392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1209bc1-2a48-4695-8f52-986f91611b1a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:03.139292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f1209bc1-2a48-4695-8f52-986f91611b1a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:03.148281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1209bc1-2a48-4695-8f52-986f91611b1a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:03.149754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1209bc1-2a48-4695-8f52-986f91611b1a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:03.155661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1209bc1-2a48-4695-8f52-986f91611b1a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:03.156666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1209bc1-2a48-4695-8f52-986f91611b1a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:03.551093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e547445-b0aa-4b25-972b-ae3216ab6f06 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:03.553430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e547445-b0aa-4b25-972b-ae3216ab6f06 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:03.566822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e547445-b0aa-4b25-972b-ae3216ab6f06 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:03.567647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e547445-b0aa-4b25-972b-ae3216ab6f06 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:03.571301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e547445-b0aa-4b25-972b-ae3216ab6f06 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:03.573704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e547445-b0aa-4b25-972b-ae3216ab6f06 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:03.788199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2e547445-b0aa-4b25-972b-ae3216ab6f06 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:03.825788 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e547445-b0aa-4b25-972b-ae3216ab6f06 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1280 microversion: 2.1 time: 0.278478 Jul 26 14:26:03.849630 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2041/4206] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:03 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1280 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:03.869626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-70b0bdf0-58a0-43b4-97d2-b015e6729bbd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:03.871265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-70b0bdf0-58a0-43b4-97d2-b015e6729bbd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:03.897928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b0bdf0-58a0-43b4-97d2-b015e6729bbd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:03.899378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b0bdf0-58a0-43b4-97d2-b015e6729bbd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:03.901161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b0bdf0-58a0-43b4-97d2-b015e6729bbd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:03.906451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b0bdf0-58a0-43b4-97d2-b015e6729bbd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:03.923273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1209bc1-2a48-4695-8f52-986f91611b1a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:03.941178 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f1209bc1-2a48-4695-8f52-986f91611b1a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.808213 Jul 26 14:26:03.956269 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2166/4207] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:03 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:04.217576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-70b0bdf0-58a0-43b4-97d2-b015e6729bbd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:04.231578 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-70b0bdf0-58a0-43b4-97d2-b015e6729bbd tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1267 microversion: 2.1 time: 0.380632 Jul 26 14:26:04.253314 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2042/4208] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:03 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1267 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:04.849440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c31ca123-611d-4d74-8c28-cfd4df216dda tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:04.850268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c31ca123-611d-4d74-8c28-cfd4df216dda tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:04.872662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c31ca123-611d-4d74-8c28-cfd4df216dda tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:04.876895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c31ca123-611d-4d74-8c28-cfd4df216dda tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:04.881123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c31ca123-611d-4d74-8c28-cfd4df216dda tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:04.885516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c31ca123-611d-4d74-8c28-cfd4df216dda tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:05.261654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7ebf3763-2903-4328-a952-6e85798fb28d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:05.263379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7ebf3763-2903-4328-a952-6e85798fb28d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:05.281522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7ebf3763-2903-4328-a952-6e85798fb28d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:05.285234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7ebf3763-2903-4328-a952-6e85798fb28d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:05.286632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7ebf3763-2903-4328-a952-6e85798fb28d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:05.287423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7ebf3763-2903-4328-a952-6e85798fb28d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:05.536481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7ebf3763-2903-4328-a952-6e85798fb28d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:05.580151 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7ebf3763-2903-4328-a952-6e85798fb28d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1285 microversion: 2.1 time: 0.323066 Jul 26 14:26:05.604965 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2043/4209] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:05 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1285 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:05.777499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c31ca123-611d-4d74-8c28-cfd4df216dda tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:05.798767 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c31ca123-611d-4d74-8c28-cfd4df216dda tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1322 microversion: 2.1 time: 0.953620 Jul 26 14:26:05.801703 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2167/4210] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:04 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1322 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:06.624617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c7c514b-ef4b-4d65-8e2f-0bbcd9d4615b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:06.624984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c7c514b-ef4b-4d65-8e2f-0bbcd9d4615b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:06.633063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c7c514b-ef4b-4d65-8e2f-0bbcd9d4615b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:06.634926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c7c514b-ef4b-4d65-8e2f-0bbcd9d4615b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:06.636013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c7c514b-ef4b-4d65-8e2f-0bbcd9d4615b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:06.637067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c7c514b-ef4b-4d65-8e2f-0bbcd9d4615b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:06.836711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c6045eb8-c7ba-490f-a20f-331ef9e7d465 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:06.839093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c6045eb8-c7ba-490f-a20f-331ef9e7d465 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:06.861006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c7c514b-ef4b-4d65-8e2f-0bbcd9d4615b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:06.865852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6045eb8-c7ba-490f-a20f-331ef9e7d465 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:06.872939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6045eb8-c7ba-490f-a20f-331ef9e7d465 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:06.873312 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2c7c514b-ef4b-4d65-8e2f-0bbcd9d4615b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1273 microversion: 2.1 time: 0.252962 Jul 26 14:26:06.874038 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2044/4211] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:06 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1273 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:06.875737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6045eb8-c7ba-490f-a20f-331ef9e7d465 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:06.877049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6045eb8-c7ba-490f-a20f-331ef9e7d465 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:07.892622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c6045eb8-c7ba-490f-a20f-331ef9e7d465 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:07.903554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ab0a4da8-dd6e-4866-9766-58d579e6312a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:07.905038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ab0a4da8-dd6e-4866-9766-58d579e6312a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:07.922913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab0a4da8-dd6e-4866-9766-58d579e6312a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:07.923837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab0a4da8-dd6e-4866-9766-58d579e6312a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:07.924482 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c6045eb8-c7ba-490f-a20f-331ef9e7d465 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1322 microversion: 2.1 time: 1.102869 Jul 26 14:26:07.925702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab0a4da8-dd6e-4866-9766-58d579e6312a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:07.927880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab0a4da8-dd6e-4866-9766-58d579e6312a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:07.940723 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2168/4212] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:06 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1322 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:08.980213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb745d9c-f0a5-43f0-b634-ab9551af347b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:08.982566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cb745d9c-f0a5-43f0-b634-ab9551af347b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:09.021829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb745d9c-f0a5-43f0-b634-ab9551af347b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:09.026438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb745d9c-f0a5-43f0-b634-ab9551af347b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:09.028245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb745d9c-f0a5-43f0-b634-ab9551af347b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:09.032979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb745d9c-f0a5-43f0-b634-ab9551af347b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:09.505273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ab0a4da8-dd6e-4866-9766-58d579e6312a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:09.528322 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ab0a4da8-dd6e-4866-9766-58d579e6312a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1315 microversion: 2.1 time: 1.623856 Jul 26 14:26:09.533234 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2045/4213] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:07 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1315 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:10.072538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cb745d9c-f0a5-43f0-b634-ab9551af347b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:10.081825 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cb745d9c-f0a5-43f0-b634-ab9551af347b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1322 microversion: 2.1 time: 1.117432 Jul 26 14:26:10.092939 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2169/4214] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:08 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1322 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:10.569721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-31dd7e32-6d7b-4fd8-b131-df38933f2b10 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:10.570594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-31dd7e32-6d7b-4fd8-b131-df38933f2b10 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:10.590306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31dd7e32-6d7b-4fd8-b131-df38933f2b10 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:10.594552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31dd7e32-6d7b-4fd8-b131-df38933f2b10 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:10.602848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31dd7e32-6d7b-4fd8-b131-df38933f2b10 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:10.603231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31dd7e32-6d7b-4fd8-b131-df38933f2b10 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:10.912385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-5c2dad70-78d3-4a7b-b5a4-c3dc94f7ab4c req-808ac7cb-ad1e-4d97-9185-cf8b2ee3ccae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d060450-0605-41f4-8bb5-38ff9a4388c5", "tag": "7c18c3de-f26b-4037-97aa-c1985ec47e89"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:10.937740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5c2dad70-78d3-4a7b-b5a4-c3dc94f7ab4c req-808ac7cb-ad1e-4d97-9185-cf8b2ee3ccae service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:10.939322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5c2dad70-78d3-4a7b-b5a4-c3dc94f7ab4c req-808ac7cb-ad1e-4d97-9185-cf8b2ee3ccae service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:10.993273 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-5c2dad70-78d3-4a7b-b5a4-c3dc94f7ab4c req-808ac7cb-ad1e-4d97-9185-cf8b2ee3ccae service nova] Creating event network-changed:7c18c3de-f26b-4037-97aa-c1985ec47e89 for instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 on n-h1-833090-9 Jul 26 14:26:11.013153 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-5c2dad70-78d3-4a7b-b5a4-c3dc94f7ab4c req-808ac7cb-ad1e-4d97-9185-cf8b2ee3ccae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109295 Jul 26 14:26:11.019796 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2170/4215] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:26:11.118639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5026eba6-983b-4f1f-a319-77eb082f8cfa tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:11.119623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5026eba6-983b-4f1f-a319-77eb082f8cfa tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:11.146527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5026eba6-983b-4f1f-a319-77eb082f8cfa tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:11.148165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5026eba6-983b-4f1f-a319-77eb082f8cfa tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:11.149043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5026eba6-983b-4f1f-a319-77eb082f8cfa tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:11.149507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5026eba6-983b-4f1f-a319-77eb082f8cfa tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:11.168213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31dd7e32-6d7b-4fd8-b131-df38933f2b10 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:11.179619 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-31dd7e32-6d7b-4fd8-b131-df38933f2b10 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1315 microversion: 2.1 time: 0.616860 Jul 26 14:26:11.180353 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2046/4216] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:10 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:11.925150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5026eba6-983b-4f1f-a319-77eb082f8cfa tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:11.930245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:UPDATE=14,nova_cell1:SELECT=83,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:11.946738 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5026eba6-983b-4f1f-a319-77eb082f8cfa tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1322 microversion: 2.1 time: 0.843346 Jul 26 14:26:11.947536 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2171/4217] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:11 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1322 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:12.207048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81bcb290-5ffa-4acf-bd83-50c72dbd502f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:12.208199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-81bcb290-5ffa-4acf-bd83-50c72dbd502f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:12.222932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:12.228355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81bcb290-5ffa-4acf-bd83-50c72dbd502f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:12.231577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81bcb290-5ffa-4acf-bd83-50c72dbd502f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:12.232566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81bcb290-5ffa-4acf-bd83-50c72dbd502f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:12.233174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81bcb290-5ffa-4acf-bd83-50c72dbd502f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:12.725435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=14 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:12.979151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64b2f84a-0f5f-4ba2-8aba-4556b173938b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:12.980208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-64b2f84a-0f5f-4ba2-8aba-4556b173938b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:13.001867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64b2f84a-0f5f-4ba2-8aba-4556b173938b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:13.002343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64b2f84a-0f5f-4ba2-8aba-4556b173938b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:13.004072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64b2f84a-0f5f-4ba2-8aba-4556b173938b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:13.005373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64b2f84a-0f5f-4ba2-8aba-4556b173938b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:13.017502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-81bcb290-5ffa-4acf-bd83-50c72dbd502f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:13.038266 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-81bcb290-5ffa-4acf-bd83-50c72dbd502f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1315 microversion: 2.1 time: 0.836544 Jul 26 14:26:13.063989 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2047/4218] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:12 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:13.166184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-021c199f-e8fa-4ac1-a3e8-435c6a105ca6 req-435e2204-edcf-470b-a341-d12542b77fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1200626-26aa-45b9-aad7-0474c6e8b500", "tag": "78b9f61e-9b47-4ca7-aa18-066ee3fe1b32"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:13.192660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-021c199f-e8fa-4ac1-a3e8-435c6a105ca6 req-435e2204-edcf-470b-a341-d12542b77fab service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:13.194734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-021c199f-e8fa-4ac1-a3e8-435c6a105ca6 req-435e2204-edcf-470b-a341-d12542b77fab service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:13.226720 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-021c199f-e8fa-4ac1-a3e8-435c6a105ca6 req-435e2204-edcf-470b-a341-d12542b77fab service nova] Creating event network-changed:78b9f61e-9b47-4ca7-aa18-066ee3fe1b32 for instance a1200626-26aa-45b9-aad7-0474c6e8b500 on n-h2-833090-9 Jul 26 14:26:13.238804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-021c199f-e8fa-4ac1-a3e8-435c6a105ca6 req-435e2204-edcf-470b-a341-d12542b77fab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078205 Jul 26 14:26:13.240860 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2048/4219] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:26:13.724982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-64b2f84a-0f5f-4ba2-8aba-4556b173938b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:13.739603 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-64b2f84a-0f5f-4ba2-8aba-4556b173938b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1322 microversion: 2.1 time: 0.763825 Jul 26 14:26:13.742881 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2172/4220] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:12 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1322 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:14.095749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fb919b52-9ca6-484f-a6fd-45eafa0f71b1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:14.096355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fb919b52-9ca6-484f-a6fd-45eafa0f71b1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:14.106934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb919b52-9ca6-484f-a6fd-45eafa0f71b1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:14.107417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb919b52-9ca6-484f-a6fd-45eafa0f71b1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:14.113702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb919b52-9ca6-484f-a6fd-45eafa0f71b1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:14.115306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb919b52-9ca6-484f-a6fd-45eafa0f71b1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:14.665338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb919b52-9ca6-484f-a6fd-45eafa0f71b1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:14.682462 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fb919b52-9ca6-484f-a6fd-45eafa0f71b1 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1315 microversion: 2.1 time: 0.584303 Jul 26 14:26:14.698300 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2049/4221] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:14 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:14.784710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-068ee125-f5ea-4f6d-82d5-c29e5da1acae tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:14.786352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-068ee125-f5ea-4f6d-82d5-c29e5da1acae tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:14.834450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-068ee125-f5ea-4f6d-82d5-c29e5da1acae tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:14.834928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-068ee125-f5ea-4f6d-82d5-c29e5da1acae tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:14.835766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-068ee125-f5ea-4f6d-82d5-c29e5da1acae tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:14.836253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-068ee125-f5ea-4f6d-82d5-c29e5da1acae tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:15.241644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-068ee125-f5ea-4f6d-82d5-c29e5da1acae tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:15.259546 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-068ee125-f5ea-4f6d-82d5-c29e5da1acae tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1322 microversion: 2.1 time: 0.482287 Jul 26 14:26:15.260233 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2173/4222] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:14 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:15.711163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7fb7951c-b68c-4043-9b2c-5bebf90c9fa0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:15.713811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7fb7951c-b68c-4043-9b2c-5bebf90c9fa0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:15.735853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fb7951c-b68c-4043-9b2c-5bebf90c9fa0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:15.736907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fb7951c-b68c-4043-9b2c-5bebf90c9fa0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:15.740324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fb7951c-b68c-4043-9b2c-5bebf90c9fa0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:15.745223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fb7951c-b68c-4043-9b2c-5bebf90c9fa0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:16.286245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d6a6edd1-5a18-4ead-8e19-307b95320037 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:16.287571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d6a6edd1-5a18-4ead-8e19-307b95320037 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:16.311188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6a6edd1-5a18-4ead-8e19-307b95320037 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:16.316040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6a6edd1-5a18-4ead-8e19-307b95320037 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:16.317032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6a6edd1-5a18-4ead-8e19-307b95320037 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:16.317507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6a6edd1-5a18-4ead-8e19-307b95320037 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:16.575740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7fb7951c-b68c-4043-9b2c-5bebf90c9fa0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:16.601033 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7fb7951c-b68c-4043-9b2c-5bebf90c9fa0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1315 microversion: 2.1 time: 0.896950 Jul 26 14:26:16.603646 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2050/4223] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:15 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1315 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:17.015676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2120882133", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": "none"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:17.151918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:26:17.152551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:26:17.153068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:26:17.153498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:26:17.153927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:26:17.177904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:17.178443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:17.179281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:17.179725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:17.240522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Getting quotas for project 9b402ce99fae429986eeb689d41ccafb. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:26:17.249359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Getting quotas for user ca9a2a2067034eb9b34f211a1058e038 and project 9b402ce99fae429986eeb689d41ccafb. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:26:17.270715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:26:17.276038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:26:17.284694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d6a6edd1-5a18-4ead-8e19-307b95320037 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:17.303760 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d6a6edd1-5a18-4ead-8e19-307b95320037 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1322 microversion: 2.1 time: 1.021103 Jul 26 14:26:17.329339 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2174/4224] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:16 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1322 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:17.428749 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ddb1f819-5e94-42a5-ab50-a210ef42cdcd tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.769108 Jul 26 14:26:17.434079 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2051/4225] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:26:17.450883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c65d674a-dd72-4cdf-827d-774365102d85 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:17.452312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c65d674a-dd72-4cdf-827d-774365102d85 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:17.628343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4b56571d-273b-4362-9eff-341ac6c41bfb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:17.629255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4b56571d-273b-4362-9eff-341ac6c41bfb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:17.638246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b56571d-273b-4362-9eff-341ac6c41bfb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:17.639589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b56571d-273b-4362-9eff-341ac6c41bfb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:17.640990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b56571d-273b-4362-9eff-341ac6c41bfb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:17.642281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b56571d-273b-4362-9eff-341ac6c41bfb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:17.760068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c65d674a-dd72-4cdf-827d-774365102d85 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:17.774400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c65d674a-dd72-4cdf-827d-774365102d85 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:17.780024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c65d674a-dd72-4cdf-827d-774365102d85 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:17.781821 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c65d674a-dd72-4cdf-827d-774365102d85 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 200 len: 1281 microversion: 2.47 time: 0.338909 Jul 26 14:26:17.796946 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2175/4226] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:17 2022] GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 1281 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:26:18.100777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4b56571d-273b-4362-9eff-341ac6c41bfb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:18.111885 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4b56571d-273b-4362-9eff-341ac6c41bfb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1315 microversion: 2.1 time: 0.489403 Jul 26 14:26:18.114122 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2052/4227] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:17 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:18.329412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1c39199a-9608-480f-b424-c7c9b458a813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:18.331389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1c39199a-9608-480f-b424-c7c9b458a813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:18.356242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:18.361784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c39199a-9608-480f-b424-c7c9b458a813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:18.362259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c39199a-9608-480f-b424-c7c9b458a813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:18.363257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c39199a-9608-480f-b424-c7c9b458a813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:18.367318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c39199a-9608-480f-b424-c7c9b458a813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:18.739413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1c39199a-9608-480f-b424-c7c9b458a813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:18.763562 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1c39199a-9608-480f-b424-c7c9b458a813 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1322 microversion: 2.1 time: 0.440901 Jul 26 14:26:18.767558 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2176/4228] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:18 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:18.816969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-63ad20ba-4d0f-49f9-b751-61f8e5b14fc6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:18.818185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-63ad20ba-4d0f-49f9-b751-61f8e5b14fc6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:18.840101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-63ad20ba-4d0f-49f9-b751-61f8e5b14fc6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:18.841331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-63ad20ba-4d0f-49f9-b751-61f8e5b14fc6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:18.844829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-63ad20ba-4d0f-49f9-b751-61f8e5b14fc6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:18.846177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-63ad20ba-4d0f-49f9-b751-61f8e5b14fc6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:18.855324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:19.002186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-63ad20ba-4d0f-49f9-b751-61f8e5b14fc6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:19.021058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-63ad20ba-4d0f-49f9-b751-61f8e5b14fc6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:19.024066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-63ad20ba-4d0f-49f9-b751-61f8e5b14fc6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:19.034177 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-63ad20ba-4d0f-49f9-b751-61f8e5b14fc6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 200 len: 1277 microversion: 2.47 time: 0.216835 Jul 26 14:26:19.035669 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2053/4229] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:18 2022] GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:26:19.141895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76f6a1e7-66dc-4502-99f4-97ef2c9225a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:19.142667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-76f6a1e7-66dc-4502-99f4-97ef2c9225a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:19.160732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76f6a1e7-66dc-4502-99f4-97ef2c9225a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:19.162370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76f6a1e7-66dc-4502-99f4-97ef2c9225a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:19.164184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76f6a1e7-66dc-4502-99f4-97ef2c9225a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:19.165303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76f6a1e7-66dc-4502-99f4-97ef2c9225a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:19.603783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-76f6a1e7-66dc-4502-99f4-97ef2c9225a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:19.637147 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76f6a1e7-66dc-4502-99f4-97ef2c9225a2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1315 microversion: 2.1 time: 0.500854 Jul 26 14:26:19.654663 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2177/4230] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:19 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:19.805669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d2b7c12-c96f-4538-8481-de546a71f0b7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:19.807878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7d2b7c12-c96f-4538-8481-de546a71f0b7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:19.849986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d2b7c12-c96f-4538-8481-de546a71f0b7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:19.853135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d2b7c12-c96f-4538-8481-de546a71f0b7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:19.854898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d2b7c12-c96f-4538-8481-de546a71f0b7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:19.856092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d2b7c12-c96f-4538-8481-de546a71f0b7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:20.075852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fb1043bf-19de-4b4c-9bcf-8f0b33d562ac tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:20.078018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fb1043bf-19de-4b4c-9bcf-8f0b33d562ac tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:20.096425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb1043bf-19de-4b4c-9bcf-8f0b33d562ac tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:20.104517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb1043bf-19de-4b4c-9bcf-8f0b33d562ac tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:20.107300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb1043bf-19de-4b4c-9bcf-8f0b33d562ac tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:20.110991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb1043bf-19de-4b4c-9bcf-8f0b33d562ac tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:20.325369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fb1043bf-19de-4b4c-9bcf-8f0b33d562ac tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:20.340529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fb1043bf-19de-4b4c-9bcf-8f0b33d562ac tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:20.344444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fb1043bf-19de-4b4c-9bcf-8f0b33d562ac tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:20.346189 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fb1043bf-19de-4b4c-9bcf-8f0b33d562ac tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 200 len: 1339 microversion: 2.47 time: 0.276393 Jul 26 14:26:20.347318 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2178/4231] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:20 2022] GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 1339 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:26:20.411073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-fab5a73d-18b5-4a6d-aef1-904482c60be9 req-299f5fec-2549-476d-9c52-d2e4fd6a93c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d060450-0605-41f4-8bb5-38ff9a4388c5", "name": "network-vif-plugged", "status": "completed", "tag": "7c18c3de-f26b-4037-97aa-c1985ec47e89"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:20.440290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fab5a73d-18b5-4a6d-aef1-904482c60be9 req-299f5fec-2549-476d-9c52-d2e4fd6a93c3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:20.441162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fab5a73d-18b5-4a6d-aef1-904482c60be9 req-299f5fec-2549-476d-9c52-d2e4fd6a93c3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:20.462918 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-fab5a73d-18b5-4a6d-aef1-904482c60be9 req-299f5fec-2549-476d-9c52-d2e4fd6a93c3 service nova] Creating event network-vif-plugged:7c18c3de-f26b-4037-97aa-c1985ec47e89 for instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 on n-h1-833090-9 Jul 26 14:26:20.479464 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-fab5a73d-18b5-4a6d-aef1-904482c60be9 req-299f5fec-2549-476d-9c52-d2e4fd6a93c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082716 Jul 26 14:26:20.481667 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2179/4232] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:26:20.518754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d2b7c12-c96f-4538-8481-de546a71f0b7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:20.530641 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7d2b7c12-c96f-4538-8481-de546a71f0b7 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1322 microversion: 2.1 time: 0.731908 Jul 26 14:26:20.531249 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2054/4233] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:19 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:20.661389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8ec8ab2c-3638-4835-ac50-e1b056823631 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:20.662715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8ec8ab2c-3638-4835-ac50-e1b056823631 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:20.672106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ec8ab2c-3638-4835-ac50-e1b056823631 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:20.672791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ec8ab2c-3638-4835-ac50-e1b056823631 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:20.673757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ec8ab2c-3638-4835-ac50-e1b056823631 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:20.674207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ec8ab2c-3638-4835-ac50-e1b056823631 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:20.956283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8ec8ab2c-3638-4835-ac50-e1b056823631 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:20.966510 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8ec8ab2c-3638-4835-ac50-e1b056823631 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1315 microversion: 2.1 time: 0.310658 Jul 26 14:26:20.972872 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2180/4234] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:20 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:21.376144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64f4109f-8f79-48b5-9d7f-aa9039445d80 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:21.378445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-64f4109f-8f79-48b5-9d7f-aa9039445d80 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:21.391931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64f4109f-8f79-48b5-9d7f-aa9039445d80 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:21.392347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64f4109f-8f79-48b5-9d7f-aa9039445d80 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:21.393356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64f4109f-8f79-48b5-9d7f-aa9039445d80 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:21.394066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64f4109f-8f79-48b5-9d7f-aa9039445d80 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:21.531661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64f4109f-8f79-48b5-9d7f-aa9039445d80 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:21.550391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64f4109f-8f79-48b5-9d7f-aa9039445d80 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:21.553468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64f4109f-8f79-48b5-9d7f-aa9039445d80 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:21.555045 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64f4109f-8f79-48b5-9d7f-aa9039445d80 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 200 len: 1339 microversion: 2.47 time: 0.184610 Jul 26 14:26:21.568243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23496d4b-19f3-4773-8405-72722a68578f tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:21.568243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-23496d4b-19f3-4773-8405-72722a68578f tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:21.569656 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2055/4235] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:21 2022] GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 1339 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:26:21.577815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23496d4b-19f3-4773-8405-72722a68578f tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:21.578643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23496d4b-19f3-4773-8405-72722a68578f tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:21.580380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23496d4b-19f3-4773-8405-72722a68578f tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:21.581212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23496d4b-19f3-4773-8405-72722a68578f tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:21.996591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-516f5020-294a-4f5f-a1de-42ace7d58e43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:21.997710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-516f5020-294a-4f5f-a1de-42ace7d58e43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:22.009586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-516f5020-294a-4f5f-a1de-42ace7d58e43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:22.011086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-516f5020-294a-4f5f-a1de-42ace7d58e43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:22.012643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-516f5020-294a-4f5f-a1de-42ace7d58e43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:22.013438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-516f5020-294a-4f5f-a1de-42ace7d58e43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:22.584531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23496d4b-19f3-4773-8405-72722a68578f tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:22.603839 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23496d4b-19f3-4773-8405-72722a68578f tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1322 microversion: 2.1 time: 1.051402 Jul 26 14:26:22.604959 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2181/4236] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:21 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1322 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:22.611010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a1ba5078-800c-43a4-8480-b579e04995b1 req-bfa36c34-5528-4f4f-9cb6-d1b0eb011fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1200626-26aa-45b9-aad7-0474c6e8b500", "name": "network-vif-plugged", "status": "completed", "tag": "78b9f61e-9b47-4ca7-aa18-066ee3fe1b32"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:22.626898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a1ba5078-800c-43a4-8480-b579e04995b1 req-bfa36c34-5528-4f4f-9cb6-d1b0eb011fd8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:22.627929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a1ba5078-800c-43a4-8480-b579e04995b1 req-bfa36c34-5528-4f4f-9cb6-d1b0eb011fd8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:22.653798 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a1ba5078-800c-43a4-8480-b579e04995b1 req-bfa36c34-5528-4f4f-9cb6-d1b0eb011fd8 service nova] Creating event network-vif-plugged:78b9f61e-9b47-4ca7-aa18-066ee3fe1b32 for instance a1200626-26aa-45b9-aad7-0474c6e8b500 on n-h2-833090-9 Jul 26 14:26:22.667481 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a1ba5078-800c-43a4-8480-b579e04995b1 req-bfa36c34-5528-4f4f-9cb6-d1b0eb011fd8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059761 Jul 26 14:26:22.669705 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2182/4237] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:26:22.689681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-de146071-9619-4b21-8c5f-ca14f81fd42e tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:22.693118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-de146071-9619-4b21-8c5f-ca14f81fd42e tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:22.696854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-516f5020-294a-4f5f-a1de-42ace7d58e43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:22.706355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de146071-9619-4b21-8c5f-ca14f81fd42e tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:22.707133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de146071-9619-4b21-8c5f-ca14f81fd42e tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:22.708206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de146071-9619-4b21-8c5f-ca14f81fd42e tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:22.708871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de146071-9619-4b21-8c5f-ca14f81fd42e tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:22.714232 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-516f5020-294a-4f5f-a1de-42ace7d58e43 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1315 microversion: 2.1 time: 0.722152 Jul 26 14:26:22.724842 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2056/4238] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:21 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:22.859510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-de146071-9619-4b21-8c5f-ca14f81fd42e tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:22.890262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-de146071-9619-4b21-8c5f-ca14f81fd42e tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:22.893478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-de146071-9619-4b21-8c5f-ca14f81fd42e tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:22.895385 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-de146071-9619-4b21-8c5f-ca14f81fd42e tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 200 len: 1339 microversion: 2.47 time: 0.222001 Jul 26 14:26:22.908649 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2183/4239] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:22 2022] GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 1339 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:26:23.637094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1ed32c02-788f-4f3d-9e9c-3f96eaa38214 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:23.637948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1ed32c02-788f-4f3d-9e9c-3f96eaa38214 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:23.648696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ed32c02-788f-4f3d-9e9c-3f96eaa38214 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:23.649435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ed32c02-788f-4f3d-9e9c-3f96eaa38214 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:23.650539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ed32c02-788f-4f3d-9e9c-3f96eaa38214 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:23.651221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ed32c02-788f-4f3d-9e9c-3f96eaa38214 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:23.760544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ab379ee6-47ed-45a1-beaa-f5491510d9ce tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:23.761516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ab379ee6-47ed-45a1-beaa-f5491510d9ce tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:23.771412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab379ee6-47ed-45a1-beaa-f5491510d9ce tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:23.771910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab379ee6-47ed-45a1-beaa-f5491510d9ce tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:23.772764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab379ee6-47ed-45a1-beaa-f5491510d9ce tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:23.773469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab379ee6-47ed-45a1-beaa-f5491510d9ce tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:24.003477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ed32c02-788f-4f3d-9e9c-3f96eaa38214 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:24.014244 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1ed32c02-788f-4f3d-9e9c-3f96eaa38214 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1472 microversion: 2.1 time: 0.381425 Jul 26 14:26:24.015901 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2057/4240] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:23 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1472 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:24.037509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-827727a2-639c-418c-8424-b5b38ee4887d tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:24.041913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-827727a2-639c-418c-8424-b5b38ee4887d tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:24.063358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-827727a2-639c-418c-8424-b5b38ee4887d tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:24.064167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-827727a2-639c-418c-8424-b5b38ee4887d tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:24.065631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-827727a2-639c-418c-8424-b5b38ee4887d tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:24.066419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-827727a2-639c-418c-8424-b5b38ee4887d tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:24.128412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ab379ee6-47ed-45a1-beaa-f5491510d9ce tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:24.153941 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ab379ee6-47ed-45a1-beaa-f5491510d9ce tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1315 microversion: 2.1 time: 0.399306 Jul 26 14:26:24.172665 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2184/4241] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:23 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:24.191697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d392d29b-8294-41cf-b07e-e80ce5685825 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:24.193294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d392d29b-8294-41cf-b07e-e80ce5685825 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:24.206686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d392d29b-8294-41cf-b07e-e80ce5685825 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:24.208024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d392d29b-8294-41cf-b07e-e80ce5685825 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:24.209650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d392d29b-8294-41cf-b07e-e80ce5685825 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:24.210644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d392d29b-8294-41cf-b07e-e80ce5685825 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:24.232083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-827727a2-639c-418c-8424-b5b38ee4887d tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:24.262380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-827727a2-639c-418c-8424-b5b38ee4887d tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:24.271414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-827727a2-639c-418c-8424-b5b38ee4887d tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:24.293591 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-827727a2-639c-418c-8424-b5b38ee4887d tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 200 len: 1360 microversion: 2.47 time: 0.270020 Jul 26 14:26:24.295473 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2058/4242] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:24 2022] GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 1360 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:26:24.307616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-d392d29b-8294-41cf-b07e-e80ce5685825 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lazy-loading 'flavor' on Instance uuid 7d060450-0605-41f4-8bb5-38ff9a4388c5 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:26:24.330607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a898c4f1-8ed1-465b-b006-f843449645ef tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-871573383"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:24.341563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a898c4f1-8ed1-465b-b006-f843449645ef tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:24.363031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a898c4f1-8ed1-465b-b006-f843449645ef tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:24.364542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a898c4f1-8ed1-465b-b006-f843449645ef tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:24.369517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a898c4f1-8ed1-465b-b006-f843449645ef tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:24.370841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a898c4f1-8ed1-465b-b006-f843449645ef tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:24.473023 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d392d29b-8294-41cf-b07e-e80ce5685825 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5/action" status: 202 len: 0 microversion: 2.1 time: 0.289934 Jul 26 14:26:24.479114 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2185/4243] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:26:24 2022] POST /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:26:24.496154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ae84f17-8b63-4d20-8d77-29932ca33ec3 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:24.506987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2ae84f17-8b63-4d20-8d77-29932ca33ec3 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:24.536321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ae84f17-8b63-4d20-8d77-29932ca33ec3 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:24.537151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ae84f17-8b63-4d20-8d77-29932ca33ec3 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:24.538188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ae84f17-8b63-4d20-8d77-29932ca33ec3 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:24.538609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ae84f17-8b63-4d20-8d77-29932ca33ec3 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:24.943027 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a898c4f1-8ed1-465b-b006-f843449645ef tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "POST /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863/action" status: 202 len: 52 microversion: 2.47 time: 0.620747 Jul 26 14:26:24.955026 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2059/4244] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Jul 26 14:26:24 2022] POST /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863/action => generated 52 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Jul 26 14:26:24.964590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-265212be-7787-4810-9d9d-9f8a80256090 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:24.965296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-265212be-7787-4810-9d9d-9f8a80256090 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:24.975910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-265212be-7787-4810-9d9d-9f8a80256090 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:24.976887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-265212be-7787-4810-9d9d-9f8a80256090 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:24.978686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-265212be-7787-4810-9d9d-9f8a80256090 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:24.980595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-265212be-7787-4810-9d9d-9f8a80256090 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:25.049379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-265212be-7787-4810-9d9d-9f8a80256090 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:26:25.326583 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-265212be-7787-4810-9d9d-9f8a80256090 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 204 len: 0 microversion: 2.47 time: 0.368078 Jul 26 14:26:25.332192 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2060/4245] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:26:24 2022] DELETE /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:26:25.338471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b2a7183-8117-4a4d-b025-a0ab7ba9a5a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:25.339778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b2a7183-8117-4a4d-b025-a0ab7ba9a5a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:25.352668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b2a7183-8117-4a4d-b025-a0ab7ba9a5a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:25.353496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b2a7183-8117-4a4d-b025-a0ab7ba9a5a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:25.354954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b2a7183-8117-4a4d-b025-a0ab7ba9a5a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:25.356006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b2a7183-8117-4a4d-b025-a0ab7ba9a5a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:26.183083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b2a7183-8117-4a4d-b025-a0ab7ba9a5a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:26.211233 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b2a7183-8117-4a4d-b025-a0ab7ba9a5a0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1503 microversion: 2.1 time: 0.881479 Jul 26 14:26:26.216575 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2061/4246] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:25 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1503 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:26.262834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d2ae709-4b93-41e7-b5d0-0a894a5150df tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:26.266104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8d2ae709-4b93-41e7-b5d0-0a894a5150df tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:26.282783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d2ae709-4b93-41e7-b5d0-0a894a5150df tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:26.283199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d2ae709-4b93-41e7-b5d0-0a894a5150df tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:26.284212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d2ae709-4b93-41e7-b5d0-0a894a5150df tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:26.285153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d2ae709-4b93-41e7-b5d0-0a894a5150df tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:26.325547 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ae84f17-8b63-4d20-8d77-29932ca33ec3 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1631 microversion: 2.1 time: 1.838340 Jul 26 14:26:26.328694 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2186/4247] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:24 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1631 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:26.367918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21ec8e87-1b70-4125-a5d3-503e3bf446e3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:26.384247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21ec8e87-1b70-4125-a5d3-503e3bf446e3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:26.385034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21ec8e87-1b70-4125-a5d3-503e3bf446e3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:26.453178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d2ae709-4b93-41e7-b5d0-0a894a5150df tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:26.456367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-21ec8e87-1b70-4125-a5d3-503e3bf446e3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Going to try to stop instance {{(pid=119479) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:26:26.470319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d2ae709-4b93-41e7-b5d0-0a894a5150df tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:26.477233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d2ae709-4b93-41e7-b5d0-0a894a5150df tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:26.479184 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d2ae709-4b93-41e7-b5d0-0a894a5150df tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 200 len: 1366 microversion: 2.47 time: 0.256141 Jul 26 14:26:26.479498 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2062/4248] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:26 2022] GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:26:26.552337 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-21ec8e87-1b70-4125-a5d3-503e3bf446e3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500/action" status: 202 len: 0 microversion: 2.1 time: 0.219368 Jul 26 14:26:26.554155 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2187/4249] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:26:26 2022] POST /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:26:26.567668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef1f2aff-ea2a-444e-8f13-02a572095de3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:26.568872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ef1f2aff-ea2a-444e-8f13-02a572095de3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:26.582839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef1f2aff-ea2a-444e-8f13-02a572095de3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:26.583665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef1f2aff-ea2a-444e-8f13-02a572095de3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:26.585821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef1f2aff-ea2a-444e-8f13-02a572095de3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:26.586526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef1f2aff-ea2a-444e-8f13-02a572095de3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:26.812208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ef1f2aff-ea2a-444e-8f13-02a572095de3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:26.828196 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ef1f2aff-ea2a-444e-8f13-02a572095de3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 0.269213 Jul 26 14:26:26.828912 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2063/4250] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:26 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:27.372296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-630bc2f9-b670-48bd-9944-98ef092ac75e tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:27.374452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-630bc2f9-b670-48bd-9944-98ef092ac75e tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:27.397363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-630bc2f9-b670-48bd-9944-98ef092ac75e tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:27.397839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-630bc2f9-b670-48bd-9944-98ef092ac75e tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:27.412101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-630bc2f9-b670-48bd-9944-98ef092ac75e tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:27.412859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-630bc2f9-b670-48bd-9944-98ef092ac75e tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:27.477645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:27.508913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e888b81e-33c2-41d2-9f6c-290ce37fd5c9 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:27.510544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e888b81e-33c2-41d2-9f6c-290ce37fd5c9 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:27.512900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:27.515986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:27.546336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e888b81e-33c2-41d2-9f6c-290ce37fd5c9 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:27.547038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e888b81e-33c2-41d2-9f6c-290ce37fd5c9 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:27.548002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e888b81e-33c2-41d2-9f6c-290ce37fd5c9 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:27.548604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e888b81e-33c2-41d2-9f6c-290ce37fd5c9 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:27.758983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e888b81e-33c2-41d2-9f6c-290ce37fd5c9 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:27.767202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:27.784534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e888b81e-33c2-41d2-9f6c-290ce37fd5c9 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:27.786629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e888b81e-33c2-41d2-9f6c-290ce37fd5c9 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:27.788013 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e888b81e-33c2-41d2-9f6c-290ce37fd5c9 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 200 len: 1366 microversion: 2.47 time: 0.284812 Jul 26 14:26:27.797744 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2064/4251] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:27 2022] GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:26:27.854555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1653ff81-e036-404f-8376-a865d8ccc0b8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:27.855572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1653ff81-e036-404f-8376-a865d8ccc0b8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:27.870215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1653ff81-e036-404f-8376-a865d8ccc0b8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:27.872967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1653ff81-e036-404f-8376-a865d8ccc0b8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:27.877169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1653ff81-e036-404f-8376-a865d8ccc0b8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:27.879964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1653ff81-e036-404f-8376-a865d8ccc0b8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:27.970763 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-630bc2f9-b670-48bd-9944-98ef092ac75e tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1614 microversion: 2.1 time: 0.607672 Jul 26 14:26:27.976095 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2188/4252] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:27 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1614 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:28.005616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-056939e3-76e7-4840-afdc-550e7a80070d tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:28.006709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-056939e3-76e7-4840-afdc-550e7a80070d tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:28.030799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-056939e3-76e7-4840-afdc-550e7a80070d tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:28.031670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-056939e3-76e7-4840-afdc-550e7a80070d tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:28.037524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-056939e3-76e7-4840-afdc-550e7a80070d tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:28.042004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-056939e3-76e7-4840-afdc-550e7a80070d tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:28.221383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1653ff81-e036-404f-8376-a865d8ccc0b8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:28.260887 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1653ff81-e036-404f-8376-a865d8ccc0b8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 0.410987 Jul 26 14:26:28.264966 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2065/4253] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:27 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:28.367747 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-056939e3-76e7-4840-afdc-550e7a80070d tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] HTTP exception thrown: Cannot 'migrate' instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 while it is in vm_state suspended Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-056939e3-76e7-4840-afdc-550e7a80070d tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Request method failure captured: Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5/action HTTP/1.1 Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 15 Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_lEHjiPqOk1XMAwlmEywJYpywHzA_HkDcpvH_ofj5OWeGV8CTPIKA2fFVzsI75bmtE0ei1RrgxKaBAn9F3zYJhzCPF9_7N_ssSsilRFEt4JpCliaMHNhPtXPsMjk8_Moz7gXA-P4GpfEmCtH6ecChgTDVg3CwXLksht-Mf3tN4qxdE Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 967d3bbe82384d7c99a848d8beccc940 Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/967d3bbe82384d7c99a848d8beccc940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/967d3bbe82384d7c99a848d8beccc940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_967d3bbe82384d7c99a848d8beccc940", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/967d3bbe82384d7c99a848d8beccc940"}]}] Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 967d3bbe82384d7c99a848d8beccc940 Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersAdminNegativeTestJSON-426556569-project-admin Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c6130345b01a47b1aeeee25cdaa6972c Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersAdminNegativeTestJSON-426556569-project-admin Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: {"migrate": {}} Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: exception: Cannot 'migrate' instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 while it is in vm_state suspended Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '7d060450-0605-41f4-8bb5-38ff9a4388c5', 'body': {'migrate': {}}} Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 in vm_state suspended. Cannot resize while the instance is in this state. Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:28.371669 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 while it is in vm_state suspended Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 while it is in vm_state suspended Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-056939e3-76e7-4840-afdc-550e7a80070d tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Returning 409 to user: Cannot 'migrate' instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 while it is in vm_state suspended {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:28.381326 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-056939e3-76e7-4840-afdc-550e7a80070d tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5/action" status: 409 len: 148 microversion: 2.1 time: 0.378075 Jul 26 14:26:28.383933 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2189/4254] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:26:27 2022] POST /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5/action => generated 148 bytes in 389 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:26:28.392662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-023bfa13-ac74-40ec-9452-e77731c21d24 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-023bfa13-ac74-40ec-9452-e77731c21d24 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Request method failure captured: Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0/action HTTP/1.1 Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 39 Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_lEHjiPqOk1XMAwlmEywJYpywHzA_HkDcpvH_ofj5OWeGV8CTPIKA2fFVzsI75bmtE0ei1RrgxKaBAn9F3zYJhzCPF9_7N_ssSsilRFEt4JpCliaMHNhPtXPsMjk8_Moz7gXA-P4GpfEmCtH6ecChgTDVg3CwXLksht-Mf3tN4qxdE Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 967d3bbe82384d7c99a848d8beccc940 Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/967d3bbe82384d7c99a848d8beccc940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/967d3bbe82384d7c99a848d8beccc940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_967d3bbe82384d7c99a848d8beccc940", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/967d3bbe82384d7c99a848d8beccc940"}]}] Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 967d3bbe82384d7c99a848d8beccc940 Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersAdminNegativeTestJSON-426556569-project-admin Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: c6130345b01a47b1aeeee25cdaa6972c Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersAdminNegativeTestJSON-426556569-project-admin Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: {"os-resetState": {"state": "invalid"}} Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '3c24f3d4-2732-40cf-94d4-6155480bd7c0', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'invalid' Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:26:28.437344 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-023bfa13-ac74-40ec-9452-e77731c21d24 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:28.443923 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-023bfa13-ac74-40ec-9452-e77731c21d24 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0/action" status: 400 len: 144 microversion: 2.1 time: 0.054046 Jul 26 14:26:28.447334 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2066/4255] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:26:28 2022] POST /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0/action => generated 144 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:26:28.466386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8bed5f74-1137-47c0-9d1e-ef7b2ee8ad2f tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8bed5f74-1137-47c0-9d1e-ef7b2ee8ad2f tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Request method failure captured: Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0/action HTTP/1.1 Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 31 Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_lEHjiPqOk1XMAwlmEywJYpywHzA_HkDcpvH_ofj5OWeGV8CTPIKA2fFVzsI75bmtE0ei1RrgxKaBAn9F3zYJhzCPF9_7N_ssSsilRFEt4JpCliaMHNhPtXPsMjk8_Moz7gXA-P4GpfEmCtH6ecChgTDVg3CwXLksht-Mf3tN4qxdE Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 967d3bbe82384d7c99a848d8beccc940 Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/967d3bbe82384d7c99a848d8beccc940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/967d3bbe82384d7c99a848d8beccc940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_967d3bbe82384d7c99a848d8beccc940", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/967d3bbe82384d7c99a848d8beccc940"}]}] Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 967d3bbe82384d7c99a848d8beccc940 Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersAdminNegativeTestJSON-426556569-project-admin Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c6130345b01a47b1aeeee25cdaa6972c Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersAdminNegativeTestJSON-426556569-project-admin Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: {"os-resetState": {"state": 1}} Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '3c24f3d4-2732-40cf-94d4-6155480bd7c0', 'body': {'os-resetState': {'state': 1}}} Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 1 Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 26 14:26:28.500001 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.508224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:28.508224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.508224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.508224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:28.508224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:28.508224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:26:28.508224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:26:28.508224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 26 14:26:28.508224 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.511991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8bed5f74-1137-47c0-9d1e-ef7b2ee8ad2f tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:28.517103 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8bed5f74-1137-47c0-9d1e-ef7b2ee8ad2f tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0/action" status: 400 len: 120 microversion: 2.1 time: 0.060595 Jul 26 14:26:28.518608 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2190/4256] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:26:28 2022] POST /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0/action => generated 120 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:26:28.537669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-61c12cbc-86a9-447e-bf56-8ffefc01c182 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:28.548902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-61c12cbc-86a9-447e-bf56-8ffefc01c182 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Failed to fetch instance by id 999 {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 14:26:28.549776 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-61c12cbc-86a9-447e-bf56-8ffefc01c182 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-61c12cbc-86a9-447e-bf56-8ffefc01c182 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Request method failure captured: Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 37 Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_lEHjiPqOk1XMAwlmEywJYpywHzA_HkDcpvH_ofj5OWeGV8CTPIKA2fFVzsI75bmtE0ei1RrgxKaBAn9F3zYJhzCPF9_7N_ssSsilRFEt4JpCliaMHNhPtXPsMjk8_Moz7gXA-P4GpfEmCtH6ecChgTDVg3CwXLksht-Mf3tN4qxdE Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 967d3bbe82384d7c99a848d8beccc940 Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/967d3bbe82384d7c99a848d8beccc940"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/967d3bbe82384d7c99a848d8beccc940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_967d3bbe82384d7c99a848d8beccc940", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/967d3bbe82384d7c99a848d8beccc940"}]}] Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 967d3bbe82384d7c99a848d8beccc940 Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-426556569 Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersAdminNegativeTestJSON-426556569-project-admin Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: c6130345b01a47b1aeeee25cdaa6972c Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersAdminNegativeTestJSON-426556569-project-admin Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: {"os-resetState": {"state": "error"}} Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 999 could not be found. Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:28.557080 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:28.573355 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:28.573355 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 26 14:26:28.573355 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:28.573355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-61c12cbc-86a9-447e-bf56-8ffefc01c182 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:28.573355 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-61c12cbc-86a9-447e-bf56-8ffefc01c182 tempest-ServersAdminNegativeTestJSON-426556569 tempest-ServersAdminNegativeTestJSON-426556569-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.031830 Jul 26 14:26:28.573355 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2067/4257] 10.222.0.70 () {60 vars in 1179 bytes} [Tue Jul 26 14:26:28 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:26:28.585865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e565a8d8-a9ab-41c4-a371-bdc40af94188 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:28.593318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e565a8d8-a9ab-41c4-a371-bdc40af94188 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:28.630932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e565a8d8-a9ab-41c4-a371-bdc40af94188 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:28.631648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e565a8d8-a9ab-41c4-a371-bdc40af94188 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:28.633282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e565a8d8-a9ab-41c4-a371-bdc40af94188 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:28.634133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e565a8d8-a9ab-41c4-a371-bdc40af94188 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:28.677553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e565a8d8-a9ab-41c4-a371-bdc40af94188 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:26:28.819984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6c66b9a-c430-4793-9a18-ff82f7c12763 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:28.823207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e6c66b9a-c430-4793-9a18-ff82f7c12763 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:28.844119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6c66b9a-c430-4793-9a18-ff82f7c12763 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:28.847284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6c66b9a-c430-4793-9a18-ff82f7c12763 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:28.850416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6c66b9a-c430-4793-9a18-ff82f7c12763 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:28.850904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6c66b9a-c430-4793-9a18-ff82f7c12763 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:28.937920 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e565a8d8-a9ab-41c4-a371-bdc40af94188 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 204 len: 0 microversion: 2.1 time: 0.359957 Jul 26 14:26:28.945600 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2191/4258] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:26:28 2022] DELETE /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:26:28.963396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e705f3b4-95b4-4484-9f3d-2d9638016596 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:28.967444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e705f3b4-95b4-4484-9f3d-2d9638016596 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:28.994996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e705f3b4-95b4-4484-9f3d-2d9638016596 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:28.995822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e705f3b4-95b4-4484-9f3d-2d9638016596 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:28.999191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e705f3b4-95b4-4484-9f3d-2d9638016596 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:29.000404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e705f3b4-95b4-4484-9f3d-2d9638016596 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:29.067552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6c66b9a-c430-4793-9a18-ff82f7c12763 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:29.075348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:29.083092 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e705f3b4-95b4-4484-9f3d-2d9638016596 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.135876 Jul 26 14:26:29.084120 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2192/4259] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Jul 26 14:26:28 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:29.088545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6c66b9a-c430-4793-9a18-ff82f7c12763 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:29.096626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6c66b9a-c430-4793-9a18-ff82f7c12763 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca9a2a2067034eb9b34f211a1058e038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b402ce99fae429986eeb689d41ccafb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:29.102461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8712c118-4c5a-46cc-ad86-fe4982032c14 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:29.103177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8712c118-4c5a-46cc-ad86-fe4982032c14 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:29.106212 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6c66b9a-c430-4793-9a18-ff82f7c12763 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 200 len: 1366 microversion: 2.47 time: 0.293374 Jul 26 14:26:29.107504 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2068/4260] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:28 2022] GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:26:29.128268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8712c118-4c5a-46cc-ad86-fe4982032c14 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:29.128730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8712c118-4c5a-46cc-ad86-fe4982032c14 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:29.129822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8712c118-4c5a-46cc-ad86-fe4982032c14 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:29.130437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8712c118-4c5a-46cc-ad86-fe4982032c14 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:29.217979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7803631d-e6b6-4888-b1bf-9c0bd146964f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:29.218631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7803631d-e6b6-4888-b1bf-9c0bd146964f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:29.235594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7803631d-e6b6-4888-b1bf-9c0bd146964f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:29.236360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7803631d-e6b6-4888-b1bf-9c0bd146964f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:29.239880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7803631d-e6b6-4888-b1bf-9c0bd146964f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:29.241975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7803631d-e6b6-4888-b1bf-9c0bd146964f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:29.422531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7803631d-e6b6-4888-b1bf-9c0bd146964f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:26:29.607035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8712c118-4c5a-46cc-ad86-fe4982032c14 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:29.634844 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7803631d-e6b6-4888-b1bf-9c0bd146964f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 204 len: 0 microversion: 2.20 time: 0.423311 Jul 26 14:26:29.635684 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2069/4261] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:26:29 2022] DELETE /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 14:26:29.641442 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8712c118-4c5a-46cc-ad86-fe4982032c14 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1469 microversion: 2.1 time: 0.555000 Jul 26 14:26:29.644562 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2193/4262] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:29 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1469 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:29.661814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f1e95833-9ddc-44a5-8fe3-b5cf420388a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:29.662669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23484fba-732e-4c24-b19b-ed66a3c82ba0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:29.663064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f1e95833-9ddc-44a5-8fe3-b5cf420388a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:29.667132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-23484fba-732e-4c24-b19b-ed66a3c82ba0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:29.690253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23484fba-732e-4c24-b19b-ed66a3c82ba0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:29.691103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23484fba-732e-4c24-b19b-ed66a3c82ba0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:29.693284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23484fba-732e-4c24-b19b-ed66a3c82ba0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:29.694702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23484fba-732e-4c24-b19b-ed66a3c82ba0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:29.699232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1e95833-9ddc-44a5-8fe3-b5cf420388a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:29.701838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1e95833-9ddc-44a5-8fe3-b5cf420388a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:29.718658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1e95833-9ddc-44a5-8fe3-b5cf420388a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:29.737228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1e95833-9ddc-44a5-8fe3-b5cf420388a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:30.296399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f1e95833-9ddc-44a5-8fe3-b5cf420388a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:30.313750 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f1e95833-9ddc-44a5-8fe3-b5cf420388a3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 0.665986 Jul 26 14:26:30.318425 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2070/4263] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:29 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:30.338128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-669170b6-e9b4-43b5-8bfe-0d08b711daa6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:30.339203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-669170b6-e9b4-43b5-8bfe-0d08b711daa6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] [instance: 6d314569-9d82-45dd-8905-11f07c595863] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:30.362262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-669170b6-e9b4-43b5-8bfe-0d08b711daa6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:30.363631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-669170b6-e9b4-43b5-8bfe-0d08b711daa6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:30.364661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-669170b6-e9b4-43b5-8bfe-0d08b711daa6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:30.370018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-669170b6-e9b4-43b5-8bfe-0d08b711daa6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:30.431849 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-669170b6-e9b4-43b5-8bfe-0d08b711daa6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] HTTP exception thrown: Instance 6d314569-9d82-45dd-8905-11f07c595863 could not be found. Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-669170b6-e9b4-43b5-8bfe-0d08b711daa6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Request method failure captured: Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 HTTP/1.1 Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_mI4KznA0PgUAMMFXNWt7U0O4YpxLZiOKw8fexeg-V0jT0u3EDyVZbOzST-ZZpp1OWvtjA5rXlqZA5aiXw7oYMpQ0Q-hwTc9D7E-CXmTiK0i4quiakaOlLZZEIP5BoRHCtBrIIU3Qva06Ed3YHe0vDAoziQDZ18pvE8mDIIqde7wug Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.47 Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 9b402ce99fae429986eeb689d41ccafb Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersAaction247Test-1851854981 Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9b402ce99fae429986eeb689d41ccafb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9b402ce99fae429986eeb689d41ccafb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9b402ce99fae429986eeb689d41ccafb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9b402ce99fae429986eeb689d41ccafb"}]}] Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersAaction247Test-1851854981 Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 9b402ce99fae429986eeb689d41ccafb Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersAaction247Test-1851854981 Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersAaction247Test-1851854981-project Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ca9a2a2067034eb9b34f211a1058e038 Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersAaction247Test-1851854981-project Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 6d314569-9d82-45dd-8905-11f07c595863 could not be found. Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '6d314569-9d82-45dd-8905-11f07c595863'} Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d314569-9d82-45dd-8905-11f07c595863 could not be found. Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d314569-9d82-45dd-8905-11f07c595863 could not be found. Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:30.441624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:30.448921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:30.448921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:30.448921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:30.448921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:30.448921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:30.448921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d314569-9d82-45dd-8905-11f07c595863 could not be found. Jul 26 14:26:30.448921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:30.448921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-669170b6-e9b4-43b5-8bfe-0d08b711daa6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] Returning 404 to user: Instance 6d314569-9d82-45dd-8905-11f07c595863 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:30.448921 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-669170b6-e9b4-43b5-8bfe-0d08b711daa6 tempest-ServersAaction247Test-1851854981 tempest-ServersAaction247Test-1851854981-project] 10.222.0.70 "GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863" status: 404 len: 111 microversion: 2.47 time: 0.126432 Jul 26 14:26:30.454821 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2071/4264] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:30 2022] GET /compute/v2.1/servers/6d314569-9d82-45dd-8905-11f07c595863 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:26:30.473090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23484fba-732e-4c24-b19b-ed66a3c82ba0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:30.515746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23484fba-732e-4c24-b19b-ed66a3c82ba0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:30.519513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23484fba-732e-4c24-b19b-ed66a3c82ba0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:30.525939 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23484fba-732e-4c24-b19b-ed66a3c82ba0 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 0.874704 Jul 26 14:26:30.528375 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2194/4265] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:29 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:26:30.688168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-633d1db3-95eb-471e-a7d1-5101f33f8c0b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:30.689185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-633d1db3-95eb-471e-a7d1-5101f33f8c0b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:30.713727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-633d1db3-95eb-471e-a7d1-5101f33f8c0b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:30.714537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-633d1db3-95eb-471e-a7d1-5101f33f8c0b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:30.720781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-633d1db3-95eb-471e-a7d1-5101f33f8c0b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:30.722345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-633d1db3-95eb-471e-a7d1-5101f33f8c0b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:31.382006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-633d1db3-95eb-471e-a7d1-5101f33f8c0b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:31.424139 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-633d1db3-95eb-471e-a7d1-5101f33f8c0b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1469 microversion: 2.1 time: 0.742197 Jul 26 14:26:31.432447 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2072/4266] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:30 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1469 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:31.560287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d467350f-0fc7-47e2-a378-2bcbef487c4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:31.561739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d467350f-0fc7-47e2-a378-2bcbef487c4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:31.572127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d467350f-0fc7-47e2-a378-2bcbef487c4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:31.572586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d467350f-0fc7-47e2-a378-2bcbef487c4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:31.574954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d467350f-0fc7-47e2-a378-2bcbef487c4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:31.578621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d467350f-0fc7-47e2-a378-2bcbef487c4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:32.266763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b1fbd3bf-a168-49de-bd56-4c272c25ba67 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:32.269282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b1fbd3bf-a168-49de-bd56-4c272c25ba67 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:32.293857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1fbd3bf-a168-49de-bd56-4c272c25ba67 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:32.299398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1fbd3bf-a168-49de-bd56-4c272c25ba67 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:32.303846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1fbd3bf-a168-49de-bd56-4c272c25ba67 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:32.305382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1fbd3bf-a168-49de-bd56-4c272c25ba67 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:33.293216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d467350f-0fc7-47e2-a378-2bcbef487c4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:33.312757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d467350f-0fc7-47e2-a378-2bcbef487c4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:33.314698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d467350f-0fc7-47e2-a378-2bcbef487c4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:33.315971 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d467350f-0fc7-47e2-a378-2bcbef487c4a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 1.759808 Jul 26 14:26:33.319106 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2073/4267] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:31 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:26:33.327309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ecb50156-7eaf-4daa-87a5-bcb2603bf9e0 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:33.330093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ecb50156-7eaf-4daa-87a5-bcb2603bf9e0 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:33.338695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:33.350469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecb50156-7eaf-4daa-87a5-bcb2603bf9e0 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:33.351890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecb50156-7eaf-4daa-87a5-bcb2603bf9e0 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:33.356565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecb50156-7eaf-4daa-87a5-bcb2603bf9e0 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:33.357451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ecb50156-7eaf-4daa-87a5-bcb2603bf9e0 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:33.731620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1fbd3bf-a168-49de-bd56-4c272c25ba67 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:33.764710 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b1fbd3bf-a168-49de-bd56-4c272c25ba67 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 2.415886 Jul 26 14:26:33.766721 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2195/4268] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:31 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 2425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:34.365102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-47e39bdf-7abb-401d-847c-e8e3b14b591f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:34.366672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47e39bdf-7abb-401d-847c-e8e3b14b591f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:34.381591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47e39bdf-7abb-401d-847c-e8e3b14b591f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:34.382557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47e39bdf-7abb-401d-847c-e8e3b14b591f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:34.383589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47e39bdf-7abb-401d-847c-e8e3b14b591f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:34.384871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47e39bdf-7abb-401d-847c-e8e3b14b591f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:34.608192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ecb50156-7eaf-4daa-87a5-bcb2603bf9e0 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:34.643362 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ecb50156-7eaf-4daa-87a5-bcb2603bf9e0 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1469 microversion: 2.1 time: 1.320745 Jul 26 14:26:34.647794 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2074/4269] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:33 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1469 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:34.798077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e145b1c-af2b-4e02-ab34-6ba79b1fa4bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:34.801357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e145b1c-af2b-4e02-ab34-6ba79b1fa4bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:34.826078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e145b1c-af2b-4e02-ab34-6ba79b1fa4bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:34.831999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e145b1c-af2b-4e02-ab34-6ba79b1fa4bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:34.836210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e145b1c-af2b-4e02-ab34-6ba79b1fa4bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:34.837198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e145b1c-af2b-4e02-ab34-6ba79b1fa4bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:35.553566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47e39bdf-7abb-401d-847c-e8e3b14b591f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:35.567642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47e39bdf-7abb-401d-847c-e8e3b14b591f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:35.584061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47e39bdf-7abb-401d-847c-e8e3b14b591f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:35.589730 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-47e39bdf-7abb-401d-847c-e8e3b14b591f tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1722 microversion: 2.20 time: 1.228782 Jul 26 14:26:35.592825 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2196/4270] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:34 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1722 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:26:35.618682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-779e8ab6-9e2c-4692-9acc-f6197a6788ef req-fbd1c0a3-771e-4c17-8a1e-d5b41bf57d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d060450-0605-41f4-8bb5-38ff9a4388c5", "name": "network-vif-deleted", "tag": "7c18c3de-f26b-4037-97aa-c1985ec47e89"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:35.668964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-779e8ab6-9e2c-4692-9acc-f6197a6788ef req-fbd1c0a3-771e-4c17-8a1e-d5b41bf57d0f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:35.672812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-779e8ab6-9e2c-4692-9acc-f6197a6788ef req-fbd1c0a3-771e-4c17-8a1e-d5b41bf57d0f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:35.716399 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-779e8ab6-9e2c-4692-9acc-f6197a6788ef req-fbd1c0a3-771e-4c17-8a1e-d5b41bf57d0f service nova] Creating event network-vif-deleted:7c18c3de-f26b-4037-97aa-c1985ec47e89 for instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 on n-h1-833090-9 Jul 26 14:26:35.736700 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-779e8ab6-9e2c-4692-9acc-f6197a6788ef req-fbd1c0a3-771e-4c17-8a1e-d5b41bf57d0f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133336 Jul 26 14:26:35.737363 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2197/4271] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:26:35.744082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:35.744971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:35.760288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:35.761134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:35.762958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:35.763577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:35.821426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:35.822580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:35.823344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lazy-loading 'fault' on Instance uuid 7d060450-0605-41f4-8bb5-38ff9a4388c5 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:26:35.823840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2e145b1c-af2b-4e02-ab34-6ba79b1fa4bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:35.837241 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e145b1c-af2b-4e02-ab34-6ba79b1fa4bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 1.044765 Jul 26 14:26:35.855247 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2075/4272] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:34 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:35.894430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:35.906254 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3ecd1bd9-bb7a-49cc-97f4-0068deff256b tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 200 len: 1312 microversion: 2.1 time: 0.167037 Jul 26 14:26:35.907440 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2198/4273] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:35 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:36.642022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a6b135fb-0ab4-4e23-87ba-be0f6f4def48 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:36.642701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a6b135fb-0ab4-4e23-87ba-be0f6f4def48 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:36.668385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6b135fb-0ab4-4e23-87ba-be0f6f4def48 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:36.668880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6b135fb-0ab4-4e23-87ba-be0f6f4def48 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:36.670255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6b135fb-0ab4-4e23-87ba-be0f6f4def48 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:36.674557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6b135fb-0ab4-4e23-87ba-be0f6f4def48 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:36.884115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-819d06a9-e9d4-466c-b17f-d24637fb5f14 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:36.885990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-819d06a9-e9d4-466c-b17f-d24637fb5f14 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:36.913492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a6b135fb-0ab4-4e23-87ba-be0f6f4def48 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:36.922721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-819d06a9-e9d4-466c-b17f-d24637fb5f14 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:36.925230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-819d06a9-e9d4-466c-b17f-d24637fb5f14 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:36.929401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-819d06a9-e9d4-466c-b17f-d24637fb5f14 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:36.930366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-819d06a9-e9d4-466c-b17f-d24637fb5f14 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:36.943224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a6b135fb-0ab4-4e23-87ba-be0f6f4def48 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:36.954567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a6b135fb-0ab4-4e23-87ba-be0f6f4def48 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d9d1bc9d8e44404a6bf64e912fbe562', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa556625719414283409d2773814cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:36.957414 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a6b135fb-0ab4-4e23-87ba-be0f6f4def48 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 200 len: 1654 microversion: 2.20 time: 0.325670 Jul 26 14:26:36.958031 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2076/4274] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:36 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 1654 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:26:36.976996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d99187bb-8626-4023-b44a-5f865ed9178d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:36.977886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d99187bb-8626-4023-b44a-5f865ed9178d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 7d060450-0605-41f4-8bb5-38ff9a4388c5] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:36.991660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d99187bb-8626-4023-b44a-5f865ed9178d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:36.992806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d99187bb-8626-4023-b44a-5f865ed9178d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:36.996060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d99187bb-8626-4023-b44a-5f865ed9178d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:37.002444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d99187bb-8626-4023-b44a-5f865ed9178d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:37.068815 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d99187bb-8626-4023-b44a-5f865ed9178d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] HTTP exception thrown: Instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 could not be found. Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d99187bb-8626-4023-b44a-5f865ed9178d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Request method failure captured: Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 HTTP/1.1 Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_lDst9TJWO3-DbD_POUBEK4DPCCqLS8tkIcZSiNsqw3MHbDrrtEQjiPiOUpeyA9QUSce_ADJjWIpzsLgk0Zu7abBGWgZI5-FQEL9P0wJHV1MNbIOK-WSpg4cWJAnNw48GJtYyP9TG-5AabGK9pVdmph8thKXiUvB2zpElBF1Pm4ALE Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: d2cac47fd5cf4c93a0ea6ee5b1d41642 Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-83256963 Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2cac47fd5cf4c93a0ea6ee5b1d41642"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2cac47fd5cf4c93a0ea6ee5b1d41642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2cac47fd5cf4c93a0ea6ee5b1d41642", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2cac47fd5cf4c93a0ea6ee5b1d41642"}]}] Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersAdminNegativeTestJSON-83256963 Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: d2cac47fd5cf4c93a0ea6ee5b1d41642 Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-83256963 Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersAdminNegativeTestJSON-83256963-project Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8589a1f1945945cc91bdf4485a9dde53 Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersAdminNegativeTestJSON-83256963-project Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 could not be found. Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '7d060450-0605-41f4-8bb5-38ff9a4388c5'} Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 could not be found. Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 could not be found. Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:37.080130 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:37.090167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:37.090167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:37.090167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:37.090167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:37.090167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:37.090167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 could not be found. Jul 26 14:26:37.090167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:37.090167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d99187bb-8626-4023-b44a-5f865ed9178d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Returning 404 to user: Instance 7d060450-0605-41f4-8bb5-38ff9a4388c5 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:37.090167 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d99187bb-8626-4023-b44a-5f865ed9178d tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5" status: 404 len: 111 microversion: 2.1 time: 0.124505 Jul 26 14:26:37.095742 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2077/4275] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:36 2022] GET /compute/v2.1/servers/7d060450-0605-41f4-8bb5-38ff9a4388c5 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:26:37.123985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0b5dfd04-05ae-48b2-8b6b-fc84d58a5627 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:37.123985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0b5dfd04-05ae-48b2-8b6b-fc84d58a5627 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:37.144851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b5dfd04-05ae-48b2-8b6b-fc84d58a5627 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:37.146894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b5dfd04-05ae-48b2-8b6b-fc84d58a5627 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:37.156787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b5dfd04-05ae-48b2-8b6b-fc84d58a5627 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:37.157985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0b5dfd04-05ae-48b2-8b6b-fc84d58a5627 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:37.286481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0b5dfd04-05ae-48b2-8b6b-fc84d58a5627 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:26:37.613923 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0b5dfd04-05ae-48b2-8b6b-fc84d58a5627 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 204 len: 0 microversion: 2.1 time: 0.514091 Jul 26 14:26:37.616973 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2078/4276] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:26:37 2022] DELETE /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:26:37.642218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7cd1a4d0-03af-402b-98bb-713c8e8f8054 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:37.648050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7cd1a4d0-03af-402b-98bb-713c8e8f8054 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:37.673818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cd1a4d0-03af-402b-98bb-713c8e8f8054 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:37.681261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cd1a4d0-03af-402b-98bb-713c8e8f8054 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:37.686262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cd1a4d0-03af-402b-98bb-713c8e8f8054 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:37.687378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cd1a4d0-03af-402b-98bb-713c8e8f8054 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:38.601397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-819d06a9-e9d4-466c-b17f-d24637fb5f14 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:38.613541 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-819d06a9-e9d4-466c-b17f-d24637fb5f14 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 1.735966 Jul 26 14:26:38.625204 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2199/4277] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:36 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:38.649859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-16811e00-e8dc-4057-a392-d406a9006ad4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:38.659674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-16811e00-e8dc-4057-a392-d406a9006ad4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:38.683698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16811e00-e8dc-4057-a392-d406a9006ad4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:38.683999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16811e00-e8dc-4057-a392-d406a9006ad4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:38.684685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16811e00-e8dc-4057-a392-d406a9006ad4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:38.697023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16811e00-e8dc-4057-a392-d406a9006ad4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:38.759548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7cd1a4d0-03af-402b-98bb-713c8e8f8054 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:38.760742 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-16811e00-e8dc-4057-a392-d406a9006ad4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] HTTP exception thrown: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-16811e00-e8dc-4057-a392-d406a9006ad4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Request method failure captured: Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 HTTP/1.1 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_emer31WJRgz1Hz7IpB8GyV1XoR6442Jyo-MFrCPV5O3Drqot8ZJ9SJ5-4noShgqUws1D9ByuHE-EYyJnlKllg46ni0t7dQ7ygndoOmnLeT4tRge06-lvTcURP8Efj31V_CdocTge7aBnVzyORZjj0Qkl8VsyaATYS8tAEN4nZPoDQ Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: eaa556625719414283409d2773814cf7 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eaa556625719414283409d2773814cf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eaa556625719414283409d2773814cf7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}] Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: eaa556625719414283409d2773814cf7 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 8d9d1bc9d8e44404a6bf64e912fbe562 Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd7576357-b5e0-45fb-9641-d397a6b3faf2'} Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:38.765775 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:38.777991 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:38.777991 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:38.777991 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:38.777991 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:38.777991 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:38.777991 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:38.777991 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:38.777991 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:26:38.777991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-16811e00-e8dc-4057-a392-d406a9006ad4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Returning 404 to user: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:38.777991 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-16811e00-e8dc-4057-a392-d406a9006ad4 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 404 len: 111 microversion: 2.20 time: 0.140753 Jul 26 14:26:38.780702 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7cd1a4d0-03af-402b-98bb-713c8e8f8054 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1477 microversion: 2.1 time: 1.145666 Jul 26 14:26:38.780897 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2200/4278] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:38 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:26:38.794277 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2079/4279] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:37 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1477 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:38.806749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cc544edb-9726-4657-b70d-c2fc83789e44 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '.version_select at 0x7f8787f0fdc0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:38.814920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-5414126b-b0c0-4073-936f-365477392a4f req-1c1cc3bf-ae36-4db8-aee4-d6e9ab22544d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7576357-b5e0-45fb-9641-d397a6b3faf2", "name": "network-vif-deleted", "tag": "f88eaeb3-e484-4f96-b4ba-99b8b947950a"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:38.846745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5414126b-b0c0-4073-936f-365477392a4f req-1c1cc3bf-ae36-4db8-aee4-d6e9ab22544d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:38.847225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5414126b-b0c0-4073-936f-365477392a4f req-1c1cc3bf-ae36-4db8-aee4-d6e9ab22544d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:38.888791 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cc544edb-9726-4657-b70d-c2fc83789e44 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-207836996" status: 204 len: 0 microversion: 2.20 time: 0.089386 Jul 26 14:26:38.894832 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2080/4280] 10.222.0.70 () {60 vars in 1259 bytes} [Tue Jul 26 14:26:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-207836996 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:26:38.911817 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-5414126b-b0c0-4073-936f-365477392a4f req-1c1cc3bf-ae36-4db8-aee4-d6e9ab22544d service nova] Creating event network-vif-deleted:f88eaeb3-e484-4f96-b4ba-99b8b947950a for instance d7576357-b5e0-45fb-9641-d397a6b3faf2 on n-h1-833090-9 Jul 26 14:26:38.917966 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-5414126b-b0c0-4073-936f-365477392a4f req-1c1cc3bf-ae36-4db8-aee4-d6e9ab22544d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138019 Jul 26 14:26:38.918554 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2201/4281] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:26:39.351709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a4b08e97-4768-4ac4-b3fd-6be79ce2b3af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:39.352707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a4b08e97-4768-4ac4-b3fd-6be79ce2b3af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:39.391710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4b08e97-4768-4ac4-b3fd-6be79ce2b3af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:39.392856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4b08e97-4768-4ac4-b3fd-6be79ce2b3af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:39.394638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4b08e97-4768-4ac4-b3fd-6be79ce2b3af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:39.395346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4b08e97-4768-4ac4-b3fd-6be79ce2b3af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:39.677050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3432a92a-ec6c-465c-a486-6c000d4de81c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:39.678610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3432a92a-ec6c-465c-a486-6c000d4de81c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:39.729600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3432a92a-ec6c-465c-a486-6c000d4de81c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:39.731451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3432a92a-ec6c-465c-a486-6c000d4de81c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:39.735071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3432a92a-ec6c-465c-a486-6c000d4de81c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:39.735801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3432a92a-ec6c-465c-a486-6c000d4de81c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:40.522380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a4b08e97-4768-4ac4-b3fd-6be79ce2b3af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:40.536560 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a4b08e97-4768-4ac4-b3fd-6be79ce2b3af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.194248 Jul 26 14:26:40.540511 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2081/4282] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:39 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:40.555800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-60daebbe-462c-4b4c-9563-dd0043b0f880 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:40.556648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-60daebbe-462c-4b4c-9563-dd0043b0f880 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:40.570332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60daebbe-462c-4b4c-9563-dd0043b0f880 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:40.571586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60daebbe-462c-4b4c-9563-dd0043b0f880 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:40.572642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60daebbe-462c-4b4c-9563-dd0043b0f880 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:40.580767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60daebbe-462c-4b4c-9563-dd0043b0f880 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:41.074067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3432a92a-ec6c-465c-a486-6c000d4de81c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:41.099311 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3432a92a-ec6c-465c-a486-6c000d4de81c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 1.433036 Jul 26 14:26:41.103583 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2202/4283] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:39 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:41.131323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9cd9e3db-6736-4f3b-bb12-8b5c4b0fe97c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:41.138396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9cd9e3db-6736-4f3b-bb12-8b5c4b0fe97c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:41.175670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cd9e3db-6736-4f3b-bb12-8b5c4b0fe97c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:41.176067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cd9e3db-6736-4f3b-bb12-8b5c4b0fe97c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:41.178192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cd9e3db-6736-4f3b-bb12-8b5c4b0fe97c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:41.178997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cd9e3db-6736-4f3b-bb12-8b5c4b0fe97c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:41.207376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-60daebbe-462c-4b4c-9563-dd0043b0f880 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:41.228285 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-60daebbe-462c-4b4c-9563-dd0043b0f880 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1477 microversion: 2.1 time: 0.685924 Jul 26 14:26:41.240541 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2082/4284] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:40 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1477 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:42.129794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a08b685b-a18f-4f26-a6bf-16945d7e9187 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:42.130761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a08b685b-a18f-4f26-a6bf-16945d7e9187 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:42.163351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a08b685b-a18f-4f26-a6bf-16945d7e9187 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:42.163542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a08b685b-a18f-4f26-a6bf-16945d7e9187 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:42.164878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a08b685b-a18f-4f26-a6bf-16945d7e9187 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:42.166685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a08b685b-a18f-4f26-a6bf-16945d7e9187 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:42.293481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9cd9e3db-6736-4f3b-bb12-8b5c4b0fe97c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:42.318711 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9cd9e3db-6736-4f3b-bb12-8b5c4b0fe97c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.208437 Jul 26 14:26:42.325708 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2203/4285] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:41 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:42.346842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8730b216-8e56-4709-ac35-1a67dd01bf17 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:42.349307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8730b216-8e56-4709-ac35-1a67dd01bf17 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:42.371198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8730b216-8e56-4709-ac35-1a67dd01bf17 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:42.372384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8730b216-8e56-4709-ac35-1a67dd01bf17 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:42.374266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8730b216-8e56-4709-ac35-1a67dd01bf17 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:42.376463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8730b216-8e56-4709-ac35-1a67dd01bf17 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:43.957875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8730b216-8e56-4709-ac35-1a67dd01bf17 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:43.974405 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8730b216-8e56-4709-ac35-1a67dd01bf17 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1435 microversion: 2.1 time: 1.646394 Jul 26 14:26:43.988563 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2204/4286] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:42 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1435 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:43.995180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-96538273-547a-4fbe-b75a-68d56419de72 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:43.999386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-96538273-547a-4fbe-b75a-68d56419de72 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:44.030667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96538273-547a-4fbe-b75a-68d56419de72 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:44.032399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96538273-547a-4fbe-b75a-68d56419de72 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:44.033730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96538273-547a-4fbe-b75a-68d56419de72 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:44.036085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96538273-547a-4fbe-b75a-68d56419de72 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:44.621360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a08b685b-a18f-4f26-a6bf-16945d7e9187 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:44.649202 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a08b685b-a18f-4f26-a6bf-16945d7e9187 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 2.523066 Jul 26 14:26:44.657273 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2083/4287] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:42 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 2532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:44.671067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-8aab8af1-4855-4b8f-8912-a439a9450521 req-7831ae41-0bb3-4dcd-85a0-2c4fe4c29ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c24f3d4-2732-40cf-94d4-6155480bd7c0", "name": "network-vif-deleted", "tag": "5fb3e9ca-f414-4968-9e9a-8117f469969d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:44.731187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-8aab8af1-4855-4b8f-8912-a439a9450521 req-7831ae41-0bb3-4dcd-85a0-2c4fe4c29ec9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:44.731187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-8aab8af1-4855-4b8f-8912-a439a9450521 req-7831ae41-0bb3-4dcd-85a0-2c4fe4c29ec9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:44.833161 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-8aab8af1-4855-4b8f-8912-a439a9450521 req-7831ae41-0bb3-4dcd-85a0-2c4fe4c29ec9 service nova] Creating event network-vif-deleted:5fb3e9ca-f414-4968-9e9a-8117f469969d for instance 3c24f3d4-2732-40cf-94d4-6155480bd7c0 on n-h2-833090-9 Jul 26 14:26:44.853641 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-8aab8af1-4855-4b8f-8912-a439a9450521 req-7831ae41-0bb3-4dcd-85a0-2c4fe4c29ec9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194648 Jul 26 14:26:44.859991 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2084/4288] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:26:44.970353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-96538273-547a-4fbe-b75a-68d56419de72 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:44.986658 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-96538273-547a-4fbe-b75a-68d56419de72 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.996632 Jul 26 14:26:44.987423 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2205/4289] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:43 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:45.001135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:45.002253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:45.014781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b4294df-7558-4138-b2b7-f5ce24cf845a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:45.015801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7b4294df-7558-4138-b2b7-f5ce24cf845a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:45.025830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:45.032848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:45.034189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:45.037428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:45.066924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b4294df-7558-4138-b2b7-f5ce24cf845a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:45.068021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b4294df-7558-4138-b2b7-f5ce24cf845a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:45.069225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b4294df-7558-4138-b2b7-f5ce24cf845a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:45.069906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b4294df-7558-4138-b2b7-f5ce24cf845a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:45.082470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:45.098679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:45.230997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:45.234313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:45.235781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lazy-loading 'fault' on Instance uuid 3c24f3d4-2732-40cf-94d4-6155480bd7c0 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:26:45.456649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8589a1f1945945cc91bdf4485a9dde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2cac47fd5cf4c93a0ea6ee5b1d41642', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:45.477714 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-283adb52-8bfd-4cfa-84e0-3943c828fe66 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 200 len: 1312 microversion: 2.1 time: 0.482438 Jul 26 14:26:45.493765 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2085/4290] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:44 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 1312 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:45.622562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b4294df-7558-4138-b2b7-f5ce24cf845a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:45.642077 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b4294df-7558-4138-b2b7-f5ce24cf845a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.624557 Jul 26 14:26:45.655816 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2206/4291] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:45 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:45.696594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-19840bfa-c21a-448e-bbe3-60a9f993de9a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:45.698015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-19840bfa-c21a-448e-bbe3-60a9f993de9a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:45.713056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19840bfa-c21a-448e-bbe3-60a9f993de9a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:45.714909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19840bfa-c21a-448e-bbe3-60a9f993de9a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:45.718568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19840bfa-c21a-448e-bbe3-60a9f993de9a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:45.719418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19840bfa-c21a-448e-bbe3-60a9f993de9a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:45.976723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1034931696", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "57ac168b-59fa-4a44-88ec-5fbc6a23582a"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:26:46.109481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] validate_networks() for [('57ac168b-59fa-4a44-88ec-5fbc6a23582a', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:26:46.780092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-19840bfa-c21a-448e-bbe3-60a9f993de9a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:46.799482 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-19840bfa-c21a-448e-bbe3-60a9f993de9a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 1.106922 Jul 26 14:26:46.800466 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2086/4292] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:45 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:46.813913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a148975b-8705-41b5-87bb-4e060552e5c9 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:46.815908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a148975b-8705-41b5-87bb-4e060552e5c9 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] [instance: 3c24f3d4-2732-40cf-94d4-6155480bd7c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:46.829111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a148975b-8705-41b5-87bb-4e060552e5c9 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:46.841398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a148975b-8705-41b5-87bb-4e060552e5c9 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:46.842927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a148975b-8705-41b5-87bb-4e060552e5c9 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:46.843377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a148975b-8705-41b5-87bb-4e060552e5c9 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:46.875341 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-a148975b-8705-41b5-87bb-4e060552e5c9 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] HTTP exception thrown: Instance 3c24f3d4-2732-40cf-94d4-6155480bd7c0 could not be found. Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a148975b-8705-41b5-87bb-4e060552e5c9 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Request method failure captured: Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 HTTP/1.1 Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_lDst9TJWO3-DbD_POUBEK4DPCCqLS8tkIcZSiNsqw3MHbDrrtEQjiPiOUpeyA9QUSce_ADJjWIpzsLgk0Zu7abBGWgZI5-FQEL9P0wJHV1MNbIOK-WSpg4cWJAnNw48GJtYyP9TG-5AabGK9pVdmph8thKXiUvB2zpElBF1Pm4ALE Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: d2cac47fd5cf4c93a0ea6ee5b1d41642 Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-83256963 Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2cac47fd5cf4c93a0ea6ee5b1d41642"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2cac47fd5cf4c93a0ea6ee5b1d41642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2cac47fd5cf4c93a0ea6ee5b1d41642", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2cac47fd5cf4c93a0ea6ee5b1d41642"}]}] Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersAdminNegativeTestJSON-83256963 Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: d2cac47fd5cf4c93a0ea6ee5b1d41642 Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-83256963 Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersAdminNegativeTestJSON-83256963-project Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8589a1f1945945cc91bdf4485a9dde53 Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersAdminNegativeTestJSON-83256963-project Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 3c24f3d4-2732-40cf-94d4-6155480bd7c0 could not be found. Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '3c24f3d4-2732-40cf-94d4-6155480bd7c0'} Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c24f3d4-2732-40cf-94d4-6155480bd7c0 could not be found. Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c24f3d4-2732-40cf-94d4-6155480bd7c0 could not be found. Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:46.877622 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:46.881374 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:46.881374 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:46.881374 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:46.881374 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:46.881374 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:46.881374 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c24f3d4-2732-40cf-94d4-6155480bd7c0 could not be found. Jul 26 14:26:46.881374 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:46.882630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a148975b-8705-41b5-87bb-4e060552e5c9 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] Returning 404 to user: Instance 3c24f3d4-2732-40cf-94d4-6155480bd7c0 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:46.883689 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a148975b-8705-41b5-87bb-4e060552e5c9 tempest-ServersAdminNegativeTestJSON-83256963 tempest-ServersAdminNegativeTestJSON-83256963-project] 10.222.0.70 "GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0" status: 404 len: 111 microversion: 2.1 time: 0.082186 Jul 26 14:26:46.888450 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2087/4293] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:46 2022] GET /compute/v2.1/servers/3c24f3d4-2732-40cf-94d4-6155480bd7c0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:26:47.199182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64e55cea-b16c-4dd5-ac8f-b88cf869b7f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:47.200005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-64e55cea-b16c-4dd5-ac8f-b88cf869b7f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:47.241294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64e55cea-b16c-4dd5-ac8f-b88cf869b7f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:47.241938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64e55cea-b16c-4dd5-ac8f-b88cf869b7f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:47.243020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64e55cea-b16c-4dd5-ac8f-b88cf869b7f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:47.253899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64e55cea-b16c-4dd5-ac8f-b88cf869b7f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:47.323513 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-64e55cea-b16c-4dd5-ac8f-b88cf869b7f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] HTTP exception thrown: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64e55cea-b16c-4dd5-ac8f-b88cf869b7f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Request method failure captured: Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 HTTP/1.1 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_emer31WJRgz1Hz7IpB8GyV1XoR6442Jyo-MFrCPV5O3Drqot8ZJ9SJ5-4noShgqUws1D9ByuHE-EYyJnlKllg46ni0t7dQ7ygndoOmnLeT4tRge06-lvTcURP8Efj31V_CdocTge7aBnVzyORZjj0Qkl8VsyaATYS8tAEN4nZPoDQ Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: eaa556625719414283409d2773814cf7 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eaa556625719414283409d2773814cf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eaa556625719414283409d2773814cf7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}] Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: eaa556625719414283409d2773814cf7 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8d9d1bc9d8e44404a6bf64e912fbe562 Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd7576357-b5e0-45fb-9641-d397a6b3faf2'} Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:47.359079 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64e55cea-b16c-4dd5-ac8f-b88cf869b7f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Returning 404 to user: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:47.368001 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64e55cea-b16c-4dd5-ac8f-b88cf869b7f7 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 404 len: 111 microversion: 2.20 time: 0.168725 Jul 26 14:26:47.374191 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2088/4294] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:26:47 2022] DELETE /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:26:47.384743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1409743-4407-47dc-baae-b7f76d460f3a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:47.385374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b1409743-4407-47dc-baae-b7f76d460f3a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: d7576357-b5e0-45fb-9641-d397a6b3faf2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:47.408727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1409743-4407-47dc-baae-b7f76d460f3a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:47.412222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1409743-4407-47dc-baae-b7f76d460f3a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:47.414389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1409743-4407-47dc-baae-b7f76d460f3a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:47.415098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1409743-4407-47dc-baae-b7f76d460f3a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:47.470826 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b1409743-4407-47dc-baae-b7f76d460f3a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] HTTP exception thrown: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1409743-4407-47dc-baae-b7f76d460f3a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Request method failure captured: Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 HTTP/1.1 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_emer31WJRgz1Hz7IpB8GyV1XoR6442Jyo-MFrCPV5O3Drqot8ZJ9SJ5-4noShgqUws1D9ByuHE-EYyJnlKllg46ni0t7dQ7ygndoOmnLeT4tRge06-lvTcURP8Efj31V_CdocTge7aBnVzyORZjj0Qkl8VsyaATYS8tAEN4nZPoDQ Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: eaa556625719414283409d2773814cf7 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eaa556625719414283409d2773814cf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eaa556625719414283409d2773814cf7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}] Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: eaa556625719414283409d2773814cf7 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8d9d1bc9d8e44404a6bf64e912fbe562 Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd7576357-b5e0-45fb-9641-d397a6b3faf2'} Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:47.485517 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:47.492741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:47.492741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:47.492741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:47.492741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:47.492741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:47.492741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:47.492741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. Jul 26 14:26:47.492741 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:47.495168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1409743-4407-47dc-baae-b7f76d460f3a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Returning 404 to user: Instance d7576357-b5e0-45fb-9641-d397a6b3faf2 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:47.496640 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b1409743-4407-47dc-baae-b7f76d460f3a tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2" status: 404 len: 111 microversion: 2.20 time: 0.121064 Jul 26 14:26:47.501421 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2089/4295] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:47 2022] GET /compute/v2.1/servers/d7576357-b5e0-45fb-9641-d397a6b3faf2 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:26:47.827596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d3f4fc0-1cfa-43bb-89f9-ac1370a44eb8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:47.828506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3d3f4fc0-1cfa-43bb-89f9-ac1370a44eb8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:47.863766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d3f4fc0-1cfa-43bb-89f9-ac1370a44eb8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:47.864405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d3f4fc0-1cfa-43bb-89f9-ac1370a44eb8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:47.865248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d3f4fc0-1cfa-43bb-89f9-ac1370a44eb8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:47.869662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d3f4fc0-1cfa-43bb-89f9-ac1370a44eb8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:48.637637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3d3f4fc0-1cfa-43bb-89f9-ac1370a44eb8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:48.652932 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3d3f4fc0-1cfa-43bb-89f9-ac1370a44eb8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 0.830912 Jul 26 14:26:48.657023 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2090/4296] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:47 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:26:48.696909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:26:48.698077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:26:48.698993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:26:48.699596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:26:48.700773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:26:48.709053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:48.737494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:48.738410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:48.740969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:48.742493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:48.788558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for project 991c7f82c09446409408ca9d0638fcba. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:26:48.803043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for user 7b5b7e30e280492b85d9c8f98fe09e43 and project 991c7f82c09446409408ca9d0638fcba. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:26:48.850446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:26:48.860776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:26:49.023523 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b58d7069-ec71-4520-8db8-d54c6c08bbe8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.050403 Jul 26 14:26:49.033452 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2207/4297] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:26:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:26:49.037416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3347ab6f-3ba0-489f-a4a7-42cd902acce1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:49.038278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3347ab6f-3ba0-489f-a4a7-42cd902acce1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:49.347832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3347ab6f-3ba0-489f-a4a7-42cd902acce1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:49.355713 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3347ab6f-3ba0-489f-a4a7-42cd902acce1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1215 microversion: 2.1 time: 0.322543 Jul 26 14:26:49.359253 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2091/4298] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:49 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1215 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:49.685163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2aad9d9e-e6cb-4756-ad52-5e5cf7ef07eb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:49.686657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2aad9d9e-e6cb-4756-ad52-5e5cf7ef07eb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:49.717959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aad9d9e-e6cb-4756-ad52-5e5cf7ef07eb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:49.726900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aad9d9e-e6cb-4756-ad52-5e5cf7ef07eb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:49.728325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aad9d9e-e6cb-4756-ad52-5e5cf7ef07eb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:49.728874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2aad9d9e-e6cb-4756-ad52-5e5cf7ef07eb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:50.254286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2aad9d9e-e6cb-4756-ad52-5e5cf7ef07eb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:50.266955 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2aad9d9e-e6cb-4756-ad52-5e5cf7ef07eb tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 0.586085 Jul 26 14:26:50.269477 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2208/4299] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:49 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:50.382564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f976b746-606f-46f5-b63b-1f08b3664ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:50.383201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f976b746-606f-46f5-b63b-1f08b3664ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:50.916432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f976b746-606f-46f5-b63b-1f08b3664ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:50.938198 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f976b746-606f-46f5-b63b-1f08b3664ca5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1215 microversion: 2.1 time: 0.559078 Jul 26 14:26:50.964135 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2092/4300] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:50 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1215 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:51.291596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-335b05b5-c92d-45d5-8cef-55b818df4cf3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:51.293198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-335b05b5-c92d-45d5-8cef-55b818df4cf3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:51.304544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335b05b5-c92d-45d5-8cef-55b818df4cf3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:51.305353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335b05b5-c92d-45d5-8cef-55b818df4cf3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:51.306417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335b05b5-c92d-45d5-8cef-55b818df4cf3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:51.307085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-335b05b5-c92d-45d5-8cef-55b818df4cf3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:51.853170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-335b05b5-c92d-45d5-8cef-55b818df4cf3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:51.879515 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-335b05b5-c92d-45d5-8cef-55b818df4cf3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 0.589329 Jul 26 14:26:51.882708 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2209/4301] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:51 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:51.971900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7bc56bf-3ba6-4c2b-810d-e1abc45c0871 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:51.972570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c7bc56bf-3ba6-4c2b-810d-e1abc45c0871 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:51.986657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7bc56bf-3ba6-4c2b-810d-e1abc45c0871 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:51.993679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7bc56bf-3ba6-4c2b-810d-e1abc45c0871 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:51.994825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7bc56bf-3ba6-4c2b-810d-e1abc45c0871 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:51.995439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7bc56bf-3ba6-4c2b-810d-e1abc45c0871 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:52.386524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c7bc56bf-3ba6-4c2b-810d-e1abc45c0871 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:52.401983 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c7bc56bf-3ba6-4c2b-810d-e1abc45c0871 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1273 microversion: 2.1 time: 0.434994 Jul 26 14:26:52.415706 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2093/4302] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:51 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1273 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:52.908255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1eda11e7-2a57-462d-96b6-7ad25d8bbe06 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:52.911415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1eda11e7-2a57-462d-96b6-7ad25d8bbe06 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:52.929057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1eda11e7-2a57-462d-96b6-7ad25d8bbe06 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:52.931494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1eda11e7-2a57-462d-96b6-7ad25d8bbe06 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:52.935324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1eda11e7-2a57-462d-96b6-7ad25d8bbe06 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:52.936837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1eda11e7-2a57-462d-96b6-7ad25d8bbe06 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:53.437497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0cf1e212-2cb8-4cd6-91db-5e7843a6ac2d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:53.438293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0cf1e212-2cb8-4cd6-91db-5e7843a6ac2d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:53.460733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cf1e212-2cb8-4cd6-91db-5e7843a6ac2d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:53.464615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cf1e212-2cb8-4cd6-91db-5e7843a6ac2d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:53.469235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cf1e212-2cb8-4cd6-91db-5e7843a6ac2d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:53.469948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cf1e212-2cb8-4cd6-91db-5e7843a6ac2d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:54.465434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0cf1e212-2cb8-4cd6-91db-5e7843a6ac2d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:54.483719 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0cf1e212-2cb8-4cd6-91db-5e7843a6ac2d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1273 microversion: 2.1 time: 1.048416 Jul 26 14:26:54.485163 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2094/4303] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:53 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1273 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:55.205269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1eda11e7-2a57-462d-96b6-7ad25d8bbe06 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:55.249841 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1eda11e7-2a57-462d-96b6-7ad25d8bbe06 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1513 microversion: 2.1 time: 2.347370 Jul 26 14:26:55.254516 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2210/4304] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:52 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1513 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:55.518548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1880eb67-3017-45f5-8a6e-a44bfc26c01e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:55.519374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1880eb67-3017-45f5-8a6e-a44bfc26c01e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:55.537726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1880eb67-3017-45f5-8a6e-a44bfc26c01e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:55.539571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1880eb67-3017-45f5-8a6e-a44bfc26c01e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:55.542611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1880eb67-3017-45f5-8a6e-a44bfc26c01e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:55.543283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1880eb67-3017-45f5-8a6e-a44bfc26c01e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:56.294428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4c1419d-67c2-4f42-aabc-e031b7fc0265 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:56.295591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e4c1419d-67c2-4f42-aabc-e031b7fc0265 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:56.335029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4c1419d-67c2-4f42-aabc-e031b7fc0265 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:56.335539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4c1419d-67c2-4f42-aabc-e031b7fc0265 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:56.336520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4c1419d-67c2-4f42-aabc-e031b7fc0265 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:56.337076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4c1419d-67c2-4f42-aabc-e031b7fc0265 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:57.072087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1880eb67-3017-45f5-8a6e-a44bfc26c01e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:57.087914 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1880eb67-3017-45f5-8a6e-a44bfc26c01e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1315 microversion: 2.1 time: 1.576190 Jul 26 14:26:57.093789 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2095/4305] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:55 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1315 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:57.115750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb324f48-2caf-4180-8e28-52fb96aa0826 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:57.117162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eb324f48-2caf-4180-8e28-52fb96aa0826 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:57.150259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb324f48-2caf-4180-8e28-52fb96aa0826 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:57.150714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb324f48-2caf-4180-8e28-52fb96aa0826 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:57.153470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb324f48-2caf-4180-8e28-52fb96aa0826 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:57.157068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb324f48-2caf-4180-8e28-52fb96aa0826 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:57.193890 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-eb324f48-2caf-4180-8e28-52fb96aa0826 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] HTTP exception thrown: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb324f48-2caf-4180-8e28-52fb96aa0826 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Request method failure captured: Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e HTTP/1.1 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_emer31WJRgz1Hz7IpB8GyV1XoR6442Jyo-MFrCPV5O3Drqot8ZJ9SJ5-4noShgqUws1D9ByuHE-EYyJnlKllg46ni0t7dQ7ygndoOmnLeT4tRge06-lvTcURP8Efj31V_CdocTge7aBnVzyORZjj0Qkl8VsyaATYS8tAEN4nZPoDQ Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: eaa556625719414283409d2773814cf7 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eaa556625719414283409d2773814cf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eaa556625719414283409d2773814cf7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}] Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: eaa556625719414283409d2773814cf7 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8d9d1bc9d8e44404a6bf64e912fbe562 Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'be9c25cd-3b3d-4c48-b620-b7ea6101bf3e'} Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:57.202224 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:26:57.206771 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:57.209363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb324f48-2caf-4180-8e28-52fb96aa0826 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Returning 404 to user: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:57.212431 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eb324f48-2caf-4180-8e28-52fb96aa0826 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "DELETE /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 404 len: 111 microversion: 2.20 time: 0.116791 Jul 26 14:26:57.214118 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2096/4306] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:26:57 2022] DELETE /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:26:57.244180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fb05748b-0a85-4546-8df0-9f14b664d997 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:57.249108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fb05748b-0a85-4546-8df0-9f14b664d997 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] [instance: be9c25cd-3b3d-4c48-b620-b7ea6101bf3e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:57.265868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb05748b-0a85-4546-8df0-9f14b664d997 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:57.267183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb05748b-0a85-4546-8df0-9f14b664d997 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:57.271003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb05748b-0a85-4546-8df0-9f14b664d997 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:57.272443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb05748b-0a85-4546-8df0-9f14b664d997 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:57.323484 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-fb05748b-0a85-4546-8df0-9f14b664d997 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] HTTP exception thrown: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fb05748b-0a85-4546-8df0-9f14b664d997 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Request method failure captured: Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e HTTP/1.1 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_emer31WJRgz1Hz7IpB8GyV1XoR6442Jyo-MFrCPV5O3Drqot8ZJ9SJ5-4noShgqUws1D9ByuHE-EYyJnlKllg46ni0t7dQ7ygndoOmnLeT4tRge06-lvTcURP8Efj31V_CdocTge7aBnVzyORZjj0Qkl8VsyaATYS8tAEN4nZPoDQ Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: eaa556625719414283409d2773814cf7 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/eaa556625719414283409d2773814cf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_eaa556625719414283409d2773814cf7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/eaa556625719414283409d2773814cf7"}]}] Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: eaa556625719414283409d2773814cf7 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-767396001 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 8d9d1bc9d8e44404a6bf64e912fbe562 Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeShelveTestJSON-767396001-project Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'be9c25cd-3b3d-4c48-b620-b7ea6101bf3e'} Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:57.352708 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:26:57.358057 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:57.358057 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:26:57.358057 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:26:57.358057 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:26:57.358057 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:26:57.358057 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:26:57.358057 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. Jul 26 14:26:57.358057 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:26:57.390333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fb05748b-0a85-4546-8df0-9f14b664d997 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] Returning 404 to user: Instance be9c25cd-3b3d-4c48-b620-b7ea6101bf3e could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:26:57.395113 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fb05748b-0a85-4546-8df0-9f14b664d997 tempest-AttachVolumeShelveTestJSON-767396001 tempest-AttachVolumeShelveTestJSON-767396001-project] 10.222.0.70 "GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e" status: 404 len: 111 microversion: 2.20 time: 0.172619 Jul 26 14:26:57.397527 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2097/4307] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:26:57 2022] GET /compute/v2.1/servers/be9c25cd-3b3d-4c48-b620-b7ea6101bf3e => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:26:58.120964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b152bf20-c1cb-4b14-9f7a-037441cf7983 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:58.124818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b152bf20-c1cb-4b14-9f7a-037441cf7983 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:58.175233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b152bf20-c1cb-4b14-9f7a-037441cf7983 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:58.178686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b152bf20-c1cb-4b14-9f7a-037441cf7983 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:58.183429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b152bf20-c1cb-4b14-9f7a-037441cf7983 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:58.184583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b152bf20-c1cb-4b14-9f7a-037441cf7983 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:58.350205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e4c1419d-67c2-4f42-aabc-e031b7fc0265 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:26:58.370327 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4c1419d-67c2-4f42-aabc-e031b7fc0265 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1490 microversion: 2.1 time: 2.079927 Jul 26 14:26:58.386792 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2211/4308] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:56 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1490 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:26:58.392453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9c148623-4ae4-4334-927f-59c9970cd4b9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:58.392981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9c148623-4ae4-4334-927f-59c9970cd4b9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:58.401580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c148623-4ae4-4334-927f-59c9970cd4b9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:58.402098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c148623-4ae4-4334-927f-59c9970cd4b9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:58.402997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c148623-4ae4-4334-927f-59c9970cd4b9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:58.403457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c148623-4ae4-4334-927f-59c9970cd4b9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:58.444729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9c148623-4ae4-4334-927f-59c9970cd4b9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:26:58.694615 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9c148623-4ae4-4334-927f-59c9970cd4b9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 204 len: 0 microversion: 2.1 time: 0.288348 Jul 26 14:26:58.698994 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2212/4309] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:26:58 2022] DELETE /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:26:58.709322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-03338fe7-0d23-47d9-a4cb-3a2ae84bf1bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:26:58.710967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-03338fe7-0d23-47d9-a4cb-3a2ae84bf1bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:26:58.722886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03338fe7-0d23-47d9-a4cb-3a2ae84bf1bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:58.723964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03338fe7-0d23-47d9-a4cb-3a2ae84bf1bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:58.725349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03338fe7-0d23-47d9-a4cb-3a2ae84bf1bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:26:58.726174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-03338fe7-0d23-47d9-a4cb-3a2ae84bf1bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:26:58.832318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:26:58.840894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:00.285420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-03338fe7-0d23-47d9-a4cb-3a2ae84bf1bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:00.296885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b152bf20-c1cb-4b14-9f7a-037441cf7983 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:00.298006 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-03338fe7-0d23-47d9-a4cb-3a2ae84bf1bf tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1496 microversion: 2.1 time: 1.595679 Jul 26 14:27:00.302227 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2213/4310] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:58 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1496 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:00.338920 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b152bf20-c1cb-4b14-9f7a-037441cf7983 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1315 microversion: 2.1 time: 2.227468 Jul 26 14:27:00.339517 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2098/4311] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:26:58 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1315 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:00.650915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1696132927", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "0fe25b4d-0727-4f91-a153-42b0302a118f"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:00.822332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] validate_networks() for [('0fe25b4d-0727-4f91-a153-42b0302a118f', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:27:01.321092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1e37b118-4fba-4547-a9af-4a6841a4f3c9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:01.321772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1e37b118-4fba-4547-a9af-4a6841a4f3c9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:01.324669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:01.355073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e37b118-4fba-4547-a9af-4a6841a4f3c9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:01.355660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e37b118-4fba-4547-a9af-4a6841a4f3c9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:01.361416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e37b118-4fba-4547-a9af-4a6841a4f3c9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:01.362258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e37b118-4fba-4547-a9af-4a6841a4f3c9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:04.097786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:27:04.100810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:27:04.102618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:27:04.104340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:27:04.106989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:27:04.168528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:04.169176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:04.171050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:04.171731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:04.238877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Getting quotas for project 55b83b6c173d478fa636d4b21811e736. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:27:04.251655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Getting quotas for user f0415e0fa4fa4e5fa761708ec79a1465 and project 55b83b6c173d478fa636d4b21811e736. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:27:04.254126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1e37b118-4fba-4547-a9af-4a6841a4f3c9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:04.270548 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1e37b118-4fba-4547-a9af-4a6841a4f3c9 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1496 microversion: 2.1 time: 2.953942 Jul 26 14:27:04.290841 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2099/4312] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:01 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1496 bytes in 2975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:27:04.301263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:27:04.303685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3c31884e-8fe5-4da1-8b1e-e3bd2e57bafe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:04.306815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:27:04.309654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3c31884e-8fe5-4da1-8b1e-e3bd2e57bafe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:04.335297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:04.337852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c31884e-8fe5-4da1-8b1e-e3bd2e57bafe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:04.338592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c31884e-8fe5-4da1-8b1e-e3bd2e57bafe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:04.339785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c31884e-8fe5-4da1-8b1e-e3bd2e57bafe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:04.340455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c31884e-8fe5-4da1-8b1e-e3bd2e57bafe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:04.452085 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bf277e3c-1f1c-476b-9919-a5f5a7547a0a tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.142935 Jul 26 14:27:04.456577 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2214/4313] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:27:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:27:04.494979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08bc6dcf-a84f-428e-b348-20c10feed9c3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:04.498946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08bc6dcf-a84f-428e-b348-20c10feed9c3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:05.066681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-08bc6dcf-a84f-428e-b348-20c10feed9c3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:05.074046 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08bc6dcf-a84f-428e-b348-20c10feed9c3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1217 microversion: 2.1 time: 0.609267 Jul 26 14:27:05.074653 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2215/4314] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:04 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1217 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:05.299162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4cd41792-c668-4183-8aff-d00c3231789e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:05.300958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4cd41792-c668-4183-8aff-d00c3231789e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:05.318287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cd41792-c668-4183-8aff-d00c3231789e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:05.327420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cd41792-c668-4183-8aff-d00c3231789e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:05.330006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cd41792-c668-4183-8aff-d00c3231789e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:05.330669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cd41792-c668-4183-8aff-d00c3231789e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:05.346240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3c31884e-8fe5-4da1-8b1e-e3bd2e57bafe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:05.354973 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3c31884e-8fe5-4da1-8b1e-e3bd2e57bafe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1315 microversion: 2.1 time: 1.057077 Jul 26 14:27:05.376001 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2100/4315] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:04 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:06.095686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d637c5d6-2313-4f52-bf4d-4aae78f22d23 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:06.096358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d637c5d6-2313-4f52-bf4d-4aae78f22d23 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:06.105086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d637c5d6-2313-4f52-bf4d-4aae78f22d23 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:06.106044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d637c5d6-2313-4f52-bf4d-4aae78f22d23 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:06.109751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d637c5d6-2313-4f52-bf4d-4aae78f22d23 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:06.110473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d637c5d6-2313-4f52-bf4d-4aae78f22d23 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:06.305144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4cd41792-c668-4183-8aff-d00c3231789e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:06.334186 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4cd41792-c668-4183-8aff-d00c3231789e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1454 microversion: 2.1 time: 1.036623 Jul 26 14:27:06.340059 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2216/4316] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:05 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1454 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:06.346524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7c41fb2a-3a06-4b01-9bdc-9cabf93a7859 req-5e1aa3a1-2a36-4ea7-a273-4e2af78e0a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d3f4f5-4795-48af-a84e-00b7bf0a0e34", "tag": "2944c701-361b-4aeb-843d-be32b3e4ca8b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:06.390650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7c41fb2a-3a06-4b01-9bdc-9cabf93a7859 req-5e1aa3a1-2a36-4ea7-a273-4e2af78e0a1d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:06.395423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7c41fb2a-3a06-4b01-9bdc-9cabf93a7859 req-5e1aa3a1-2a36-4ea7-a273-4e2af78e0a1d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:06.442237 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7c41fb2a-3a06-4b01-9bdc-9cabf93a7859 req-5e1aa3a1-2a36-4ea7-a273-4e2af78e0a1d service nova] Creating event network-changed:2944c701-361b-4aeb-843d-be32b3e4ca8b for instance d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 on n-h1-833090-9 Jul 26 14:27:06.469222 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7c41fb2a-3a06-4b01-9bdc-9cabf93a7859 req-5e1aa3a1-2a36-4ea7-a273-4e2af78e0a1d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127182 Jul 26 14:27:06.474902 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2217/4317] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:06.506912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-571bce24-f054-4954-ba18-111ec8ff61b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:06.507653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-571bce24-f054-4954-ba18-111ec8ff61b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:06.535558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-571bce24-f054-4954-ba18-111ec8ff61b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:06.538986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-571bce24-f054-4954-ba18-111ec8ff61b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:06.541727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-571bce24-f054-4954-ba18-111ec8ff61b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:06.543702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-571bce24-f054-4954-ba18-111ec8ff61b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:07.358728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d637c5d6-2313-4f52-bf4d-4aae78f22d23 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:07.374971 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d637c5d6-2313-4f52-bf4d-4aae78f22d23 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1213 microversion: 2.1 time: 1.278024 Jul 26 14:27:07.380236 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2101/4318] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:06 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1213 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:07.402544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-592f5c3d-613f-4b33-9b9e-47929165a5b0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:07.403471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-592f5c3d-613f-4b33-9b9e-47929165a5b0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:07.448216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-592f5c3d-613f-4b33-9b9e-47929165a5b0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:07.448216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-592f5c3d-613f-4b33-9b9e-47929165a5b0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:07.448421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-592f5c3d-613f-4b33-9b9e-47929165a5b0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:07.455212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-592f5c3d-613f-4b33-9b9e-47929165a5b0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:08.067368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-592f5c3d-613f-4b33-9b9e-47929165a5b0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:08.084608 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-592f5c3d-613f-4b33-9b9e-47929165a5b0 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 200 len: 1454 microversion: 2.1 time: 0.701203 Jul 26 14:27:08.087892 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2102/4319] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:07 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 1454 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:08.409172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2f0ef0a4-e074-4546-8db8-0eb104e6dba4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:08.411756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2f0ef0a4-e074-4546-8db8-0eb104e6dba4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:08.463659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f0ef0a4-e074-4546-8db8-0eb104e6dba4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:08.466687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f0ef0a4-e074-4546-8db8-0eb104e6dba4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:08.472421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f0ef0a4-e074-4546-8db8-0eb104e6dba4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:08.476246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f0ef0a4-e074-4546-8db8-0eb104e6dba4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:09.038221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2f0ef0a4-e074-4546-8db8-0eb104e6dba4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:09.048479 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2f0ef0a4-e074-4546-8db8-0eb104e6dba4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1275 microversion: 2.1 time: 0.650674 Jul 26 14:27:09.052662 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2103/4320] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:08 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1275 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:09.065581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-467e7d5d-cab7-4dff-8d5c-37b697742cd8 req-45b93439-f45a-4736-a7ca-29aa8df9e887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1200626-26aa-45b9-aad7-0474c6e8b500", "name": "network-vif-deleted", "tag": "78b9f61e-9b47-4ca7-aa18-066ee3fe1b32"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:09.104779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-467e7d5d-cab7-4dff-8d5c-37b697742cd8 req-45b93439-f45a-4736-a7ca-29aa8df9e887 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:09.105688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-467e7d5d-cab7-4dff-8d5c-37b697742cd8 req-45b93439-f45a-4736-a7ca-29aa8df9e887 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:09.122029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-571bce24-f054-4954-ba18-111ec8ff61b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:09.140520 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-467e7d5d-cab7-4dff-8d5c-37b697742cd8 req-45b93439-f45a-4736-a7ca-29aa8df9e887 service nova] Creating event network-vif-deleted:78b9f61e-9b47-4ca7-aa18-066ee3fe1b32 for instance a1200626-26aa-45b9-aad7-0474c6e8b500 on n-h2-833090-9 Jul 26 14:27:09.157598 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-467e7d5d-cab7-4dff-8d5c-37b697742cd8 req-45b93439-f45a-4736-a7ca-29aa8df9e887 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092696 Jul 26 14:27:09.158111 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-571bce24-f054-4954-ba18-111ec8ff61b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1315 microversion: 2.1 time: 2.678885 Jul 26 14:27:09.158557 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2104/4321] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:09.159143 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2218/4322] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:06 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1315 bytes in 2683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:09.197812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6cec068-fc03-4e15-8beb-21d280aec018 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:09.200744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6cec068-fc03-4e15-8beb-21d280aec018 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:09.231595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6cec068-fc03-4e15-8beb-21d280aec018 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:09.233258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6cec068-fc03-4e15-8beb-21d280aec018 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:09.235745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6cec068-fc03-4e15-8beb-21d280aec018 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:09.236953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6cec068-fc03-4e15-8beb-21d280aec018 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:09.273080 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c6cec068-fc03-4e15-8beb-21d280aec018 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6cec068-fc03-4e15-8beb-21d280aec018 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 HTTP/1.1 Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'a1200626-26aa-45b9-aad7-0474c6e8b500'} Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:27:09.284508 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:27:09.292084 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:09.292084 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:27:09.292084 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:27:09.292084 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:27:09.292084 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:27:09.292084 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:27:09.292084 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:27:09.296391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6cec068-fc03-4e15-8beb-21d280aec018 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:27:09.298186 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6cec068-fc03-4e15-8beb-21d280aec018 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 404 len: 111 microversion: 2.1 time: 0.123346 Jul 26 14:27:09.298732 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2105/4323] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:09 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:27:09.486994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1162999528", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "01fdab58-8c00-4787-8288-5206df456cd7"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:09.632041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] validate_networks() for [('01fdab58-8c00-4787-8288-5206df456cd7', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:27:10.082017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb5ac13a-7162-4726-89fe-98b1b8473108 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:10.087659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bb5ac13a-7162-4726-89fe-98b1b8473108 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:10.110399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb5ac13a-7162-4726-89fe-98b1b8473108 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:10.117878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb5ac13a-7162-4726-89fe-98b1b8473108 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:10.125456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb5ac13a-7162-4726-89fe-98b1b8473108 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:10.132748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb5ac13a-7162-4726-89fe-98b1b8473108 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:11.278603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bb5ac13a-7162-4726-89fe-98b1b8473108 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:11.304451 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bb5ac13a-7162-4726-89fe-98b1b8473108 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1275 microversion: 2.1 time: 1.229905 Jul 26 14:27:11.305537 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2106/4324] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:10 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1275 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:11.315893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6316d52b-7d68-4da8-91f2-07a30f108a9b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:11.319784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6316d52b-7d68-4da8-91f2-07a30f108a9b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:11.330243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6316d52b-7d68-4da8-91f2-07a30f108a9b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:11.331068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6316d52b-7d68-4da8-91f2-07a30f108a9b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:11.332327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6316d52b-7d68-4da8-91f2-07a30f108a9b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:11.333050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6316d52b-7d68-4da8-91f2-07a30f108a9b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:12.347938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6316d52b-7d68-4da8-91f2-07a30f108a9b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:12.358071 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6316d52b-7d68-4da8-91f2-07a30f108a9b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1315 microversion: 2.1 time: 1.051079 Jul 26 14:27:12.359385 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2107/4325] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:11 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1315 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:12.365273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-43562302-f81a-4b02-aa68-8ed5a3dbc80b tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:12.366498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-43562302-f81a-4b02-aa68-8ed5a3dbc80b tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:12.376621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43562302-f81a-4b02-aa68-8ed5a3dbc80b tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:12.381252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43562302-f81a-4b02-aa68-8ed5a3dbc80b tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:12.382536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43562302-f81a-4b02-aa68-8ed5a3dbc80b tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:12.383200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43562302-f81a-4b02-aa68-8ed5a3dbc80b tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:12.392453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:12.422782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:27:12.429122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:27:12.431523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:27:12.442666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:27:12.447522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:27:12.527154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:12.528333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:12.538398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:12.545890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:12.659020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:27:12.662665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43562302-f81a-4b02-aa68-8ed5a3dbc80b tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:12.680936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Getting quotas for user b1e46ed350fa42669bba323ef30b982d and project ca1a498bf67548bf9212814bdc38d0af. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:27:12.683411 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-43562302-f81a-4b02-aa68-8ed5a3dbc80b tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1275 microversion: 2.1 time: 0.322493 Jul 26 14:27:12.690201 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2108/4326] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:12 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1275 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:12.722913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:27:12.730968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:27:12.913120 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-47d64184-bfad-4887-8374-9daa81ca82ad tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.431721 Jul 26 14:27:12.927486 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2219/4327] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:27:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:27:12.939857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b28facf1-a15d-4fda-97d1-6d75870a6f66 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:12.940683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b28facf1-a15d-4fda-97d1-6d75870a6f66 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:13.229189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b28facf1-a15d-4fda-97d1-6d75870a6f66 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:13.254296 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b28facf1-a15d-4fda-97d1-6d75870a6f66 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1215 microversion: 2.1 time: 0.325543 Jul 26 14:27:13.259774 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2109/4328] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:12 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1215 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:13.397278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-35ed88f9-eac9-4756-b39d-25f202d027d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:13.398593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-35ed88f9-eac9-4756-b39d-25f202d027d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:13.436192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35ed88f9-eac9-4756-b39d-25f202d027d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:13.440193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35ed88f9-eac9-4756-b39d-25f202d027d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:13.441177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35ed88f9-eac9-4756-b39d-25f202d027d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:13.441648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35ed88f9-eac9-4756-b39d-25f202d027d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:13.713800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fba121e5-9ecf-40a8-ba11-d6c30d410e17 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:13.715453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fba121e5-9ecf-40a8-ba11-d6c30d410e17 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:13.734705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fba121e5-9ecf-40a8-ba11-d6c30d410e17 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:13.735476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fba121e5-9ecf-40a8-ba11-d6c30d410e17 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:13.737766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fba121e5-9ecf-40a8-ba11-d6c30d410e17 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:13.742615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fba121e5-9ecf-40a8-ba11-d6c30d410e17 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:14.738035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fba121e5-9ecf-40a8-ba11-d6c30d410e17 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:14.741949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35ed88f9-eac9-4756-b39d-25f202d027d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:14.752994 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fba121e5-9ecf-40a8-ba11-d6c30d410e17 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1317 microversion: 2.1 time: 1.043170 Jul 26 14:27:14.763690 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-35ed88f9-eac9-4756-b39d-25f202d027d8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1315 microversion: 2.1 time: 1.369487 Jul 26 14:27:14.768997 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2220/4329] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:13 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1315 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:14.773019 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2110/4330] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:13 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1317 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:14.777550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f0cc135-9ba9-457e-ad8a-7ad5e409473b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:14.778111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f0cc135-9ba9-457e-ad8a-7ad5e409473b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:14.816352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f0cc135-9ba9-457e-ad8a-7ad5e409473b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:14.816954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f0cc135-9ba9-457e-ad8a-7ad5e409473b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:14.817833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f0cc135-9ba9-457e-ad8a-7ad5e409473b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:14.821104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f0cc135-9ba9-457e-ad8a-7ad5e409473b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:15.394402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f0cc135-9ba9-457e-ad8a-7ad5e409473b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:15.428867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:15.432698 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f0cc135-9ba9-457e-ad8a-7ad5e409473b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1211 microversion: 2.1 time: 0.660669 Jul 26 14:27:15.433494 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2221/4331] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:14 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1211 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:15.777810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-14374c7d-a795-4bf6-b126-16dcaf3ecf79 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:15.778468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-14374c7d-a795-4bf6-b126-16dcaf3ecf79 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:15.799248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14374c7d-a795-4bf6-b126-16dcaf3ecf79 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:15.801870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2676dcfc-a29f-4552-be0c-e72561f47e7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:15.802501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2676dcfc-a29f-4552-be0c-e72561f47e7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:15.803202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14374c7d-a795-4bf6-b126-16dcaf3ecf79 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:15.804244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14374c7d-a795-4bf6-b126-16dcaf3ecf79 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:15.806170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14374c7d-a795-4bf6-b126-16dcaf3ecf79 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:15.815105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2676dcfc-a29f-4552-be0c-e72561f47e7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:15.815620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2676dcfc-a29f-4552-be0c-e72561f47e7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:15.835653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2676dcfc-a29f-4552-be0c-e72561f47e7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:15.847731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2676dcfc-a29f-4552-be0c-e72561f47e7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:16.588946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-14374c7d-a795-4bf6-b126-16dcaf3ecf79 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:16.619705 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-14374c7d-a795-4bf6-b126-16dcaf3ecf79 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1317 microversion: 2.1 time: 0.839245 Jul 26 14:27:16.625548 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2111/4332] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:15 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:16.646169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-071586be-8afc-4152-95f9-95e5753ba7e7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:16.646800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-071586be-8afc-4152-95f9-95e5753ba7e7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:16.673757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-071586be-8afc-4152-95f9-95e5753ba7e7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:16.677439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-071586be-8afc-4152-95f9-95e5753ba7e7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:16.678472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-071586be-8afc-4152-95f9-95e5753ba7e7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:16.679590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-071586be-8afc-4152-95f9-95e5753ba7e7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:16.784918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2676dcfc-a29f-4552-be0c-e72561f47e7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:16.848815 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2676dcfc-a29f-4552-be0c-e72561f47e7f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1315 microversion: 2.1 time: 1.033439 Jul 26 14:27:16.849884 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2222/4333] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:15 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1315 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:27:16.908706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-071586be-8afc-4152-95f9-95e5753ba7e7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:16.942494 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-071586be-8afc-4152-95f9-95e5753ba7e7 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1273 microversion: 2.1 time: 0.302143 Jul 26 14:27:16.952162 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2112/4334] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:16 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:17.647098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bd83675c-b74e-4748-8189-21dbdddd9ad7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:17.647741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bd83675c-b74e-4748-8189-21dbdddd9ad7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:17.659867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd83675c-b74e-4748-8189-21dbdddd9ad7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:17.660368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd83675c-b74e-4748-8189-21dbdddd9ad7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:17.661242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd83675c-b74e-4748-8189-21dbdddd9ad7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:17.661737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd83675c-b74e-4748-8189-21dbdddd9ad7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:17.871502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d2ef615-fe5d-4adf-af33-c317e58a3814 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:17.872421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4d2ef615-fe5d-4adf-af33-c317e58a3814 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:17.890855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d2ef615-fe5d-4adf-af33-c317e58a3814 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:17.892525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d2ef615-fe5d-4adf-af33-c317e58a3814 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:17.893787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d2ef615-fe5d-4adf-af33-c317e58a3814 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:17.895743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d2ef615-fe5d-4adf-af33-c317e58a3814 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:18.565582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bd83675c-b74e-4748-8189-21dbdddd9ad7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:18.582891 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bd83675c-b74e-4748-8189-21dbdddd9ad7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1317 microversion: 2.1 time: 0.939832 Jul 26 14:27:18.584573 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2223/4335] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:17 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1317 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:18.593958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-96d5195e-4833-44dd-86a0-c76fdb5e3764 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:18.599245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-96d5195e-4833-44dd-86a0-c76fdb5e3764 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:18.617252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96d5195e-4833-44dd-86a0-c76fdb5e3764 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:18.617723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96d5195e-4833-44dd-86a0-c76fdb5e3764 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:18.618536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96d5195e-4833-44dd-86a0-c76fdb5e3764 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:18.618989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96d5195e-4833-44dd-86a0-c76fdb5e3764 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:19.428684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-96d5195e-4833-44dd-86a0-c76fdb5e3764 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:19.441788 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-96d5195e-4833-44dd-86a0-c76fdb5e3764 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1273 microversion: 2.1 time: 0.854680 Jul 26 14:27:19.442719 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2224/4336] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:18 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1273 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:19.512950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-06ccb298-d32f-4d6c-b100-f241bdf2c168 req-47fdca36-db88-41d8-af8d-7c3f36a751a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d3f4f5-4795-48af-a84e-00b7bf0a0e34", "name": "network-vif-plugged", "status": "completed", "tag": "2944c701-361b-4aeb-843d-be32b3e4ca8b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:19.519012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:19.542486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-06ccb298-d32f-4d6c-b100-f241bdf2c168 req-47fdca36-db88-41d8-af8d-7c3f36a751a4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:19.543558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-06ccb298-d32f-4d6c-b100-f241bdf2c168 req-47fdca36-db88-41d8-af8d-7c3f36a751a4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:19.589044 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-06ccb298-d32f-4d6c-b100-f241bdf2c168 req-47fdca36-db88-41d8-af8d-7c3f36a751a4 service nova] Creating event network-vif-plugged:2944c701-361b-4aeb-843d-be32b3e4ca8b for instance d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 on n-h1-833090-9 Jul 26 14:27:19.610823 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-06ccb298-d32f-4d6c-b100-f241bdf2c168 req-47fdca36-db88-41d8-af8d-7c3f36a751a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096956 Jul 26 14:27:19.615625 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2225/4337] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:19.637897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23c86e6b-6f08-4f05-9428-32ab9abad6d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:19.643732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-23c86e6b-6f08-4f05-9428-32ab9abad6d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:19.686916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4d2ef615-fe5d-4adf-af33-c317e58a3814 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:19.690388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23c86e6b-6f08-4f05-9428-32ab9abad6d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:19.691688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23c86e6b-6f08-4f05-9428-32ab9abad6d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:19.692926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23c86e6b-6f08-4f05-9428-32ab9abad6d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:19.693606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23c86e6b-6f08-4f05-9428-32ab9abad6d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:19.709065 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4d2ef615-fe5d-4adf-af33-c317e58a3814 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1315 microversion: 2.1 time: 1.841562 Jul 26 14:27:19.712566 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2113/4338] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:17 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1315 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:20.465832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8164fbfc-f73e-442c-8783-4a74a746060f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:20.466462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8164fbfc-f73e-442c-8783-4a74a746060f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:20.480657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8164fbfc-f73e-442c-8783-4a74a746060f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:20.481410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8164fbfc-f73e-442c-8783-4a74a746060f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:20.483367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8164fbfc-f73e-442c-8783-4a74a746060f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:20.485670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8164fbfc-f73e-442c-8783-4a74a746060f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:20.927100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8164fbfc-f73e-442c-8783-4a74a746060f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:20.952899 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8164fbfc-f73e-442c-8783-4a74a746060f tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1273 microversion: 2.1 time: 0.493956 Jul 26 14:27:20.954179 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2114/4339] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:20 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1273 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:27:20.974609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-da247ef5-1044-428e-8828-9ed8814db217 req-3bde4890-305f-42d8-93cd-1235d66575c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1477ddb-37c0-4904-8c5c-446f8bcab3b8", "tag": "b9f5122b-e0ef-47c5-bc27-373c2f848f66"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:21.032888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-da247ef5-1044-428e-8828-9ed8814db217 req-3bde4890-305f-42d8-93cd-1235d66575c8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:21.033560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-da247ef5-1044-428e-8828-9ed8814db217 req-3bde4890-305f-42d8-93cd-1235d66575c8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:21.046936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23c86e6b-6f08-4f05-9428-32ab9abad6d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:21.058133 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23c86e6b-6f08-4f05-9428-32ab9abad6d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1317 microversion: 2.1 time: 1.439080 Jul 26 14:27:21.059104 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2226/4340] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:19 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1317 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:21.074989 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-da247ef5-1044-428e-8828-9ed8814db217 req-3bde4890-305f-42d8-93cd-1235d66575c8 service nova] Creating event network-changed:b9f5122b-e0ef-47c5-bc27-373c2f848f66 for instance b1477ddb-37c0-4904-8c5c-446f8bcab3b8 on n-h2-833090-9 Jul 26 14:27:21.084017 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-da247ef5-1044-428e-8828-9ed8814db217 req-3bde4890-305f-42d8-93cd-1235d66575c8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121640 Jul 26 14:27:21.084905 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2115/4341] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:21.120204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-443e60da-de43-414b-a2a8-5e947bff199f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:21.126854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-443e60da-de43-414b-a2a8-5e947bff199f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:21.149279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-443e60da-de43-414b-a2a8-5e947bff199f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:21.164745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-443e60da-de43-414b-a2a8-5e947bff199f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:21.165894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-443e60da-de43-414b-a2a8-5e947bff199f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:21.166503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-443e60da-de43-414b-a2a8-5e947bff199f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:21.978670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-33dd471a-30c1-484d-8192-256c102292dc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:21.980265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-33dd471a-30c1-484d-8192-256c102292dc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:21.990751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-443e60da-de43-414b-a2a8-5e947bff199f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:22.000401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33dd471a-30c1-484d-8192-256c102292dc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:22.001235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33dd471a-30c1-484d-8192-256c102292dc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:22.002272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33dd471a-30c1-484d-8192-256c102292dc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:22.003159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33dd471a-30c1-484d-8192-256c102292dc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:22.027880 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-443e60da-de43-414b-a2a8-5e947bff199f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1315 microversion: 2.1 time: 0.920636 Jul 26 14:27:22.042115 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2227/4342] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:21 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1315 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:22.095970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3cf2c39b-949f-4a1d-a424-b0dda4707fc7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:22.097941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3cf2c39b-949f-4a1d-a424-b0dda4707fc7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:22.111454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cf2c39b-949f-4a1d-a424-b0dda4707fc7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:22.113643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cf2c39b-949f-4a1d-a424-b0dda4707fc7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:22.114735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cf2c39b-949f-4a1d-a424-b0dda4707fc7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:22.125051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cf2c39b-949f-4a1d-a424-b0dda4707fc7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:22.606680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:22.708284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=14 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:23.248682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:23.622291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-33dd471a-30c1-484d-8192-256c102292dc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:23.640039 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-33dd471a-30c1-484d-8192-256c102292dc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1315 microversion: 2.1 time: 1.657723 Jul 26 14:27:23.654424 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2116/4343] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:21 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1315 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:27:23.663787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7909b1f8-c31e-4aa2-b2b4-270b7289d948 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:23.673108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7909b1f8-c31e-4aa2-b2b4-270b7289d948 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:23.704011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7909b1f8-c31e-4aa2-b2b4-270b7289d948 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:23.704727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7909b1f8-c31e-4aa2-b2b4-270b7289d948 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:23.709370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7909b1f8-c31e-4aa2-b2b4-270b7289d948 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:23.713265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7909b1f8-c31e-4aa2-b2b4-270b7289d948 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:24.182550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3cf2c39b-949f-4a1d-a424-b0dda4707fc7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:24.204645 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3cf2c39b-949f-4a1d-a424-b0dda4707fc7 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1317 microversion: 2.1 time: 2.106254 Jul 26 14:27:24.205367 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2228/4344] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:22 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1317 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:24.664808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9be55d60-fe55-47db-8614-0a62d0d8d33c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:24.665341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9be55d60-fe55-47db-8614-0a62d0d8d33c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:24.714843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be55d60-fe55-47db-8614-0a62d0d8d33c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:24.723210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be55d60-fe55-47db-8614-0a62d0d8d33c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:24.731192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be55d60-fe55-47db-8614-0a62d0d8d33c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:24.739545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be55d60-fe55-47db-8614-0a62d0d8d33c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:24.815319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7909b1f8-c31e-4aa2-b2b4-270b7289d948 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:24.920465 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7909b1f8-c31e-4aa2-b2b4-270b7289d948 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1502 microversion: 2.1 time: 1.248132 Jul 26 14:27:24.936972 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2117/4345] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:23 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1502 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:24.958240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b544c7e7-77b8-47f8-99a3-f9864bc7b3ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:24.960219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b544c7e7-77b8-47f8-99a3-f9864bc7b3ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:24.995901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b544c7e7-77b8-47f8-99a3-f9864bc7b3ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:25.002751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b544c7e7-77b8-47f8-99a3-f9864bc7b3ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:25.004394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b544c7e7-77b8-47f8-99a3-f9864bc7b3ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:25.007216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b544c7e7-77b8-47f8-99a3-f9864bc7b3ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:26.242297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9be55d60-fe55-47db-8614-0a62d0d8d33c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:26.255505 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.network.security_group_api [None req-b544c7e7-77b8-47f8-99a3-f9864bc7b3ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Removing security group e8554b13-2d32-4e33-8e15-9d25e3176c37 from port 2944c701-361b-4aeb-843d-be32b3e4ca8b Jul 26 14:27:26.285400 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9be55d60-fe55-47db-8614-0a62d0d8d33c tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1315 microversion: 2.1 time: 1.622410 Jul 26 14:27:26.286056 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2229/4346] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:24 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1315 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:26.307116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c4326b8e-91ef-41c7-a35f-9588bbe13f93 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:26.308677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c4326b8e-91ef-41c7-a35f-9588bbe13f93 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:26.325711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4326b8e-91ef-41c7-a35f-9588bbe13f93 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:26.328978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4326b8e-91ef-41c7-a35f-9588bbe13f93 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:26.333265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4326b8e-91ef-41c7-a35f-9588bbe13f93 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:26.334236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4326b8e-91ef-41c7-a35f-9588bbe13f93 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:28.233699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c4326b8e-91ef-41c7-a35f-9588bbe13f93 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:28.270135 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c4326b8e-91ef-41c7-a35f-9588bbe13f93 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1317 microversion: 2.1 time: 1.972713 Jul 26 14:27:28.284351 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2230/4347] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:26 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1317 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:28.322068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90aa53cb-5b3e-4ea6-9aba-9725550b050e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:28.333110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-90aa53cb-5b3e-4ea6-9aba-9725550b050e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:28.377582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90aa53cb-5b3e-4ea6-9aba-9725550b050e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:28.385629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90aa53cb-5b3e-4ea6-9aba-9725550b050e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:28.395659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90aa53cb-5b3e-4ea6-9aba-9725550b050e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:28.396619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90aa53cb-5b3e-4ea6-9aba-9725550b050e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:31.614065 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b544c7e7-77b8-47f8-99a3-f9864bc7b3ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34/action" status: 202 len: 0 microversion: 2.1 time: 6.664393 Jul 26 14:27:31.615348 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2118/4348] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:27:24 2022] POST /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34/action => generated 0 bytes in 6673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:27:31.642081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-38e2f8e2-9268-412f-ab48-4b23925c06b8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:31.643136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-38e2f8e2-9268-412f-ab48-4b23925c06b8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:31.683865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38e2f8e2-9268-412f-ab48-4b23925c06b8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:31.691727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38e2f8e2-9268-412f-ab48-4b23925c06b8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:31.695920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38e2f8e2-9268-412f-ab48-4b23925c06b8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:31.696441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38e2f8e2-9268-412f-ab48-4b23925c06b8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:32.880597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90aa53cb-5b3e-4ea6-9aba-9725550b050e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:32.898403 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90aa53cb-5b3e-4ea6-9aba-9725550b050e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1315 microversion: 2.1 time: 4.614405 Jul 26 14:27:32.906323 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2231/4349] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:28 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1315 bytes in 4624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:33.266551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-38e2f8e2-9268-412f-ab48-4b23925c06b8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:33.274760 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-38e2f8e2-9268-412f-ab48-4b23925c06b8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1317 microversion: 2.1 time: 1.652993 Jul 26 14:27:33.275613 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2119/4350] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:31 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1317 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:33.304744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-20fee855-c0bb-4319-9f35-c67879d1e898 req-387a408f-d18c-4b3d-b27b-d3a922893a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f8b4b8-decd-45a0-952a-53fe17d72837", "tag": "5538da85-762b-4901-a38e-0e4e55843ebe"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:33.340663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-20fee855-c0bb-4319-9f35-c67879d1e898 req-387a408f-d18c-4b3d-b27b-d3a922893a43 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:33.342559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-20fee855-c0bb-4319-9f35-c67879d1e898 req-387a408f-d18c-4b3d-b27b-d3a922893a43 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:33.390979 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-20fee855-c0bb-4319-9f35-c67879d1e898 req-387a408f-d18c-4b3d-b27b-d3a922893a43 service nova] Creating event network-changed:5538da85-762b-4901-a38e-0e4e55843ebe for instance 24f8b4b8-decd-45a0-952a-53fe17d72837 on n-h2-833090-9 Jul 26 14:27:33.413179 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-20fee855-c0bb-4319-9f35-c67879d1e898 req-387a408f-d18c-4b3d-b27b-d3a922893a43 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124990 Jul 26 14:27:33.419526 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2120/4351] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:33.440211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-616e8858-aea2-4dda-96d5-43db13ee2a03 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:33.446014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-616e8858-aea2-4dda-96d5-43db13ee2a03 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:33.480321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-616e8858-aea2-4dda-96d5-43db13ee2a03 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:33.484762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-616e8858-aea2-4dda-96d5-43db13ee2a03 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:33.496306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-616e8858-aea2-4dda-96d5-43db13ee2a03 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:33.497310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-616e8858-aea2-4dda-96d5-43db13ee2a03 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:33.837999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cca52d5c-5e0a-4385-aa93-a96f03328235 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Action: 'create', calling method: .version_select at 0x7f87993d6940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-643067034", "metadata": {"Type": "work"}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:33.991039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-616e8858-aea2-4dda-96d5-43db13ee2a03 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:34.015195 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-616e8858-aea2-4dda-96d5-43db13ee2a03 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1460 microversion: 2.1 time: 0.592944 Jul 26 14:27:34.032768 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2121/4352] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:33 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1460 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:34.050012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32e43d6e-b3e0-491c-8035-b2f5191269b6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:34.051091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-32e43d6e-b3e0-491c-8035-b2f5191269b6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:34.075816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32e43d6e-b3e0-491c-8035-b2f5191269b6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:34.077289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32e43d6e-b3e0-491c-8035-b2f5191269b6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:34.078393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32e43d6e-b3e0-491c-8035-b2f5191269b6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:34.081062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32e43d6e-b3e0-491c-8035-b2f5191269b6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:34.816869 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cca52d5c-5e0a-4385-aa93-a96f03328235 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.907705 Jul 26 14:27:34.831096 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2232/4353] 10.222.0.70 () {60 vars in 1156 bytes} [Tue Jul 26 14:27:32 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1923 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 14:27:34.842702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-989326a9-97af-4c41-a748-c2a8754fa65e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:34.844371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-989326a9-97af-4c41-a748-c2a8754fa65e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:34.855988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-989326a9-97af-4c41-a748-c2a8754fa65e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:34.856707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-989326a9-97af-4c41-a748-c2a8754fa65e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:34.857964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-989326a9-97af-4c41-a748-c2a8754fa65e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:34.858796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-989326a9-97af-4c41-a748-c2a8754fa65e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:34.906577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-32e43d6e-b3e0-491c-8035-b2f5191269b6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:34.934616 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32e43d6e-b3e0-491c-8035-b2f5191269b6 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1315 microversion: 2.1 time: 0.887843 Jul 26 14:27:34.935309 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2122/4354] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:34 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1315 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:35.006572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-0ec517e7-ca0e-41d7-b4b1-32375b5ed44f req-3d8bad8e-373e-48cf-86a8-24b8e96b43fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1477ddb-37c0-4904-8c5c-446f8bcab3b8", "name": "network-vif-plugged", "status": "completed", "tag": "b9f5122b-e0ef-47c5-bc27-373c2f848f66"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:35.063525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=48 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:35.084197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0ec517e7-ca0e-41d7-b4b1-32375b5ed44f req-3d8bad8e-373e-48cf-86a8-24b8e96b43fd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:35.088639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0ec517e7-ca0e-41d7-b4b1-32375b5ed44f req-3d8bad8e-373e-48cf-86a8-24b8e96b43fd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:35.238991 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-0ec517e7-ca0e-41d7-b4b1-32375b5ed44f req-3d8bad8e-373e-48cf-86a8-24b8e96b43fd service nova] Creating event network-vif-plugged:b9f5122b-e0ef-47c5-bc27-373c2f848f66 for instance b1477ddb-37c0-4904-8c5c-446f8bcab3b8 on n-h2-833090-9 Jul 26 14:27:35.246350 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-0ec517e7-ca0e-41d7-b4b1-32375b5ed44f req-3d8bad8e-373e-48cf-86a8-24b8e96b43fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279411 Jul 26 14:27:35.252958 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2123/4355] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:35.280906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-abc114f4-8de2-4607-a9ae-0859b9c336d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:35.282561 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-abc114f4-8de2-4607-a9ae-0859b9c336d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:35.304244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abc114f4-8de2-4607-a9ae-0859b9c336d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:35.305658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abc114f4-8de2-4607-a9ae-0859b9c336d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:35.307883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abc114f4-8de2-4607-a9ae-0859b9c336d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:35.310776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abc114f4-8de2-4607-a9ae-0859b9c336d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:36.112608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-989326a9-97af-4c41-a748-c2a8754fa65e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:36.160147 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-989326a9-97af-4c41-a748-c2a8754fa65e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.318866 Jul 26 14:27:36.172548 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2233/4356] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:34 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:36.219289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db57737d-5f68-469f-b897-48c83d4ca6d9 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f87993aa160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:36.537863 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db57737d-5f68-469f-b897-48c83d4ca6d9 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 200 len: 352 microversion: 2.1 time: 0.361859 Jul 26 14:27:36.538481 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2234/4357] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:27:36 2022] GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 352 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:36.547188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-abc114f4-8de2-4607-a9ae-0859b9c336d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:36.547815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-74a76502-e401-404d-9b34-4ae196182c02 req-f2b2094f-55c1-4604-91a6-8dbe66e974cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d3f4f5-4795-48af-a84e-00b7bf0a0e34", "tag": "2944c701-361b-4aeb-843d-be32b3e4ca8b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:36.559748 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-abc114f4-8de2-4607-a9ae-0859b9c336d4 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1317 microversion: 2.1 time: 1.303435 Jul 26 14:27:36.576044 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2124/4358] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:35 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1317 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:36.597090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-494ca4de-938e-44c2-a0a9-53c90ad9ff46 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:36.600780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-494ca4de-938e-44c2-a0a9-53c90ad9ff46 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:36.617420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-494ca4de-938e-44c2-a0a9-53c90ad9ff46 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:36.618638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-494ca4de-938e-44c2-a0a9-53c90ad9ff46 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:36.621710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-494ca4de-938e-44c2-a0a9-53c90ad9ff46 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:36.625831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-494ca4de-938e-44c2-a0a9-53c90ad9ff46 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:36.628425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-74a76502-e401-404d-9b34-4ae196182c02 req-f2b2094f-55c1-4604-91a6-8dbe66e974cb service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:36.629288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-74a76502-e401-404d-9b34-4ae196182c02 req-f2b2094f-55c1-4604-91a6-8dbe66e974cb service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:36.661796 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-74a76502-e401-404d-9b34-4ae196182c02 req-f2b2094f-55c1-4604-91a6-8dbe66e974cb service nova] Creating event network-changed:2944c701-361b-4aeb-843d-be32b3e4ca8b for instance d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 on n-h1-833090-9 Jul 26 14:27:36.687700 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-74a76502-e401-404d-9b34-4ae196182c02 req-f2b2094f-55c1-4604-91a6-8dbe66e974cb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146595 Jul 26 14:27:36.691021 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2235/4359] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:36.720642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-99f99bf2-285d-4f2c-89e9-bfe4bdbf414d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:36.723409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-99f99bf2-285d-4f2c-89e9-bfe4bdbf414d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:36.754459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99f99bf2-285d-4f2c-89e9-bfe4bdbf414d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:36.761732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99f99bf2-285d-4f2c-89e9-bfe4bdbf414d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:36.764790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99f99bf2-285d-4f2c-89e9-bfe4bdbf414d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:36.767317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99f99bf2-285d-4f2c-89e9-bfe4bdbf414d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:37.741178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99f99bf2-285d-4f2c-89e9-bfe4bdbf414d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:37.762797 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-99f99bf2-285d-4f2c-89e9-bfe4bdbf414d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.069891 Jul 26 14:27:37.764404 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2236/4360] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:36 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:37.776498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-385d025a-b8bd-4f16-b12c-8453f1bf7d97 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f87992c2ee0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:37.962833 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-385d025a-b8bd-4f16-b12c-8453f1bf7d97 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 200 len: 352 microversion: 2.1 time: 0.196819 Jul 26 14:27:37.968240 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2237/4361] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:27:37 2022] GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 352 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:37.978366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b8a08936-a6b2-467a-abe1-678277b08bd1 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:37.980930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b8a08936-a6b2-467a-abe1-678277b08bd1 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:38.017970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8a08936-a6b2-467a-abe1-678277b08bd1 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:38.019235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8a08936-a6b2-467a-abe1-678277b08bd1 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:38.021543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8a08936-a6b2-467a-abe1-678277b08bd1 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:38.023922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b8a08936-a6b2-467a-abe1-678277b08bd1 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:38.653127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b8a08936-a6b2-467a-abe1-678277b08bd1 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:38.666099 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b8a08936-a6b2-467a-abe1-678277b08bd1 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1317 microversion: 2.1 time: 0.696276 Jul 26 14:27:38.678173 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2238/4362] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:37 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:38.695016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9b654988-c6e5-427f-bd94-a2c36e2654ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:38.697226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9b654988-c6e5-427f-bd94-a2c36e2654ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:38.712284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b654988-c6e5-427f-bd94-a2c36e2654ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:38.714140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b654988-c6e5-427f-bd94-a2c36e2654ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:38.715459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b654988-c6e5-427f-bd94-a2c36e2654ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:38.718064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b654988-c6e5-427f-bd94-a2c36e2654ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:38.790326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-494ca4de-938e-44c2-a0a9-53c90ad9ff46 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:38.813035 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-494ca4de-938e-44c2-a0a9-53c90ad9ff46 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1315 microversion: 2.1 time: 2.223758 Jul 26 14:27:38.815269 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2125/4363] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:36 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1315 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:38.983836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8fdfebc7-a3e2-4383-a4de-98885ca35ea5 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f8787857940>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:39.100543 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8fdfebc7-a3e2-4383-a4de-98885ca35ea5 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 200 len: 353 microversion: 2.1 time: 0.120944 Jul 26 14:27:39.101492 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2126/4364] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:27:38 2022] GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:27:39.120555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea1b509c-1a4b-4224-8442-ca376416b8b9 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f8787770280>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:39.295513 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ea1b509c-1a4b-4224-8442-ca376416b8b9 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 200 len: 353 microversion: 2.1 time: 0.178932 Jul 26 14:27:39.296850 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2127/4365] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:27:39 2022] GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:39.315487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3782e7bb-ba94-46ad-b342-58fc1de8e053 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f87993b89d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:39.573251 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3782e7bb-ba94-46ad-b342-58fc1de8e053 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 202 len: 0 microversion: 2.1 time: 0.261698 Jul 26 14:27:39.574400 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2128/4366] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:27:39 2022] DELETE /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:27:39.585367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05eff61f-9040-4a4e-801f-325f3fd19582 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f8799268790>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:39.742062 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05eff61f-9040-4a4e-801f-325f3fd19582 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 200 len: 352 microversion: 2.1 time: 0.163054 Jul 26 14:27:39.742969 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2129/4367] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:27:39 2022] GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 352 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:27:39.749523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b43a131c-a39a-40d6-b441-6535b30a9e72 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:39.750609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b43a131c-a39a-40d6-b441-6535b30a9e72 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:39.799014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b43a131c-a39a-40d6-b441-6535b30a9e72 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:39.801381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b43a131c-a39a-40d6-b441-6535b30a9e72 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:39.805308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b43a131c-a39a-40d6-b441-6535b30a9e72 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:39.806867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b43a131c-a39a-40d6-b441-6535b30a9e72 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:40.998931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9b654988-c6e5-427f-bd94-a2c36e2654ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:41.052852 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9b654988-c6e5-427f-bd94-a2c36e2654ff tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 2.355809 Jul 26 14:27:41.080124 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2239/4368] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:38 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:41.106485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c2c4f17-a9f0-4a55-b208-e46e725c7a90 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:41.107235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8c2c4f17-a9f0-4a55-b208-e46e725c7a90 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:41.133166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c2c4f17-a9f0-4a55-b208-e46e725c7a90 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:41.139568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c2c4f17-a9f0-4a55-b208-e46e725c7a90 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:41.144395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c2c4f17-a9f0-4a55-b208-e46e725c7a90 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:41.147467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c2c4f17-a9f0-4a55-b208-e46e725c7a90 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:41.843665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b43a131c-a39a-40d6-b441-6535b30a9e72 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:41.872978 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b43a131c-a39a-40d6-b441-6535b30a9e72 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1506 microversion: 2.1 time: 2.128115 Jul 26 14:27:41.883109 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2130/4369] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:39 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1506 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:41.924746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cbf1bc9e-4589-4708-92a6-bac6a50d12d9 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f8787074b80>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:42.079565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8c2c4f17-a9f0-4a55-b208-e46e725c7a90 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:42.097601 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cbf1bc9e-4589-4708-92a6-bac6a50d12d9 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 200 len: 352 microversion: 2.1 time: 0.211808 Jul 26 14:27:42.099896 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2131/4370] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:27:41 2022] GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 352 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:42.116841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44db938b-cd59-4ec6-a0be-34036b4e6dc8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:42.117370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44db938b-cd59-4ec6-a0be-34036b4e6dc8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:42.132954 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8c2c4f17-a9f0-4a55-b208-e46e725c7a90 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1315 microversion: 2.1 time: 1.047241 Jul 26 14:27:42.134116 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2240/4371] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:41 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1315 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:42.141303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44db938b-cd59-4ec6-a0be-34036b4e6dc8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:42.142165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44db938b-cd59-4ec6-a0be-34036b4e6dc8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:42.143404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44db938b-cd59-4ec6-a0be-34036b4e6dc8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:42.144125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44db938b-cd59-4ec6-a0be-34036b4e6dc8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:42.148661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f4fdcc4b-3190-445c-a238-2cdc19a239c8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:42.150431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f4fdcc4b-3190-445c-a238-2cdc19a239c8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:42.165276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4fdcc4b-3190-445c-a238-2cdc19a239c8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:42.171355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4fdcc4b-3190-445c-a238-2cdc19a239c8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:42.174340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4fdcc4b-3190-445c-a238-2cdc19a239c8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:42.176752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4fdcc4b-3190-445c-a238-2cdc19a239c8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:42.265048 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f4fdcc4b-3190-445c-a238-2cdc19a239c8 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8/ips" status: 200 len: 109 microversion: 2.1 time: 0.128035 Jul 26 14:27:42.306755 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2241/4372] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:27:42 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8/ips => generated 109 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:42.318551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c2c7cc13-1585-48a2-8fe4-cfed7aaa07b3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:42.335186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c2c7cc13-1585-48a2-8fe4-cfed7aaa07b3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:42.355060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2c7cc13-1585-48a2-8fe4-cfed7aaa07b3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:42.358921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2c7cc13-1585-48a2-8fe4-cfed7aaa07b3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:42.360856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2c7cc13-1585-48a2-8fe4-cfed7aaa07b3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:42.361579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2c7cc13-1585-48a2-8fe4-cfed7aaa07b3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:42.515607 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c2c7cc13-1585-48a2-8fe4-cfed7aaa07b3 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8/ips" status: 200 len: 109 microversion: 2.1 time: 0.198536 Jul 26 14:27:42.519173 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2242/4373] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:27:42 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8/ips => generated 109 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:42.545735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1de8ed4d-2cd2-4947-9f23-f3ecf4eb9004 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:42.550191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1de8ed4d-2cd2-4947-9f23-f3ecf4eb9004 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:42.587100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1de8ed4d-2cd2-4947-9f23-f3ecf4eb9004 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:42.588653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1de8ed4d-2cd2-4947-9f23-f3ecf4eb9004 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:42.594082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1de8ed4d-2cd2-4947-9f23-f3ecf4eb9004 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:42.595407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1de8ed4d-2cd2-4947-9f23-f3ecf4eb9004 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:42.673999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:42.713472 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1de8ed4d-2cd2-4947-9f23-f3ecf4eb9004 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8/ips/tempest-ServerAddressesTestJSON-1410543069-network" status: 200 len: 94 microversion: 2.1 time: 0.172395 Jul 26 14:27:42.714866 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2243/4374] 10.222.0.70 () {58 vars in 1401 bytes} [Tue Jul 26 14:27:42 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8/ips/tempest-ServerAddressesTestJSON-1410543069-network => generated 94 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:27:42.751663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71a047fe-38e0-4c34-a4af-7ec8d3bca980 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:42.769747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71a047fe-38e0-4c34-a4af-7ec8d3bca980 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:42.801330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71a047fe-38e0-4c34-a4af-7ec8d3bca980 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:42.811359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71a047fe-38e0-4c34-a4af-7ec8d3bca980 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:42.816159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-44db938b-cd59-4ec6-a0be-34036b4e6dc8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:42.831173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:42.845095 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-44db938b-cd59-4ec6-a0be-34036b4e6dc8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.740663 Jul 26 14:27:42.845918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71a047fe-38e0-4c34-a4af-7ec8d3bca980 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:42.846755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71a047fe-38e0-4c34-a4af-7ec8d3bca980 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:42.855568 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2132/4375] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:42 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:42.980541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71a047fe-38e0-4c34-a4af-7ec8d3bca980 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:27:43.128743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-99da1b0c-0d46-4c5a-bcb5-f4278eca9098 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f8799304670>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:43.375748 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71a047fe-38e0-4c34-a4af-7ec8d3bca980 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 204 len: 0 microversion: 2.1 time: 0.633510 Jul 26 14:27:43.384883 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2244/4376] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:27:42 2022] DELETE /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:27:43.426071 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-99da1b0c-0d46-4c5a-bcb5-f4278eca9098 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 200 len: 352 microversion: 2.1 time: 0.308595 Jul 26 14:27:43.447975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c0e9f5f6-f461-4abf-b3d0-28af542b211e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:43.450758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0e9f5f6-f461-4abf-b3d0-28af542b211e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:43.460069 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2133/4377] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:27:43 2022] GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 352 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:43.474975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0e9f5f6-f461-4abf-b3d0-28af542b211e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:43.476290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0e9f5f6-f461-4abf-b3d0-28af542b211e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:43.486124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0e9f5f6-f461-4abf-b3d0-28af542b211e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:43.487570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0e9f5f6-f461-4abf-b3d0-28af542b211e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:43.497302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-363741802", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "57ac168b-59fa-4a44-88ec-5fbc6a23582a"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:43.722230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] validate_networks() for [('57ac168b-59fa-4a44-88ec-5fbc6a23582a', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:27:44.346172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c0e9f5f6-f461-4abf-b3d0-28af542b211e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:44.403350 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c0e9f5f6-f461-4abf-b3d0-28af542b211e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1315 microversion: 2.1 time: 1.009282 Jul 26 14:27:44.411022 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2245/4378] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:43 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:44.454600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed2a7a3e-16f4-4b00-8e01-a975dd9ca11d tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:44.455776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ed2a7a3e-16f4-4b00-8e01-a975dd9ca11d tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:44.477052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed2a7a3e-16f4-4b00-8e01-a975dd9ca11d tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:44.480327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed2a7a3e-16f4-4b00-8e01-a975dd9ca11d tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:44.481443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed2a7a3e-16f4-4b00-8e01-a975dd9ca11d tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:44.485838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed2a7a3e-16f4-4b00-8e01-a975dd9ca11d tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:45.117633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ed2a7a3e-16f4-4b00-8e01-a975dd9ca11d tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:45.130369 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed2a7a3e-16f4-4b00-8e01-a975dd9ca11d tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1512 microversion: 2.1 time: 0.715663 Jul 26 14:27:45.131446 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2246/4379] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:44 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1512 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:45.144239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-37d8943c-8d90-477a-a98e-7a07479298e7 req-655a27ae-40a0-4be0-9efd-e6bf25767e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f8b4b8-decd-45a0-952a-53fe17d72837", "name": "network-vif-plugged", "status": "completed", "tag": "5538da85-762b-4901-a38e-0e4e55843ebe"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:45.160863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-37d8943c-8d90-477a-a98e-7a07479298e7 req-655a27ae-40a0-4be0-9efd-e6bf25767e87 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:45.173056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-37d8943c-8d90-477a-a98e-7a07479298e7 req-655a27ae-40a0-4be0-9efd-e6bf25767e87 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:45.195634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-37d8943c-8d90-477a-a98e-7a07479298e7 req-655a27ae-40a0-4be0-9efd-e6bf25767e87 service nova] Creating event network-vif-plugged:5538da85-762b-4901-a38e-0e4e55843ebe for instance 24f8b4b8-decd-45a0-952a-53fe17d72837 on n-h2-833090-9 Jul 26 14:27:45.207341 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-37d8943c-8d90-477a-a98e-7a07479298e7 req-655a27ae-40a0-4be0-9efd-e6bf25767e87 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074218 Jul 26 14:27:45.208699 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2247/4380] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:45.226936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5411e664-4d04-4ba6-87ba-609ae40473e7 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f878705b9d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:45.382054 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5411e664-4d04-4ba6-87ba-609ae40473e7 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 200 len: 352 microversion: 2.1 time: 0.171765 Jul 26 14:27:45.382818 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2248/4381] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:27:45 2022] GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 352 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:45.468497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1da42e1c-aa07-4cc9-a128-81ec54147fc2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:45.472457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1da42e1c-aa07-4cc9-a128-81ec54147fc2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:45.517272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:27:45.518488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:27:45.519026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:27:45.519448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:27:45.520027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:27:45.524110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1da42e1c-aa07-4cc9-a128-81ec54147fc2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:45.527802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1da42e1c-aa07-4cc9-a128-81ec54147fc2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:45.540511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1da42e1c-aa07-4cc9-a128-81ec54147fc2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:45.542215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1da42e1c-aa07-4cc9-a128-81ec54147fc2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:45.550236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:45.559526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:45.562062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:45.581083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:45.687984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for project 991c7f82c09446409408ca9d0638fcba. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:27:45.715631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Getting quotas for user 7b5b7e30e280492b85d9c8f98fe09e43 and project 991c7f82c09446409408ca9d0638fcba. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:27:45.770654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:27:45.773472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:27:45.903443 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fed7d696-057e-4162-bdab-1ec65dbdaa53 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.441651 Jul 26 14:27:45.904218 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2134/4382] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:27:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:27:45.933071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d00b58c-2c4c-4c8f-80fb-5af07b100dcb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:45.937133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7d00b58c-2c4c-4c8f-80fb-5af07b100dcb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:46.456215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d00b58c-2c4c-4c8f-80fb-5af07b100dcb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:46.467397 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7d00b58c-2c4c-4c8f-80fb-5af07b100dcb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1214 microversion: 2.1 time: 0.537400 Jul 26 14:27:46.487545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2135/4383] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:45 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1214 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:46.494464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-130dacce-2481-495a-bf42-3ebdff29ed25 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:46.534063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-130dacce-2481-495a-bf42-3ebdff29ed25 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:46.597067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-130dacce-2481-495a-bf42-3ebdff29ed25 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:46.597534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-130dacce-2481-495a-bf42-3ebdff29ed25 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:46.607063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-130dacce-2481-495a-bf42-3ebdff29ed25 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:46.608169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-130dacce-2481-495a-bf42-3ebdff29ed25 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:46.798865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1da42e1c-aa07-4cc9-a128-81ec54147fc2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:46.814678 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1da42e1c-aa07-4cc9-a128-81ec54147fc2 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1315 microversion: 2.1 time: 1.355129 Jul 26 14:27:46.822934 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2249/4384] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:45 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1315 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:46.830634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8bddfc87-d41b-471e-866e-4f2b6e41e959 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f8799272ca0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:46.935120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-130dacce-2481-495a-bf42-3ebdff29ed25 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:46.951535 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-130dacce-2481-495a-bf42-3ebdff29ed25 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1512 microversion: 2.1 time: 0.462429 Jul 26 14:27:46.952469 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2136/4385] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:46 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1512 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:47.058547 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8bddfc87-d41b-471e-866e-4f2b6e41e959 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 200 len: 352 microversion: 2.1 time: 0.233510 Jul 26 14:27:47.060038 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2250/4386] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:27:46 2022] GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 352 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:47.513135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9f71892b-ca49-4727-b8d2-c3626ed6a08e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:47.514288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9f71892b-ca49-4727-b8d2-c3626ed6a08e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:47.539206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f71892b-ca49-4727-b8d2-c3626ed6a08e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:47.568188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f71892b-ca49-4727-b8d2-c3626ed6a08e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:47.569408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f71892b-ca49-4727-b8d2-c3626ed6a08e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:47.586023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f71892b-ca49-4727-b8d2-c3626ed6a08e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:47.856586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-568019e6-1646-42c2-931c-f7b4ad1f1492 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:47.857228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-568019e6-1646-42c2-931c-f7b4ad1f1492 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:47.907739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-568019e6-1646-42c2-931c-f7b4ad1f1492 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:47.908240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-568019e6-1646-42c2-931c-f7b4ad1f1492 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:47.909055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-568019e6-1646-42c2-931c-f7b4ad1f1492 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:47.909507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-568019e6-1646-42c2-931c-f7b4ad1f1492 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:47.988263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9f71892b-ca49-4727-b8d2-c3626ed6a08e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:48.034160 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9f71892b-ca49-4727-b8d2-c3626ed6a08e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1210 microversion: 2.1 time: 0.519484 Jul 26 14:27:48.038097 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2137/4387] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:47 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1210 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:27:48.057018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2a36dba2-ad60-4f7b-ab7a-6fc9d9e0d2db req-fc0ba5f3-ec9f-421d-883b-5ecc3e09a8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1477ddb-37c0-4904-8c5c-446f8bcab3b8", "name": "network-vif-deleted", "tag": "b9f5122b-e0ef-47c5-bc27-373c2f848f66"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:48.089952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2a36dba2-ad60-4f7b-ab7a-6fc9d9e0d2db req-fc0ba5f3-ec9f-421d-883b-5ecc3e09a8cf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:48.090399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2a36dba2-ad60-4f7b-ab7a-6fc9d9e0d2db req-fc0ba5f3-ec9f-421d-883b-5ecc3e09a8cf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:48.182194 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2a36dba2-ad60-4f7b-ab7a-6fc9d9e0d2db req-fc0ba5f3-ec9f-421d-883b-5ecc3e09a8cf service nova] Creating event network-vif-deleted:b9f5122b-e0ef-47c5-bc27-373c2f848f66 for instance b1477ddb-37c0-4904-8c5c-446f8bcab3b8 on n-h2-833090-9 Jul 26 14:27:48.212020 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2a36dba2-ad60-4f7b-ab7a-6fc9d9e0d2db req-fc0ba5f3-ec9f-421d-883b-5ecc3e09a8cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171481 Jul 26 14:27:48.216062 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2138/4388] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:48.232442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:48.237366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:48.254894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:48.256992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:48.260206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:48.261683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:48.455891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:48.457063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:48.461238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lazy-loading 'fault' on Instance uuid b1477ddb-37c0-4904-8c5c-446f8bcab3b8 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:27:48.608497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-568019e6-1646-42c2-931c-f7b4ad1f1492 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:48.645482 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-568019e6-1646-42c2-931c-f7b4ad1f1492 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1315 microversion: 2.1 time: 0.795265 Jul 26 14:27:48.646569 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2251/4389] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:47 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1315 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:27:48.699073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5dd79480-7582-49e0-b198-23157a3aa490 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Calling method '.version_select at 0x7f87993aa160>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:48.809938 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-5dd79480-7582-49e0-b198-23157a3aa490 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] HTTP exception thrown: Volume 1342b801-6b20-444b-a895-b37d5bc07de4 could not be found. Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5dd79480-7582-49e0-b198-23157a3aa490 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Request method failure captured: Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 HTTP/1.1 Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_nT6I0NH3BN3xKK5RnotMrkcai0pDX6-5KBd17D2fX9HO_7fP6WW2McJ7p7T47q2wltUtwtHFbZ6UP7tUqL7yGMxLQa7YiUrVeSZnDJh-DzJzWWs3Z0ACl4R6q4hYceWLtpmTPwj1YJ0np01JwPw1ISkLRB-m383PhT_OnEZt3ZLNM Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: d50ae3fc12c545ad93ae89f288767ec1 Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesGetTestJSON-985550870 Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d50ae3fc12c545ad93ae89f288767ec1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d50ae3fc12c545ad93ae89f288767ec1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d50ae3fc12c545ad93ae89f288767ec1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d50ae3fc12c545ad93ae89f288767ec1"}]}] Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesGetTestJSON-985550870 Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: d50ae3fc12c545ad93ae89f288767ec1 Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesGetTestJSON-985550870 Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesGetTestJSON-985550870-project Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 77982b3b166e4b4fb2708ac5ef029068 Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesGetTestJSON-985550870-project Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: exception: Volume 1342b801-6b20-444b-a895-b37d5bc07de4 could not be found. Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '1342b801-6b20-444b-a895-b37d5bc07de4'} Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1342b801-6b20-444b-a895-b37d5bc07de4 could not be found. (HTTP 404) (Request-ID: req-5974fb3d-a2b2-44b4-be1c-8fdb9ade4ced) Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:27:48.817302 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1342b801-6b20-444b-a895-b37d5bc07de4 could not be found. Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1342b801-6b20-444b-a895-b37d5bc07de4 could not be found. Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1342b801-6b20-444b-a895-b37d5bc07de4 could not be found. Jul 26 14:27:48.821452 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:48.823877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0415e0fa4fa4e5fa761708ec79a1465', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b83b6c173d478fa636d4b21811e736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:48.824347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5dd79480-7582-49e0-b198-23157a3aa490 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] Returning 404 to user: Volume 1342b801-6b20-444b-a895-b37d5bc07de4 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:27:48.824347 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5dd79480-7582-49e0-b198-23157a3aa490 tempest-VolumesGetTestJSON-985550870 tempest-VolumesGetTestJSON-985550870-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4" status: 404 len: 109 microversion: 2.1 time: 0.148544 Jul 26 14:27:48.824347 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2252/4390] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Jul 26 14:27:48 2022] GET /compute/v2.1/os-volumes/1342b801-6b20-444b-a895-b37d5bc07de4 => generated 109 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:27:48.837360 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cfe116c0-8154-4813-9b3b-812b30b41a96 tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 200 len: 1307 microversion: 2.1 time: 0.617729 Jul 26 14:27:48.850499 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2139/4391] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:48 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 1307 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:49.074102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c4a4c083-f65b-47a3-be14-c0cbc2c6412d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:49.075062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c4a4c083-f65b-47a3-be14-c0cbc2c6412d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:49.101949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4a4c083-f65b-47a3-be14-c0cbc2c6412d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:49.106361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4a4c083-f65b-47a3-be14-c0cbc2c6412d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:49.111814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4a4c083-f65b-47a3-be14-c0cbc2c6412d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:49.119012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c4a4c083-f65b-47a3-be14-c0cbc2c6412d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:49.677278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-06a1f7a1-d18e-484e-be4e-7f3ce240ed5a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:49.677911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-06a1f7a1-d18e-484e-be4e-7f3ce240ed5a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:49.697456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06a1f7a1-d18e-484e-be4e-7f3ce240ed5a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:49.699185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06a1f7a1-d18e-484e-be4e-7f3ce240ed5a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:49.700040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06a1f7a1-d18e-484e-be4e-7f3ce240ed5a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:49.700566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06a1f7a1-d18e-484e-be4e-7f3ce240ed5a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:50.396924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c4a4c083-f65b-47a3-be14-c0cbc2c6412d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:50.416571 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c4a4c083-f65b-47a3-be14-c0cbc2c6412d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1272 microversion: 2.1 time: 1.355384 Jul 26 14:27:50.419408 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2253/4392] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:49 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1272 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:50.446773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f59d4558-c44c-4097-9dda-e273294fe5df tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:50.452442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f59d4558-c44c-4097-9dda-e273294fe5df tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] [instance: b1477ddb-37c0-4904-8c5c-446f8bcab3b8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:50.466688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:50.491834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f59d4558-c44c-4097-9dda-e273294fe5df tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:50.492343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f59d4558-c44c-4097-9dda-e273294fe5df tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:50.504763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f59d4558-c44c-4097-9dda-e273294fe5df tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:50.509734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f59d4558-c44c-4097-9dda-e273294fe5df tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:50.597429 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-f59d4558-c44c-4097-9dda-e273294fe5df tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] HTTP exception thrown: Instance b1477ddb-37c0-4904-8c5c-446f8bcab3b8 could not be found. Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f59d4558-c44c-4097-9dda-e273294fe5df tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Request method failure captured: Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 HTTP/1.1 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_myqdWJAUfN8Rkoo8aXKtaUVOed_n3Uz0ffZG0bAutR8cEDgtOU6RndVltLjfEe5G_mvZnCD1xqADZ_AwTQ13D9sBZcBdKYsHjptW0HKaiPRUmzOgixp3Dr1_HnQ2vpTzzDsGlrh51pinDFayV2IT2yisQIwCsr8ox-_eSnDDEOKR4 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 55b83b6c173d478fa636d4b21811e736 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerAddressesTestJSON-790258675 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/55b83b6c173d478fa636d4b21811e736"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/55b83b6c173d478fa636d4b21811e736"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_55b83b6c173d478fa636d4b21811e736", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/55b83b6c173d478fa636d4b21811e736"}]}] Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerAddressesTestJSON-790258675 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 55b83b6c173d478fa636d4b21811e736 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerAddressesTestJSON-790258675 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerAddressesTestJSON-790258675-project Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: f0415e0fa4fa4e5fa761708ec79a1465 Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerAddressesTestJSON-790258675-project Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance b1477ddb-37c0-4904-8c5c-446f8bcab3b8 could not be found. Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'b1477ddb-37c0-4904-8c5c-446f8bcab3b8'} Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1477ddb-37c0-4904-8c5c-446f8bcab3b8 could not be found. Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1477ddb-37c0-4904-8c5c-446f8bcab3b8 could not be found. Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:27:50.620327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:50.628187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:50.628187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:27:50.628187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:27:50.628187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:27:50.628187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:27:50.628187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1477ddb-37c0-4904-8c5c-446f8bcab3b8 could not be found. Jul 26 14:27:50.628187 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:27:50.628187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f59d4558-c44c-4097-9dda-e273294fe5df tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] Returning 404 to user: Instance b1477ddb-37c0-4904-8c5c-446f8bcab3b8 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:27:50.628187 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f59d4558-c44c-4097-9dda-e273294fe5df tempest-ServerAddressesTestJSON-790258675 tempest-ServerAddressesTestJSON-790258675-project] 10.222.0.70 "GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8" status: 404 len: 111 microversion: 2.1 time: 0.201162 Jul 26 14:27:50.628187 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2254/4393] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:50 2022] GET /compute/v2.1/servers/b1477ddb-37c0-4904-8c5c-446f8bcab3b8 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:27:50.767455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-06a1f7a1-d18e-484e-be4e-7f3ce240ed5a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:50.782455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-06a1f7a1-d18e-484e-be4e-7f3ce240ed5a tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1502 microversion: 2.1 time: 1.109671 Jul 26 14:27:50.783295 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2140/4394] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:49 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1502 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:50.808739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d971e600-ce61-4a7b-878a-37e7964ca2fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:50.810128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d971e600-ce61-4a7b-878a-37e7964ca2fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:50.826398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d971e600-ce61-4a7b-878a-37e7964ca2fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:50.831980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d971e600-ce61-4a7b-878a-37e7964ca2fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:50.835740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d971e600-ce61-4a7b-878a-37e7964ca2fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:50.840229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d971e600-ce61-4a7b-878a-37e7964ca2fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:50.909663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-d971e600-ce61-4a7b-878a-37e7964ca2fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lazy-loading 'flavor' on Instance uuid 24f8b4b8-decd-45a0-952a-53fe17d72837 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:27:51.087117 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d971e600-ce61-4a7b-878a-37e7964ca2fc tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "POST /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837/action" status: 202 len: 0 microversion: 2.1 time: 0.282326 Jul 26 14:27:51.092533 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2255/4395] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:27:50 2022] POST /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:27:51.101798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7408dc1b-52cb-4638-8997-f4fcbc6fb18e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:51.102698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7408dc1b-52cb-4638-8997-f4fcbc6fb18e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:51.119617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7408dc1b-52cb-4638-8997-f4fcbc6fb18e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:51.120405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7408dc1b-52cb-4638-8997-f4fcbc6fb18e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:51.122057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7408dc1b-52cb-4638-8997-f4fcbc6fb18e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:51.123818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7408dc1b-52cb-4638-8997-f4fcbc6fb18e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:51.444249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76ca3179-e948-4613-8741-8442ee64967b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:51.445957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-76ca3179-e948-4613-8741-8442ee64967b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:51.471836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76ca3179-e948-4613-8741-8442ee64967b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:51.472841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76ca3179-e948-4613-8741-8442ee64967b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:51.473681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76ca3179-e948-4613-8741-8442ee64967b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:51.477874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76ca3179-e948-4613-8741-8442ee64967b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:52.000374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-76ca3179-e948-4613-8741-8442ee64967b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:52.014435 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76ca3179-e948-4613-8741-8442ee64967b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1272 microversion: 2.1 time: 0.575294 Jul 26 14:27:52.015690 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2256/4396] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:51 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1272 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:27:52.131920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7408dc1b-52cb-4638-8997-f4fcbc6fb18e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:52.149375 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7408dc1b-52cb-4638-8997-f4fcbc6fb18e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1510 microversion: 2.1 time: 1.052612 Jul 26 14:27:52.152477 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2141/4397] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:51 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1510 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:53.052536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1c2be5f8-cd00-4af6-beb7-11360d580a23 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:53.053211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1c2be5f8-cd00-4af6-beb7-11360d580a23 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:53.078798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c2be5f8-cd00-4af6-beb7-11360d580a23 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:53.082926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c2be5f8-cd00-4af6-beb7-11360d580a23 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:53.085069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c2be5f8-cd00-4af6-beb7-11360d580a23 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:53.101880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1c2be5f8-cd00-4af6-beb7-11360d580a23 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:53.172769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-39c40afd-77e7-4d1f-9027-bcbb86e99731 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:53.174114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-39c40afd-77e7-4d1f-9027-bcbb86e99731 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:53.198832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39c40afd-77e7-4d1f-9027-bcbb86e99731 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:53.200233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39c40afd-77e7-4d1f-9027-bcbb86e99731 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:53.203052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39c40afd-77e7-4d1f-9027-bcbb86e99731 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:53.207866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39c40afd-77e7-4d1f-9027-bcbb86e99731 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:53.727108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1c2be5f8-cd00-4af6-beb7-11360d580a23 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:53.739761 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1c2be5f8-cd00-4af6-beb7-11360d580a23 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1314 microversion: 2.1 time: 0.692525 Jul 26 14:27:53.745863 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2257/4398] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:53 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:53.895286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-39c40afd-77e7-4d1f-9027-bcbb86e99731 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:53.908767 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-39c40afd-77e7-4d1f-9027-bcbb86e99731 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1493 microversion: 2.1 time: 0.740873 Jul 26 14:27:53.925144 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2142/4399] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:53 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1493 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:27:53.934459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08155c39-de78-43d9-8eda-4de4c7edd2b3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:53.934973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08155c39-de78-43d9-8eda-4de4c7edd2b3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:53.950872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08155c39-de78-43d9-8eda-4de4c7edd2b3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:53.964248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08155c39-de78-43d9-8eda-4de4c7edd2b3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:53.965389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08155c39-de78-43d9-8eda-4de4c7edd2b3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:53.966000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08155c39-de78-43d9-8eda-4de4c7edd2b3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:54.033932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08155c39-de78-43d9-8eda-4de4c7edd2b3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:27:54.314794 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08155c39-de78-43d9-8eda-4de4c7edd2b3 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 204 len: 0 microversion: 2.1 time: 0.375843 Jul 26 14:27:54.317944 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2258/4400] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:27:53 2022] DELETE /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:27:54.330589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-891eeadc-aeb5-46d6-a3bf-e788d7ac1975 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:54.333703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-891eeadc-aeb5-46d6-a3bf-e788d7ac1975 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:54.357808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-891eeadc-aeb5-46d6-a3bf-e788d7ac1975 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:54.358811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-891eeadc-aeb5-46d6-a3bf-e788d7ac1975 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:54.362371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-891eeadc-aeb5-46d6-a3bf-e788d7ac1975 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:54.363247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-891eeadc-aeb5-46d6-a3bf-e788d7ac1975 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:54.781053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-02911c91-4c91-4c76-b956-b37a9b337105 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:54.782837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-02911c91-4c91-4c76-b956-b37a9b337105 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:54.830237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02911c91-4c91-4c76-b956-b37a9b337105 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:54.837115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02911c91-4c91-4c76-b956-b37a9b337105 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:54.860806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02911c91-4c91-4c76-b956-b37a9b337105 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:54.862500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02911c91-4c91-4c76-b956-b37a9b337105 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:55.258592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-891eeadc-aeb5-46d6-a3bf-e788d7ac1975 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:55.278410 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-891eeadc-aeb5-46d6-a3bf-e788d7ac1975 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1499 microversion: 2.1 time: 0.954828 Jul 26 14:27:55.287408 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2143/4401] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:54 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1499 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:55.355386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-02911c91-4c91-4c76-b956-b37a9b337105 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:55.363673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:55.370423 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-02911c91-4c91-4c76-b956-b37a9b337105 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1314 microversion: 2.1 time: 0.602729 Jul 26 14:27:55.373069 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2259/4402] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:54 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:55.956659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2bd2febe-d52a-45ec-bb88-05d7f1f6dc2b req-493e597e-6bd8-4733-ace1-7cc2ffdeb8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c9375c-6932-4d7e-b1a5-66c3a4e0dc08", "tag": "193321b3-40cd-45d6-a26e-50d30a86d727"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:55.974755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:55.980260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2bd2febe-d52a-45ec-bb88-05d7f1f6dc2b req-493e597e-6bd8-4733-ace1-7cc2ffdeb8e1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:55.981866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2bd2febe-d52a-45ec-bb88-05d7f1f6dc2b req-493e597e-6bd8-4733-ace1-7cc2ffdeb8e1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:56.016856 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2bd2febe-d52a-45ec-bb88-05d7f1f6dc2b req-493e597e-6bd8-4733-ace1-7cc2ffdeb8e1 service nova] Creating event network-changed:193321b3-40cd-45d6-a26e-50d30a86d727 for instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 on n-h1-833090-9 Jul 26 14:27:56.023685 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2bd2febe-d52a-45ec-bb88-05d7f1f6dc2b req-493e597e-6bd8-4733-ace1-7cc2ffdeb8e1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076805 Jul 26 14:27:56.026660 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2144/4403] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:56.309535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-686eb509-5035-4883-99bb-20d19e5fcdba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:56.310435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-686eb509-5035-4883-99bb-20d19e5fcdba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:56.339984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-686eb509-5035-4883-99bb-20d19e5fcdba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:56.344195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-686eb509-5035-4883-99bb-20d19e5fcdba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:56.345306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-686eb509-5035-4883-99bb-20d19e5fcdba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:56.345878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-686eb509-5035-4883-99bb-20d19e5fcdba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:56.397874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1880a2ff-e1ea-4b61-bcd9-52478d11fbb1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:56.398761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1880a2ff-e1ea-4b61-bcd9-52478d11fbb1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:56.436273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1880a2ff-e1ea-4b61-bcd9-52478d11fbb1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:56.439754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1880a2ff-e1ea-4b61-bcd9-52478d11fbb1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:56.442487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1880a2ff-e1ea-4b61-bcd9-52478d11fbb1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:56.452759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1880a2ff-e1ea-4b61-bcd9-52478d11fbb1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:56.485633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:27:58.749456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-686eb509-5035-4883-99bb-20d19e5fcdba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e46ed350fa42669bba323ef30b982d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a498bf67548bf9212814bdc38d0af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:58.759675 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-686eb509-5035-4883-99bb-20d19e5fcdba tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 200 len: 1499 microversion: 2.1 time: 2.454345 Jul 26 14:27:58.760398 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2260/4404] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:56 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 1499 bytes in 2456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:58.795284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6441a502-df05-41bc-a7c6-606f9ad018b1 req-a59d1b5a-de87-4e49-a7e6-8dd13b4c3c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f8b4b8-decd-45a0-952a-53fe17d72837", "name": "network-vif-deleted", "tag": "5538da85-762b-4901-a38e-0e4e55843ebe"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:27:58.804694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1880a2ff-e1ea-4b61-bcd9-52478d11fbb1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:27:58.822360 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1880a2ff-e1ea-4b61-bcd9-52478d11fbb1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1314 microversion: 2.1 time: 2.429065 Jul 26 14:27:58.845746 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2145/4405] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:56 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1314 bytes in 2453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:27:58.852114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6441a502-df05-41bc-a7c6-606f9ad018b1 req-a59d1b5a-de87-4e49-a7e6-8dd13b4c3c17 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:58.855363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6441a502-df05-41bc-a7c6-606f9ad018b1 req-a59d1b5a-de87-4e49-a7e6-8dd13b4c3c17 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:58.893518 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6441a502-df05-41bc-a7c6-606f9ad018b1 req-a59d1b5a-de87-4e49-a7e6-8dd13b4c3c17 service nova] Creating event network-vif-deleted:5538da85-762b-4901-a38e-0e4e55843ebe for instance 24f8b4b8-decd-45a0-952a-53fe17d72837 on n-h2-833090-9 Jul 26 14:27:58.907362 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6441a502-df05-41bc-a7c6-606f9ad018b1 req-a59d1b5a-de87-4e49-a7e6-8dd13b4c3c17 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123173 Jul 26 14:27:58.914756 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2261/4406] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:27:59.786680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9e366580-fe90-4cac-a86e-8756dab1ad39 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:59.787308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9e366580-fe90-4cac-a86e-8756dab1ad39 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:59.809954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e366580-fe90-4cac-a86e-8756dab1ad39 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:59.810580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e366580-fe90-4cac-a86e-8756dab1ad39 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:59.811456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e366580-fe90-4cac-a86e-8756dab1ad39 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:59.811902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e366580-fe90-4cac-a86e-8756dab1ad39 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:59.847713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8e743249-657d-4972-97aa-0bef7ba9a81d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:59.848522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8e743249-657d-4972-97aa-0bef7ba9a81d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:59.861229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e743249-657d-4972-97aa-0bef7ba9a81d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:59.861229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e743249-657d-4972-97aa-0bef7ba9a81d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:59.861820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e743249-657d-4972-97aa-0bef7ba9a81d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:59.862264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e743249-657d-4972-97aa-0bef7ba9a81d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:59.877721 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-9e366580-fe90-4cac-a86e-8756dab1ad39 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9e366580-fe90-4cac-a86e-8756dab1ad39 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 HTTP/1.1 Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '24f8b4b8-decd-45a0-952a-53fe17d72837'} Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:27:59.879450 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:27:59.883463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:27:59.883463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:27:59.883463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:27:59.883463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:27:59.883463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:27:59.883463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:27:59.883463 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:27:59.883463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9e366580-fe90-4cac-a86e-8756dab1ad39 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:27:59.883463 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9e366580-fe90-4cac-a86e-8756dab1ad39 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 404 len: 111 microversion: 2.1 time: 0.098950 Jul 26 14:27:59.883463 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2146/4407] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:59 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:27:59.906222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae4df1ca-fb42-41c8-87e5-7c0c2bde6de5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:27:59.906649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ae4df1ca-fb42-41c8-87e5-7c0c2bde6de5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:27:59.934103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae4df1ca-fb42-41c8-87e5-7c0c2bde6de5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:59.934562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae4df1ca-fb42-41c8-87e5-7c0c2bde6de5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:27:59.936110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae4df1ca-fb42-41c8-87e5-7c0c2bde6de5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:27:59.936522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae4df1ca-fb42-41c8-87e5-7c0c2bde6de5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.024786 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ae4df1ca-fb42-41c8-87e5-7c0c2bde6de5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae4df1ca-fb42-41c8-87e5-7c0c2bde6de5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 HTTP/1.1 Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '24f8b4b8-decd-45a0-952a-53fe17d72837'} Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:00.026810 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae4df1ca-fb42-41c8-87e5-7c0c2bde6de5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ae4df1ca-fb42-41c8-87e5-7c0c2bde6de5 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 404 len: 111 microversion: 2.1 time: 0.136498 Jul 26 14:28:00.031977 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2147/4408] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:27:59 2022] DELETE /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:00.056972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7876e419-03b4-407a-b422-0e735ccd8686 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:00.057628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7876e419-03b4-407a-b422-0e735ccd8686 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 24f8b4b8-decd-45a0-952a-53fe17d72837] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:00.084830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7876e419-03b4-407a-b422-0e735ccd8686 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.085299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7876e419-03b4-407a-b422-0e735ccd8686 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.086111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7876e419-03b4-407a-b422-0e735ccd8686 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.086555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7876e419-03b4-407a-b422-0e735ccd8686 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.140552 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-7876e419-03b4-407a-b422-0e735ccd8686 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7876e419-03b4-407a-b422-0e735ccd8686 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 HTTP/1.1 Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '24f8b4b8-decd-45a0-952a-53fe17d72837'} Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.142433 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.147883 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.147883 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.147883 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.147883 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:00.147883 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:00.147883 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. Jul 26 14:28:00.147883 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.147883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7876e419-03b4-407a-b422-0e735ccd8686 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 24f8b4b8-decd-45a0-952a-53fe17d72837 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:00.147883 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7876e419-03b4-407a-b422-0e735ccd8686 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837" status: 404 len: 111 microversion: 2.1 time: 0.099801 Jul 26 14:28:00.147883 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2148/4409] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:00 2022] GET /compute/v2.1/servers/24f8b4b8-decd-45a0-952a-53fe17d72837 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:00.180301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb3b7d45-6b00-46bc-a78d-997253b9320d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:00.180818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bb3b7d45-6b00-46bc-a78d-997253b9320d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:00.202813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb3b7d45-6b00-46bc-a78d-997253b9320d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.203270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb3b7d45-6b00-46bc-a78d-997253b9320d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.205671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb3b7d45-6b00-46bc-a78d-997253b9320d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.206162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb3b7d45-6b00-46bc-a78d-997253b9320d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.242255 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-bb3b7d45-6b00-46bc-a78d-997253b9320d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb3b7d45-6b00-46bc-a78d-997253b9320d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 HTTP/1.1 Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'a1200626-26aa-45b9-aad7-0474c6e8b500'} Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:00.243861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb3b7d45-6b00-46bc-a78d-997253b9320d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:00.248839 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bb3b7d45-6b00-46bc-a78d-997253b9320d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 404 len: 111 microversion: 2.1 time: 0.078429 Jul 26 14:28:00.256358 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2149/4410] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:28:00 2022] DELETE /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:00.273535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87777970-56c7-44b8-b018-8c7461802955 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:00.274299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-87777970-56c7-44b8-b018-8c7461802955 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: a1200626-26aa-45b9-aad7-0474c6e8b500] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:00.281490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87777970-56c7-44b8-b018-8c7461802955 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.281954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87777970-56c7-44b8-b018-8c7461802955 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.282879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87777970-56c7-44b8-b018-8c7461802955 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.283323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87777970-56c7-44b8-b018-8c7461802955 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.328220 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-87777970-56c7-44b8-b018-8c7461802955 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87777970-56c7-44b8-b018-8c7461802955 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 HTTP/1.1 Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'a1200626-26aa-45b9-aad7-0474c6e8b500'} Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.329818 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.333735 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.333735 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.333735 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.333735 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:00.333735 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:00.333735 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. Jul 26 14:28:00.333735 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.333735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87777970-56c7-44b8-b018-8c7461802955 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance a1200626-26aa-45b9-aad7-0474c6e8b500 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:00.333735 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-87777970-56c7-44b8-b018-8c7461802955 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500" status: 404 len: 111 microversion: 2.1 time: 0.073450 Jul 26 14:28:00.342717 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2150/4411] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:00 2022] GET /compute/v2.1/servers/a1200626-26aa-45b9-aad7-0474c6e8b500 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:00.359212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-841edadf-c1e5-4845-b8a0-cd649d8f09ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:00.361233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-841edadf-c1e5-4845-b8a0-cd649d8f09ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:00.382114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-841edadf-c1e5-4845-b8a0-cd649d8f09ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.382586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-841edadf-c1e5-4845-b8a0-cd649d8f09ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.386979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-841edadf-c1e5-4845-b8a0-cd649d8f09ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.387493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-841edadf-c1e5-4845-b8a0-cd649d8f09ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.432151 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-841edadf-c1e5-4845-b8a0-cd649d8f09ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-841edadf-c1e5-4845-b8a0-cd649d8f09ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 HTTP/1.1 Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '0a3e2faf-7a49-47df-886a-ef79f5fbe3b8'} Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:00.434063 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:28:00.439506 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.446040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-841edadf-c1e5-4845-b8a0-cd649d8f09ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:00.447195 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-841edadf-c1e5-4845-b8a0-cd649d8f09ea tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 404 len: 111 microversion: 2.1 time: 0.103225 Jul 26 14:28:00.449586 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2151/4412] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:28:00 2022] DELETE /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:28:00.460494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-42ce5f5e-f5e2-4546-ac3a-729bc0d09504 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:00.469428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-42ce5f5e-f5e2-4546-ac3a-729bc0d09504 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:00.488850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42ce5f5e-f5e2-4546-ac3a-729bc0d09504 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.489646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42ce5f5e-f5e2-4546-ac3a-729bc0d09504 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.491534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42ce5f5e-f5e2-4546-ac3a-729bc0d09504 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.492327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-42ce5f5e-f5e2-4546-ac3a-729bc0d09504 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.513907 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-42ce5f5e-f5e2-4546-ac3a-729bc0d09504 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-42ce5f5e-f5e2-4546-ac3a-729bc0d09504 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 HTTP/1.1 Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '0a3e2faf-7a49-47df-886a-ef79f5fbe3b8'} Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.517750 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.524997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.524997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.524997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.524997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:00.524997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:00.524997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. Jul 26 14:28:00.524997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.529516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-42ce5f5e-f5e2-4546-ac3a-729bc0d09504 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:00.530696 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-42ce5f5e-f5e2-4546-ac3a-729bc0d09504 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8" status: 404 len: 111 microversion: 2.1 time: 0.077263 Jul 26 14:28:00.532160 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2152/4413] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:00 2022] GET /compute/v2.1/servers/0a3e2faf-7a49-47df-886a-ef79f5fbe3b8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:00.556263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8f3f7b79-cb7c-4cec-bd78-6b8766d57d5b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:00.565620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8f3f7b79-cb7c-4cec-bd78-6b8766d57d5b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:00.578154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8e743249-657d-4972-97aa-0bef7ba9a81d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:00.584384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f3f7b79-cb7c-4cec-bd78-6b8766d57d5b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.585479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f3f7b79-cb7c-4cec-bd78-6b8766d57d5b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.587355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f3f7b79-cb7c-4cec-bd78-6b8766d57d5b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.589192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f3f7b79-cb7c-4cec-bd78-6b8766d57d5b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.594965 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8e743249-657d-4972-97aa-0bef7ba9a81d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1314 microversion: 2.1 time: 0.745662 Jul 26 14:28:00.595885 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2262/4414] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:27:59 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:00.640666 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8f3f7b79-cb7c-4cec-bd78-6b8766d57d5b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8f3f7b79-cb7c-4cec-bd78-6b8766d57d5b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 HTTP/1.1 Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '45fbc4fe-2ffa-4211-8d46-1d6b4102b429'} Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:00.642878 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:28:00.646415 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.648846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8f3f7b79-cb7c-4cec-bd78-6b8766d57d5b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:00.649901 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8f3f7b79-cb7c-4cec-bd78-6b8766d57d5b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 404 len: 111 microversion: 2.1 time: 0.109780 Jul 26 14:28:00.660656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dad899fc-6080-49b1-874d-3ea57df9bc6e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:00.661937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dad899fc-6080-49b1-874d-3ea57df9bc6e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 45fbc4fe-2ffa-4211-8d46-1d6b4102b429] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:00.670588 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2153/4415] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:28:00 2022] DELETE /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:00.673275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dad899fc-6080-49b1-874d-3ea57df9bc6e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.673982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dad899fc-6080-49b1-874d-3ea57df9bc6e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.677785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dad899fc-6080-49b1-874d-3ea57df9bc6e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:00.680202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dad899fc-6080-49b1-874d-3ea57df9bc6e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:00.719829 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-dad899fc-6080-49b1-874d-3ea57df9bc6e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dad899fc-6080-49b1-874d-3ea57df9bc6e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 HTTP/1.1 Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '45fbc4fe-2ffa-4211-8d46-1d6b4102b429'} Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.721806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.727065 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.727065 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.727065 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.727065 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:00.727065 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:00.727065 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. Jul 26 14:28:00.727065 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.728714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dad899fc-6080-49b1-874d-3ea57df9bc6e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 45fbc4fe-2ffa-4211-8d46-1d6b4102b429 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:00.729794 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dad899fc-6080-49b1-874d-3ea57df9bc6e tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429" status: 404 len: 111 microversion: 2.1 time: 0.073813 Jul 26 14:28:00.735790 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2263/4416] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:00 2022] GET /compute/v2.1/servers/45fbc4fe-2ffa-4211-8d46-1d6b4102b429 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:28:00.742467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e8510a0-680c-442d-a352-bf7d6ea0fb48 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:00.743213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e8510a0-680c-442d-a352-bf7d6ea0fb48 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: ea891fb6-6a01-4dd6-a433-49ec45d593ca] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:00.763517 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-2e8510a0-680c-442d-a352-bf7d6ea0fb48 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e8510a0-680c-442d-a352-bf7d6ea0fb48 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca HTTP/1.1 Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'ea891fb6-6a01-4dd6-a433-49ec45d593ca'} Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.768295 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.772031 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.772031 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.772031 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.772031 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:00.772031 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:00.772031 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:28:00.772031 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.772031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e8510a0-680c-442d-a352-bf7d6ea0fb48 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:00.775137 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e8510a0-680c-442d-a352-bf7d6ea0fb48 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca" status: 404 len: 111 microversion: 2.1 time: 0.037665 Jul 26 14:28:00.782328 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2154/4417] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:28:00 2022] DELETE /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:00.788733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c1c4b97d-7238-4700-8d83-865d59f76981 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:00.789374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c1c4b97d-7238-4700-8d83-865d59f76981 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: ea891fb6-6a01-4dd6-a433-49ec45d593ca] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:00.813566 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c1c4b97d-7238-4700-8d83-865d59f76981 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c1c4b97d-7238-4700-8d83-865d59f76981 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca HTTP/1.1 Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'ea891fb6-6a01-4dd6-a433-49ec45d593ca'} Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:00.828101 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:00.834508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:00.834508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:00.834508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:00.834508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. Jul 26 14:28:00.834508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:00.834508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c1c4b97d-7238-4700-8d83-865d59f76981 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance ea891fb6-6a01-4dd6-a433-49ec45d593ca could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:00.839072 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c1c4b97d-7238-4700-8d83-865d59f76981 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca" status: 404 len: 111 microversion: 2.1 time: 0.055500 Jul 26 14:28:00.870409 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2264/4418] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:00 2022] GET /compute/v2.1/servers/ea891fb6-6a01-4dd6-a433-49ec45d593ca => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:01.625013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e71008dc-ecf5-49ed-a512-a96091cf4c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:01.626527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e71008dc-ecf5-49ed-a512-a96091cf4c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:01.651927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e71008dc-ecf5-49ed-a512-a96091cf4c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:01.653746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e71008dc-ecf5-49ed-a512-a96091cf4c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:01.657375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e71008dc-ecf5-49ed-a512-a96091cf4c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:01.659274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e71008dc-ecf5-49ed-a512-a96091cf4c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:03.500464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e71008dc-ecf5-49ed-a512-a96091cf4c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:03.514888 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e71008dc-ecf5-49ed-a512-a96091cf4c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1314 microversion: 2.1 time: 1.895505 Jul 26 14:28:03.515488 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2155/4419] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:01 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1314 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:04.538143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0c7645a4-58cd-4123-8cb3-7709482c117f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:04.539449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0c7645a4-58cd-4123-8cb3-7709482c117f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:04.580608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c7645a4-58cd-4123-8cb3-7709482c117f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:04.581847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c7645a4-58cd-4123-8cb3-7709482c117f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:04.590587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c7645a4-58cd-4123-8cb3-7709482c117f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:04.591721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c7645a4-58cd-4123-8cb3-7709482c117f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:05.192792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4b9433bf-ed61-4a4f-87ea-9105a4bc444b req-f5f759d1-9005-4156-951d-473f5b727b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c9375c-6932-4d7e-b1a5-66c3a4e0dc08", "name": "network-vif-plugged", "status": "completed", "tag": "193321b3-40cd-45d6-a26e-50d30a86d727"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:28:05.225584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:05.254853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4b9433bf-ed61-4a4f-87ea-9105a4bc444b req-f5f759d1-9005-4156-951d-473f5b727b2c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:05.262263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4b9433bf-ed61-4a4f-87ea-9105a4bc444b req-f5f759d1-9005-4156-951d-473f5b727b2c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:05.285361 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4b9433bf-ed61-4a4f-87ea-9105a4bc444b req-f5f759d1-9005-4156-951d-473f5b727b2c service nova] Creating event network-vif-plugged:193321b3-40cd-45d6-a26e-50d30a86d727 for instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 on n-h1-833090-9 Jul 26 14:28:05.292171 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4b9433bf-ed61-4a4f-87ea-9105a4bc444b req-f5f759d1-9005-4156-951d-473f5b727b2c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107944 Jul 26 14:28:05.293363 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2156/4420] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:28:06.504533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0c7645a4-58cd-4123-8cb3-7709482c117f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:06.519210 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0c7645a4-58cd-4123-8cb3-7709482c117f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1314 microversion: 2.1 time: 1.984562 Jul 26 14:28:06.541677 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2265/4421] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:04 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1314 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:07.554829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5200d902-100c-491a-a460-95770a637a0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:07.555554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5200d902-100c-491a-a460-95770a637a0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:07.573866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5200d902-100c-491a-a460-95770a637a0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:07.578774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5200d902-100c-491a-a460-95770a637a0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:07.579708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5200d902-100c-491a-a460-95770a637a0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:07.581870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5200d902-100c-491a-a460-95770a637a0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.140998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-61146779-b671-4533-b13a-257b562c567d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:09.141583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-61146779-b671-4533-b13a-257b562c567d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:09.160625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61146779-b671-4533-b13a-257b562c567d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.162259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61146779-b671-4533-b13a-257b562c567d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.181457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61146779-b671-4533-b13a-257b562c567d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.182135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61146779-b671-4533-b13a-257b562c567d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.242296 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-61146779-b671-4533-b13a-257b562c567d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-61146779-b671-4533-b13a-257b562c567d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 HTTP/1.1 Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '35be98ed-040c-424a-ba1f-945630e1de71'} Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:09.249290 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:28:09.254428 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.261830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-61146779-b671-4533-b13a-257b562c567d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:09.266019 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-61146779-b671-4533-b13a-257b562c567d tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 404 len: 111 microversion: 2.1 time: 0.130299 Jul 26 14:28:09.271253 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2266/4422] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:28:09 2022] DELETE /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:09.304683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e534a616-81e8-43c0-be9f-74f1b843292b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:09.320000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e534a616-81e8-43c0-be9f-74f1b843292b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 35be98ed-040c-424a-ba1f-945630e1de71] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:09.344523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5200d902-100c-491a-a460-95770a637a0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:09.361644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e534a616-81e8-43c0-be9f-74f1b843292b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.365491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e534a616-81e8-43c0-be9f-74f1b843292b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.371216 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5200d902-100c-491a-a460-95770a637a0e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1501 microversion: 2.1 time: 1.819569 Jul 26 14:28:09.371718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e534a616-81e8-43c0-be9f-74f1b843292b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.388831 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2157/4423] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:07 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1501 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:09.414169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e534a616-81e8-43c0-be9f-74f1b843292b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.418338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a6935d3e-4a39-4bb6-bd6c-e39672b59420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:28:09.424691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a6935d3e-4a39-4bb6-bd6c-e39672b59420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:09.452269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6935d3e-4a39-4bb6-bd6c-e39672b59420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.459599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6935d3e-4a39-4bb6-bd6c-e39672b59420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.460770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6935d3e-4a39-4bb6-bd6c-e39672b59420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.466232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6935d3e-4a39-4bb6-bd6c-e39672b59420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.522852 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e534a616-81e8-43c0-be9f-74f1b843292b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e534a616-81e8-43c0-be9f-74f1b843292b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 HTTP/1.1 Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '35be98ed-040c-424a-ba1f-945630e1de71'} Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:09.532745 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.536430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.536430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:09.536430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:09.536430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:09.536430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:09.536430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. Jul 26 14:28:09.536430 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.548777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e534a616-81e8-43c0-be9f-74f1b843292b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 35be98ed-040c-424a-ba1f-945630e1de71 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:09.553274 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e534a616-81e8-43c0-be9f-74f1b843292b tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71" status: 404 len: 111 microversion: 2.1 time: 0.273775 Jul 26 14:28:09.560798 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2267/4424] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:09 2022] GET /compute/v2.1/servers/35be98ed-040c-424a-ba1f-945630e1de71 => generated 111 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:09.601108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73dc8199-8591-4027-a5a5-e3d7f0bc4ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:09.604150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-73dc8199-8591-4027-a5a5-e3d7f0bc4ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:09.624142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73dc8199-8591-4027-a5a5-e3d7f0bc4ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.627593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73dc8199-8591-4027-a5a5-e3d7f0bc4ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.631008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73dc8199-8591-4027-a5a5-e3d7f0bc4ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.634146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73dc8199-8591-4027-a5a5-e3d7f0bc4ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.655526 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a6935d3e-4a39-4bb6-bd6c-e39672b59420 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08/action" status: 202 len: 0 microversion: 2.1 time: 0.257531 Jul 26 14:28:09.668872 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2158/4425] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:28:09 2022] POST /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:28:09.672006 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-73dc8199-8591-4027-a5a5-e3d7f0bc4ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:28:09.686018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-03f1d189-c8d7-468a-8753-aad84823b03d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73dc8199-8591-4027-a5a5-e3d7f0bc4ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 HTTP/1.1 Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6'} Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:09.687178 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:28:09.691695 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.692662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-03f1d189-c8d7-468a-8753-aad84823b03d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:09.696348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73dc8199-8591-4027-a5a5-e3d7f0bc4ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:09.700598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03f1d189-c8d7-468a-8753-aad84823b03d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.701164 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-73dc8199-8591-4027-a5a5-e3d7f0bc4ca8 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 404 len: 111 microversion: 2.1 time: 0.129395 Jul 26 14:28:09.702151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03f1d189-c8d7-468a-8753-aad84823b03d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.702805 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2268/4426] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:28:09 2022] DELETE /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:09.706128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03f1d189-c8d7-468a-8753-aad84823b03d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.706128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03f1d189-c8d7-468a-8753-aad84823b03d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.723588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c7fdcfa-3d70-493c-b8be-111f00422614 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:09.726331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8c7fdcfa-3d70-493c-b8be-111f00422614 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] [instance: 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:09.748423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:09.750087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c7fdcfa-3d70-493c-b8be-111f00422614 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.752853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c7fdcfa-3d70-493c-b8be-111f00422614 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.754754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c7fdcfa-3d70-493c-b8be-111f00422614 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:09.757997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8c7fdcfa-3d70-493c-b8be-111f00422614 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:09.816062 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-8c7fdcfa-3d70-493c-b8be-111f00422614 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] HTTP exception thrown: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c7fdcfa-3d70-493c-b8be-111f00422614 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Request method failure captured: Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 HTTP/1.1 Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_hrdaj9uIAdktZrsgF7VfLs0oipJrOD_ucocD0P-yrbdFvWX21s6zidHQujOYTqgYaUmKt2cAjButaOPM1H3FXo4PsIHeijL6evw46eck1HJFFOzqlkoefjBttUAcu0mUx0Mfg3wEh5tC3ORexDNSkiLknj9wNe_pzX7mpv8pDovWs Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ca1a498bf67548bf9212814bdc38d0af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ca1a498bf67548bf9212814bdc38d0af", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ca1a498bf67548bf9212814bdc38d0af"}]}] Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: ca1a498bf67548bf9212814bdc38d0af Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-815977915 Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1e46ed350fa42669bba323ef30b982d Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-815977915-project Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6'} Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:28:09.820762 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.826155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:28:09.826155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:28:09.826155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:28:09.826155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:28:09.826155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:28:09.826155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. Jul 26 14:28:09.826155 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:28:09.826155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c7fdcfa-3d70-493c-b8be-111f00422614 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] Returning 404 to user: Instance 9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:28:09.828882 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8c7fdcfa-3d70-493c-b8be-111f00422614 tempest-DeleteServersTestJSON-815977915 tempest-DeleteServersTestJSON-815977915-project] 10.222.0.70 "GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6" status: 404 len: 111 microversion: 2.1 time: 0.118431 Jul 26 14:28:09.833063 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2269/4427] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:09 2022] GET /compute/v2.1/servers/9b1cbcdc-dfa4-486f-a92b-9f2b2f2f1ce6 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:28:10.521336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-03f1d189-c8d7-468a-8753-aad84823b03d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:10.569191 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-03f1d189-c8d7-468a-8753-aad84823b03d tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1506 microversion: 2.1 time: 0.895406 Jul 26 14:28:10.578716 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2159/4428] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:09 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1506 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:11.611849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9fa3cd5e-3b5b-45d8-a0d1-57da800c0c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:11.613073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9fa3cd5e-3b5b-45d8-a0d1-57da800c0c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:11.647911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fa3cd5e-3b5b-45d8-a0d1-57da800c0c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:11.651988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fa3cd5e-3b5b-45d8-a0d1-57da800c0c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:11.657535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fa3cd5e-3b5b-45d8-a0d1-57da800c0c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:11.661660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fa3cd5e-3b5b-45d8-a0d1-57da800c0c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:12.640306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9fa3cd5e-3b5b-45d8-a0d1-57da800c0c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:12.650547 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9fa3cd5e-3b5b-45d8-a0d1-57da800c0c4e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1486 microversion: 2.1 time: 1.048396 Jul 26 14:28:12.657049 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2270/4429] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:11 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1486 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:12.682025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3c541cb-29bf-466b-9fee-8c21fe047f08 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:28:12.683012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f3c541cb-29bf-466b-9fee-8c21fe047f08 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:12.705746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3c541cb-29bf-466b-9fee-8c21fe047f08 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:12.706546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3c541cb-29bf-466b-9fee-8c21fe047f08 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:12.712315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3c541cb-29bf-466b-9fee-8c21fe047f08 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:12.713304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3c541cb-29bf-466b-9fee-8c21fe047f08 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:12.796401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-f3c541cb-29bf-466b-9fee-8c21fe047f08 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lazy-loading 'flavor' on Instance uuid 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:28:13.332680 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f3c541cb-29bf-466b-9fee-8c21fe047f08 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08/action" status: 202 len: 0 microversion: 2.1 time: 0.654208 Jul 26 14:28:13.338925 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2160/4430] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:28:12 2022] POST /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08/action => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:28:13.344460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d97d2953-6b07-4932-9bc5-bcacff163f8a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:13.345184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d97d2953-6b07-4932-9bc5-bcacff163f8a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:13.364106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d97d2953-6b07-4932-9bc5-bcacff163f8a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:13.365912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d97d2953-6b07-4932-9bc5-bcacff163f8a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:13.368654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d97d2953-6b07-4932-9bc5-bcacff163f8a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:13.370232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d97d2953-6b07-4932-9bc5-bcacff163f8a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:14.637789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d97d2953-6b07-4932-9bc5-bcacff163f8a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:14.649463 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d97d2953-6b07-4932-9bc5-bcacff163f8a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1492 microversion: 2.1 time: 1.310166 Jul 26 14:28:14.657573 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2271/4431] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:13 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1492 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:15.689393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-944034d5-d627-4afa-b1ca-6053ba3b631e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:15.691353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-944034d5-d627-4afa-b1ca-6053ba3b631e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:15.729839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-944034d5-d627-4afa-b1ca-6053ba3b631e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:15.734253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-944034d5-d627-4afa-b1ca-6053ba3b631e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:15.735549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-944034d5-d627-4afa-b1ca-6053ba3b631e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:15.739786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-944034d5-d627-4afa-b1ca-6053ba3b631e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:17.103557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-944034d5-d627-4afa-b1ca-6053ba3b631e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:17.119170 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-944034d5-d627-4afa-b1ca-6053ba3b631e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1513 microversion: 2.1 time: 1.441560 Jul 26 14:28:17.119755 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2161/4432] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:15 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1513 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:18.144697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2c3c046c-7708-478b-8729-4b378b189695 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:18.145963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2c3c046c-7708-478b-8729-4b378b189695 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:18.166033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c3c046c-7708-478b-8729-4b378b189695 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:18.169364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c3c046c-7708-478b-8729-4b378b189695 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:18.174753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c3c046c-7708-478b-8729-4b378b189695 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:18.182938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c3c046c-7708-478b-8729-4b378b189695 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:19.385753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2c3c046c-7708-478b-8729-4b378b189695 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:19.398142 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2c3c046c-7708-478b-8729-4b378b189695 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 1.257832 Jul 26 14:28:19.415084 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2272/4433] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:18 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:28:20.444666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d7e850cf-b3b3-415c-b3a0-7a92491aab0a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:20.445367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d7e850cf-b3b3-415c-b3a0-7a92491aab0a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:20.458855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7e850cf-b3b3-415c-b3a0-7a92491aab0a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:20.459319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7e850cf-b3b3-415c-b3a0-7a92491aab0a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:20.471610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7e850cf-b3b3-415c-b3a0-7a92491aab0a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:20.477936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7e850cf-b3b3-415c-b3a0-7a92491aab0a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:20.708032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-138a7fd5-90e4-4295-9d7f-404584758820 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Action: 'create', calling method: .version_select at 0x7f8786ff98b0>, body: {"keypair": {"name": "tempest-keypair-1366299657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDJ9CEy/rbG9dsTgjygfW/XK2MWKpc+Ec2vw2CDWkAMCMd3rYPDcLUwpSWNTk3qEFPaWsQUTOsLmklLUECCKxpXtOWxMK9J3UYagGvOoYERNn8eGDTlPlLix4t5Nypc+w=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:28:20.789255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-138a7fd5-90e4-4295-9d7f-404584758820 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Getting quotas for project f396f632336642a4b37a3968761f944a. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:28:20.832982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-138a7fd5-90e4-4295-9d7f-404584758820 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Getting quotas for user 58cb60aa5eb8468b870a6d4d7fceea8a and project f396f632336642a4b37a3968761f944a. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:28:20.972411 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-138a7fd5-90e4-4295-9d7f-404584758820 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.013883 Jul 26 14:28:20.975447 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2162/4434] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:28:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:28:21.327548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d7e850cf-b3b3-415c-b3a0-7a92491aab0a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:21.355274 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d7e850cf-b3b3-415c-b3a0-7a92491aab0a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 0.929909 Jul 26 14:28:21.356401 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2273/4435] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:20 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:28:22.380309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b70dc4b7-6cae-4d4e-9ecc-205fb4e3d1bb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:22.380937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b70dc4b7-6cae-4d4e-9ecc-205fb4e3d1bb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:22.399672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b70dc4b7-6cae-4d4e-9ecc-205fb4e3d1bb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:22.404583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b70dc4b7-6cae-4d4e-9ecc-205fb4e3d1bb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:22.412351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b70dc4b7-6cae-4d4e-9ecc-205fb4e3d1bb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:22.412970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b70dc4b7-6cae-4d4e-9ecc-205fb4e3d1bb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:25.189970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b70dc4b7-6cae-4d4e-9ecc-205fb4e3d1bb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:25.198651 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b70dc4b7-6cae-4d4e-9ecc-205fb4e3d1bb tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 2.824692 Jul 26 14:28:25.202526 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2163/4436] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:22 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 2829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:25.202691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-98b7b25c-9124-4bba-bb41-eb73697e8022 req-41fed8d5-fa42-456d-9ab5-350d44ce3823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c9375c-6932-4d7e-b1a5-66c3a4e0dc08", "name": "network-vif-plugged", "status": "completed", "tag": "193321b3-40cd-45d6-a26e-50d30a86d727"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:28:25.231882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:25.234009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-98b7b25c-9124-4bba-bb41-eb73697e8022 req-41fed8d5-fa42-456d-9ab5-350d44ce3823 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:25.234474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-98b7b25c-9124-4bba-bb41-eb73697e8022 req-41fed8d5-fa42-456d-9ab5-350d44ce3823 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:25.283423 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-98b7b25c-9124-4bba-bb41-eb73697e8022 req-41fed8d5-fa42-456d-9ab5-350d44ce3823 service nova] Creating event network-vif-plugged:193321b3-40cd-45d6-a26e-50d30a86d727 for instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 on n-h1-833090-9 Jul 26 14:28:25.297729 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-98b7b25c-9124-4bba-bb41-eb73697e8022 req-41fed8d5-fa42-456d-9ab5-350d44ce3823 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100374 Jul 26 14:28:25.303387 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2274/4437] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:28:26.224997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02257d1b-ae8b-4c18-a549-6e1f415b361a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:26.226243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-02257d1b-ae8b-4c18-a549-6e1f415b361a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:26.257067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02257d1b-ae8b-4c18-a549-6e1f415b361a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:26.257593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02257d1b-ae8b-4c18-a549-6e1f415b361a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:26.265637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02257d1b-ae8b-4c18-a549-6e1f415b361a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:26.266106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02257d1b-ae8b-4c18-a549-6e1f415b361a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:28.727604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-02257d1b-ae8b-4c18-a549-6e1f415b361a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:28.742486 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-02257d1b-ae8b-4c18-a549-6e1f415b361a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 2.516673 Jul 26 14:28:28.746083 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2164/4438] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:26 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 2526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:29.773043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5e9ef1a9-b44c-46ec-a474-f85ceb6481dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:29.780349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5e9ef1a9-b44c-46ec-a474-f85ceb6481dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:29.846177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e9ef1a9-b44c-46ec-a474-f85ceb6481dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:29.846657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e9ef1a9-b44c-46ec-a474-f85ceb6481dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:29.862046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e9ef1a9-b44c-46ec-a474-f85ceb6481dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:29.862522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e9ef1a9-b44c-46ec-a474-f85ceb6481dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:29.922911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=58 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:31.005782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5e9ef1a9-b44c-46ec-a474-f85ceb6481dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:31.029067 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5e9ef1a9-b44c-46ec-a474-f85ceb6481dd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 1.264440 Jul 26 14:28:31.033895 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2275/4439] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:29 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:28:31.786084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:32.068742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e67a78f6-0f65-41d2-88e7-5de67c408405 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:32.069982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e67a78f6-0f65-41d2-88e7-5de67c408405 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:32.109491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e67a78f6-0f65-41d2-88e7-5de67c408405 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:32.118356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e67a78f6-0f65-41d2-88e7-5de67c408405 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:32.125870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e67a78f6-0f65-41d2-88e7-5de67c408405 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:32.129238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e67a78f6-0f65-41d2-88e7-5de67c408405 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:32.752938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2095296461", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "c9e870a3-10cb-44cd-96a3-85b91513249c"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:28:32.953855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] validate_networks() for [('c9e870a3-10cb-44cd-96a3-85b91513249c', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:28:33.216739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e67a78f6-0f65-41d2-88e7-5de67c408405 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:33.255362 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e67a78f6-0f65-41d2-88e7-5de67c408405 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 1.193135 Jul 26 14:28:33.264583 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2276/4440] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:32 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:33.693967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1562711314", "imageRef": "d505ee88-452f-4694-a7d0-35511944a69c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "32107d37-a3a5-4de5-8628-82253dea35e7"}], "security_groups": [{"name": "tempest-securitygroup--1878886544"}], "key_name": "tempest-keypair-1366299657", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:28:34.643649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] validate_networks() for [('32107d37-a3a5-4de5-8628-82253dea35e7', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:28:35.748257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:28:35.749327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:28:35.749976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:28:35.750553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:28:35.751134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:28:35.753634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:35.786842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:35.801269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:35.805100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:35.808750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:35.932463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Getting quotas for project d984b2614b6b41c4aca43d888a567313. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:28:35.977473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Getting quotas for user 139178c93bda48d597bc039169e560a3 and project d984b2614b6b41c4aca43d888a567313. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:28:36.060789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:28:36.067207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:28:36.279373 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-85ffff0f-bc9f-45c1-bd0f-f588bfd3a053 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.502003 Jul 26 14:28:36.288710 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2165/4441] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:28:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:28:36.307289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a5e2a63-b428-48d3-9241-9e3facb45e82 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:36.324222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4a5e2a63-b428-48d3-9241-9e3facb45e82 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:36.354729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a5e2a63-b428-48d3-9241-9e3facb45e82 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:36.368567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a5e2a63-b428-48d3-9241-9e3facb45e82 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:36.369808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a5e2a63-b428-48d3-9241-9e3facb45e82 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:36.370612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a5e2a63-b428-48d3-9241-9e3facb45e82 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:39.396141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4a5e2a63-b428-48d3-9241-9e3facb45e82 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:39.424534 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4a5e2a63-b428-48d3-9241-9e3facb45e82 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 3.122685 Jul 26 14:28:39.427041 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2166/4442] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:36 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 3133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:39.431029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-97f47a0f-fcf2-49f4-b052-39a268dcacc2 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:39.449262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-97f47a0f-fcf2-49f4-b052-39a268dcacc2 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:39.472596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97f47a0f-fcf2-49f4-b052-39a268dcacc2 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:39.475890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97f47a0f-fcf2-49f4-b052-39a268dcacc2 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:39.482431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97f47a0f-fcf2-49f4-b052-39a268dcacc2 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:39.483041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97f47a0f-fcf2-49f4-b052-39a268dcacc2 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:39.771706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:28:39.772562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:28:39.773229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:28:39.774012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:28:39.775034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:28:39.829769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-97f47a0f-fcf2-49f4-b052-39a268dcacc2 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:39.875213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:39.879692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:39.881039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:39.888385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:39.893449 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-97f47a0f-fcf2-49f4-b052-39a268dcacc2 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1277 microversion: 2.1 time: 0.462914 Jul 26 14:28:39.896337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:39.897463 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2167/4443] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:39 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1277 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:39.973234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Getting quotas for project f396f632336642a4b37a3968761f944a. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:28:39.986518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Getting quotas for user 58cb60aa5eb8468b870a6d4d7fceea8a and project f396f632336642a4b37a3968761f944a. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:28:40.031770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:28:40.042191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d505ee88-452f-4694-a7d0-35511944a69c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:28:40.200639 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dae143b0-9473-43ff-bfe4-9edde15449b8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 6.506802 Jul 26 14:28:40.205665 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2277/4444] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:28:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 6517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:28:40.220253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86e11c7e-cf6b-4139-bb1a-2cf4d2e8b781 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:40.220253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-86e11c7e-cf6b-4139-bb1a-2cf4d2e8b781 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:40.459600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-909e911c-1be4-4366-a975-e432e162a1f3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:40.460618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-909e911c-1be4-4366-a975-e432e162a1f3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:40.479939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-909e911c-1be4-4366-a975-e432e162a1f3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:40.484103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-909e911c-1be4-4366-a975-e432e162a1f3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:40.489284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-909e911c-1be4-4366-a975-e432e162a1f3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:40.502050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-909e911c-1be4-4366-a975-e432e162a1f3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:40.717446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-86e11c7e-cf6b-4139-bb1a-2cf4d2e8b781 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:40.733944 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-86e11c7e-cf6b-4139-bb1a-2cf4d2e8b781 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1246 microversion: 2.1 time: 0.514550 Jul 26 14:28:40.737972 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2168/4445] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:40 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1246 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:40.927214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d739c2ec-0f1d-4121-aa35-f05edc3fa001 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:40.928246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d739c2ec-0f1d-4121-aa35-f05edc3fa001 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:40.956943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d739c2ec-0f1d-4121-aa35-f05edc3fa001 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:40.957729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d739c2ec-0f1d-4121-aa35-f05edc3fa001 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:40.961744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d739c2ec-0f1d-4121-aa35-f05edc3fa001 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:40.962651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d739c2ec-0f1d-4121-aa35-f05edc3fa001 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:41.550080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d739c2ec-0f1d-4121-aa35-f05edc3fa001 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:41.561002 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d739c2ec-0f1d-4121-aa35-f05edc3fa001 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1283 microversion: 2.1 time: 0.637869 Jul 26 14:28:41.566762 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2169/4446] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:40 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1283 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:41.755575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-51e15efb-c4b1-4595-a42d-506a987ce6ab tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:41.756350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-51e15efb-c4b1-4595-a42d-506a987ce6ab tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:41.770406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51e15efb-c4b1-4595-a42d-506a987ce6ab tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:41.770915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51e15efb-c4b1-4595-a42d-506a987ce6ab tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:41.773067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51e15efb-c4b1-4595-a42d-506a987ce6ab tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:41.778412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51e15efb-c4b1-4595-a42d-506a987ce6ab tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:42.155377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-51e15efb-c4b1-4595-a42d-506a987ce6ab tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:42.172462 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-51e15efb-c4b1-4595-a42d-506a987ce6ab tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1250 microversion: 2.1 time: 0.414766 Jul 26 14:28:42.176416 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2170/4447] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:41 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1250 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:28:42.198370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-909e911c-1be4-4366-a975-e432e162a1f3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:42.209336 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-909e911c-1be4-4366-a975-e432e162a1f3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 1.754235 Jul 26 14:28:42.216407 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2278/4448] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:40 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:28:42.594357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cd163840-d7a2-47ac-8c07-b2ab22c564d1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:42.595098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cd163840-d7a2-47ac-8c07-b2ab22c564d1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:42.623596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd163840-d7a2-47ac-8c07-b2ab22c564d1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:42.627989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd163840-d7a2-47ac-8c07-b2ab22c564d1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:42.631163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd163840-d7a2-47ac-8c07-b2ab22c564d1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:42.634143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd163840-d7a2-47ac-8c07-b2ab22c564d1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:43.194862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23e627fd-07b2-47b0-97da-7b304c86f00e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:43.195492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-23e627fd-07b2-47b0-97da-7b304c86f00e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:43.221467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23e627fd-07b2-47b0-97da-7b304c86f00e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:43.222208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23e627fd-07b2-47b0-97da-7b304c86f00e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:43.238159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23e627fd-07b2-47b0-97da-7b304c86f00e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:43.239226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23e627fd-07b2-47b0-97da-7b304c86f00e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:43.368785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cd163840-d7a2-47ac-8c07-b2ab22c564d1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:43.392775 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cd163840-d7a2-47ac-8c07-b2ab22c564d1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1283 microversion: 2.1 time: 0.804374 Jul 26 14:28:43.406584 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2171/4449] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:42 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1283 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:43.412897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-91cc28b9-1d34-47f5-919f-512cc9f07aac tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:43.413466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-91cc28b9-1d34-47f5-919f-512cc9f07aac tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:43.434172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91cc28b9-1d34-47f5-919f-512cc9f07aac tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:43.444138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91cc28b9-1d34-47f5-919f-512cc9f07aac tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:43.445399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91cc28b9-1d34-47f5-919f-512cc9f07aac tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:43.450661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91cc28b9-1d34-47f5-919f-512cc9f07aac tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:43.679348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23e627fd-07b2-47b0-97da-7b304c86f00e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:43.691418 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23e627fd-07b2-47b0-97da-7b304c86f00e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1316 microversion: 2.1 time: 0.500211 Jul 26 14:28:43.695497 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2279/4450] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:43 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:44.422047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63cea649-19e8-4d2d-9891-638de861f2c1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:44.423879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63cea649-19e8-4d2d-9891-638de861f2c1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:44.450302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63cea649-19e8-4d2d-9891-638de861f2c1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:44.452578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63cea649-19e8-4d2d-9891-638de861f2c1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:44.453458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63cea649-19e8-4d2d-9891-638de861f2c1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:44.453926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63cea649-19e8-4d2d-9891-638de861f2c1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:44.841283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-91cc28b9-1d34-47f5-919f-512cc9f07aac tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:44.855456 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-91cc28b9-1d34-47f5-919f-512cc9f07aac tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 1.456561 Jul 26 14:28:44.864696 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2172/4451] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:43 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:44.870716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5290fe94-a845-4879-98bb-6302a6659a30 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:44.888156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5290fe94-a845-4879-98bb-6302a6659a30 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:44.903745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5290fe94-a845-4879-98bb-6302a6659a30 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:44.904515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5290fe94-a845-4879-98bb-6302a6659a30 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:44.909303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5290fe94-a845-4879-98bb-6302a6659a30 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:44.912473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5290fe94-a845-4879-98bb-6302a6659a30 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:45.166813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63cea649-19e8-4d2d-9891-638de861f2c1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:45.176940 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63cea649-19e8-4d2d-9891-638de861f2c1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1283 microversion: 2.1 time: 0.760230 Jul 26 14:28:45.177547 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2280/4452] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:44 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1283 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:28:45.363024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5290fe94-a845-4879-98bb-6302a6659a30 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:45.401730 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5290fe94-a845-4879-98bb-6302a6659a30 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1304 microversion: 2.1 time: 0.533077 Jul 26 14:28:45.404031 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2173/4453] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:44 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1304 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:45.897223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a5b6904-cd6d-4c6d-8fc7-b15f919e0335 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:45.915122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1a5b6904-cd6d-4c6d-8fc7-b15f919e0335 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:45.934895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a5b6904-cd6d-4c6d-8fc7-b15f919e0335 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:45.936162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a5b6904-cd6d-4c6d-8fc7-b15f919e0335 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:45.937022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a5b6904-cd6d-4c6d-8fc7-b15f919e0335 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:45.937790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a5b6904-cd6d-4c6d-8fc7-b15f919e0335 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:46.200795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b9c73b41-d711-4920-b1ac-d163cb70d674 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:46.201584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b9c73b41-d711-4920-b1ac-d163cb70d674 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:46.206472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:46.228066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9c73b41-d711-4920-b1ac-d163cb70d674 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:46.233851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9c73b41-d711-4920-b1ac-d163cb70d674 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:46.236058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9c73b41-d711-4920-b1ac-d163cb70d674 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:46.236537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9c73b41-d711-4920-b1ac-d163cb70d674 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:47.638453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1a5b6904-cd6d-4c6d-8fc7-b15f919e0335 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:47.698283 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1a5b6904-cd6d-4c6d-8fc7-b15f919e0335 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 1.805462 Jul 26 14:28:47.703357 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2281/4454] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:45 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:47.723564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db52b2fe-dc8b-4caa-828d-048cb17b9cc6 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:47.727147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-db52b2fe-dc8b-4caa-828d-048cb17b9cc6 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:47.763818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db52b2fe-dc8b-4caa-828d-048cb17b9cc6 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:47.764909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db52b2fe-dc8b-4caa-828d-048cb17b9cc6 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:47.767596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db52b2fe-dc8b-4caa-828d-048cb17b9cc6 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:47.772469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db52b2fe-dc8b-4caa-828d-048cb17b9cc6 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:48.261918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b9c73b41-d711-4920-b1ac-d163cb70d674 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:48.278842 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b9c73b41-d711-4920-b1ac-d163cb70d674 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 2.078122 Jul 26 14:28:48.293538 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2174/4455] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:46 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:48.293795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-db52b2fe-dc8b-4caa-828d-048cb17b9cc6 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:48.313985 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db52b2fe-dc8b-4caa-828d-048cb17b9cc6 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1304 microversion: 2.1 time: 0.607554 Jul 26 14:28:48.314572 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2282/4456] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:47 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1304 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:48.729337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-94bdb905-2b23-4a42-afa7-c476fe8b38fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:48.730788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-94bdb905-2b23-4a42-afa7-c476fe8b38fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:48.748707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94bdb905-2b23-4a42-afa7-c476fe8b38fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:48.751455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94bdb905-2b23-4a42-afa7-c476fe8b38fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:48.752534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94bdb905-2b23-4a42-afa7-c476fe8b38fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:48.756280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94bdb905-2b23-4a42-afa7-c476fe8b38fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:49.309218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-35e778cb-24e2-49b9-86d3-620c81480a9c tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:49.316151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-35e778cb-24e2-49b9-86d3-620c81480a9c tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:49.397398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35e778cb-24e2-49b9-86d3-620c81480a9c tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:49.406049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35e778cb-24e2-49b9-86d3-620c81480a9c tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:49.415493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35e778cb-24e2-49b9-86d3-620c81480a9c tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:49.420669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35e778cb-24e2-49b9-86d3-620c81480a9c tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:49.930345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:50.011597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:50.722838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:28:53.049319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-94bdb905-2b23-4a42-afa7-c476fe8b38fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:53.100872 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-94bdb905-2b23-4a42-afa7-c476fe8b38fe tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 4.375306 Jul 26 14:28:53.146113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35e778cb-24e2-49b9-86d3-620c81480a9c tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:53.155561 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2175/4457] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:48 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 4431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:53.217836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5e142b30-a041-4949-a055-be776eded1e7 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:53.219342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5e142b30-a041-4949-a055-be776eded1e7 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:53.220285 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-35e778cb-24e2-49b9-86d3-620c81480a9c tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 3.905077 Jul 26 14:28:53.254872 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2283/4458] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:49 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 3956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:53.278337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e142b30-a041-4949-a055-be776eded1e7 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:53.283778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e142b30-a041-4949-a055-be776eded1e7 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:53.287435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e142b30-a041-4949-a055-be776eded1e7 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:53.288448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e142b30-a041-4949-a055-be776eded1e7 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:54.149879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85d7d421-511a-494a-ac21-6f76151afc2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:54.150422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85d7d421-511a-494a-ac21-6f76151afc2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:54.163643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d7d421-511a-494a-ac21-6f76151afc2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:54.168740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d7d421-511a-494a-ac21-6f76151afc2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:54.170733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d7d421-511a-494a-ac21-6f76151afc2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:54.171639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d7d421-511a-494a-ac21-6f76151afc2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:54.907652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5e142b30-a041-4949-a055-be776eded1e7 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:54.922700 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5e142b30-a041-4949-a055-be776eded1e7 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 1.765004 Jul 26 14:28:54.926222 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2176/4459] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:53 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:54.939290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8126d544-2a1a-40de-8f5b-eb3ef2b280ff tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:54.943009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8126d544-2a1a-40de-8f5b-eb3ef2b280ff tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:54.955255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8126d544-2a1a-40de-8f5b-eb3ef2b280ff tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:54.960039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8126d544-2a1a-40de-8f5b-eb3ef2b280ff tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:54.964118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8126d544-2a1a-40de-8f5b-eb3ef2b280ff tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:54.965054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8126d544-2a1a-40de-8f5b-eb3ef2b280ff tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:57.295819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8126d544-2a1a-40de-8f5b-eb3ef2b280ff tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:57.315247 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8126d544-2a1a-40de-8f5b-eb3ef2b280ff tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 2.387516 Jul 26 14:28:57.334492 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2177/4460] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:54 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 2407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:28:57.349816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ab1ea0ca-7436-45f6-8e29-d0e031059476 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:57.352170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ab1ea0ca-7436-45f6-8e29-d0e031059476 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:57.418047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab1ea0ca-7436-45f6-8e29-d0e031059476 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:57.421698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab1ea0ca-7436-45f6-8e29-d0e031059476 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:57.423725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab1ea0ca-7436-45f6-8e29-d0e031059476 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:57.425411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab1ea0ca-7436-45f6-8e29-d0e031059476 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:57.916825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-85d7d421-511a-494a-ac21-6f76151afc2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:28:57.940573 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85d7d421-511a-494a-ac21-6f76151afc2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1508 microversion: 2.1 time: 3.790745 Jul 26 14:28:57.941975 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2284/4461] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:54 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1508 bytes in 3797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:28:58.270970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-48e8cb41-b730-4841-9132-b671b6718def req-56e10220-91b0-44d6-a18e-ef969f02ee8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4053013d-b86a-4625-a126-287cacda1428", "tag": "d926fa0b-37bb-4684-9986-f9ba027b0fd0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:28:58.340522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-48e8cb41-b730-4841-9132-b671b6718def req-56e10220-91b0-44d6-a18e-ef969f02ee8d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:58.342600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-48e8cb41-b730-4841-9132-b671b6718def req-56e10220-91b0-44d6-a18e-ef969f02ee8d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:58.403145 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-48e8cb41-b730-4841-9132-b671b6718def req-56e10220-91b0-44d6-a18e-ef969f02ee8d service nova] Creating event network-changed:d926fa0b-37bb-4684-9986-f9ba027b0fd0 for instance 4053013d-b86a-4625-a126-287cacda1428 on n-h2-833090-9 Jul 26 14:28:58.445936 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-48e8cb41-b730-4841-9132-b671b6718def req-56e10220-91b0-44d6-a18e-ef969f02ee8d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172411 Jul 26 14:28:58.457365 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2285/4462] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:28:58.482742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9bbe8a72-8231-407b-bb1a-25f699764487 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:28:58.485679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9bbe8a72-8231-407b-bb1a-25f699764487 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:28:58.514538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bbe8a72-8231-407b-bb1a-25f699764487 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:58.518133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bbe8a72-8231-407b-bb1a-25f699764487 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:28:58.520271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bbe8a72-8231-407b-bb1a-25f699764487 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:28:58.521971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bbe8a72-8231-407b-bb1a-25f699764487 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:00.365173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ab1ea0ca-7436-45f6-8e29-d0e031059476 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:00.422362 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ab1ea0ca-7436-45f6-8e29-d0e031059476 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 3.086105 Jul 26 14:29:00.441325 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2178/4463] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:57 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 3106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:01.113901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-0bb036a1-ef59-4b4a-939b-bf5fc969e6ac req-949ec854-9c00-4858-853f-0036df952b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c9375c-6932-4d7e-b1a5-66c3a4e0dc08", "name": "network-vif-unplugged", "status": "completed", "tag": "193321b3-40cd-45d6-a26e-50d30a86d727"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:01.164980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0bb036a1-ef59-4b4a-939b-bf5fc969e6ac req-949ec854-9c00-4858-853f-0036df952b30 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:01.165834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0bb036a1-ef59-4b4a-939b-bf5fc969e6ac req-949ec854-9c00-4858-853f-0036df952b30 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:01.195599 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-0bb036a1-ef59-4b4a-939b-bf5fc969e6ac req-949ec854-9c00-4858-853f-0036df952b30 service nova] Creating event network-vif-unplugged:193321b3-40cd-45d6-a26e-50d30a86d727 for instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 on n-h1-833090-9 Jul 26 14:29:01.216487 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-0bb036a1-ef59-4b4a-939b-bf5fc969e6ac req-949ec854-9c00-4858-853f-0036df952b30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.744243 Jul 26 14:29:01.222030 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2179/4464] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:29:01.238784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-51af1080-e206-42f0-86ad-01995751bf91 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:01.239770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-51af1080-e206-42f0-86ad-01995751bf91 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:01.250969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51af1080-e206-42f0-86ad-01995751bf91 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:01.251788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51af1080-e206-42f0-86ad-01995751bf91 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:01.252916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51af1080-e206-42f0-86ad-01995751bf91 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:01.253524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51af1080-e206-42f0-86ad-01995751bf91 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:02.321085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9bbe8a72-8231-407b-bb1a-25f699764487 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:02.331031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=62 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:02.336919 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9bbe8a72-8231-407b-bb1a-25f699764487 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 3.877589 Jul 26 14:29:02.358184 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2286/4465] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:28:58 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 3900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:02.377668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3fc30b1-bc54-4a10-9a40-7444875a6825 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:02.379881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b3fc30b1-bc54-4a10-9a40-7444875a6825 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:02.391349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:02.394816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3fc30b1-bc54-4a10-9a40-7444875a6825 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:02.408319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3fc30b1-bc54-4a10-9a40-7444875a6825 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:02.408319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3fc30b1-bc54-4a10-9a40-7444875a6825 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:02.408319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3fc30b1-bc54-4a10-9a40-7444875a6825 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:04.084382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-51af1080-e206-42f0-86ad-01995751bf91 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:04.148766 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-51af1080-e206-42f0-86ad-01995751bf91 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1505 microversion: 2.1 time: 2.916941 Jul 26 14:29:04.169263 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2180/4466] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:01 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1505 bytes in 2938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:04.210624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-5954c81d-b3ac-406e-af0b-216fdfa69826 req-a0763b43-02e8-4a87-a47b-01dc411a3675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d85143-b08f-40ab-a08d-9278963e0602", "tag": "c3500c5b-4a04-40b8-8ae4-cbacbe8371af"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:04.282460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5954c81d-b3ac-406e-af0b-216fdfa69826 req-a0763b43-02e8-4a87-a47b-01dc411a3675 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:04.284143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5954c81d-b3ac-406e-af0b-216fdfa69826 req-a0763b43-02e8-4a87-a47b-01dc411a3675 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:04.366583 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-5954c81d-b3ac-406e-af0b-216fdfa69826 req-a0763b43-02e8-4a87-a47b-01dc411a3675 service nova] Creating event network-changed:c3500c5b-4a04-40b8-8ae4-cbacbe8371af for instance 56d85143-b08f-40ab-a08d-9278963e0602 on n-h2-833090-9 Jul 26 14:29:04.406283 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-5954c81d-b3ac-406e-af0b-216fdfa69826 req-a0763b43-02e8-4a87-a47b-01dc411a3675 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228078 Jul 26 14:29:04.413527 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2181/4467] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:29:04.455698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ebd7c40c-e999-40a8-b753-fb209a57b148 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:04.458959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ebd7c40c-e999-40a8-b753-fb209a57b148 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:04.505651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd7c40c-e999-40a8-b753-fb209a57b148 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:04.507087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd7c40c-e999-40a8-b753-fb209a57b148 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:04.512180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd7c40c-e999-40a8-b753-fb209a57b148 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:04.529029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd7c40c-e999-40a8-b753-fb209a57b148 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:04.843527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3fc30b1-bc54-4a10-9a40-7444875a6825 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:04.869505 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3fc30b1-bc54-4a10-9a40-7444875a6825 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 2.506529 Jul 26 14:29:04.897507 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2287/4468] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:02 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 2530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:05.193643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-49720e96-002f-4413-a785-522119371455 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:05.194832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-49720e96-002f-4413-a785-522119371455 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:05.208960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49720e96-002f-4413-a785-522119371455 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:05.209779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49720e96-002f-4413-a785-522119371455 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:05.211446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49720e96-002f-4413-a785-522119371455 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:05.214059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49720e96-002f-4413-a785-522119371455 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:05.631049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ebd7c40c-e999-40a8-b753-fb209a57b148 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:05.648628 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ebd7c40c-e999-40a8-b753-fb209a57b148 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 1.233221 Jul 26 14:29:05.653533 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2182/4469] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:04 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:05.904501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22f0edc6-c783-47dc-bc9f-02dc9c001496 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:05.905466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22f0edc6-c783-47dc-bc9f-02dc9c001496 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:05.910161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:05.950896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22f0edc6-c783-47dc-bc9f-02dc9c001496 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:05.963301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22f0edc6-c783-47dc-bc9f-02dc9c001496 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:05.969330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22f0edc6-c783-47dc-bc9f-02dc9c001496 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:05.970573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22f0edc6-c783-47dc-bc9f-02dc9c001496 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:06.481142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-49720e96-002f-4413-a785-522119371455 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:06.495671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-49720e96-002f-4413-a785-522119371455 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1505 microversion: 2.1 time: 1.301922 Jul 26 14:29:06.497457 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2288/4470] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:05 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1505 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:06.676854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6239f439-6a06-4bec-b24b-6950343ea62b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:06.678464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6239f439-6a06-4bec-b24b-6950343ea62b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:06.731000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6239f439-6a06-4bec-b24b-6950343ea62b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:06.734668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6239f439-6a06-4bec-b24b-6950343ea62b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:06.738950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6239f439-6a06-4bec-b24b-6950343ea62b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:06.740812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6239f439-6a06-4bec-b24b-6950343ea62b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:07.478079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22f0edc6-c783-47dc-bc9f-02dc9c001496 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:07.495662 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22f0edc6-c783-47dc-bc9f-02dc9c001496 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 1.596259 Jul 26 14:29:07.496746 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2183/4471] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:05 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:07.535516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-99425b04-1320-4def-8dbd-34d915658c2e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:07.536596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-99425b04-1320-4def-8dbd-34d915658c2e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:07.552328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99425b04-1320-4def-8dbd-34d915658c2e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:07.558641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99425b04-1320-4def-8dbd-34d915658c2e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:07.560022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99425b04-1320-4def-8dbd-34d915658c2e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:07.565022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99425b04-1320-4def-8dbd-34d915658c2e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:07.610019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6239f439-6a06-4bec-b24b-6950343ea62b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:07.622960 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6239f439-6a06-4bec-b24b-6950343ea62b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 0.951747 Jul 26 14:29:07.623568 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2289/4472] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:06 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:08.233743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-99425b04-1320-4def-8dbd-34d915658c2e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:08.250325 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-99425b04-1320-4def-8dbd-34d915658c2e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 200 len: 1448 microversion: 2.1 time: 0.728911 Jul 26 14:29:08.250953 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2184/4473] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:07 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 1448 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:08.277814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-17c20f8d-4974-4378-af84-5dfe8332da2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:08.278453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-17c20f8d-4974-4378-af84-5dfe8332da2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:08.298161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17c20f8d-4974-4378-af84-5dfe8332da2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:08.299149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17c20f8d-4974-4378-af84-5dfe8332da2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:08.300310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17c20f8d-4974-4378-af84-5dfe8332da2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:08.312828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17c20f8d-4974-4378-af84-5dfe8332da2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:08.520002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7434ba50-f57b-4f19-8ee4-cec21a66c7c8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:08.521309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7434ba50-f57b-4f19-8ee4-cec21a66c7c8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:08.534746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7434ba50-f57b-4f19-8ee4-cec21a66c7c8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:08.535407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7434ba50-f57b-4f19-8ee4-cec21a66c7c8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:08.536300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7434ba50-f57b-4f19-8ee4-cec21a66c7c8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:08.537995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7434ba50-f57b-4f19-8ee4-cec21a66c7c8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:09.502902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7434ba50-f57b-4f19-8ee4-cec21a66c7c8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:09.513467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-17c20f8d-4974-4378-af84-5dfe8332da2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:09.552567 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7434ba50-f57b-4f19-8ee4-cec21a66c7c8 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 1.030668 Jul 26 14:29:09.560060 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-17c20f8d-4974-4378-af84-5dfe8332da2c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.281960 Jul 26 14:29:09.560308 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2185/4474] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:08 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:29:09.560422 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2290/4475] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:08 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:09.576795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-54e555d3-e915-486b-a7f3-0f5477c2cf52 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:09.577754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-54e555d3-e915-486b-a7f3-0f5477c2cf52 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:09.597376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-22ac593d-2142-4e83-a569-3bc83ac87b40 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:09.598298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-22ac593d-2142-4e83-a569-3bc83ac87b40 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:09.610790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54e555d3-e915-486b-a7f3-0f5477c2cf52 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:09.620953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54e555d3-e915-486b-a7f3-0f5477c2cf52 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:09.623296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22ac593d-2142-4e83-a569-3bc83ac87b40 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:09.625545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54e555d3-e915-486b-a7f3-0f5477c2cf52 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:09.626794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22ac593d-2142-4e83-a569-3bc83ac87b40 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:09.627832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54e555d3-e915-486b-a7f3-0f5477c2cf52 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:09.631208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22ac593d-2142-4e83-a569-3bc83ac87b40 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:09.632980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22ac593d-2142-4e83-a569-3bc83ac87b40 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:11.160236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-22ac593d-2142-4e83-a569-3bc83ac87b40 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:11.170653 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-22ac593d-2142-4e83-a569-3bc83ac87b40 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.586239 Jul 26 14:29:11.177830 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2291/4476] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:09 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:11.192293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-84e3fb52-e1fd-4f21-b56a-e799997e53b5 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:11.196266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-84e3fb52-e1fd-4f21-b56a-e799997e53b5 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:11.239662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84e3fb52-e1fd-4f21-b56a-e799997e53b5 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:11.241449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84e3fb52-e1fd-4f21-b56a-e799997e53b5 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:11.242471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84e3fb52-e1fd-4f21-b56a-e799997e53b5 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:11.243195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84e3fb52-e1fd-4f21-b56a-e799997e53b5 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:11.451981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-54e555d3-e915-486b-a7f3-0f5477c2cf52 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:11.454299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:11.468563 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-54e555d3-e915-486b-a7f3-0f5477c2cf52 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 1.910942 Jul 26 14:29:11.469670 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2186/4477] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:09 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:11.479226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3bba4eb9-50d1-4bd1-9ccf-870c19ccf7e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:11.492927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3bba4eb9-50d1-4bd1-9ccf-870c19ccf7e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:11.500106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bba4eb9-50d1-4bd1-9ccf-870c19ccf7e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:11.500931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bba4eb9-50d1-4bd1-9ccf-870c19ccf7e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:11.502975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bba4eb9-50d1-4bd1-9ccf-870c19ccf7e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:11.503684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bba4eb9-50d1-4bd1-9ccf-870c19ccf7e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:12.004414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-84e3fb52-e1fd-4f21-b56a-e799997e53b5 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:12.026090 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-84e3fb52-e1fd-4f21-b56a-e799997e53b5 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 0.843278 Jul 26 14:29:12.033337 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2292/4478] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:11 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:12.327106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-249924066", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "1fd702ca-299c-4a2d-b7e0-ba3df462bd41"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:12.343643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3bba4eb9-50d1-4bd1-9ccf-870c19ccf7e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:12.399926 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3bba4eb9-50d1-4bd1-9ccf-870c19ccf7e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.926708 Jul 26 14:29:12.420732 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2187/4479] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:11 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:12.443701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d0d20945-ecba-43ed-80c2-4d8eb1fdf549 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:12.445104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d0d20945-ecba-43ed-80c2-4d8eb1fdf549 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:12.460901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] validate_networks() for [('1fd702ca-299c-4a2d-b7e0-ba3df462bd41', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:29:12.497385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0d20945-ecba-43ed-80c2-4d8eb1fdf549 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:12.497906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0d20945-ecba-43ed-80c2-4d8eb1fdf549 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:12.503215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0d20945-ecba-43ed-80c2-4d8eb1fdf549 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:12.503813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d0d20945-ecba-43ed-80c2-4d8eb1fdf549 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:13.247368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d0d20945-ecba-43ed-80c2-4d8eb1fdf549 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:13.262954 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d0d20945-ecba-43ed-80c2-4d8eb1fdf549 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.829064 Jul 26 14:29:13.269447 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2188/4480] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:12 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:13.280417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-01d3e563-cd3d-451a-9959-a9b13eccabb1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:13.282392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-01d3e563-cd3d-451a-9959-a9b13eccabb1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:13.306654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01d3e563-cd3d-451a-9959-a9b13eccabb1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:13.308142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01d3e563-cd3d-451a-9959-a9b13eccabb1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:13.309766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01d3e563-cd3d-451a-9959-a9b13eccabb1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:13.310421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01d3e563-cd3d-451a-9959-a9b13eccabb1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:13.922373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-01d3e563-cd3d-451a-9959-a9b13eccabb1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:13.940352 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-01d3e563-cd3d-451a-9959-a9b13eccabb1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 0.668361 Jul 26 14:29:13.942807 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2189/4481] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:13 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:13.966747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aa191df0-548b-4892-8312-9b0262d67ab3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:13.968346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aa191df0-548b-4892-8312-9b0262d67ab3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:13.976520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa191df0-548b-4892-8312-9b0262d67ab3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:13.979027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa191df0-548b-4892-8312-9b0262d67ab3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:13.980290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa191df0-548b-4892-8312-9b0262d67ab3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:13.980979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa191df0-548b-4892-8312-9b0262d67ab3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:14.506977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aa191df0-548b-4892-8312-9b0262d67ab3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:14.520650 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aa191df0-548b-4892-8312-9b0262d67ab3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 0.565692 Jul 26 14:29:14.521256 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2190/4482] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:13 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:14.534447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-98436bd9-6dc8-407b-b151-bb6de68fed33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:14.535182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:29:14.536544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:29:14.537299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:29:14.542284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:29:14.544926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:29:14.553010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-98436bd9-6dc8-407b-b151-bb6de68fed33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:14.553633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-98436bd9-6dc8-407b-b151-bb6de68fed33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:14.612318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:14.614066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:14.616673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:14.618505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:14.637066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-98436bd9-6dc8-407b-b151-bb6de68fed33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Going to try to stop instance {{(pid=119478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:29:14.657145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Getting quotas for project bc0ddfed511a4f71886dfcb9211ed6a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:29:14.677964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Getting quotas for user fbfff61dbe554bc09670a4674201a299 and project bc0ddfed511a4f71886dfcb9211ed6a9. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:29:14.715460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:29:14.718385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:29:14.790038 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-98436bd9-6dc8-407b-b151-bb6de68fed33 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.267514 Jul 26 14:29:14.793527 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2191/4483] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:29:14 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:29:14.794596 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-774fb312-7c1c-4fe2-9cc7-8867c76057ad tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.758538 Jul 26 14:29:14.803061 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2293/4484] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:29:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:29:14.805573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-610e420f-e2bc-4695-aa45-914d1347c4e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:14.808025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-610e420f-e2bc-4695-aa45-914d1347c4e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:14.827797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b01879b3-e946-4480-9335-328907291ccc tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:14.834288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b01879b3-e946-4480-9335-328907291ccc tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:14.841053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-610e420f-e2bc-4695-aa45-914d1347c4e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:14.841053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-610e420f-e2bc-4695-aa45-914d1347c4e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:14.843581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-610e420f-e2bc-4695-aa45-914d1347c4e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:14.846026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-610e420f-e2bc-4695-aa45-914d1347c4e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:15.021979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b01879b3-e946-4480-9335-328907291ccc tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:15.036053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b01879b3-e946-4480-9335-328907291ccc tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:15.038580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b01879b3-e946-4480-9335-328907291ccc tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:15.039922 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b01879b3-e946-4480-9335-328907291ccc tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1258 microversion: 2.21 time: 0.233572 Jul 26 14:29:15.044355 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2294/4485] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:14 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:15.058540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dc0dd6c0-cedf-4825-9827-f32e64bc01f1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:15.059050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dc0dd6c0-cedf-4825-9827-f32e64bc01f1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:15.073220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dc0dd6c0-cedf-4825-9827-f32e64bc01f1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:15.073684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dc0dd6c0-cedf-4825-9827-f32e64bc01f1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:15.080270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dc0dd6c0-cedf-4825-9827-f32e64bc01f1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:15.080805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dc0dd6c0-cedf-4825-9827-f32e64bc01f1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:15.383887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-610e420f-e2bc-4695-aa45-914d1347c4e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:15.403897 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-610e420f-e2bc-4695-aa45-914d1347c4e0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.601936 Jul 26 14:29:15.405509 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2192/4486] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:14 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:15.517056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dc0dd6c0-cedf-4825-9827-f32e64bc01f1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:15.537029 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dc0dd6c0-cedf-4825-9827-f32e64bc01f1 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 0.487799 Jul 26 14:29:15.551326 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2295/4487] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:15 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:15.559003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f8a276d0-1610-4749-a0e9-08a7a87581aa tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:15.559904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f8a276d0-1610-4749-a0e9-08a7a87581aa tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:15.568244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8a276d0-1610-4749-a0e9-08a7a87581aa tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:15.569337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8a276d0-1610-4749-a0e9-08a7a87581aa tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:15.570406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8a276d0-1610-4749-a0e9-08a7a87581aa tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:15.571080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8a276d0-1610-4749-a0e9-08a7a87581aa tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:15.740446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f8a276d0-1610-4749-a0e9-08a7a87581aa tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:15.750028 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f8a276d0-1610-4749-a0e9-08a7a87581aa tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 0.196382 Jul 26 14:29:15.752467 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2193/4488] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:15 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:16.077096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fea72d37-c8e4-403d-ae91-e140fb8a6575 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:16.077761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fea72d37-c8e4-403d-ae91-e140fb8a6575 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:16.085438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea72d37-c8e4-403d-ae91-e140fb8a6575 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:16.086110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea72d37-c8e4-403d-ae91-e140fb8a6575 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:16.087077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea72d37-c8e4-403d-ae91-e140fb8a6575 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:16.088879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fea72d37-c8e4-403d-ae91-e140fb8a6575 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:16.283728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fea72d37-c8e4-403d-ae91-e140fb8a6575 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:16.316081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fea72d37-c8e4-403d-ae91-e140fb8a6575 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:16.340753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fea72d37-c8e4-403d-ae91-e140fb8a6575 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:16.344165 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fea72d37-c8e4-403d-ae91-e140fb8a6575 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1262 microversion: 2.21 time: 0.276901 Jul 26 14:29:16.360868 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2296/4489] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:16 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1262 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:29:16.437846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0cba53a4-3cbb-4342-8213-39b03acdebae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:16.440075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0cba53a4-3cbb-4342-8213-39b03acdebae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:16.460780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cba53a4-3cbb-4342-8213-39b03acdebae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:16.463073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cba53a4-3cbb-4342-8213-39b03acdebae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:16.467703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cba53a4-3cbb-4342-8213-39b03acdebae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:16.468563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0cba53a4-3cbb-4342-8213-39b03acdebae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:16.563151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a58a6200-6432-4b6a-9e7f-73a9ea0e21c6 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:16.564419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a58a6200-6432-4b6a-9e7f-73a9ea0e21c6 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:16.586072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a58a6200-6432-4b6a-9e7f-73a9ea0e21c6 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:16.586849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a58a6200-6432-4b6a-9e7f-73a9ea0e21c6 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:16.590977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a58a6200-6432-4b6a-9e7f-73a9ea0e21c6 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:16.591549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a58a6200-6432-4b6a-9e7f-73a9ea0e21c6 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:16.791676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0cba53a4-3cbb-4342-8213-39b03acdebae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:16.803438 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0cba53a4-3cbb-4342-8213-39b03acdebae tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.377727 Jul 26 14:29:16.803822 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2194/4490] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:16 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:16.815595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cfc6dddf-6736-4bb4-886e-cc6c63b4b201 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:16.818494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cfc6dddf-6736-4bb4-886e-cc6c63b4b201 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:16.834663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfc6dddf-6736-4bb4-886e-cc6c63b4b201 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:16.835125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfc6dddf-6736-4bb4-886e-cc6c63b4b201 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:16.836813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfc6dddf-6736-4bb4-886e-cc6c63b4b201 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:16.841048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfc6dddf-6736-4bb4-886e-cc6c63b4b201 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:16.970435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a58a6200-6432-4b6a-9e7f-73a9ea0e21c6 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:16.990673 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a58a6200-6432-4b6a-9e7f-73a9ea0e21c6 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 0.434752 Jul 26 14:29:16.991614 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2297/4491] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:16 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:17.383429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c92bcb18-62be-4fa8-99ae-f1cbb9cd0b7e tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:17.384272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c92bcb18-62be-4fa8-99ae-f1cbb9cd0b7e tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:17.404222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c92bcb18-62be-4fa8-99ae-f1cbb9cd0b7e tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:17.404673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c92bcb18-62be-4fa8-99ae-f1cbb9cd0b7e tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:17.410260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c92bcb18-62be-4fa8-99ae-f1cbb9cd0b7e tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:17.413660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c92bcb18-62be-4fa8-99ae-f1cbb9cd0b7e tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:17.650983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cfc6dddf-6736-4bb4-886e-cc6c63b4b201 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:17.667892 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cfc6dddf-6736-4bb4-886e-cc6c63b4b201 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 0.853997 Jul 26 14:29:17.669221 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2195/4492] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:16 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:17.738393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c92bcb18-62be-4fa8-99ae-f1cbb9cd0b7e tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:17.754574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c92bcb18-62be-4fa8-99ae-f1cbb9cd0b7e tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:17.759585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c92bcb18-62be-4fa8-99ae-f1cbb9cd0b7e tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:17.762116 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c92bcb18-62be-4fa8-99ae-f1cbb9cd0b7e tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1316 microversion: 2.21 time: 0.388580 Jul 26 14:29:17.768689 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2298/4493] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:17 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:17.836350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-07feaaec-6c02-43a7-b99c-2b0ab3148053 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:17.838240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-07feaaec-6c02-43a7-b99c-2b0ab3148053 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:17.867811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07feaaec-6c02-43a7-b99c-2b0ab3148053 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:17.869846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07feaaec-6c02-43a7-b99c-2b0ab3148053 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:17.871449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07feaaec-6c02-43a7-b99c-2b0ab3148053 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:17.872307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07feaaec-6c02-43a7-b99c-2b0ab3148053 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:18.013950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a6b17307-cc40-4935-a604-09ab1de7d03b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:18.014583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a6b17307-cc40-4935-a604-09ab1de7d03b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:18.035269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6b17307-cc40-4935-a604-09ab1de7d03b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:18.036747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6b17307-cc40-4935-a604-09ab1de7d03b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:18.037709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6b17307-cc40-4935-a604-09ab1de7d03b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:18.038265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6b17307-cc40-4935-a604-09ab1de7d03b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:18.550145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-07feaaec-6c02-43a7-b99c-2b0ab3148053 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:18.574509 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-07feaaec-6c02-43a7-b99c-2b0ab3148053 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.752558 Jul 26 14:29:18.576071 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2196/4494] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:17 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:18.690535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c5b86c85-5d18-48df-99b5-75354c22e400 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:18.691915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c5b86c85-5d18-48df-99b5-75354c22e400 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:18.701402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5b86c85-5d18-48df-99b5-75354c22e400 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:18.705745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a6b17307-cc40-4935-a604-09ab1de7d03b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:18.715322 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a6b17307-cc40-4935-a604-09ab1de7d03b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 0.706500 Jul 26 14:29:18.719444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5b86c85-5d18-48df-99b5-75354c22e400 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:18.720613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5b86c85-5d18-48df-99b5-75354c22e400 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:18.733670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5b86c85-5d18-48df-99b5-75354c22e400 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:18.734235 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2299/4495] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:18 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:18.798482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-60ade37e-892b-4af7-be91-ee0cc096c9a9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:18.799839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-60ade37e-892b-4af7-be91-ee0cc096c9a9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:18.815038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ade37e-892b-4af7-be91-ee0cc096c9a9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:18.818014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ade37e-892b-4af7-be91-ee0cc096c9a9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:18.819086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ade37e-892b-4af7-be91-ee0cc096c9a9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:18.825258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-60ade37e-892b-4af7-be91-ee0cc096c9a9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:19.817658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-60ade37e-892b-4af7-be91-ee0cc096c9a9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:19.839635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-60ade37e-892b-4af7-be91-ee0cc096c9a9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:19.841300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-60ade37e-892b-4af7-be91-ee0cc096c9a9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:19.842482 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-60ade37e-892b-4af7-be91-ee0cc096c9a9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1316 microversion: 2.21 time: 1.048545 Jul 26 14:29:19.843054 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2300/4496] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:18 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1316 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:29:19.855284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6da93b46-2ebb-4664-a9b4-ae2095f63266 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:19.872843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6da93b46-2ebb-4664-a9b4-ae2095f63266 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:19.891731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6da93b46-2ebb-4664-a9b4-ae2095f63266 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:19.892523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6da93b46-2ebb-4664-a9b4-ae2095f63266 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:19.901835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6da93b46-2ebb-4664-a9b4-ae2095f63266 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:19.902573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6da93b46-2ebb-4664-a9b4-ae2095f63266 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:20.155119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c5b86c85-5d18-48df-99b5-75354c22e400 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:20.172590 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c5b86c85-5d18-48df-99b5-75354c22e400 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 1.485718 Jul 26 14:29:20.173508 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2197/4497] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:18 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:20.187989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d6a7adfd-18a5-4e66-a6f5-8ed630d65f2b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:20.193169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d6a7adfd-18a5-4e66-a6f5-8ed630d65f2b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:20.214524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6a7adfd-18a5-4e66-a6f5-8ed630d65f2b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:20.214989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6a7adfd-18a5-4e66-a6f5-8ed630d65f2b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:20.215810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6a7adfd-18a5-4e66-a6f5-8ed630d65f2b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:20.218986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6a7adfd-18a5-4e66-a6f5-8ed630d65f2b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:20.475361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6da93b46-2ebb-4664-a9b4-ae2095f63266 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:20.492343 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6da93b46-2ebb-4664-a9b4-ae2095f63266 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.641312 Jul 26 14:29:20.499610 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2301/4498] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:19 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:20.520662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-31ffef9e-bc95-4a31-998b-dc679d6d0ce6 req-e0e836b8-e370-4efd-abe7-e00d1eafc4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4053013d-b86a-4625-a126-287cacda1428", "name": "network-vif-plugged", "status": "completed", "tag": "d926fa0b-37bb-4684-9986-f9ba027b0fd0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:20.549849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-31ffef9e-bc95-4a31-998b-dc679d6d0ce6 req-e0e836b8-e370-4efd-abe7-e00d1eafc4f6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:20.550510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-31ffef9e-bc95-4a31-998b-dc679d6d0ce6 req-e0e836b8-e370-4efd-abe7-e00d1eafc4f6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:20.583345 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-31ffef9e-bc95-4a31-998b-dc679d6d0ce6 req-e0e836b8-e370-4efd-abe7-e00d1eafc4f6 service nova] Creating event network-vif-plugged:d926fa0b-37bb-4684-9986-f9ba027b0fd0 for instance 4053013d-b86a-4625-a126-287cacda1428 on n-h2-833090-9 Jul 26 14:29:20.598119 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-31ffef9e-bc95-4a31-998b-dc679d6d0ce6 req-e0e836b8-e370-4efd-abe7-e00d1eafc4f6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096702 Jul 26 14:29:20.599019 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2302/4499] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:29:20.879384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-370afd2d-2ba3-4cca-9042-49af85a8d081 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:20.881379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-370afd2d-2ba3-4cca-9042-49af85a8d081 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:20.904914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-370afd2d-2ba3-4cca-9042-49af85a8d081 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:20.917205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-370afd2d-2ba3-4cca-9042-49af85a8d081 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:20.917749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-370afd2d-2ba3-4cca-9042-49af85a8d081 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:20.918200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-370afd2d-2ba3-4cca-9042-49af85a8d081 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:21.054678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d6a7adfd-18a5-4e66-a6f5-8ed630d65f2b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:21.071043 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d6a7adfd-18a5-4e66-a6f5-8ed630d65f2b tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 0.896165 Jul 26 14:29:21.071631 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2198/4500] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:20 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:21.197907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ae993d7-a373-4ff0-b2c5-cbc9dc321181 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:21.200876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4ae993d7-a373-4ff0-b2c5-cbc9dc321181 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:21.220230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ae993d7-a373-4ff0-b2c5-cbc9dc321181 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:21.223175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ae993d7-a373-4ff0-b2c5-cbc9dc321181 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:21.229094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ae993d7-a373-4ff0-b2c5-cbc9dc321181 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:21.233453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ae993d7-a373-4ff0-b2c5-cbc9dc321181 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:21.961044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-370afd2d-2ba3-4cca-9042-49af85a8d081 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:21.990235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-370afd2d-2ba3-4cca-9042-49af85a8d081 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:21.992131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-370afd2d-2ba3-4cca-9042-49af85a8d081 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:21.994893 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-370afd2d-2ba3-4cca-9042-49af85a8d081 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1358 microversion: 2.21 time: 1.118220 Jul 26 14:29:21.995696 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2303/4501] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:20 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1358 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:29:22.002900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09e7913a-f493-4f23-a4ce-92df03b609f0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:22.003813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-09e7913a-f493-4f23-a4ce-92df03b609f0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:22.013958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09e7913a-f493-4f23-a4ce-92df03b609f0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:22.015157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09e7913a-f493-4f23-a4ce-92df03b609f0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:22.016556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09e7913a-f493-4f23-a4ce-92df03b609f0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:22.017181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09e7913a-f493-4f23-a4ce-92df03b609f0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:22.093908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ae993d7-a373-4ff0-b2c5-cbc9dc321181 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:22.109359 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ae993d7-a373-4ff0-b2c5-cbc9dc321181 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 0.916446 Jul 26 14:29:22.112582 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2199/4502] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:21 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:22.128608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dd9e248b-833c-4698-9bae-5cda261941d7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:22.130082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dd9e248b-833c-4698-9bae-5cda261941d7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:22.146200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dd9e248b-833c-4698-9bae-5cda261941d7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:22.147788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dd9e248b-833c-4698-9bae-5cda261941d7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:22.153377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dd9e248b-833c-4698-9bae-5cda261941d7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:22.154122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dd9e248b-833c-4698-9bae-5cda261941d7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:22.543712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-09e7913a-f493-4f23-a4ce-92df03b609f0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:22.570906 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-09e7913a-f493-4f23-a4ce-92df03b609f0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.570847 Jul 26 14:29:22.576435 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2304/4503] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:21 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:22.663253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-32c666d8-6be7-4234-8ef4-4b019e1960ed req-f373dcf8-2af8-4c37-87fa-860c063bc4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d85143-b08f-40ab-a08d-9278963e0602", "name": "network-vif-plugged", "status": "completed", "tag": "c3500c5b-4a04-40b8-8ae4-cbacbe8371af"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:22.703195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-32c666d8-6be7-4234-8ef4-4b019e1960ed req-f373dcf8-2af8-4c37-87fa-860c063bc4aa service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:22.703851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-32c666d8-6be7-4234-8ef4-4b019e1960ed req-f373dcf8-2af8-4c37-87fa-860c063bc4aa service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:22.754100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dd9e248b-833c-4698-9bae-5cda261941d7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:22.790610 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-32c666d8-6be7-4234-8ef4-4b019e1960ed req-f373dcf8-2af8-4c37-87fa-860c063bc4aa service nova] Creating event network-vif-plugged:c3500c5b-4a04-40b8-8ae4-cbacbe8371af for instance 56d85143-b08f-40ab-a08d-9278963e0602 on n-h2-833090-9 Jul 26 14:29:22.797259 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dd9e248b-833c-4698-9bae-5cda261941d7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1325 microversion: 2.1 time: 0.683501 Jul 26 14:29:22.799992 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2200/4504] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:22 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1325 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:22.822695 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-32c666d8-6be7-4234-8ef4-4b019e1960ed req-f373dcf8-2af8-4c37-87fa-860c063bc4aa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162565 Jul 26 14:29:22.832104 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2305/4505] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:29:23.020238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d5a93231-acc3-45c4-88af-4d4c57cd34d9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:23.027718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d5a93231-acc3-45c4-88af-4d4c57cd34d9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:23.058916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5a93231-acc3-45c4-88af-4d4c57cd34d9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:23.059707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5a93231-acc3-45c4-88af-4d4c57cd34d9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:23.070031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5a93231-acc3-45c4-88af-4d4c57cd34d9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:23.073219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5a93231-acc3-45c4-88af-4d4c57cd34d9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:23.155915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e1f2183f-12c3-480f-b90e-76f082669dec tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:23.156770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e1f2183f-12c3-480f-b90e-76f082669dec tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:23.195437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1f2183f-12c3-480f-b90e-76f082669dec tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:23.195640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1f2183f-12c3-480f-b90e-76f082669dec tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:23.205276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1f2183f-12c3-480f-b90e-76f082669dec tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:23.205832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1f2183f-12c3-480f-b90e-76f082669dec tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:23.281348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:23.809064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e1f2183f-12c3-480f-b90e-76f082669dec tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:23.822988 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e1f2183f-12c3-480f-b90e-76f082669dec tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 0.672543 Jul 26 14:29:23.824127 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2306/4506] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:23 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:23.832694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5569553-f1d5-4b1c-ac4b-0f6541472898 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:23.846532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d5569553-f1d5-4b1c-ac4b-0f6541472898 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:23.864131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5569553-f1d5-4b1c-ac4b-0f6541472898 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:23.878220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5569553-f1d5-4b1c-ac4b-0f6541472898 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:23.885220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5569553-f1d5-4b1c-ac4b-0f6541472898 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:23.890060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5569553-f1d5-4b1c-ac4b-0f6541472898 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:24.334728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5a93231-acc3-45c4-88af-4d4c57cd34d9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:24.351522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5a93231-acc3-45c4-88af-4d4c57cd34d9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:24.353695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5a93231-acc3-45c4-88af-4d4c57cd34d9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:24.362020 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d5a93231-acc3-45c4-88af-4d4c57cd34d9 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1358 microversion: 2.21 time: 1.341939 Jul 26 14:29:24.363033 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2201/4507] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:23 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1358 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:24.392411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-caeaf10b-49cb-4bee-a173-daaf6c1506ec tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:24.395420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-caeaf10b-49cb-4bee-a173-daaf6c1506ec tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:24.457893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-caeaf10b-49cb-4bee-a173-daaf6c1506ec tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:24.460305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-caeaf10b-49cb-4bee-a173-daaf6c1506ec tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:24.468516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-caeaf10b-49cb-4bee-a173-daaf6c1506ec tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:24.469429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-caeaf10b-49cb-4bee-a173-daaf6c1506ec tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:24.563216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:24.584866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d5569553-f1d5-4b1c-ac4b-0f6541472898 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:24.596831 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5569553-f1d5-4b1c-ac4b-0f6541472898 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1677 microversion: 2.1 time: 0.767494 Jul 26 14:29:24.600911 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2307/4508] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:23 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1677 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:24.851118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7988a909-5016-4753-897d-51f99c278133 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:24.851764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7988a909-5016-4753-897d-51f99c278133 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:24.868916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:24.878960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7988a909-5016-4753-897d-51f99c278133 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:24.879483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7988a909-5016-4753-897d-51f99c278133 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:24.880406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7988a909-5016-4753-897d-51f99c278133 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:24.891384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7988a909-5016-4753-897d-51f99c278133 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:24.907502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-caeaf10b-49cb-4bee-a173-daaf6c1506ec tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:24.919233 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-caeaf10b-49cb-4bee-a173-daaf6c1506ec tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1522 microversion: 2.1 time: 0.553925 Jul 26 14:29:24.923541 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2202/4509] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:24 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:24.984979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9ec9948-fa45-4d12-9203-46d9f59be0d9 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:24.985823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d9ec9948-fa45-4d12-9203-46d9f59be0d9 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:25.014465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9ec9948-fa45-4d12-9203-46d9f59be0d9 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:25.017137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9ec9948-fa45-4d12-9203-46d9f59be0d9 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:25.028293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:25.028687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9ec9948-fa45-4d12-9203-46d9f59be0d9 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:25.029686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9ec9948-fa45-4d12-9203-46d9f59be0d9 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:25.118713 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d9ec9948-fa45-4d12-9203-46d9f59be0d9 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] HTTP exception thrown: Instance is not a member of specified network Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9ec9948-fa45-4d12-9203-46d9f59be0d9 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Request method failure captured: Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428/ips/invalid HTTP/1.1 Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_oPE9JlrvLCgaJypLF1CDfQM-ovTfYcWxSP_xWAMrs1KtHUZFNIFMFXZLvtEnoKQscia9qc1KFa1ZVnHUhKwux_W8kQPDdrTe0C2RKoTd2qaL_gwb8pGv7VUhR2VNbSWQVMXuufMUNlhq7obxtIwKK_x_Ck-px8Dvf3g10vK4D9lVs Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: d984b2614b6b41c4aca43d888a567313 Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1717526799 Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d984b2614b6b41c4aca43d888a567313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d984b2614b6b41c4aca43d888a567313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d984b2614b6b41c4aca43d888a567313", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d984b2614b6b41c4aca43d888a567313"}]}] Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1717526799 Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: d984b2614b6b41c4aca43d888a567313 Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1717526799 Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerAddressesNegativeTestJSON-1717526799-project Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 139178c93bda48d597bc039169e560a3 Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1717526799-project Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance is not a member of specified network Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': '4053013d-b86a-4625-a126-287cacda1428', 'id': 'invalid'} Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 26 14:29:25.131515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:25.137600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9ec9948-fa45-4d12-9203-46d9f59be0d9 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:29:25.139010 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d9ec9948-fa45-4d12-9203-46d9f59be0d9 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.194573 Jul 26 14:29:25.140256 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2203/4510] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:29:24 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428/ips/invalid => generated 91 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:29:25.152599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d8df128-2d3d-4af0-a755-0547bcb48c88 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:25.169321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d8df128-2d3d-4af0-a755-0547bcb48c88 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Failed to fetch instance by id 999 {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 26 14:29:25.170802 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-0d8df128-2d3d-4af0-a755-0547bcb48c88 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] HTTP exception thrown: Instance 999 could not be found. Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d8df128-2d3d-4af0-a755-0547bcb48c88 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Request method failure captured: Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_oPE9JlrvLCgaJypLF1CDfQM-ovTfYcWxSP_xWAMrs1KtHUZFNIFMFXZLvtEnoKQscia9qc1KFa1ZVnHUhKwux_W8kQPDdrTe0C2RKoTd2qaL_gwb8pGv7VUhR2VNbSWQVMXuufMUNlhq7obxtIwKK_x_Ck-px8Dvf3g10vK4D9lVs Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: d984b2614b6b41c4aca43d888a567313 Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1717526799 Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d984b2614b6b41c4aca43d888a567313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d984b2614b6b41c4aca43d888a567313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d984b2614b6b41c4aca43d888a567313", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d984b2614b6b41c4aca43d888a567313"}]}] Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1717526799 Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: d984b2614b6b41c4aca43d888a567313 Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1717526799 Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerAddressesNegativeTestJSON-1717526799-project Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 139178c93bda48d597bc039169e560a3 Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1717526799-project Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 999 could not be found. Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': '999'} Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 26 14:29:25.174848 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:25.189357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d8df128-2d3d-4af0-a755-0547bcb48c88 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:29:25.189357 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d8df128-2d3d-4af0-a755-0547bcb48c88 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.040234 Jul 26 14:29:25.190905 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2204/4511] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Jul 26 14:29:25 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 26 14:29:25.215006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca2c8dec-b25b-4991-ab70-da958dea348d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:25.216911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ca2c8dec-b25b-4991-ab70-da958dea348d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:25.263442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca2c8dec-b25b-4991-ab70-da958dea348d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:25.270394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca2c8dec-b25b-4991-ab70-da958dea348d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:25.275462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca2c8dec-b25b-4991-ab70-da958dea348d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:25.278639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca2c8dec-b25b-4991-ab70-da958dea348d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:25.395992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ca2c8dec-b25b-4991-ab70-da958dea348d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:29:25.421801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7988a909-5016-4753-897d-51f99c278133 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:25.429686 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7988a909-5016-4753-897d-51f99c278133 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1372 microversion: 2.1 time: 0.585055 Jul 26 14:29:25.430287 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2308/4512] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:24 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1372 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:25.707976 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ca2c8dec-b25b-4991-ab70-da958dea348d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 204 len: 0 microversion: 2.1 time: 0.509431 Jul 26 14:29:25.727339 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2205/4513] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:29:25 2022] DELETE /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:29:25.779172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-137e27e3-8174-4ea2-ac9e-a16766572314 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:25.783491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-137e27e3-8174-4ea2-ac9e-a16766572314 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:25.852182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-137e27e3-8174-4ea2-ac9e-a16766572314 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:25.857818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-137e27e3-8174-4ea2-ac9e-a16766572314 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:25.865999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-137e27e3-8174-4ea2-ac9e-a16766572314 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:25.872643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-137e27e3-8174-4ea2-ac9e-a16766572314 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:26.427350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-39cf7782-2515-424c-97e6-8f20472e761e req-0d9c4f21-f788-484e-8626-47e4e306636b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a6c0bf-2552-4066-ab74-f61f82c986e4", "tag": "f7ea3a50-751b-4e4e-90b7-b4df79ca7345"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:26.465438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-39cf7782-2515-424c-97e6-8f20472e761e req-0d9c4f21-f788-484e-8626-47e4e306636b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:26.465899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-39cf7782-2515-424c-97e6-8f20472e761e req-0d9c4f21-f788-484e-8626-47e4e306636b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:26.518541 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-39cf7782-2515-424c-97e6-8f20472e761e req-0d9c4f21-f788-484e-8626-47e4e306636b service nova] Creating event network-changed:f7ea3a50-751b-4e4e-90b7-b4df79ca7345 for instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 on n-h1-833090-9 Jul 26 14:29:26.530806 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-39cf7782-2515-424c-97e6-8f20472e761e req-0d9c4f21-f788-484e-8626-47e4e306636b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.086985 Jul 26 14:29:26.533570 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2309/4514] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:29:26.570665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a92f22d-6240-41e5-9e95-5fd6163db6b8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:26.570665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a92f22d-6240-41e5-9e95-5fd6163db6b8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:26.576558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a92f22d-6240-41e5-9e95-5fd6163db6b8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:26.577023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a92f22d-6240-41e5-9e95-5fd6163db6b8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:26.577980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a92f22d-6240-41e5-9e95-5fd6163db6b8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:26.596823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a92f22d-6240-41e5-9e95-5fd6163db6b8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:26.735573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-137e27e3-8174-4ea2-ac9e-a16766572314 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:26.760834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-137e27e3-8174-4ea2-ac9e-a16766572314 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:26.764589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-137e27e3-8174-4ea2-ac9e-a16766572314 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:26.768835 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-137e27e3-8174-4ea2-ac9e-a16766572314 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1358 microversion: 2.21 time: 1.035001 Jul 26 14:29:26.799844 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2206/4515] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:25 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1358 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:26.817221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4829cf12-57e4-431f-ae7b-db02c8bbc2a7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:26.824411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4829cf12-57e4-431f-ae7b-db02c8bbc2a7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:26.843754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4829cf12-57e4-431f-ae7b-db02c8bbc2a7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:26.844558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4829cf12-57e4-431f-ae7b-db02c8bbc2a7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:26.845893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4829cf12-57e4-431f-ae7b-db02c8bbc2a7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:26.846642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4829cf12-57e4-431f-ae7b-db02c8bbc2a7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:27.345298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a92f22d-6240-41e5-9e95-5fd6163db6b8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:27.376791 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a92f22d-6240-41e5-9e95-5fd6163db6b8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1654 microversion: 2.1 time: 0.833110 Jul 26 14:29:27.380783 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2310/4516] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:26 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1654 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:27.409211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8acaddb2-f3ae-47a6-a22c-e30b326a293a tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:27.410272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8acaddb2-f3ae-47a6-a22c-e30b326a293a tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:27.426595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8acaddb2-f3ae-47a6-a22c-e30b326a293a tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:27.432124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8acaddb2-f3ae-47a6-a22c-e30b326a293a tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:27.434778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8acaddb2-f3ae-47a6-a22c-e30b326a293a tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:27.437966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8acaddb2-f3ae-47a6-a22c-e30b326a293a tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:27.559861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4829cf12-57e4-431f-ae7b-db02c8bbc2a7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:27.603555 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4829cf12-57e4-431f-ae7b-db02c8bbc2a7 tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1528 microversion: 2.1 time: 0.797988 Jul 26 14:29:27.637855 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2207/4517] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:26 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1528 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:27.653937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-41df1073-da6c-4e7e-8c54-b42ed06c17be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:27.670562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-41df1073-da6c-4e7e-8c54-b42ed06c17be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:27.671602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-41df1073-da6c-4e7e-8c54-b42ed06c17be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:27.751919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-41df1073-da6c-4e7e-8c54-b42ed06c17be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Going to try to start instance {{(pid=119478) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 14:29:27.867709 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-41df1073-da6c-4e7e-8c54-b42ed06c17be tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.224764 Jul 26 14:29:27.877625 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2208/4518] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:29:27 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:29:27.891205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-38a3b02d-bc32-4082-90b8-8338f20c7d3b tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:27.893027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-38a3b02d-bc32-4082-90b8-8338f20c7d3b tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:27.913338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38a3b02d-bc32-4082-90b8-8338f20c7d3b tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:27.914129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38a3b02d-bc32-4082-90b8-8338f20c7d3b tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:27.917197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38a3b02d-bc32-4082-90b8-8338f20c7d3b tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:27.917766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38a3b02d-bc32-4082-90b8-8338f20c7d3b tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:28.388267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8acaddb2-f3ae-47a6-a22c-e30b326a293a tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:28.408649 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8acaddb2-f3ae-47a6-a22c-e30b326a293a tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1558 microversion: 2.1 time: 1.019439 Jul 26 14:29:28.412446 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2311/4519] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:27 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1558 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:28.433040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-38a3b02d-bc32-4082-90b8-8338f20c7d3b tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:28.442756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-38a3b02d-bc32-4082-90b8-8338f20c7d3b tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:28.444277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5655c205-6b66-41b7-ab83-595b2ab65fa3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:28.447176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5655c205-6b66-41b7-ab83-595b2ab65fa3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:28.454152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-38a3b02d-bc32-4082-90b8-8338f20c7d3b tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:28.460316 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-38a3b02d-bc32-4082-90b8-8338f20c7d3b tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1358 microversion: 2.21 time: 0.581162 Jul 26 14:29:28.465820 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2209/4520] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:27 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1358 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:28.477272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5655c205-6b66-41b7-ab83-595b2ab65fa3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:28.477272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5655c205-6b66-41b7-ab83-595b2ab65fa3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:28.477272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5655c205-6b66-41b7-ab83-595b2ab65fa3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:28.477272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5655c205-6b66-41b7-ab83-595b2ab65fa3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:28.486327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-543a9720-62df-4ffa-9b87-78fb13dbca1e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:28.486327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-543a9720-62df-4ffa-9b87-78fb13dbca1e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:28.517454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-543a9720-62df-4ffa-9b87-78fb13dbca1e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:28.518174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-543a9720-62df-4ffa-9b87-78fb13dbca1e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:28.522453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-543a9720-62df-4ffa-9b87-78fb13dbca1e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:28.523782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-543a9720-62df-4ffa-9b87-78fb13dbca1e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:28.850796 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-543a9720-62df-4ffa-9b87-78fb13dbca1e tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.383677 Jul 26 14:29:28.860822 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2210/4521] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:29:28 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-interface => generated 284 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:29:28.868194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e1179ccf-21f5-435d-a3e0-0dbc1a615e9e tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:28.869360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e1179ccf-21f5-435d-a3e0-0dbc1a615e9e tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:28.889863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1179ccf-21f5-435d-a3e0-0dbc1a615e9e tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:28.890740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1179ccf-21f5-435d-a3e0-0dbc1a615e9e tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:28.891871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1179ccf-21f5-435d-a3e0-0dbc1a615e9e tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:28.892603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e1179ccf-21f5-435d-a3e0-0dbc1a615e9e tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:29.473736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5655c205-6b66-41b7-ab83-595b2ab65fa3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:29.482500 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5655c205-6b66-41b7-ab83-595b2ab65fa3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1663 microversion: 2.1 time: 1.068565 Jul 26 14:29:29.501511 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2312/4522] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:28 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1663 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:29.515106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8caee9fc-3f87-4808-9136-dfd4cb0a1cf0 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:29.516666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8caee9fc-3f87-4808-9136-dfd4cb0a1cf0 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:29.533603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8caee9fc-3f87-4808-9136-dfd4cb0a1cf0 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:29.540460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8caee9fc-3f87-4808-9136-dfd4cb0a1cf0 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:29.542821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8caee9fc-3f87-4808-9136-dfd4cb0a1cf0 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:29.547031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8caee9fc-3f87-4808-9136-dfd4cb0a1cf0 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:30.528464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e1179ccf-21f5-435d-a3e0-0dbc1a615e9e tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:30.540395 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e1179ccf-21f5-435d-a3e0-0dbc1a615e9e tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1528 microversion: 2.1 time: 1.677796 Jul 26 14:29:30.541145 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2211/4523] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:28 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1528 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:30.552784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-778ce975-aa64-4524-9aec-3f59a2d27ea2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:30.568841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-778ce975-aa64-4524-9aec-3f59a2d27ea2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:30.578794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-778ce975-aa64-4524-9aec-3f59a2d27ea2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:30.578794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-778ce975-aa64-4524-9aec-3f59a2d27ea2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:30.602106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-778ce975-aa64-4524-9aec-3f59a2d27ea2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:30.605115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-778ce975-aa64-4524-9aec-3f59a2d27ea2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:31.831025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8caee9fc-3f87-4808-9136-dfd4cb0a1cf0 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:31.840445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8caee9fc-3f87-4808-9136-dfd4cb0a1cf0 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:31.842216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8caee9fc-3f87-4808-9136-dfd4cb0a1cf0 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:31.844058 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8caee9fc-3f87-4808-9136-dfd4cb0a1cf0 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1358 microversion: 2.21 time: 2.340242 Jul 26 14:29:31.860490 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2313/4524] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:29 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1358 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:31.866733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8ce0fca0-762b-4030-adcc-413a3920816d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:31.867616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8ce0fca0-762b-4030-adcc-413a3920816d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:31.874949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ce0fca0-762b-4030-adcc-413a3920816d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:31.875722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ce0fca0-762b-4030-adcc-413a3920816d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:31.876712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ce0fca0-762b-4030-adcc-413a3920816d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:31.877386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ce0fca0-762b-4030-adcc-413a3920816d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:32.112406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8ce0fca0-762b-4030-adcc-413a3920816d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139178c93bda48d597bc039169e560a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd984b2614b6b41c4aca43d888a567313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:32.125485 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8ce0fca0-762b-4030-adcc-413a3920816d tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 200 len: 1486 microversion: 2.1 time: 0.263137 Jul 26 14:29:32.132279 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2314/4525] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:31 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 1486 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:32.323582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7796d411-7b49-4b93-acc6-68f0e89643e2 req-a6927e83-5a3b-4b94-9484-40c2ceec747b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4053013d-b86a-4625-a126-287cacda1428", "name": "network-vif-deleted", "tag": "d926fa0b-37bb-4684-9986-f9ba027b0fd0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:32.352997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7796d411-7b49-4b93-acc6-68f0e89643e2 req-a6927e83-5a3b-4b94-9484-40c2ceec747b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:32.353528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7796d411-7b49-4b93-acc6-68f0e89643e2 req-a6927e83-5a3b-4b94-9484-40c2ceec747b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:32.387579 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7796d411-7b49-4b93-acc6-68f0e89643e2 req-a6927e83-5a3b-4b94-9484-40c2ceec747b service nova] Creating event network-vif-deleted:d926fa0b-37bb-4684-9986-f9ba027b0fd0 for instance 4053013d-b86a-4625-a126-287cacda1428 on n-h2-833090-9 Jul 26 14:29:32.396526 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7796d411-7b49-4b93-acc6-68f0e89643e2 req-a6927e83-5a3b-4b94-9484-40c2ceec747b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089456 Jul 26 14:29:32.398445 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2315/4526] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:29:32.539438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d8bef06b-ee6e-41a6-8db4-02aed21a51a6 req-d43f65e7-36b6-4faa-91e3-99faf5756e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a6c0bf-2552-4066-ab74-f61f82c986e4", "name": "network-vif-plugged", "status": "completed", "tag": "f7ea3a50-751b-4e4e-90b7-b4df79ca7345"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:32.554675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:32.574806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d8bef06b-ee6e-41a6-8db4-02aed21a51a6 req-d43f65e7-36b6-4faa-91e3-99faf5756e74 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:32.575806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d8bef06b-ee6e-41a6-8db4-02aed21a51a6 req-d43f65e7-36b6-4faa-91e3-99faf5756e74 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:32.607656 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d8bef06b-ee6e-41a6-8db4-02aed21a51a6 req-d43f65e7-36b6-4faa-91e3-99faf5756e74 service nova] Creating event network-vif-plugged:f7ea3a50-751b-4e4e-90b7-b4df79ca7345 for instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 on n-h1-833090-9 Jul 26 14:29:32.614994 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d8bef06b-ee6e-41a6-8db4-02aed21a51a6 req-d43f65e7-36b6-4faa-91e3-99faf5756e74 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079527 Jul 26 14:29:32.632507 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2316/4527] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:29:32.796484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-778ce975-aa64-4524-9aec-3f59a2d27ea2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:32.807089 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-778ce975-aa64-4524-9aec-3f59a2d27ea2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1663 microversion: 2.1 time: 2.264681 Jul 26 14:29:32.816792 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2212/4528] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:30 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1663 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:32.868544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3cde25de-2fd4-4711-a03e-6afc87c1dea1 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:32.869329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3cde25de-2fd4-4711-a03e-6afc87c1dea1 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:32.879801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cde25de-2fd4-4711-a03e-6afc87c1dea1 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:32.881240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cde25de-2fd4-4711-a03e-6afc87c1dea1 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:32.883414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cde25de-2fd4-4711-a03e-6afc87c1dea1 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:32.884744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3cde25de-2fd4-4711-a03e-6afc87c1dea1 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:33.155183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0ee44038-bb04-4cd5-9354-13ac1ed8523a tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:33.156090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0ee44038-bb04-4cd5-9354-13ac1ed8523a tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] [instance: 4053013d-b86a-4625-a126-287cacda1428] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:33.176056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ee44038-bb04-4cd5-9354-13ac1ed8523a tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:33.176810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ee44038-bb04-4cd5-9354-13ac1ed8523a tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:33.178563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ee44038-bb04-4cd5-9354-13ac1ed8523a tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:33.179247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ee44038-bb04-4cd5-9354-13ac1ed8523a tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:33.231977 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-0ee44038-bb04-4cd5-9354-13ac1ed8523a tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] HTTP exception thrown: Instance 4053013d-b86a-4625-a126-287cacda1428 could not be found. Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0ee44038-bb04-4cd5-9354-13ac1ed8523a tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Request method failure captured: Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 HTTP/1.1 Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_oPE9JlrvLCgaJypLF1CDfQM-ovTfYcWxSP_xWAMrs1KtHUZFNIFMFXZLvtEnoKQscia9qc1KFa1ZVnHUhKwux_W8kQPDdrTe0C2RKoTd2qaL_gwb8pGv7VUhR2VNbSWQVMXuufMUNlhq7obxtIwKK_x_Ck-px8Dvf3g10vK4D9lVs Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: d984b2614b6b41c4aca43d888a567313 Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1717526799 Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d984b2614b6b41c4aca43d888a567313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d984b2614b6b41c4aca43d888a567313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d984b2614b6b41c4aca43d888a567313", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d984b2614b6b41c4aca43d888a567313"}]}] Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1717526799 Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: d984b2614b6b41c4aca43d888a567313 Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1717526799 Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerAddressesNegativeTestJSON-1717526799-project Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 139178c93bda48d597bc039169e560a3 Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1717526799-project Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 4053013d-b86a-4625-a126-287cacda1428 could not be found. Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4053013d-b86a-4625-a126-287cacda1428'} Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4053013d-b86a-4625-a126-287cacda1428 could not be found. Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4053013d-b86a-4625-a126-287cacda1428 could not be found. Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:33.234058 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:33.239756 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:33.239756 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:33.239756 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:33.239756 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:33.239756 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:29:33.239756 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:29:33.239756 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4053013d-b86a-4625-a126-287cacda1428 could not be found. Jul 26 14:29:33.239756 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:29:33.252139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0ee44038-bb04-4cd5-9354-13ac1ed8523a tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] Returning 404 to user: Instance 4053013d-b86a-4625-a126-287cacda1428 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:29:33.253105 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0ee44038-bb04-4cd5-9354-13ac1ed8523a tempest-ServerAddressesNegativeTestJSON-1717526799 tempest-ServerAddressesNegativeTestJSON-1717526799-project] 10.222.0.70 "GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428" status: 404 len: 111 microversion: 2.1 time: 0.101915 Jul 26 14:29:33.253954 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2213/4529] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:33 2022] GET /compute/v2.1/servers/4053013d-b86a-4625-a126-287cacda1428 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:29:33.648053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3cde25de-2fd4-4711-a03e-6afc87c1dea1 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:33.660204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3cde25de-2fd4-4711-a03e-6afc87c1dea1 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:33.672553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3cde25de-2fd4-4711-a03e-6afc87c1dea1 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:33.674014 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3cde25de-2fd4-4711-a03e-6afc87c1dea1 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1358 microversion: 2.21 time: 0.811009 Jul 26 14:29:33.674814 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2317/4530] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:32 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1358 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:33.841069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3323ce87-d680-49dd-abd3-f041b5ec5f8e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:33.841878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3323ce87-d680-49dd-abd3-f041b5ec5f8e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:33.857296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3323ce87-d680-49dd-abd3-f041b5ec5f8e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:33.858127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3323ce87-d680-49dd-abd3-f041b5ec5f8e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:33.859553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3323ce87-d680-49dd-abd3-f041b5ec5f8e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:33.863362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3323ce87-d680-49dd-abd3-f041b5ec5f8e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:34.263074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3323ce87-d680-49dd-abd3-f041b5ec5f8e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:34.287252 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3323ce87-d680-49dd-abd3-f041b5ec5f8e tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1663 microversion: 2.1 time: 0.450709 Jul 26 14:29:34.288999 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2214/4531] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:33 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1663 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:34.454228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a4bb14b7-b692-4d3c-91d9-c7b48beae86f req-60a3768d-1448-44cb-a142-798738c4c538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d85143-b08f-40ab-a08d-9278963e0602", "tag": "c3500c5b-4a04-40b8-8ae4-cbacbe8371af"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:34.470278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a4bb14b7-b692-4d3c-91d9-c7b48beae86f req-60a3768d-1448-44cb-a142-798738c4c538 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:34.480180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a4bb14b7-b692-4d3c-91d9-c7b48beae86f req-60a3768d-1448-44cb-a142-798738c4c538 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:34.497374 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a4bb14b7-b692-4d3c-91d9-c7b48beae86f req-60a3768d-1448-44cb-a142-798738c4c538 service nova] Creating event network-changed:c3500c5b-4a04-40b8-8ae4-cbacbe8371af for instance 56d85143-b08f-40ab-a08d-9278963e0602 on n-h2-833090-9 Jul 26 14:29:34.507815 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a4bb14b7-b692-4d3c-91d9-c7b48beae86f req-60a3768d-1448-44cb-a142-798738c4c538 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057235 Jul 26 14:29:34.516894 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2318/4532] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:29:34.699309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7561bce7-cdb7-417d-9515-5618ce90f324 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:34.699922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7561bce7-cdb7-417d-9515-5618ce90f324 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:34.713952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7561bce7-cdb7-417d-9515-5618ce90f324 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:34.715682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7561bce7-cdb7-417d-9515-5618ce90f324 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:34.717004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7561bce7-cdb7-417d-9515-5618ce90f324 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:34.717819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7561bce7-cdb7-417d-9515-5618ce90f324 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:35.073522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7561bce7-cdb7-417d-9515-5618ce90f324 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:35.087521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7561bce7-cdb7-417d-9515-5618ce90f324 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:35.094691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7561bce7-cdb7-417d-9515-5618ce90f324 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:35.097263 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7561bce7-cdb7-417d-9515-5618ce90f324 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1550 microversion: 2.21 time: 0.401374 Jul 26 14:29:35.098404 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2215/4533] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:34 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1550 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:35.127322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7e6825fb-61b5-4723-9932-8f291d965aba tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:35.127587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e6825fb-61b5-4723-9932-8f291d965aba tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:35.137104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e6825fb-61b5-4723-9932-8f291d965aba tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:35.137779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e6825fb-61b5-4723-9932-8f291d965aba tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:35.138452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e6825fb-61b5-4723-9932-8f291d965aba tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:35.138899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e6825fb-61b5-4723-9932-8f291d965aba tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:35.189217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e6825fb-61b5-4723-9932-8f291d965aba tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:29:35.315908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ac2e643b-f0cd-40c0-9ea3-5bdb523fecab tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:35.316851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ac2e643b-f0cd-40c0-9ea3-5bdb523fecab tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:35.331802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac2e643b-f0cd-40c0-9ea3-5bdb523fecab tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:35.332528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac2e643b-f0cd-40c0-9ea3-5bdb523fecab tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:35.333430 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7e6825fb-61b5-4723-9932-8f291d965aba tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "DELETE /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 204 len: 0 microversion: 2.21 time: 0.210907 Jul 26 14:29:35.333892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac2e643b-f0cd-40c0-9ea3-5bdb523fecab tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:35.334513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac2e643b-f0cd-40c0-9ea3-5bdb523fecab tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:35.338891 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2319/4534] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:29:35 2022] DELETE /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:29:35.344691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f0aa23cc-c659-44d9-8a17-a5e5d127b53d tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:35.345634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f0aa23cc-c659-44d9-8a17-a5e5d127b53d tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:35.361000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0aa23cc-c659-44d9-8a17-a5e5d127b53d tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:35.361958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0aa23cc-c659-44d9-8a17-a5e5d127b53d tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:35.364981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0aa23cc-c659-44d9-8a17-a5e5d127b53d tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:35.365679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0aa23cc-c659-44d9-8a17-a5e5d127b53d tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:35.786225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f0aa23cc-c659-44d9-8a17-a5e5d127b53d tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:35.812797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f0aa23cc-c659-44d9-8a17-a5e5d127b53d tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:35.814556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f0aa23cc-c659-44d9-8a17-a5e5d127b53d tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:35.816728 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f0aa23cc-c659-44d9-8a17-a5e5d127b53d tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1556 microversion: 2.21 time: 0.476170 Jul 26 14:29:35.817432 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2320/4535] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:35 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1556 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:35.920355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ac2e643b-f0cd-40c0-9ea3-5bdb523fecab tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:35.929610 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ac2e643b-f0cd-40c0-9ea3-5bdb523fecab tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.617706 Jul 26 14:29:35.945052 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2216/4536] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:35 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:35.959350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3611f061-0b54-44ef-864a-88264ecd6115 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:35.960845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3611f061-0b54-44ef-864a-88264ecd6115 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:35.970382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3611f061-0b54-44ef-864a-88264ecd6115 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:35.971241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3611f061-0b54-44ef-864a-88264ecd6115 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:35.973064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3611f061-0b54-44ef-864a-88264ecd6115 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:35.973910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3611f061-0b54-44ef-864a-88264ecd6115 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:36.245569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3611f061-0b54-44ef-864a-88264ecd6115 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:36.259335 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3611f061-0b54-44ef-864a-88264ecd6115 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.306231 Jul 26 14:29:36.260331 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2321/4537] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:35 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:36.292598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d5940a2f-0380-463b-be2c-14684899ece5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:36.293767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d5940a2f-0380-463b-be2c-14684899ece5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:36.301532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:36.316977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5940a2f-0380-463b-be2c-14684899ece5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:36.317491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5940a2f-0380-463b-be2c-14684899ece5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:36.318437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5940a2f-0380-463b-be2c-14684899ece5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:36.319069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5940a2f-0380-463b-be2c-14684899ece5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:36.607496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5940a2f-0380-463b-be2c-14684899ece5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:36.618181 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d5940a2f-0380-463b-be2c-14684899ece5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.332776 Jul 26 14:29:36.619655 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2217/4538] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:36 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:36.667839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-728f6a4d-d17c-4ec0-b890-1e7c711a130a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:36.668813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-728f6a4d-d17c-4ec0-b890-1e7c711a130a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:36.683879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-728f6a4d-d17c-4ec0-b890-1e7c711a130a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:36.684593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-728f6a4d-d17c-4ec0-b890-1e7c711a130a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:36.685442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-728f6a4d-d17c-4ec0-b890-1e7c711a130a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:36.686393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-728f6a4d-d17c-4ec0-b890-1e7c711a130a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:36.846321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bc67a99f-e314-44ae-9e0b-ddd3920c6e78 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:36.847156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bc67a99f-e314-44ae-9e0b-ddd3920c6e78 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:36.856918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc67a99f-e314-44ae-9e0b-ddd3920c6e78 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:36.857517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc67a99f-e314-44ae-9e0b-ddd3920c6e78 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:36.858566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc67a99f-e314-44ae-9e0b-ddd3920c6e78 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:36.859418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc67a99f-e314-44ae-9e0b-ddd3920c6e78 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:37.224995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-728f6a4d-d17c-4ec0-b890-1e7c711a130a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:37.243801 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-728f6a4d-d17c-4ec0-b890-1e7c711a130a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.580461 Jul 26 14:29:37.248770 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2322/4539] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:36 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:37.271836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e54bd8f3-7cbe-4b78-bbae-43e2edf6f96a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:37.272871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e54bd8f3-7cbe-4b78-bbae-43e2edf6f96a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:37.295537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e54bd8f3-7cbe-4b78-bbae-43e2edf6f96a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:37.296203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e54bd8f3-7cbe-4b78-bbae-43e2edf6f96a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:37.296904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e54bd8f3-7cbe-4b78-bbae-43e2edf6f96a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:37.297345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e54bd8f3-7cbe-4b78-bbae-43e2edf6f96a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:37.379640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bc67a99f-e314-44ae-9e0b-ddd3920c6e78 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:37.384281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:37.397464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bc67a99f-e314-44ae-9e0b-ddd3920c6e78 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:37.412027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bc67a99f-e314-44ae-9e0b-ddd3920c6e78 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:37.416879 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bc67a99f-e314-44ae-9e0b-ddd3920c6e78 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1556 microversion: 2.21 time: 0.576694 Jul 26 14:29:37.417981 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2218/4540] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:36 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1556 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:37.915332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e54bd8f3-7cbe-4b78-bbae-43e2edf6f96a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:37.925086 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e54bd8f3-7cbe-4b78-bbae-43e2edf6f96a tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.657894 Jul 26 14:29:37.934541 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2323/4541] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:37 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:37.954833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bcb07af5-561d-415f-900a-31baa1df5a07 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:37.955680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bcb07af5-561d-415f-900a-31baa1df5a07 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:37.969978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcb07af5-561d-415f-900a-31baa1df5a07 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:37.973696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcb07af5-561d-415f-900a-31baa1df5a07 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:37.975992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcb07af5-561d-415f-900a-31baa1df5a07 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:37.978535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bcb07af5-561d-415f-900a-31baa1df5a07 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:38.080204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-bcb07af5-561d-415f-900a-31baa1df5a07 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lazy-loading 'flavor' on Instance uuid c584bb0a-2fbb-4014-9f21-bcb83a0068c0 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:29:38.223314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-de4eb630-204c-45c0-a5ce-dd68cad36113 req-79cb519d-f783-485a-a083-8cd7a5ee289e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a6c0bf-2552-4066-ab74-f61f82c986e4", "name": "network-vif-deleted", "tag": "f7ea3a50-751b-4e4e-90b7-b4df79ca7345"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:38.283816 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bcb07af5-561d-415f-900a-31baa1df5a07 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.333438 Jul 26 14:29:38.290561 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2219/4542] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:29:37 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:29:38.296460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7e887f3c-4824-4d83-8724-1e64f43dea79 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:38.297169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7e887f3c-4824-4d83-8724-1e64f43dea79 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:38.313005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-de4eb630-204c-45c0-a5ce-dd68cad36113 req-79cb519d-f783-485a-a083-8cd7a5ee289e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:38.314760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-de4eb630-204c-45c0-a5ce-dd68cad36113 req-79cb519d-f783-485a-a083-8cd7a5ee289e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:38.327468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e887f3c-4824-4d83-8724-1e64f43dea79 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:38.334278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e887f3c-4824-4d83-8724-1e64f43dea79 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:38.335480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e887f3c-4824-4d83-8724-1e64f43dea79 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:38.339772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e887f3c-4824-4d83-8724-1e64f43dea79 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:38.362014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:38.404910 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-de4eb630-204c-45c0-a5ce-dd68cad36113 req-79cb519d-f783-485a-a083-8cd7a5ee289e service nova] Creating event network-vif-deleted:f7ea3a50-751b-4e4e-90b7-b4df79ca7345 for instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 on n-h1-833090-9 Jul 26 14:29:38.427440 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-de4eb630-204c-45c0-a5ce-dd68cad36113 req-79cb519d-f783-485a-a083-8cd7a5ee289e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212429 Jul 26 14:29:38.454009 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2324/4543] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:29:38.476595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:38.481093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:38.512763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:38.515021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:38.519468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:38.520284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:38.583645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:38.592981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:38.593814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lazy-loading 'fault' on Instance uuid 01a6c0bf-2552-4066-ab74-f61f82c986e4 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:29:38.747147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7e887f3c-4824-4d83-8724-1e64f43dea79 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:38.750092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:38.764772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:38.770433 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7e887f3c-4824-4d83-8724-1e64f43dea79 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1675 microversion: 2.1 time: 0.475550 Jul 26 14:29:38.777635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbfff61dbe554bc09670a4674201a299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc0ddfed511a4f71886dfcb9211ed6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:38.779234 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2220/4544] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:38 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1675 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:38.781535 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43a610c3-46f7-4fa4-b59d-235add845248 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 200 len: 1348 microversion: 2.21 time: 0.325699 Jul 26 14:29:38.782125 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2325/4545] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:38 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 1348 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:29:39.803592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aa397bd9-ba32-410e-b557-ce096fc878d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:39.812329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-845cda7a-4d45-4d04-8d91-08f1e4204090 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:39.820184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-845cda7a-4d45-4d04-8d91-08f1e4204090 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:39.832045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aa397bd9-ba32-410e-b557-ce096fc878d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:39.859816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-845cda7a-4d45-4d04-8d91-08f1e4204090 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:39.860479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-845cda7a-4d45-4d04-8d91-08f1e4204090 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:39.861435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-845cda7a-4d45-4d04-8d91-08f1e4204090 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:39.862653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-845cda7a-4d45-4d04-8d91-08f1e4204090 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:39.866951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa397bd9-ba32-410e-b557-ce096fc878d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:39.875905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa397bd9-ba32-410e-b557-ce096fc878d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:39.880991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa397bd9-ba32-410e-b557-ce096fc878d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:39.881779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aa397bd9-ba32-410e-b557-ce096fc878d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:39.922516 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-845cda7a-4d45-4d04-8d91-08f1e4204090 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] HTTP exception thrown: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-845cda7a-4d45-4d04-8d91-08f1e4204090 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Request method failure captured: Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 HTTP/1.1 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_o3uVKtreTg02YWGFCscU-mDM8TokSjuC6pjk8P_yNhUEZbBFTPDo4kSFbLWR4-fpiVOT4CtExdAiVC7yUSe1O9CyxnJPgMJp0ZI_vCIOsKrUUvF26AXJoxrmw5PfQbODpxCSFDgrj4EpZ6pYiRagu8HKzxCEm-_5PfI2qemWFNB_k Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.21 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: bc0ddfed511a4f71886dfcb9211ed6a9 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-InstanceActionsV221TestJSON-113409433 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc0ddfed511a4f71886dfcb9211ed6a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bc0ddfed511a4f71886dfcb9211ed6a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bc0ddfed511a4f71886dfcb9211ed6a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc0ddfed511a4f71886dfcb9211ed6a9"}]}] Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-InstanceActionsV221TestJSON-113409433 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: bc0ddfed511a4f71886dfcb9211ed6a9 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-113409433 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-InstanceActionsV221TestJSON-113409433-project Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: fbfff61dbe554bc09670a4674201a299 Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-InstanceActionsV221TestJSON-113409433-project Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '01a6c0bf-2552-4066-ab74-f61f82c986e4'} Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:39.928850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:39.934330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:39.934330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:39.934330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:39.934330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:39.934330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:29:39.934330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:29:39.934330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:39.934330 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:39.937914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-845cda7a-4d45-4d04-8d91-08f1e4204090 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Returning 404 to user: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:29:39.940091 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-845cda7a-4d45-4d04-8d91-08f1e4204090 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 404 len: 111 microversion: 2.21 time: 0.132994 Jul 26 14:29:39.942227 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2326/4546] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:39 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:29:39.952671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0698fe36-51bc-4ec6-a26d-7aee25d8ad4c tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '.version_select at 0x7f8786c18c10>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:39.959389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0698fe36-51bc-4ec6-a26d-7aee25d8ad4c tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:39.978460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0698fe36-51bc-4ec6-a26d-7aee25d8ad4c tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:39.979629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0698fe36-51bc-4ec6-a26d-7aee25d8ad4c tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:39.980743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0698fe36-51bc-4ec6-a26d-7aee25d8ad4c tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:39.981426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0698fe36-51bc-4ec6-a26d-7aee25d8ad4c tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:40.170589 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0698fe36-51bc-4ec6-a26d-7aee25d8ad4c tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.222562 Jul 26 14:29:40.171979 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2327/4547] 10.222.0.70 () {60 vars in 1337 bytes} [Tue Jul 26 14:29:39 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4/os-instance-actions => generated 611 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:29:40.195284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e350aeb1-a33d-46cb-8a80-e96cfc0cb475 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:40.196231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e350aeb1-a33d-46cb-8a80-e96cfc0cb475 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:40.214409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e350aeb1-a33d-46cb-8a80-e96cfc0cb475 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:40.215033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e350aeb1-a33d-46cb-8a80-e96cfc0cb475 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:40.216015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e350aeb1-a33d-46cb-8a80-e96cfc0cb475 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:40.216663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e350aeb1-a33d-46cb-8a80-e96cfc0cb475 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:40.260785 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e350aeb1-a33d-46cb-8a80-e96cfc0cb475 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] HTTP exception thrown: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e350aeb1-a33d-46cb-8a80-e96cfc0cb475 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Request method failure captured: Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 HTTP/1.1 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_o3uVKtreTg02YWGFCscU-mDM8TokSjuC6pjk8P_yNhUEZbBFTPDo4kSFbLWR4-fpiVOT4CtExdAiVC7yUSe1O9CyxnJPgMJp0ZI_vCIOsKrUUvF26AXJoxrmw5PfQbODpxCSFDgrj4EpZ6pYiRagu8HKzxCEm-_5PfI2qemWFNB_k Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.21 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: bc0ddfed511a4f71886dfcb9211ed6a9 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-InstanceActionsV221TestJSON-113409433 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc0ddfed511a4f71886dfcb9211ed6a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bc0ddfed511a4f71886dfcb9211ed6a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bc0ddfed511a4f71886dfcb9211ed6a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc0ddfed511a4f71886dfcb9211ed6a9"}]}] Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-InstanceActionsV221TestJSON-113409433 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: bc0ddfed511a4f71886dfcb9211ed6a9 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-113409433 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-InstanceActionsV221TestJSON-113409433-project Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: fbfff61dbe554bc09670a4674201a299 Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-InstanceActionsV221TestJSON-113409433-project Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '01a6c0bf-2552-4066-ab74-f61f82c986e4'} Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:29:40.263145 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e350aeb1-a33d-46cb-8a80-e96cfc0cb475 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Returning 404 to user: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:29:40.269894 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e350aeb1-a33d-46cb-8a80-e96cfc0cb475 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "DELETE /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 404 len: 111 microversion: 2.21 time: 0.075772 Jul 26 14:29:40.270916 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2328/4548] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:29:40 2022] DELETE /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 14:29:40.280754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-799c4557-9e6e-406c-a452-e4a8b10c9684 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:40.281523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-799c4557-9e6e-406c-a452-e4a8b10c9684 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] [instance: 01a6c0bf-2552-4066-ab74-f61f82c986e4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:40.300455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-799c4557-9e6e-406c-a452-e4a8b10c9684 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:40.301055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-799c4557-9e6e-406c-a452-e4a8b10c9684 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:40.301996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-799c4557-9e6e-406c-a452-e4a8b10c9684 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:40.302560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-799c4557-9e6e-406c-a452-e4a8b10c9684 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:40.330113 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-799c4557-9e6e-406c-a452-e4a8b10c9684 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] HTTP exception thrown: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-799c4557-9e6e-406c-a452-e4a8b10c9684 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Request method failure captured: Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 HTTP/1.1 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_o3uVKtreTg02YWGFCscU-mDM8TokSjuC6pjk8P_yNhUEZbBFTPDo4kSFbLWR4-fpiVOT4CtExdAiVC7yUSe1O9CyxnJPgMJp0ZI_vCIOsKrUUvF26AXJoxrmw5PfQbODpxCSFDgrj4EpZ6pYiRagu8HKzxCEm-_5PfI2qemWFNB_k Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.21 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: bc0ddfed511a4f71886dfcb9211ed6a9 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-InstanceActionsV221TestJSON-113409433 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc0ddfed511a4f71886dfcb9211ed6a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bc0ddfed511a4f71886dfcb9211ed6a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bc0ddfed511a4f71886dfcb9211ed6a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bc0ddfed511a4f71886dfcb9211ed6a9"}]}] Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-InstanceActionsV221TestJSON-113409433 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: bc0ddfed511a4f71886dfcb9211ed6a9 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-113409433 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-InstanceActionsV221TestJSON-113409433-project Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: fbfff61dbe554bc09670a4674201a299 Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-InstanceActionsV221TestJSON-113409433-project Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '01a6c0bf-2552-4066-ab74-f61f82c986e4'} Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:40.341836 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:40.347283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:40.347283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:40.347283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:40.347283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:40.347283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:29:40.347283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:29:40.347283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. Jul 26 14:29:40.347283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:40.347283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-799c4557-9e6e-406c-a452-e4a8b10c9684 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] Returning 404 to user: Instance 01a6c0bf-2552-4066-ab74-f61f82c986e4 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:29:40.348488 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-799c4557-9e6e-406c-a452-e4a8b10c9684 tempest-InstanceActionsV221TestJSON-113409433 tempest-InstanceActionsV221TestJSON-113409433-project] 10.222.0.70 "GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4" status: 404 len: 111 microversion: 2.21 time: 0.071459 Jul 26 14:29:40.353943 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2329/4549] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:29:40 2022] GET /compute/v2.1/servers/01a6c0bf-2552-4066-ab74-f61f82c986e4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 14:29:41.272612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aa397bd9-ba32-410e-b557-ce096fc878d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:41.286688 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aa397bd9-ba32-410e-b557-ce096fc878d0 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1658 microversion: 2.1 time: 1.488802 Jul 26 14:29:41.287535 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2221/4550] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:39 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1658 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:41.313313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e42284e3-2efe-466d-97f8-985273567899 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:41.314043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e42284e3-2efe-466d-97f8-985273567899 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:41.333975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e42284e3-2efe-466d-97f8-985273567899 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:41.334427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e42284e3-2efe-466d-97f8-985273567899 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:41.335226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e42284e3-2efe-466d-97f8-985273567899 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:41.335678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e42284e3-2efe-466d-97f8-985273567899 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:41.487080 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e42284e3-2efe-466d-97f8-985273567899 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action" status: 202 len: 0 microversion: 2.1 time: 0.162632 Jul 26 14:29:41.494094 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2330/4551] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:29:41 2022] POST /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:29:41.500808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9a9a083d-5cb7-4de6-8778-729f2c4284a3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:41.501700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9a9a083d-5cb7-4de6-8778-729f2c4284a3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:41.529198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a9a083d-5cb7-4de6-8778-729f2c4284a3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:41.530003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a9a083d-5cb7-4de6-8778-729f2c4284a3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:41.533094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a9a083d-5cb7-4de6-8778-729f2c4284a3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:41.533847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a9a083d-5cb7-4de6-8778-729f2c4284a3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:42.543271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a9a083d-5cb7-4de6-8778-729f2c4284a3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:42.561299 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9a9a083d-5cb7-4de6-8778-729f2c4284a3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1664 microversion: 2.1 time: 1.065274 Jul 26 14:29:42.562043 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2222/4552] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:41 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1664 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:43.590616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-38187492-1435-4982-8084-2bac6215d9c3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:43.591422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-38187492-1435-4982-8084-2bac6215d9c3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:43.600603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38187492-1435-4982-8084-2bac6215d9c3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:43.601340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38187492-1435-4982-8084-2bac6215d9c3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:43.602961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38187492-1435-4982-8084-2bac6215d9c3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:43.603650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38187492-1435-4982-8084-2bac6215d9c3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:44.468933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-38187492-1435-4982-8084-2bac6215d9c3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:44.500116 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-38187492-1435-4982-8084-2bac6215d9c3 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1664 microversion: 2.1 time: 0.915211 Jul 26 14:29:44.512411 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2331/4553] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:43 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1664 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:29:45.528411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-608e37cf-10ab-4bf4-a704-43c4243a96b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:45.529696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-608e37cf-10ab-4bf4-a704-43c4243a96b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:45.555542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-608e37cf-10ab-4bf4-a704-43c4243a96b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:45.558670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-608e37cf-10ab-4bf4-a704-43c4243a96b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:45.560917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-608e37cf-10ab-4bf4-a704-43c4243a96b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:45.565170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-608e37cf-10ab-4bf4-a704-43c4243a96b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:46.613204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-608e37cf-10ab-4bf4-a704-43c4243a96b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:46.637791 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-608e37cf-10ab-4bf4-a704-43c4243a96b5 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 1.112936 Jul 26 14:29:46.638400 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2223/4554] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:45 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:46.665460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-16fc9b0d-1019-4103-a602-14b7875d7755 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:46.666432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-16fc9b0d-1019-4103-a602-14b7875d7755 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:46.677271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16fc9b0d-1019-4103-a602-14b7875d7755 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:46.679654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16fc9b0d-1019-4103-a602-14b7875d7755 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:46.682113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16fc9b0d-1019-4103-a602-14b7875d7755 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:46.685439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16fc9b0d-1019-4103-a602-14b7875d7755 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:47.218589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-16fc9b0d-1019-4103-a602-14b7875d7755 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:47.229661 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-16fc9b0d-1019-4103-a602-14b7875d7755 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1667 microversion: 2.1 time: 0.569379 Jul 26 14:29:47.234527 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2332/4555] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:46 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1667 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:47.255579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:47.256388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:47.267416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:47.280603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:47.283225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:47.283908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:47.348481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:29:47.360605 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.compute.api [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Working on deleting snapshot e6b04890-dfc9-43cf-b8b6-fbb9a1d9626c from shelved instance... Jul 26 14:29:48.748993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Doing local delete in cell b932038d-06d1-4ca1-bcc6-753a97a3adde(cell1) {{(pid=119478) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 26 14:29:48.749891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:48.751177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:48.753474 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.compute.api [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 26 14:29:48.761589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] deallocate_for_instance() {{(pid=119478) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 26 14:29:52.175260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-cb265731-4a5c-48da-a2b4-3175f57b75bd req-27f7536e-11cc-4e7f-82b8-59af8ab70d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c9375c-6932-4d7e-b1a5-66c3a4e0dc08", "name": "network-vif-deleted", "tag": "193321b3-40cd-45d6-a26e-50d30a86d727"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:52.186090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Updating instance_info_cache with network_info: [] {{(pid=119478) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 26 14:29:52.231481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-cb265731-4a5c-48da-a2b4-3175f57b75bd req-27f7536e-11cc-4e7f-82b8-59af8ab70d53 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:52.234351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-cb265731-4a5c-48da-a2b4-3175f57b75bd req-27f7536e-11cc-4e7f-82b8-59af8ab70d53 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:52.265477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.compute.server_external_events [req-cb265731-4a5c-48da-a2b4-3175f57b75bd req-27f7536e-11cc-4e7f-82b8-59af8ab70d53 service nova] Unable to find a host for instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08. Dropping event network-vif-deleted {{(pid=119479) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 14:29:52.272126 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-cb265731-4a5c-48da-a2b4-3175f57b75bd req-27f7536e-11cc-4e7f-82b8-59af8ab70d53 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.103754 Jul 26 14:29:52.299293 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2333/4556] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 127 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 14:29:52.918823 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fc604392-dcf9-4ccb-a417-6166ab5ff1a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "DELETE /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 204 len: 0 microversion: 2.1 time: 5.667323 Jul 26 14:29:52.928194 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2224/4557] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:29:47 2022] DELETE /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 0 bytes in 5674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:29:52.934636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d26e97b7-38d0-40ef-aed0-e5b35c54877c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:52.935268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d26e97b7-38d0-40ef-aed0-e5b35c54877c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:52.948977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d26e97b7-38d0-40ef-aed0-e5b35c54877c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:52.949440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d26e97b7-38d0-40ef-aed0-e5b35c54877c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:52.950235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d26e97b7-38d0-40ef-aed0-e5b35c54877c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:52.950677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d26e97b7-38d0-40ef-aed0-e5b35c54877c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:52.977342 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d26e97b7-38d0-40ef-aed0-e5b35c54877c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] HTTP exception thrown: Instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 could not be found. Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d26e97b7-38d0-40ef-aed0-e5b35c54877c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Request method failure captured: Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 HTTP/1.1 Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_gD_hLe4yYjyVRRD_eA6GVhdkfPxR8QWOGH5r8qlmzIDnMNdav7H6cyUjImiXrhQxfxZUH7cQ6O-Q_HjYXSEPjTnvG-AJV6AUujNzHf_5Z-iAfA8ca1KbgHCM97U_us5Qw6rHC7uf5VCZWiCK90aIkJmCVd8nu-zDxyCpI_B9PliI4 Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_991c7f82c09446409408ca9d0638fcba", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}] Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-472121431 Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7b5b7e30e280492b85d9c8f98fe09e43 Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 could not be found. Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '48c9375c-6932-4d7e-b1a5-66c3a4e0dc08'} Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 could not be found. Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 could not be found. Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:52.979286 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:52.983444 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:52.983444 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:52.983444 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:52.983444 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:29:52.983444 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:29:52.983444 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 could not be found. Jul 26 14:29:52.983444 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:52.985529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d26e97b7-38d0-40ef-aed0-e5b35c54877c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Returning 404 to user: Instance 48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:29:52.987577 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d26e97b7-38d0-40ef-aed0-e5b35c54877c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08" status: 404 len: 111 microversion: 2.1 time: 0.057630 Jul 26 14:29:52.988479 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2334/4558] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:52 2022] GET /compute/v2.1/servers/48c9375c-6932-4d7e-b1a5-66c3a4e0dc08 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:29:52.999127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aee02bd2-4604-4aee-b451-d419177b3452 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:52.999702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aee02bd2-4604-4aee-b451-d419177b3452 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:53.042798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aee02bd2-4604-4aee-b451-d419177b3452 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:53.043324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aee02bd2-4604-4aee-b451-d419177b3452 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:53.066606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aee02bd2-4604-4aee-b451-d419177b3452 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:53.067214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aee02bd2-4604-4aee-b451-d419177b3452 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:53.251495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aee02bd2-4604-4aee-b451-d419177b3452 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:29:53.402217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=19,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:29:53.522460 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aee02bd2-4604-4aee-b451-d419177b3452 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 204 len: 0 microversion: 2.1 time: 0.527917 Jul 26 14:29:53.529472 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2225/4559] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:29:52 2022] DELETE /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:29:53.538702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-02e945c9-e1ff-44b4-a089-4ceed27e13de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:53.539490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-02e945c9-e1ff-44b4-a089-4ceed27e13de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:53.555160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02e945c9-e1ff-44b4-a089-4ceed27e13de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:53.555930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02e945c9-e1ff-44b4-a089-4ceed27e13de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:53.557683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02e945c9-e1ff-44b4-a089-4ceed27e13de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:53.559314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02e945c9-e1ff-44b4-a089-4ceed27e13de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:53.814814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-02e945c9-e1ff-44b4-a089-4ceed27e13de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:53.831894 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-02e945c9-e1ff-44b4-a089-4ceed27e13de tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1466 microversion: 2.1 time: 0.297451 Jul 26 14:29:53.832941 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2335/4560] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:53 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1466 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:54.864324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-997f1455-9149-4234-9803-cca97ed18d3f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:54.865577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-997f1455-9149-4234-9803-cca97ed18d3f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:54.879577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-997f1455-9149-4234-9803-cca97ed18d3f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:54.880024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-997f1455-9149-4234-9803-cca97ed18d3f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:54.886662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-997f1455-9149-4234-9803-cca97ed18d3f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:54.887130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-997f1455-9149-4234-9803-cca97ed18d3f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:55.705240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-997f1455-9149-4234-9803-cca97ed18d3f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:55.716558 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-997f1455-9149-4234-9803-cca97ed18d3f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1466 microversion: 2.1 time: 0.857594 Jul 26 14:29:55.717406 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2226/4561] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:54 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1466 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:56.742308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4a292828-0d83-4855-943f-ad48e711639b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:56.743983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4a292828-0d83-4855-943f-ad48e711639b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:56.766138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a292828-0d83-4855-943f-ad48e711639b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:56.772714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a292828-0d83-4855-943f-ad48e711639b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:56.776321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a292828-0d83-4855-943f-ad48e711639b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:56.777724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a292828-0d83-4855-943f-ad48e711639b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:57.176582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4a292828-0d83-4855-943f-ad48e711639b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:57.207930 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4a292828-0d83-4855-943f-ad48e711639b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1466 microversion: 2.1 time: 0.466664 Jul 26 14:29:57.210067 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2336/4562] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:56 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1466 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:58.237450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f62db9b5-0672-4f21-9492-8e5c3651bd26 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:58.237450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f62db9b5-0672-4f21-9492-8e5c3651bd26 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:58.253307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f62db9b5-0672-4f21-9492-8e5c3651bd26 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:58.253794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f62db9b5-0672-4f21-9492-8e5c3651bd26 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:58.256864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f62db9b5-0672-4f21-9492-8e5c3651bd26 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:58.260012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f62db9b5-0672-4f21-9492-8e5c3651bd26 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:58.281258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-21d129ba-b77c-4c36-a2ca-c54d9caf4afa req-7516aa6d-dfa8-45ab-a2d6-97bb478aa5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d3f4f5-4795-48af-a84e-00b7bf0a0e34", "name": "network-vif-deleted", "tag": "2944c701-361b-4aeb-843d-be32b3e4ca8b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:29:58.306350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-21d129ba-b77c-4c36-a2ca-c54d9caf4afa req-7516aa6d-dfa8-45ab-a2d6-97bb478aa5ed service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:58.306827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-21d129ba-b77c-4c36-a2ca-c54d9caf4afa req-7516aa6d-dfa8-45ab-a2d6-97bb478aa5ed service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:58.332876 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-21d129ba-b77c-4c36-a2ca-c54d9caf4afa req-7516aa6d-dfa8-45ab-a2d6-97bb478aa5ed service nova] Creating event network-vif-deleted:2944c701-361b-4aeb-843d-be32b3e4ca8b for instance d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 on n-h1-833090-9 Jul 26 14:29:58.348967 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-21d129ba-b77c-4c36-a2ca-c54d9caf4afa req-7516aa6d-dfa8-45ab-a2d6-97bb478aa5ed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069484 Jul 26 14:29:58.354394 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2337/4563] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:29:58.504109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f62db9b5-0672-4f21-9492-8e5c3651bd26 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:29:58.517224 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f62db9b5-0672-4f21-9492-8e5c3651bd26 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 200 len: 1466 microversion: 2.1 time: 0.286061 Jul 26 14:29:58.521057 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2227/4564] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:58 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 1466 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:29:59.545400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7d976e9c-2b85-4d1b-b5d6-7c2692c1f514 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:59.546140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7d976e9c-2b85-4d1b-b5d6-7c2692c1f514 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: d3d3f4f5-4795-48af-a84e-00b7bf0a0e34] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:59.578953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d976e9c-2b85-4d1b-b5d6-7c2692c1f514 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:59.579404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d976e9c-2b85-4d1b-b5d6-7c2692c1f514 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:59.587030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d976e9c-2b85-4d1b-b5d6-7c2692c1f514 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:59.595843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d976e9c-2b85-4d1b-b5d6-7c2692c1f514 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:59.677764 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-7d976e9c-2b85-4d1b-b5d6-7c2692c1f514 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] HTTP exception thrown: Instance d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 could not be found. Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7d976e9c-2b85-4d1b-b5d6-7c2692c1f514 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Request method failure captured: Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 HTTP/1.1 Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_gD_hLe4yYjyVRRD_eA6GVhdkfPxR8QWOGH5r8qlmzIDnMNdav7H6cyUjImiXrhQxfxZUH7cQ6O-Q_HjYXSEPjTnvG-AJV6AUujNzHf_5Z-iAfA8ca1KbgHCM97U_us5Qw6rHC7uf5VCZWiCK90aIkJmCVd8nu-zDxyCpI_B9PliI4 Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_991c7f82c09446409408ca9d0638fcba", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}] Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-472121431 Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7b5b7e30e280492b85d9c8f98fe09e43 Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 could not be found. Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd3d3f4f5-4795-48af-a84e-00b7bf0a0e34'} Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 could not be found. Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 could not be found. Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:29:59.686776 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:59.691581 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:29:59.691581 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:29:59.691581 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:29:59.691581 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:29:59.691581 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:29:59.691581 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 could not be found. Jul 26 14:29:59.691581 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:29:59.693690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7d976e9c-2b85-4d1b-b5d6-7c2692c1f514 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Returning 404 to user: Instance d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:29:59.697727 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7d976e9c-2b85-4d1b-b5d6-7c2692c1f514 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34" status: 404 len: 111 microversion: 2.1 time: 0.157393 Jul 26 14:29:59.701848 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2338/4565] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:29:59 2022] GET /compute/v2.1/servers/d3d3f4f5-4795-48af-a84e-00b7bf0a0e34 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:29:59.710797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3490ae4a-40df-4b5b-a638-5fbcb67c8acd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:29:59.711770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3490ae4a-40df-4b5b-a638-5fbcb67c8acd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:29:59.735749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3490ae4a-40df-4b5b-a638-5fbcb67c8acd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:59.736251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3490ae4a-40df-4b5b-a638-5fbcb67c8acd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:59.737067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3490ae4a-40df-4b5b-a638-5fbcb67c8acd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:29:59.737535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3490ae4a-40df-4b5b-a638-5fbcb67c8acd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:29:59.832443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3490ae4a-40df-4b5b-a638-5fbcb67c8acd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:29:59.999630 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3490ae4a-40df-4b5b-a638-5fbcb67c8acd tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "DELETE /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 204 len: 0 microversion: 2.1 time: 0.293018 Jul 26 14:30:00.000351 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2228/4566] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:29:59 2022] DELETE /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:30:00.010608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-340aa9cf-b7ea-4c91-a271-67e783e8d3c6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:00.011337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-340aa9cf-b7ea-4c91-a271-67e783e8d3c6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:00.030244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-340aa9cf-b7ea-4c91-a271-67e783e8d3c6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:00.030911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-340aa9cf-b7ea-4c91-a271-67e783e8d3c6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:00.031830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-340aa9cf-b7ea-4c91-a271-67e783e8d3c6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:00.034328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-340aa9cf-b7ea-4c91-a271-67e783e8d3c6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:02.543503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-340aa9cf-b7ea-4c91-a271-67e783e8d3c6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:02.560476 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-340aa9cf-b7ea-4c91-a271-67e783e8d3c6 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1507 microversion: 2.1 time: 2.555474 Jul 26 14:30:02.561697 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2339/4567] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:00 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1507 bytes in 2557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:03.597762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-49b8fb81-c2a8-46d8-be31-d9d38da98e50 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:03.603287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-49b8fb81-c2a8-46d8-be31-d9d38da98e50 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:03.622027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49b8fb81-c2a8-46d8-be31-d9d38da98e50 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:03.630006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49b8fb81-c2a8-46d8-be31-d9d38da98e50 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:03.635597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49b8fb81-c2a8-46d8-be31-d9d38da98e50 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:03.637919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49b8fb81-c2a8-46d8-be31-d9d38da98e50 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:04.121510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-49b8fb81-c2a8-46d8-be31-d9d38da98e50 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:04.137343 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-49b8fb81-c2a8-46d8-be31-d9d38da98e50 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1465 microversion: 2.1 time: 0.551145 Jul 26 14:30:04.138026 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2229/4568] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:03 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1465 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:04.283713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-60e07b01-af2d-4333-93d4-3a5e2ee8739f req-ac84cbb4-854b-4d44-83b0-fee40e5d24aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ae26a2-843c-41a1-81e3-6a3f68715198", "name": "network-vif-deleted", "tag": "f78e74aa-99f8-48f8-9979-6215ff449103"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:04.292835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:04.302727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-60e07b01-af2d-4333-93d4-3a5e2ee8739f req-ac84cbb4-854b-4d44-83b0-fee40e5d24aa service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:04.303789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-60e07b01-af2d-4333-93d4-3a5e2ee8739f req-ac84cbb4-854b-4d44-83b0-fee40e5d24aa service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:04.317620 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-60e07b01-af2d-4333-93d4-3a5e2ee8739f req-ac84cbb4-854b-4d44-83b0-fee40e5d24aa service nova] Creating event network-vif-deleted:f78e74aa-99f8-48f8-9979-6215ff449103 for instance 71ae26a2-843c-41a1-81e3-6a3f68715198 on n-h2-833090-9 Jul 26 14:30:04.324669 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-60e07b01-af2d-4333-93d4-3a5e2ee8739f req-ac84cbb4-854b-4d44-83b0-fee40e5d24aa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045886 Jul 26 14:30:04.326344 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2340/4569] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:05.160225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:05.161445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:05.183846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:05.184730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:05.185693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:05.186302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:05.274903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:05.275937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:05.276774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lazy-loading 'fault' on Instance uuid 71ae26a2-843c-41a1-81e3-6a3f68715198 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:30:05.396900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:05.412105 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-83b23817-86b7-4135-b436-fe786907b686 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 200 len: 1305 microversion: 2.1 time: 0.256740 Jul 26 14:30:05.428856 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2230/4570] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:05 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 1305 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:06.444186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ee7e2cd8-cd6a-4883-8981-ab7e15d041da tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:06.445219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ee7e2cd8-cd6a-4883-8981-ab7e15d041da tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 71ae26a2-843c-41a1-81e3-6a3f68715198] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:06.463675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee7e2cd8-cd6a-4883-8981-ab7e15d041da tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:06.467430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee7e2cd8-cd6a-4883-8981-ab7e15d041da tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:06.468914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee7e2cd8-cd6a-4883-8981-ab7e15d041da tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:06.469402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ee7e2cd8-cd6a-4883-8981-ab7e15d041da tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:06.509658 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-ee7e2cd8-cd6a-4883-8981-ab7e15d041da tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] HTTP exception thrown: Instance 71ae26a2-843c-41a1-81e3-6a3f68715198 could not be found. Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ee7e2cd8-cd6a-4883-8981-ab7e15d041da tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Request method failure captured: Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 HTTP/1.1 Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_gD_hLe4yYjyVRRD_eA6GVhdkfPxR8QWOGH5r8qlmzIDnMNdav7H6cyUjImiXrhQxfxZUH7cQ6O-Q_HjYXSEPjTnvG-AJV6AUujNzHf_5Z-iAfA8ca1KbgHCM97U_us5Qw6rHC7uf5VCZWiCK90aIkJmCVd8nu-zDxyCpI_B9PliI4 Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_991c7f82c09446409408ca9d0638fcba", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}] Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-472121431 Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 7b5b7e30e280492b85d9c8f98fe09e43 Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 71ae26a2-843c-41a1-81e3-6a3f68715198 could not be found. Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '71ae26a2-843c-41a1-81e3-6a3f68715198'} Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ae26a2-843c-41a1-81e3-6a3f68715198 could not be found. Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ae26a2-843c-41a1-81e3-6a3f68715198 could not be found. Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:06.516849 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:06.520952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:06.520952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:06.520952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:06.520952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:30:06.520952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:30:06.520952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ae26a2-843c-41a1-81e3-6a3f68715198 could not be found. Jul 26 14:30:06.520952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:06.520952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ee7e2cd8-cd6a-4883-8981-ab7e15d041da tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Returning 404 to user: Instance 71ae26a2-843c-41a1-81e3-6a3f68715198 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:06.520952 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ee7e2cd8-cd6a-4883-8981-ab7e15d041da tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198" status: 404 len: 111 microversion: 2.1 time: 0.080570 Jul 26 14:30:06.523078 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2341/4571] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:06 2022] GET /compute/v2.1/servers/71ae26a2-843c-41a1-81e3-6a3f68715198 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:30:06.531012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c8e08881-d899-483b-bd1d-fa4f77a629e2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:06.531574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c8e08881-d899-483b-bd1d-fa4f77a629e2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:06.534911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:06.566327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8e08881-d899-483b-bd1d-fa4f77a629e2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:06.566784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8e08881-d899-483b-bd1d-fa4f77a629e2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:06.567583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8e08881-d899-483b-bd1d-fa4f77a629e2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:06.568051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8e08881-d899-483b-bd1d-fa4f77a629e2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:06.648949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c8e08881-d899-483b-bd1d-fa4f77a629e2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:30:06.839372 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c8e08881-d899-483b-bd1d-fa4f77a629e2 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "DELETE /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 204 len: 0 microversion: 2.1 time: 0.311849 Jul 26 14:30:06.844433 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2231/4572] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:30:06 2022] DELETE /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:30:06.851057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1fef8447-11db-4764-8edf-6bb0677f646f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:06.851984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1fef8447-11db-4764-8edf-6bb0677f646f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:06.865973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fef8447-11db-4764-8edf-6bb0677f646f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:06.870729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fef8447-11db-4764-8edf-6bb0677f646f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:06.871734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fef8447-11db-4764-8edf-6bb0677f646f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:06.872220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fef8447-11db-4764-8edf-6bb0677f646f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:09.729027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1fef8447-11db-4764-8edf-6bb0677f646f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:09.739230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:09.749464 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1fef8447-11db-4764-8edf-6bb0677f646f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1493 microversion: 2.1 time: 2.897972 Jul 26 14:30:09.750573 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2342/4573] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:06 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1493 bytes in 2905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:10.509031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6aeed6e3-6708-4ac3-922b-4454f4dad6af tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dab26cd5-17c2-4e05-ae3f-cdcf2af139a6"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:10.511885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6aeed6e3-6708-4ac3-922b-4454f4dad6af tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:10.527229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6aeed6e3-6708-4ac3-922b-4454f4dad6af tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:10.534777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6aeed6e3-6708-4ac3-922b-4454f4dad6af tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:10.536024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6aeed6e3-6708-4ac3-922b-4454f4dad6af tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:10.536641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6aeed6e3-6708-4ac3-922b-4454f4dad6af tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:10.773694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27323479-2c04-41de-9c12-6595cb3e7497 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:10.774902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27323479-2c04-41de-9c12-6595cb3e7497 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:10.846610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27323479-2c04-41de-9c12-6595cb3e7497 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:10.848881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27323479-2c04-41de-9c12-6595cb3e7497 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:10.850354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27323479-2c04-41de-9c12-6595cb3e7497 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:10.851111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27323479-2c04-41de-9c12-6595cb3e7497 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:11.055852 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6aeed6e3-6708-4ac3-922b-4454f4dad6af tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "POST /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550581 Jul 26 14:30:11.057672 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2232/4574] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:30:10 2022] POST /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-volume_attachments => generated 194 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:11.707749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27323479-2c04-41de-9c12-6595cb3e7497 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:11.720881 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27323479-2c04-41de-9c12-6595cb3e7497 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1451 microversion: 2.1 time: 0.953662 Jul 26 14:30:11.741845 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2343/4575] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:10 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1451 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:12.362252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-1e32d94a-671b-439d-b4de-33c2a727a0c0 req-d321d6ae-d56f-418d-828e-7f0bfb493f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08201385-1b2e-4fcd-95d4-ae2473256860", "name": "network-vif-deleted", "tag": "34ec0ab6-21f2-4baa-b538-eeee85ef60cc"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:12.405789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1e32d94a-671b-439d-b4de-33c2a727a0c0 req-d321d6ae-d56f-418d-828e-7f0bfb493f2f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:12.408609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1e32d94a-671b-439d-b4de-33c2a727a0c0 req-d321d6ae-d56f-418d-828e-7f0bfb493f2f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:12.457426 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-1e32d94a-671b-439d-b4de-33c2a727a0c0 req-d321d6ae-d56f-418d-828e-7f0bfb493f2f service nova] Creating event network-vif-deleted:34ec0ab6-21f2-4baa-b538-eeee85ef60cc for instance 08201385-1b2e-4fcd-95d4-ae2473256860 on n-h1-833090-9 Jul 26 14:30:12.484287 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-1e32d94a-671b-439d-b4de-33c2a727a0c0 req-d321d6ae-d56f-418d-828e-7f0bfb493f2f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121456 Jul 26 14:30:12.485622 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2233/4576] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:12.747535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:12.748931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:12.766624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:12.769152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:12.771629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:12.776743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:12.934181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:12.937033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:12.937515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lazy-loading 'fault' on Instance uuid 08201385-1b2e-4fcd-95d4-ae2473256860 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:30:13.310117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:13.317631 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57fbca24-d920-4a51-b8b6-ffba6701301f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 200 len: 1304 microversion: 2.1 time: 0.574597 Jul 26 14:30:13.339834 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2344/4577] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:12 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 1304 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:14.343652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-232b50f7-121f-44c6-96a2-245ae4dd44af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:14.344598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-232b50f7-121f-44c6-96a2-245ae4dd44af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: 08201385-1b2e-4fcd-95d4-ae2473256860] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:14.364384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-232b50f7-121f-44c6-96a2-245ae4dd44af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:14.364845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-232b50f7-121f-44c6-96a2-245ae4dd44af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:14.365641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-232b50f7-121f-44c6-96a2-245ae4dd44af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:14.366153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-232b50f7-121f-44c6-96a2-245ae4dd44af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:14.435739 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-232b50f7-121f-44c6-96a2-245ae4dd44af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] HTTP exception thrown: Instance 08201385-1b2e-4fcd-95d4-ae2473256860 could not be found. Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-232b50f7-121f-44c6-96a2-245ae4dd44af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Request method failure captured: Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 HTTP/1.1 Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_gD_hLe4yYjyVRRD_eA6GVhdkfPxR8QWOGH5r8qlmzIDnMNdav7H6cyUjImiXrhQxfxZUH7cQ6O-Q_HjYXSEPjTnvG-AJV6AUujNzHf_5Z-iAfA8ca1KbgHCM97U_us5Qw6rHC7uf5VCZWiCK90aIkJmCVd8nu-zDxyCpI_B9PliI4 Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_991c7f82c09446409408ca9d0638fcba", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}] Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerActionsTestJSON-472121431 Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7b5b7e30e280492b85d9c8f98fe09e43 Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 08201385-1b2e-4fcd-95d4-ae2473256860 could not be found. Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '08201385-1b2e-4fcd-95d4-ae2473256860'} Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08201385-1b2e-4fcd-95d4-ae2473256860 could not be found. Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08201385-1b2e-4fcd-95d4-ae2473256860 could not be found. Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:14.446187 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:14.451538 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:14.451538 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:14.451538 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:14.451538 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:30:14.451538 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:30:14.451538 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08201385-1b2e-4fcd-95d4-ae2473256860 could not be found. Jul 26 14:30:14.451538 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:14.451538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-232b50f7-121f-44c6-96a2-245ae4dd44af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Returning 404 to user: Instance 08201385-1b2e-4fcd-95d4-ae2473256860 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:14.451538 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-232b50f7-121f-44c6-96a2-245ae4dd44af tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860" status: 404 len: 111 microversion: 2.1 time: 0.109271 Jul 26 14:30:14.455176 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2234/4578] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:14 2022] GET /compute/v2.1/servers/08201385-1b2e-4fcd-95d4-ae2473256860 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:30:14.456556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5105e97-4382-4617-821b-7a371ee99c74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:14.457064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d5105e97-4382-4617-821b-7a371ee99c74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:14.473470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5105e97-4382-4617-821b-7a371ee99c74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:14.473968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5105e97-4382-4617-821b-7a371ee99c74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:14.484274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5105e97-4382-4617-821b-7a371ee99c74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:14.486803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5105e97-4382-4617-821b-7a371ee99c74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:14.607583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d5105e97-4382-4617-821b-7a371ee99c74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:30:14.844265 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5105e97-4382-4617-821b-7a371ee99c74 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 204 len: 0 microversion: 2.1 time: 0.390948 Jul 26 14:30:14.846826 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2345/4579] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:30:14 2022] DELETE /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:30:14.866759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5813008c-bbff-4d4e-80b8-9ac6baaa04c8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:14.869915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5813008c-bbff-4d4e-80b8-9ac6baaa04c8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:14.901468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5813008c-bbff-4d4e-80b8-9ac6baaa04c8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:14.902547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5813008c-bbff-4d4e-80b8-9ac6baaa04c8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:14.903519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5813008c-bbff-4d4e-80b8-9ac6baaa04c8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:14.908464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5813008c-bbff-4d4e-80b8-9ac6baaa04c8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:15.652835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-527989037", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "1a4b9ec0-389b-4373-be2a-c978e4d77c7a"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:15.828873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5813008c-bbff-4d4e-80b8-9ac6baaa04c8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:15.845205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] validate_networks() for [('1a4b9ec0-389b-4373-be2a-c978e4d77c7a', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:30:15.852741 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5813008c-bbff-4d4e-80b8-9ac6baaa04c8 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1673 microversion: 2.1 time: 0.999220 Jul 26 14:30:15.876509 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2346/4580] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:14 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1673 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:16.888833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fe586899-b6a0-472e-8f1b-61aa7429e4a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:16.890527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fe586899-b6a0-472e-8f1b-61aa7429e4a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:16.937149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe586899-b6a0-472e-8f1b-61aa7429e4a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:16.938456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe586899-b6a0-472e-8f1b-61aa7429e4a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:16.941953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe586899-b6a0-472e-8f1b-61aa7429e4a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:16.946505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe586899-b6a0-472e-8f1b-61aa7429e4a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:19.275618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fe586899-b6a0-472e-8f1b-61aa7429e4a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:19.287144 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fe586899-b6a0-472e-8f1b-61aa7429e4a9 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1673 microversion: 2.1 time: 2.402562 Jul 26 14:30:19.302911 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2347/4581] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:16 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1673 bytes in 2419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:20.319320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-42e485bc-d358-42f9-b879-c21f4754166c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:20.323565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-42e485bc-d358-42f9-b879-c21f4754166c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:20.343394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42e485bc-d358-42f9-b879-c21f4754166c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:20.343868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42e485bc-d358-42f9-b879-c21f4754166c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:20.344715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42e485bc-d358-42f9-b879-c21f4754166c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:20.345167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42e485bc-d358-42f9-b879-c21f4754166c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:21.186413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:30:21.186974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:30:21.187233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:30:21.187651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:30:21.188681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:30:21.203663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:21.203663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:21.204090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:21.204538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:21.287099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Getting quotas for project bf8f783db8ee4e9c8dbca2cae717f059. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:30:21.303793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Getting quotas for user 0a08edc430f44ad5bd674fe056b33319 and project bf8f783db8ee4e9c8dbca2cae717f059. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:30:21.344807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:30:21.364055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:30:21.376058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-42e485bc-d358-42f9-b879-c21f4754166c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:21.390422 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-42e485bc-d358-42f9-b879-c21f4754166c tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1673 microversion: 2.1 time: 1.078873 Jul 26 14:30:21.409435 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2348/4582] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:20 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1673 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:21.535842 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-99c72d84-51eb-4d9a-befa-a5eb4c55b543 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.780234 Jul 26 14:30:21.536517 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2235/4583] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:30:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 6782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:30:21.548776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-91e81330-fc53-4a15-8205-3b8b7113f0d9 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:21.549615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-91e81330-fc53-4a15-8205-3b8b7113f0d9 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:22.002184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-91e81330-fc53-4a15-8205-3b8b7113f0d9 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:22.012146 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-91e81330-fc53-4a15-8205-3b8b7113f0d9 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1215 microversion: 2.1 time: 0.466049 Jul 26 14:30:22.016874 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2349/4584] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:21 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1215 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:22.414251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-613f681d-0f31-4fbc-8288-dbf929686b4b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:22.414980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-613f681d-0f31-4fbc-8288-dbf929686b4b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:22.440216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-613f681d-0f31-4fbc-8288-dbf929686b4b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:22.440706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-613f681d-0f31-4fbc-8288-dbf929686b4b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:22.445648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-613f681d-0f31-4fbc-8288-dbf929686b4b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:22.446413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-613f681d-0f31-4fbc-8288-dbf929686b4b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:22.667832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-499269903", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:22.751108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] validate_networks() for [('8e8d2033-2cf7-4cbe-8fc9-f923c27160ff', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:30:22.752027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-613f681d-0f31-4fbc-8288-dbf929686b4b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:22.765300 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-613f681d-0f31-4fbc-8288-dbf929686b4b tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1606 microversion: 2.1 time: 0.356102 Jul 26 14:30:22.765951 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2350/4585] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:22 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1606 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:23.045862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1dafa65f-d21f-4ab1-bcd6-88f77ef43bd6 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:23.045862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1dafa65f-d21f-4ab1-bcd6-88f77ef43bd6 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:23.066883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dafa65f-d21f-4ab1-bcd6-88f77ef43bd6 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:23.067893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dafa65f-d21f-4ab1-bcd6-88f77ef43bd6 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:23.070796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dafa65f-d21f-4ab1-bcd6-88f77ef43bd6 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:23.071545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dafa65f-d21f-4ab1-bcd6-88f77ef43bd6 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:23.296506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1dafa65f-d21f-4ab1-bcd6-88f77ef43bd6 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:23.333199 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1dafa65f-d21f-4ab1-bcd6-88f77ef43bd6 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1267 microversion: 2.1 time: 0.284368 Jul 26 14:30:23.343578 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2351/4586] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:23 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:23.788023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d089f4e5-40a5-402f-af6c-dbcdddd8864f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:23.789609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d089f4e5-40a5-402f-af6c-dbcdddd8864f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:23.808681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d089f4e5-40a5-402f-af6c-dbcdddd8864f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:23.811732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d089f4e5-40a5-402f-af6c-dbcdddd8864f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:23.812771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d089f4e5-40a5-402f-af6c-dbcdddd8864f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:23.813382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d089f4e5-40a5-402f-af6c-dbcdddd8864f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:25.037996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d089f4e5-40a5-402f-af6c-dbcdddd8864f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b5b7e30e280492b85d9c8f98fe09e43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '991c7f82c09446409408ca9d0638fcba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:25.058093 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d089f4e5-40a5-402f-af6c-dbcdddd8864f tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 200 len: 1606 microversion: 2.1 time: 1.274902 Jul 26 14:30:25.072359 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2352/4587] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:23 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 1606 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:25.079249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-51d7a9a9-67b4-4c58-86f4-262ec47b31b5 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:25.079876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-51d7a9a9-67b4-4c58-86f4-262ec47b31b5 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:25.103905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51d7a9a9-67b4-4c58-86f4-262ec47b31b5 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:25.104921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51d7a9a9-67b4-4c58-86f4-262ec47b31b5 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:25.105726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51d7a9a9-67b4-4c58-86f4-262ec47b31b5 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:25.106174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51d7a9a9-67b4-4c58-86f4-262ec47b31b5 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:25.376347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-51d7a9a9-67b4-4c58-86f4-262ec47b31b5 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:25.390601 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-51d7a9a9-67b4-4c58-86f4-262ec47b31b5 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1273 microversion: 2.1 time: 0.314691 Jul 26 14:30:25.404183 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2353/4588] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:25 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1273 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:25.416491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-03142078-4ed3-4540-80cd-8ebb1804810d req-8a99af5d-acb5-4a96-8c36-0c165941fb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c584bb0a-2fbb-4014-9f21-bcb83a0068c0", "name": "network-vif-deleted", "tag": "3ba17f96-9407-49f5-8771-0ba49b9937c1"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:25.454105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-03142078-4ed3-4540-80cd-8ebb1804810d req-8a99af5d-acb5-4a96-8c36-0c165941fb53 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:25.454560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-03142078-4ed3-4540-80cd-8ebb1804810d req-8a99af5d-acb5-4a96-8c36-0c165941fb53 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:25.502668 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-03142078-4ed3-4540-80cd-8ebb1804810d req-8a99af5d-acb5-4a96-8c36-0c165941fb53 service nova] Creating event network-vif-deleted:3ba17f96-9407-49f5-8771-0ba49b9937c1 for instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 on n-h1-833090-9 Jul 26 14:30:25.517077 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-03142078-4ed3-4540-80cd-8ebb1804810d req-8a99af5d-acb5-4a96-8c36-0c165941fb53 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111482 Jul 26 14:30:25.526047 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2354/4589] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:25.670197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:30:25.671489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:30:25.672212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:30:25.672819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:30:25.680173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:30:25.721856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:25.722823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:25.725036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:25.733260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:25.759877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=72,nova_cell1:UPDATE=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:25.802781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Getting quotas for project 10d1bb24d6cf4d2dad1cad97a2f94073. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:30:25.817258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Getting quotas for user c4c6f1d210ee485fb1d351dc376637e9 and project 10d1bb24d6cf4d2dad1cad97a2f94073. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:30:25.868557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:30:25.871424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:30:26.005271 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cbc6bf9b-4e61-4480-9456-a03240049ebc tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.684387 Jul 26 14:30:26.007134 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2236/4590] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:30:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:30:26.051469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90e3f276-df1f-43bf-a7d7-ed6d7105e3fe tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:26.057345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-90e3f276-df1f-43bf-a7d7-ed6d7105e3fe tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:26.094236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef0fa494-8a23-4828-bca6-cdfd143db742 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:26.097959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ef0fa494-8a23-4828-bca6-cdfd143db742 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] [instance: c584bb0a-2fbb-4014-9f21-bcb83a0068c0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:26.113978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0fa494-8a23-4828-bca6-cdfd143db742 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:26.114442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0fa494-8a23-4828-bca6-cdfd143db742 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:26.116086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0fa494-8a23-4828-bca6-cdfd143db742 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:26.123633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0fa494-8a23-4828-bca6-cdfd143db742 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:26.169849 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ef0fa494-8a23-4828-bca6-cdfd143db742 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] HTTP exception thrown: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 could not be found. Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef0fa494-8a23-4828-bca6-cdfd143db742 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Request method failure captured: Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 HTTP/1.1 Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_gD_hLe4yYjyVRRD_eA6GVhdkfPxR8QWOGH5r8qlmzIDnMNdav7H6cyUjImiXrhQxfxZUH7cQ6O-Q_HjYXSEPjTnvG-AJV6AUujNzHf_5Z-iAfA8ca1KbgHCM97U_us5Qw6rHC7uf5VCZWiCK90aIkJmCVd8nu-zDxyCpI_B9PliI4 Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/991c7f82c09446409408ca9d0638fcba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_991c7f82c09446409408ca9d0638fcba", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/991c7f82c09446409408ca9d0638fcba"}]}] Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerActionsTestJSON-472121431 Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 991c7f82c09446409408ca9d0638fcba Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerActionsTestJSON-472121431 Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 7b5b7e30e280492b85d9c8f98fe09e43 Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerActionsTestJSON-472121431-project Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 could not be found. Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c584bb0a-2fbb-4014-9f21-bcb83a0068c0'} Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 could not be found. Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 could not be found. Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:26.171846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:26.176167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:26.176167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:26.176167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:26.176167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:30:26.176167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:30:26.176167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 could not be found. Jul 26 14:30:26.176167 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:26.176969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef0fa494-8a23-4828-bca6-cdfd143db742 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Returning 404 to user: Instance c584bb0a-2fbb-4014-9f21-bcb83a0068c0 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:26.178354 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ef0fa494-8a23-4828-bca6-cdfd143db742 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0" status: 404 len: 111 microversion: 2.1 time: 0.088224 Jul 26 14:30:26.182995 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2237/4591] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:26 2022] GET /compute/v2.1/servers/c584bb0a-2fbb-4014-9f21-bcb83a0068c0 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:30:26.196301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff4819ed-7bdb-451e-91b7-3793fb54caf1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] Calling method '.version_select at 0x7f8786df5700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:26.263187 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff4819ed-7bdb-451e-91b7-3793fb54caf1 tempest-ServerActionsTestJSON-472121431 tempest-ServerActionsTestJSON-472121431-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071702475" status: 202 len: 0 microversion: 2.1 time: 0.078856 Jul 26 14:30:26.263925 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2238/4592] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:30:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071702475 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:30:26.425440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4f44e50d-804a-4f45-80d0-e55f603387ba tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:26.433959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4f44e50d-804a-4f45-80d0-e55f603387ba tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:26.451873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90e3f276-df1f-43bf-a7d7-ed6d7105e3fe tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:26.468089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f44e50d-804a-4f45-80d0-e55f603387ba tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:26.468876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f44e50d-804a-4f45-80d0-e55f603387ba tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:26.471744 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90e3f276-df1f-43bf-a7d7-ed6d7105e3fe tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1223 microversion: 2.1 time: 0.444457 Jul 26 14:30:26.472015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f44e50d-804a-4f45-80d0-e55f603387ba tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:26.472715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f44e50d-804a-4f45-80d0-e55f603387ba tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:26.484285 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2355/4593] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:26 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1223 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:26.765662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4f44e50d-804a-4f45-80d0-e55f603387ba tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:26.785523 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4f44e50d-804a-4f45-80d0-e55f603387ba tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1273 microversion: 2.1 time: 0.370023 Jul 26 14:30:26.787849 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2239/4594] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:26 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1273 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:27.520255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da361208-d7c2-46e9-be8f-f72c159296b5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:27.520856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-da361208-d7c2-46e9-be8f-f72c159296b5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:27.544907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da361208-d7c2-46e9-be8f-f72c159296b5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:27.547071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da361208-d7c2-46e9-be8f-f72c159296b5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:27.550614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da361208-d7c2-46e9-be8f-f72c159296b5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:27.552373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da361208-d7c2-46e9-be8f-f72c159296b5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:27.809513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8e1e5956-b984-42cc-9aa4-c0b28be76be0 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:27.810882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8e1e5956-b984-42cc-9aa4-c0b28be76be0 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:27.825783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e1e5956-b984-42cc-9aa4-c0b28be76be0 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:27.828734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e1e5956-b984-42cc-9aa4-c0b28be76be0 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:27.829757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e1e5956-b984-42cc-9aa4-c0b28be76be0 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:27.831574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e1e5956-b984-42cc-9aa4-c0b28be76be0 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:27.998954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da361208-d7c2-46e9-be8f-f72c159296b5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:28.038184 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-da361208-d7c2-46e9-be8f-f72c159296b5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1219 microversion: 2.1 time: 0.522481 Jul 26 14:30:28.058694 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2356/4595] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:27 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1219 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:28.126316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8e1e5956-b984-42cc-9aa4-c0b28be76be0 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:28.140947 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8e1e5956-b984-42cc-9aa4-c0b28be76be0 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1273 microversion: 2.1 time: 0.330698 Jul 26 14:30:28.142295 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2240/4596] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:27 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:29.074289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6b08546e-2f50-42b3-b69d-a74af0a075ae tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:29.076971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6b08546e-2f50-42b3-b69d-a74af0a075ae tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:29.099078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b08546e-2f50-42b3-b69d-a74af0a075ae tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:29.099832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b08546e-2f50-42b3-b69d-a74af0a075ae tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:29.102094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b08546e-2f50-42b3-b69d-a74af0a075ae tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:29.104020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b08546e-2f50-42b3-b69d-a74af0a075ae tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:29.172348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-324f1092-e4e6-4e8e-ba51-5ee6b4a0c5be tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:29.173902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-324f1092-e4e6-4e8e-ba51-5ee6b4a0c5be tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:29.190207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-324f1092-e4e6-4e8e-ba51-5ee6b4a0c5be tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:29.193526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-324f1092-e4e6-4e8e-ba51-5ee6b4a0c5be tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:29.198450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-324f1092-e4e6-4e8e-ba51-5ee6b4a0c5be tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:29.199232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-324f1092-e4e6-4e8e-ba51-5ee6b4a0c5be tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:29.621782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6b08546e-2f50-42b3-b69d-a74af0a075ae tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:29.633796 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6b08546e-2f50-42b3-b69d-a74af0a075ae tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1281 microversion: 2.1 time: 0.574421 Jul 26 14:30:29.635216 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2357/4597] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:29 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1281 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:30.184202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1797121863", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "0cc50ad8-aec5-44d3-ae0e-96c5ed8470ad"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:30.328539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] validate_networks() for [('0cc50ad8-aec5-44d3-ae0e-96c5ed8470ad', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:30:31.791697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-324f1092-e4e6-4e8e-ba51-5ee6b4a0c5be tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:31.808642 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-324f1092-e4e6-4e8e-ba51-5ee6b4a0c5be tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1315 microversion: 2.1 time: 2.644006 Jul 26 14:30:31.825244 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2241/4598] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:29 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1315 bytes in 2661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:31.837593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d7cfd68-bee0-49c7-82d7-91137b30ae2f tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:31.846199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8d7cfd68-bee0-49c7-82d7-91137b30ae2f tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:31.879664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d7cfd68-bee0-49c7-82d7-91137b30ae2f tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:31.883589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d7cfd68-bee0-49c7-82d7-91137b30ae2f tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:31.890538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d7cfd68-bee0-49c7-82d7-91137b30ae2f tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:31.891316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d7cfd68-bee0-49c7-82d7-91137b30ae2f tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:32.093473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d7cfd68-bee0-49c7-82d7-91137b30ae2f tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:32.116181 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d7cfd68-bee0-49c7-82d7-91137b30ae2f tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1281 microversion: 2.1 time: 0.288949 Jul 26 14:30:32.120928 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2242/4599] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:31 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1281 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:32.837751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ea96ed5-d98d-4ad4-b1be-06e9ec200108 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:32.839061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ea96ed5-d98d-4ad4-b1be-06e9ec200108 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:32.877311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ea96ed5-d98d-4ad4-b1be-06e9ec200108 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:32.881882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ea96ed5-d98d-4ad4-b1be-06e9ec200108 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:32.885038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ea96ed5-d98d-4ad4-b1be-06e9ec200108 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:32.887201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ea96ed5-d98d-4ad4-b1be-06e9ec200108 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:33.856136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:30:33.857413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:30:33.858202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:30:33.858845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:30:33.859559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:30:33.879383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:33.886344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:33.887904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:33.890008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:33.941732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Getting quotas for project 9237dcfb14cf43598b4dab920691e6fe. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:30:33.957671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Getting quotas for user 38ed87e88e53486abc87972934995bb3 and project 9237dcfb14cf43598b4dab920691e6fe. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:30:34.016224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:30:34.025505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:30:34.028640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8ea96ed5-d98d-4ad4-b1be-06e9ec200108 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:34.036589 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ea96ed5-d98d-4ad4-b1be-06e9ec200108 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1315 microversion: 2.1 time: 1.203567 Jul 26 14:30:34.042448 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2243/4600] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:32 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1315 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:34.060290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c02c83b9-776a-4b01-8226-0837ba707245 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:34.063914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c02c83b9-776a-4b01-8226-0837ba707245 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:34.082699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c02c83b9-776a-4b01-8226-0837ba707245 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:34.083298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c02c83b9-776a-4b01-8226-0837ba707245 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:34.085031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c02c83b9-776a-4b01-8226-0837ba707245 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:34.085477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c02c83b9-776a-4b01-8226-0837ba707245 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:34.185343 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-54347606-8bb7-4c76-a82b-200f963a513e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.374181 Jul 26 14:30:34.190319 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2358/4601] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 4380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:30:34.205573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a1e519b3-5042-4653-bd9e-5de64a229aa0 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:34.217339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a1e519b3-5042-4653-bd9e-5de64a229aa0 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:34.237551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1e519b3-5042-4653-bd9e-5de64a229aa0 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:34.241466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1e519b3-5042-4653-bd9e-5de64a229aa0 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:34.242474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1e519b3-5042-4653-bd9e-5de64a229aa0 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:34.244807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1e519b3-5042-4653-bd9e-5de64a229aa0 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:34.327917 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a1e519b3-5042-4653-bd9e-5de64a229aa0 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136195 Jul 26 14:30:34.331586 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2359/4602] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:30:34 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:34.343139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8a780a7d-ecda-4cc6-9abe-c673a2d74ef7 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:34.348461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8a780a7d-ecda-4cc6-9abe-c673a2d74ef7 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:34.353435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:34.637626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8a780a7d-ecda-4cc6-9abe-c673a2d74ef7 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:34.649262 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8a780a7d-ecda-4cc6-9abe-c673a2d74ef7 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1215 microversion: 2.1 time: 0.313564 Jul 26 14:30:34.656435 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2360/4603] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:34 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1215 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:34.666468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-037b7ce6-e19d-4d99-b308-68460f8ce208 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:34.668234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-037b7ce6-e19d-4d99-b308-68460f8ce208 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:34.692699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-037b7ce6-e19d-4d99-b308-68460f8ce208 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:34.695641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-037b7ce6-e19d-4d99-b308-68460f8ce208 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:34.697617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-037b7ce6-e19d-4d99-b308-68460f8ce208 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:34.698068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-037b7ce6-e19d-4d99-b308-68460f8ce208 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:34.970367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:34.982029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-037b7ce6-e19d-4d99-b308-68460f8ce208 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lazy-loading 'services' on Instance uuid 56d85143-b08f-40ab-a08d-9278963e0602 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:30:35.028706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c02c83b9-776a-4b01-8226-0837ba707245 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:35.050715 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c02c83b9-776a-4b01-8226-0837ba707245 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1323 microversion: 2.1 time: 1.004729 Jul 26 14:30:35.055492 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2244/4604] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:34 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1323 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:35.070744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6c0acdd-f476-4107-9cc9-c68d7118ad4a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:35.071746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6c0acdd-f476-4107-9cc9-c68d7118ad4a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:35.087062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6c0acdd-f476-4107-9cc9-c68d7118ad4a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:35.089713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6c0acdd-f476-4107-9cc9-c68d7118ad4a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:35.096357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6c0acdd-f476-4107-9cc9-c68d7118ad4a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:35.096934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6c0acdd-f476-4107-9cc9-c68d7118ad4a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:35.217539 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-037b7ce6-e19d-4d99-b308-68460f8ce208 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "DELETE /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-volume_attachments/dab26cd5-17c2-4e05-ae3f-cdcf2af139a6" status: 202 len: 0 microversion: 2.1 time: 0.558369 Jul 26 14:30:35.218625 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2361/4605] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:30:34 2022] DELETE /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-volume_attachments/dab26cd5-17c2-4e05-ae3f-cdcf2af139a6 => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:30:35.523436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-52e5c100-c5c7-485d-a618-24491c576019 req-4f3fc1a6-13c9-40b2-9edb-bc9cf7b346ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c869059b-70d3-4bed-80b9-52f9f6113ea2", "tag": "22f02fc0-ab03-48b1-83a2-d5fc390293f6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:35.552258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-52e5c100-c5c7-485d-a618-24491c576019 req-4f3fc1a6-13c9-40b2-9edb-bc9cf7b346ec service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:35.553793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-52e5c100-c5c7-485d-a618-24491c576019 req-4f3fc1a6-13c9-40b2-9edb-bc9cf7b346ec service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:35.591582 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-52e5c100-c5c7-485d-a618-24491c576019 req-4f3fc1a6-13c9-40b2-9edb-bc9cf7b346ec service nova] Creating event network-changed:22f02fc0-ab03-48b1-83a2-d5fc390293f6 for instance c869059b-70d3-4bed-80b9-52f9f6113ea2 on n-h2-833090-9 Jul 26 14:30:35.613084 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-52e5c100-c5c7-485d-a618-24491c576019 req-4f3fc1a6-13c9-40b2-9edb-bc9cf7b346ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094651 Jul 26 14:30:35.614759 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2362/4606] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:35.697046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a1a7b156-ae9a-4741-b9aa-aecc29ea6b4b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:35.701189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a1a7b156-ae9a-4741-b9aa-aecc29ea6b4b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:35.710886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1a7b156-ae9a-4741-b9aa-aecc29ea6b4b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:35.723638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1a7b156-ae9a-4741-b9aa-aecc29ea6b4b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:35.725489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1a7b156-ae9a-4741-b9aa-aecc29ea6b4b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:35.726322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1a7b156-ae9a-4741-b9aa-aecc29ea6b4b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:35.762298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:35.839116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=12 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:36.149667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a1a7b156-ae9a-4741-b9aa-aecc29ea6b4b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:36.197728 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a1a7b156-ae9a-4741-b9aa-aecc29ea6b4b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1267 microversion: 2.1 time: 0.520078 Jul 26 14:30:36.216725 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2363/4607] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:35 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1267 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:36.232807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b4bced7f-8da6-4088-8c57-d419c851193e tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:36.233732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b4bced7f-8da6-4088-8c57-d419c851193e tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:36.243789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4bced7f-8da6-4088-8c57-d419c851193e tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:36.244690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4bced7f-8da6-4088-8c57-d419c851193e tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:36.245651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4bced7f-8da6-4088-8c57-d419c851193e tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:36.247548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4bced7f-8da6-4088-8c57-d419c851193e tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:37.227449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c6c0acdd-f476-4107-9cc9-c68d7118ad4a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:37.237453 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6c0acdd-f476-4107-9cc9-c68d7118ad4a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1315 microversion: 2.1 time: 2.180491 Jul 26 14:30:37.246593 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2245/4608] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:35 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1315 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:37.258198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-82144c99-b222-4575-add8-88517ed69bdb tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:37.260562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-82144c99-b222-4575-add8-88517ed69bdb tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:37.280243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:37.303159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82144c99-b222-4575-add8-88517ed69bdb tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:37.304298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82144c99-b222-4575-add8-88517ed69bdb tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:37.307588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82144c99-b222-4575-add8-88517ed69bdb tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:37.312254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82144c99-b222-4575-add8-88517ed69bdb tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:37.625369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-82144c99-b222-4575-add8-88517ed69bdb tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:37.638770 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-82144c99-b222-4575-add8-88517ed69bdb tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1273 microversion: 2.1 time: 0.390692 Jul 26 14:30:37.641900 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2246/4609] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:37 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1273 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:38.266384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8e0f05b3-c9d9-4918-a7f5-5639ff6c4490 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:38.267064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8e0f05b3-c9d9-4918-a7f5-5639ff6c4490 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:38.300232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e0f05b3-c9d9-4918-a7f5-5639ff6c4490 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:38.300695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e0f05b3-c9d9-4918-a7f5-5639ff6c4490 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:38.301491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e0f05b3-c9d9-4918-a7f5-5639ff6c4490 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:38.302185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e0f05b3-c9d9-4918-a7f5-5639ff6c4490 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:39.347789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b4bced7f-8da6-4088-8c57-d419c851193e tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:39.372119 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b4bced7f-8da6-4088-8c57-d419c851193e tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1323 microversion: 2.1 time: 3.139299 Jul 26 14:30:39.372798 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2364/4610] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:36 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1323 bytes in 3155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:39.409258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27982429-40cb-4cec-9482-f07f1a99e155 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:39.410252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27982429-40cb-4cec-9482-f07f1a99e155 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:39.437438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27982429-40cb-4cec-9482-f07f1a99e155 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:39.438148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27982429-40cb-4cec-9482-f07f1a99e155 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:39.439111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27982429-40cb-4cec-9482-f07f1a99e155 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:39.439720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27982429-40cb-4cec-9482-f07f1a99e155 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:40.172898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27982429-40cb-4cec-9482-f07f1a99e155 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:40.184767 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27982429-40cb-4cec-9482-f07f1a99e155 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1273 microversion: 2.1 time: 0.794036 Jul 26 14:30:40.185369 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2365/4611] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:39 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1273 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:40.372188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8e0f05b3-c9d9-4918-a7f5-5639ff6c4490 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:40.388540 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8e0f05b3-c9d9-4918-a7f5-5639ff6c4490 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1315 microversion: 2.1 time: 2.124952 Jul 26 14:30:40.390034 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2247/4612] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:38 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1315 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:40.399256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70b2dd0e-0088-4259-a28e-ea226a4b1775 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:40.399886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70b2dd0e-0088-4259-a28e-ea226a4b1775 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:40.442353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70b2dd0e-0088-4259-a28e-ea226a4b1775 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:40.449394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70b2dd0e-0088-4259-a28e-ea226a4b1775 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:40.450906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70b2dd0e-0088-4259-a28e-ea226a4b1775 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:40.452605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70b2dd0e-0088-4259-a28e-ea226a4b1775 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:41.225440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4884997-19e6-4100-bed2-d9cd3be5f44b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:41.234220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b4884997-19e6-4100-bed2-d9cd3be5f44b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:41.269556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4884997-19e6-4100-bed2-d9cd3be5f44b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:41.279170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4884997-19e6-4100-bed2-d9cd3be5f44b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:41.281423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4884997-19e6-4100-bed2-d9cd3be5f44b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:41.284490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4884997-19e6-4100-bed2-d9cd3be5f44b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:42.255044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70b2dd0e-0088-4259-a28e-ea226a4b1775 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:42.290177 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70b2dd0e-0088-4259-a28e-ea226a4b1775 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1323 microversion: 2.1 time: 1.896585 Jul 26 14:30:42.323089 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2366/4613] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:40 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1323 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:42.330939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dcf0d3c6-3bb3-49b2-9f50-57518ad7ea3f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:42.332029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dcf0d3c6-3bb3-49b2-9f50-57518ad7ea3f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:42.340499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcf0d3c6-3bb3-49b2-9f50-57518ad7ea3f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:42.341220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcf0d3c6-3bb3-49b2-9f50-57518ad7ea3f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:42.342384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcf0d3c6-3bb3-49b2-9f50-57518ad7ea3f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:42.343075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dcf0d3c6-3bb3-49b2-9f50-57518ad7ea3f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:43.668588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4884997-19e6-4100-bed2-d9cd3be5f44b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:43.684290 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b4884997-19e6-4100-bed2-d9cd3be5f44b tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 2.473057 Jul 26 14:30:43.690256 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2248/4614] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:41 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:43.704925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-187bc882-3630-4d6c-9941-91a0e33620f3 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:43.706351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-187bc882-3630-4d6c-9941-91a0e33620f3 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:43.737126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-187bc882-3630-4d6c-9941-91a0e33620f3 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:43.738488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-187bc882-3630-4d6c-9941-91a0e33620f3 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:43.741889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-187bc882-3630-4d6c-9941-91a0e33620f3 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:43.742688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-187bc882-3630-4d6c-9941-91a0e33620f3 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:43.919931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:44.345681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dcf0d3c6-3bb3-49b2-9f50-57518ad7ea3f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:44.368838 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dcf0d3c6-3bb3-49b2-9f50-57518ad7ea3f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1315 microversion: 2.1 time: 2.044423 Jul 26 14:30:44.372821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2367/4615] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:42 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1315 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:44.706483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-25ad8a38-c7b4-4e39-9375-df873ac4da8a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:44.707488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-25ad8a38-c7b4-4e39-9375-df873ac4da8a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:44.722388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:44.728387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25ad8a38-c7b4-4e39-9375-df873ac4da8a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:44.730912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25ad8a38-c7b4-4e39-9375-df873ac4da8a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:44.732249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25ad8a38-c7b4-4e39-9375-df873ac4da8a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:44.735848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25ad8a38-c7b4-4e39-9375-df873ac4da8a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:46.220555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-187bc882-3630-4d6c-9941-91a0e33620f3 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:46.236486 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-187bc882-3630-4d6c-9941-91a0e33620f3 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1323 microversion: 2.1 time: 2.542112 Jul 26 14:30:46.237104 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2249/4616] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:43 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1323 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:46.277936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9b628023-46c8-4bdf-994e-92024b17b90a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:46.285399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9b628023-46c8-4bdf-994e-92024b17b90a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:46.303786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b628023-46c8-4bdf-994e-92024b17b90a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:46.304473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b628023-46c8-4bdf-994e-92024b17b90a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:46.305433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b628023-46c8-4bdf-994e-92024b17b90a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:46.306029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b628023-46c8-4bdf-994e-92024b17b90a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:47.380539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25ad8a38-c7b4-4e39-9375-df873ac4da8a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:47.392979 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-25ad8a38-c7b4-4e39-9375-df873ac4da8a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 2.690974 Jul 26 14:30:47.394393 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2368/4617] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:44 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 2693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:47.414785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4f84df2d-bb6b-4d88-b972-85c6b6408a01 req-6d902e1f-43b4-43cc-b14e-af70286d896f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9919389f-00d1-4477-b3b5-c839994c738f", "tag": "9867f333-b9c9-4ad6-94c0-654450bcd805"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:47.434149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4f84df2d-bb6b-4d88-b972-85c6b6408a01 req-6d902e1f-43b4-43cc-b14e-af70286d896f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:47.434624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4f84df2d-bb6b-4d88-b972-85c6b6408a01 req-6d902e1f-43b4-43cc-b14e-af70286d896f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:47.450497 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4f84df2d-bb6b-4d88-b972-85c6b6408a01 req-6d902e1f-43b4-43cc-b14e-af70286d896f service nova] Creating event network-changed:9867f333-b9c9-4ad6-94c0-654450bcd805 for instance 9919389f-00d1-4477-b3b5-c839994c738f on n-h1-833090-9 Jul 26 14:30:47.455938 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4f84df2d-bb6b-4d88-b972-85c6b6408a01 req-6d902e1f-43b4-43cc-b14e-af70286d896f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060127 Jul 26 14:30:47.456929 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2369/4618] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:47.463781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7268c827-c67d-472b-86d6-18f5175034d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:47.466816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7268c827-c67d-472b-86d6-18f5175034d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:47.474845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7268c827-c67d-472b-86d6-18f5175034d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:47.475885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7268c827-c67d-472b-86d6-18f5175034d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:47.477209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7268c827-c67d-472b-86d6-18f5175034d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:47.477823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7268c827-c67d-472b-86d6-18f5175034d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:47.515506 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7268c827-c67d-472b-86d6-18f5175034d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056932 Jul 26 14:30:47.531370 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2370/4619] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:30:47 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:30:47.546602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-13db9625-2cf3-435a-84f3-c5aa3185df32 req-47dc61ac-bc89-46d0-9e7a-2e097e576b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c869059b-70d3-4bed-80b9-52f9f6113ea2", "name": "network-vif-plugged", "status": "completed", "tag": "22f02fc0-ab03-48b1-83a2-d5fc390293f6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:47.566422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-13db9625-2cf3-435a-84f3-c5aa3185df32 req-47dc61ac-bc89-46d0-9e7a-2e097e576b14 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:47.567114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-13db9625-2cf3-435a-84f3-c5aa3185df32 req-47dc61ac-bc89-46d0-9e7a-2e097e576b14 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:47.597397 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-13db9625-2cf3-435a-84f3-c5aa3185df32 req-47dc61ac-bc89-46d0-9e7a-2e097e576b14 service nova] Creating event network-vif-plugged:22f02fc0-ab03-48b1-83a2-d5fc390293f6 for instance c869059b-70d3-4bed-80b9-52f9f6113ea2 on n-h2-833090-9 Jul 26 14:30:47.603743 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-13db9625-2cf3-435a-84f3-c5aa3185df32 req-47dc61ac-bc89-46d0-9e7a-2e097e576b14 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070849 Jul 26 14:30:47.605089 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2371/4620] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:47.610904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-84db3ad4-f0f0-42f0-b661-6164cb9f9d9b tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:47.612308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-84db3ad4-f0f0-42f0-b661-6164cb9f9d9b tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:47.620171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84db3ad4-f0f0-42f0-b661-6164cb9f9d9b tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:47.620948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84db3ad4-f0f0-42f0-b661-6164cb9f9d9b tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:47.622416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84db3ad4-f0f0-42f0-b661-6164cb9f9d9b tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:47.623151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84db3ad4-f0f0-42f0-b661-6164cb9f9d9b tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:47.946864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9b628023-46c8-4bdf-994e-92024b17b90a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:47.959823 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9b628023-46c8-4bdf-994e-92024b17b90a tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1315 microversion: 2.1 time: 1.708531 Jul 26 14:30:47.963444 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2250/4621] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:46 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1315 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:47.970377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cef83fc3-8bb0-4f03-8d9f-584432b7ca0c tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:47.973982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cef83fc3-8bb0-4f03-8d9f-584432b7ca0c tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:47.991901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cef83fc3-8bb0-4f03-8d9f-584432b7ca0c tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:47.992625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cef83fc3-8bb0-4f03-8d9f-584432b7ca0c tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:47.993599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cef83fc3-8bb0-4f03-8d9f-584432b7ca0c tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:47.994219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cef83fc3-8bb0-4f03-8d9f-584432b7ca0c tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:48.054326 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cef83fc3-8bb0-4f03-8d9f-584432b7ca0c tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089293 Jul 26 14:30:48.055687 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2251/4622] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:30:47 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:30:48.193958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-23f54682-3ec1-4b64-977f-b7d4306c5e38 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:48.195122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-23f54682-3ec1-4b64-977f-b7d4306c5e38 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:48.203087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-23f54682-3ec1-4b64-977f-b7d4306c5e38 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:48.204034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-23f54682-3ec1-4b64-977f-b7d4306c5e38 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:48.205052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-23f54682-3ec1-4b64-977f-b7d4306c5e38 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:48.205857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-23f54682-3ec1-4b64-977f-b7d4306c5e38 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:48.258379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-23f54682-3ec1-4b64-977f-b7d4306c5e38 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:30:48.445733 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-23f54682-3ec1-4b64-977f-b7d4306c5e38 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "DELETE /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 204 len: 0 microversion: 2.1 time: 0.258422 Jul 26 14:30:48.446887 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2252/4623] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:30:48 2022] DELETE /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:30:48.452663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c1b1ab70-1ae6-4f1e-a263-d331de5568b8 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:48.455793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c1b1ab70-1ae6-4f1e-a263-d331de5568b8 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:48.465479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1b1ab70-1ae6-4f1e-a263-d331de5568b8 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:48.466600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1b1ab70-1ae6-4f1e-a263-d331de5568b8 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:48.468564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1b1ab70-1ae6-4f1e-a263-d331de5568b8 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:48.469637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1b1ab70-1ae6-4f1e-a263-d331de5568b8 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:48.500735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:48.757310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-84db3ad4-f0f0-42f0-b661-6164cb9f9d9b tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:48.773596 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-84db3ad4-f0f0-42f0-b661-6164cb9f9d9b tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1323 microversion: 2.1 time: 1.166685 Jul 26 14:30:48.774202 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2372/4624] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:47 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1323 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:48.784884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e7247722-7fa1-4980-bc01-1b53a35f11ae tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:48.785726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e7247722-7fa1-4980-bc01-1b53a35f11ae tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:48.798472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7247722-7fa1-4980-bc01-1b53a35f11ae tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:48.798871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7247722-7fa1-4980-bc01-1b53a35f11ae tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:48.799689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7247722-7fa1-4980-bc01-1b53a35f11ae tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:48.800956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7247722-7fa1-4980-bc01-1b53a35f11ae tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:49.221092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c1b1ab70-1ae6-4f1e-a263-d331de5568b8 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:49.234133 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c1b1ab70-1ae6-4f1e-a263-d331de5568b8 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 0.785550 Jul 26 14:30:49.234740 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2253/4625] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:48 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:49.240681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-68878e58-500a-4f5a-8fc7-e0382d3390cc tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:49.241674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-68878e58-500a-4f5a-8fc7-e0382d3390cc tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:49.249909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68878e58-500a-4f5a-8fc7-e0382d3390cc tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:49.250775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68878e58-500a-4f5a-8fc7-e0382d3390cc tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:49.251783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68878e58-500a-4f5a-8fc7-e0382d3390cc tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:49.252316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68878e58-500a-4f5a-8fc7-e0382d3390cc tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:49.662853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e7247722-7fa1-4980-bc01-1b53a35f11ae tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:49.672561 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e7247722-7fa1-4980-bc01-1b53a35f11ae tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1682 microversion: 2.1 time: 0.896785 Jul 26 14:30:49.688474 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2373/4626] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:48 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1682 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:49.806015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9ac4355c-c854-4697-b683-0089826d6cd5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:49.807509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9ac4355c-c854-4697-b683-0089826d6cd5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:49.818653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ac4355c-c854-4697-b683-0089826d6cd5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:49.819592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ac4355c-c854-4697-b683-0089826d6cd5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:49.821705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ac4355c-c854-4697-b683-0089826d6cd5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:49.822502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ac4355c-c854-4697-b683-0089826d6cd5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:50.045098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-68878e58-500a-4f5a-8fc7-e0382d3390cc tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:50.061111 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-68878e58-500a-4f5a-8fc7-e0382d3390cc tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1315 microversion: 2.1 time: 0.824705 Jul 26 14:30:50.063083 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2254/4627] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:49 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:50.190535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-63c3aebd-f0c5-4d22-b168-bc1376b0a7fe req-00cd4df8-3b5f-4319-993e-f59fd6034ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293d8c60-94b6-4482-8aa0-baee2c780287", "tag": "916c5156-1919-4742-804d-88d6b1db08d8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:50.219292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-63c3aebd-f0c5-4d22-b168-bc1376b0a7fe req-00cd4df8-3b5f-4319-993e-f59fd6034ca5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:50.219881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-63c3aebd-f0c5-4d22-b168-bc1376b0a7fe req-00cd4df8-3b5f-4319-993e-f59fd6034ca5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:50.246600 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-63c3aebd-f0c5-4d22-b168-bc1376b0a7fe req-00cd4df8-3b5f-4319-993e-f59fd6034ca5 service nova] Creating event network-changed:916c5156-1919-4742-804d-88d6b1db08d8 for instance 293d8c60-94b6-4482-8aa0-baee2c780287 on n-h1-833090-9 Jul 26 14:30:50.263943 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-63c3aebd-f0c5-4d22-b168-bc1376b0a7fe req-00cd4df8-3b5f-4319-993e-f59fd6034ca5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080567 Jul 26 14:30:50.266895 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2255/4628] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:50.278485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de931f95-d043-4995-bcac-cb79b542eda1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:50.284056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-de931f95-d043-4995-bcac-cb79b542eda1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:50.298140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de931f95-d043-4995-bcac-cb79b542eda1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:50.298925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de931f95-d043-4995-bcac-cb79b542eda1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:50.303345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de931f95-d043-4995-bcac-cb79b542eda1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:50.305803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de931f95-d043-4995-bcac-cb79b542eda1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:50.636169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ac4355c-c854-4697-b683-0089826d6cd5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:50.649123 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9ac4355c-c854-4697-b683-0089826d6cd5 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1323 microversion: 2.1 time: 0.852838 Jul 26 14:30:50.657158 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2374/4629] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:49 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1323 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:50.697353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dfcd0b2c-0a50-4d3d-84fd-b090eeeb8686 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:50.697978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dfcd0b2c-0a50-4d3d-84fd-b090eeeb8686 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:50.712620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfcd0b2c-0a50-4d3d-84fd-b090eeeb8686 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:50.713301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfcd0b2c-0a50-4d3d-84fd-b090eeeb8686 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:50.714310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfcd0b2c-0a50-4d3d-84fd-b090eeeb8686 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:50.714917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfcd0b2c-0a50-4d3d-84fd-b090eeeb8686 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:51.690615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-de931f95-d043-4995-bcac-cb79b542eda1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:51.709076 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-de931f95-d043-4995-bcac-cb79b542eda1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 1.440057 Jul 26 14:30:51.722204 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2256/4630] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:50 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:51.728317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af2f9243-2971-41f4-9828-f52ec97d5116 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:51.729164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-af2f9243-2971-41f4-9828-f52ec97d5116 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:51.735552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af2f9243-2971-41f4-9828-f52ec97d5116 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:51.736412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af2f9243-2971-41f4-9828-f52ec97d5116 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:51.737405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af2f9243-2971-41f4-9828-f52ec97d5116 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:51.738096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af2f9243-2971-41f4-9828-f52ec97d5116 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:52.073872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dfcd0b2c-0a50-4d3d-84fd-b090eeeb8686 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:52.092596 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dfcd0b2c-0a50-4d3d-84fd-b090eeeb8686 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1682 microversion: 2.1 time: 1.399511 Jul 26 14:30:52.112144 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2375/4631] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:50 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1682 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:52.119075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9118f964-2532-4735-b95b-dc81d4ca04f1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:52.120060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9118f964-2532-4735-b95b-dc81d4ca04f1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:52.126301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9118f964-2532-4735-b95b-dc81d4ca04f1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:52.127024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9118f964-2532-4735-b95b-dc81d4ca04f1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:52.127817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9118f964-2532-4735-b95b-dc81d4ca04f1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:52.128299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9118f964-2532-4735-b95b-dc81d4ca04f1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:52.543160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-af2f9243-2971-41f4-9828-f52ec97d5116 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:52.552145 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af2f9243-2971-41f4-9828-f52ec97d5116 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1504 microversion: 2.1 time: 0.828490 Jul 26 14:30:52.552882 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2257/4632] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:51 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1504 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:52.576638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff21801c-3cad-4243-9683-4d10f59d5f15 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:52.577406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ff21801c-3cad-4243-9683-4d10f59d5f15 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:52.587553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff21801c-3cad-4243-9683-4d10f59d5f15 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:52.588046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff21801c-3cad-4243-9683-4d10f59d5f15 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:52.588840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff21801c-3cad-4243-9683-4d10f59d5f15 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:52.589284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff21801c-3cad-4243-9683-4d10f59d5f15 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:52.679328 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff21801c-3cad-4243-9683-4d10f59d5f15 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.108027 Jul 26 14:30:52.684240 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2258/4633] 10.222.0.70 () {58 vars in 1296 bytes} [Tue Jul 26 14:30:52 2022] DELETE /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2/os-server-password => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:30:52.694083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6d89e76-4e67-40b1-9b08-a3189405aa8f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:52.694748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6d89e76-4e67-40b1-9b08-a3189405aa8f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:52.702547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6d89e76-4e67-40b1-9b08-a3189405aa8f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:52.703254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6d89e76-4e67-40b1-9b08-a3189405aa8f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:52.704273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6d89e76-4e67-40b1-9b08-a3189405aa8f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:52.705094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6d89e76-4e67-40b1-9b08-a3189405aa8f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:52.730863 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6d89e76-4e67-40b1-9b08-a3189405aa8f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.041443 Jul 26 14:30:52.732350 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2259/4634] 10.222.0.70 () {58 vars in 1293 bytes} [Tue Jul 26 14:30:52 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2/os-server-password => generated 16 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:30:52.742367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-350bf64a-3691-4661-bf00-83486fed5362 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:52.743333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-350bf64a-3691-4661-bf00-83486fed5362 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:52.750792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-350bf64a-3691-4661-bf00-83486fed5362 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:52.751863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-350bf64a-3691-4661-bf00-83486fed5362 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:52.753100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-350bf64a-3691-4661-bf00-83486fed5362 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:52.753887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-350bf64a-3691-4661-bf00-83486fed5362 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:53.154032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9118f964-2532-4735-b95b-dc81d4ca04f1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:53.193826 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9118f964-2532-4735-b95b-dc81d4ca04f1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1323 microversion: 2.1 time: 1.078603 Jul 26 14:30:53.194981 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2376/4635] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:52 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1323 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:53.211123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-433ab3bb-2e9e-43ce-9e34-62be69f2701f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:53.220782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-433ab3bb-2e9e-43ce-9e34-62be69f2701f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:53.240392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-433ab3bb-2e9e-43ce-9e34-62be69f2701f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:53.241168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-433ab3bb-2e9e-43ce-9e34-62be69f2701f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:53.244251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-433ab3bb-2e9e-43ce-9e34-62be69f2701f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:53.244707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-433ab3bb-2e9e-43ce-9e34-62be69f2701f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:53.284587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-433ab3bb-2e9e-43ce-9e34-62be69f2701f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:30:53.448629 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-433ab3bb-2e9e-43ce-9e34-62be69f2701f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 204 len: 0 microversion: 2.1 time: 0.245762 Jul 26 14:30:53.453490 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2377/4636] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:30:53 2022] DELETE /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:30:53.460392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-fae17aaf-dead-47f3-8a43-dc8e4a75bf02 req-334aac00-111e-4916-bf50-93f1b35833d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9919389f-00d1-4477-b3b5-c839994c738f", "name": "network-vif-plugged", "status": "completed", "tag": "9867f333-b9c9-4ad6-94c0-654450bcd805"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:53.464641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-350bf64a-3691-4661-bf00-83486fed5362 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:53.473192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fae17aaf-dead-47f3-8a43-dc8e4a75bf02 req-334aac00-111e-4916-bf50-93f1b35833d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:53.474554 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-350bf64a-3691-4661-bf00-83486fed5362 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 0.739262 Jul 26 14:30:53.474697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fae17aaf-dead-47f3-8a43-dc8e4a75bf02 req-334aac00-111e-4916-bf50-93f1b35833d4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:53.476653 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2260/4637] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:52 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:53.492777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:30:53.493758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-77c742f4-3dab-4488-a8e7-4279fadfe1d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:53.494388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-77c742f4-3dab-4488-a8e7-4279fadfe1d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:53.503739 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-fae17aaf-dead-47f3-8a43-dc8e4a75bf02 req-334aac00-111e-4916-bf50-93f1b35833d4 service nova] Creating event network-vif-plugged:9867f333-b9c9-4ad6-94c0-654450bcd805 for instance 9919389f-00d1-4477-b3b5-c839994c738f on n-h1-833090-9 Jul 26 14:30:53.509644 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-fae17aaf-dead-47f3-8a43-dc8e4a75bf02 req-334aac00-111e-4916-bf50-93f1b35833d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054281 Jul 26 14:30:53.510992 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2378/4638] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:53.511797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77c742f4-3dab-4488-a8e7-4279fadfe1d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:53.512380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77c742f4-3dab-4488-a8e7-4279fadfe1d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:53.513317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77c742f4-3dab-4488-a8e7-4279fadfe1d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:53.513751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77c742f4-3dab-4488-a8e7-4279fadfe1d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:53.517813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36ea5b24-3760-488f-a72d-d4c307b1d1e4 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:53.518786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-36ea5b24-3760-488f-a72d-d4c307b1d1e4 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:53.527180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36ea5b24-3760-488f-a72d-d4c307b1d1e4 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:53.528103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36ea5b24-3760-488f-a72d-d4c307b1d1e4 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:53.529137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36ea5b24-3760-488f-a72d-d4c307b1d1e4 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:53.529810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36ea5b24-3760-488f-a72d-d4c307b1d1e4 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:54.221778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-36ea5b24-3760-488f-a72d-d4c307b1d1e4 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:54.230627 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-36ea5b24-3760-488f-a72d-d4c307b1d1e4 tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1510 microversion: 2.1 time: 0.717728 Jul 26 14:30:54.240124 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2379/4639] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:53 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1510 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:54.249055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83d6529d-5685-4065-b6b6-52d2d21e4c43 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:54.249936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-83d6529d-5685-4065-b6b6-52d2d21e4c43 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:54.258656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83d6529d-5685-4065-b6b6-52d2d21e4c43 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:54.259341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83d6529d-5685-4065-b6b6-52d2d21e4c43 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:54.260747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83d6529d-5685-4065-b6b6-52d2d21e4c43 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:54.261441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83d6529d-5685-4065-b6b6-52d2d21e4c43 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:54.325877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-77c742f4-3dab-4488-a8e7-4279fadfe1d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:54.361125 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-77c742f4-3dab-4488-a8e7-4279fadfe1d3 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1682 microversion: 2.1 time: 0.883152 Jul 26 14:30:54.364148 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2261/4640] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:53 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1682 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:54.497976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-54472ec3-1a36-42ae-94a2-b8f9e4223741 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:54.498591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-54472ec3-1a36-42ae-94a2-b8f9e4223741 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:54.514399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54472ec3-1a36-42ae-94a2-b8f9e4223741 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:54.515396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54472ec3-1a36-42ae-94a2-b8f9e4223741 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:54.517854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54472ec3-1a36-42ae-94a2-b8f9e4223741 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:54.524852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54472ec3-1a36-42ae-94a2-b8f9e4223741 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:54.764575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-83d6529d-5685-4065-b6b6-52d2d21e4c43 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:54.773881 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-83d6529d-5685-4065-b6b6-52d2d21e4c43 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1323 microversion: 2.1 time: 0.541352 Jul 26 14:30:54.788425 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2380/4641] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:54 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:55.089297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-54472ec3-1a36-42ae-94a2-b8f9e4223741 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:55.106838 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-54472ec3-1a36-42ae-94a2-b8f9e4223741 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 0.612908 Jul 26 14:30:55.108890 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2262/4642] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:54 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:55.133310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b5700291-cc01-4e7d-a804-9b0bdf56c170 req-8d6b4815-0ee8-402a-9399-f2302ccd3f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d85143-b08f-40ab-a08d-9278963e0602", "name": "network-vif-deleted", "tag": "c3500c5b-4a04-40b8-8ae4-cbacbe8371af"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:55.156099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b5700291-cc01-4e7d-a804-9b0bdf56c170 req-8d6b4815-0ee8-402a-9399-f2302ccd3f34 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:55.156875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b5700291-cc01-4e7d-a804-9b0bdf56c170 req-8d6b4815-0ee8-402a-9399-f2302ccd3f34 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:55.182289 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b5700291-cc01-4e7d-a804-9b0bdf56c170 req-8d6b4815-0ee8-402a-9399-f2302ccd3f34 service nova] Creating event network-vif-deleted:c3500c5b-4a04-40b8-8ae4-cbacbe8371af for instance 56d85143-b08f-40ab-a08d-9278963e0602 on n-h2-833090-9 Jul 26 14:30:55.198007 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b5700291-cc01-4e7d-a804-9b0bdf56c170 req-8d6b4815-0ee8-402a-9399-f2302ccd3f34 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068998 Jul 26 14:30:55.199058 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2381/4643] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:30:55.254267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0a535580-359f-4e36-8bf9-090906cea01d tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:55.255544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0a535580-359f-4e36-8bf9-090906cea01d tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:55.264232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a535580-359f-4e36-8bf9-090906cea01d tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:55.265074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a535580-359f-4e36-8bf9-090906cea01d tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:55.266105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a535580-359f-4e36-8bf9-090906cea01d tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:55.266791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a535580-359f-4e36-8bf9-090906cea01d tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:55.393685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:55.395105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:55.413738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:55.414608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:55.415675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:55.416529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:55.468548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:55.469295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:55.470062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lazy-loading 'fault' on Instance uuid 56d85143-b08f-40ab-a08d-9278963e0602 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:30:55.808286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58cb60aa5eb8468b870a6d4d7fceea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f396f632336642a4b37a3968761f944a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:55.816446 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e1ea6b2a-eca7-4c10-a720-baa246016e62 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 200 len: 1332 microversion: 2.1 time: 0.428540 Jul 26 14:30:55.837976 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2382/4644] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:55 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 1332 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:55.845712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7e17f7de-6352-44db-87f9-d69ed2efce2d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:55.846618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e17f7de-6352-44db-87f9-d69ed2efce2d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:55.854715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e17f7de-6352-44db-87f9-d69ed2efce2d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:55.855416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e17f7de-6352-44db-87f9-d69ed2efce2d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:55.856486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e17f7de-6352-44db-87f9-d69ed2efce2d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:55.857677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e17f7de-6352-44db-87f9-d69ed2efce2d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:55.934847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0a535580-359f-4e36-8bf9-090906cea01d tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:55.948329 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0a535580-359f-4e36-8bf9-090906cea01d tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1510 microversion: 2.1 time: 0.697944 Jul 26 14:30:55.949811 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2263/4645] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:55 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1510 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:56.133039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02904bbe-2e6a-4ead-a4a0-a083ffca96f4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:56.133832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-02904bbe-2e6a-4ead-a4a0-a083ffca96f4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:56.150738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02904bbe-2e6a-4ead-a4a0-a083ffca96f4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:56.151424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02904bbe-2e6a-4ead-a4a0-a083ffca96f4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:56.156991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02904bbe-2e6a-4ead-a4a0-a083ffca96f4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:56.157779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02904bbe-2e6a-4ead-a4a0-a083ffca96f4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:56.378360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7e17f7de-6352-44db-87f9-d69ed2efce2d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:56.393665 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7e17f7de-6352-44db-87f9-d69ed2efce2d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1323 microversion: 2.1 time: 0.553765 Jul 26 14:30:56.394269 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2383/4646] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:55 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1323 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:56.680363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-02904bbe-2e6a-4ead-a4a0-a083ffca96f4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:56.691546 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-02904bbe-2e6a-4ead-a4a0-a083ffca96f4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 0.564663 Jul 26 14:30:56.717271 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2264/4647] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:56 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:56.849480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b94f694-fb07-4b09-8dac-7eba68db6216 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:56.851147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4b94f694-fb07-4b09-8dac-7eba68db6216 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:56.860277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b94f694-fb07-4b09-8dac-7eba68db6216 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:56.861257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b94f694-fb07-4b09-8dac-7eba68db6216 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:56.862295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b94f694-fb07-4b09-8dac-7eba68db6216 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:56.862944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b94f694-fb07-4b09-8dac-7eba68db6216 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:56.898795 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-4b94f694-fb07-4b09-8dac-7eba68db6216 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] HTTP exception thrown: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b94f694-fb07-4b09-8dac-7eba68db6216 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Request method failure captured: Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 HTTP/1.1 Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_m_Koo_Gag-ZprbaL4ySBTNagp5EZOvINAOvyzuRk-PQZEbAVBF6sul6hQCP1UKw-Bj4Sk79-NnV81H83nARlUVr0GET9CXbcQ1myMObSrKsGmEGsRE0G5GyxRy0ILfC-ZmPnpswYPG5Vel9jOiU5xI-oF9PKjNtacxAwFoqOwlacs Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f396f632336642a4b37a3968761f944a Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-151665744 Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f396f632336642a4b37a3968761f944a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f396f632336642a4b37a3968761f944a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f396f632336642a4b37a3968761f944a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f396f632336642a4b37a3968761f944a"}]}] Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-151665744 Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f396f632336642a4b37a3968761f944a Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-151665744 Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachSCSIVolumeTestJSON-151665744-project Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 58cb60aa5eb8468b870a6d4d7fceea8a Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-151665744-project Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '56d85143-b08f-40ab-a08d-9278963e0602'} Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:56.906560 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:56.911356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:56.911356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:56.911356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:56.911356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:30:56.911356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:30:56.911356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:30:56.911356 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:56.920476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b94f694-fb07-4b09-8dac-7eba68db6216 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Returning 404 to user: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:56.924269 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4b94f694-fb07-4b09-8dac-7eba68db6216 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 404 len: 111 microversion: 2.1 time: 0.079290 Jul 26 14:30:56.932019 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2384/4648] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:56 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:30:56.934462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1b5bcd6b-2104-4360-adbc-89db5fdc4e5c tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '.version_select at 0x7f8786d1a8b0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:56.970999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:56.971430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:56.974472 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1b5bcd6b-2104-4360-adbc-89db5fdc4e5c tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366299657" status: 202 len: 0 microversion: 2.1 time: 0.043683 Jul 26 14:30:56.975246 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2265/4649] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:30:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366299657 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:30:56.981897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:56.982372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:56.983164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:56.983665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:57.063376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:57.063846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:57.064395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lazy-loading 'fault' on Instance uuid c869059b-70d3-4bed-80b9-52f9f6113ea2 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:30:57.176139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a08edc430f44ad5bd674fe056b33319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8f783db8ee4e9c8dbca2cae717f059', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:57.184652 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0ee87628-280e-4d46-8c72-c7ef694667ea tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 200 len: 1305 microversion: 2.1 time: 0.217762 Jul 26 14:30:57.192612 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2385/4650] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:56 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 1305 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:30:57.236086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-6794e5c0-d813-4f5a-a166-295bd0f7746a req-d52b6448-d767-4419-8560-abcb588ec03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c869059b-70d3-4bed-80b9-52f9f6113ea2", "name": "network-vif-deleted", "tag": "22f02fc0-ab03-48b1-83a2-d5fc390293f6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:57.260802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6794e5c0-d813-4f5a-a166-295bd0f7746a req-d52b6448-d767-4419-8560-abcb588ec03a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:57.261726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6794e5c0-d813-4f5a-a166-295bd0f7746a req-d52b6448-d767-4419-8560-abcb588ec03a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:57.290270 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-6794e5c0-d813-4f5a-a166-295bd0f7746a req-d52b6448-d767-4419-8560-abcb588ec03a service nova] Creating event network-vif-deleted:22f02fc0-ab03-48b1-83a2-d5fc390293f6 for instance c869059b-70d3-4bed-80b9-52f9f6113ea2 on n-h2-833090-9 Jul 26 14:30:57.298789 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-6794e5c0-d813-4f5a-a166-295bd0f7746a req-d52b6448-d767-4419-8560-abcb588ec03a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067690 Jul 26 14:30:57.303135 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2266/4651] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:30:57.424208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29a566c0-5faa-4a66-a380-428e611829da tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:57.425596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-29a566c0-5faa-4a66-a380-428e611829da tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:57.434649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29a566c0-5faa-4a66-a380-428e611829da tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:57.435520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29a566c0-5faa-4a66-a380-428e611829da tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:57.436953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29a566c0-5faa-4a66-a380-428e611829da tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:57.437567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29a566c0-5faa-4a66-a380-428e611829da tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:57.743302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ecc211a-4428-459f-9f65-5d453e177861 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:57.745266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ecc211a-4428-459f-9f65-5d453e177861 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:57.764490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ecc211a-4428-459f-9f65-5d453e177861 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:57.765047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ecc211a-4428-459f-9f65-5d453e177861 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:57.766773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ecc211a-4428-459f-9f65-5d453e177861 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:57.769787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ecc211a-4428-459f-9f65-5d453e177861 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:58.045998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-29a566c0-5faa-4a66-a380-428e611829da tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:58.055413 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-29a566c0-5faa-4a66-a380-428e611829da tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1518 microversion: 2.1 time: 0.638296 Jul 26 14:30:58.092867 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2386/4652] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:57 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1518 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:58.211731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a6dcfb44-d3a5-45b5-80d1-ac7ae0cd916f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:58.212735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a6dcfb44-d3a5-45b5-80d1-ac7ae0cd916f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] [instance: c869059b-70d3-4bed-80b9-52f9f6113ea2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:58.242659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6dcfb44-d3a5-45b5-80d1-ac7ae0cd916f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:58.243501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6dcfb44-d3a5-45b5-80d1-ac7ae0cd916f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:58.244584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6dcfb44-d3a5-45b5-80d1-ac7ae0cd916f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:58.245255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6dcfb44-d3a5-45b5-80d1-ac7ae0cd916f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:58.277104 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a6dcfb44-d3a5-45b5-80d1-ac7ae0cd916f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] HTTP exception thrown: Instance c869059b-70d3-4bed-80b9-52f9f6113ea2 could not be found. Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a6dcfb44-d3a5-45b5-80d1-ac7ae0cd916f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Request method failure captured: Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 HTTP/1.1 Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_p2C_jajLfhQcfZYgAm8gUft95hRgTdcyiU9S0B0ZwlF4H9H-3YyTkiVUlRnmSM4rz5NnkQJFSPPr7S7vdVsBk1bX_DyVXxQNaLhVE_pTOi2qhV8oMlXUh58uogw-8T0cGdB7Ir_tJ_YoZS4bCTBGVsCixRthrS2GBAgy88vropijY Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: bf8f783db8ee4e9c8dbca2cae717f059 Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerPasswordTestJSON-38218212 Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf8f783db8ee4e9c8dbca2cae717f059"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf8f783db8ee4e9c8dbca2cae717f059"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf8f783db8ee4e9c8dbca2cae717f059", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf8f783db8ee4e9c8dbca2cae717f059"}]}] Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerPasswordTestJSON-38218212 Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: bf8f783db8ee4e9c8dbca2cae717f059 Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerPasswordTestJSON-38218212 Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerPasswordTestJSON-38218212-project Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 0a08edc430f44ad5bd674fe056b33319 Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerPasswordTestJSON-38218212-project Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c869059b-70d3-4bed-80b9-52f9f6113ea2 could not be found. Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c869059b-70d3-4bed-80b9-52f9f6113ea2'} Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c869059b-70d3-4bed-80b9-52f9f6113ea2 could not be found. Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c869059b-70d3-4bed-80b9-52f9f6113ea2 could not be found. Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.279283 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.283424 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.283424 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.283424 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.283424 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:30:58.283424 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:30:58.283424 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c869059b-70d3-4bed-80b9-52f9f6113ea2 could not be found. Jul 26 14:30:58.283424 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.286170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a6dcfb44-d3a5-45b5-80d1-ac7ae0cd916f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] Returning 404 to user: Instance c869059b-70d3-4bed-80b9-52f9f6113ea2 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:58.287354 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a6dcfb44-d3a5-45b5-80d1-ac7ae0cd916f tempest-ServerPasswordTestJSON-38218212 tempest-ServerPasswordTestJSON-38218212-project] 10.222.0.70 "GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2" status: 404 len: 111 microversion: 2.1 time: 0.080128 Jul 26 14:30:58.288554 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2387/4653] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:58 2022] GET /compute/v2.1/servers/c869059b-70d3-4bed-80b9-52f9f6113ea2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:30:58.302297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-88864a1c-05a3-4f13-9b89-008a77c2836c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1440811353", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-88864a1c-05a3-4f13-9b89-008a77c2836c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Request method failure captured: Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 243 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_p9yV9oHRP9S3TFySlJbPUrYlDKxP8OVdHCNX3ZLb3-Y1-kKEyis_-GKteznRwNyHcZxJ3Yghrr4eT6CUR4-MNJztaSBqlgmMZ5OQ_8VAQzbDejlxsya0mKExRUUMbK-xIGjX8XFe0Df3lPGRlTW21gQTKkmNI-nEOXMzXPvUPSA58 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10d1bb24d6cf4d2dad1cad97a2f94073", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}] Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c4c6f1d210ee485fb1d351dc376637e9 Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1440811353", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1440811353', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8e8d2033-2cf7-4cbe-8fc9-f923c27160ff'}]}}} Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:30:58.325384 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.329641 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.336368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-88864a1c-05a3-4f13-9b89-008a77c2836c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:58.337592 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-88864a1c-05a3-4f13-9b89-008a77c2836c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.047744 Jul 26 14:30:58.338885 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2388/4654] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:30:58 2022] POST /compute/v2.1/servers => generated 175 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:30:58.350617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8ecc211a-4428-459f-9f65-5d453e177861 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:58.354693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9e15e158-fbd9-4318-8317-be35eb6210cf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:58.355437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9e15e158-fbd9-4318-8317-be35eb6210cf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 1a312fe3-0797-4e3c-b3a3-d74965b949a5] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:58.359727 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ecc211a-4428-459f-9f65-5d453e177861 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 0.623017 Jul 26 14:30:58.360359 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2267/4655] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:57 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:58.371634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-9e15e158-fbd9-4318-8317-be35eb6210cf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] HTTP exception thrown: Instance 1a312fe3-0797-4e3c-b3a3-d74965b949a5 could not be found. Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9e15e158-fbd9-4318-8317-be35eb6210cf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Request method failure captured: Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/1a312fe3-0797-4e3c-b3a3-d74965b949a5/metadata HTTP/1.1 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_p9yV9oHRP9S3TFySlJbPUrYlDKxP8OVdHCNX3ZLb3-Y1-kKEyis_-GKteznRwNyHcZxJ3Yghrr4eT6CUR4-MNJztaSBqlgmMZ5OQ_8VAQzbDejlxsya0mKExRUUMbK-xIGjX8XFe0Df3lPGRlTW21gQTKkmNI-nEOXMzXPvUPSA58 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10d1bb24d6cf4d2dad1cad97a2f94073", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}] Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c4c6f1d210ee485fb1d351dc376637e9 Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 1a312fe3-0797-4e3c-b3a3-d74965b949a5 could not be found. Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'server_id': '1a312fe3-0797-4e3c-b3a3-d74965b949a5'} Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a312fe3-0797-4e3c-b3a3-d74965b949a5 could not be found. Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a312fe3-0797-4e3c-b3a3-d74965b949a5 could not be found. Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.382462 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.387522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:30:58.387522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:30:58.387522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a312fe3-0797-4e3c-b3a3-d74965b949a5 could not be found. Jul 26 14:30:58.387522 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.391319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9e15e158-fbd9-4318-8317-be35eb6210cf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Returning 404 to user: Instance 1a312fe3-0797-4e3c-b3a3-d74965b949a5 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:58.392506 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9e15e158-fbd9-4318-8317-be35eb6210cf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/1a312fe3-0797-4e3c-b3a3-d74965b949a5/metadata" status: 404 len: 111 microversion: 2.1 time: 0.043782 Jul 26 14:30:58.393257 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2389/4656] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:30:58 2022] GET /compute/v2.1/servers/1a312fe3-0797-4e3c-b3a3-d74965b949a5/metadata => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:30:58.500267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3e76838c-1c81-45c8-be00-40f888f797fd tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-370046449", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3e76838c-1c81-45c8-be00-40f888f797fd tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Request method failure captured: Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 498 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_p9yV9oHRP9S3TFySlJbPUrYlDKxP8OVdHCNX3ZLb3-Y1-kKEyis_-GKteznRwNyHcZxJ3Yghrr4eT6CUR4-MNJztaSBqlgmMZ5OQ_8VAQzbDejlxsya0mKExRUUMbK-xIGjX8XFe0Df3lPGRlTW21gQTKkmNI-nEOXMzXPvUPSA58 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10d1bb24d6cf4d2dad1cad97a2f94073", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}] Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: c4c6f1d210ee485fb1d351dc376637e9 Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-370046449", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-370046449', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8e8d2033-2cf7-4cbe-8fc9-f923c27160ff'}]}}} Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 14:30:58.505882 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.510023 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.524193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3e76838c-1c81-45c8-be00-40f888f797fd tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:58.525363 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3e76838c-1c81-45c8-be00-40f888f797fd tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.029122 Jul 26 14:30:58.526474 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2268/4657] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:30:58 2022] POST /compute/v2.1/servers => generated 687 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:30:58.614426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b5d91085-e5bb-4fb2-a3bf-d8c497782873 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1377767491", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b5d91085-e5bb-4fb2-a3bf-d8c497782873 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Request method failure captured: Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 500 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_p9yV9oHRP9S3TFySlJbPUrYlDKxP8OVdHCNX3ZLb3-Y1-kKEyis_-GKteznRwNyHcZxJ3Yghrr4eT6CUR4-MNJztaSBqlgmMZ5OQ_8VAQzbDejlxsya0mKExRUUMbK-xIGjX8XFe0Df3lPGRlTW21gQTKkmNI-nEOXMzXPvUPSA58 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10d1bb24d6cf4d2dad1cad97a2f94073", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}] Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c4c6f1d210ee485fb1d351dc376637e9 Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1377767491", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1377767491', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8e8d2033-2cf7-4cbe-8fc9-f923c27160ff'}]}}} Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 14:30:58.625783 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b5d91085-e5bb-4fb2-a3bf-d8c497782873 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b5d91085-e5bb-4fb2-a3bf-d8c497782873 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.017687 Jul 26 14:30:58.630182 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2390/4658] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:30:58 2022] POST /compute/v2.1/servers => generated 689 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:30:58.762702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-930dfb8d-1f74-45cc-b417-65889859b595 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1911301766", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-930dfb8d-1f74-45cc-b417-65889859b595 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Request method failure captured: Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 754 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_p9yV9oHRP9S3TFySlJbPUrYlDKxP8OVdHCNX3ZLb3-Y1-kKEyis_-GKteznRwNyHcZxJ3Yghrr4eT6CUR4-MNJztaSBqlgmMZ5OQ_8VAQzbDejlxsya0mKExRUUMbK-xIGjX8XFe0Df3lPGRlTW21gQTKkmNI-nEOXMzXPvUPSA58 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10d1bb24d6cf4d2dad1cad97a2f94073", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}] Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: c4c6f1d210ee485fb1d351dc376637e9 Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1911301766", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1911301766', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8e8d2033-2cf7-4cbe-8fc9-f923c27160ff'}]}}} Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:30:58.769048 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:30:58.774649 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:30:58.792367 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.792367 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.792367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-930dfb8d-1f74-45cc-b417-65889859b595 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:58.792367 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-930dfb8d-1f74-45cc-b417-65889859b595 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.021479 Jul 26 14:30:58.792367 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2269/4659] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:30:58 2022] POST /compute/v2.1/servers => generated 1197 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 26 14:30:58.880716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b6c5ce2a-8e29-4568-985f-8d8f09265430 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1630376248", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b6c5ce2a-8e29-4568-985f-8d8f09265430 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Request method failure captured: Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 1266 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_p9yV9oHRP9S3TFySlJbPUrYlDKxP8OVdHCNX3ZLb3-Y1-kKEyis_-GKteznRwNyHcZxJ3Yghrr4eT6CUR4-MNJztaSBqlgmMZ5OQ_8VAQzbDejlxsya0mKExRUUMbK-xIGjX8XFe0Df3lPGRlTW21gQTKkmNI-nEOXMzXPvUPSA58 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10d1bb24d6cf4d2dad1cad97a2f94073", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}] Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c4c6f1d210ee485fb1d351dc376637e9 Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1630376248", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8e8d2033-2cf7-4cbe-8fc9-f923c27160ff"}]}} Jul 26 14:30:58.889065 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1630376248', 'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8e8d2033-2cf7-4cbe-8fc9-f923c27160ff'}]}}} Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.891850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:30:58.893432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:30:58.896719 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:30:58.896719 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.901303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b6c5ce2a-8e29-4568-985f-8d8f09265430 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:58.910168 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b6c5ce2a-8e29-4568-985f-8d8f09265430 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.034399 Jul 26 14:30:58.912738 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2391/4660] 10.222.0.70 () {60 vars in 1148 bytes} [Tue Jul 26 14:30:58 2022] POST /compute/v2.1/servers => generated 2221 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 26 14:30:58.937233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6f37395f-6bb8-4885-906c-69b3ffa5d830 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:58.938099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6f37395f-6bb8-4885-906c-69b3ffa5d830 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: ba0eb3a2-6775-43ab-b0ff-b86f731557de] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:58.950202 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-6f37395f-6bb8-4885-906c-69b3ffa5d830 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] HTTP exception thrown: Instance ba0eb3a2-6775-43ab-b0ff-b86f731557de could not be found. Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6f37395f-6bb8-4885-906c-69b3ffa5d830 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Request method failure captured: Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/ba0eb3a2-6775-43ab-b0ff-b86f731557de/metadata/test2 HTTP/1.1 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_p9yV9oHRP9S3TFySlJbPUrYlDKxP8OVdHCNX3ZLb3-Y1-kKEyis_-GKteznRwNyHcZxJ3Yghrr4eT6CUR4-MNJztaSBqlgmMZ5OQ_8VAQzbDejlxsya0mKExRUUMbK-xIGjX8XFe0Df3lPGRlTW21gQTKkmNI-nEOXMzXPvUPSA58 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10d1bb24d6cf4d2dad1cad97a2f94073", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}] Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: c4c6f1d210ee485fb1d351dc376637e9 Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance ba0eb3a2-6775-43ab-b0ff-b86f731557de could not be found. Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': 'ba0eb3a2-6775-43ab-b0ff-b86f731557de', 'id': 'test2'} Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0eb3a2-6775-43ab-b0ff-b86f731557de could not be found. Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0eb3a2-6775-43ab-b0ff-b86f731557de could not be found. Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:30:58.952978 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:30:58.959921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:30:58.959921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:30:58.959921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0eb3a2-6775-43ab-b0ff-b86f731557de could not be found. Jul 26 14:30:58.959921 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:30:58.963407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6f37395f-6bb8-4885-906c-69b3ffa5d830 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Returning 404 to user: Instance ba0eb3a2-6775-43ab-b0ff-b86f731557de could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:30:58.963407 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6f37395f-6bb8-4885-906c-69b3ffa5d830 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/ba0eb3a2-6775-43ab-b0ff-b86f731557de/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.032715 Jul 26 14:30:58.963407 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2270/4661] 10.222.0.70 () {58 vars in 1281 bytes} [Tue Jul 26 14:30:58 2022] GET /compute/v2.1/servers/ba0eb3a2-6775-43ab-b0ff-b86f731557de/metadata/test2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:30:59.001793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1e9bdc27-d9af-45dd-8c58-c3b926d04caf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:59.003860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1e9bdc27-d9af-45dd-8c58-c3b926d04caf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:59.012691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e9bdc27-d9af-45dd-8c58-c3b926d04caf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:59.013356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e9bdc27-d9af-45dd-8c58-c3b926d04caf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:59.014414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e9bdc27-d9af-45dd-8c58-c3b926d04caf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:59.015151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e9bdc27-d9af-45dd-8c58-c3b926d04caf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:59.092458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1e9bdc27-d9af-45dd-8c58-c3b926d04caf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:30:59.204413 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1e9bdc27-d9af-45dd-8c58-c3b926d04caf tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 204 len: 0 microversion: 2.1 time: 0.212385 Jul 26 14:30:59.207337 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2392/4662] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:30:58 2022] DELETE /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:30:59.224332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ed60050b-0d07-4f97-852a-0174de2a6282 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:59.225015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ed60050b-0d07-4f97-852a-0174de2a6282 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:59.232892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed60050b-0d07-4f97-852a-0174de2a6282 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:59.233402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed60050b-0d07-4f97-852a-0174de2a6282 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:59.236408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed60050b-0d07-4f97-852a-0174de2a6282 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:59.237120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed60050b-0d07-4f97-852a-0174de2a6282 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:59.392911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63cf1d13-36e9-4ea9-bd68-fa9bb0c5ff09 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:30:59.394495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63cf1d13-36e9-4ea9-bd68-fa9bb0c5ff09 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:30:59.418583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63cf1d13-36e9-4ea9-bd68-fa9bb0c5ff09 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:59.419302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63cf1d13-36e9-4ea9-bd68-fa9bb0c5ff09 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:59.420556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63cf1d13-36e9-4ea9-bd68-fa9bb0c5ff09 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:30:59.421172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63cf1d13-36e9-4ea9-bd68-fa9bb0c5ff09 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:30:59.702942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ed60050b-0d07-4f97-852a-0174de2a6282 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:59.722256 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ed60050b-0d07-4f97-852a-0174de2a6282 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1524 microversion: 2.1 time: 0.505008 Jul 26 14:30:59.725236 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2271/4663] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:59 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1524 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:30:59.882471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63cf1d13-36e9-4ea9-bd68-fa9bb0c5ff09 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:30:59.892395 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63cf1d13-36e9-4ea9-bd68-fa9bb0c5ff09 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 0.510397 Jul 26 14:30:59.893516 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2393/4664] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:30:59 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:00.749458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55bfac48-1920-4151-a494-fb4d88c9ada1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:00.750652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-55bfac48-1920-4151-a494-fb4d88c9ada1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:00.767995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55bfac48-1920-4151-a494-fb4d88c9ada1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:00.772823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55bfac48-1920-4151-a494-fb4d88c9ada1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:00.774170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55bfac48-1920-4151-a494-fb4d88c9ada1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:00.774782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55bfac48-1920-4151-a494-fb4d88c9ada1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:00.932426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3ffd93a-397b-4f11-a83b-166c322d4665 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:00.936344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b3ffd93a-397b-4f11-a83b-166c322d4665 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:00.987251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3ffd93a-397b-4f11-a83b-166c322d4665 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:00.987722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3ffd93a-397b-4f11-a83b-166c322d4665 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:00.991346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3ffd93a-397b-4f11-a83b-166c322d4665 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:00.994997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3ffd93a-397b-4f11-a83b-166c322d4665 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:01.797629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3ffd93a-397b-4f11-a83b-166c322d4665 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:01.807400 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3ffd93a-397b-4f11-a83b-166c322d4665 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 0.895190 Jul 26 14:31:01.810444 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2394/4665] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:00 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:01.872732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-55bfac48-1920-4151-a494-fb4d88c9ada1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:01.882675 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-55bfac48-1920-4151-a494-fb4d88c9ada1 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1524 microversion: 2.1 time: 1.137428 Jul 26 14:31:01.892767 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2272/4666] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:00 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1524 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:01.944360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e1b82070-4958-463a-bc94-7bf94bd084ab req-3f7a2361-1fb4-49ff-8f1b-54304e252307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293d8c60-94b6-4482-8aa0-baee2c780287", "name": "network-vif-plugged", "status": "completed", "tag": "916c5156-1919-4742-804d-88d6b1db08d8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:31:01.967007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e1b82070-4958-463a-bc94-7bf94bd084ab req-3f7a2361-1fb4-49ff-8f1b-54304e252307 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:01.967762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e1b82070-4958-463a-bc94-7bf94bd084ab req-3f7a2361-1fb4-49ff-8f1b-54304e252307 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:01.993671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e1b82070-4958-463a-bc94-7bf94bd084ab req-3f7a2361-1fb4-49ff-8f1b-54304e252307 service nova] Creating event network-vif-plugged:916c5156-1919-4742-804d-88d6b1db08d8 for instance 293d8c60-94b6-4482-8aa0-baee2c780287 on n-h1-833090-9 Jul 26 14:31:02.008832 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e1b82070-4958-463a-bc94-7bf94bd084ab req-3f7a2361-1fb4-49ff-8f1b-54304e252307 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068367 Jul 26 14:31:02.009868 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2395/4667] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:31:02.831873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-453cdead-1b59-4f32-884d-717c1473f150 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:02.833164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-453cdead-1b59-4f32-884d-717c1473f150 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:02.847788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-453cdead-1b59-4f32-884d-717c1473f150 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:02.848862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-453cdead-1b59-4f32-884d-717c1473f150 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:02.849674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-453cdead-1b59-4f32-884d-717c1473f150 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:02.853067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-453cdead-1b59-4f32-884d-717c1473f150 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:02.922351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9be89ad9-6ee5-413c-96a6-c38a6f764e56 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:02.923062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9be89ad9-6ee5-413c-96a6-c38a6f764e56 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:02.935022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be89ad9-6ee5-413c-96a6-c38a6f764e56 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:02.939293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be89ad9-6ee5-413c-96a6-c38a6f764e56 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:02.940616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be89ad9-6ee5-413c-96a6-c38a6f764e56 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:02.941351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be89ad9-6ee5-413c-96a6-c38a6f764e56 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:03.207485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9be89ad9-6ee5-413c-96a6-c38a6f764e56 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:03.253209 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9be89ad9-6ee5-413c-96a6-c38a6f764e56 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1482 microversion: 2.1 time: 0.335276 Jul 26 14:31:03.267764 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2396/4668] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:02 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1482 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:31:03.757250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-453cdead-1b59-4f32-884d-717c1473f150 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:03.758805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1e40bb69-2116-4e99-bf2e-ac5f016b30b8 req-a9d7e8b3-7da8-4813-8c5f-5ae84cc5d85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9919389f-00d1-4477-b3b5-c839994c738f", "name": "network-vif-deleted", "tag": "9867f333-b9c9-4ad6-94c0-654450bcd805"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:31:03.795730 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-453cdead-1b59-4f32-884d-717c1473f150 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1315 microversion: 2.1 time: 0.967676 Jul 26 14:31:03.802339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1e40bb69-2116-4e99-bf2e-ac5f016b30b8 req-a9d7e8b3-7da8-4813-8c5f-5ae84cc5d85d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:03.803096 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2273/4669] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:02 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:03.812466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1e40bb69-2116-4e99-bf2e-ac5f016b30b8 req-a9d7e8b3-7da8-4813-8c5f-5ae84cc5d85d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:03.852514 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1e40bb69-2116-4e99-bf2e-ac5f016b30b8 req-a9d7e8b3-7da8-4813-8c5f-5ae84cc5d85d service nova] Creating event network-vif-deleted:9867f333-b9c9-4ad6-94c0-654450bcd805 for instance 9919389f-00d1-4477-b3b5-c839994c738f on n-h1-833090-9 Jul 26 14:31:03.870694 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1e40bb69-2116-4e99-bf2e-ac5f016b30b8 req-a9d7e8b3-7da8-4813-8c5f-5ae84cc5d85d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123747 Jul 26 14:31:03.872125 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2397/4670] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:31:04.288576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:04.289818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:04.303766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:04.317448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:04.321499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:04.322797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:04.392791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:04.438673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:04.439371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:04.445071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lazy-loading 'fault' on Instance uuid 9919389f-00d1-4477-b3b5-c839994c738f {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:31:04.609668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:04.623175 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6e306b8d-68b3-42e6-8cbd-37655f1809d9 tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1313 microversion: 2.1 time: 0.335935 Jul 26 14:31:04.626174 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2274/4671] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:04 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:04.839472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ea23fbaa-12de-4d1a-b39e-b018bf3fc171 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:04.840705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ea23fbaa-12de-4d1a-b39e-b018bf3fc171 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:04.853025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:04.854923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea23fbaa-12de-4d1a-b39e-b018bf3fc171 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:04.860549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea23fbaa-12de-4d1a-b39e-b018bf3fc171 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:04.861528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea23fbaa-12de-4d1a-b39e-b018bf3fc171 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:04.862099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea23fbaa-12de-4d1a-b39e-b018bf3fc171 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:05.120193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ea23fbaa-12de-4d1a-b39e-b018bf3fc171 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:05.140495 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ea23fbaa-12de-4d1a-b39e-b018bf3fc171 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1502 microversion: 2.1 time: 0.306017 Jul 26 14:31:05.141514 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2398/4672] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:04 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1502 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:05.166169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-49664709-a017-4794-bac7-c8687ed9a3bd tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:05.167870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-49664709-a017-4794-bac7-c8687ed9a3bd tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:05.175436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49664709-a017-4794-bac7-c8687ed9a3bd tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:05.176672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49664709-a017-4794-bac7-c8687ed9a3bd tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:05.178069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49664709-a017-4794-bac7-c8687ed9a3bd tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:05.178685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49664709-a017-4794-bac7-c8687ed9a3bd tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:05.646408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:05.647449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:05.660366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:05.661760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:05.662849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:05.663470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:05.750793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:05.751266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:05.751748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lazy-loading 'fault' on Instance uuid 9919389f-00d1-4477-b3b5-c839994c738f {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:31:05.922017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c6f1d210ee485fb1d351dc376637e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10d1bb24d6cf4d2dad1cad97a2f94073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:05.933602 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71be8acc-a5e5-45e4-ad83-9c57ac02498d tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 200 len: 1313 microversion: 2.1 time: 0.289682 Jul 26 14:31:05.934116 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2399/4673] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:05 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:31:06.104145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-49664709-a017-4794-bac7-c8687ed9a3bd tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:06.115140 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-49664709-a017-4794-bac7-c8687ed9a3bd tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1502 microversion: 2.1 time: 0.951306 Jul 26 14:31:06.140818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36e91f42-2575-4fd2-89f1-e9a4dac93556 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:31:06.141602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-36e91f42-2575-4fd2-89f1-e9a4dac93556 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:06.146623 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2275/4674] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:05 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1502 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:06.151800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e91f42-2575-4fd2-89f1-e9a4dac93556 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:06.153490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e91f42-2575-4fd2-89f1-e9a4dac93556 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:06.161482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e91f42-2575-4fd2-89f1-e9a4dac93556 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:06.162229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e91f42-2575-4fd2-89f1-e9a4dac93556 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:06.205316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:06.213494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-36e91f42-2575-4fd2-89f1-e9a4dac93556 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lazy-loading 'flavor' on Instance uuid 293d8c60-94b6-4482-8aa0-baee2c780287 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:31:06.357861 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-36e91f42-2575-4fd2-89f1-e9a4dac93556 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "POST /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287/action" status: 202 len: 0 microversion: 2.1 time: 0.220530 Jul 26 14:31:06.360894 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2400/4675] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:31:06 2022] POST /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:31:06.380824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-25dae909-9acd-4873-8e50-44d44ebc0b75 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:06.381696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-25dae909-9acd-4873-8e50-44d44ebc0b75 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:06.413505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25dae909-9acd-4873-8e50-44d44ebc0b75 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:06.416322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25dae909-9acd-4873-8e50-44d44ebc0b75 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:06.420389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25dae909-9acd-4873-8e50-44d44ebc0b75 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:06.421041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25dae909-9acd-4873-8e50-44d44ebc0b75 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:06.914426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-25dae909-9acd-4873-8e50-44d44ebc0b75 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:06.923188 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-25dae909-9acd-4873-8e50-44d44ebc0b75 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1510 microversion: 2.1 time: 0.559317 Jul 26 14:31:06.926547 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2276/4676] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:06 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1510 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:06.956627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-498ab3ee-4e00-406d-8989-85f45f34878c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:06.957301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-498ab3ee-4e00-406d-8989-85f45f34878c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] [instance: 9919389f-00d1-4477-b3b5-c839994c738f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:06.975621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-498ab3ee-4e00-406d-8989-85f45f34878c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:06.976634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-498ab3ee-4e00-406d-8989-85f45f34878c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:06.978862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-498ab3ee-4e00-406d-8989-85f45f34878c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:06.979509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-498ab3ee-4e00-406d-8989-85f45f34878c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:07.047775 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-498ab3ee-4e00-406d-8989-85f45f34878c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] HTTP exception thrown: Instance 9919389f-00d1-4477-b3b5-c839994c738f could not be found. Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-498ab3ee-4e00-406d-8989-85f45f34878c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Request method failure captured: Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f HTTP/1.1 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_p9yV9oHRP9S3TFySlJbPUrYlDKxP8OVdHCNX3ZLb3-Y1-kKEyis_-GKteznRwNyHcZxJ3Yghrr4eT6CUR4-MNJztaSBqlgmMZ5OQ_8VAQzbDejlxsya0mKExRUUMbK-xIGjX8XFe0Df3lPGRlTW21gQTKkmNI-nEOXMzXPvUPSA58 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/10d1bb24d6cf4d2dad1cad97a2f94073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_10d1bb24d6cf4d2dad1cad97a2f94073", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/10d1bb24d6cf4d2dad1cad97a2f94073"}]}] Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 10d1bb24d6cf4d2dad1cad97a2f94073 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1059490336 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c4c6f1d210ee485fb1d351dc376637e9 Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1059490336-project Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 9919389f-00d1-4477-b3b5-c839994c738f could not be found. Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '9919389f-00d1-4477-b3b5-c839994c738f'} Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9919389f-00d1-4477-b3b5-c839994c738f could not be found. Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9919389f-00d1-4477-b3b5-c839994c738f could not be found. Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:07.050362 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:31:07.058369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:07.058369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:07.058369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:31:07.058369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:31:07.058369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:31:07.058369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:31:07.058369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9919389f-00d1-4477-b3b5-c839994c738f could not be found. Jul 26 14:31:07.058369 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:07.067888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-498ab3ee-4e00-406d-8989-85f45f34878c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] Returning 404 to user: Instance 9919389f-00d1-4477-b3b5-c839994c738f could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:31:07.070357 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-498ab3ee-4e00-406d-8989-85f45f34878c tempest-ServerMetadataNegativeTestJSON-1059490336 tempest-ServerMetadataNegativeTestJSON-1059490336-project] 10.222.0.70 "GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f" status: 404 len: 111 microversion: 2.1 time: 0.119345 Jul 26 14:31:07.076703 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2401/4677] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:06 2022] GET /compute/v2.1/servers/9919389f-00d1-4477-b3b5-c839994c738f => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:31:07.947664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-24cb4020-3f3b-4e9c-bc0d-af159c5656ff tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:07.948696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-24cb4020-3f3b-4e9c-bc0d-af159c5656ff tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:07.956256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:07.984094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24cb4020-3f3b-4e9c-bc0d-af159c5656ff tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:07.986117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24cb4020-3f3b-4e9c-bc0d-af159c5656ff tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:07.986963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24cb4020-3f3b-4e9c-bc0d-af159c5656ff tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:07.987415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24cb4020-3f3b-4e9c-bc0d-af159c5656ff tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:08.447341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-24cb4020-3f3b-4e9c-bc0d-af159c5656ff tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:08.464316 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-24cb4020-3f3b-4e9c-bc0d-af159c5656ff tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1493 microversion: 2.1 time: 0.520714 Jul 26 14:31:08.477443 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2277/4678] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:07 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1493 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:08.485901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abe119d6-88bd-42df-8b18-7bb13c002c8e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:31:08.486461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-abe119d6-88bd-42df-8b18-7bb13c002c8e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:08.511067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abe119d6-88bd-42df-8b18-7bb13c002c8e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:08.511538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abe119d6-88bd-42df-8b18-7bb13c002c8e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:08.512379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abe119d6-88bd-42df-8b18-7bb13c002c8e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:08.515916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abe119d6-88bd-42df-8b18-7bb13c002c8e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:08.709710 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-abe119d6-88bd-42df-8b18-7bb13c002c8e tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "POST /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287/action" status: 202 len: 0 microversion: 2.1 time: 0.226698 Jul 26 14:31:08.730591 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2402/4679] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:31:08 2022] POST /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:31:08.746007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-59527aeb-4519-4493-89af-9f2682386223 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:08.747293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-59527aeb-4519-4493-89af-9f2682386223 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:08.780033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da6a00be-d5b6-47ff-9f13-3eb2101958e1 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:08.795679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59527aeb-4519-4493-89af-9f2682386223 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:08.797066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-da6a00be-d5b6-47ff-9f13-3eb2101958e1 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:08.800246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59527aeb-4519-4493-89af-9f2682386223 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:08.801990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59527aeb-4519-4493-89af-9f2682386223 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:08.802773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59527aeb-4519-4493-89af-9f2682386223 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:08.824590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da6a00be-d5b6-47ff-9f13-3eb2101958e1 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:08.831258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da6a00be-d5b6-47ff-9f13-3eb2101958e1 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:08.832384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da6a00be-d5b6-47ff-9f13-3eb2101958e1 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:08.833448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da6a00be-d5b6-47ff-9f13-3eb2101958e1 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:08.893949 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-da6a00be-d5b6-47ff-9f13-3eb2101958e1 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] HTTP exception thrown: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da6a00be-d5b6-47ff-9f13-3eb2101958e1 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Request method failure captured: Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 HTTP/1.1 Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_m_Koo_Gag-ZprbaL4ySBTNagp5EZOvINAOvyzuRk-PQZEbAVBF6sul6hQCP1UKw-Bj4Sk79-NnV81H83nARlUVr0GET9CXbcQ1myMObSrKsGmEGsRE0G5GyxRy0ILfC-ZmPnpswYPG5Vel9jOiU5xI-oF9PKjNtacxAwFoqOwlacs Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f396f632336642a4b37a3968761f944a Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-151665744 Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f396f632336642a4b37a3968761f944a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f396f632336642a4b37a3968761f944a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f396f632336642a4b37a3968761f944a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f396f632336642a4b37a3968761f944a"}]}] Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-151665744 Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f396f632336642a4b37a3968761f944a Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-151665744 Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachSCSIVolumeTestJSON-151665744-project Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 58cb60aa5eb8468b870a6d4d7fceea8a Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-151665744-project Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '56d85143-b08f-40ab-a08d-9278963e0602'} Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:31:08.904475 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da6a00be-d5b6-47ff-9f13-3eb2101958e1 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Returning 404 to user: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-da6a00be-d5b6-47ff-9f13-3eb2101958e1 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "DELETE /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 404 len: 111 microversion: 2.1 time: 0.152966 Jul 26 14:31:08.908808 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2403/4680] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:31:08 2022] DELETE /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:31:08.925032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:08.925664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] [instance: 56d85143-b08f-40ab-a08d-9278963e0602] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:08.953610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:08.959798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:08.961148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:08.961842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:08.998064 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] HTTP exception thrown: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Request method failure captured: Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 HTTP/1.1 Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_m_Koo_Gag-ZprbaL4ySBTNagp5EZOvINAOvyzuRk-PQZEbAVBF6sul6hQCP1UKw-Bj4Sk79-NnV81H83nARlUVr0GET9CXbcQ1myMObSrKsGmEGsRE0G5GyxRy0ILfC-ZmPnpswYPG5Vel9jOiU5xI-oF9PKjNtacxAwFoqOwlacs Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f396f632336642a4b37a3968761f944a Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-151665744 Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f396f632336642a4b37a3968761f944a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f396f632336642a4b37a3968761f944a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f396f632336642a4b37a3968761f944a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f396f632336642a4b37a3968761f944a"}]}] Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-151665744 Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f396f632336642a4b37a3968761f944a Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-151665744 Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachSCSIVolumeTestJSON-151665744-project Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 58cb60aa5eb8468b870a6d4d7fceea8a Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-151665744-project Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '56d85143-b08f-40ab-a08d-9278963e0602'} Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:31:08.999848 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:09.005207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:09.005207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:31:09.005207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:31:09.005207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:31:09.005207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:31:09.005207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. Jul 26 14:31:09.005207 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:09.007642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Returning 404 to user: Instance 56d85143-b08f-40ab-a08d-9278963e0602 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:31:09.008841 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602" status: 404 len: 111 microversion: 2.1 time: 0.088295 Jul 26 14:31:09.010745 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2404/4681] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:08 2022] GET /compute/v2.1/servers/56d85143-b08f-40ab-a08d-9278963e0602 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:31:09.455896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:09.457127 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08fa5d0c-9c16-490a-9bed-93daf3b7d674 tempest-AttachSCSIVolumeTestJSON-151665744 tempest-AttachSCSIVolumeTestJSON-151665744-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001589 Jul 26 14:31:09.458166 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2405/4682] 10.222.0.70 () {56 vars in 886 bytes} [Tue Jul 26 14:31:09 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 26 14:31:10.423120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-59527aeb-4519-4493-89af-9f2682386223 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:10.445188 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-59527aeb-4519-4493-89af-9f2682386223 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1499 microversion: 2.1 time: 1.711595 Jul 26 14:31:10.445790 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2278/4683] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:08 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1499 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:11.471909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fc83b704-3633-4ca6-bbd2-9e0d15270b45 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:11.472570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fc83b704-3633-4ca6-bbd2-9e0d15270b45 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:11.506736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc83b704-3633-4ca6-bbd2-9e0d15270b45 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:11.512017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc83b704-3633-4ca6-bbd2-9e0d15270b45 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:11.522123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc83b704-3633-4ca6-bbd2-9e0d15270b45 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:11.523223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc83b704-3633-4ca6-bbd2-9e0d15270b45 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:12.531217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fc83b704-3633-4ca6-bbd2-9e0d15270b45 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:12.557053 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fc83b704-3633-4ca6-bbd2-9e0d15270b45 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1499 microversion: 2.1 time: 1.084005 Jul 26 14:31:12.559381 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2406/4684] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:11 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1499 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:13.587673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ca0c818-8c59-4f89-b23c-f3ccdf6531f6 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:13.589617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4ca0c818-8c59-4f89-b23c-f3ccdf6531f6 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:13.627598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ca0c818-8c59-4f89-b23c-f3ccdf6531f6 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:13.633796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ca0c818-8c59-4f89-b23c-f3ccdf6531f6 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:13.635416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ca0c818-8c59-4f89-b23c-f3ccdf6531f6 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:13.647703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ca0c818-8c59-4f89-b23c-f3ccdf6531f6 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:14.284268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-978218112", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": "none"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:31:14.511607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:31:14.513517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:31:14.518578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:31:14.519447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:31:14.523290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:31:14.595303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:14.596192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:14.597509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:14.598337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:14.631241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Getting quotas for project 3cabf263ec224d74bf4198a01bba1ae7. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:31:14.669502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Getting quotas for user 0762370271b54557a330f7cfe2902198 and project 3cabf263ec224d74bf4198a01bba1ae7. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:31:14.703024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:31:14.706026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:31:14.849199 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-adbb1124-e131-4d85-86f3-432319cf8f60 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.890779 Jul 26 14:31:14.856266 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2407/4685] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Jul 26 14:31:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 14:31:14.870787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ffb23cc1-124d-478e-888b-59f0ee447e36 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:14.871875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ffb23cc1-124d-478e-888b-59f0ee447e36 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:15.615071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ffb23cc1-124d-478e-888b-59f0ee447e36 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:15.627256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ffb23cc1-124d-478e-888b-59f0ee447e36 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:15.629560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ffb23cc1-124d-478e-888b-59f0ee447e36 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:15.634147 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ffb23cc1-124d-478e-888b-59f0ee447e36 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1277 microversion: 2.54 time: 0.776539 Jul 26 14:31:15.634969 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2408/4686] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:14 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1277 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:15.762758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ca0c818-8c59-4f89-b23c-f3ccdf6531f6 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:15.794215 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ca0c818-8c59-4f89-b23c-f3ccdf6531f6 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1502 microversion: 2.1 time: 2.202330 Jul 26 14:31:15.798636 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2279/4687] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:13 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1502 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:15.817619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9eabac28-3bdd-486f-9312-4cb83797f030 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:31:15.818564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9eabac28-3bdd-486f-9312-4cb83797f030 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:15.825316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9eabac28-3bdd-486f-9312-4cb83797f030 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:15.825773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9eabac28-3bdd-486f-9312-4cb83797f030 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:15.826555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9eabac28-3bdd-486f-9312-4cb83797f030 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:15.849362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9eabac28-3bdd-486f-9312-4cb83797f030 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:15.896091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-9eabac28-3bdd-486f-9312-4cb83797f030 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lazy-loading 'flavor' on Instance uuid 293d8c60-94b6-4482-8aa0-baee2c780287 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:31:16.121006 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9eabac28-3bdd-486f-9312-4cb83797f030 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "POST /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287/action" status: 202 len: 0 microversion: 2.1 time: 0.289500 Jul 26 14:31:16.122207 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2409/4688] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:31:15 2022] POST /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:31:16.131930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d8e0dcbb-9956-484c-a336-b4fe89e7a2b3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:16.136579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d8e0dcbb-9956-484c-a336-b4fe89e7a2b3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:16.155420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8e0dcbb-9956-484c-a336-b4fe89e7a2b3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:16.156307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8e0dcbb-9956-484c-a336-b4fe89e7a2b3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:16.162092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8e0dcbb-9956-484c-a336-b4fe89e7a2b3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:16.165973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d8e0dcbb-9956-484c-a336-b4fe89e7a2b3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:16.660982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6e42ef1d-434f-42e9-8f5f-31c75575103a tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:16.662995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6e42ef1d-434f-42e9-8f5f-31c75575103a tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:16.689044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e42ef1d-434f-42e9-8f5f-31c75575103a tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:16.690234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e42ef1d-434f-42e9-8f5f-31c75575103a tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:16.700941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e42ef1d-434f-42e9-8f5f-31c75575103a tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:16.701771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6e42ef1d-434f-42e9-8f5f-31c75575103a tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:17.558419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6e42ef1d-434f-42e9-8f5f-31c75575103a tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:17.576290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6e42ef1d-434f-42e9-8f5f-31c75575103a tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:17.585841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6e42ef1d-434f-42e9-8f5f-31c75575103a tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:17.589443 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6e42ef1d-434f-42e9-8f5f-31c75575103a tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1329 microversion: 2.54 time: 0.933456 Jul 26 14:31:17.592478 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2410/4689] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:16 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1329 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:31:17.691079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d8e0dcbb-9956-484c-a336-b4fe89e7a2b3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:17.702518 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d8e0dcbb-9956-484c-a336-b4fe89e7a2b3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1510 microversion: 2.1 time: 1.573127 Jul 26 14:31:17.708220 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2280/4690] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:16 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1510 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:18.209027 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 14:31:18.210296 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 14:31:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 14:31:18.621023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df434d66-e73e-45dc-b441-1a7369ece182 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:18.621906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df434d66-e73e-45dc-b441-1a7369ece182 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:18.636195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df434d66-e73e-45dc-b441-1a7369ece182 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:18.644455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df434d66-e73e-45dc-b441-1a7369ece182 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:18.646010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df434d66-e73e-45dc-b441-1a7369ece182 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:18.651168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df434d66-e73e-45dc-b441-1a7369ece182 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:18.729283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-08474964-1d7c-4fdf-9f05-9dac484dbcc3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:18.729911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-08474964-1d7c-4fdf-9f05-9dac484dbcc3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:18.753252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08474964-1d7c-4fdf-9f05-9dac484dbcc3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:18.753904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08474964-1d7c-4fdf-9f05-9dac484dbcc3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:18.755254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08474964-1d7c-4fdf-9f05-9dac484dbcc3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:18.755805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08474964-1d7c-4fdf-9f05-9dac484dbcc3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:18.955330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df434d66-e73e-45dc-b441-1a7369ece182 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:18.973431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df434d66-e73e-45dc-b441-1a7369ece182 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:18.981419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df434d66-e73e-45dc-b441-1a7369ece182 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:18.992230 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df434d66-e73e-45dc-b441-1a7369ece182 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1335 microversion: 2.54 time: 0.374736 Jul 26 14:31:18.993723 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2411/4691] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:18 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1335 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:19.133557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-08474964-1d7c-4fdf-9f05-9dac484dbcc3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:19.143640 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-08474964-1d7c-4fdf-9f05-9dac484dbcc3 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1493 microversion: 2.1 time: 0.417949 Jul 26 14:31:19.168430 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2281/4692] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:18 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1493 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:19.187705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ef9abf11-597c-45f2-89ac-993b915a39d1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:31:19.188418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef9abf11-597c-45f2-89ac-993b915a39d1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:19.200140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef9abf11-597c-45f2-89ac-993b915a39d1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:19.206943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef9abf11-597c-45f2-89ac-993b915a39d1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:19.208258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef9abf11-597c-45f2-89ac-993b915a39d1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:19.211693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef9abf11-597c-45f2-89ac-993b915a39d1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:19.418962 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ef9abf11-597c-45f2-89ac-993b915a39d1 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "POST /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287/action" status: 202 len: 0 microversion: 2.1 time: 0.231423 Jul 26 14:31:19.442731 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2412/4693] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:31:19 2022] POST /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:31:19.448177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-26f00025-ff96-43e9-9510-e82075c5e937 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:19.448912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-26f00025-ff96-43e9-9510-e82075c5e937 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:19.470223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26f00025-ff96-43e9-9510-e82075c5e937 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:19.470688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26f00025-ff96-43e9-9510-e82075c5e937 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:19.471490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26f00025-ff96-43e9-9510-e82075c5e937 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:19.471935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26f00025-ff96-43e9-9510-e82075c5e937 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:20.029589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76c09ed0-9395-4cdf-9ace-3e3a891f079d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:20.030292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-76c09ed0-9395-4cdf-9ace-3e3a891f079d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:20.047568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76c09ed0-9395-4cdf-9ace-3e3a891f079d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:20.053194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76c09ed0-9395-4cdf-9ace-3e3a891f079d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:20.055763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76c09ed0-9395-4cdf-9ace-3e3a891f079d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:20.059526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76c09ed0-9395-4cdf-9ace-3e3a891f079d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:20.217997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-76c09ed0-9395-4cdf-9ace-3e3a891f079d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:20.241915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-76c09ed0-9395-4cdf-9ace-3e3a891f079d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:20.243754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-76c09ed0-9395-4cdf-9ace-3e3a891f079d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:20.245145 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76c09ed0-9395-4cdf-9ace-3e3a891f079d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1356 microversion: 2.54 time: 0.220292 Jul 26 14:31:20.249879 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2413/4694] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:20 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1356 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:20.278772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a875a364-a1cf-4cba-9c23-6e743d09e390 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Action: 'create', calling method: .version_select at 0x7f8786b58dc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-321805554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE39U5fYifK/94S9jbUqfgniIrrynuuzBCedmjuKy5mzXVYNLJJydNsQLcTsA6hL6m781JGZ69m2UGnSDkKnAIQoMQ1dKt8sqoo5LyfizxsbMJ+vwiKZyJjgIj7tZ+hdSA=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:31:20.334029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-a875a364-a1cf-4cba-9c23-6e743d09e390 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Getting quotas for project 3cabf263ec224d74bf4198a01bba1ae7. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:31:20.346393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-26f00025-ff96-43e9-9510-e82075c5e937 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:20.347028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-a875a364-a1cf-4cba-9c23-6e743d09e390 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Getting quotas for user 0762370271b54557a330f7cfe2902198 and project 3cabf263ec224d74bf4198a01bba1ae7. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:31:20.357664 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-26f00025-ff96-43e9-9510-e82075c5e937 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1499 microversion: 2.1 time: 0.913540 Jul 26 14:31:20.358857 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2282/4695] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:19 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1499 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:20.417313 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a875a364-a1cf-4cba-9c23-6e743d09e390 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.142810 Jul 26 14:31:20.423425 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2414/4696] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Jul 26 14:31:20 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 26 14:31:20.435030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-321805554", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:31:20.441137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:20.461160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:20.461617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:20.462416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:20.462859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:20.638508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:31:20.641019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:31:20.641654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:31:20.642172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:31:20.649435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:31:20.851390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:20.862395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:20.863356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:20.864666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:20.865497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:20.923219 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e97f95ab-bf07-4c6b-a00c-11bb4ddf2d54 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "POST /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0/action" status: 202 len: 1138 microversion: 2.54 time: 0.498204 Jul 26 14:31:20.927518 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2283/4697] 10.222.0.70 () {62 vars in 1320 bytes} [Tue Jul 26 14:31:20 2022] POST /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0/action => generated 1138 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 14:31:20.953185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ece9637-8902-4aea-944e-9a1e054eadcc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:20.954088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1ece9637-8902-4aea-944e-9a1e054eadcc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:20.969876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ece9637-8902-4aea-944e-9a1e054eadcc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:20.998564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ece9637-8902-4aea-944e-9a1e054eadcc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:21.006500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ece9637-8902-4aea-944e-9a1e054eadcc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:21.006976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ece9637-8902-4aea-944e-9a1e054eadcc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:21.357281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ece9637-8902-4aea-944e-9a1e054eadcc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:21.377146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ece9637-8902-4aea-944e-9a1e054eadcc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:21.382911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ece9637-8902-4aea-944e-9a1e054eadcc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:21.386017 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ece9637-8902-4aea-944e-9a1e054eadcc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.438817 Jul 26 14:31:21.387469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-58cf7c8c-82b0-4743-95cd-eabe20cb7b2a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:21.388150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-58cf7c8c-82b0-4743-95cd-eabe20cb7b2a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:21.413004 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2415/4698] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:20 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:31:21.417744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58cf7c8c-82b0-4743-95cd-eabe20cb7b2a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:21.418209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58cf7c8c-82b0-4743-95cd-eabe20cb7b2a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:21.419080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58cf7c8c-82b0-4743-95cd-eabe20cb7b2a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:21.419545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58cf7c8c-82b0-4743-95cd-eabe20cb7b2a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:22.213847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-58cf7c8c-82b0-4743-95cd-eabe20cb7b2a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:22.221909 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-58cf7c8c-82b0-4743-95cd-eabe20cb7b2a tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1499 microversion: 2.1 time: 0.844229 Jul 26 14:31:22.228172 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2284/4699] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:21 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1499 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:22.418610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2dc19944-4034-4cb9-879a-66369da724b1 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:22.420472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2dc19944-4034-4cb9-879a-66369da724b1 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:22.444663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2dc19944-4034-4cb9-879a-66369da724b1 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:22.446382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2dc19944-4034-4cb9-879a-66369da724b1 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:22.450143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2dc19944-4034-4cb9-879a-66369da724b1 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:22.451250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2dc19944-4034-4cb9-879a-66369da724b1 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:22.620890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2dc19944-4034-4cb9-879a-66369da724b1 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:22.661571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2dc19944-4034-4cb9-879a-66369da724b1 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:22.665152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2dc19944-4034-4cb9-879a-66369da724b1 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:22.666844 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2dc19944-4034-4cb9-879a-66369da724b1 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.252901 Jul 26 14:31:22.694152 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2416/4700] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:22 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:23.254718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8484b024-31cc-4c5f-b087-74fe13289618 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:23.273760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8484b024-31cc-4c5f-b087-74fe13289618 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:23.328318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8484b024-31cc-4c5f-b087-74fe13289618 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:23.329112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8484b024-31cc-4c5f-b087-74fe13289618 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:23.330419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8484b024-31cc-4c5f-b087-74fe13289618 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:23.331182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8484b024-31cc-4c5f-b087-74fe13289618 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:23.695472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9aedf2ca-707c-4bd1-9c1b-bc404f3d9455 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:23.696358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9aedf2ca-707c-4bd1-9c1b-bc404f3d9455 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:23.714719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9aedf2ca-707c-4bd1-9c1b-bc404f3d9455 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:23.715198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9aedf2ca-707c-4bd1-9c1b-bc404f3d9455 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:23.716763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9aedf2ca-707c-4bd1-9c1b-bc404f3d9455 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:23.717217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9aedf2ca-707c-4bd1-9c1b-bc404f3d9455 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:23.729856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:24.068805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9aedf2ca-707c-4bd1-9c1b-bc404f3d9455 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:24.094366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9aedf2ca-707c-4bd1-9c1b-bc404f3d9455 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:24.098414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9aedf2ca-707c-4bd1-9c1b-bc404f3d9455 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:24.101343 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9aedf2ca-707c-4bd1-9c1b-bc404f3d9455 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.409408 Jul 26 14:31:24.103322 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2417/4701] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:23 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:31:24.583846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8484b024-31cc-4c5f-b087-74fe13289618 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:24.602785 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8484b024-31cc-4c5f-b087-74fe13289618 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1502 microversion: 2.1 time: 1.355996 Jul 26 14:31:24.605905 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2285/4702] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:23 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1502 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:24.634955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85d92e95-cda3-4637-83c2-b4f4f70b9ca4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:24.635643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85d92e95-cda3-4637-83c2-b4f4f70b9ca4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:24.645180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:24.652415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d92e95-cda3-4637-83c2-b4f4f70b9ca4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:24.652936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d92e95-cda3-4637-83c2-b4f4f70b9ca4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:24.653749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d92e95-cda3-4637-83c2-b4f4f70b9ca4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:24.654881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d92e95-cda3-4637-83c2-b4f4f70b9ca4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:24.723284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85d92e95-cda3-4637-83c2-b4f4f70b9ca4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:31:25.014756 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85d92e95-cda3-4637-83c2-b4f4f70b9ca4 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "DELETE /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 204 len: 0 microversion: 2.1 time: 0.386476 Jul 26 14:31:25.015612 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2418/4703] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:31:24 2022] DELETE /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:31:25.025199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c9407bd-bc44-4687-a343-aa1bef162979 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:25.025929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c9407bd-bc44-4687-a343-aa1bef162979 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:25.033890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c9407bd-bc44-4687-a343-aa1bef162979 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:25.036487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c9407bd-bc44-4687-a343-aa1bef162979 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:25.037718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c9407bd-bc44-4687-a343-aa1bef162979 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:25.042577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c9407bd-bc44-4687-a343-aa1bef162979 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:25.140409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6413d821-fc61-4bf8-9a16-2fd056a41a6e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:25.141267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6413d821-fc61-4bf8-9a16-2fd056a41a6e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:25.151360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6413d821-fc61-4bf8-9a16-2fd056a41a6e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:25.151912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6413d821-fc61-4bf8-9a16-2fd056a41a6e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:25.152742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6413d821-fc61-4bf8-9a16-2fd056a41a6e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:25.153347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6413d821-fc61-4bf8-9a16-2fd056a41a6e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:25.511660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6413d821-fc61-4bf8-9a16-2fd056a41a6e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:25.526921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6413d821-fc61-4bf8-9a16-2fd056a41a6e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:25.532543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6413d821-fc61-4bf8-9a16-2fd056a41a6e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:25.537486 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6413d821-fc61-4bf8-9a16-2fd056a41a6e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.409229 Jul 26 14:31:25.539857 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2419/4704] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:25 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:25.817079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c9407bd-bc44-4687-a343-aa1bef162979 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:25.830856 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2c9407bd-bc44-4687-a343-aa1bef162979 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1508 microversion: 2.1 time: 0.809072 Jul 26 14:31:25.832337 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2286/4705] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:25 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1508 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:26.563095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2e23b6d2-b48e-406b-90aa-3301c81d36b0 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:26.564407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2e23b6d2-b48e-406b-90aa-3301c81d36b0 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:26.618663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e23b6d2-b48e-406b-90aa-3301c81d36b0 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:26.620120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e23b6d2-b48e-406b-90aa-3301c81d36b0 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:26.629782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e23b6d2-b48e-406b-90aa-3301c81d36b0 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:26.635431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e23b6d2-b48e-406b-90aa-3301c81d36b0 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:26.853675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8efef826-698a-4b38-af78-b1408974d591 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:26.854346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8efef826-698a-4b38-af78-b1408974d591 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:26.875490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8efef826-698a-4b38-af78-b1408974d591 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:26.876033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8efef826-698a-4b38-af78-b1408974d591 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:26.881575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8efef826-698a-4b38-af78-b1408974d591 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:26.882144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8efef826-698a-4b38-af78-b1408974d591 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:27.802247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2e23b6d2-b48e-406b-90aa-3301c81d36b0 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:27.824553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2e23b6d2-b48e-406b-90aa-3301c81d36b0 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:27.830993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2e23b6d2-b48e-406b-90aa-3301c81d36b0 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:27.839718 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2e23b6d2-b48e-406b-90aa-3301c81d36b0 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 1.281628 Jul 26 14:31:27.840360 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2420/4706] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:26 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:27.867820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8efef826-698a-4b38-af78-b1408974d591 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:27.876887 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8efef826-698a-4b38-af78-b1408974d591 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1508 microversion: 2.1 time: 1.027530 Jul 26 14:31:27.887974 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2287/4707] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:26 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1508 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:28.866056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f51b24c2-640d-49e4-a06a-a5c9608b1c6f tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:28.866610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f51b24c2-640d-49e4-a06a-a5c9608b1c6f tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:28.878914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f51b24c2-640d-49e4-a06a-a5c9608b1c6f tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:28.880875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f51b24c2-640d-49e4-a06a-a5c9608b1c6f tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:28.883587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f51b24c2-640d-49e4-a06a-a5c9608b1c6f tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:28.885863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f51b24c2-640d-49e4-a06a-a5c9608b1c6f tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:28.902759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86ea2d3a-64f3-4747-a7d5-cd46b4d467d0 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:28.904322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-86ea2d3a-64f3-4747-a7d5-cd46b4d467d0 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:28.914583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86ea2d3a-64f3-4747-a7d5-cd46b4d467d0 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:28.915045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86ea2d3a-64f3-4747-a7d5-cd46b4d467d0 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:28.915838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86ea2d3a-64f3-4747-a7d5-cd46b4d467d0 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:28.916326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86ea2d3a-64f3-4747-a7d5-cd46b4d467d0 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:28.967893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:29.178065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-86ea2d3a-64f3-4747-a7d5-cd46b4d467d0 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ed87e88e53486abc87972934995bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9237dcfb14cf43598b4dab920691e6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:29.187494 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-86ea2d3a-64f3-4747-a7d5-cd46b4d467d0 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 200 len: 1466 microversion: 2.1 time: 0.288324 Jul 26 14:31:29.194657 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2288/4708] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:28 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 1466 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:31:29.249151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7a672745-8558-49ca-95fb-9354e6c032c4 req-11eabf9b-e9ca-42b2-b258-1151761b15c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293d8c60-94b6-4482-8aa0-baee2c780287", "name": "network-vif-deleted", "tag": "916c5156-1919-4742-804d-88d6b1db08d8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:31:29.251581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f51b24c2-640d-49e4-a06a-a5c9608b1c6f tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:29.288230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f51b24c2-640d-49e4-a06a-a5c9608b1c6f tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:29.291360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f51b24c2-640d-49e4-a06a-a5c9608b1c6f tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:29.292638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7a672745-8558-49ca-95fb-9354e6c032c4 req-11eabf9b-e9ca-42b2-b258-1151761b15c7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:29.293161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7a672745-8558-49ca-95fb-9354e6c032c4 req-11eabf9b-e9ca-42b2-b258-1151761b15c7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:29.296797 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f51b24c2-640d-49e4-a06a-a5c9608b1c6f tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.433419 Jul 26 14:31:29.299518 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2421/4709] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:28 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:29.315131 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7a672745-8558-49ca-95fb-9354e6c032c4 req-11eabf9b-e9ca-42b2-b258-1151761b15c7 service nova] Creating event network-vif-deleted:916c5156-1919-4742-804d-88d6b1db08d8 for instance 293d8c60-94b6-4482-8aa0-baee2c780287 on n-h1-833090-9 Jul 26 14:31:29.324231 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7a672745-8558-49ca-95fb-9354e6c032c4 req-11eabf9b-e9ca-42b2-b258-1151761b15c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078603 Jul 26 14:31:29.325643 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2289/4710] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:31:30.217063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-021d585e-708e-4415-bf39-9918621c5f68 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:30.217063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-021d585e-708e-4415-bf39-9918621c5f68 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] [instance: 293d8c60-94b6-4482-8aa0-baee2c780287] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:30.226147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-021d585e-708e-4415-bf39-9918621c5f68 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:30.226608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-021d585e-708e-4415-bf39-9918621c5f68 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:30.227389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-021d585e-708e-4415-bf39-9918621c5f68 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:30.244615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-021d585e-708e-4415-bf39-9918621c5f68 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:30.328661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05a1cb22-3ee1-47b0-b0ef-e2eb8a762e5e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:30.329993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05a1cb22-3ee1-47b0-b0ef-e2eb8a762e5e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:30.355531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05a1cb22-3ee1-47b0-b0ef-e2eb8a762e5e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:30.357696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05a1cb22-3ee1-47b0-b0ef-e2eb8a762e5e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:30.364307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05a1cb22-3ee1-47b0-b0ef-e2eb8a762e5e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:30.366367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05a1cb22-3ee1-47b0-b0ef-e2eb8a762e5e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:30.642944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05a1cb22-3ee1-47b0-b0ef-e2eb8a762e5e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:30.660396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05a1cb22-3ee1-47b0-b0ef-e2eb8a762e5e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:30.662466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05a1cb22-3ee1-47b0-b0ef-e2eb8a762e5e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:30.673957 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05a1cb22-3ee1-47b0-b0ef-e2eb8a762e5e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.349401 Jul 26 14:31:30.675560 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2290/4711] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:30 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:31:30.696473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:30.698678 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-021d585e-708e-4415-bf39-9918621c5f68 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] HTTP exception thrown: Instance 293d8c60-94b6-4482-8aa0-baee2c780287 could not be found. Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-021d585e-708e-4415-bf39-9918621c5f68 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Request method failure captured: Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 HTTP/1.1 Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_qAtW7MGOmNCecZgsaxaHDma7j-SMhYYtvm9vmq97p-Hk8yI2euUE-3hFH02OoUQlkEqqptqXB8ThUfH1ja6pgJOHqlEFZDOFg5-LZlmIGGj0BpZ297f9tgAC1719M73hXioxmcsoRAKyB2KExEv6tlf_MQY5rFPIB4pZ_8cQLZceE Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 9237dcfb14cf43598b4dab920691e6fe Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestServerAdvancedOps-1112671432 Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9237dcfb14cf43598b4dab920691e6fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9237dcfb14cf43598b4dab920691e6fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9237dcfb14cf43598b4dab920691e6fe", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9237dcfb14cf43598b4dab920691e6fe"}]}] Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestServerAdvancedOps-1112671432 Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 9237dcfb14cf43598b4dab920691e6fe Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestServerAdvancedOps-1112671432 Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestServerAdvancedOps-1112671432-project Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 38ed87e88e53486abc87972934995bb3 Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestServerAdvancedOps-1112671432-project Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 293d8c60-94b6-4482-8aa0-baee2c780287 could not be found. Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '293d8c60-94b6-4482-8aa0-baee2c780287'} Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 293d8c60-94b6-4482-8aa0-baee2c780287 could not be found. Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 293d8c60-94b6-4482-8aa0-baee2c780287 could not be found. Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:31:30.700419 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:30.708220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:31:30.708220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:31:30.708220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:31:30.708220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:31:30.708220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:31:30.708220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 293d8c60-94b6-4482-8aa0-baee2c780287 could not be found. Jul 26 14:31:30.708220 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:31:30.708220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-021d585e-708e-4415-bf39-9918621c5f68 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] Returning 404 to user: Instance 293d8c60-94b6-4482-8aa0-baee2c780287 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:31:30.708220 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-021d585e-708e-4415-bf39-9918621c5f68 tempest-TestServerAdvancedOps-1112671432 tempest-TestServerAdvancedOps-1112671432-project] 10.222.0.70 "GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287" status: 404 len: 111 microversion: 2.1 time: 0.489970 Jul 26 14:31:30.710531 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2422/4712] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:31:30 2022] GET /compute/v2.1/servers/293d8c60-94b6-4482-8aa0-baee2c780287 => generated 111 bytes in 498 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:31:31.706081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4495c2f0-fb5b-4404-a65d-5d4ae37caebb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:31.707337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4495c2f0-fb5b-4404-a65d-5d4ae37caebb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:31.718392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4495c2f0-fb5b-4404-a65d-5d4ae37caebb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:31.718876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4495c2f0-fb5b-4404-a65d-5d4ae37caebb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:31.723827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4495c2f0-fb5b-4404-a65d-5d4ae37caebb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:31.724300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4495c2f0-fb5b-4404-a65d-5d4ae37caebb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:32.865326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4495c2f0-fb5b-4404-a65d-5d4ae37caebb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:32.879494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4495c2f0-fb5b-4404-a65d-5d4ae37caebb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:32.881241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4495c2f0-fb5b-4404-a65d-5d4ae37caebb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:32.882465 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4495c2f0-fb5b-4404-a65d-5d4ae37caebb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 1.182347 Jul 26 14:31:32.886083 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2291/4713] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:31 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:33.914699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9228378b-ebb1-4edb-bca1-741505832dbc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:33.915807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9228378b-ebb1-4edb-bca1-741505832dbc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:33.942279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9228378b-ebb1-4edb-bca1-741505832dbc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:33.944178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9228378b-ebb1-4edb-bca1-741505832dbc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:33.953224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9228378b-ebb1-4edb-bca1-741505832dbc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:33.953857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9228378b-ebb1-4edb-bca1-741505832dbc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:34.125746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9228378b-ebb1-4edb-bca1-741505832dbc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:34.148710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9228378b-ebb1-4edb-bca1-741505832dbc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:34.153690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9228378b-ebb1-4edb-bca1-741505832dbc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:34.157335 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9228378b-ebb1-4edb-bca1-741505832dbc tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.246473 Jul 26 14:31:34.157976 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2423/4714] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:33 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:35.186846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cafcc81e-dbd2-4b0d-b5d7-37275a21a76c tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:35.189495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cafcc81e-dbd2-4b0d-b5d7-37275a21a76c tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:35.212671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafcc81e-dbd2-4b0d-b5d7-37275a21a76c tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:35.213886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafcc81e-dbd2-4b0d-b5d7-37275a21a76c tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:35.214874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafcc81e-dbd2-4b0d-b5d7-37275a21a76c tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:35.215398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafcc81e-dbd2-4b0d-b5d7-37275a21a76c tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:35.367244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cafcc81e-dbd2-4b0d-b5d7-37275a21a76c tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:35.381064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cafcc81e-dbd2-4b0d-b5d7-37275a21a76c tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:35.382597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cafcc81e-dbd2-4b0d-b5d7-37275a21a76c tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:35.390931 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cafcc81e-dbd2-4b0d-b5d7-37275a21a76c tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.211377 Jul 26 14:31:35.411973 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2292/4715] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:35 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:36.439170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f819db7f-8fe9-41fb-a19f-f4383264f6fe tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:36.439914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f819db7f-8fe9-41fb-a19f-f4383264f6fe tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:36.468854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:36.473659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f819db7f-8fe9-41fb-a19f-f4383264f6fe tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:36.474991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f819db7f-8fe9-41fb-a19f-f4383264f6fe tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:36.476701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f819db7f-8fe9-41fb-a19f-f4383264f6fe tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:36.477921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f819db7f-8fe9-41fb-a19f-f4383264f6fe tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:36.811394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f819db7f-8fe9-41fb-a19f-f4383264f6fe tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:36.822141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f819db7f-8fe9-41fb-a19f-f4383264f6fe tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:36.829878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f819db7f-8fe9-41fb-a19f-f4383264f6fe tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:36.834203 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f819db7f-8fe9-41fb-a19f-f4383264f6fe tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.406940 Jul 26 14:31:36.834837 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2424/4716] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:36 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:31:37.876550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-75f6304c-6b7b-4992-9e05-ed023c72b4f2 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:37.879107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-75f6304c-6b7b-4992-9e05-ed023c72b4f2 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:37.897044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75f6304c-6b7b-4992-9e05-ed023c72b4f2 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:37.897531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75f6304c-6b7b-4992-9e05-ed023c72b4f2 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:37.901441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75f6304c-6b7b-4992-9e05-ed023c72b4f2 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:37.902309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75f6304c-6b7b-4992-9e05-ed023c72b4f2 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:38.020680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-75f6304c-6b7b-4992-9e05-ed023c72b4f2 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:38.041308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-75f6304c-6b7b-4992-9e05-ed023c72b4f2 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:38.042877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-75f6304c-6b7b-4992-9e05-ed023c72b4f2 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:38.044129 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-75f6304c-6b7b-4992-9e05-ed023c72b4f2 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.175407 Jul 26 14:31:38.075229 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2293/4717] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:37 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:39.082808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-432a1a8c-fd7e-4e5f-9e04-9174ccb3cbda tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:39.083439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-432a1a8c-fd7e-4e5f-9e04-9174ccb3cbda tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:39.094494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-432a1a8c-fd7e-4e5f-9e04-9174ccb3cbda tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:39.098416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-432a1a8c-fd7e-4e5f-9e04-9174ccb3cbda tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:39.099511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-432a1a8c-fd7e-4e5f-9e04-9174ccb3cbda tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:39.103501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-432a1a8c-fd7e-4e5f-9e04-9174ccb3cbda tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:39.413430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-432a1a8c-fd7e-4e5f-9e04-9174ccb3cbda tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:39.423244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-432a1a8c-fd7e-4e5f-9e04-9174ccb3cbda tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:39.425403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-432a1a8c-fd7e-4e5f-9e04-9174ccb3cbda tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:39.439032 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-432a1a8c-fd7e-4e5f-9e04-9174ccb3cbda tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.360290 Jul 26 14:31:39.446511 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2425/4718] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:39 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:40.467731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e31a5ee0-0dff-4e4b-97ab-3ee12b65d5a9 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:40.468430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e31a5ee0-0dff-4e4b-97ab-3ee12b65d5a9 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:40.472777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=40 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:40.493900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31a5ee0-0dff-4e4b-97ab-3ee12b65d5a9 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:40.494311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31a5ee0-0dff-4e4b-97ab-3ee12b65d5a9 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:40.495093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31a5ee0-0dff-4e4b-97ab-3ee12b65d5a9 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:40.497925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e31a5ee0-0dff-4e4b-97ab-3ee12b65d5a9 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:41.341787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e31a5ee0-0dff-4e4b-97ab-3ee12b65d5a9 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:41.356098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e31a5ee0-0dff-4e4b-97ab-3ee12b65d5a9 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:41.359781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e31a5ee0-0dff-4e4b-97ab-3ee12b65d5a9 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:41.361264 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e31a5ee0-0dff-4e4b-97ab-3ee12b65d5a9 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.898039 Jul 26 14:31:41.375349 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2294/4719] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:40 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:42.388089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-34905296-c009-4a96-b045-952302eb4eb4 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:42.388828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-34905296-c009-4a96-b045-952302eb4eb4 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:42.413195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34905296-c009-4a96-b045-952302eb4eb4 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:42.413799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34905296-c009-4a96-b045-952302eb4eb4 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:42.416756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34905296-c009-4a96-b045-952302eb4eb4 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:42.418549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34905296-c009-4a96-b045-952302eb4eb4 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:42.852571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-34905296-c009-4a96-b045-952302eb4eb4 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:42.865732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-34905296-c009-4a96-b045-952302eb4eb4 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:42.868367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-34905296-c009-4a96-b045-952302eb4eb4 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:42.869686 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-34905296-c009-4a96-b045-952302eb4eb4 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.486636 Jul 26 14:31:42.874938 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2426/4720] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:42 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:31:43.905282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-14fff94c-759b-4462-b6f1-49a26908d574 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:43.906564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-14fff94c-759b-4462-b6f1-49a26908d574 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:43.921333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14fff94c-759b-4462-b6f1-49a26908d574 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:43.922280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14fff94c-759b-4462-b6f1-49a26908d574 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:43.926690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14fff94c-759b-4462-b6f1-49a26908d574 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:43.927405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14fff94c-759b-4462-b6f1-49a26908d574 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:44.125878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-14fff94c-759b-4462-b6f1-49a26908d574 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:44.142420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-14fff94c-759b-4462-b6f1-49a26908d574 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:44.145159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-14fff94c-759b-4462-b6f1-49a26908d574 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:44.150261 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-14fff94c-759b-4462-b6f1-49a26908d574 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.249083 Jul 26 14:31:44.152394 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2295/4721] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:43 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:45.179630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6c235a53-570a-492d-aeae-274839f9f269 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:45.181072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6c235a53-570a-492d-aeae-274839f9f269 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:45.201120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c235a53-570a-492d-aeae-274839f9f269 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:45.207800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c235a53-570a-492d-aeae-274839f9f269 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:45.208876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c235a53-570a-492d-aeae-274839f9f269 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:45.209523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c235a53-570a-492d-aeae-274839f9f269 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:45.432224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6c235a53-570a-492d-aeae-274839f9f269 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:45.443627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6c235a53-570a-492d-aeae-274839f9f269 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:45.445187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6c235a53-570a-492d-aeae-274839f9f269 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:45.446382 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6c235a53-570a-492d-aeae-274839f9f269 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.272076 Jul 26 14:31:45.446953 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2427/4722] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:45 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:46.470264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-14f492d8-b0e5-43d4-bd34-12208fb05094 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:46.470883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-14f492d8-b0e5-43d4-bd34-12208fb05094 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:46.487157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f492d8-b0e5-43d4-bd34-12208fb05094 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:46.487681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f492d8-b0e5-43d4-bd34-12208fb05094 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:46.489668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f492d8-b0e5-43d4-bd34-12208fb05094 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:46.490144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f492d8-b0e5-43d4-bd34-12208fb05094 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:46.755841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-14f492d8-b0e5-43d4-bd34-12208fb05094 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:46.797794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-14f492d8-b0e5-43d4-bd34-12208fb05094 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:46.808804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-14f492d8-b0e5-43d4-bd34-12208fb05094 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:46.814783 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-14f492d8-b0e5-43d4-bd34-12208fb05094 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.343863 Jul 26 14:31:46.818982 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2296/4723] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:46 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:47.851302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-80d2932a-aa1f-4383-8197-c47353bc0110 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:47.851930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-80d2932a-aa1f-4383-8197-c47353bc0110 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:47.867252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80d2932a-aa1f-4383-8197-c47353bc0110 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:47.871242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80d2932a-aa1f-4383-8197-c47353bc0110 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:47.874144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80d2932a-aa1f-4383-8197-c47353bc0110 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:47.875015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80d2932a-aa1f-4383-8197-c47353bc0110 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:48.432624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-80d2932a-aa1f-4383-8197-c47353bc0110 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:48.448574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-80d2932a-aa1f-4383-8197-c47353bc0110 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:48.450424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-80d2932a-aa1f-4383-8197-c47353bc0110 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:48.454128 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-80d2932a-aa1f-4383-8197-c47353bc0110 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.608217 Jul 26 14:31:48.458210 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2428/4724] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:47 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:49.483942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c06775d-39b8-40d4-a297-aa0047b33774 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:49.487869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c06775d-39b8-40d4-a297-aa0047b33774 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:49.524947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c06775d-39b8-40d4-a297-aa0047b33774 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:49.527709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c06775d-39b8-40d4-a297-aa0047b33774 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:49.529311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c06775d-39b8-40d4-a297-aa0047b33774 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:49.530239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c06775d-39b8-40d4-a297-aa0047b33774 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:49.733886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c06775d-39b8-40d4-a297-aa0047b33774 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:49.743075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c06775d-39b8-40d4-a297-aa0047b33774 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:49.747093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c06775d-39b8-40d4-a297-aa0047b33774 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:49.756326 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c06775d-39b8-40d4-a297-aa0047b33774 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.272828 Jul 26 14:31:49.757614 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2297/4725] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:49 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:50.784755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56eb8a63-9020-40a9-80e4-6b956b9ca15e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:50.786054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56eb8a63-9020-40a9-80e4-6b956b9ca15e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:50.814361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56eb8a63-9020-40a9-80e4-6b956b9ca15e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:50.814930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56eb8a63-9020-40a9-80e4-6b956b9ca15e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:50.820658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56eb8a63-9020-40a9-80e4-6b956b9ca15e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:50.821553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56eb8a63-9020-40a9-80e4-6b956b9ca15e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:51.001885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56eb8a63-9020-40a9-80e4-6b956b9ca15e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:51.020308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56eb8a63-9020-40a9-80e4-6b956b9ca15e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:51.021860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56eb8a63-9020-40a9-80e4-6b956b9ca15e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:51.023335 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56eb8a63-9020-40a9-80e4-6b956b9ca15e tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.242993 Jul 26 14:31:51.023905 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2429/4726] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:50 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:52.061206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-502be0a4-a66d-4121-b5a5-2dc016c4a6b7 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:52.072035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-502be0a4-a66d-4121-b5a5-2dc016c4a6b7 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:52.099788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-502be0a4-a66d-4121-b5a5-2dc016c4a6b7 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:52.100659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-502be0a4-a66d-4121-b5a5-2dc016c4a6b7 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:52.101719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-502be0a4-a66d-4121-b5a5-2dc016c4a6b7 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:52.105727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-502be0a4-a66d-4121-b5a5-2dc016c4a6b7 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:52.413211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-502be0a4-a66d-4121-b5a5-2dc016c4a6b7 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:52.450195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-502be0a4-a66d-4121-b5a5-2dc016c4a6b7 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:52.463371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-502be0a4-a66d-4121-b5a5-2dc016c4a6b7 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:52.473530 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-502be0a4-a66d-4121-b5a5-2dc016c4a6b7 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1407 microversion: 2.54 time: 0.425047 Jul 26 14:31:52.474282 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2298/4727] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:52 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:53.509515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-078143b8-f9eb-4957-b0c9-5f27ff6f58cb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:53.511637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-078143b8-f9eb-4957-b0c9-5f27ff6f58cb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:53.529540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-078143b8-f9eb-4957-b0c9-5f27ff6f58cb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:53.534010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-078143b8-f9eb-4957-b0c9-5f27ff6f58cb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:53.536074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-078143b8-f9eb-4957-b0c9-5f27ff6f58cb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:53.539508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-078143b8-f9eb-4957-b0c9-5f27ff6f58cb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:53.940432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-078143b8-f9eb-4957-b0c9-5f27ff6f58cb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:53.943899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:53.985348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-078143b8-f9eb-4957-b0c9-5f27ff6f58cb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:53.992424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-078143b8-f9eb-4957-b0c9-5f27ff6f58cb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:53.997504 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-078143b8-f9eb-4957-b0c9-5f27ff6f58cb tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1413 microversion: 2.54 time: 0.496528 Jul 26 14:31:53.998633 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2430/4728] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:53 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1413 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:55.028244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3321e3fc-9b3c-404f-9993-2e73c44626f5 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:55.028840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3321e3fc-9b3c-404f-9993-2e73c44626f5 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:55.054938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3321e3fc-9b3c-404f-9993-2e73c44626f5 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:55.055575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3321e3fc-9b3c-404f-9993-2e73c44626f5 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:55.056497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3321e3fc-9b3c-404f-9993-2e73c44626f5 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:55.063368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3321e3fc-9b3c-404f-9993-2e73c44626f5 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:55.861086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3321e3fc-9b3c-404f-9993-2e73c44626f5 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:55.875522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3321e3fc-9b3c-404f-9993-2e73c44626f5 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:55.877122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3321e3fc-9b3c-404f-9993-2e73c44626f5 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:55.879323 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3321e3fc-9b3c-404f-9993-2e73c44626f5 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1413 microversion: 2.54 time: 0.855388 Jul 26 14:31:55.879896 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2299/4729] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:55 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1413 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:56.922226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-17227b2e-7dbe-4bd4-87a7-6924c929e524 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:56.923505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-17227b2e-7dbe-4bd4-87a7-6924c929e524 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:56.975578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17227b2e-7dbe-4bd4-87a7-6924c929e524 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:56.976279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17227b2e-7dbe-4bd4-87a7-6924c929e524 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:56.977923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17227b2e-7dbe-4bd4-87a7-6924c929e524 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:56.978702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17227b2e-7dbe-4bd4-87a7-6924c929e524 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:57.408630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-17227b2e-7dbe-4bd4-87a7-6924c929e524 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:57.428476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-17227b2e-7dbe-4bd4-87a7-6924c929e524 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:57.445559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-17227b2e-7dbe-4bd4-87a7-6924c929e524 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:57.446968 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-17227b2e-7dbe-4bd4-87a7-6924c929e524 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1413 microversion: 2.54 time: 0.542988 Jul 26 14:31:57.457239 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2431/4730] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:56 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1413 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:58.475695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fb5de156-9be6-4444-a197-56d0c43d00af tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:58.480946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fb5de156-9be6-4444-a197-56d0c43d00af tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:58.496025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb5de156-9be6-4444-a197-56d0c43d00af tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:58.496810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb5de156-9be6-4444-a197-56d0c43d00af tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:58.497818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb5de156-9be6-4444-a197-56d0c43d00af tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:58.500402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb5de156-9be6-4444-a197-56d0c43d00af tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:58.731746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb5de156-9be6-4444-a197-56d0c43d00af tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:58.745770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb5de156-9be6-4444-a197-56d0c43d00af tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:58.750101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb5de156-9be6-4444-a197-56d0c43d00af tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:58.756186 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fb5de156-9be6-4444-a197-56d0c43d00af tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1398 microversion: 2.54 time: 0.284819 Jul 26 14:31:58.764755 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2300/4731] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:58 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1398 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:31:58.786020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9974d7c7-ff50-458f-89c0-274c33d3d36d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '.version_select at 0x7f8786bd34c0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:58.832377 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9974d7c7-ff50-458f-89c0-274c33d3d36d tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-321805554" status: 204 len: 0 microversion: 2.54 time: 0.054076 Jul 26 14:31:58.836508 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2432/4732] 10.222.0.70 () {60 vars in 1316 bytes} [Tue Jul 26 14:31:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-321805554 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:31:58.847524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3bf09b44-589b-4c83-a10c-4e070bb72c09 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:58.848248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3bf09b44-589b-4c83-a10c-4e070bb72c09 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:58.859869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bf09b44-589b-4c83-a10c-4e070bb72c09 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:58.860511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bf09b44-589b-4c83-a10c-4e070bb72c09 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:58.861408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bf09b44-589b-4c83-a10c-4e070bb72c09 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:58.866699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bf09b44-589b-4c83-a10c-4e070bb72c09 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:58.925081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3bf09b44-589b-4c83-a10c-4e070bb72c09 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:31:59.020903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=80 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:31:59.177158 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3bf09b44-589b-4c83-a10c-4e070bb72c09 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 204 len: 0 microversion: 2.54 time: 0.333722 Jul 26 14:31:59.180570 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2301/4733] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Jul 26 14:31:58 2022] DELETE /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:31:59.217883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-787e9130-dd28-4ffa-a322-d59521e56998 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:31:59.218880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-787e9130-dd28-4ffa-a322-d59521e56998 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:31:59.254083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-787e9130-dd28-4ffa-a322-d59521e56998 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:59.254860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-787e9130-dd28-4ffa-a322-d59521e56998 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:59.255863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-787e9130-dd28-4ffa-a322-d59521e56998 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:31:59.256545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-787e9130-dd28-4ffa-a322-d59521e56998 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:31:59.734026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-787e9130-dd28-4ffa-a322-d59521e56998 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:59.750628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-787e9130-dd28-4ffa-a322-d59521e56998 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:59.758616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-787e9130-dd28-4ffa-a322-d59521e56998 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:31:59.765410 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-787e9130-dd28-4ffa-a322-d59521e56998 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1404 microversion: 2.54 time: 0.579347 Jul 26 14:31:59.789207 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2302/4734] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:31:59 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1404 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:31:59.891901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d50a03d-b0ac-4fba-9c0d-9afe1d364aca tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Action: 'create', calling method: .version_select at 0x7f8799264af0>, body: {"pool": null} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:32:00.800779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32dd8f4a-f46d-4423-8de4-e664b81dfa23 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:00.804244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-32dd8f4a-f46d-4423-8de4-e664b81dfa23 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:32:00.812892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32dd8f4a-f46d-4423-8de4-e664b81dfa23 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:00.813618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32dd8f4a-f46d-4423-8de4-e664b81dfa23 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:00.815306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32dd8f4a-f46d-4423-8de4-e664b81dfa23 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:00.816184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32dd8f4a-f46d-4423-8de4-e664b81dfa23 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:01.882446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-32dd8f4a-f46d-4423-8de4-e664b81dfa23 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:01.896970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-32dd8f4a-f46d-4423-8de4-e664b81dfa23 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:01.902190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-32dd8f4a-f46d-4423-8de4-e664b81dfa23 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:01.905394 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32dd8f4a-f46d-4423-8de4-e664b81dfa23 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1404 microversion: 2.54 time: 1.111187 Jul 26 14:32:01.907723 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2303/4735] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:32:00 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1404 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:32:02.933077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-38c8da19-e5d4-44fd-81a9-4999d2b14268 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:02.934516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-38c8da19-e5d4-44fd-81a9-4999d2b14268 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:32:02.953634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38c8da19-e5d4-44fd-81a9-4999d2b14268 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:02.960587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38c8da19-e5d4-44fd-81a9-4999d2b14268 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:02.972176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38c8da19-e5d4-44fd-81a9-4999d2b14268 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:02.973500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-38c8da19-e5d4-44fd-81a9-4999d2b14268 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:03.369163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-38c8da19-e5d4-44fd-81a9-4999d2b14268 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:03.385906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-38c8da19-e5d4-44fd-81a9-4999d2b14268 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:03.387732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-38c8da19-e5d4-44fd-81a9-4999d2b14268 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0762370271b54557a330f7cfe2902198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cabf263ec224d74bf4198a01bba1ae7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:03.389205 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-38c8da19-e5d4-44fd-81a9-4999d2b14268 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 200 len: 1404 microversion: 2.54 time: 0.460436 Jul 26 14:32:03.389971 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2304/4736] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:32:02 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 1404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:32:04.418999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d99d4f6-7aa3-49d1-bdd6-66b439688225 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:04.419624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8d99d4f6-7aa3-49d1-bdd6-66b439688225 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] [instance: c512c49c-3eff-46ff-a162-9e3304e033b0] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:32:04.440615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d99d4f6-7aa3-49d1-bdd6-66b439688225 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:04.441091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d99d4f6-7aa3-49d1-bdd6-66b439688225 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:04.441919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d99d4f6-7aa3-49d1-bdd6-66b439688225 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:04.442372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d99d4f6-7aa3-49d1-bdd6-66b439688225 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:04.543633 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8d99d4f6-7aa3-49d1-bdd6-66b439688225 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] HTTP exception thrown: Instance c512c49c-3eff-46ff-a162-9e3304e033b0 could not be found. Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d99d4f6-7aa3-49d1-bdd6-66b439688225 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Request method failure captured: Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 HTTP/1.1 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_qx85vxU2QMj3kiU2n5QQwrL9cPIB7O3P2a8abq-hi7FnK6XQZFDqGDqvcjLLIDLQ3TY7SFcQNVsP_ob8timgH95U7CgnoPfsPmjeSO46uY21hqtY7gnKcwu7MWnBMGEYCKILVuKYESBOBmb_wszBjOTpAGI_GnZmfhWJUwQ-UXucw Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Openstack-Nova-Api-Version: 2.54 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 3cabf263ec224d74bf4198a01bba1ae7 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerShowV254Test-1262486186 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3cabf263ec224d74bf4198a01bba1ae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3cabf263ec224d74bf4198a01bba1ae7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3cabf263ec224d74bf4198a01bba1ae7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3cabf263ec224d74bf4198a01bba1ae7"}]}] Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerShowV254Test-1262486186 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 3cabf263ec224d74bf4198a01bba1ae7 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerShowV254Test-1262486186 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerShowV254Test-1262486186-project Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 0762370271b54557a330f7cfe2902198 Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerShowV254Test-1262486186-project Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance c512c49c-3eff-46ff-a162-9e3304e033b0 could not be found. Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c512c49c-3eff-46ff-a162-9e3304e033b0'} Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c512c49c-3eff-46ff-a162-9e3304e033b0 could not be found. Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c512c49c-3eff-46ff-a162-9e3304e033b0 could not be found. Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:32:04.545437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:04.551588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:04.551588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:32:04.551588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:32:04.551588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:32:04.551588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:32:04.551588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c512c49c-3eff-46ff-a162-9e3304e033b0 could not be found. Jul 26 14:32:04.551588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:04.551588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d99d4f6-7aa3-49d1-bdd6-66b439688225 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] Returning 404 to user: Instance c512c49c-3eff-46ff-a162-9e3304e033b0 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:32:04.555204 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d99d4f6-7aa3-49d1-bdd6-66b439688225 tempest-ServerShowV254Test-1262486186 tempest-ServerShowV254Test-1262486186-project] 10.222.0.70 "GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0" status: 404 len: 111 microversion: 2.54 time: 0.132159 Jul 26 14:32:04.556268 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2305/4737] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Jul 26 14:32:04 2022] GET /compute/v2.1/servers/c512c49c-3eff-46ff-a162-9e3304e033b0 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 14:32:07.420691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=7 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:32:08.335360 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d50a03d-b0ac-4fba-9c0d-9afe1d364aca tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.231937 Jul 26 14:32:08.335977 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2433/4738] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:31:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:32:08.439072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9533351b-ad55-448c-b3c9-3d7af383245c tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Calling method '.version_select at 0x7f8786d06310>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:09.560606 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9533351b-ad55-448c-b3c9-3d7af383245c tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/b1583be1-3bbf-4e21-8ba6-20fe75470fb6" status: 200 len: 142 microversion: 2.1 time: 1.127132 Jul 26 14:32:09.562718 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2306/4739] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:32:08 2022] GET /compute/v2.1/os-floating-ips/b1583be1-3bbf-4e21-8ba6-20fe75470fb6 => generated 142 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:32:09.575296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:32:09.584057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2df72aa3-13f1-4ef6-b7e2-38af93e7c62c tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Calling method '.version_select at 0x7f8799370b80>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:10.863612 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2df72aa3-13f1-4ef6-b7e2-38af93e7c62c tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.290689 Jul 26 14:32:10.865130 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2434/4740] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Jul 26 14:32:09 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:32:10.879107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e14d3d22-4ca1-4f92-a66d-d2116d08402f tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Calling method '.version_select at 0x7f8786dd58b0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:14.429558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:32:14.482972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:32:14.795645 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e14d3d22-4ca1-4f92-a66d-d2116d08402f tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/b1583be1-3bbf-4e21-8ba6-20fe75470fb6" status: 202 len: 0 microversion: 2.1 time: 3.919570 Jul 26 14:32:14.796678 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2307/4741] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:32:10 2022] DELETE /compute/v2.1/os-floating-ips/b1583be1-3bbf-4e21-8ba6-20fe75470fb6 => generated 0 bytes in 3924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:32:14.806889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-48d7deaa-aea4-4738-96b0-588dae8e4055 tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Action: 'create', calling method: .version_select at 0x7f8786b0f5e0>, body: {"pool": null} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:32:23.203316 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-48d7deaa-aea4-4738-96b0-588dae8e4055 tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.400936 Jul 26 14:32:23.205997 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2435/4742] 10.222.0.70 () {60 vars in 1170 bytes} [Tue Jul 26 14:32:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:32:23.218908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3f21cc4-f7b6-4845-9c07-9a67b0994b1a tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Calling method '.version_select at 0x7f8786dc6b80>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:26.358599 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f3f21cc4-f7b6-4845-9c07-9a67b0994b1a tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/34f93dd8-fc4d-4379-8695-b08ab235b9b1" status: 202 len: 0 microversion: 2.1 time: 3.146013 Jul 26 14:32:26.359587 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2308/4743] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:32:23 2022] DELETE /compute/v2.1/os-floating-ips/34f93dd8-fc4d-4379-8695-b08ab235b9b1 => generated 0 bytes in 3148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:32:26.370102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8a50baf8-adf5-43b3-8f2f-886db2671944 tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Calling method '.version_select at 0x7f8787f1b430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:26.467418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-8a50baf8-adf5-43b3-8f2f-886db2671944 tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 34f93dd8-fc4d-4379-8695-b08ab235b9b1 could not be found", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:32:26.468388 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-8a50baf8-adf5-43b3-8f2f-886db2671944 tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] HTTP exception thrown: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8a50baf8-adf5-43b3-8f2f-886db2671944 tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Request method failure captured: Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-floating-ips/34f93dd8-fc4d-4379-8695-b08ab235b9b1 HTTP/1.1 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_re6zb9TGJfomJY4-ZM1IOunXnnHoQVDCrZ2o1tv1HAa9FQq3e4TqCJWqKhPGzB7kkWgqxrLD-vTGV4u9Go_eZ7cbm5aZYDhwibK3_7yuoUjIYYR4c3X7DjSBIAjckLuesw9n0dGrWu7smhFCX9UHtPyNIQDEfNxA-N0HbCPcNPfvM Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: e33cdcfa80a444109a63ef8be408d993 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-FloatingIPsTestJSON-147867870 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e33cdcfa80a444109a63ef8be408d993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e33cdcfa80a444109a63ef8be408d993"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e33cdcfa80a444109a63ef8be408d993", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e33cdcfa80a444109a63ef8be408d993"}]}] Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-FloatingIPsTestJSON-147867870 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: e33cdcfa80a444109a63ef8be408d993 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-FloatingIPsTestJSON-147867870 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-FloatingIPsTestJSON-147867870-project Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6ea8fb0648cc46bd99097caa2db9f45e Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-FloatingIPsTestJSON-147867870-project Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: exception: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '34f93dd8-fc4d-4379-8695-b08ab235b9b1'} Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 34f93dd8-fc4d-4379-8695-b08ab235b9b1 could not be found Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c23eb02f-379c-4afe-b796-2d982d134e60'] Jul 26 14:32:26.480701 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1. Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1 Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1 Jul 26 14:32:26.486636 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.493969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8a50baf8-adf5-43b3-8f2f-886db2671944 tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Returning 404 to user: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1 {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:32:26.493969 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8a50baf8-adf5-43b3-8f2f-886db2671944 tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/34f93dd8-fc4d-4379-8695-b08ab235b9b1" status: 404 len: 111 microversion: 2.1 time: 0.127752 Jul 26 14:32:26.494655 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2436/4744] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 14:32:26 2022] GET /compute/v2.1/os-floating-ips/34f93dd8-fc4d-4379-8695-b08ab235b9b1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:32:26.504759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d3baed93-50a9-408f-90e8-f696ae82e5cf tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Calling method '.version_select at 0x7f8786d2c310>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:26.641568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-d3baed93-50a9-408f-90e8-f696ae82e5cf tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 34f93dd8-fc4d-4379-8695-b08ab235b9b1 could not be found", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:32:26.642907 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d3baed93-50a9-408f-90e8-f696ae82e5cf tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] HTTP exception thrown: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d3baed93-50a9-408f-90e8-f696ae82e5cf tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Request method failure captured: Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-floating-ips/34f93dd8-fc4d-4379-8695-b08ab235b9b1 HTTP/1.1 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_re6zb9TGJfomJY4-ZM1IOunXnnHoQVDCrZ2o1tv1HAa9FQq3e4TqCJWqKhPGzB7kkWgqxrLD-vTGV4u9Go_eZ7cbm5aZYDhwibK3_7yuoUjIYYR4c3X7DjSBIAjckLuesw9n0dGrWu7smhFCX9UHtPyNIQDEfNxA-N0HbCPcNPfvM Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: e33cdcfa80a444109a63ef8be408d993 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-FloatingIPsTestJSON-147867870 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e33cdcfa80a444109a63ef8be408d993"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e33cdcfa80a444109a63ef8be408d993"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e33cdcfa80a444109a63ef8be408d993", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e33cdcfa80a444109a63ef8be408d993"}]}] Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-FloatingIPsTestJSON-147867870 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: e33cdcfa80a444109a63ef8be408d993 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-FloatingIPsTestJSON-147867870 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-FloatingIPsTestJSON-147867870-project Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6ea8fb0648cc46bd99097caa2db9f45e Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-FloatingIPsTestJSON-147867870-project Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: exception: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '34f93dd8-fc4d-4379-8695-b08ab235b9b1'} Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 34f93dd8-fc4d-4379-8695-b08ab235b9b1 could not be found Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8501ffc4-ba52-462d-8adc-05c1da507b57'] Jul 26 14:32:26.646131 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1. Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1 Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1 Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d3baed93-50a9-408f-90e8-f696ae82e5cf tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] Returning 404 to user: Floating IP not found for ID 34f93dd8-fc4d-4379-8695-b08ab235b9b1 {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d3baed93-50a9-408f-90e8-f696ae82e5cf tempest-FloatingIPsTestJSON-147867870 tempest-FloatingIPsTestJSON-147867870-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/34f93dd8-fc4d-4379-8695-b08ab235b9b1" status: 404 len: 111 microversion: 2.1 time: 0.148299 Jul 26 14:32:26.654331 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2309/4745] 10.222.0.70 () {58 vars in 1263 bytes} [Tue Jul 26 14:32:26 2022] DELETE /compute/v2.1/os-floating-ips/34f93dd8-fc4d-4379-8695-b08ab235b9b1 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:32:49.008120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-301256945", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "e83c45b5-8571-49b8-8948-f75f93862b4a"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:32:49.298587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] validate_networks() for [('e83c45b5-8571-49b8-8948-f75f93862b4a', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:32:51.240341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:32:51.240945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:32:51.242309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:32:51.242309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:32:51.242309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:32:51.285103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:51.286167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:51.287424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:51.295305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:51.375209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Getting quotas for project 1bd529458cb14838a52bb97042910a73. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:32:51.411028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Getting quotas for user fe09966a2dd345b88b12944bf831bf0c and project 1bd529458cb14838a52bb97042910a73. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:32:51.456789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:32:51.461309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:32:51.616675 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e86075fc-dd30-4582-b441-765886efc953 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.614716 Jul 26 14:32:51.617933 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2437/4746] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:32:51.630993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-696424cc-ad87-4954-be6f-a8f8ef73020d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:51.631751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-696424cc-ad87-4954-be6f-a8f8ef73020d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:32:51.904980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-696424cc-ad87-4954-be6f-a8f8ef73020d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:51.919543 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-696424cc-ad87-4954-be6f-a8f8ef73020d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1218 microversion: 2.1 time: 0.293677 Jul 26 14:32:51.930383 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2310/4747] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:32:51 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1218 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:32:52.955735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ae66040-6c37-4328-a34d-10b96c30dd85 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:52.958725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5ae66040-6c37-4328-a34d-10b96c30dd85 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:32:52.986251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ae66040-6c37-4328-a34d-10b96c30dd85 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:52.986964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ae66040-6c37-4328-a34d-10b96c30dd85 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:52.993536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ae66040-6c37-4328-a34d-10b96c30dd85 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:52.997811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ae66040-6c37-4328-a34d-10b96c30dd85 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:53.361359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5ae66040-6c37-4328-a34d-10b96c30dd85 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:53.375643 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ae66040-6c37-4328-a34d-10b96c30dd85 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1214 microversion: 2.1 time: 0.429274 Jul 26 14:32:53.381315 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2438/4748] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:32:52 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1214 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:32:54.399330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-73d3615b-220d-4375-8a7c-f8b99f489db1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:54.399997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-73d3615b-220d-4375-8a7c-f8b99f489db1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:32:54.430904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73d3615b-220d-4375-8a7c-f8b99f489db1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:54.430904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73d3615b-220d-4375-8a7c-f8b99f489db1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:54.431697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73d3615b-220d-4375-8a7c-f8b99f489db1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:54.437243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73d3615b-220d-4375-8a7c-f8b99f489db1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:54.784645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-73d3615b-220d-4375-8a7c-f8b99f489db1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:54.796789 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-73d3615b-220d-4375-8a7c-f8b99f489db1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1276 microversion: 2.1 time: 0.400629 Jul 26 14:32:54.812913 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2311/4749] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:32:54 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1276 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:32:55.822531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d3b285f5-5cc1-41a4-b0a7-9e65a2d07de5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:55.823170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d3b285f5-5cc1-41a4-b0a7-9e65a2d07de5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:32:55.841925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3b285f5-5cc1-41a4-b0a7-9e65a2d07de5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:55.844876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3b285f5-5cc1-41a4-b0a7-9e65a2d07de5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:55.845938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3b285f5-5cc1-41a4-b0a7-9e65a2d07de5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:55.846575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3b285f5-5cc1-41a4-b0a7-9e65a2d07de5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:56.367989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d3b285f5-5cc1-41a4-b0a7-9e65a2d07de5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:56.384125 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d3b285f5-5cc1-41a4-b0a7-9e65a2d07de5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1276 microversion: 2.1 time: 0.561505 Jul 26 14:32:56.385460 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2439/4750] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:32:55 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1276 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:32:57.410971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8e5a62b5-0b14-4d7f-8d22-14765e4d5406 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:57.414603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8e5a62b5-0b14-4d7f-8d22-14765e4d5406 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:32:57.427110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e5a62b5-0b14-4d7f-8d22-14765e4d5406 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:57.434358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e5a62b5-0b14-4d7f-8d22-14765e4d5406 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:57.435464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e5a62b5-0b14-4d7f-8d22-14765e4d5406 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:57.436170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e5a62b5-0b14-4d7f-8d22-14765e4d5406 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:58.272502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8e5a62b5-0b14-4d7f-8d22-14765e4d5406 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:32:58.312496 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8e5a62b5-0b14-4d7f-8d22-14765e4d5406 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1318 microversion: 2.1 time: 0.907933 Jul 26 14:32:58.326816 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2312/4751] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:32:57 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1318 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:32:58.382345 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 14:32:58.382822 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 14:32:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 14:32:59.337960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4da45a4b-c0f8-4ebc-80ba-4318a60e84a2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:32:59.339890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4da45a4b-c0f8-4ebc-80ba-4318a60e84a2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:32:59.356629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4da45a4b-c0f8-4ebc-80ba-4318a60e84a2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:59.357587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4da45a4b-c0f8-4ebc-80ba-4318a60e84a2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:32:59.359998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4da45a4b-c0f8-4ebc-80ba-4318a60e84a2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:32:59.364421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4da45a4b-c0f8-4ebc-80ba-4318a60e84a2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:01.060426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4da45a4b-c0f8-4ebc-80ba-4318a60e84a2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:01.077101 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4da45a4b-c0f8-4ebc-80ba-4318a60e84a2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1318 microversion: 2.1 time: 1.743181 Jul 26 14:33:01.078010 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2440/4752] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:32:59 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1318 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:01.580254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-106298240", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "111e101e-35c6-4e14-9f1a-19bc9cc657df"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:01.686770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] validate_networks() for [('111e101e-35c6-4e14-9f1a-19bc9cc657df', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:33:01.910456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:02.101562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cc7acfc1-1d33-483f-bf8a-3e84a7778b7a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:02.102209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cc7acfc1-1d33-483f-bf8a-3e84a7778b7a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:02.105376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:02.106498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:02.119812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc7acfc1-1d33-483f-bf8a-3e84a7778b7a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:02.120261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc7acfc1-1d33-483f-bf8a-3e84a7778b7a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:02.121060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc7acfc1-1d33-483f-bf8a-3e84a7778b7a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:02.121512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc7acfc1-1d33-483f-bf8a-3e84a7778b7a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:02.835930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cc7acfc1-1d33-483f-bf8a-3e84a7778b7a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:02.855599 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cc7acfc1-1d33-483f-bf8a-3e84a7778b7a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1318 microversion: 2.1 time: 0.757936 Jul 26 14:33:02.860116 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2441/4753] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:02 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:02.885901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1da1165b-189c-4cb4-81d2-95113dd712ea req-e66d1d80-1845-44eb-99bf-a4921ecc9ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed1cf1ca-f033-41e3-bdff-b0c315f13412", "tag": "49b04061-6067-44b5-a323-5993116f5190"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:02.929098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1da1165b-189c-4cb4-81d2-95113dd712ea req-e66d1d80-1845-44eb-99bf-a4921ecc9ba7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:02.930848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1da1165b-189c-4cb4-81d2-95113dd712ea req-e66d1d80-1845-44eb-99bf-a4921ecc9ba7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:02.986966 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1da1165b-189c-4cb4-81d2-95113dd712ea req-e66d1d80-1845-44eb-99bf-a4921ecc9ba7 service nova] Creating event network-changed:49b04061-6067-44b5-a323-5993116f5190 for instance ed1cf1ca-f033-41e3-bdff-b0c315f13412 on n-h2-833090-9 Jul 26 14:33:03.009255 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1da1165b-189c-4cb4-81d2-95113dd712ea req-e66d1d80-1845-44eb-99bf-a4921ecc9ba7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140650 Jul 26 14:33:03.012922 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2442/4754] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:33:03.882938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-67c10a8f-e569-4101-97f9-0fe98dd1605b tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:03.884860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-67c10a8f-e569-4101-97f9-0fe98dd1605b tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:03.910728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67c10a8f-e569-4101-97f9-0fe98dd1605b tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:03.911203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67c10a8f-e569-4101-97f9-0fe98dd1605b tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:03.919880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67c10a8f-e569-4101-97f9-0fe98dd1605b tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:03.923802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67c10a8f-e569-4101-97f9-0fe98dd1605b tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:04.707723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-67c10a8f-e569-4101-97f9-0fe98dd1605b tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:04.727209 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-67c10a8f-e569-4101-97f9-0fe98dd1605b tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1318 microversion: 2.1 time: 0.849553 Jul 26 14:33:04.728519 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2443/4755] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:03 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1318 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:05.072248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:33:05.072764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:33:05.073455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:33:05.074197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:33:05.074855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:33:05.116829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:05.117382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:05.119133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:05.119934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:05.191732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Getting quotas for project 8891372cf522401f83bd7e379abd4a32. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:33:05.214844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Getting quotas for user 4cbd008c47a04847b8772b7f957bcd04 and project 8891372cf522401f83bd7e379abd4a32. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:33:05.269178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:33:05.273185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:33:05.503971 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3cf06e31-bd8c-4f6e-a99b-5172372fbe07 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.291517 Jul 26 14:33:05.510665 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2313/4756] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:33:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:33:05.513147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1439175703", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "43a29853-2a65-4510-8376-03740769179b"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:05.542019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-50e83c2f-c9b1-4af7-8e6e-1eded4760fbe tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:05.544630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-50e83c2f-c9b1-4af7-8e6e-1eded4760fbe tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:05.920979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-50e83c2f-c9b1-4af7-8e6e-1eded4760fbe tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:05.928901 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-50e83c2f-c9b1-4af7-8e6e-1eded4760fbe tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1224 microversion: 2.1 time: 0.416754 Jul 26 14:33:05.933913 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2314/4757] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:05 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1224 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:05.951163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-962c2718-779b-415f-83b3-80a5ccd9657d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:05.954387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-962c2718-779b-415f-83b3-80a5ccd9657d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:05.977129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-962c2718-779b-415f-83b3-80a5ccd9657d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:05.977659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-962c2718-779b-415f-83b3-80a5ccd9657d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:05.978470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-962c2718-779b-415f-83b3-80a5ccd9657d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:05.983077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-962c2718-779b-415f-83b3-80a5ccd9657d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:06.436838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] validate_networks() for [('43a29853-2a65-4510-8376-03740769179b', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:33:08.762983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-962c2718-779b-415f-83b3-80a5ccd9657d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:08.774641 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-962c2718-779b-415f-83b3-80a5ccd9657d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1318 microversion: 2.1 time: 2.838973 Jul 26 14:33:08.793155 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2315/4758] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:05 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1318 bytes in 2858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:08.801846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae598b53-d9f3-4291-825c-8cda7bec6081 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:08.803385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ae598b53-d9f3-4291-825c-8cda7bec6081 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:08.833220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae598b53-d9f3-4291-825c-8cda7bec6081 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:08.835733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae598b53-d9f3-4291-825c-8cda7bec6081 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:08.844481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae598b53-d9f3-4291-825c-8cda7bec6081 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:08.847100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae598b53-d9f3-4291-825c-8cda7bec6081 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:09.470173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ae598b53-d9f3-4291-825c-8cda7bec6081 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:09.489310 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ae598b53-d9f3-4291-825c-8cda7bec6081 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1282 microversion: 2.1 time: 0.689105 Jul 26 14:33:09.489998 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2316/4759] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:08 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1282 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:09.798071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c63e038d-459b-41c0-a7e7-f40573347457 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:09.799470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c63e038d-459b-41c0-a7e7-f40573347457 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:09.812247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c63e038d-459b-41c0-a7e7-f40573347457 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:09.812963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c63e038d-459b-41c0-a7e7-f40573347457 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:09.815999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c63e038d-459b-41c0-a7e7-f40573347457 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:09.818236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c63e038d-459b-41c0-a7e7-f40573347457 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:11.217328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:33:11.220416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:33:11.221305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:33:11.228827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c63e038d-459b-41c0-a7e7-f40573347457 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:11.229441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:33:11.231072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:33:11.243014 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c63e038d-459b-41c0-a7e7-f40573347457 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1318 microversion: 2.1 time: 1.450272 Jul 26 14:33:11.262990 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2317/4760] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:09 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1318 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:11.274086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d263db4-9819-4347-a66c-b90c6828fb8e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:11.274723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3d263db4-9819-4347-a66c-b90c6828fb8e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:11.286716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:11.288062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:11.290907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:11.293922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:11.296634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d263db4-9819-4347-a66c-b90c6828fb8e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:11.300094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d263db4-9819-4347-a66c-b90c6828fb8e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:11.302138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d263db4-9819-4347-a66c-b90c6828fb8e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:11.303194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d263db4-9819-4347-a66c-b90c6828fb8e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:11.414496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Getting quotas for project a8ac838c74b14807b401f02d5092ecd1. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:33:11.452155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Getting quotas for user 178c09ff427d4a51b8863e86055e1e41 and project a8ac838c74b14807b401f02d5092ecd1. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:33:11.540979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:33:11.552659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:33:11.645046 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b46c99c6-dcb2-4866-92d9-1bdf8163b4d0 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.867155 Jul 26 14:33:11.646726 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2444/4761] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:33:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 6870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:33:11.671416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8d8aa552-34d3-44a9-b23a-ddfca0b15a89 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:11.675930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8d8aa552-34d3-44a9-b23a-ddfca0b15a89 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:11.859411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3d263db4-9819-4347-a66c-b90c6828fb8e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:11.867897 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3d263db4-9819-4347-a66c-b90c6828fb8e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1324 microversion: 2.1 time: 0.600051 Jul 26 14:33:11.877250 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2318/4762] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:11 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1324 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:11.907800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8d8aa552-34d3-44a9-b23a-ddfca0b15a89 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:11.927314 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8d8aa552-34d3-44a9-b23a-ddfca0b15a89 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1228 microversion: 2.1 time: 0.268679 Jul 26 14:33:11.932232 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2445/4763] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:11 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1228 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:12.267720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-212c7264-a888-40a0-9dde-5049b634a003 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:12.268242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-212c7264-a888-40a0-9dde-5049b634a003 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:12.287113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-212c7264-a888-40a0-9dde-5049b634a003 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:12.294776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-212c7264-a888-40a0-9dde-5049b634a003 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:12.296018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-212c7264-a888-40a0-9dde-5049b634a003 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:12.296496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-212c7264-a888-40a0-9dde-5049b634a003 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:12.884766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-212c7264-a888-40a0-9dde-5049b634a003 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:12.899215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0c4bb613-8a92-4f24-ae2e-91e16dbeaf4d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:12.911891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0c4bb613-8a92-4f24-ae2e-91e16dbeaf4d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:12.923781 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-212c7264-a888-40a0-9dde-5049b634a003 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1318 microversion: 2.1 time: 0.660901 Jul 26 14:33:12.925161 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2319/4764] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:12 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1318 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:12.947012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c4bb613-8a92-4f24-ae2e-91e16dbeaf4d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:12.947862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c4bb613-8a92-4f24-ae2e-91e16dbeaf4d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:12.949891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c4bb613-8a92-4f24-ae2e-91e16dbeaf4d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:12.950567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0c4bb613-8a92-4f24-ae2e-91e16dbeaf4d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:12.960512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-121d0b70-8cac-4f90-a78c-9b6d0b3b5f1c tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:12.961154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-121d0b70-8cac-4f90-a78c-9b6d0b3b5f1c tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:12.992455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-121d0b70-8cac-4f90-a78c-9b6d0b3b5f1c tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:12.992937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-121d0b70-8cac-4f90-a78c-9b6d0b3b5f1c tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:12.993789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-121d0b70-8cac-4f90-a78c-9b6d0b3b5f1c tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:12.998587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-121d0b70-8cac-4f90-a78c-9b6d0b3b5f1c tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:13.174818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-121d0b70-8cac-4f90-a78c-9b6d0b3b5f1c tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:13.183311 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-121d0b70-8cac-4f90-a78c-9b6d0b3b5f1c tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1232 microversion: 2.1 time: 0.234232 Jul 26 14:33:13.195745 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2320/4765] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:12 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1232 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:13.545495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0c4bb613-8a92-4f24-ae2e-91e16dbeaf4d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:13.558458 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0c4bb613-8a92-4f24-ae2e-91e16dbeaf4d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1324 microversion: 2.1 time: 0.665357 Jul 26 14:33:13.561661 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2446/4766] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:12 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1324 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:13.948929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c2df086-9e10-493f-9ddc-cad968af90d5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:13.950218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c2df086-9e10-493f-9ddc-cad968af90d5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:13.964214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c2df086-9e10-493f-9ddc-cad968af90d5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:13.966149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c2df086-9e10-493f-9ddc-cad968af90d5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:13.967288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c2df086-9e10-493f-9ddc-cad968af90d5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:13.970069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c2df086-9e10-493f-9ddc-cad968af90d5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:14.166057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b20e0c5c-0b08-4db6-bd22-5d9dcf3842d8 req-278d9196-362c-4bb1-9b8b-a0fb6c9b6585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde8a26b-25d1-4cfa-93a1-9d697e5d395e", "tag": "b84a5eb8-d40f-4ed0-a8cb-3758d0ca85f2"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:14.205653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b20e0c5c-0b08-4db6-bd22-5d9dcf3842d8 req-278d9196-362c-4bb1-9b8b-a0fb6c9b6585 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:14.206107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b20e0c5c-0b08-4db6-bd22-5d9dcf3842d8 req-278d9196-362c-4bb1-9b8b-a0fb6c9b6585 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:14.242758 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b20e0c5c-0b08-4db6-bd22-5d9dcf3842d8 req-278d9196-362c-4bb1-9b8b-a0fb6c9b6585 service nova] Creating event network-changed:b84a5eb8-d40f-4ed0-a8cb-3758d0ca85f2 for instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e on n-h1-833090-9 Jul 26 14:33:14.252599 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b20e0c5c-0b08-4db6-bd22-5d9dcf3842d8 req-278d9196-362c-4bb1-9b8b-a0fb6c9b6585 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092654 Jul 26 14:33:14.257143 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2447/4767] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:33:14.270333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2e684d67-598f-4fbd-a3c5-9a82c671b02a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:14.271062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2e684d67-598f-4fbd-a3c5-9a82c671b02a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:14.290925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e684d67-598f-4fbd-a3c5-9a82c671b02a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:14.291884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e684d67-598f-4fbd-a3c5-9a82c671b02a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:14.293061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e684d67-598f-4fbd-a3c5-9a82c671b02a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:14.293614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e684d67-598f-4fbd-a3c5-9a82c671b02a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:14.550387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2e684d67-598f-4fbd-a3c5-9a82c671b02a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:14.559311 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2e684d67-598f-4fbd-a3c5-9a82c671b02a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1286 microversion: 2.1 time: 0.300931 Jul 26 14:33:14.564231 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2448/4768] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:14 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1286 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:14.589993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7557064d-afcb-4cdf-9b18-4893223022af tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:14.590958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7557064d-afcb-4cdf-9b18-4893223022af tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:14.605215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7557064d-afcb-4cdf-9b18-4893223022af tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:14.605975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7557064d-afcb-4cdf-9b18-4893223022af tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:14.611657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7557064d-afcb-4cdf-9b18-4893223022af tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:14.612332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7557064d-afcb-4cdf-9b18-4893223022af tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:14.789024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c2df086-9e10-493f-9ddc-cad968af90d5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:14.806912 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c2df086-9e10-493f-9ddc-cad968af90d5 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1318 microversion: 2.1 time: 0.862451 Jul 26 14:33:14.807629 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2321/4769] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:13 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1318 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:14.955489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b4cff118-e57a-4024-9d76-01e427a48940 req-980c5b01-563f-4921-b7f7-e0dbe780d481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1cf1ca-f033-41e3-bdff-b0c315f13412", "name": "network-vif-plugged", "status": "completed", "tag": "49b04061-6067-44b5-a323-5993116f5190"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:14.974538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b4cff118-e57a-4024-9d76-01e427a48940 req-980c5b01-563f-4921-b7f7-e0dbe780d481 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:14.979708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b4cff118-e57a-4024-9d76-01e427a48940 req-980c5b01-563f-4921-b7f7-e0dbe780d481 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:15.001044 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b4cff118-e57a-4024-9d76-01e427a48940 req-980c5b01-563f-4921-b7f7-e0dbe780d481 service nova] Creating event network-vif-plugged:49b04061-6067-44b5-a323-5993116f5190 for instance ed1cf1ca-f033-41e3-bdff-b0c315f13412 on n-h2-833090-9 Jul 26 14:33:15.019174 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b4cff118-e57a-4024-9d76-01e427a48940 req-980c5b01-563f-4921-b7f7-e0dbe780d481 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068692 Jul 26 14:33:15.021990 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2322/4770] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:33:15.541228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7557064d-afcb-4cdf-9b18-4893223022af tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:15.557380 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7557064d-afcb-4cdf-9b18-4893223022af tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1324 microversion: 2.1 time: 0.964779 Jul 26 14:33:15.558381 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2449/4771] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:14 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1324 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:15.591389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8df650e7-5821-44ef-84df-04b0aac866b4 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:15.592897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8df650e7-5821-44ef-84df-04b0aac866b4 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:15.597058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:15.614923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8df650e7-5821-44ef-84df-04b0aac866b4 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:15.617539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8df650e7-5821-44ef-84df-04b0aac866b4 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:15.618604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8df650e7-5821-44ef-84df-04b0aac866b4 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:15.619516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8df650e7-5821-44ef-84df-04b0aac866b4 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:15.833428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aefce404-7039-4352-8b65-39922329e3d3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:15.834160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aefce404-7039-4352-8b65-39922329e3d3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:15.842024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aefce404-7039-4352-8b65-39922329e3d3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:15.843104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aefce404-7039-4352-8b65-39922329e3d3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:15.846635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aefce404-7039-4352-8b65-39922329e3d3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:15.847487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aefce404-7039-4352-8b65-39922329e3d3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:15.926308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:16.017705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8df650e7-5821-44ef-84df-04b0aac866b4 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:16.038447 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8df650e7-5821-44ef-84df-04b0aac866b4 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1286 microversion: 2.1 time: 0.451039 Jul 26 14:33:16.040432 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2323/4772] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:15 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1286 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:16.295344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aefce404-7039-4352-8b65-39922329e3d3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:16.307706 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aefce404-7039-4352-8b65-39922329e3d3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1318 microversion: 2.1 time: 0.475252 Jul 26 14:33:16.308712 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2450/4773] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:15 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:16.599034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4bf7dda-cf1e-41c9-a5c0-8637a4cc9494 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:16.599888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b4bf7dda-cf1e-41c9-a5c0-8637a4cc9494 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:16.616201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4bf7dda-cf1e-41c9-a5c0-8637a4cc9494 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:16.619194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4bf7dda-cf1e-41c9-a5c0-8637a4cc9494 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:16.629300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4bf7dda-cf1e-41c9-a5c0-8637a4cc9494 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:16.633206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4bf7dda-cf1e-41c9-a5c0-8637a4cc9494 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:17.059583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9c69015-4d93-4eca-9041-2367736fd180 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:17.063010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b9c69015-4d93-4eca-9041-2367736fd180 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:17.077343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9c69015-4d93-4eca-9041-2367736fd180 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:17.091300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9c69015-4d93-4eca-9041-2367736fd180 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:17.097022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9c69015-4d93-4eca-9041-2367736fd180 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:17.097022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9c69015-4d93-4eca-9041-2367736fd180 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:17.125847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4bf7dda-cf1e-41c9-a5c0-8637a4cc9494 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:17.140089 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b4bf7dda-cf1e-41c9-a5c0-8637a4cc9494 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1324 microversion: 2.1 time: 0.556565 Jul 26 14:33:17.164024 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2324/4774] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:16 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1324 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:17.330445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-21b92509-1449-43e1-9b66-425d4b2abf9e tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:17.331181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-21b92509-1449-43e1-9b66-425d4b2abf9e tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:17.340295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21b92509-1449-43e1-9b66-425d4b2abf9e tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:17.340954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21b92509-1449-43e1-9b66-425d4b2abf9e tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:17.341915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21b92509-1449-43e1-9b66-425d4b2abf9e tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:17.342564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21b92509-1449-43e1-9b66-425d4b2abf9e tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:17.991924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b9c69015-4d93-4eca-9041-2367736fd180 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:18.004140 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b9c69015-4d93-4eca-9041-2367736fd180 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1328 microversion: 2.1 time: 0.948833 Jul 26 14:33:18.007370 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2451/4775] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:17 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1328 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:18.178827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ae7d407-fd92-4531-a2d7-0af5765b13f0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:18.180249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1ae7d407-fd92-4531-a2d7-0af5765b13f0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:18.195021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ae7d407-fd92-4531-a2d7-0af5765b13f0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:18.195795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ae7d407-fd92-4531-a2d7-0af5765b13f0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:18.196798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ae7d407-fd92-4531-a2d7-0af5765b13f0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:18.197413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ae7d407-fd92-4531-a2d7-0af5765b13f0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:18.414533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-21b92509-1449-43e1-9b66-425d4b2abf9e tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:18.424151 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-21b92509-1449-43e1-9b66-425d4b2abf9e tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1508 microversion: 2.1 time: 1.097497 Jul 26 14:33:18.436299 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2325/4776] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:17 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1508 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:19.029530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1ef2d4a1-44e2-4a2d-8e37-d0603e59e3f3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:19.031529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1ef2d4a1-44e2-4a2d-8e37-d0603e59e3f3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:19.047205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ef2d4a1-44e2-4a2d-8e37-d0603e59e3f3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:19.052237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ef2d4a1-44e2-4a2d-8e37-d0603e59e3f3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:19.054476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ef2d4a1-44e2-4a2d-8e37-d0603e59e3f3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:19.065912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ef2d4a1-44e2-4a2d-8e37-d0603e59e3f3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:19.408882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ae7d407-fd92-4531-a2d7-0af5765b13f0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:19.412100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=73 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:19.431399 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ae7d407-fd92-4531-a2d7-0af5765b13f0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1324 microversion: 2.1 time: 1.256236 Jul 26 14:33:19.438748 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2452/4777] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:18 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1324 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:20.152914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ef2d4a1-44e2-4a2d-8e37-d0603e59e3f3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:20.162113 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1ef2d4a1-44e2-4a2d-8e37-d0603e59e3f3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1328 microversion: 2.1 time: 1.138365 Jul 26 14:33:20.180529 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2326/4778] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:19 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1328 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:20.462632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5075ea9-3894-4a55-9377-448947e832a7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:20.466867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a5075ea9-3894-4a55-9377-448947e832a7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:20.535442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:20.552347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5075ea9-3894-4a55-9377-448947e832a7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:20.553026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5075ea9-3894-4a55-9377-448947e832a7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:20.554083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5075ea9-3894-4a55-9377-448947e832a7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:20.554533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5075ea9-3894-4a55-9377-448947e832a7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:21.199592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1934d3f9-1752-45ef-98be-22898ab1aa46 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:21.200465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1934d3f9-1752-45ef-98be-22898ab1aa46 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:21.217350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1934d3f9-1752-45ef-98be-22898ab1aa46 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:21.221488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1934d3f9-1752-45ef-98be-22898ab1aa46 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:21.224876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1934d3f9-1752-45ef-98be-22898ab1aa46 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:21.227338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1934d3f9-1752-45ef-98be-22898ab1aa46 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:21.351644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:21.478333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a5075ea9-3894-4a55-9377-448947e832a7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:21.491316 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a5075ea9-3894-4a55-9377-448947e832a7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1324 microversion: 2.1 time: 1.040312 Jul 26 14:33:21.495162 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2453/4779] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:20 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1324 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:22.275305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-233c3e56-308a-466c-8532-98bb79a6db44 req-bdb30146-3199-4cea-9e6a-c4c24795011d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde8a26b-25d1-4cfa-93a1-9d697e5d395e", "name": "network-vif-plugged", "status": "completed", "tag": "b84a5eb8-d40f-4ed0-a8cb-3758d0ca85f2"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:22.306972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:22.313992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-233c3e56-308a-466c-8532-98bb79a6db44 req-bdb30146-3199-4cea-9e6a-c4c24795011d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:22.316455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-233c3e56-308a-466c-8532-98bb79a6db44 req-bdb30146-3199-4cea-9e6a-c4c24795011d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:22.353270 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-233c3e56-308a-466c-8532-98bb79a6db44 req-bdb30146-3199-4cea-9e6a-c4c24795011d service nova] Creating event network-vif-plugged:b84a5eb8-d40f-4ed0-a8cb-3758d0ca85f2 for instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e on n-h1-833090-9 Jul 26 14:33:22.375522 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-233c3e56-308a-466c-8532-98bb79a6db44 req-bdb30146-3199-4cea-9e6a-c4c24795011d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103756 Jul 26 14:33:22.376314 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2454/4780] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:33:22.524590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-49b9327b-6bf6-4390-9854-7447f25bbfe2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:22.525472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-49b9327b-6bf6-4390-9854-7447f25bbfe2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:22.541063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49b9327b-6bf6-4390-9854-7447f25bbfe2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:22.550020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49b9327b-6bf6-4390-9854-7447f25bbfe2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:22.551815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49b9327b-6bf6-4390-9854-7447f25bbfe2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:22.556395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49b9327b-6bf6-4390-9854-7447f25bbfe2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:23.316633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1934d3f9-1752-45ef-98be-22898ab1aa46 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:23.323053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=87 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:23.389663 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1934d3f9-1752-45ef-98be-22898ab1aa46 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1328 microversion: 2.1 time: 2.194483 Jul 26 14:33:23.395847 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2327/4781] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:21 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1328 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:23.633330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-02de244a-9946-4840-8771-aba129e04818 req-ed9b0367-cef0-4608-8d3c-1534575fbc2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f868d8-a273-4f83-a180-bab450c10fe8", "tag": "34e51ec1-7549-4a33-a960-0beb30309972"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:23.655523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:23.684713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-02de244a-9946-4840-8771-aba129e04818 req-ed9b0367-cef0-4608-8d3c-1534575fbc2c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:23.684964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-02de244a-9946-4840-8771-aba129e04818 req-ed9b0367-cef0-4608-8d3c-1534575fbc2c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:23.736462 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-02de244a-9946-4840-8771-aba129e04818 req-ed9b0367-cef0-4608-8d3c-1534575fbc2c service nova] Creating event network-changed:34e51ec1-7549-4a33-a960-0beb30309972 for instance c4f868d8-a273-4f83-a180-bab450c10fe8 on n-h2-833090-9 Jul 26 14:33:23.744831 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-02de244a-9946-4840-8771-aba129e04818 req-ed9b0367-cef0-4608-8d3c-1534575fbc2c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120934 Jul 26 14:33:23.747929 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2328/4782] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:33:23.821946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-49b9327b-6bf6-4390-9854-7447f25bbfe2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:23.850673 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-49b9327b-6bf6-4390-9854-7447f25bbfe2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1324 microversion: 2.1 time: 1.332802 Jul 26 14:33:23.856408 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2455/4783] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:22 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1324 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:24.419215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7e8258d7-03fb-40e0-89af-cea21aba7d8e tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:24.419941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7e8258d7-03fb-40e0-89af-cea21aba7d8e tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:24.443631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e8258d7-03fb-40e0-89af-cea21aba7d8e tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:24.444420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e8258d7-03fb-40e0-89af-cea21aba7d8e tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:24.445542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e8258d7-03fb-40e0-89af-cea21aba7d8e tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:24.446234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e8258d7-03fb-40e0-89af-cea21aba7d8e tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:24.877889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dd97556c-ba0b-4392-83ca-343077670de7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:24.878725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dd97556c-ba0b-4392-83ca-343077670de7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:24.897098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd97556c-ba0b-4392-83ca-343077670de7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:24.897995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd97556c-ba0b-4392-83ca-343077670de7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:24.898935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd97556c-ba0b-4392-83ca-343077670de7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:24.899496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd97556c-ba0b-4392-83ca-343077670de7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:25.187800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7e8258d7-03fb-40e0-89af-cea21aba7d8e tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:25.205983 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7e8258d7-03fb-40e0-89af-cea21aba7d8e tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1328 microversion: 2.1 time: 0.785638 Jul 26 14:33:25.206847 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2329/4784] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:24 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1328 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:25.308296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dd97556c-ba0b-4392-83ca-343077670de7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:25.319587 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dd97556c-ba0b-4392-83ca-343077670de7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1521 microversion: 2.1 time: 0.446648 Jul 26 14:33:25.332645 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2456/4785] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:24 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:25.359742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8bc8248e-a2b6-4812-8309-826813791121 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:25.360902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8bc8248e-a2b6-4812-8309-826813791121 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:25.376733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bc8248e-a2b6-4812-8309-826813791121 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:25.378536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bc8248e-a2b6-4812-8309-826813791121 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:25.380272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bc8248e-a2b6-4812-8309-826813791121 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:25.381332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bc8248e-a2b6-4812-8309-826813791121 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:25.856334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8bc8248e-a2b6-4812-8309-826813791121 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:25.869457 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8bc8248e-a2b6-4812-8309-826813791121 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1521 microversion: 2.1 time: 0.518527 Jul 26 14:33:25.870287 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2330/4786] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:25 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:25.899644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7839397e-c32d-489d-b1eb-f529478b0e81 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-601985377", "metadata": {"": ""}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7839397e-c32d-489d-b1eb-f529478b0e81 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action HTTP/1.1 Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 106 Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-601985377", "metadata": {"": ""}}} Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'fde8a26b-25d1-4cfa-93a1-9d697e5d395e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-601985377', 'metadata': {'': ''}}}} Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'': ''} Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:33:25.917056 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:25.923279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7839397e-c32d-489d-b1eb-f529478b0e81 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:33:25.924625 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7839397e-c32d-489d-b1eb-f529478b0e81 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action" status: 400 len: 170 microversion: 2.1 time: 0.034489 Jul 26 14:33:25.932021 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2457/4787] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jul 26 14:33:25 2022] POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action => generated 170 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:33:25.939912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-77fe4fc7-6d78-42e5-b64c-6f94f7088500 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:25.941928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-77fe4fc7-6d78-42e5-b64c-6f94f7088500 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:25.949675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77fe4fc7-6d78-42e5-b64c-6f94f7088500 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:25.950887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77fe4fc7-6d78-42e5-b64c-6f94f7088500 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:25.952338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77fe4fc7-6d78-42e5-b64c-6f94f7088500 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:25.952969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77fe4fc7-6d78-42e5-b64c-6f94f7088500 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:26.237726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-814bba17-3440-4ec8-85b2-42aafbc31818 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:26.238638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-814bba17-3440-4ec8-85b2-42aafbc31818 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:26.264515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-814bba17-3440-4ec8-85b2-42aafbc31818 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:26.267588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-814bba17-3440-4ec8-85b2-42aafbc31818 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:26.268738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-814bba17-3440-4ec8-85b2-42aafbc31818 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:26.270786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-814bba17-3440-4ec8-85b2-42aafbc31818 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:26.922674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-77fe4fc7-6d78-42e5-b64c-6f94f7088500 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:26.931835 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-77fe4fc7-6d78-42e5-b64c-6f94f7088500 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1521 microversion: 2.1 time: 0.996909 Jul 26 14:33:26.932565 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2331/4788] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:25 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1521 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:26.956020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b7637a8a-7c1a-4625-9c58-cdab77202ebb tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:26.956746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b7637a8a-7c1a-4625-9c58-cdab77202ebb tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:26.976558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7637a8a-7c1a-4625-9c58-cdab77202ebb tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:26.977359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7637a8a-7c1a-4625-9c58-cdab77202ebb tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:26.979070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7637a8a-7c1a-4625-9c58-cdab77202ebb tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:26.980697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7637a8a-7c1a-4625-9c58-cdab77202ebb tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:28.014042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-814bba17-3440-4ec8-85b2-42aafbc31818 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:28.025130 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-814bba17-3440-4ec8-85b2-42aafbc31818 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1328 microversion: 2.1 time: 1.793020 Jul 26 14:33:28.027915 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2458/4789] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:26 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1328 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:28.388137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b7637a8a-7c1a-4625-9c58-cdab77202ebb tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:28.420540 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b7637a8a-7c1a-4625-9c58-cdab77202ebb tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1521 microversion: 2.1 time: 1.468500 Jul 26 14:33:28.463684 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2332/4790] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:26 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1521 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:28.497242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-decf3205-62ca-421d-ab3e-06ff60a200d8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1649299198", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-decf3205-62ca-421d-ab3e-06ff60a200d8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action HTTP/1.1 Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 619 Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1649299198", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'fde8a26b-25d1-4cfa-93a1-9d697e5d395e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1649299198', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:33:28.512802 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 26 14:33:28.517884 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:28.526794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-decf3205-62ca-421d-ab3e-06ff60a200d8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:33:28.531639 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-decf3205-62ca-421d-ab3e-06ff60a200d8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action" status: 400 len: 938 microversion: 2.1 time: 0.051504 Jul 26 14:33:28.537268 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2459/4791] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jul 26 14:33:28 2022] POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action => generated 938 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:33:28.558029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-049f4c2c-8a58-4124-b981-35daa7a801ab tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:28.561617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-049f4c2c-8a58-4124-b981-35daa7a801ab tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:28.614963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-049f4c2c-8a58-4124-b981-35daa7a801ab tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:28.616423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-049f4c2c-8a58-4124-b981-35daa7a801ab tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:28.620411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-049f4c2c-8a58-4124-b981-35daa7a801ab tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:28.620953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-049f4c2c-8a58-4124-b981-35daa7a801ab tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:29.060275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85a91d3e-4c93-4c8c-b682-3efa45b6960f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:29.063157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85a91d3e-4c93-4c8c-b682-3efa45b6960f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:29.101182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85a91d3e-4c93-4c8c-b682-3efa45b6960f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:29.101769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85a91d3e-4c93-4c8c-b682-3efa45b6960f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:29.102823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85a91d3e-4c93-4c8c-b682-3efa45b6960f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:29.113604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85a91d3e-4c93-4c8c-b682-3efa45b6960f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:29.337675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-049f4c2c-8a58-4124-b981-35daa7a801ab tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:29.364232 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-049f4c2c-8a58-4124-b981-35daa7a801ab tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1521 microversion: 2.1 time: 0.820241 Jul 26 14:33:29.366676 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2333/4792] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:28 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1521 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:29.402753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-844b708c-54fe-4824-9936-38d1535c091e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:29.404282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-844b708c-54fe-4824-9936-38d1535c091e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:29.427396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-844b708c-54fe-4824-9936-38d1535c091e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:29.429702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-844b708c-54fe-4824-9936-38d1535c091e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:29.431316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-844b708c-54fe-4824-9936-38d1535c091e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:29.432788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-844b708c-54fe-4824-9936-38d1535c091e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:29.514212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-85a91d3e-4c93-4c8c-b682-3efa45b6960f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:29.526757 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85a91d3e-4c93-4c8c-b682-3efa45b6960f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1328 microversion: 2.1 time: 0.471806 Jul 26 14:33:29.527932 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2460/4793] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:29 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1328 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:30.018488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-844b708c-54fe-4824-9936-38d1535c091e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:30.026757 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-844b708c-54fe-4824-9936-38d1535c091e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1521 microversion: 2.1 time: 0.642284 Jul 26 14:33:30.027355 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2334/4794] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:29 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:30.053427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1fa17e4a-4a74-4027-8578-8bfd7be8ea1e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1fa17e4a-4a74-4027-8578-8bfd7be8ea1e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action HTTP/1.1 Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 285 Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'fde8a26b-25d1-4cfa-93a1-9d697e5d395e', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise error Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:30.061134 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:30.066702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1fa17e4a-4a74-4027-8578-8bfd7be8ea1e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:33:30.069205 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1fa17e4a-4a74-4027-8578-8bfd7be8ea1e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action" status: 400 len: 619 microversion: 2.1 time: 0.023085 Jul 26 14:33:30.071391 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2461/4795] 10.222.0.70 () {60 vars in 1279 bytes} [Tue Jul 26 14:33:30 2022] POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:33:30.079065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0ffc4981-ebb4-46f9-9dc1-7bc816c6e5e5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:30.081034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0ffc4981-ebb4-46f9-9dc1-7bc816c6e5e5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:30.108242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ffc4981-ebb4-46f9-9dc1-7bc816c6e5e5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:30.111885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ffc4981-ebb4-46f9-9dc1-7bc816c6e5e5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:30.113628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ffc4981-ebb4-46f9-9dc1-7bc816c6e5e5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:30.115494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ffc4981-ebb4-46f9-9dc1-7bc816c6e5e5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:30.306520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-3ae1b7bf-0939-4e4a-bccc-3b489341aabe req-60b3e72c-6123-4a2e-9fe3-cc565a9fb4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f868d8-a273-4f83-a180-bab450c10fe8", "name": "network-vif-plugged", "status": "completed", "tag": "34e51ec1-7549-4a33-a960-0beb30309972"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:30.335466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3ae1b7bf-0939-4e4a-bccc-3b489341aabe req-60b3e72c-6123-4a2e-9fe3-cc565a9fb4bd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:30.349759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3ae1b7bf-0939-4e4a-bccc-3b489341aabe req-60b3e72c-6123-4a2e-9fe3-cc565a9fb4bd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:30.402543 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-3ae1b7bf-0939-4e4a-bccc-3b489341aabe req-60b3e72c-6123-4a2e-9fe3-cc565a9fb4bd service nova] Creating event network-vif-plugged:34e51ec1-7549-4a33-a960-0beb30309972 for instance c4f868d8-a273-4f83-a180-bab450c10fe8 on n-h2-833090-9 Jul 26 14:33:30.431988 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-3ae1b7bf-0939-4e4a-bccc-3b489341aabe req-60b3e72c-6123-4a2e-9fe3-cc565a9fb4bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126706 Jul 26 14:33:30.433600 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2462/4796] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:33:30.552111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9b47f803-709c-462c-99aa-5081053612a9 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:30.553173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9b47f803-709c-462c-99aa-5081053612a9 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:30.576944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b47f803-709c-462c-99aa-5081053612a9 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:30.579103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b47f803-709c-462c-99aa-5081053612a9 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:30.584485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b47f803-709c-462c-99aa-5081053612a9 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:30.592554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b47f803-709c-462c-99aa-5081053612a9 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:30.977803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0ffc4981-ebb4-46f9-9dc1-7bc816c6e5e5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:30.993089 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0ffc4981-ebb4-46f9-9dc1-7bc816c6e5e5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1521 microversion: 2.1 time: 0.917862 Jul 26 14:33:30.993875 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2335/4797] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:30 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1521 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:31.020201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-70c58879-9cce-4e7d-88c4-f85285594b78 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:31.021399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-70c58879-9cce-4e7d-88c4-f85285594b78 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:31.041911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70c58879-9cce-4e7d-88c4-f85285594b78 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:31.043589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70c58879-9cce-4e7d-88c4-f85285594b78 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:31.045223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70c58879-9cce-4e7d-88c4-f85285594b78 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:31.046776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70c58879-9cce-4e7d-88c4-f85285594b78 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:32.158318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9b47f803-709c-462c-99aa-5081053612a9 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:32.171790 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9b47f803-709c-462c-99aa-5081053612a9 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1328 microversion: 2.1 time: 1.625519 Jul 26 14:33:32.173273 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2463/4798] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:30 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1328 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:32.320992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-70c58879-9cce-4e7d-88c4-f85285594b78 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:32.336368 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-70c58879-9cce-4e7d-88c4-f85285594b78 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1521 microversion: 2.1 time: 1.322376 Jul 26 14:33:32.337421 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2336/4799] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:31 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1521 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:32.359834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6542157-c729-449c-b365-331293dcb444 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-843730540"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:32.363500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e6542157-c729-449c-b365-331293dcb444 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:32.391446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6542157-c729-449c-b365-331293dcb444 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:32.394643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6542157-c729-449c-b365-331293dcb444 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:32.395842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6542157-c729-449c-b365-331293dcb444 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:32.396554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6542157-c729-449c-b365-331293dcb444 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:32.868196 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e6542157-c729-449c-b365-331293dcb444 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action" status: 202 len: 0 microversion: 2.1 time: 0.513824 Jul 26 14:33:32.874737 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2464/4800] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:33:32 2022] POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 14:33:32.883042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d30a0d19-ad79-4903-9e9f-66891ff1220d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-19141639"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:32.886016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d30a0d19-ad79-4903-9e9f-66891ff1220d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:32.918139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d30a0d19-ad79-4903-9e9f-66891ff1220d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:32.918614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d30a0d19-ad79-4903-9e9f-66891ff1220d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:32.920112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d30a0d19-ad79-4903-9e9f-66891ff1220d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:32.920526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d30a0d19-ad79-4903-9e9f-66891ff1220d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:33.021461 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d30a0d19-ad79-4903-9e9f-66891ff1220d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Cannot 'createImage' instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e while it is in task_state image_snapshot_pending Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d30a0d19-ad79-4903-9e9f-66891ff1220d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action HTTP/1.1 Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 83 Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-19141639"}} Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: exception: Cannot 'createImage' instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e while it is in task_state image_snapshot_pending Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'fde8a26b-25d1-4cfa-93a1-9d697e5d395e', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-19141639'}}} Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:33:33.024588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e while it is in task_state image_snapshot_pending Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e while it is in task_state image_snapshot_pending Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d30a0d19-ad79-4903-9e9f-66891ff1220d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 409 to user: Cannot 'createImage' instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e while it is in task_state image_snapshot_pending {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d30a0d19-ad79-4903-9e9f-66891ff1220d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action" status: 409 len: 167 microversion: 2.1 time: 0.147363 Jul 26 14:33:33.029086 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2337/4801] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:33:32 2022] POST /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e/action => generated 167 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 14:33:33.038480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d180a2cb-5b43-4f71-9012-8c4666a3996c tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '.version_select at 0x7f8786b0f9d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:33.210686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d51ddb12-61f8-4387-8f5a-4eb883681582 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:33.211622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d51ddb12-61f8-4387-8f5a-4eb883681582 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:33.231375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d51ddb12-61f8-4387-8f5a-4eb883681582 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:33.232486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d51ddb12-61f8-4387-8f5a-4eb883681582 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:33.246723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d51ddb12-61f8-4387-8f5a-4eb883681582 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:33.257843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d51ddb12-61f8-4387-8f5a-4eb883681582 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:33.494782 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d180a2cb-5b43-4f71-9012-8c4666a3996c tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "DELETE /compute/v2.1/images/c0503b66-9c42-4a91-b1be-e9ddf1c336da" status: 204 len: 0 microversion: 2.1 time: 0.461145 Jul 26 14:33:33.496270 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2465/4802] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:33 2022] DELETE /compute/v2.1/images/c0503b66-9c42-4a91-b1be-e9ddf1c336da => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:33:33.508163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c917a5a1-fd5b-40c3-bde7-c8952734d286 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:33.509270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c917a5a1-fd5b-40c3-bde7-c8952734d286 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:33.551651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c917a5a1-fd5b-40c3-bde7-c8952734d286 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:33.552934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c917a5a1-fd5b-40c3-bde7-c8952734d286 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:33.564685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c917a5a1-fd5b-40c3-bde7-c8952734d286 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:33.584371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c917a5a1-fd5b-40c3-bde7-c8952734d286 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:34.231507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d51ddb12-61f8-4387-8f5a-4eb883681582 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:34.246555 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d51ddb12-61f8-4387-8f5a-4eb883681582 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1328 microversion: 2.1 time: 1.041404 Jul 26 14:33:34.250742 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2338/4803] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:33 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1328 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:34.424008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c917a5a1-fd5b-40c3-bde7-c8952734d286 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:34.433198 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c917a5a1-fd5b-40c3-bde7-c8952734d286 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1533 microversion: 2.1 time: 0.931339 Jul 26 14:33:34.438754 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2466/4804] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:33 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1533 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:35.272122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5f16527e-37c3-43a0-bc23-7b7723b7b71a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:35.273121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5f16527e-37c3-43a0-bc23-7b7723b7b71a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:35.297139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f16527e-37c3-43a0-bc23-7b7723b7b71a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:35.297647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f16527e-37c3-43a0-bc23-7b7723b7b71a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:35.298467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f16527e-37c3-43a0-bc23-7b7723b7b71a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:35.298920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f16527e-37c3-43a0-bc23-7b7723b7b71a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:35.459876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9c47ce17-da00-4d29-8551-11e17377d16d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:35.460788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9c47ce17-da00-4d29-8551-11e17377d16d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:35.480118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c47ce17-da00-4d29-8551-11e17377d16d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:35.480766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c47ce17-da00-4d29-8551-11e17377d16d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:35.482016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c47ce17-da00-4d29-8551-11e17377d16d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:35.483225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c47ce17-da00-4d29-8551-11e17377d16d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:36.161886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5f16527e-37c3-43a0-bc23-7b7723b7b71a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:36.170967 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5f16527e-37c3-43a0-bc23-7b7723b7b71a tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1529 microversion: 2.1 time: 0.903713 Jul 26 14:33:36.173100 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2339/4805] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:35 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1529 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:36.194685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d4a3f66a-8868-4cbf-8784-79209cb13875 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:36.195363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d4a3f66a-8868-4cbf-8784-79209cb13875 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:36.205445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4a3f66a-8868-4cbf-8784-79209cb13875 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:36.205838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9c47ce17-da00-4d29-8551-11e17377d16d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:36.206417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4a3f66a-8868-4cbf-8784-79209cb13875 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:36.207451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4a3f66a-8868-4cbf-8784-79209cb13875 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:36.209515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4a3f66a-8868-4cbf-8784-79209cb13875 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:36.221522 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9c47ce17-da00-4d29-8551-11e17377d16d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1539 microversion: 2.1 time: 0.764878 Jul 26 14:33:36.237716 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2467/4806] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:35 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1539 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:36.768053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d4a3f66a-8868-4cbf-8784-79209cb13875 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:36.778956 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d4a3f66a-8868-4cbf-8784-79209cb13875 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1529 microversion: 2.1 time: 0.588408 Jul 26 14:33:36.795903 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2340/4807] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:36 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1529 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:37.157597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8478c928-37d3-4009-93de-ccf9a096ac3b tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:37.158157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8478c928-37d3-4009-93de-ccf9a096ac3b tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:37.210418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8478c928-37d3-4009-93de-ccf9a096ac3b tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:37.210418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8478c928-37d3-4009-93de-ccf9a096ac3b tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:37.211221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8478c928-37d3-4009-93de-ccf9a096ac3b tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:37.212475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8478c928-37d3-4009-93de-ccf9a096ac3b tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:37.247070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-31c16443-5795-4910-9251-25dbec68792f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:37.248115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-31c16443-5795-4910-9251-25dbec68792f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:37.272217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31c16443-5795-4910-9251-25dbec68792f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:37.273055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31c16443-5795-4910-9251-25dbec68792f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:37.273904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31c16443-5795-4910-9251-25dbec68792f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:37.274205 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-8478c928-37d3-4009-93de-ccf9a096ac3b tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] HTTP exception thrown: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:37.278619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31c16443-5795-4910-9251-25dbec68792f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8478c928-37d3-4009-93de-ccf9a096ac3b tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Request method failure captured: Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 HTTP/1.1 Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_sgC9kRPMwNrIE7JkeW-OorPmUCGzo1fKY53drH5wVgF4IVxYxArDKt1lDe08EVxneEKJu1k36ZsF7bm0ogp_Mu5Lsk6LeMMDR83RwDlACBx8oSTdQngJqJ_sc9Mjxr6wail91chngzeMCtx6-KvUIaxCI8ToSYdjUCsqRwFvXjWvA Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 15576373328a475e9cb6652a9b976fd9 Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2002963442 Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15576373328a475e9cb6652a9b976fd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/15576373328a475e9cb6652a9b976fd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_15576373328a475e9cb6652a9b976fd9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15576373328a475e9cb6652a9b976fd9"}]}] Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2002963442 Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 15576373328a475e9cb6652a9b976fd9 Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2002963442 Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2002963442-project Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 46489a2bd21e4bd8ad02555d686e657b Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2002963442-project Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c4f868d8-a273-4f83-a180-bab450c10fe8'} Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:33:37.281215 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8478c928-37d3-4009-93de-ccf9a096ac3b tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Returning 404 to user: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8478c928-37d3-4009-93de-ccf9a096ac3b tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 404 len: 111 microversion: 2.1 time: 0.484102 Jul 26 14:33:37.287211 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2468/4808] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:33:36 2022] DELETE /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 111 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:33:37.303842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba0df13f-024b-4eda-9207-ae2ca2ea85fa tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:37.304503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba0df13f-024b-4eda-9207-ae2ca2ea85fa tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:37.357733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba0df13f-024b-4eda-9207-ae2ca2ea85fa tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:37.359056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba0df13f-024b-4eda-9207-ae2ca2ea85fa tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:37.359921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba0df13f-024b-4eda-9207-ae2ca2ea85fa tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:37.367411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba0df13f-024b-4eda-9207-ae2ca2ea85fa tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:38.464539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31c16443-5795-4910-9251-25dbec68792f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:38.476926 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-31c16443-5795-4910-9251-25dbec68792f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1521 microversion: 2.1 time: 1.233721 Jul 26 14:33:38.479741 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2341/4809] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:37 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1521 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:38.482967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba0df13f-024b-4eda-9207-ae2ca2ea85fa tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:38.513987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b91efe1e-e657-46d0-a73e-9fbc6a2d41e9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:38.518165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b91efe1e-e657-46d0-a73e-9fbc6a2d41e9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:38.518701 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba0df13f-024b-4eda-9207-ae2ca2ea85fa tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1529 microversion: 2.1 time: 1.217154 Jul 26 14:33:38.524938 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2469/4810] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:37 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1529 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:38.536188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b91efe1e-e657-46d0-a73e-9fbc6a2d41e9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:38.536929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b91efe1e-e657-46d0-a73e-9fbc6a2d41e9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:38.538253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b91efe1e-e657-46d0-a73e-9fbc6a2d41e9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:38.544995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aeaad73b-a779-412d-96a3-6c16d8c31978 tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Action: 'update', calling method: >, body: {"server": {"name": "c4f868d8-a273-4f83-a180-bab450c10fe8_new"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:38.552425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aeaad73b-a779-412d-96a3-6c16d8c31978 tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:38.552657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b91efe1e-e657-46d0-a73e-9fbc6a2d41e9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:38.575016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aeaad73b-a779-412d-96a3-6c16d8c31978 tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:38.582644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aeaad73b-a779-412d-96a3-6c16d8c31978 tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:38.587799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aeaad73b-a779-412d-96a3-6c16d8c31978 tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:38.594781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aeaad73b-a779-412d-96a3-6c16d8c31978 tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:38.636240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b91efe1e-e657-46d0-a73e-9fbc6a2d41e9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:33:38.666476 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-aeaad73b-a779-412d-96a3-6c16d8c31978 tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] HTTP exception thrown: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aeaad73b-a779-412d-96a3-6c16d8c31978 tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Request method failure captured: Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: request: PUT /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 HTTP/1.1 Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 64 Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_sgC9kRPMwNrIE7JkeW-OorPmUCGzo1fKY53drH5wVgF4IVxYxArDKt1lDe08EVxneEKJu1k36ZsF7bm0ogp_Mu5Lsk6LeMMDR83RwDlACBx8oSTdQngJqJ_sc9Mjxr6wail91chngzeMCtx6-KvUIaxCI8ToSYdjUCsqRwFvXjWvA Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 15576373328a475e9cb6652a9b976fd9 Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2002963442 Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15576373328a475e9cb6652a9b976fd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/15576373328a475e9cb6652a9b976fd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_15576373328a475e9cb6652a9b976fd9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/15576373328a475e9cb6652a9b976fd9"}]}] Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2002963442 Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 15576373328a475e9cb6652a9b976fd9 Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2002963442 Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2002963442-project Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 46489a2bd21e4bd8ad02555d686e657b Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2002963442-project Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: {"server": {"name": "c4f868d8-a273-4f83-a180-bab450c10fe8_new"}} Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c4f868d8-a273-4f83-a180-bab450c10fe8', 'body': {'server': {'name': 'c4f868d8-a273-4f83-a180-bab450c10fe8_new'}}} Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 26 14:33:38.678732 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:33:38.684906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aeaad73b-a779-412d-96a3-6c16d8c31978 tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] Returning 404 to user: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:33:38.686441 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aeaad73b-a779-412d-96a3-6c16d8c31978 tempest-ServersNegativeTestMultiTenantJSON-2002963442 tempest-ServersNegativeTestMultiTenantJSON-2002963442-project] 10.222.0.70 "PUT /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 404 len: 111 microversion: 2.1 time: 0.145739 Jul 26 14:33:38.693778 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2470/4811] 10.222.0.70 () {60 vars in 1256 bytes} [Tue Jul 26 14:33:38 2022] PUT /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:33:38.704272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dd232da4-dfc0-4586-a3bf-ccf7f64d6ddb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:38.706306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dd232da4-dfc0-4586-a3bf-ccf7f64d6ddb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:38.728282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd232da4-dfc0-4586-a3bf-ccf7f64d6ddb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:38.728282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd232da4-dfc0-4586-a3bf-ccf7f64d6ddb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:38.728930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd232da4-dfc0-4586-a3bf-ccf7f64d6ddb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:38.729596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd232da4-dfc0-4586-a3bf-ccf7f64d6ddb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:38.807873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dd232da4-dfc0-4586-a3bf-ccf7f64d6ddb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:33:38.894864 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b91efe1e-e657-46d0-a73e-9fbc6a2d41e9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 204 len: 0 microversion: 2.1 time: 0.386010 Jul 26 14:33:38.898392 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2342/4812] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:33:38 2022] DELETE /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:33:38.916961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-683adbf3-154b-4e1c-b5d3-db586166b6e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:38.924947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-683adbf3-154b-4e1c-b5d3-db586166b6e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:38.956565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-683adbf3-154b-4e1c-b5d3-db586166b6e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:38.957080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-683adbf3-154b-4e1c-b5d3-db586166b6e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:38.960506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-683adbf3-154b-4e1c-b5d3-db586166b6e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:38.964372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-683adbf3-154b-4e1c-b5d3-db586166b6e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:39.041221 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dd232da4-dfc0-4586-a3bf-ccf7f64d6ddb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 204 len: 0 microversion: 2.1 time: 0.342326 Jul 26 14:33:39.047981 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2471/4813] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:33:38 2022] DELETE /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:33:39.057265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:39.068572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0b16ad41-d122-4651-8da2-f1bf08d358c3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:39.072322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0b16ad41-d122-4651-8da2-f1bf08d358c3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:39.097406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b16ad41-d122-4651-8da2-f1bf08d358c3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:39.098305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b16ad41-d122-4651-8da2-f1bf08d358c3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:39.099503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b16ad41-d122-4651-8da2-f1bf08d358c3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:39.099707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b16ad41-d122-4651-8da2-f1bf08d358c3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:39.829045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-683adbf3-154b-4e1c-b5d3-db586166b6e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:39.834105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0b16ad41-d122-4651-8da2-f1bf08d358c3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:39.864935 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-683adbf3-154b-4e1c-b5d3-db586166b6e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1527 microversion: 2.1 time: 0.962708 Jul 26 14:33:39.868782 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0b16ad41-d122-4651-8da2-f1bf08d358c3 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1535 microversion: 2.1 time: 0.818583 Jul 26 14:33:39.887120 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2343/4814] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:38 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1527 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:39.900798 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2472/4815] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:39 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1535 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:39.909798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-fdb42245-7798-410a-a2e0-ac379659983a req-2fe00991-7fbe-44a4-a47f-3d2a619b9b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde8a26b-25d1-4cfa-93a1-9d697e5d395e", "name": "network-vif-plugged", "status": "completed", "tag": "b84a5eb8-d40f-4ed0-a8cb-3758d0ca85f2"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:39.940555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fdb42245-7798-410a-a2e0-ac379659983a req-2fe00991-7fbe-44a4-a47f-3d2a619b9b97 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:39.946259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fdb42245-7798-410a-a2e0-ac379659983a req-2fe00991-7fbe-44a4-a47f-3d2a619b9b97 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:39.966631 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-fdb42245-7798-410a-a2e0-ac379659983a req-2fe00991-7fbe-44a4-a47f-3d2a619b9b97 service nova] Creating event network-vif-plugged:b84a5eb8-d40f-4ed0-a8cb-3758d0ca85f2 for instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e on n-h1-833090-9 Jul 26 14:33:39.982119 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-fdb42245-7798-410a-a2e0-ac379659983a req-2fe00991-7fbe-44a4-a47f-3d2a619b9b97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082186 Jul 26 14:33:39.990617 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2344/4816] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:33:40.915626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b163dc8-542f-45dd-ae9f-2aa6e88d6393 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:40.918273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7b163dc8-542f-45dd-ae9f-2aa6e88d6393 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:40.923825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-72248228-bb41-4500-8861-d06e7a02d42f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:40.924657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-72248228-bb41-4500-8861-d06e7a02d42f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:40.934151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b163dc8-542f-45dd-ae9f-2aa6e88d6393 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:40.936036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b163dc8-542f-45dd-ae9f-2aa6e88d6393 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:40.940099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b163dc8-542f-45dd-ae9f-2aa6e88d6393 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:40.941158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b163dc8-542f-45dd-ae9f-2aa6e88d6393 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:40.945129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-72248228-bb41-4500-8861-d06e7a02d42f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:40.945605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-72248228-bb41-4500-8861-d06e7a02d42f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:40.946412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-72248228-bb41-4500-8861-d06e7a02d42f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:40.952871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-72248228-bb41-4500-8861-d06e7a02d42f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:41.052764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:42.087041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-72248228-bb41-4500-8861-d06e7a02d42f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:42.108425 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-72248228-bb41-4500-8861-d06e7a02d42f tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1535 microversion: 2.1 time: 1.189967 Jul 26 14:33:42.126107 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2345/4817] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:40 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1535 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:42.142104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2d21f1b1-ed5d-41d6-8277-f0d6952504ba req-0f644378-d603-4178-933d-91e71806381d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde8a26b-25d1-4cfa-93a1-9d697e5d395e", "name": "network-vif-unplugged", "status": "completed", "tag": "b84a5eb8-d40f-4ed0-a8cb-3758d0ca85f2"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:42.153352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2d21f1b1-ed5d-41d6-8277-f0d6952504ba req-0f644378-d603-4178-933d-91e71806381d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:42.154194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2d21f1b1-ed5d-41d6-8277-f0d6952504ba req-0f644378-d603-4178-933d-91e71806381d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:42.184833 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2d21f1b1-ed5d-41d6-8277-f0d6952504ba req-0f644378-d603-4178-933d-91e71806381d service nova] Creating event network-vif-unplugged:b84a5eb8-d40f-4ed0-a8cb-3758d0ca85f2 for instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e on n-h1-833090-9 Jul 26 14:33:42.190752 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2d21f1b1-ed5d-41d6-8277-f0d6952504ba req-0f644378-d603-4178-933d-91e71806381d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062941 Jul 26 14:33:42.191707 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2346/4818] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:33:42.793045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b163dc8-542f-45dd-ae9f-2aa6e88d6393 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:42.821366 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b163dc8-542f-45dd-ae9f-2aa6e88d6393 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 200 len: 1527 microversion: 2.1 time: 1.917490 Jul 26 14:33:42.824340 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2473/4819] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:40 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 1527 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:42.997056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ed321a49-d895-42b6-95d5-c0f6cd331b88 req-1a19393f-b9d4-4faa-aa6b-501fccc43b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde8a26b-25d1-4cfa-93a1-9d697e5d395e", "name": "network-vif-deleted", "tag": "b84a5eb8-d40f-4ed0-a8cb-3758d0ca85f2"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:43.048590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ed321a49-d895-42b6-95d5-c0f6cd331b88 req-1a19393f-b9d4-4faa-aa6b-501fccc43b36 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:43.054993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ed321a49-d895-42b6-95d5-c0f6cd331b88 req-1a19393f-b9d4-4faa-aa6b-501fccc43b36 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:43.151769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-277e3581-c6c7-4148-ba5f-2333b8adee38 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:43.152472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-277e3581-c6c7-4148-ba5f-2333b8adee38 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:43.154143 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ed321a49-d895-42b6-95d5-c0f6cd331b88 req-1a19393f-b9d4-4faa-aa6b-501fccc43b36 service nova] Creating event network-vif-deleted:b84a5eb8-d40f-4ed0-a8cb-3758d0ca85f2 for instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e on n-h1-833090-9 Jul 26 14:33:43.179853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-277e3581-c6c7-4148-ba5f-2333b8adee38 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:43.182832 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ed321a49-d895-42b6-95d5-c0f6cd331b88 req-1a19393f-b9d4-4faa-aa6b-501fccc43b36 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200953 Jul 26 14:33:43.184125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-277e3581-c6c7-4148-ba5f-2333b8adee38 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:43.190887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-277e3581-c6c7-4148-ba5f-2333b8adee38 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:43.191654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-277e3581-c6c7-4148-ba5f-2333b8adee38 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:43.195046 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2347/4820] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:33:43.855678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f03595a3-860e-4272-85d6-c0c8a496d3d4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:43.863327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f03595a3-860e-4272-85d6-c0c8a496d3d4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:43.886499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f03595a3-860e-4272-85d6-c0c8a496d3d4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:43.887369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f03595a3-860e-4272-85d6-c0c8a496d3d4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:43.888665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f03595a3-860e-4272-85d6-c0c8a496d3d4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:43.889964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f03595a3-860e-4272-85d6-c0c8a496d3d4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:43.923069 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-f03595a3-860e-4272-85d6-c0c8a496d3d4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f03595a3-860e-4272-85d6-c0c8a496d3d4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e HTTP/1.1 Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'fde8a26b-25d1-4cfa-93a1-9d697e5d395e'} Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:43.926863 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:43.933273 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:43.933273 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:43.933273 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:43.933273 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:43.933273 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:33:43.933273 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:33:43.933273 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:33:43.933273 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:43.934255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f03595a3-860e-4272-85d6-c0c8a496d3d4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 404 to user: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:33:43.936032 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f03595a3-860e-4272-85d6-c0c8a496d3d4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 404 len: 111 microversion: 2.1 time: 0.088424 Jul 26 14:33:43.941860 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2348/4821] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:43 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:33:43.954449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c5651cc-3417-4954-90b2-2cdc83a96115 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Action: 'create', calling method: .version_select at 0x7f8786d1adc0>, body: {"keypair": {"name": "tempest-keypair-1680067545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTf0lXsRpopi2z4lq4XhcDpqcopgMFFKOcXbUaL/i2Z3LIV2s4XNLew+qH8QpwSQaik6xcP5in0FQDpznEZ3xVoRjCqOoleXGXsysXPBdUG5aQWzCHD9qB9HWZNF44Qog=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:43.988459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5c5651cc-3417-4954-90b2-2cdc83a96115 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Getting quotas for project 8891372cf522401f83bd7e379abd4a32. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:33:43.995654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5c5651cc-3417-4954-90b2-2cdc83a96115 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Getting quotas for user 4cbd008c47a04847b8772b7f957bcd04 and project 8891372cf522401f83bd7e379abd4a32. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:33:44.044934 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5c5651cc-3417-4954-90b2-2cdc83a96115 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095162 Jul 26 14:33:44.046625 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2349/4822] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:33:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:33:44.286712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-277e3581-c6c7-4148-ba5f-2333b8adee38 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:44.297772 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-277e3581-c6c7-4148-ba5f-2333b8adee38 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1535 microversion: 2.1 time: 1.158890 Jul 26 14:33:44.321478 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2474/4823] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:43 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1535 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:45.335628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-917c31ae-96d7-472c-8b49-5feb22ed7e86 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:45.336930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-917c31ae-96d7-472c-8b49-5feb22ed7e86 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:45.347210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-917c31ae-96d7-472c-8b49-5feb22ed7e86 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:45.347679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-917c31ae-96d7-472c-8b49-5feb22ed7e86 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:45.348555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-917c31ae-96d7-472c-8b49-5feb22ed7e86 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:45.349008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-917c31ae-96d7-472c-8b49-5feb22ed7e86 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:45.953423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-917c31ae-96d7-472c-8b49-5feb22ed7e86 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '178c09ff427d4a51b8863e86055e1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ac838c74b14807b401f02d5092ecd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:45.995198 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-917c31ae-96d7-472c-8b49-5feb22ed7e86 tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 200 len: 1493 microversion: 2.1 time: 0.657041 Jul 26 14:33:45.999218 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2350/4824] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:45 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 1493 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:46.100798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-123aff0b-4433-423d-bf40-bbc92bcf3ec2 req-8c88acab-7aa7-4012-adbb-e15508ff5081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f868d8-a273-4f83-a180-bab450c10fe8", "name": "network-vif-deleted", "tag": "34e51ec1-7549-4a33-a960-0beb30309972"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:46.140051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-123aff0b-4433-423d-bf40-bbc92bcf3ec2 req-8c88acab-7aa7-4012-adbb-e15508ff5081 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:46.141545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-123aff0b-4433-423d-bf40-bbc92bcf3ec2 req-8c88acab-7aa7-4012-adbb-e15508ff5081 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:46.209240 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-123aff0b-4433-423d-bf40-bbc92bcf3ec2 req-8c88acab-7aa7-4012-adbb-e15508ff5081 service nova] Creating event network-vif-deleted:34e51ec1-7549-4a33-a960-0beb30309972 for instance c4f868d8-a273-4f83-a180-bab450c10fe8 on n-h2-833090-9 Jul 26 14:33:46.215163 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-123aff0b-4433-423d-bf40-bbc92bcf3ec2 req-8c88acab-7aa7-4012-adbb-e15508ff5081 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124935 Jul 26 14:33:46.228005 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2475/4825] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:33:47.020827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d750e18-181d-40a1-9b32-d0362f5c96eb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:47.021622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3d750e18-181d-40a1-9b32-d0362f5c96eb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] [instance: c4f868d8-a273-4f83-a180-bab450c10fe8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:47.037247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d750e18-181d-40a1-9b32-d0362f5c96eb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:47.037724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d750e18-181d-40a1-9b32-d0362f5c96eb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:47.038585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d750e18-181d-40a1-9b32-d0362f5c96eb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:47.039014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d750e18-181d-40a1-9b32-d0362f5c96eb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:47.073288 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-3d750e18-181d-40a1-9b32-d0362f5c96eb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] HTTP exception thrown: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d750e18-181d-40a1-9b32-d0362f5c96eb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Request method failure captured: Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 HTTP/1.1 Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_sGSb236adCw1o03RfIhl9g8zWSCpGgkPk75zCpdGmHb2LhK9mc9pel5QJeXPdQGWngHOKr1t4OyMWXFXpwwUA5CmrvZzZ6yyY-jBqaZoppY8AX0ZzWHjTx_6vcVttKCIkhyW0ZoTQo9y6J5xO0B2K5mlcLV5OxC5NGCHmEaUk1EKM Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a8ac838c74b14807b401f02d5092ecd1 Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-425541337 Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a8ac838c74b14807b401f02d5092ecd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a8ac838c74b14807b401f02d5092ecd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a8ac838c74b14807b401f02d5092ecd1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a8ac838c74b14807b401f02d5092ecd1"}]}] Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-425541337 Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a8ac838c74b14807b401f02d5092ecd1 Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-425541337 Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestMultiTenantJSON-425541337-project Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 178c09ff427d4a51b8863e86055e1e41 Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-425541337-project Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c4f868d8-a273-4f83-a180-bab450c10fe8'} Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:47.080092 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:33:47.085977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:47.085977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:33:47.085977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:33:47.085977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:33:47.085977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:33:47.085977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:33:47.085977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. Jul 26 14:33:47.085977 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:33:47.085977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d750e18-181d-40a1-9b32-d0362f5c96eb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] Returning 404 to user: Instance c4f868d8-a273-4f83-a180-bab450c10fe8 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:33:47.085977 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3d750e18-181d-40a1-9b32-d0362f5c96eb tempest-ServersNegativeTestMultiTenantJSON-425541337 tempest-ServersNegativeTestMultiTenantJSON-425541337-project] 10.222.0.70 "GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8" status: 404 len: 111 microversion: 2.1 time: 0.067740 Jul 26 14:33:47.089225 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2351/4826] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:47 2022] GET /compute/v2.1/servers/c4f868d8-a273-4f83-a180-bab450c10fe8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:33:51.979560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1482830614", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:51.991219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:52.068175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] validate_networks() for [('111e101e-35c6-4e14-9f1a-19bc9cc657df', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:33:53.141075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9436b76d-a8ac-4b5e-94fd-980e622b5ace tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1593d15-9842-46e8-85f3-a49b0a38d492", "device": "/dev/sdb"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:33:53.143653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9436b76d-a8ac-4b5e-94fd-980e622b5ace tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:53.166019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9436b76d-a8ac-4b5e-94fd-980e622b5ace tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:53.169501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9436b76d-a8ac-4b5e-94fd-980e622b5ace tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:53.174329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9436b76d-a8ac-4b5e-94fd-980e622b5ace tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:53.176514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9436b76d-a8ac-4b5e-94fd-980e622b5ace tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:53.243276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:33:53.244618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:33:53.245309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:33:53.245898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:33:53.246485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:33:53.266867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:53.271112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:53.273300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:53.273959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:53.323814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Getting quotas for project 8891372cf522401f83bd7e379abd4a32. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:33:53.362656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Getting quotas for user 4cbd008c47a04847b8772b7f957bcd04 and project 8891372cf522401f83bd7e379abd4a32. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:33:53.412642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:33:53.418406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:33:53.551500 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7cc70696-292a-486c-9593-f4d1b7a83f37 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.575639 Jul 26 14:33:53.552474 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2476/4827] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:33:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:33:53.568160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c5fb6de4-7c58-4a77-a324-fafd793e5521 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:53.575399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c5fb6de4-7c58-4a77-a324-fafd793e5521 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:53.754709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c5fb6de4-7c58-4a77-a324-fafd793e5521 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:53.762151 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c5fb6de4-7c58-4a77-a324-fafd793e5521 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1225 microversion: 2.1 time: 0.199563 Jul 26 14:33:53.762624 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2477/4828] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:53 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:33:53.881498 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9436b76d-a8ac-4b5e-94fd-980e622b5ace tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "POST /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.743152 Jul 26 14:33:53.893921 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2352/4829] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:33:53 2022] POST /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:33:54.788419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3a7e2f5-3213-46cf-a338-8edd6c268452 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:54.790801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b3a7e2f5-3213-46cf-a338-8edd6c268452 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:55.081987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3a7e2f5-3213-46cf-a338-8edd6c268452 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:55.089742 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3a7e2f5-3213-46cf-a338-8edd6c268452 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1225 microversion: 2.1 time: 0.306473 Jul 26 14:33:55.109064 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2478/4830] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:54 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1225 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:56.108045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:56.114732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-24d1ec05-283e-4299-8f83-3ace438f2c6e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:56.115470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-24d1ec05-283e-4299-8f83-3ace438f2c6e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:56.122144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:33:56.146679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24d1ec05-283e-4299-8f83-3ace438f2c6e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:56.147214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24d1ec05-283e-4299-8f83-3ace438f2c6e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:56.159460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24d1ec05-283e-4299-8f83-3ace438f2c6e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:56.160058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24d1ec05-283e-4299-8f83-3ace438f2c6e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:56.545001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-24d1ec05-283e-4299-8f83-3ace438f2c6e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:56.581426 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-24d1ec05-283e-4299-8f83-3ace438f2c6e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1295 microversion: 2.1 time: 0.473799 Jul 26 14:33:56.588895 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2353/4831] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:56 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1295 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:57.615977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ccb16a2d-6aec-475c-8cd7-1c83be195a58 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:57.617285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ccb16a2d-6aec-475c-8cd7-1c83be195a58 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:57.638792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccb16a2d-6aec-475c-8cd7-1c83be195a58 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:57.641053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccb16a2d-6aec-475c-8cd7-1c83be195a58 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:57.642381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccb16a2d-6aec-475c-8cd7-1c83be195a58 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:57.643115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccb16a2d-6aec-475c-8cd7-1c83be195a58 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:58.178274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ccb16a2d-6aec-475c-8cd7-1c83be195a58 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:58.195810 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ccb16a2d-6aec-475c-8cd7-1c83be195a58 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1283 microversion: 2.1 time: 0.584402 Jul 26 14:33:58.199880 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2479/4832] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:57 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1283 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:33:59.221832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-34e7ec7b-af8d-424a-be6d-453112b79502 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:33:59.222532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-34e7ec7b-af8d-424a-be6d-453112b79502 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:33:59.235778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34e7ec7b-af8d-424a-be6d-453112b79502 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:59.236458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34e7ec7b-af8d-424a-be6d-453112b79502 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:59.238751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34e7ec7b-af8d-424a-be6d-453112b79502 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:33:59.240846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34e7ec7b-af8d-424a-be6d-453112b79502 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:33:59.362014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-34e7ec7b-af8d-424a-be6d-453112b79502 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:33:59.373084 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-34e7ec7b-af8d-424a-be6d-453112b79502 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1283 microversion: 2.1 time: 0.156122 Jul 26 14:33:59.376704 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2354/4833] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:33:59 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1283 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:00.399113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-79222c72-a213-48f6-a8a6-190013fd0cfd tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:00.399999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79222c72-a213-48f6-a8a6-190013fd0cfd tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:00.410859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79222c72-a213-48f6-a8a6-190013fd0cfd tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:00.411538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79222c72-a213-48f6-a8a6-190013fd0cfd tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:00.412600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79222c72-a213-48f6-a8a6-190013fd0cfd tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:00.423541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79222c72-a213-48f6-a8a6-190013fd0cfd tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:00.551756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-79222c72-a213-48f6-a8a6-190013fd0cfd tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:00.559840 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-79222c72-a213-48f6-a8a6-190013fd0cfd tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1283 microversion: 2.1 time: 0.166530 Jul 26 14:34:00.572408 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2480/4834] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:00 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1283 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:01.583120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7636a357-4e1f-4e4e-bef7-5f8c6a07bec5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:01.584440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7636a357-4e1f-4e4e-bef7-5f8c6a07bec5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:01.595591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7636a357-4e1f-4e4e-bef7-5f8c6a07bec5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:01.596420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7636a357-4e1f-4e4e-bef7-5f8c6a07bec5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:01.597791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7636a357-4e1f-4e4e-bef7-5f8c6a07bec5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:01.598505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7636a357-4e1f-4e4e-bef7-5f8c6a07bec5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:02.581630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7636a357-4e1f-4e4e-bef7-5f8c6a07bec5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:02.596065 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7636a357-4e1f-4e4e-bef7-5f8c6a07bec5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1325 microversion: 2.1 time: 1.013170 Jul 26 14:34:02.597582 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2355/4835] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:01 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1325 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:03.626875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27281e56-0274-4572-8f49-54fd4ac5155f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:03.627489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27281e56-0274-4572-8f49-54fd4ac5155f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:03.634440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:03.646520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27281e56-0274-4572-8f49-54fd4ac5155f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:03.647293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27281e56-0274-4572-8f49-54fd4ac5155f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:03.652311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27281e56-0274-4572-8f49-54fd4ac5155f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:03.653058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27281e56-0274-4572-8f49-54fd4ac5155f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:04.393788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27281e56-0274-4572-8f49-54fd4ac5155f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:04.431543 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27281e56-0274-4572-8f49-54fd4ac5155f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1325 microversion: 2.1 time: 0.797385 Jul 26 14:34:04.437262 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2481/4836] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:03 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1325 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:04.708908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f252518f-48af-4154-9c80-24fcfe82b708 req-33a3c791-2206-407e-a2ef-9446bb508af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60cec85c-17f0-4c05-b18f-4ba8791cc737", "tag": "bbb083ad-083b-4271-a0d7-d5fafcc90fac"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:34:04.743597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f252518f-48af-4154-9c80-24fcfe82b708 req-33a3c791-2206-407e-a2ef-9446bb508af8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:04.744388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f252518f-48af-4154-9c80-24fcfe82b708 req-33a3c791-2206-407e-a2ef-9446bb508af8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:04.772291 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f252518f-48af-4154-9c80-24fcfe82b708 req-33a3c791-2206-407e-a2ef-9446bb508af8 service nova] Creating event network-changed:bbb083ad-083b-4271-a0d7-d5fafcc90fac for instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 on n-h1-833090-9 Jul 26 14:34:04.781429 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f252518f-48af-4154-9c80-24fcfe82b708 req-33a3c791-2206-407e-a2ef-9446bb508af8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075818 Jul 26 14:34:04.782750 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2356/4837] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:34:05.463905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cae056b4-be30-4a48-a767-8dfe27fc8f77 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:05.465570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cae056b4-be30-4a48-a767-8dfe27fc8f77 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:05.484649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=10 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:05.487077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cae056b4-be30-4a48-a767-8dfe27fc8f77 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:05.488216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cae056b4-be30-4a48-a767-8dfe27fc8f77 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:05.489365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cae056b4-be30-4a48-a767-8dfe27fc8f77 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:05.490628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cae056b4-be30-4a48-a767-8dfe27fc8f77 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:06.192086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cae056b4-be30-4a48-a767-8dfe27fc8f77 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:06.203219 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cae056b4-be30-4a48-a767-8dfe27fc8f77 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1325 microversion: 2.1 time: 0.745170 Jul 26 14:34:06.231179 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2482/4838] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:05 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1325 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:07.240766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0a929d00-6671-45c4-901b-f93d8e7fbcf8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:07.242258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0a929d00-6671-45c4-901b-f93d8e7fbcf8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:07.250806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a929d00-6671-45c4-901b-f93d8e7fbcf8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:07.261671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a929d00-6671-45c4-901b-f93d8e7fbcf8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:07.262996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a929d00-6671-45c4-901b-f93d8e7fbcf8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:07.266372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a929d00-6671-45c4-901b-f93d8e7fbcf8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:08.242689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0a929d00-6671-45c4-901b-f93d8e7fbcf8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:08.258040 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0a929d00-6671-45c4-901b-f93d8e7fbcf8 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1325 microversion: 2.1 time: 1.023221 Jul 26 14:34:08.258653 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2357/4839] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:07 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1325 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:34:09.293619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-886ed49b-2f86-4793-9d4f-de6d85025120 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:09.296390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-886ed49b-2f86-4793-9d4f-de6d85025120 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:09.322090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-886ed49b-2f86-4793-9d4f-de6d85025120 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:09.323287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-886ed49b-2f86-4793-9d4f-de6d85025120 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:09.326558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-886ed49b-2f86-4793-9d4f-de6d85025120 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:09.327352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-886ed49b-2f86-4793-9d4f-de6d85025120 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:10.435354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-886ed49b-2f86-4793-9d4f-de6d85025120 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:10.448241 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-886ed49b-2f86-4793-9d4f-de6d85025120 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1325 microversion: 2.1 time: 1.159212 Jul 26 14:34:10.449796 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2483/4840] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:09 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1325 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:11.475094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6d5f554-4e95-488f-b7cf-8eda0f63e106 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:11.475740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e6d5f554-4e95-488f-b7cf-8eda0f63e106 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:11.495232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6d5f554-4e95-488f-b7cf-8eda0f63e106 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:11.496216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6d5f554-4e95-488f-b7cf-8eda0f63e106 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:11.499310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6d5f554-4e95-488f-b7cf-8eda0f63e106 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:11.500107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6d5f554-4e95-488f-b7cf-8eda0f63e106 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:11.583991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:12.509816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6d5f554-4e95-488f-b7cf-8eda0f63e106 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:12.530728 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6d5f554-4e95-488f-b7cf-8eda0f63e106 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1325 microversion: 2.1 time: 1.059199 Jul 26 14:34:12.531514 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2358/4841] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:11 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1325 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:13.559737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85c2bfb8-3923-44e2-ab14-1340cbfbc760 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:13.564974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85c2bfb8-3923-44e2-ab14-1340cbfbc760 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:13.590612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85c2bfb8-3923-44e2-ab14-1340cbfbc760 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:13.591071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85c2bfb8-3923-44e2-ab14-1340cbfbc760 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:13.595895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85c2bfb8-3923-44e2-ab14-1340cbfbc760 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:13.596605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85c2bfb8-3923-44e2-ab14-1340cbfbc760 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:13.687538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=46 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:14.497272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-85c2bfb8-3923-44e2-ab14-1340cbfbc760 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:14.506488 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85c2bfb8-3923-44e2-ab14-1340cbfbc760 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1325 microversion: 2.1 time: 0.953588 Jul 26 14:34:14.511263 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2484/4842] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:13 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1325 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:15.332448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b34af3fe-bcbf-4710-ad83-f522d66d320c req-900dc0af-7f75-4ead-bb47-5b0b4349d05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60cec85c-17f0-4c05-b18f-4ba8791cc737", "name": "network-vif-plugged", "status": "completed", "tag": "bbb083ad-083b-4271-a0d7-d5fafcc90fac"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:34:15.353432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b34af3fe-bcbf-4710-ad83-f522d66d320c req-900dc0af-7f75-4ead-bb47-5b0b4349d05d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:15.354158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b34af3fe-bcbf-4710-ad83-f522d66d320c req-900dc0af-7f75-4ead-bb47-5b0b4349d05d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:15.379841 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b34af3fe-bcbf-4710-ad83-f522d66d320c req-900dc0af-7f75-4ead-bb47-5b0b4349d05d service nova] Creating event network-vif-plugged:bbb083ad-083b-4271-a0d7-d5fafcc90fac for instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 on n-h1-833090-9 Jul 26 14:34:15.391735 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b34af3fe-bcbf-4710-ad83-f522d66d320c req-900dc0af-7f75-4ead-bb47-5b0b4349d05d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.620429 Jul 26 14:34:15.397330 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2359/4843] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:34:15.531784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-78956796-198e-4576-9715-114225e76dc4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:15.532533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-78956796-198e-4576-9715-114225e76dc4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:15.543141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78956796-198e-4576-9715-114225e76dc4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:15.546174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78956796-198e-4576-9715-114225e76dc4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:15.548236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78956796-198e-4576-9715-114225e76dc4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:15.550315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78956796-198e-4576-9715-114225e76dc4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:17.331711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-78956796-198e-4576-9715-114225e76dc4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:17.348815 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-78956796-198e-4576-9715-114225e76dc4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1325 microversion: 2.1 time: 1.820379 Jul 26 14:34:17.350305 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2485/4844] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:15 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1325 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:18.373639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e303e1bc-7eb6-4cb1-b735-710a1bf07e8a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:18.374869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e303e1bc-7eb6-4cb1-b735-710a1bf07e8a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:18.386670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e303e1bc-7eb6-4cb1-b735-710a1bf07e8a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:18.395943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e303e1bc-7eb6-4cb1-b735-710a1bf07e8a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:18.411160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e303e1bc-7eb6-4cb1-b735-710a1bf07e8a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:18.413907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e303e1bc-7eb6-4cb1-b735-710a1bf07e8a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:19.545793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e303e1bc-7eb6-4cb1-b735-710a1bf07e8a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:19.558701 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e303e1bc-7eb6-4cb1-b735-710a1bf07e8a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1523 microversion: 2.1 time: 1.187333 Jul 26 14:34:19.559333 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2360/4845] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:18 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1523 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:19.583914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9697348f-483f-4da2-a0b6-21c9851345ee tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:19.585143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9697348f-483f-4da2-a0b6-21c9851345ee tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:19.598895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9697348f-483f-4da2-a0b6-21c9851345ee tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:19.599186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9697348f-483f-4da2-a0b6-21c9851345ee tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:19.599998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9697348f-483f-4da2-a0b6-21c9851345ee tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:19.601149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9697348f-483f-4da2-a0b6-21c9851345ee tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:20.151940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9697348f-483f-4da2-a0b6-21c9851345ee tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:20.164895 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9697348f-483f-4da2-a0b6-21c9851345ee tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1523 microversion: 2.1 time: 0.583096 Jul 26 14:34:20.168414 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2486/4846] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:19 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1523 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:20.184048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-35644129-1049-464f-b54e-8ef93f014f87 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-541100070"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:34:20.186560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-35644129-1049-464f-b54e-8ef93f014f87 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:20.198175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35644129-1049-464f-b54e-8ef93f014f87 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:20.198634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35644129-1049-464f-b54e-8ef93f014f87 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:20.203837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35644129-1049-464f-b54e-8ef93f014f87 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:20.204446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35644129-1049-464f-b54e-8ef93f014f87 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:20.792346 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-35644129-1049-464f-b54e-8ef93f014f87 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "POST /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737/action" status: 202 len: 0 microversion: 2.1 time: 0.612488 Jul 26 14:34:20.796385 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2361/4847] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:34:20 2022] POST /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 14:34:20.808638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c4645114-8b94-4a6c-b6a7-be58b31248b5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '.version_select at 0x7f87942791f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:21.110640 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c4645114-8b94-4a6c-b6a7-be58b31248b5 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "DELETE /compute/v2.1/images/35908e98-5205-43d5-ace9-7a8ff253606f" status: 204 len: 0 microversion: 2.1 time: 0.308408 Jul 26 14:34:21.113565 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2487/4848] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:20 2022] DELETE /compute/v2.1/images/35908e98-5205-43d5-ace9-7a8ff253606f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:34:21.124378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dc9b0920-266a-453b-93cd-d95684861d9d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '.version_select at 0x7f8786ccb4c0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:21.160738 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-dc9b0920-266a-453b-93cd-d95684861d9d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Image not found. Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dc9b0920-266a-453b-93cd-d95684861d9d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/images/35908e98-5205-43d5-ace9-7a8ff253606f HTTP/1.1 Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '35908e98-5205-43d5-ace9-7a8ff253606f'} Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 35908e98-5205-43d5-ace9-7a8ff253606f Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 26 14:34:21.178003 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 35908e98-5205-43d5-ace9-7a8ff253606f could not be found. Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:34:21.183102 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:21.193809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dc9b0920-266a-453b-93cd-d95684861d9d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:34:21.195317 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dc9b0920-266a-453b-93cd-d95684861d9d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/images/35908e98-5205-43d5-ace9-7a8ff253606f" status: 404 len: 62 microversion: 2.1 time: 0.077110 Jul 26 14:34:21.196811 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2362/4849] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Jul 26 14:34:21 2022] GET /compute/v2.1/images/35908e98-5205-43d5-ace9-7a8ff253606f => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:34:21.204949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a757bc8-4d80-402f-b610-64faafb59580 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:21.205589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0a757bc8-4d80-402f-b610-64faafb59580 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:21.212561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a757bc8-4d80-402f-b610-64faafb59580 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:21.213025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a757bc8-4d80-402f-b610-64faafb59580 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:21.214212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a757bc8-4d80-402f-b610-64faafb59580 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:21.214857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a757bc8-4d80-402f-b610-64faafb59580 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:21.629160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0a757bc8-4d80-402f-b610-64faafb59580 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:21.637761 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0a757bc8-4d80-402f-b610-64faafb59580 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1535 microversion: 2.1 time: 0.436882 Jul 26 14:34:21.640958 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2488/4850] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:21 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1535 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:34:22.665242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7bfd9047-55da-4e4b-a8a5-b75dc56894b9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:22.666599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7bfd9047-55da-4e4b-a8a5-b75dc56894b9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:22.682210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bfd9047-55da-4e4b-a8a5-b75dc56894b9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:22.687845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bfd9047-55da-4e4b-a8a5-b75dc56894b9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:22.692505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bfd9047-55da-4e4b-a8a5-b75dc56894b9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:22.692505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bfd9047-55da-4e4b-a8a5-b75dc56894b9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:23.089826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7bfd9047-55da-4e4b-a8a5-b75dc56894b9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:23.104000 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7bfd9047-55da-4e4b-a8a5-b75dc56894b9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1541 microversion: 2.1 time: 0.446325 Jul 26 14:34:23.106848 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2363/4851] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:22 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1541 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:24.132998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fcc85ac9-7ca7-4e67-bd11-75c79bbe29d2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:24.135047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fcc85ac9-7ca7-4e67-bd11-75c79bbe29d2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:24.139189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:24.155605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcc85ac9-7ca7-4e67-bd11-75c79bbe29d2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:24.159131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcc85ac9-7ca7-4e67-bd11-75c79bbe29d2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:24.160217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcc85ac9-7ca7-4e67-bd11-75c79bbe29d2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:24.163658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcc85ac9-7ca7-4e67-bd11-75c79bbe29d2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:24.613073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fcc85ac9-7ca7-4e67-bd11-75c79bbe29d2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:24.628752 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fcc85ac9-7ca7-4e67-bd11-75c79bbe29d2 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1536 microversion: 2.1 time: 0.499608 Jul 26 14:34:24.630894 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2489/4852] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:24 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1536 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:25.651323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-317fb943-0eb9-4b73-89fa-be1d1b3a0a6b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:25.652147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-317fb943-0eb9-4b73-89fa-be1d1b3a0a6b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:25.670491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-317fb943-0eb9-4b73-89fa-be1d1b3a0a6b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:25.671031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-317fb943-0eb9-4b73-89fa-be1d1b3a0a6b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:25.671835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-317fb943-0eb9-4b73-89fa-be1d1b3a0a6b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:25.672312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-317fb943-0eb9-4b73-89fa-be1d1b3a0a6b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:26.133770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-317fb943-0eb9-4b73-89fa-be1d1b3a0a6b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:26.145829 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-317fb943-0eb9-4b73-89fa-be1d1b3a0a6b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1523 microversion: 2.1 time: 0.498735 Jul 26 14:34:26.154751 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2364/4853] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:25 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1523 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:26.179623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e738573d-b758-4594-b173-f1467acc0317 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:26.181327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e738573d-b758-4594-b173-f1467acc0317 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:26.194761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e738573d-b758-4594-b173-f1467acc0317 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:26.196537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e738573d-b758-4594-b173-f1467acc0317 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:26.197966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e738573d-b758-4594-b173-f1467acc0317 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:26.201977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e738573d-b758-4594-b173-f1467acc0317 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:26.239888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e738573d-b758-4594-b173-f1467acc0317 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:34:26.402789 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e738573d-b758-4594-b173-f1467acc0317 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "DELETE /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 204 len: 0 microversion: 2.1 time: 0.226668 Jul 26 14:34:26.404724 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2490/4854] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:34:26 2022] DELETE /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:34:26.412835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8166d835-9de2-4c62-8bb3-f8827ce2a62b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:26.413463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8166d835-9de2-4c62-8bb3-f8827ce2a62b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:26.415446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=22 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:26.438496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8166d835-9de2-4c62-8bb3-f8827ce2a62b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:26.439201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8166d835-9de2-4c62-8bb3-f8827ce2a62b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:26.440239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8166d835-9de2-4c62-8bb3-f8827ce2a62b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:26.440845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8166d835-9de2-4c62-8bb3-f8827ce2a62b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:27.059888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-65462aad-8b6f-4232-8769-ddcfbdcdb426 tempest-ComputeTenantNetworksTest-2130607110 tempest-ComputeTenantNetworksTest-2130607110-project] Calling method '.version_select at 0x7f8786bd3550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:27.091908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8166d835-9de2-4c62-8bb3-f8827ce2a62b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:27.112669 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8166d835-9de2-4c62-8bb3-f8827ce2a62b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1529 microversion: 2.1 time: 0.703717 Jul 26 14:34:27.113634 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2365/4855] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:26 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1529 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:34:27.449352 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-65462aad-8b6f-4232-8769-ddcfbdcdb426 tempest-ComputeTenantNetworksTest-2130607110 tempest-ComputeTenantNetworksTest-2130607110-project] 10.222.0.70 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.572259 Jul 26 14:34:27.450341 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2491/4856] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:34:26 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:34:27.462286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0da91610-05e2-4efc-9108-c54682d90bf2 tempest-ComputeTenantNetworksTest-2130607110 tempest-ComputeTenantNetworksTest-2130607110-project] Calling method '.version_select at 0x7f87877703a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:27.666871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4e134139-1e4e-4ca4-81b2-b5143984046b req-929f21fc-aa9b-40f2-b49b-200f3f4edc49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60cec85c-17f0-4c05-b18f-4ba8791cc737", "name": "network-vif-plugged", "status": "completed", "tag": "bbb083ad-083b-4271-a0d7-d5fafcc90fac"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:34:27.692554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4e134139-1e4e-4ca4-81b2-b5143984046b req-929f21fc-aa9b-40f2-b49b-200f3f4edc49 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:27.693788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4e134139-1e4e-4ca4-81b2-b5143984046b req-929f21fc-aa9b-40f2-b49b-200f3f4edc49 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:27.725138 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4e134139-1e4e-4ca4-81b2-b5143984046b req-929f21fc-aa9b-40f2-b49b-200f3f4edc49 service nova] Creating event network-vif-plugged:bbb083ad-083b-4271-a0d7-d5fafcc90fac for instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 on n-h1-833090-9 Jul 26 14:34:27.736494 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4e134139-1e4e-4ca4-81b2-b5143984046b req-929f21fc-aa9b-40f2-b49b-200f3f4edc49 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072921 Jul 26 14:34:27.741948 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2492/4857] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:34:27.949567 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0da91610-05e2-4efc-9108-c54682d90bf2 tempest-ComputeTenantNetworksTest-2130607110 tempest-ComputeTenantNetworksTest-2130607110-project] 10.222.0.70 "GET /compute/v2.1/os-tenant-networks/4f87621d-14f7-471a-a96d-a09d5d148d64" status: 200 len: 140 microversion: 2.1 time: 0.491337 Jul 26 14:34:27.950816 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2366/4858] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:34:27 2022] GET /compute/v2.1/os-tenant-networks/4f87621d-14f7-471a-a96d-a09d5d148d64 => generated 140 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:34:28.139805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8050637f-151a-4c77-8e04-bb3a22e49a06 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:28.144191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8050637f-151a-4c77-8e04-bb3a22e49a06 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:28.156422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8050637f-151a-4c77-8e04-bb3a22e49a06 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:28.156945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8050637f-151a-4c77-8e04-bb3a22e49a06 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:28.157942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8050637f-151a-4c77-8e04-bb3a22e49a06 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:28.158428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8050637f-151a-4c77-8e04-bb3a22e49a06 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:29.658820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8050637f-151a-4c77-8e04-bb3a22e49a06 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:29.668960 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8050637f-151a-4c77-8e04-bb3a22e49a06 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1529 microversion: 2.1 time: 1.537771 Jul 26 14:34:29.680851 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2493/4859] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:28 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1529 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:30.496418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-583db910-99e7-4ca8-aaf0-4e60617bf7be req-8b2cceaf-3ae4-4749-9bf5-b1088b39b2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60cec85c-17f0-4c05-b18f-4ba8791cc737", "name": "network-vif-deleted", "tag": "bbb083ad-083b-4271-a0d7-d5fafcc90fac"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:34:30.521455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-583db910-99e7-4ca8-aaf0-4e60617bf7be req-8b2cceaf-3ae4-4749-9bf5-b1088b39b2f5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:30.521910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-583db910-99e7-4ca8-aaf0-4e60617bf7be req-8b2cceaf-3ae4-4749-9bf5-b1088b39b2f5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:30.569325 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-583db910-99e7-4ca8-aaf0-4e60617bf7be req-8b2cceaf-3ae4-4749-9bf5-b1088b39b2f5 service nova] Creating event network-vif-deleted:bbb083ad-083b-4271-a0d7-d5fafcc90fac for instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 on n-h1-833090-9 Jul 26 14:34:30.598509 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-583db910-99e7-4ca8-aaf0-4e60617bf7be req-8b2cceaf-3ae4-4749-9bf5-b1088b39b2f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.457019 Jul 26 14:34:30.606355 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2367/4860] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:34:30.698410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:30.699740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:30.721438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:30.728200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:30.740140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:30.741071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:30.846557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:30.851644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:30.852201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lazy-loading 'fault' on Instance uuid 60cec85c-17f0-4c05-b18f-4ba8791cc737 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:34:31.221058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:31.238809 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d0e73fd7-1b86-42ed-8b89-cc8544e5a74b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 200 len: 1315 microversion: 2.1 time: 0.544419 Jul 26 14:34:31.241938 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2494/4861] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:30 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:31.757282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f2eb61a0-45de-4071-9d96-bc9d6659da8c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:31.757867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f2eb61a0-45de-4071-9d96-bc9d6659da8c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:31.777376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2eb61a0-45de-4071-9d96-bc9d6659da8c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:31.777825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2eb61a0-45de-4071-9d96-bc9d6659da8c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:31.779209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2eb61a0-45de-4071-9d96-bc9d6659da8c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:31.779969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2eb61a0-45de-4071-9d96-bc9d6659da8c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:32.001293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-f2eb61a0-45de-4071-9d96-bc9d6659da8c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lazy-loading 'services' on Instance uuid ed1cf1ca-f033-41e3-bdff-b0c315f13412 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:34:32.247426 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f2eb61a0-45de-4071-9d96-bc9d6659da8c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412/os-volume_attachments/b1593d15-9842-46e8-85f3-a49b0a38d492" status: 202 len: 0 microversion: 2.1 time: 0.494934 Jul 26 14:34:32.249032 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2368/4862] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:34:31 2022] DELETE /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412/os-volume_attachments/b1593d15-9842-46e8-85f3-a49b0a38d492 => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:34:32.263487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f6b1885-9e1a-4dbe-8687-fe28763158e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:32.267803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4f6b1885-9e1a-4dbe-8687-fe28763158e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:32.283975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f6b1885-9e1a-4dbe-8687-fe28763158e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:32.288239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f6b1885-9e1a-4dbe-8687-fe28763158e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:32.289308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f6b1885-9e1a-4dbe-8687-fe28763158e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:32.290696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f6b1885-9e1a-4dbe-8687-fe28763158e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:32.325134 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-4f6b1885-9e1a-4dbe-8687-fe28763158e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f6b1885-9e1a-4dbe-8687-fe28763158e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 HTTP/1.1 Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '60cec85c-17f0-4c05-b18f-4ba8791cc737'} Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:34:32.329871 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:34:32.336217 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:34:32.336217 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:34:32.336217 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:34:32.336217 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:34:32.336217 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:34:32.336217 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:34:32.336217 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:34:32.336217 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:34:32.347143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f6b1885-9e1a-4dbe-8687-fe28763158e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 404 to user: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:34:32.350060 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4f6b1885-9e1a-4dbe-8687-fe28763158e7 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 404 len: 111 microversion: 2.1 time: 0.090964 Jul 26 14:34:32.362920 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2495/4863] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:32 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:34:32.570975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1651400599", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:34:32.727810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] validate_networks() for [('111e101e-35c6-4e14-9f1a-19bc9cc657df', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:34:37.240752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:34:37.242045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:34:37.242867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:34:37.243916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:34:37.244719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:34:37.269528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:37.270508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:37.281260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:37.282139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:37.308441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Getting quotas for project 8891372cf522401f83bd7e379abd4a32. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:34:37.316798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Getting quotas for user 4cbd008c47a04847b8772b7f957bcd04 and project 8891372cf522401f83bd7e379abd4a32. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:34:37.350217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:34:37.354474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:34:37.524457 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a5fecd6f-26d4-4a3c-821e-e9a5c25ede2f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.958867 Jul 26 14:34:37.526854 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2369/4864] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:34:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 4966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:34:37.541773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7679a20a-66b5-49f4-b956-63c6273508d3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:37.542422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7679a20a-66b5-49f4-b956-63c6273508d3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:37.993394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7679a20a-66b5-49f4-b956-63c6273508d3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:38.005079 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7679a20a-66b5-49f4-b956-63c6273508d3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1225 microversion: 2.1 time: 0.471923 Jul 26 14:34:38.024508 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2496/4865] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:37 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1225 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:38.231735 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 14:34:38.231929 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 14:34:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 14:34:39.027672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ac1db11f-b966-4645-8311-2b0705891895 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:39.028345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ac1db11f-b966-4645-8311-2b0705891895 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:39.062166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac1db11f-b966-4645-8311-2b0705891895 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:39.062602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac1db11f-b966-4645-8311-2b0705891895 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:39.063708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac1db11f-b966-4645-8311-2b0705891895 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:39.063858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac1db11f-b966-4645-8311-2b0705891895 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:39.721442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ac1db11f-b966-4645-8311-2b0705891895 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:39.736769 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ac1db11f-b966-4645-8311-2b0705891895 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1221 microversion: 2.1 time: 0.713775 Jul 26 14:34:39.743103 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2370/4866] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:39 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1221 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:40.774258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9642375f-9b8f-4e9c-935c-755f911eaa3e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:40.775679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9642375f-9b8f-4e9c-935c-755f911eaa3e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:40.790903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9642375f-9b8f-4e9c-935c-755f911eaa3e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:40.793734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9642375f-9b8f-4e9c-935c-755f911eaa3e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:40.795316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9642375f-9b8f-4e9c-935c-755f911eaa3e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:40.797932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9642375f-9b8f-4e9c-935c-755f911eaa3e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:41.276190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9642375f-9b8f-4e9c-935c-755f911eaa3e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:41.293363 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9642375f-9b8f-4e9c-935c-755f911eaa3e tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1283 microversion: 2.1 time: 0.527219 Jul 26 14:34:41.297007 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2497/4867] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:40 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1283 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:42.321074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a00e3612-3c8d-4a82-be29-86e6b1974f6d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:42.321729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a00e3612-3c8d-4a82-be29-86e6b1974f6d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:42.347277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a00e3612-3c8d-4a82-be29-86e6b1974f6d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:42.351413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a00e3612-3c8d-4a82-be29-86e6b1974f6d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:42.359915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a00e3612-3c8d-4a82-be29-86e6b1974f6d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:42.363739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a00e3612-3c8d-4a82-be29-86e6b1974f6d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:42.453909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:42.734976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a00e3612-3c8d-4a82-be29-86e6b1974f6d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:42.748145 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a00e3612-3c8d-4a82-be29-86e6b1974f6d tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1283 microversion: 2.1 time: 0.429946 Jul 26 14:34:42.761450 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2371/4868] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:42 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1283 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:43.770923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-746ecede-4065-491d-8fa7-0a481f1523e4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:43.771727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-746ecede-4065-491d-8fa7-0a481f1523e4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:43.802845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-746ecede-4065-491d-8fa7-0a481f1523e4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:43.803384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-746ecede-4065-491d-8fa7-0a481f1523e4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:43.806141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-746ecede-4065-491d-8fa7-0a481f1523e4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:43.806607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-746ecede-4065-491d-8fa7-0a481f1523e4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:43.875316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:45.274994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-54038203-18d1-4144-898d-97b7bc881fd0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:45.275643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-54038203-18d1-4144-898d-97b7bc881fd0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:45.305822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54038203-18d1-4144-898d-97b7bc881fd0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:45.312731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54038203-18d1-4144-898d-97b7bc881fd0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:45.313885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54038203-18d1-4144-898d-97b7bc881fd0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:45.316327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54038203-18d1-4144-898d-97b7bc881fd0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:45.390685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-54038203-18d1-4144-898d-97b7bc881fd0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:34:45.503976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-746ecede-4065-491d-8fa7-0a481f1523e4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:45.515519 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-746ecede-4065-491d-8fa7-0a481f1523e4 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1325 microversion: 2.1 time: 1.745303 Jul 26 14:34:45.516185 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2498/4869] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:43 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1325 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:45.549895 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-54038203-18d1-4144-898d-97b7bc881fd0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 204 len: 0 microversion: 2.1 time: 0.282095 Jul 26 14:34:45.554566 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2372/4870] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:34:45 2022] DELETE /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:34:45.560332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eefb0279-6554-4440-a40d-dcdacd0232b3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:45.561265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eefb0279-6554-4440-a40d-dcdacd0232b3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:45.582388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eefb0279-6554-4440-a40d-dcdacd0232b3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:45.583863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eefb0279-6554-4440-a40d-dcdacd0232b3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:45.584949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eefb0279-6554-4440-a40d-dcdacd0232b3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:45.586888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eefb0279-6554-4440-a40d-dcdacd0232b3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:46.344427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eefb0279-6554-4440-a40d-dcdacd0232b3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:46.362692 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eefb0279-6554-4440-a40d-dcdacd0232b3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1514 microversion: 2.1 time: 0.806594 Jul 26 14:34:46.384033 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2499/4871] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:45 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1514 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:46.543718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5b19ef81-e9b4-4f5a-9bc6-3054d8ea588f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:46.545208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b19ef81-e9b4-4f5a-9bc6-3054d8ea588f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:46.565645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b19ef81-e9b4-4f5a-9bc6-3054d8ea588f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:46.566307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b19ef81-e9b4-4f5a-9bc6-3054d8ea588f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:46.569829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b19ef81-e9b4-4f5a-9bc6-3054d8ea588f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:46.570354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b19ef81-e9b4-4f5a-9bc6-3054d8ea588f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:47.298101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:47.335390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:47.389239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a6ad92ac-078e-487a-a593-1ef7712ea4af tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:47.390038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a6ad92ac-078e-487a-a593-1ef7712ea4af tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:47.408934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ad92ac-078e-487a-a593-1ef7712ea4af tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:47.409724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ad92ac-078e-487a-a593-1ef7712ea4af tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:47.414320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ad92ac-078e-487a-a593-1ef7712ea4af tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:47.435429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ad92ac-078e-487a-a593-1ef7712ea4af tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:47.490547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5b19ef81-e9b4-4f5a-9bc6-3054d8ea588f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:47.503641 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5b19ef81-e9b4-4f5a-9bc6-3054d8ea588f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1325 microversion: 2.1 time: 0.969072 Jul 26 14:34:47.504296 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2373/4872] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:46 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1325 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:47.999331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:48.233157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a6ad92ac-078e-487a-a593-1ef7712ea4af tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:48.260952 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a6ad92ac-078e-487a-a593-1ef7712ea4af tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1514 microversion: 2.1 time: 0.874489 Jul 26 14:34:48.262224 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2500/4873] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:47 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1514 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:34:48.526034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da9ab754-ca5f-4498-805a-2f58a3cafd51 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:48.526732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-da9ab754-ca5f-4498-805a-2f58a3cafd51 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:48.538719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da9ab754-ca5f-4498-805a-2f58a3cafd51 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:48.544522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da9ab754-ca5f-4498-805a-2f58a3cafd51 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:48.545518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da9ab754-ca5f-4498-805a-2f58a3cafd51 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:48.546122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da9ab754-ca5f-4498-805a-2f58a3cafd51 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:49.285794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-16c352fc-4068-4493-a3f9-96fbe161a6fc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:49.287125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-16c352fc-4068-4493-a3f9-96fbe161a6fc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:49.295882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16c352fc-4068-4493-a3f9-96fbe161a6fc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:49.296790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16c352fc-4068-4493-a3f9-96fbe161a6fc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:49.298640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16c352fc-4068-4493-a3f9-96fbe161a6fc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:49.300598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16c352fc-4068-4493-a3f9-96fbe161a6fc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:49.795769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-da9ab754-ca5f-4498-805a-2f58a3cafd51 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:49.815995 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-da9ab754-ca5f-4498-805a-2f58a3cafd51 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1325 microversion: 2.1 time: 1.294037 Jul 26 14:34:49.836587 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2374/4874] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:48 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1325 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:50.120213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-16c352fc-4068-4493-a3f9-96fbe161a6fc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:50.133626 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-16c352fc-4068-4493-a3f9-96fbe161a6fc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1514 microversion: 2.1 time: 0.852425 Jul 26 14:34:50.151734 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2501/4875] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:49 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1514 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:34:50.636603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4a71fff1-a571-4dc5-84d6-2b527a481860 req-eb1ea938-5020-4201-91e4-db7197de4e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1cf1ca-f033-41e3-bdff-b0c315f13412", "name": "network-vif-deleted", "tag": "49b04061-6067-44b5-a323-5993116f5190"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:34:50.670806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4a71fff1-a571-4dc5-84d6-2b527a481860 req-eb1ea938-5020-4201-91e4-db7197de4e9c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:50.671839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4a71fff1-a571-4dc5-84d6-2b527a481860 req-eb1ea938-5020-4201-91e4-db7197de4e9c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:50.692499 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4a71fff1-a571-4dc5-84d6-2b527a481860 req-eb1ea938-5020-4201-91e4-db7197de4e9c service nova] Creating event network-vif-deleted:49b04061-6067-44b5-a323-5993116f5190 for instance ed1cf1ca-f033-41e3-bdff-b0c315f13412 on n-h2-833090-9 Jul 26 14:34:50.700103 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4a71fff1-a571-4dc5-84d6-2b527a481860 req-eb1ea938-5020-4201-91e4-db7197de4e9c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066452 Jul 26 14:34:50.701472 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2375/4876] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:34:50.838682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5e734353-7704-4035-9fee-5eb3c7b8c25a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:50.840228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5e734353-7704-4035-9fee-5eb3c7b8c25a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:50.859658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e734353-7704-4035-9fee-5eb3c7b8c25a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:50.860661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e734353-7704-4035-9fee-5eb3c7b8c25a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:50.861656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e734353-7704-4035-9fee-5eb3c7b8c25a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:50.862316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e734353-7704-4035-9fee-5eb3c7b8c25a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:51.156642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:51.157365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:51.167842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:51.172881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:51.174458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:51.177815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:51.224767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:51.225520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:51.226482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lazy-loading 'fault' on Instance uuid ed1cf1ca-f033-41e3-bdff-b0c315f13412 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:34:51.305862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5e734353-7704-4035-9fee-5eb3c7b8c25a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:51.321908 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5e734353-7704-4035-9fee-5eb3c7b8c25a tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1325 microversion: 2.1 time: 0.485983 Jul 26 14:34:51.338771 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2502/4877] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:50 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1325 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:51.498729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:51.509580 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b6a2989b-c8f9-49f0-8e22-6141c8d9a122 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 200 len: 1308 microversion: 2.1 time: 0.357510 Jul 26 14:34:51.515471 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2376/4878] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:51 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:52.364261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-276af1ab-4f35-47e4-ab81-0e0a0c7dc048 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:52.365923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-276af1ab-4f35-47e4-ab81-0e0a0c7dc048 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:52.378274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-276af1ab-4f35-47e4-ab81-0e0a0c7dc048 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:52.378945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-276af1ab-4f35-47e4-ab81-0e0a0c7dc048 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:52.379932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-276af1ab-4f35-47e4-ab81-0e0a0c7dc048 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:52.380580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-276af1ab-4f35-47e4-ab81-0e0a0c7dc048 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:52.540457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cee27ef5-90f9-4513-914d-582c11b2440c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:52.541126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cee27ef5-90f9-4513-914d-582c11b2440c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: ed1cf1ca-f033-41e3-bdff-b0c315f13412] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:52.557321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cee27ef5-90f9-4513-914d-582c11b2440c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:52.563516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cee27ef5-90f9-4513-914d-582c11b2440c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:52.564604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cee27ef5-90f9-4513-914d-582c11b2440c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:52.565247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cee27ef5-90f9-4513-914d-582c11b2440c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:52.608806 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-cee27ef5-90f9-4513-914d-582c11b2440c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] HTTP exception thrown: Instance ed1cf1ca-f033-41e3-bdff-b0c315f13412 could not be found. Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cee27ef5-90f9-4513-914d-582c11b2440c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Request method failure captured: Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 HTTP/1.1 Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_qgtj99AoKwNyGqVh45GZ7B_avOYKmEtudjJVeguKPZegC0wCz_c1p3gfCsDWVdU9IaSBIUaawvs5ac3iedUB6pdK2B6b-iKdaGGFHzrjkPp_OTEOlHwn0PxZAUDpWPkW8MZbBAI3t1ahJF4Zb1pffF6eXY9B-hwnvOuKanBjfsFes Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 1bd529458cb14838a52bb97042910a73 Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-VolumesSnapshotTestJSON-131664859 Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1bd529458cb14838a52bb97042910a73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1bd529458cb14838a52bb97042910a73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1bd529458cb14838a52bb97042910a73", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1bd529458cb14838a52bb97042910a73"}]}] Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-VolumesSnapshotTestJSON-131664859 Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 1bd529458cb14838a52bb97042910a73 Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-131664859 Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-VolumesSnapshotTestJSON-131664859-project Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: fe09966a2dd345b88b12944bf831bf0c Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-VolumesSnapshotTestJSON-131664859-project Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance ed1cf1ca-f033-41e3-bdff-b0c315f13412 could not be found. Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'ed1cf1ca-f033-41e3-bdff-b0c315f13412'} Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed1cf1ca-f033-41e3-bdff-b0c315f13412 could not be found. Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed1cf1ca-f033-41e3-bdff-b0c315f13412 could not be found. Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:34:52.615630 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:52.683648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:34:52.683648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:34:52.683648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:34:52.683648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:34:52.683648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:34:52.683648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed1cf1ca-f033-41e3-bdff-b0c315f13412 could not be found. Jul 26 14:34:52.683648 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:34:52.683648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cee27ef5-90f9-4513-914d-582c11b2440c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Returning 404 to user: Instance ed1cf1ca-f033-41e3-bdff-b0c315f13412 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:34:52.683648 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cee27ef5-90f9-4513-914d-582c11b2440c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412" status: 404 len: 111 microversion: 2.1 time: 0.091007 Jul 26 14:34:52.683648 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2377/4879] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:52 2022] GET /compute/v2.1/servers/ed1cf1ca-f033-41e3-bdff-b0c315f13412 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:34:52.761448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c36fe6c6-bb0f-47a5-a0f5-116f93c32949 req-0a22117e-3b31-460d-a232-3d8f94d8acb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f", "tag": "60eb60e9-354c-41f0-87a1-52fba51939d4"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:34:52.804439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c36fe6c6-bb0f-47a5-a0f5-116f93c32949 req-0a22117e-3b31-460d-a232-3d8f94d8acb2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:52.804923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c36fe6c6-bb0f-47a5-a0f5-116f93c32949 req-0a22117e-3b31-460d-a232-3d8f94d8acb2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:52.847409 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c36fe6c6-bb0f-47a5-a0f5-116f93c32949 req-0a22117e-3b31-460d-a232-3d8f94d8acb2 service nova] Creating event network-changed:60eb60e9-354c-41f0-87a1-52fba51939d4 for instance 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f on n-h1-833090-9 Jul 26 14:34:52.861077 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c36fe6c6-bb0f-47a5-a0f5-116f93c32949 req-0a22117e-3b31-460d-a232-3d8f94d8acb2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103523 Jul 26 14:34:52.861708 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2378/4880] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:34:53.723495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-276af1ab-4f35-47e4-ab81-0e0a0c7dc048 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:53.735448 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-276af1ab-4f35-47e4-ab81-0e0a0c7dc048 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1325 microversion: 2.1 time: 1.377573 Jul 26 14:34:53.739628 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2503/4881] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:52 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1325 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:54.767009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e3eae3be-6ed6-417c-8667-c907bf3b6ca3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:54.768542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e3eae3be-6ed6-417c-8667-c907bf3b6ca3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:54.785581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3eae3be-6ed6-417c-8667-c907bf3b6ca3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:54.786385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3eae3be-6ed6-417c-8667-c907bf3b6ca3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:54.787379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3eae3be-6ed6-417c-8667-c907bf3b6ca3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:54.788050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3eae3be-6ed6-417c-8667-c907bf3b6ca3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:55.918382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e3eae3be-6ed6-417c-8667-c907bf3b6ca3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:55.927157 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e3eae3be-6ed6-417c-8667-c907bf3b6ca3 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1325 microversion: 2.1 time: 1.166249 Jul 26 14:34:55.927749 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2379/4882] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:54 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1325 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:56.950060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-59fbdad1-5f64-4347-ba1b-3ba2bd662b71 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:56.951274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-59fbdad1-5f64-4347-ba1b-3ba2bd662b71 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:56.959689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:56.964681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59fbdad1-5f64-4347-ba1b-3ba2bd662b71 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:56.967189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59fbdad1-5f64-4347-ba1b-3ba2bd662b71 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:56.969504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59fbdad1-5f64-4347-ba1b-3ba2bd662b71 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:56.970169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59fbdad1-5f64-4347-ba1b-3ba2bd662b71 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:57.974256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-59fbdad1-5f64-4347-ba1b-3ba2bd662b71 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:57.982450 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-59fbdad1-5f64-4347-ba1b-3ba2bd662b71 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1325 microversion: 2.1 time: 1.036846 Jul 26 14:34:57.983033 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2504/4883] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:56 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1325 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:59.007312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-26429ca6-f162-4dd8-855c-2fd0389d7949 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:34:59.008627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-26429ca6-f162-4dd8-855c-2fd0389d7949 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:34:59.011922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:34:59.032101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26429ca6-f162-4dd8-855c-2fd0389d7949 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:59.032933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26429ca6-f162-4dd8-855c-2fd0389d7949 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:59.034089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26429ca6-f162-4dd8-855c-2fd0389d7949 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:59.035319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26429ca6-f162-4dd8-855c-2fd0389d7949 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:59.536453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-26429ca6-f162-4dd8-855c-2fd0389d7949 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:34:59.558777 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-26429ca6-f162-4dd8-855c-2fd0389d7949 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1325 microversion: 2.1 time: 0.555001 Jul 26 14:34:59.561561 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2380/4884] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:34:59 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1325 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:34:59.826782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-52c46598-de39-41d8-9dc4-16cdf9e1cd48 req-630b0be4-3a55-4126-b31f-af77d066a737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f", "name": "network-vif-plugged", "status": "completed", "tag": "60eb60e9-354c-41f0-87a1-52fba51939d4"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:34:59.852338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-52c46598-de39-41d8-9dc4-16cdf9e1cd48 req-630b0be4-3a55-4126-b31f-af77d066a737 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:34:59.862641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-52c46598-de39-41d8-9dc4-16cdf9e1cd48 req-630b0be4-3a55-4126-b31f-af77d066a737 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:34:59.904052 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-52c46598-de39-41d8-9dc4-16cdf9e1cd48 req-630b0be4-3a55-4126-b31f-af77d066a737 service nova] Creating event network-vif-plugged:60eb60e9-354c-41f0-87a1-52fba51939d4 for instance 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f on n-h1-833090-9 Jul 26 14:34:59.932700 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-52c46598-de39-41d8-9dc4-16cdf9e1cd48 req-630b0be4-3a55-4126-b31f-af77d066a737 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110646 Jul 26 14:34:59.937102 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2505/4885] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:35:00.582877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1f9873fd-4f16-4cd9-a459-1c17bf11bca9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:00.583720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f9873fd-4f16-4cd9-a459-1c17bf11bca9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:00.599443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9873fd-4f16-4cd9-a459-1c17bf11bca9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:00.599443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9873fd-4f16-4cd9-a459-1c17bf11bca9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:00.600753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9873fd-4f16-4cd9-a459-1c17bf11bca9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:00.601200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f9873fd-4f16-4cd9-a459-1c17bf11bca9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:01.986967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1f9873fd-4f16-4cd9-a459-1c17bf11bca9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:02.002859 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1f9873fd-4f16-4cd9-a459-1c17bf11bca9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1325 microversion: 2.1 time: 1.424579 Jul 26 14:35:02.006454 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2381/4886] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:00 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1325 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:03.034723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-42c30090-df7b-45cc-8f0b-b9ad24fd172f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:03.035624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-42c30090-df7b-45cc-8f0b-b9ad24fd172f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:03.069328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42c30090-df7b-45cc-8f0b-b9ad24fd172f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:03.069816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42c30090-df7b-45cc-8f0b-b9ad24fd172f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:03.070679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42c30090-df7b-45cc-8f0b-b9ad24fd172f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:03.071065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42c30090-df7b-45cc-8f0b-b9ad24fd172f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:03.576115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-595653517", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "e83c45b5-8571-49b8-8948-f75f93862b4a"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:35:03.668244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] validate_networks() for [('e83c45b5-8571-49b8-8948-f75f93862b4a', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:35:03.971184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-42c30090-df7b-45cc-8f0b-b9ad24fd172f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:04.005692 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-42c30090-df7b-45cc-8f0b-b9ad24fd172f tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1523 microversion: 2.1 time: 0.983990 Jul 26 14:35:04.026023 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2506/4887] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:03 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1523 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:04.042080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-91712d27-346a-46e7-a4d9-a627203102ef tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:04.045548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-91712d27-346a-46e7-a4d9-a627203102ef tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:04.053788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91712d27-346a-46e7-a4d9-a627203102ef tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:04.054580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91712d27-346a-46e7-a4d9-a627203102ef tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:04.055903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91712d27-346a-46e7-a4d9-a627203102ef tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:04.056725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91712d27-346a-46e7-a4d9-a627203102ef tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:04.088575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-91712d27-346a-46e7-a4d9-a627203102ef tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:35:04.205554 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-91712d27-346a-46e7-a4d9-a627203102ef tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 204 len: 0 microversion: 2.1 time: 0.170387 Jul 26 14:35:04.209990 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2507/4888] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:35:04 2022] DELETE /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:35:04.218455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b01355af-fafd-42cd-8d99-209288475d05 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:04.220089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b01355af-fafd-42cd-8d99-209288475d05 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:04.227331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b01355af-fafd-42cd-8d99-209288475d05 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:04.228136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b01355af-fafd-42cd-8d99-209288475d05 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:04.229354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b01355af-fafd-42cd-8d99-209288475d05 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:04.230018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b01355af-fafd-42cd-8d99-209288475d05 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:05.396487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b01355af-fafd-42cd-8d99-209288475d05 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:05.427207 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b01355af-fafd-42cd-8d99-209288475d05 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1529 microversion: 2.1 time: 1.215310 Jul 26 14:35:05.431677 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2508/4889] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:04 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1529 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:06.038785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:35:06.039557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:35:06.040493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:35:06.041043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:35:06.041745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:35:06.068459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:06.069397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:06.071756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:06.074384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:06.132968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Getting quotas for project 1bd529458cb14838a52bb97042910a73. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:35:06.146343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Getting quotas for user fe09966a2dd345b88b12944bf831bf0c and project 1bd529458cb14838a52bb97042910a73. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:35:06.164610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:35:06.167462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:35:06.280614 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-acebe717-0d34-45a0-804c-957b48bfa7d1 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.709737 Jul 26 14:35:06.284078 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2382/4890] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:35:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:35:06.295596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5b92cbe8-c3b3-474d-b53f-fcca6e71d21d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:06.296585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5b92cbe8-c3b3-474d-b53f-fcca6e71d21d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:06.454681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dbc61092-d5d2-4b75-8c75-fc07c73e3d10 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:06.455520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dbc61092-d5d2-4b75-8c75-fc07c73e3d10 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:06.478250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbc61092-d5d2-4b75-8c75-fc07c73e3d10 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:06.479059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbc61092-d5d2-4b75-8c75-fc07c73e3d10 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:06.480137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbc61092-d5d2-4b75-8c75-fc07c73e3d10 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:06.481366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbc61092-d5d2-4b75-8c75-fc07c73e3d10 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:06.976576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5b92cbe8-c3b3-474d-b53f-fcca6e71d21d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:06.989891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dbc61092-d5d2-4b75-8c75-fc07c73e3d10 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:06.990276 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5b92cbe8-c3b3-474d-b53f-fcca6e71d21d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1218 microversion: 2.1 time: 0.700455 Jul 26 14:35:06.991234 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2509/4891] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:06 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1218 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:07.017984 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dbc61092-d5d2-4b75-8c75-fc07c73e3d10 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1487 microversion: 2.1 time: 0.568281 Jul 26 14:35:07.018218 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2383/4892] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:06 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1487 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:35:07.416351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1994eed0-7e83-4525-a133-b2c33a532168 req-d1bd9637-d8c3-4aa7-9891-5091456222bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f", "name": "network-vif-deleted", "tag": "60eb60e9-354c-41f0-87a1-52fba51939d4"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:35:07.462314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1994eed0-7e83-4525-a133-b2c33a532168 req-d1bd9637-d8c3-4aa7-9891-5091456222bf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:07.463624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1994eed0-7e83-4525-a133-b2c33a532168 req-d1bd9637-d8c3-4aa7-9891-5091456222bf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:07.503087 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1994eed0-7e83-4525-a133-b2c33a532168 req-d1bd9637-d8c3-4aa7-9891-5091456222bf service nova] Creating event network-vif-deleted:60eb60e9-354c-41f0-87a1-52fba51939d4 for instance 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f on n-h1-833090-9 Jul 26 14:35:07.514607 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1994eed0-7e83-4525-a133-b2c33a532168 req-d1bd9637-d8c3-4aa7-9891-5091456222bf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105243 Jul 26 14:35:07.516139 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2510/4893] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:35:08.015111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-070a48d2-5b8b-4854-a02d-78f6fe304982 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:08.016381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-070a48d2-5b8b-4854-a02d-78f6fe304982 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:08.031191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-070a48d2-5b8b-4854-a02d-78f6fe304982 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:08.034092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-070a48d2-5b8b-4854-a02d-78f6fe304982 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:08.035112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-070a48d2-5b8b-4854-a02d-78f6fe304982 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:08.045210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:08.046566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:08.050633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-070a48d2-5b8b-4854-a02d-78f6fe304982 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:08.071472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:08.074241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:08.080786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:08.084690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:08.233842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:08.234763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:08.236365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lazy-loading 'fault' on Instance uuid 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:35:09.075420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-070a48d2-5b8b-4854-a02d-78f6fe304982 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:09.085867 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-070a48d2-5b8b-4854-a02d-78f6fe304982 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1270 microversion: 2.1 time: 1.075347 Jul 26 14:35:09.091836 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2384/4894] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:08 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1270 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:09.304846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cbd008c47a04847b8772b7f957bcd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891372cf522401f83bd7e379abd4a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:09.316391 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2c71bdb1-89ee-4235-9496-1ba2dcc3ae16 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 200 len: 1315 microversion: 2.1 time: 1.275911 Jul 26 14:35:09.327240 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2511/4895] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:08 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 1315 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:10.113642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44656dd8-544a-4162-ae96-0637e4813509 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:10.114979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44656dd8-544a-4162-ae96-0637e4813509 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:10.131408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44656dd8-544a-4162-ae96-0637e4813509 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:10.131942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44656dd8-544a-4162-ae96-0637e4813509 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:10.134294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44656dd8-544a-4162-ae96-0637e4813509 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:10.134294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44656dd8-544a-4162-ae96-0637e4813509 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:10.259011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-44656dd8-544a-4162-ae96-0637e4813509 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:10.343003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4131d50f-3a37-4e40-8539-8cc9323f4453 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:10.343628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4131d50f-3a37-4e40-8539-8cc9323f4453 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:10.343809 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-44656dd8-544a-4162-ae96-0637e4813509 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1276 microversion: 2.1 time: 0.235232 Jul 26 14:35:10.344470 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2385/4896] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:10 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:10.360643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4131d50f-3a37-4e40-8539-8cc9323f4453 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:10.363509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4131d50f-3a37-4e40-8539-8cc9323f4453 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:10.366955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4131d50f-3a37-4e40-8539-8cc9323f4453 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:10.367413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4131d50f-3a37-4e40-8539-8cc9323f4453 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:10.433169 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-4131d50f-3a37-4e40-8539-8cc9323f4453 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Instance 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f could not be found. Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4131d50f-3a37-4e40-8539-8cc9323f4453 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f HTTP/1.1 Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f could not be found. Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f'} Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f could not be found. Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f could not be found. Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.435289 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:10.438801 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.438801 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.438801 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:10.438801 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:10.438801 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:35:10.438801 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:35:10.438801 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f could not be found. Jul 26 14:35:10.438801 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.438801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4131d50f-3a37-4e40-8539-8cc9323f4453 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 404 to user: Instance 1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:35:10.438801 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4131d50f-3a37-4e40-8539-8cc9323f4453 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f" status: 404 len: 111 microversion: 2.1 time: 0.098234 Jul 26 14:35:10.448342 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2512/4897] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:10 2022] GET /compute/v2.1/servers/1f41c11e-1a2a-4f1d-a6e8-19afdf0de78f => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:35:10.460146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d216f1f-2b67-477a-abe6-fe9af2459aea tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '.version_select at 0x7f879936a430>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:10.526926 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-7d216f1f-2b67-477a-abe6-fe9af2459aea tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Image not found. Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d216f1f-2b67-477a-abe6-fe9af2459aea tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/images/35908e98-5205-43d5-ace9-7a8ff253606f HTTP/1.1 Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '35908e98-5205-43d5-ace9-7a8ff253606f'} Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 35908e98-5205-43d5-ace9-7a8ff253606f to delete Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 35908e98-5205-43d5-ace9-7a8ff253606f could not be found. Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:10.529880 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d216f1f-2b67-477a-abe6-fe9af2459aea tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:35:10.534030 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7d216f1f-2b67-477a-abe6-fe9af2459aea tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "DELETE /compute/v2.1/images/35908e98-5205-43d5-ace9-7a8ff253606f" status: 404 len: 62 microversion: 2.1 time: 0.089676 Jul 26 14:35:10.537358 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2386/4898] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:10 2022] DELETE /compute/v2.1/images/35908e98-5205-43d5-ace9-7a8ff253606f => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 26 14:35:10.541361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-547631ed-fa3b-4815-93ac-1a477afc97bc tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:10.541882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-547631ed-fa3b-4815-93ac-1a477afc97bc tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:10.563240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-547631ed-fa3b-4815-93ac-1a477afc97bc tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:10.564871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-547631ed-fa3b-4815-93ac-1a477afc97bc tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:10.565887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-547631ed-fa3b-4815-93ac-1a477afc97bc tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:10.567812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-547631ed-fa3b-4815-93ac-1a477afc97bc tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:10.591858 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-547631ed-fa3b-4815-93ac-1a477afc97bc tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-547631ed-fa3b-4815-93ac-1a477afc97bc tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 HTTP/1.1 Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '60cec85c-17f0-4c05-b18f-4ba8791cc737'} Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:35:10.614294 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.618691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-547631ed-fa3b-4815-93ac-1a477afc97bc tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 404 to user: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:35:10.620369 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-547631ed-fa3b-4815-93ac-1a477afc97bc tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "DELETE /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 404 len: 111 microversion: 2.1 time: 0.082588 Jul 26 14:35:10.625261 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2513/4899] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:35:10 2022] DELETE /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:35:10.630823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20dfa807-d5bf-4fde-a44c-36aa32099d70 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:10.631559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-20dfa807-d5bf-4fde-a44c-36aa32099d70 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: 60cec85c-17f0-4c05-b18f-4ba8791cc737] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:10.643635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20dfa807-d5bf-4fde-a44c-36aa32099d70 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:10.644232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20dfa807-d5bf-4fde-a44c-36aa32099d70 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:10.645285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20dfa807-d5bf-4fde-a44c-36aa32099d70 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:10.651370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20dfa807-d5bf-4fde-a44c-36aa32099d70 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:10.670337 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-20dfa807-d5bf-4fde-a44c-36aa32099d70 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20dfa807-d5bf-4fde-a44c-36aa32099d70 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 HTTP/1.1 Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '60cec85c-17f0-4c05-b18f-4ba8791cc737'} Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.672483 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20dfa807-d5bf-4fde-a44c-36aa32099d70 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 404 to user: Instance 60cec85c-17f0-4c05-b18f-4ba8791cc737 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-20dfa807-d5bf-4fde-a44c-36aa32099d70 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737" status: 404 len: 111 microversion: 2.1 time: 0.047817 Jul 26 14:35:10.676562 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2387/4900] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:10 2022] GET /compute/v2.1/servers/60cec85c-17f0-4c05-b18f-4ba8791cc737 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:35:10.684483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f5957b01-2177-40c4-9402-3be5a559a49b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '.version_select at 0x7f879937b430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:10.716940 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f5957b01-2177-40c4-9402-3be5a559a49b tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680067545" status: 202 len: 0 microversion: 2.1 time: 0.037199 Jul 26 14:35:10.721631 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2514/4901] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:35:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680067545 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:35:11.371035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-793eef82-5d9c-4dd7-8cb5-3b1515732ca3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:11.372587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-793eef82-5d9c-4dd7-8cb5-3b1515732ca3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:11.394228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-793eef82-5d9c-4dd7-8cb5-3b1515732ca3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:11.394970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-793eef82-5d9c-4dd7-8cb5-3b1515732ca3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:11.411059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-793eef82-5d9c-4dd7-8cb5-3b1515732ca3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:11.411538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-793eef82-5d9c-4dd7-8cb5-3b1515732ca3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:12.620466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-793eef82-5d9c-4dd7-8cb5-3b1515732ca3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:12.623190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:35:12.636391 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-793eef82-5d9c-4dd7-8cb5-3b1515732ca3 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1318 microversion: 2.1 time: 1.273018 Jul 26 14:35:12.653756 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2388/4902] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:11 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1318 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:13.483514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-0bab020a-948c-4a07-8590-534a1ae6fc61 req-646ab53c-bca2-4ff3-aa4e-f2e280f2ab61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6bbef22-d671-4268-b1d4-f85713b29d2b", "tag": "d9e98c88-bf0a-44c0-9703-6fc2f252e7ff"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:35:13.509692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0bab020a-948c-4a07-8590-534a1ae6fc61 req-646ab53c-bca2-4ff3-aa4e-f2e280f2ab61 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:13.510235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0bab020a-948c-4a07-8590-534a1ae6fc61 req-646ab53c-bca2-4ff3-aa4e-f2e280f2ab61 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:13.539664 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-0bab020a-948c-4a07-8590-534a1ae6fc61 req-646ab53c-bca2-4ff3-aa4e-f2e280f2ab61 service nova] Creating event network-changed:d9e98c88-bf0a-44c0-9703-6fc2f252e7ff for instance b6bbef22-d671-4268-b1d4-f85713b29d2b on n-h2-833090-9 Jul 26 14:35:13.558120 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-0bab020a-948c-4a07-8590-534a1ae6fc61 req-646ab53c-bca2-4ff3-aa4e-f2e280f2ab61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081645 Jul 26 14:35:13.560175 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2515/4903] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:35:13.672893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a7c9f882-9c0c-4cee-a8fc-4fd324fedb45 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:13.673705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a7c9f882-9c0c-4cee-a8fc-4fd324fedb45 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:13.684551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7c9f882-9c0c-4cee-a8fc-4fd324fedb45 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:13.688136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7c9f882-9c0c-4cee-a8fc-4fd324fedb45 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:13.689186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7c9f882-9c0c-4cee-a8fc-4fd324fedb45 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:13.690507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7c9f882-9c0c-4cee-a8fc-4fd324fedb45 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:14.436900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a7c9f882-9c0c-4cee-a8fc-4fd324fedb45 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:14.448297 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a7c9f882-9c0c-4cee-a8fc-4fd324fedb45 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1318 microversion: 2.1 time: 0.779616 Jul 26 14:35:14.453411 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2389/4904] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:13 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1318 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:15.474680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a7f58751-45d3-4076-b9d3-fd35d3bc7eae tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:15.475417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a7f58751-45d3-4076-b9d3-fd35d3bc7eae tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:15.491859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7f58751-45d3-4076-b9d3-fd35d3bc7eae tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:15.494325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7f58751-45d3-4076-b9d3-fd35d3bc7eae tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:15.495980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7f58751-45d3-4076-b9d3-fd35d3bc7eae tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:15.499259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7f58751-45d3-4076-b9d3-fd35d3bc7eae tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:15.513255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:35:16.091885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8be7cf9e-b2ee-4bec-950f-baade55fbae0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '.version_select at 0x7f87993b8ca0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:16.124654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:35:16.157106 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8be7cf9e-b2ee-4bec-950f-baade55fbae0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Image not found. Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8be7cf9e-b2ee-4bec-950f-baade55fbae0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/images/c0503b66-9c42-4a91-b1be-e9ddf1c336da HTTP/1.1 Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: exception: Image not found. Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c0503b66-9c42-4a91-b1be-e9ddf1c336da'} Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c0503b66-9c42-4a91-b1be-e9ddf1c336da to delete Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c0503b66-9c42-4a91-b1be-e9ddf1c336da could not be found. Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:16.174817 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 26 14:35:16.179226 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.183565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8be7cf9e-b2ee-4bec-950f-baade55fbae0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 404 to user: Image not found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:35:16.188624 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8be7cf9e-b2ee-4bec-950f-baade55fbae0 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "DELETE /compute/v2.1/images/c0503b66-9c42-4a91-b1be-e9ddf1c336da" status: 404 len: 62 microversion: 2.1 time: 0.105604 Jul 26 14:35:16.193907 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2390/4905] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:16 2022] DELETE /compute/v2.1/images/c0503b66-9c42-4a91-b1be-e9ddf1c336da => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:35:16.197325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:35:16.214456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-13b835ae-2a5f-4ddd-9481-c9ecf3b581c9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:16.215597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-13b835ae-2a5f-4ddd-9481-c9ecf3b581c9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:16.223057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13b835ae-2a5f-4ddd-9481-c9ecf3b581c9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:16.223765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13b835ae-2a5f-4ddd-9481-c9ecf3b581c9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:16.224811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13b835ae-2a5f-4ddd-9481-c9ecf3b581c9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:16.225470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13b835ae-2a5f-4ddd-9481-c9ecf3b581c9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:16.249491 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-13b835ae-2a5f-4ddd-9481-c9ecf3b581c9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-13b835ae-2a5f-4ddd-9481-c9ecf3b581c9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e HTTP/1.1 Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'fde8a26b-25d1-4cfa-93a1-9d697e5d395e'} Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:35:16.252113 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:35:16.255345 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.258409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-13b835ae-2a5f-4ddd-9481-c9ecf3b581c9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 404 to user: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:35:16.259611 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-13b835ae-2a5f-4ddd-9481-c9ecf3b581c9 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 404 len: 111 microversion: 2.1 time: 0.064377 Jul 26 14:35:16.260626 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2391/4906] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:35:16 2022] DELETE /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:35:16.271066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-13df097d-d256-40b9-91b3-401271209059 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:16.272695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-13df097d-d256-40b9-91b3-401271209059 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] [instance: fde8a26b-25d1-4cfa-93a1-9d697e5d395e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:16.281181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13df097d-d256-40b9-91b3-401271209059 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:16.281962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13df097d-d256-40b9-91b3-401271209059 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:16.282953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13df097d-d256-40b9-91b3-401271209059 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:16.283597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13df097d-d256-40b9-91b3-401271209059 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:16.302313 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-13df097d-d256-40b9-91b3-401271209059 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] HTTP exception thrown: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-13df097d-d256-40b9-91b3-401271209059 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Request method failure captured: Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e HTTP/1.1 Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_sc40PMplnRnQ0AJNOjiNFwJ5iTycrDhVzKy3gLiRe2ODdv01bhGxu7dExCr96etzLdzFsS3GWgHYLbo8Xhi3D3JZX5ZY-V56EDO0BrHSQYVGO06diYYnSu_DyZLJtdUrKQq2m0-lATfpkzfDuI4Ycbmz5KsDaM55gzj94ODaqHD9w Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8891372cf522401f83bd7e379abd4a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8891372cf522401f83bd7e379abd4a32", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8891372cf522401f83bd7e379abd4a32"}]}] Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 8891372cf522401f83bd7e379abd4a32 Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-612348320 Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 4cbd008c47a04847b8772b7f957bcd04 Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-612348320-project Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'fde8a26b-25d1-4cfa-93a1-9d697e5d395e'} Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.304595 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:35:16.307727 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.307727 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:35:16.307727 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:35:16.307727 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:35:16.307727 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:35:16.307727 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:35:16.307727 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. Jul 26 14:35:16.307727 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:35:16.310292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-13df097d-d256-40b9-91b3-401271209059 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] Returning 404 to user: Instance fde8a26b-25d1-4cfa-93a1-9d697e5d395e could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:35:16.311421 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-13df097d-d256-40b9-91b3-401271209059 tempest-ImagesOneServerNegativeTestJSON-612348320 tempest-ImagesOneServerNegativeTestJSON-612348320-project] 10.222.0.70 "GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e" status: 404 len: 111 microversion: 2.1 time: 0.046329 Jul 26 14:35:16.312795 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2392/4907] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:16 2022] GET /compute/v2.1/servers/fde8a26b-25d1-4cfa-93a1-9d697e5d395e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:35:16.358544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a7f58751-45d3-4076-b9d3-fd35d3bc7eae tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:16.368564 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a7f58751-45d3-4076-b9d3-fd35d3bc7eae tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1318 microversion: 2.1 time: 0.898648 Jul 26 14:35:16.380232 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2516/4908] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:15 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1318 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:17.444882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3f97b92-114b-4ced-8ef6-28a989044096 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:17.450096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f3f97b92-114b-4ced-8ef6-28a989044096 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:17.471411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3f97b92-114b-4ced-8ef6-28a989044096 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:17.472178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3f97b92-114b-4ced-8ef6-28a989044096 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:17.474706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3f97b92-114b-4ced-8ef6-28a989044096 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:17.475399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3f97b92-114b-4ced-8ef6-28a989044096 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:18.082360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f3f97b92-114b-4ced-8ef6-28a989044096 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:18.091378 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f3f97b92-114b-4ced-8ef6-28a989044096 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1318 microversion: 2.1 time: 0.692161 Jul 26 14:35:18.092356 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2393/4909] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:17 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1318 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:19.116414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ccc72684-e5ab-4ea5-abe2-98ee00b01c02 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:19.120364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ccc72684-e5ab-4ea5-abe2-98ee00b01c02 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:19.149685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:35:19.155133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccc72684-e5ab-4ea5-abe2-98ee00b01c02 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:19.156099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccc72684-e5ab-4ea5-abe2-98ee00b01c02 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:19.157949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccc72684-e5ab-4ea5-abe2-98ee00b01c02 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:19.158628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccc72684-e5ab-4ea5-abe2-98ee00b01c02 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:20.242025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ccc72684-e5ab-4ea5-abe2-98ee00b01c02 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:20.259917 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ccc72684-e5ab-4ea5-abe2-98ee00b01c02 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1318 microversion: 2.1 time: 1.148741 Jul 26 14:35:20.260661 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2517/4910] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:19 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1318 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:20.709062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-10bb4c1d-a1a4-4870-a26f-232a83a5925f req-d3789db1-169d-4555-b3b0-502d634d2202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bbef22-d671-4268-b1d4-f85713b29d2b", "name": "network-vif-plugged", "status": "completed", "tag": "d9e98c88-bf0a-44c0-9703-6fc2f252e7ff"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:35:20.733673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-10bb4c1d-a1a4-4870-a26f-232a83a5925f req-d3789db1-169d-4555-b3b0-502d634d2202 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:20.736426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-10bb4c1d-a1a4-4870-a26f-232a83a5925f req-d3789db1-169d-4555-b3b0-502d634d2202 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:20.778218 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-10bb4c1d-a1a4-4870-a26f-232a83a5925f req-d3789db1-169d-4555-b3b0-502d634d2202 service nova] Creating event network-vif-plugged:d9e98c88-bf0a-44c0-9703-6fc2f252e7ff for instance b6bbef22-d671-4268-b1d4-f85713b29d2b on n-h2-833090-9 Jul 26 14:35:20.786662 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-10bb4c1d-a1a4-4870-a26f-232a83a5925f req-d3789db1-169d-4555-b3b0-502d634d2202 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086387 Jul 26 14:35:20.787726 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2394/4911] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:35:21.282422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a8e71148-26db-4e39-96a2-a43d9d41bafc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:21.283043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a8e71148-26db-4e39-96a2-a43d9d41bafc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:21.293416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8e71148-26db-4e39-96a2-a43d9d41bafc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:21.294545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8e71148-26db-4e39-96a2-a43d9d41bafc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:21.295559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8e71148-26db-4e39-96a2-a43d9d41bafc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:21.299329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8e71148-26db-4e39-96a2-a43d9d41bafc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:21.905181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a8e71148-26db-4e39-96a2-a43d9d41bafc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:21.919719 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a8e71148-26db-4e39-96a2-a43d9d41bafc tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1318 microversion: 2.1 time: 0.640927 Jul 26 14:35:21.920979 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2518/4912] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:21 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:23.172476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8f95bb67-ac70-4d2e-b4ab-d0ae83c7038d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:35:23.172476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8f95bb67-ac70-4d2e-b4ab-d0ae83c7038d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:23.172476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f95bb67-ac70-4d2e-b4ab-d0ae83c7038d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:23.172476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f95bb67-ac70-4d2e-b4ab-d0ae83c7038d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:23.172476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f95bb67-ac70-4d2e-b4ab-d0ae83c7038d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:23.172476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f95bb67-ac70-4d2e-b4ab-d0ae83c7038d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:24.270374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8f95bb67-ac70-4d2e-b4ab-d0ae83c7038d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:35:24.285977 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8f95bb67-ac70-4d2e-b4ab-d0ae83c7038d tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1507 microversion: 2.1 time: 1.345707 Jul 26 14:35:24.288260 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2395/4913] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:35:22 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1507 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:35:24.308991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-440daade-cd6d-4f54-bf4f-8db2080c79d0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "180a3ee6-f0ac-4db0-9da9-09adadcf6d85", "device": "/dev/sdb"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:35:24.311679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-440daade-cd6d-4f54-bf4f-8db2080c79d0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:35:24.330935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-440daade-cd6d-4f54-bf4f-8db2080c79d0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:24.331190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-440daade-cd6d-4f54-bf4f-8db2080c79d0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:24.333556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-440daade-cd6d-4f54-bf4f-8db2080c79d0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:35:24.338593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-440daade-cd6d-4f54-bf4f-8db2080c79d0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:35:25.004863 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-440daade-cd6d-4f54-bf4f-8db2080c79d0 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "POST /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698498 Jul 26 14:35:25.027774 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2519/4914] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:35:24 2022] POST /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:35:59.708594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d673b2b-7542-4bbf-8d54-05faad6c72c5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Action: 'create', calling method: .version_select at 0x7f878705b670>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1083626827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYSeo7sVC6LSwJ7G70Dva9wXnGT4nR+tE7hK4iLwjzLYmdeWZo9oym6ISEA7cTQ33OwvpAG2fKFO5EOkgpMHrXeMS85tnEqKpZMM49B4kC3vXynm36hS+AzY9wX2/geFQ=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:35:59.730642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:35:59.745002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=25 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:35:59.775037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-4d673b2b-7542-4bbf-8d54-05faad6c72c5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Getting quotas for project 81c7b4c084a64c3cbc0a4422d8ae8f15. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:35:59.790501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-4d673b2b-7542-4bbf-8d54-05faad6c72c5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Getting quotas for user 6bafff185a894f20ba51b63a5617fa83 and project 81c7b4c084a64c3cbc0a4422d8ae8f15. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:35:59.824983 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d673b2b-7542-4bbf-8d54-05faad6c72c5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [d2f55996-37e8-4142-99a1-3c8f4d298bbc] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 14:36:00.834357 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d673b2b-7542-4bbf-8d54-05faad6c72c5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [d2f55996-37e8-4142-99a1-3c8f4d298bbc] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 52244. Jul 26 14:36:00.857233 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4d673b2b-7542-4bbf-8d54-05faad6c72c5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.155881 Jul 26 14:36:00.858379 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2396/4915] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:35:59 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:36:02.730929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cd49445c-1515-44e6-8061-4b77e4c06245 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:02.733025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cd49445c-1515-44e6-8061-4b77e4c06245 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:02.741752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:02.742726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:02.745870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd49445c-1515-44e6-8061-4b77e4c06245 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:02.746595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd49445c-1515-44e6-8061-4b77e4c06245 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:02.747635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd49445c-1515-44e6-8061-4b77e4c06245 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:02.748308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd49445c-1515-44e6-8061-4b77e4c06245 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:02.926973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-cd49445c-1515-44e6-8061-4b77e4c06245 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lazy-loading 'services' on Instance uuid b6bbef22-d671-4268-b1d4-f85713b29d2b {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:36:03.077762 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cd49445c-1515-44e6-8061-4b77e4c06245 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b/os-volume_attachments/180a3ee6-f0ac-4db0-9da9-09adadcf6d85" status: 202 len: 0 microversion: 2.1 time: 0.352652 Jul 26 14:36:03.078553 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2520/4916] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:36:02 2022] DELETE /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b/os-volume_attachments/180a3ee6-f0ac-4db0-9da9-09adadcf6d85 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:36:06.670286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1305334966", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3b6a6409-1272-4def-99c9-df82bb5d2adf", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1083626827", "security_groups": [{"name": "tempest-secgroup-smoke-211703068"}], "networks": [{"uuid": "782b0f39-3368-428d-8b4a-d522ddc1c634"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:06.918416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-db0276ee-5fce-49a7-8e19-f9ebbbfadd45 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f87993b8a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-693433899", "description": "tempest-description-2095071605"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:07.831602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] validate_networks() for [('782b0f39-3368-428d-8b4a-d522ddc1c634', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:36:08.964897 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-db0276ee-5fce-49a7-8e19-f9ebbbfadd45 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.330239 Jul 26 14:36:08.965518 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2397/4917] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:36:06 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:36:08.981435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e2bba0ed-9c64-4a86-b51c-8382ed7da4cc tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f8786d1af70>, body: {"security_group_rule": {"parent_group_id": "00d7f89f-f6ec-44cb-a4d6-9854858397d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:09.812651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:10.645014 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e2bba0ed-9c64-4a86-b51c-8382ed7da4cc tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.669391 Jul 26 14:36:10.653246 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2398/4918] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:36:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:36:10.658674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b54b6483-d38b-4575-87e5-f8ca5379a085 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f8786d08a60>, body: {"security_group_rule": {"parent_group_id": "00d7f89f-f6ec-44cb-a4d6-9854858397d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:10.846269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:10.866027 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b54b6483-d38b-4575-87e5-f8ca5379a085 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] HTTP exception thrown: This rule already exists in group 00d7f89f-f6ec-44cb-a4d6-9854858397d7 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b54b6483-d38b-4575-87e5-f8ca5379a085 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Request method failure captured: Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 138 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_vWBZFYAjqJiUPyBzmK_r_WkH-dl_RMNQoCPW7jWVEFHAOzbqNLwQ6GPIup3895vwqWxcD_v1MoFgniCqUuMjY8gD4ay4cQbrAJm9fjcGYZsKg536isjx90aSYr5ngfEuzs26xihGpQExojjL6TrDlISXcY4qmK3THOWLF-9cdkiz4 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a673ce2da79c40fe82c90ad1c83300fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}] Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 5598589de2974cee8e6c5a5d7872f3b0 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: {"security_group_rule": {"parent_group_id": "00d7f89f-f6ec-44cb-a4d6-9854858397d7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: exception: This rule already exists in group 00d7f89f-f6ec-44cb-a4d6-9854858397d7 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'security_group_rule': {'parent_group_id': '00d7f89f-f6ec-44cb-a4d6-9854858397d7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 00d7f89f-f6ec-44cb-a4d6-9854858397d7 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 00d7f89f-f6ec-44cb-a4d6-9854858397d7 Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:10.869495 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:10.874339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:36:10.874339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:36:10.874339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 00d7f89f-f6ec-44cb-a4d6-9854858397d7 Jul 26 14:36:10.874339 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:10.875781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b54b6483-d38b-4575-87e5-f8ca5379a085 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Returning 400 to user: This rule already exists in group 00d7f89f-f6ec-44cb-a4d6-9854858397d7 {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:36:10.876655 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b54b6483-d38b-4575-87e5-f8ca5379a085 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.221653 Jul 26 14:36:10.877961 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2399/4919] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:36:10 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:36:10.890271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4102a829-2b1e-4d68-9333-1314c3338942 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Calling method '.version_select at 0x7f878705b3a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:11.002888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:36:11.004236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:36:11.005923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:36:11.006548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:36:11.006986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:36:11.018847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:11.019629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:11.020815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:11.021423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:11.048202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Getting quotas for project 81c7b4c084a64c3cbc0a4422d8ae8f15. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:36:11.056362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Getting quotas for user 6bafff185a894f20ba51b63a5617fa83 and project 81c7b4c084a64c3cbc0a4422d8ae8f15. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:36:11.160765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:36:11.163206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b6a6409-1272-4def-99c9-df82bb5d2adf',volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:36:11.418756 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [3483da47-2347-4c3e-b342-6ede8a93bfbc] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 14:36:11.749858 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4102a829-2b1e-4d68-9333-1314c3338942 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/02d634e1-f97c-4fdf-9081-a666ebc432a0" status: 202 len: 0 microversion: 2.1 time: 0.867578 Jul 26 14:36:11.751357 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2400/4920] 10.222.0.70 () {58 vars in 1287 bytes} [Tue Jul 26 14:36:10 2022] DELETE /compute/v2.1/os-security-group-rules/02d634e1-f97c-4fdf-9081-a666ebc432a0 => generated 0 bytes in 870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:36:11.758614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a1b754c5-25e6-4cdf-a6a1-b6bdad212f3a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:11.759345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a1b754c5-25e6-4cdf-a6a1-b6bdad212f3a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:11.787869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1b754c5-25e6-4cdf-a6a1-b6bdad212f3a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:11.788698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1b754c5-25e6-4cdf-a6a1-b6bdad212f3a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:11.790040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1b754c5-25e6-4cdf-a6a1-b6bdad212f3a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:11.790747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1b754c5-25e6-4cdf-a6a1-b6bdad212f3a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:11.846314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a1b754c5-25e6-4cdf-a6a1-b6bdad212f3a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:36:12.048517 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a1b754c5-25e6-4cdf-a6a1-b6bdad212f3a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 204 len: 0 microversion: 2.1 time: 0.294170 Jul 26 14:36:12.051354 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2401/4921] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:36:11 2022] DELETE /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:36:12.062190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8152edc5-7ff4-4357-85dd-6396c269c88d tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f8799268040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1894863854", "description": "tempest-description-822339817"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:12.436369 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [3483da47-2347-4c3e-b342-6ede8a93bfbc] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 52492. Jul 26 14:36:12.445495 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df41dd2a-a5a2-43bb-81ce-febb3dff9469 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.784545 Jul 26 14:36:12.451180 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2521/4922] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:36:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 5791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:36:12.456373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7e92bb97-5ce6-4056-9893-d652122985f2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:12.457003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e92bb97-5ce6-4056-9893-d652122985f2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:12.487388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e92bb97-5ce6-4056-9893-d652122985f2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:12.487935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e92bb97-5ce6-4056-9893-d652122985f2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:12.492113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e92bb97-5ce6-4056-9893-d652122985f2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:12.493359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e92bb97-5ce6-4056-9893-d652122985f2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:12.830164 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8152edc5-7ff4-4357-85dd-6396c269c88d tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.775365 Jul 26 14:36:12.831284 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2402/4923] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:36:12 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:36:12.835465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aa2230ec-a492-40f0-8ee3-2b345afe30ba tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:12.836272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aa2230ec-a492-40f0-8ee3-2b345afe30ba tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:13.077757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aa2230ec-a492-40f0-8ee3-2b345afe30ba tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:13.093255 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aa2230ec-a492-40f0-8ee3-2b345afe30ba tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1099 microversion: 2.1 time: 0.259259 Jul 26 14:36:13.094218 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2403/4924] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:12 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1099 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:13.108780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d16f287a-a283-459c-87b9-a4fed33a801f tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f87878571f0>, body: {"security_group_rule": {"parent_group_id": "9d12fe20-6b44-457d-96a0-7dbb46e84493", "ip_protocol": "tcp", "from_port": 919115526, "to_port": 22}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:13.138542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7e92bb97-5ce6-4056-9893-d652122985f2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:13.178371 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7e92bb97-5ce6-4056-9893-d652122985f2 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1513 microversion: 2.1 time: 0.725841 Jul 26 14:36:13.179402 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2522/4925] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:12 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1513 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:13.282636 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d16f287a-a283-459c-87b9-a4fed33a801f tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] HTTP exception thrown: Invalid port range 919115526:22. Former value cannot be greater than the later Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d16f287a-a283-459c-87b9-a4fed33a801f tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Request method failure captured: Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 145 Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_vWBZFYAjqJiUPyBzmK_r_WkH-dl_RMNQoCPW7jWVEFHAOzbqNLwQ6GPIup3895vwqWxcD_v1MoFgniCqUuMjY8gD4ay4cQbrAJm9fjcGYZsKg536isjx90aSYr5ngfEuzs26xihGpQExojjL6TrDlISXcY4qmK3THOWLF-9cdkiz4 Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a673ce2da79c40fe82c90ad1c83300fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}] Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 5598589de2974cee8e6c5a5d7872f3b0 Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: {"security_group_rule": {"parent_group_id": "9d12fe20-6b44-457d-96a0-7dbb46e84493", "ip_protocol": "tcp", "from_port": 919115526, "to_port": 22}} Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid port range 919115526:22. Former value cannot be greater than the later Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9d12fe20-6b44-457d-96a0-7dbb46e84493', 'ip_protocol': 'tcp', 'from_port': 919115526, 'to_port': 22}}} Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 919115526:22. Former value cannot be greater than the later Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 919115526:22. Former value cannot be greater than the later Jul 26 14:36:13.285280 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:13.290141 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:13.290141 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:13.290141 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:13.290141 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:13.290141 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:13.290141 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:36:13.290141 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:36:13.290141 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 919115526:22. Former value cannot be greater than the later Jul 26 14:36:13.290141 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:13.295220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d16f287a-a283-459c-87b9-a4fed33a801f tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Returning 400 to user: Invalid port range 919115526:22. Former value cannot be greater than the later {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:36:13.297977 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d16f287a-a283-459c-87b9-a4fed33a801f tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.200729 Jul 26 14:36:13.299401 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2404/4926] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:36:13 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:36:13.311213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b7e708a9-9c24-4db9-9ff7-01e75dd9981b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f8799350790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-909825839", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:13.313145 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-b7e708a9-9c24-4db9-9ff7-01e75dd9981b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] HTTP exception thrown: Security group id should be uuid Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b7e708a9-9c24-4db9-9ff7-01e75dd9981b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Request method failure captured: Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 130 Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_vWBZFYAjqJiUPyBzmK_r_WkH-dl_RMNQoCPW7jWVEFHAOzbqNLwQ6GPIup3895vwqWxcD_v1MoFgniCqUuMjY8gD4ay4cQbrAJm9fjcGYZsKg536isjx90aSYr5ngfEuzs26xihGpQExojjL6TrDlISXcY4qmK3THOWLF-9cdkiz4 Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a673ce2da79c40fe82c90ad1c83300fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}] Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 5598589de2974cee8e6c5a5d7872f3b0 Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-909825839", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group id should be uuid Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-909825839', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:36:13.314935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:36:13.318542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 26 14:36:13.318542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:13.321026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b7e708a9-9c24-4db9-9ff7-01e75dd9981b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Returning 400 to user: Security group id should be uuid {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:36:13.321026 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b7e708a9-9c24-4db9-9ff7-01e75dd9981b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015708 Jul 26 14:36:13.321529 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2523/4927] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:36:13 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:36:13.331985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dd77b161-f618-4d54-8043-e1ff7edfee96 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f8786ff93a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-341510710", "description": "tempest-description-1724981963"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:14.120648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b0443459-07e6-40a5-a46a-2b3fcb6dfcfc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:14.121520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b0443459-07e6-40a5-a46a-2b3fcb6dfcfc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:14.142506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b0443459-07e6-40a5-a46a-2b3fcb6dfcfc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:14.143016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b0443459-07e6-40a5-a46a-2b3fcb6dfcfc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:14.146835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b0443459-07e6-40a5-a46a-2b3fcb6dfcfc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:14.147470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b0443459-07e6-40a5-a46a-2b3fcb6dfcfc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:14.277197 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dd77b161-f618-4d54-8043-e1ff7edfee96 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.949478 Jul 26 14:36:14.278691 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2405/4928] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:36:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:36:14.300733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9fd05a8-ec86-4e2f-9fc0-ca91c1e67b4c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:14.302163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d9fd05a8-ec86-4e2f-9fc0-ca91c1e67b4c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:14.330611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9fd05a8-ec86-4e2f-9fc0-ca91c1e67b4c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:14.332530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9fd05a8-ec86-4e2f-9fc0-ca91c1e67b4c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:14.334630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9fd05a8-ec86-4e2f-9fc0-ca91c1e67b4c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:14.336829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9fd05a8-ec86-4e2f-9fc0-ca91c1e67b4c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:14.643160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b0443459-07e6-40a5-a46a-2b3fcb6dfcfc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:14.666223 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b0443459-07e6-40a5-a46a-2b3fcb6dfcfc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1197 microversion: 2.1 time: 0.551788 Jul 26 14:36:14.707470 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2524/4929] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:14 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1197 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:36:14.715486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ec77b3d-f656-42ba-ad4f-e998df938020 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f8799350e50>, body: {"security_group_rule": {"parent_group_id": "a9b9976b-1f2c-4331-b867-698cc4d68250", "ip_protocol": "tempest-999-102479442", "from_port": 22, "to_port": 22}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:14.864484 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-2ec77b3d-f656-42ba-ad4f-e998df938020 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] HTTP exception thrown: Invalid IP protocol tempest-999-102479442. Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ec77b3d-f656-42ba-ad4f-e998df938020 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Request method failure captured: Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 156 Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_vWBZFYAjqJiUPyBzmK_r_WkH-dl_RMNQoCPW7jWVEFHAOzbqNLwQ6GPIup3895vwqWxcD_v1MoFgniCqUuMjY8gD4ay4cQbrAJm9fjcGYZsKg536isjx90aSYr5ngfEuzs26xihGpQExojjL6TrDlISXcY4qmK3THOWLF-9cdkiz4 Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a673ce2da79c40fe82c90ad1c83300fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}] Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 5598589de2974cee8e6c5a5d7872f3b0 Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: {"security_group_rule": {"parent_group_id": "a9b9976b-1f2c-4331-b867-698cc4d68250", "ip_protocol": "tempest-999-102479442", "from_port": 22, "to_port": 22}} Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid IP protocol tempest-999-102479442. Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a9b9976b-1f2c-4331-b867-698cc4d68250', 'ip_protocol': 'tempest-999-102479442', 'from_port': 22, 'to_port': 22}}} Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-102479442. Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-102479442. Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:14.866325 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:14.869877 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:14.869877 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:14.869877 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:14.869877 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:14.869877 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:36:14.869877 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:36:14.869877 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-102479442. Jul 26 14:36:14.869877 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:14.872642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ec77b3d-f656-42ba-ad4f-e998df938020 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Returning 400 to user: Invalid IP protocol tempest-999-102479442. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:36:14.873611 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ec77b3d-f656-42ba-ad4f-e998df938020 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.164922 Jul 26 14:36:14.874739 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2525/4930] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:36:14 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:36:14.890538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-824c85ef-e0a6-4d2a-b685-0ad4fc2a5371 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f87992431f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-886079995", "description": "tempest-description-511031834"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:15.987343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d9fd05a8-ec86-4e2f-9fc0-ca91c1e67b4c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:16.013453 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d9fd05a8-ec86-4e2f-9fc0-ca91c1e67b4c tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1513 microversion: 2.1 time: 1.724230 Jul 26 14:36:16.016979 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2406/4931] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:14 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1513 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:16.030700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e89aaf93-147e-463f-947e-4cb751f2039a tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:16.031673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e89aaf93-147e-463f-947e-4cb751f2039a tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:16.046279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e89aaf93-147e-463f-947e-4cb751f2039a tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:16.047163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e89aaf93-147e-463f-947e-4cb751f2039a tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:16.048481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e89aaf93-147e-463f-947e-4cb751f2039a tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:16.049440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e89aaf93-147e-463f-947e-4cb751f2039a tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:16.302452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e89aaf93-147e-463f-947e-4cb751f2039a tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:16.318628 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e89aaf93-147e-463f-947e-4cb751f2039a tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1215 microversion: 2.1 time: 0.297923 Jul 26 14:36:16.319533 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2407/4932] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:16 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1215 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:16.562839 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-824c85ef-e0a6-4d2a-b685-0ad4fc2a5371 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.683094 Jul 26 14:36:16.563887 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2526/4933] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:36:14 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:36:16.598566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f6955780-7a6b-49f3-9638-4eda3b260038 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f87870745e0>, body: {"security_group_rule": {"parent_group_id": "d9b292e5-1a1f-464a-ad6a-23c8f0407dc5", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:16.966189 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-f6955780-7a6b-49f3-9638-4eda3b260038 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f6955780-7a6b-49f3-9638-4eda3b260038 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Request method failure captured: Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 138 Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_vWBZFYAjqJiUPyBzmK_r_WkH-dl_RMNQoCPW7jWVEFHAOzbqNLwQ6GPIup3895vwqWxcD_v1MoFgniCqUuMjY8gD4ay4cQbrAJm9fjcGYZsKg536isjx90aSYr5ngfEuzs26xihGpQExojjL6TrDlISXcY4qmK3THOWLF-9cdkiz4 Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a673ce2da79c40fe82c90ad1c83300fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}] Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 5598589de2974cee8e6c5a5d7872f3b0 Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: {"security_group_rule": {"parent_group_id": "d9b292e5-1a1f-464a-ad6a-23c8f0407dc5", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd9b292e5-1a1f-464a-ad6a-23c8f0407dc5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 14:36:16.968179 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f6955780-7a6b-49f3-9638-4eda3b260038 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f6955780-7a6b-49f3-9638-4eda3b260038 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.393349 Jul 26 14:36:16.972770 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2408/4934] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:36:16 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 398 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:36:16.982606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6304cee9-5183-4405-b753-bb09d1fb566e tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f8799350040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1746329237", "description": "tempest-description-785185832"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:17.044465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0968579b-6223-44c4-9e5a-447ce98e7af7 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:17.045103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0968579b-6223-44c4-9e5a-447ce98e7af7 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:17.067150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0968579b-6223-44c4-9e5a-447ce98e7af7 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:17.068715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0968579b-6223-44c4-9e5a-447ce98e7af7 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:17.074003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0968579b-6223-44c4-9e5a-447ce98e7af7 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:17.076950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0968579b-6223-44c4-9e5a-447ce98e7af7 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:17.232680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0968579b-6223-44c4-9e5a-447ce98e7af7 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:17.253307 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0968579b-6223-44c4-9e5a-447ce98e7af7 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1471 microversion: 2.1 time: 0.208317 Jul 26 14:36:17.254002 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2409/4935] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:17 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:36:17.358205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5180ac28-1bc0-4808-b9cc-1163b9c835f6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:17.366200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5180ac28-1bc0-4808-b9cc-1163b9c835f6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:17.401553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5180ac28-1bc0-4808-b9cc-1163b9c835f6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:17.402828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5180ac28-1bc0-4808-b9cc-1163b9c835f6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:17.407778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5180ac28-1bc0-4808-b9cc-1163b9c835f6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:17.410615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5180ac28-1bc0-4808-b9cc-1163b9c835f6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:17.994077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5180ac28-1bc0-4808-b9cc-1163b9c835f6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:18.011060 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5180ac28-1bc0-4808-b9cc-1163b9c835f6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1215 microversion: 2.1 time: 0.669148 Jul 26 14:36:18.020828 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2410/4936] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:17 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1215 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:36:18.027134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3149f206-7c15-48db-9569-4afdcb590a0b req-d5a861be-fcf1-4660-8b6c-70be118e7953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bbef22-d671-4268-b1d4-f85713b29d2b", "name": "network-vif-deleted", "tag": "d9e98c88-bf0a-44c0-9703-6fc2f252e7ff"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:18.065050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3149f206-7c15-48db-9569-4afdcb590a0b req-d5a861be-fcf1-4660-8b6c-70be118e7953 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:18.066213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3149f206-7c15-48db-9569-4afdcb590a0b req-d5a861be-fcf1-4660-8b6c-70be118e7953 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:18.079738 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3149f206-7c15-48db-9569-4afdcb590a0b req-d5a861be-fcf1-4660-8b6c-70be118e7953 service nova] Creating event network-vif-deleted:d9e98c88-bf0a-44c0-9703-6fc2f252e7ff for instance b6bbef22-d671-4268-b1d4-f85713b29d2b on n-h2-833090-9 Jul 26 14:36:18.099633 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3149f206-7c15-48db-9569-4afdcb590a0b req-d5a861be-fcf1-4660-8b6c-70be118e7953 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075961 Jul 26 14:36:18.100960 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2411/4937] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:36:18.133957 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6304cee9-5183-4405-b753-bb09d1fb566e tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.156313 Jul 26 14:36:18.136074 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2527/4938] 10.222.0.70 () {60 vars in 1180 bytes} [Tue Jul 26 14:36:16 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:36:18.150639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-889d9968-6033-4841-8907-b83fd01a9f14 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f8786d2c3a0>, body: {"security_group_rule": {"parent_group_id": "29ba69b8-7cdf-48a3-9474-167bb1dae6df", "ip_protocol": "tcp", "from_port": 22, "to_port": 953199069}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:18.277485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:18.278043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:18.290789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:18.291194 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-889d9968-6033-4841-8907-b83fd01a9f14 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] HTTP exception thrown: Invalid port range 22:953199069. Valid TCP ports should be between 1-65535 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-889d9968-6033-4841-8907-b83fd01a9f14 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Request method failure captured: Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 145 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_vWBZFYAjqJiUPyBzmK_r_WkH-dl_RMNQoCPW7jWVEFHAOzbqNLwQ6GPIup3895vwqWxcD_v1MoFgniCqUuMjY8gD4ay4cQbrAJm9fjcGYZsKg536isjx90aSYr5ngfEuzs26xihGpQExojjL6TrDlISXcY4qmK3THOWLF-9cdkiz4 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a673ce2da79c40fe82c90ad1c83300fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}] Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 5598589de2974cee8e6c5a5d7872f3b0 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: {"security_group_rule": {"parent_group_id": "29ba69b8-7cdf-48a3-9474-167bb1dae6df", "ip_protocol": "tcp", "from_port": 22, "to_port": 953199069}} Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid port range 22:953199069. Valid TCP ports should be between 1-65535 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'security_group_rule': {'parent_group_id': '29ba69b8-7cdf-48a3-9474-167bb1dae6df', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 953199069}}} Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:953199069. Valid TCP ports should be between 1-65535 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:953199069. Valid TCP ports should be between 1-65535 Jul 26 14:36:18.293531 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.297667 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:18.297667 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.297667 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.297667 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:18.297667 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:18.297667 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:36:18.297667 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:36:18.297667 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:953199069. Valid TCP ports should be between 1-65535 Jul 26 14:36:18.297667 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.298515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:18.299248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-889d9968-6033-4841-8907-b83fd01a9f14 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Returning 400 to user: Invalid port range 22:953199069. Valid TCP ports should be between 1-65535 {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:36:18.299567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:18.300077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:18.300714 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-889d9968-6033-4841-8907-b83fd01a9f14 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.154974 Jul 26 14:36:18.301763 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2412/4939] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:36:18 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:36:18.311640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84fcced7-ad77-480d-8192-b83444cb1b28 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Action: 'create', calling method: .version_select at 0x7f8787074670>, body: {"security_group_rule": {"parent_group_id": "c99baeb9-e2f1-4618-9751-6f0d141e5e9a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:18.375652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:18.380129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:18.380951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lazy-loading 'fault' on Instance uuid b6bbef22-d671-4268-b1d4-f85713b29d2b {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:36:18.425846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-84fcced7-ad77-480d-8192-b83444cb1b28 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c99baeb9-e2f1-4618-9751-6f0d141e5e9a does not exist", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:36:18.426451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.security_group_api [None req-84fcced7-ad77-480d-8192-b83444cb1b28 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Neutron security group c99baeb9-e2f1-4618-9751-6f0d141e5e9a not found {{(pid=119478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:36:18.426977 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-84fcced7-ad77-480d-8192-b83444cb1b28 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] HTTP exception thrown: Security group c99baeb9-e2f1-4618-9751-6f0d141e5e9a does not exist Jul 26 14:36:18.426977 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-deaa3ed3-aee8-4253-a493-58629dfab215'] Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84fcced7-ad77-480d-8192-b83444cb1b28 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Request method failure captured: Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 138 Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_vWBZFYAjqJiUPyBzmK_r_WkH-dl_RMNQoCPW7jWVEFHAOzbqNLwQ6GPIup3895vwqWxcD_v1MoFgniCqUuMjY8gD4ay4cQbrAJm9fjcGYZsKg536isjx90aSYr5ngfEuzs26xihGpQExojjL6TrDlISXcY4qmK3THOWLF-9cdkiz4 Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a673ce2da79c40fe82c90ad1c83300fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}] Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 5598589de2974cee8e6c5a5d7872f3b0 Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: {"security_group_rule": {"parent_group_id": "c99baeb9-e2f1-4618-9751-6f0d141e5e9a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: exception: Security group c99baeb9-e2f1-4618-9751-6f0d141e5e9a does not exist Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-deaa3ed3-aee8-4253-a493-58629dfab215'] Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c99baeb9-e2f1-4618-9751-6f0d141e5e9a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:36:18.428891 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c99baeb9-e2f1-4618-9751-6f0d141e5e9a does not exist Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deaa3ed3-aee8-4253-a493-58629dfab215'] Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c99baeb9-e2f1-4618-9751-6f0d141e5e9a does not exist Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deaa3ed3-aee8-4253-a493-58629dfab215'] Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c99baeb9-e2f1-4618-9751-6f0d141e5e9a does not exist Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deaa3ed3-aee8-4253-a493-58629dfab215'] Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c99baeb9-e2f1-4618-9751-6f0d141e5e9a does not exist Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-deaa3ed3-aee8-4253-a493-58629dfab215'] Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84fcced7-ad77-480d-8192-b83444cb1b28 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Returning 404 to user: Security group c99baeb9-e2f1-4618-9751-6f0d141e5e9a does not exist Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-deaa3ed3-aee8-4253-a493-58629dfab215'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:36:18.434241 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-84fcced7-ad77-480d-8192-b83444cb1b28 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.123164 Jul 26 14:36:18.437480 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2413/4940] 10.222.0.70 () {60 vars in 1195 bytes} [Tue Jul 26 14:36:18 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:36:18.447054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-565ae411-c2cb-4ade-8082-f8c3eca4409b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Calling method '.version_select at 0x7f87993b8310>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:18.491849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe09966a2dd345b88b12944bf831bf0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd529458cb14838a52bb97042910a73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:18.508968 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7e35553c-c523-4517-83f3-10ef621a510a tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 200 len: 1308 microversion: 2.1 time: 0.236045 Jul 26 14:36:18.510127 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2528/4941] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:18 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:18.510412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-565ae411-c2cb-4ade-8082-f8c3eca4409b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule db3aa3e7-a084-4a49-9db1-7277d40e8ae4 does not exist", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:36:18.511021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.security_group_api [None req-565ae411-c2cb-4ade-8082-f8c3eca4409b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Neutron security group rule db3aa3e7-a084-4a49-9db1-7277d40e8ae4 not found {{(pid=119478) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 26 14:36:18.511544 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-565ae411-c2cb-4ade-8082-f8c3eca4409b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] HTTP exception thrown: Security group rule db3aa3e7-a084-4a49-9db1-7277d40e8ae4 does not exist Jul 26 14:36:18.511544 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-f89c3c08-f8bc-4d5e-a18c-77633aecd003'] Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-565ae411-c2cb-4ade-8082-f8c3eca4409b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Request method failure captured: Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-security-group-rules/db3aa3e7-a084-4a49-9db1-7277d40e8ae4 HTTP/1.1 Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_vWBZFYAjqJiUPyBzmK_r_WkH-dl_RMNQoCPW7jWVEFHAOzbqNLwQ6GPIup3895vwqWxcD_v1MoFgniCqUuMjY8gD4ay4cQbrAJm9fjcGYZsKg536isjx90aSYr5ngfEuzs26xihGpQExojjL6TrDlISXcY4qmK3THOWLF-9cdkiz4 Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a673ce2da79c40fe82c90ad1c83300fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a673ce2da79c40fe82c90ad1c83300fd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a673ce2da79c40fe82c90ad1c83300fd"}]}] Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: a673ce2da79c40fe82c90ad1c83300fd Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681 Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 5598589de2974cee8e6c5a5d7872f3b0 Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: exception: Security group rule db3aa3e7-a084-4a49-9db1-7277d40e8ae4 does not exist Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-f89c3c08-f8bc-4d5e-a18c-77633aecd003'] Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'db3aa3e7-a084-4a49-9db1-7277d40e8ae4'} Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:36:18.513439 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule db3aa3e7-a084-4a49-9db1-7277d40e8ae4 does not exist Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f89c3c08-f8bc-4d5e-a18c-77633aecd003'] Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule db3aa3e7-a084-4a49-9db1-7277d40e8ae4 does not exist Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f89c3c08-f8bc-4d5e-a18c-77633aecd003'] Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule db3aa3e7-a084-4a49-9db1-7277d40e8ae4 does not exist Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f89c3c08-f8bc-4d5e-a18c-77633aecd003'] Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule db3aa3e7-a084-4a49-9db1-7277d40e8ae4 does not exist Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f89c3c08-f8bc-4d5e-a18c-77633aecd003'] Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-565ae411-c2cb-4ade-8082-f8c3eca4409b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Returning 404 to user: Security group rule db3aa3e7-a084-4a49-9db1-7277d40e8ae4 does not exist Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-f89c3c08-f8bc-4d5e-a18c-77633aecd003'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-565ae411-c2cb-4ade-8082-f8c3eca4409b tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/db3aa3e7-a084-4a49-9db1-7277d40e8ae4" status: 404 len: 199 microversion: 2.1 time: 0.077227 Jul 26 14:36:18.517460 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2414/4942] 10.222.0.70 () {58 vars in 1287 bytes} [Tue Jul 26 14:36:18 2022] DELETE /compute/v2.1/os-security-group-rules/db3aa3e7-a084-4a49-9db1-7277d40e8ae4 => generated 199 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:36:18.535915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-54a81d30-d690-480f-a29a-5d90dfd4a9bc tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Calling method '.version_select at 0x7f879938fee0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:19.065550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ceaeb41-3553-4dc0-98f4-083f2fe0c752 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:19.066313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ceaeb41-3553-4dc0-98f4-083f2fe0c752 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:19.079603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ceaeb41-3553-4dc0-98f4-083f2fe0c752 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:19.080108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ceaeb41-3553-4dc0-98f4-083f2fe0c752 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:19.082060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ceaeb41-3553-4dc0-98f4-083f2fe0c752 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:19.085061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ceaeb41-3553-4dc0-98f4-083f2fe0c752 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:20.330572 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-54a81d30-d690-480f-a29a-5d90dfd4a9bc tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/29ba69b8-7cdf-48a3-9474-167bb1dae6df" status: 202 len: 0 microversion: 2.1 time: 1.805252 Jul 26 14:36:20.332148 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2529/4943] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:36:18 2022] DELETE /compute/v2.1/os-security-groups/29ba69b8-7cdf-48a3-9474-167bb1dae6df => generated 0 bytes in 1807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:36:20.337346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cc39bba1-7093-42cc-80a2-0d06c38da359 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:20.339936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cc39bba1-7093-42cc-80a2-0d06c38da359 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] [instance: b6bbef22-d671-4268-b1d4-f85713b29d2b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:20.363814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc39bba1-7093-42cc-80a2-0d06c38da359 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:20.364635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8ceaeb41-3553-4dc0-98f4-083f2fe0c752 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:20.365541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc39bba1-7093-42cc-80a2-0d06c38da359 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:20.366521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc39bba1-7093-42cc-80a2-0d06c38da359 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:20.382477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc39bba1-7093-42cc-80a2-0d06c38da359 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:20.385460 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ceaeb41-3553-4dc0-98f4-083f2fe0c752 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1282 microversion: 2.1 time: 1.339613 Jul 26 14:36:20.389884 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2415/4944] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:19 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1282 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:20.411462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-653782b4-4190-4390-82c4-64c4afeb07c7 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Calling method '.version_select at 0x7f87993b8c10>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:20.415320 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-cc39bba1-7093-42cc-80a2-0d06c38da359 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] HTTP exception thrown: Instance b6bbef22-d671-4268-b1d4-f85713b29d2b could not be found. Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cc39bba1-7093-42cc-80a2-0d06c38da359 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Request method failure captured: Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b HTTP/1.1 Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_qgtj99AoKwNyGqVh45GZ7B_avOYKmEtudjJVeguKPZegC0wCz_c1p3gfCsDWVdU9IaSBIUaawvs5ac3iedUB6pdK2B6b-iKdaGGFHzrjkPp_OTEOlHwn0PxZAUDpWPkW8MZbBAI3t1ahJF4Zb1pffF6eXY9B-hwnvOuKanBjfsFes Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 1bd529458cb14838a52bb97042910a73 Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesSnapshotTestJSON-131664859 Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1bd529458cb14838a52bb97042910a73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1bd529458cb14838a52bb97042910a73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1bd529458cb14838a52bb97042910a73", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1bd529458cb14838a52bb97042910a73"}]}] Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesSnapshotTestJSON-131664859 Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 1bd529458cb14838a52bb97042910a73 Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-131664859 Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesSnapshotTestJSON-131664859-project Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: fe09966a2dd345b88b12944bf831bf0c Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesSnapshotTestJSON-131664859-project Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance b6bbef22-d671-4268-b1d4-f85713b29d2b could not be found. Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'b6bbef22-d671-4268-b1d4-f85713b29d2b'} Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6bbef22-d671-4268-b1d4-f85713b29d2b could not be found. Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6bbef22-d671-4268-b1d4-f85713b29d2b could not be found. Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:36:20.417705 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:20.423456 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:36:20.423456 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:36:20.423456 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:36:20.423456 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:36:20.423456 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:36:20.423456 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6bbef22-d671-4268-b1d4-f85713b29d2b could not be found. Jul 26 14:36:20.423456 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:36:20.423456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cc39bba1-7093-42cc-80a2-0d06c38da359 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] Returning 404 to user: Instance b6bbef22-d671-4268-b1d4-f85713b29d2b could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:36:20.423456 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cc39bba1-7093-42cc-80a2-0d06c38da359 tempest-VolumesSnapshotTestJSON-131664859 tempest-VolumesSnapshotTestJSON-131664859-project] 10.222.0.70 "GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b" status: 404 len: 111 microversion: 2.1 time: 0.086426 Jul 26 14:36:20.423456 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2530/4945] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:20 2022] GET /compute/v2.1/servers/b6bbef22-d671-4268-b1d4-f85713b29d2b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:36:21.404646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:21.406794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:21.411669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-008a9918-293e-484d-af99-88da1da37a6b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:21.412300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-008a9918-293e-484d-af99-88da1da37a6b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:21.441723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-008a9918-293e-484d-af99-88da1da37a6b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:21.442538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-008a9918-293e-484d-af99-88da1da37a6b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:21.443624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-008a9918-293e-484d-af99-88da1da37a6b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:21.444574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-008a9918-293e-484d-af99-88da1da37a6b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:21.451422 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-653782b4-4190-4390-82c4-64c4afeb07c7 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/d9b292e5-1a1f-464a-ad6a-23c8f0407dc5" status: 202 len: 0 microversion: 2.1 time: 1.059324 Jul 26 14:36:21.453478 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2416/4946] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:36:20 2022] DELETE /compute/v2.1/os-security-groups/d9b292e5-1a1f-464a-ad6a-23c8f0407dc5 => generated 0 bytes in 1062 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:36:21.462198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-08f654b9-d232-4370-b6b5-8eb7934938f3 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Calling method '.version_select at 0x7f878705bb80>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:22.099715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-008a9918-293e-484d-af99-88da1da37a6b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:22.110396 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-008a9918-293e-484d-af99-88da1da37a6b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1282 microversion: 2.1 time: 0.706579 Jul 26 14:36:22.120840 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2531/4947] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:21 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1282 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:22.194044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f6bb6ca5-0636-419a-a8c7-194ece3ef56f req-f24f25c2-5188-481e-b3e0-5bc653696db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872dc503-096d-43b3-8297-8c0a426cf057", "tag": "b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:22.213200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f6bb6ca5-0636-419a-a8c7-194ece3ef56f req-f24f25c2-5188-481e-b3e0-5bc653696db9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:22.219019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f6bb6ca5-0636-419a-a8c7-194ece3ef56f req-f24f25c2-5188-481e-b3e0-5bc653696db9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:22.245008 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f6bb6ca5-0636-419a-a8c7-194ece3ef56f req-f24f25c2-5188-481e-b3e0-5bc653696db9 service nova] Creating event network-changed:b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8 for instance 872dc503-096d-43b3-8297-8c0a426cf057 on n-h1-833090-9 Jul 26 14:36:22.253352 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f6bb6ca5-0636-419a-a8c7-194ece3ef56f req-f24f25c2-5188-481e-b3e0-5bc653696db9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063321 Jul 26 14:36:22.257279 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2532/4948] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:36:22.664633 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-08f654b9-d232-4370-b6b5-8eb7934938f3 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/a9b9976b-1f2c-4331-b867-698cc4d68250" status: 202 len: 0 microversion: 2.1 time: 1.206887 Jul 26 14:36:22.668241 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2417/4949] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:36:21 2022] DELETE /compute/v2.1/os-security-groups/a9b9976b-1f2c-4331-b867-698cc4d68250 => generated 0 bytes in 1210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:36:22.677615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7f1fe7d4-2264-4fbb-87d7-b42890eb72ed tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Calling method '.version_select at 0x7f879945a550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:23.140131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:23.152413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b05d909d-aa25-4562-a2ba-e357e9502ffd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:23.153374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b05d909d-aa25-4562-a2ba-e357e9502ffd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:23.162710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b05d909d-aa25-4562-a2ba-e357e9502ffd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:23.163451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b05d909d-aa25-4562-a2ba-e357e9502ffd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:23.165341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b05d909d-aa25-4562-a2ba-e357e9502ffd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:23.166000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b05d909d-aa25-4562-a2ba-e357e9502ffd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:24.069417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b05d909d-aa25-4562-a2ba-e357e9502ffd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:24.089279 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b05d909d-aa25-4562-a2ba-e357e9502ffd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1270 microversion: 2.1 time: 0.948481 Jul 26 14:36:24.091979 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2418/4950] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:23 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1270 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:24.144170 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7f1fe7d4-2264-4fbb-87d7-b42890eb72ed tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/9d12fe20-6b44-457d-96a0-7dbb46e84493" status: 202 len: 0 microversion: 2.1 time: 1.472374 Jul 26 14:36:24.144825 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2533/4951] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:36:22 2022] DELETE /compute/v2.1/os-security-groups/9d12fe20-6b44-457d-96a0-7dbb46e84493 => generated 0 bytes in 1474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:36:24.165177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-35573141-f8df-4fcb-8d45-9940c21d82c0 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] Calling method '.version_select at 0x7f8787e80940>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:25.070832 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-35573141-f8df-4fcb-8d45-9940c21d82c0 tempest-SecurityGroupRulesNegativeTestJSON-1907595681 tempest-SecurityGroupRulesNegativeTestJSON-1907595681-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/00d7f89f-f6ec-44cb-a4d6-9854858397d7" status: 202 len: 0 microversion: 2.1 time: 0.919994 Jul 26 14:36:25.075116 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2419/4952] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:36:24 2022] DELETE /compute/v2.1/os-security-groups/00d7f89f-f6ec-44cb-a4d6-9854858397d7 => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:36:25.120437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af5936b4-2deb-4d86-905a-dfa6d28dcebe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:25.121393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af5936b4-2deb-4d86-905a-dfa6d28dcebe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:25.138534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af5936b4-2deb-4d86-905a-dfa6d28dcebe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:25.139007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af5936b4-2deb-4d86-905a-dfa6d28dcebe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:25.140075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af5936b4-2deb-4d86-905a-dfa6d28dcebe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:25.141124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af5936b4-2deb-4d86-905a-dfa6d28dcebe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:25.717878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af5936b4-2deb-4d86-905a-dfa6d28dcebe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:25.727036 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af5936b4-2deb-4d86-905a-dfa6d28dcebe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1270 microversion: 2.1 time: 0.612756 Jul 26 14:36:25.732477 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2534/4953] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:25 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1270 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:26.753985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce3f66a1-b9c9-4958-b00e-6bde7bc22520 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:26.754626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce3f66a1-b9c9-4958-b00e-6bde7bc22520 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:26.773550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce3f66a1-b9c9-4958-b00e-6bde7bc22520 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:26.774304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce3f66a1-b9c9-4958-b00e-6bde7bc22520 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:26.775121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce3f66a1-b9c9-4958-b00e-6bde7bc22520 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:26.775562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce3f66a1-b9c9-4958-b00e-6bde7bc22520 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:27.525639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ce3f66a1-b9c9-4958-b00e-6bde7bc22520 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:27.536777 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce3f66a1-b9c9-4958-b00e-6bde7bc22520 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1270 microversion: 2.1 time: 0.787766 Jul 26 14:36:27.537406 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2420/4954] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:26 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1270 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:28.559105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e3c44c5c-0192-4965-924f-bd93565a7905 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:28.559959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e3c44c5c-0192-4965-924f-bd93565a7905 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:28.577797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3c44c5c-0192-4965-924f-bd93565a7905 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:28.578473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3c44c5c-0192-4965-924f-bd93565a7905 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:28.579553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3c44c5c-0192-4965-924f-bd93565a7905 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:28.581751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3c44c5c-0192-4965-924f-bd93565a7905 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:29.210165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e3c44c5c-0192-4965-924f-bd93565a7905 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:29.224258 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e3c44c5c-0192-4965-924f-bd93565a7905 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1270 microversion: 2.1 time: 0.670182 Jul 26 14:36:29.238037 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2535/4955] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:28 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1270 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:30.246742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f2003337-1b6e-4a18-b370-a5cae7c3b3fc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:30.248165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f2003337-1b6e-4a18-b370-a5cae7c3b3fc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:30.271665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2003337-1b6e-4a18-b370-a5cae7c3b3fc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:30.272581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2003337-1b6e-4a18-b370-a5cae7c3b3fc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:30.279368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2003337-1b6e-4a18-b370-a5cae7c3b3fc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:30.282098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2003337-1b6e-4a18-b370-a5cae7c3b3fc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:31.199771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f2003337-1b6e-4a18-b370-a5cae7c3b3fc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:31.223893 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f2003337-1b6e-4a18-b370-a5cae7c3b3fc tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1270 microversion: 2.1 time: 0.982228 Jul 26 14:36:31.229068 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2421/4956] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:30 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1270 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:32.249685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85f3ad2a-bc15-470a-83f3-f0295ce5af8f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:32.250723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85f3ad2a-bc15-470a-83f3-f0295ce5af8f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:32.264248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f3ad2a-bc15-470a-83f3-f0295ce5af8f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:32.266261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f3ad2a-bc15-470a-83f3-f0295ce5af8f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:32.267087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f3ad2a-bc15-470a-83f3-f0295ce5af8f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:32.267530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85f3ad2a-bc15-470a-83f3-f0295ce5af8f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:33.349540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-85f3ad2a-bc15-470a-83f3-f0295ce5af8f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:33.355047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:33.368292 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85f3ad2a-bc15-470a-83f3-f0295ce5af8f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1270 microversion: 2.1 time: 1.122575 Jul 26 14:36:33.375145 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2536/4957] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:32 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1270 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:34.405658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1e2a8c3c-b2d8-4534-ae39-fa4997bcdfda tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:34.406996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1e2a8c3c-b2d8-4534-ae39-fa4997bcdfda tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:34.427579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e2a8c3c-b2d8-4534-ae39-fa4997bcdfda tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:34.428061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e2a8c3c-b2d8-4534-ae39-fa4997bcdfda tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:34.431258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e2a8c3c-b2d8-4534-ae39-fa4997bcdfda tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:34.438687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e2a8c3c-b2d8-4534-ae39-fa4997bcdfda tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:35.198925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1e2a8c3c-b2d8-4534-ae39-fa4997bcdfda tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:35.208021 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1e2a8c3c-b2d8-4534-ae39-fa4997bcdfda tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1270 microversion: 2.1 time: 0.807358 Jul 26 14:36:35.219993 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2422/4958] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:34 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1270 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:36.261522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba897281-3a52-4b12-9785-0d5867cb9ee6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:36.261522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba897281-3a52-4b12-9785-0d5867cb9ee6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:36.298534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:36.333500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba897281-3a52-4b12-9785-0d5867cb9ee6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:36.334967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba897281-3a52-4b12-9785-0d5867cb9ee6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:36.340530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba897281-3a52-4b12-9785-0d5867cb9ee6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:36.342761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba897281-3a52-4b12-9785-0d5867cb9ee6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:37.125122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba897281-3a52-4b12-9785-0d5867cb9ee6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:37.140211 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba897281-3a52-4b12-9785-0d5867cb9ee6 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1270 microversion: 2.1 time: 0.893850 Jul 26 14:36:37.143011 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2537/4959] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:36 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1270 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:37.739429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ca5ca748-1a62-4f85-bd06-4fd03cc39ca1 req-a29f0886-5615-4556-8990-362410d4247c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872dc503-096d-43b3-8297-8c0a426cf057", "name": "network-vif-plugged", "status": "completed", "tag": "b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:37.777701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ca5ca748-1a62-4f85-bd06-4fd03cc39ca1 req-a29f0886-5615-4556-8990-362410d4247c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:37.780291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ca5ca748-1a62-4f85-bd06-4fd03cc39ca1 req-a29f0886-5615-4556-8990-362410d4247c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:37.821373 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ca5ca748-1a62-4f85-bd06-4fd03cc39ca1 req-a29f0886-5615-4556-8990-362410d4247c service nova] Creating event network-vif-plugged:b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8 for instance 872dc503-096d-43b3-8297-8c0a426cf057 on n-h1-833090-9 Jul 26 14:36:37.839899 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ca5ca748-1a62-4f85-bd06-4fd03cc39ca1 req-a29f0886-5615-4556-8990-362410d4247c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105369 Jul 26 14:36:37.850746 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2423/4960] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:36:38.168401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7be448d5-83b3-4470-9456-6cd4873db8e5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:38.169735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7be448d5-83b3-4470-9456-6cd4873db8e5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:38.184801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7be448d5-83b3-4470-9456-6cd4873db8e5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:38.186305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7be448d5-83b3-4470-9456-6cd4873db8e5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:38.187292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7be448d5-83b3-4470-9456-6cd4873db8e5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:38.187920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7be448d5-83b3-4470-9456-6cd4873db8e5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:38.751701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7be448d5-83b3-4470-9456-6cd4873db8e5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:38.767740 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7be448d5-83b3-4470-9456-6cd4873db8e5 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1270 microversion: 2.1 time: 0.603910 Jul 26 14:36:38.780348 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2538/4961] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:38 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1270 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:39.793114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-657988ab-ef42-4522-b305-5b9d2fab14c3 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:39.794529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-657988ab-ef42-4522-b305-5b9d2fab14c3 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:39.828994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-657988ab-ef42-4522-b305-5b9d2fab14c3 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:39.829449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-657988ab-ef42-4522-b305-5b9d2fab14c3 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:39.840481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-657988ab-ef42-4522-b305-5b9d2fab14c3 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:39.840929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-657988ab-ef42-4522-b305-5b9d2fab14c3 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:39.847070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:40.598146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-657988ab-ef42-4522-b305-5b9d2fab14c3 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:40.622730 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-657988ab-ef42-4522-b305-5b9d2fab14c3 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1458 microversion: 2.1 time: 0.833770 Jul 26 14:36:40.627719 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2424/4962] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:39 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1458 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:40.659285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b80671fb-30c8-42d3-bb9a-f1c705423d5c tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:36:40.659919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b80671fb-30c8-42d3-bb9a-f1c705423d5c tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:36:40.672038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b80671fb-30c8-42d3-bb9a-f1c705423d5c tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:40.677946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b80671fb-30c8-42d3-bb9a-f1c705423d5c tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:40.679690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b80671fb-30c8-42d3-bb9a-f1c705423d5c tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:40.684837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b80671fb-30c8-42d3-bb9a-f1c705423d5c tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:41.071681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b80671fb-30c8-42d3-bb9a-f1c705423d5c tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:36:41.082267 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b80671fb-30c8-42d3-bb9a-f1c705423d5c tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1458 microversion: 2.1 time: 0.427881 Jul 26 14:36:41.096227 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2539/4963] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:36:40 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1458 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:36:56.714592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4e1bb371-9d51-491d-b802-6904694dd1ef req-cb430c11-1a76-4505-b8e5-468e8e1e4b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872dc503-096d-43b3-8297-8c0a426cf057", "tag": "b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:36:56.729667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:56.733395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=5 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:36:56.766308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4e1bb371-9d51-491d-b802-6904694dd1ef req-cb430c11-1a76-4505-b8e5-468e8e1e4b2e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:36:56.769738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4e1bb371-9d51-491d-b802-6904694dd1ef req-cb430c11-1a76-4505-b8e5-468e8e1e4b2e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:36:56.847398 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4e1bb371-9d51-491d-b802-6904694dd1ef req-cb430c11-1a76-4505-b8e5-468e8e1e4b2e service nova] Creating event network-changed:b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8 for instance 872dc503-096d-43b3-8297-8c0a426cf057 on n-h1-833090-9 Jul 26 14:36:56.870385 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4e1bb371-9d51-491d-b802-6904694dd1ef req-cb430c11-1a76-4505-b8e5-468e8e1e4b2e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163027 Jul 26 14:36:56.871446 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2425/4964] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:37:03.863133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=5 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:03.867130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=19 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:04.214268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36498bc9-a938-4b1f-93b2-9aafa297e07f tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Calling method '.version_select at 0x7f8794627040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:04.398234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-36498bc9-a938-4b1f-93b2-9aafa297e07f tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:37:04.400600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-36498bc9-a938-4b1f-93b2-9aafa297e07f tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Neutron security group e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:37:04.401544 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-36498bc9-a938-4b1f-93b2-9aafa297e07f tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] HTTP exception thrown: Security group e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 does not exist Jul 26 14:37:04.401544 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-e2f4870d-a901-4351-bb10-69db01e9d71a'] Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36498bc9-a938-4b1f-93b2-9aafa297e07f tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Request method failure captured: Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-security-groups/e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 HTTP/1.1 Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_wPmYrWc2yYYp5hR4HFmRrbDQUMCO7KFiqKLT8VNjLJl-PMimGKYuFZ5ym4DICUbUGe9mjpvnjgM29yJxy-oA-gqct8wexkFGnYd6qO3GwMrbcFMEpNoWgM1GITvJVoJHuDjP1uZjT7uv2Pz0wzUrWw0MS4kwdQBtdHh9lRvAqdK_I Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4d93c1a352364eac941e465c7c3ae287 Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d93c1a352364eac941e465c7c3ae287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d93c1a352364eac941e465c7c3ae287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d93c1a352364eac941e465c7c3ae287", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d93c1a352364eac941e465c7c3ae287"}]}] Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4d93c1a352364eac941e465c7c3ae287 Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsNegativeTestJSON-1637033945-project Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 95754d47b200458b9b5ae4cabeb0a4fe Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945-project Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 does not exist Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-e2f4870d-a901-4351-bb10-69db01e9d71a'] Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4'} Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:37:04.404370 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 does not exist Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2f4870d-a901-4351-bb10-69db01e9d71a'] Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 does not exist Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2f4870d-a901-4351-bb10-69db01e9d71a'] Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 does not exist Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2f4870d-a901-4351-bb10-69db01e9d71a'] Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 does not exist Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e2f4870d-a901-4351-bb10-69db01e9d71a'] Jul 26 14:37:04.408800 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:04.412422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36498bc9-a938-4b1f-93b2-9aafa297e07f tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Returning 404 to user: Security group e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 does not exist Jul 26 14:37:04.412422 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-e2f4870d-a901-4351-bb10-69db01e9d71a'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:37:04.413541 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-36498bc9-a938-4b1f-93b2-9aafa297e07f tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4" status: 404 len: 194 microversion: 2.1 time: 0.574074 Jul 26 14:37:04.414594 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2540/4965] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:37:03 2022] DELETE /compute/v2.1/os-security-groups/e76abbe0-eb7a-4b21-baec-a92eb4ccc1f4 => generated 194 bytes in 576 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:37:04.433229 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-28251386-f49d-497d-a9f5-441adc37f624 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.011298 Jul 26 14:37:04.439373 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2426/4966] 10.222.0.70 () {58 vars in 1164 bytes} [Tue Jul 26 14:37:04 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 14:37:04.451601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f7c0eada-a3c7-435e-9923-5eb76af86ab5 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Calling method '.version_select at 0x7f8786b78e50>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:05.615174 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f7c0eada-a3c7-435e-9923-5eb76af86ab5 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.170549 Jul 26 14:37:05.616577 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2541/4967] 10.222.0.70 () {58 vars in 1158 bytes} [Tue Jul 26 14:37:04 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:37:05.634071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71e85296-2141-4d1b-bebc-4ed9e3d31029 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Calling method '.version_select at 0x7f87993b88b0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:06.780719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:06.781842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:07.178848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-8be7d8d5-6531-4a6d-b12d-e49edd6942a5 req-2ddd0c61-dbf0-49db-be9b-c83e22cab3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872dc503-096d-43b3-8297-8c0a426cf057", "tag": "b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:37:07.218942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8be7d8d5-6531-4a6d-b12d-e49edd6942a5 req-2ddd0c61-dbf0-49db-be9b-c83e22cab3d6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:07.247485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-8be7d8d5-6531-4a6d-b12d-e49edd6942a5 req-2ddd0c61-dbf0-49db-be9b-c83e22cab3d6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:07.274738 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-8be7d8d5-6531-4a6d-b12d-e49edd6942a5 req-2ddd0c61-dbf0-49db-be9b-c83e22cab3d6 service nova] Creating event network-changed:b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8 for instance 872dc503-096d-43b3-8297-8c0a426cf057 on n-h1-833090-9 Jul 26 14:37:07.325112 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-8be7d8d5-6531-4a6d-b12d-e49edd6942a5 req-2ddd0c61-dbf0-49db-be9b-c83e22cab3d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133770 Jul 26 14:37:07.326450 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2542/4968] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:37:07.425117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-71e85296-2141-4d1b-bebc-4ed9e3d31029 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:37:07.425874 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-71e85296-2141-4d1b-bebc-4ed9e3d31029 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 26 14:37:07.425874 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-173541f5-e756-4818-8ccb-3737fb3d4925'] Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71e85296-2141-4d1b-bebc-4ed9e3d31029 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Request method failure captured: Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/os-security-groups/8afea600-6b6a-4b7e-bb01-29331207ceb9 HTTP/1.1 Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_wPmYrWc2yYYp5hR4HFmRrbDQUMCO7KFiqKLT8VNjLJl-PMimGKYuFZ5ym4DICUbUGe9mjpvnjgM29yJxy-oA-gqct8wexkFGnYd6qO3GwMrbcFMEpNoWgM1GITvJVoJHuDjP1uZjT7uv2Pz0wzUrWw0MS4kwdQBtdHh9lRvAqdK_I Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4d93c1a352364eac941e465c7c3ae287 Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d93c1a352364eac941e465c7c3ae287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d93c1a352364eac941e465c7c3ae287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d93c1a352364eac941e465c7c3ae287", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d93c1a352364eac941e465c7c3ae287"}]}] Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4d93c1a352364eac941e465c7c3ae287 Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupsNegativeTestJSON-1637033945-project Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 95754d47b200458b9b5ae4cabeb0a4fe Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945-project Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: exception: Insufficient rights for removing default security group. Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-173541f5-e756-4818-8ccb-3737fb3d4925'] Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '8afea600-6b6a-4b7e-bb01-29331207ceb9'} Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:37:07.428588 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-173541f5-e756-4818-8ccb-3737fb3d4925'] Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-173541f5-e756-4818-8ccb-3737fb3d4925'] Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-173541f5-e756-4818-8ccb-3737fb3d4925'] Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-173541f5-e756-4818-8ccb-3737fb3d4925'] Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-71e85296-2141-4d1b-bebc-4ed9e3d31029 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-173541f5-e756-4818-8ccb-3737fb3d4925'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:37:07.435886 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-71e85296-2141-4d1b-bebc-4ed9e3d31029 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/8afea600-6b6a-4b7e-bb01-29331207ceb9" status: 400 len: 182 microversion: 2.1 time: 1.802747 Jul 26 14:37:07.444227 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2427/4969] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 14:37:05 2022] DELETE /compute/v2.1/os-security-groups/8afea600-6b6a-4b7e-bb01-29331207ceb9 => generated 182 bytes in 1812 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:37:07.461462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09768aa8-ae65-413f-8764-8a4a937feed9 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Calling method '.version_select at 0x7f8794627550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:08.132587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG neutronclient.v2_0.client [None req-09768aa8-ae65-413f-8764-8a4a937feed9 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8c711470-5848-48b8-a51d-e05dff4f8fb8 does not exist", "detail": ""}} {{(pid=119479) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:37:08.133524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.security_group_api [None req-09768aa8-ae65-413f-8764-8a4a937feed9 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Neutron security group 8c711470-5848-48b8-a51d-e05dff4f8fb8 not found {{(pid=119479) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:37:08.135377 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-09768aa8-ae65-413f-8764-8a4a937feed9 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] HTTP exception thrown: Security group 8c711470-5848-48b8-a51d-e05dff4f8fb8 does not exist Jul 26 14:37:08.135377 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-86b32eb2-9193-43b9-8e35-762506074de6'] Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09768aa8-ae65-413f-8764-8a4a937feed9 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Request method failure captured: Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/os-security-groups/8c711470-5848-48b8-a51d-e05dff4f8fb8 HTTP/1.1 Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_wPmYrWc2yYYp5hR4HFmRrbDQUMCO7KFiqKLT8VNjLJl-PMimGKYuFZ5ym4DICUbUGe9mjpvnjgM29yJxy-oA-gqct8wexkFGnYd6qO3GwMrbcFMEpNoWgM1GITvJVoJHuDjP1uZjT7uv2Pz0wzUrWw0MS4kwdQBtdHh9lRvAqdK_I Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4d93c1a352364eac941e465c7c3ae287 Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d93c1a352364eac941e465c7c3ae287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d93c1a352364eac941e465c7c3ae287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d93c1a352364eac941e465c7c3ae287", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d93c1a352364eac941e465c7c3ae287"}]}] Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4d93c1a352364eac941e465c7c3ae287 Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-SecurityGroupsNegativeTestJSON-1637033945-project Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 95754d47b200458b9b5ae4cabeb0a4fe Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945-project Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: method: Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: exception: Security group 8c711470-5848-48b8-a51d-e05dff4f8fb8 does not exist Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-86b32eb2-9193-43b9-8e35-762506074de6'] Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '8c711470-5848-48b8-a51d-e05dff4f8fb8'} Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:37:08.138516 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8c711470-5848-48b8-a51d-e05dff4f8fb8 does not exist Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86b32eb2-9193-43b9-8e35-762506074de6'] Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8c711470-5848-48b8-a51d-e05dff4f8fb8 does not exist Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86b32eb2-9193-43b9-8e35-762506074de6'] Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8c711470-5848-48b8-a51d-e05dff4f8fb8 does not exist Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86b32eb2-9193-43b9-8e35-762506074de6'] Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8c711470-5848-48b8-a51d-e05dff4f8fb8 does not exist Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86b32eb2-9193-43b9-8e35-762506074de6'] Jul 26 14:37:08.142761 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:08.147507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09768aa8-ae65-413f-8764-8a4a937feed9 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Returning 404 to user: Security group 8c711470-5848-48b8-a51d-e05dff4f8fb8 does not exist Jul 26 14:37:08.147507 n-d-833090-9 devstack@n-api.service[119479]: Neutron server returns request_ids: ['req-86b32eb2-9193-43b9-8e35-762506074de6'] {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:37:08.149143 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-09768aa8-ae65-413f-8764-8a4a937feed9 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/8c711470-5848-48b8-a51d-e05dff4f8fb8" status: 404 len: 194 microversion: 2.1 time: 0.701324 Jul 26 14:37:08.150963 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2543/4970] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:37:07 2022] GET /compute/v2.1/os-security-groups/8c711470-5848-48b8-a51d-e05dff4f8fb8 => generated 194 bytes in 706 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:37:08.160634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d68b1c9e-3698-418a-8345-74ffcc71d009 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Action: 'update', calling method: .version_select at 0x7f878704e430>, body: {"security_group": {"name": "tempest-sg-2090468089", "description": "tempest-description-1533536974"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:37:09.317051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG neutronclient.v2_0.client [None req-d68b1c9e-3698-418a-8345-74ffcc71d009 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 28e13dd6-3251-4c7f-bc14-2f9909518a24 does not exist", "detail": ""}} {{(pid=119478) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 26 14:37:09.318371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.security_group_api [None req-d68b1c9e-3698-418a-8345-74ffcc71d009 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Neutron security group 28e13dd6-3251-4c7f-bc14-2f9909518a24 not found {{(pid=119478) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 26 14:37:09.319185 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d68b1c9e-3698-418a-8345-74ffcc71d009 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] HTTP exception thrown: Security group 28e13dd6-3251-4c7f-bc14-2f9909518a24 does not exist Jul 26 14:37:09.319185 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-06ebbd42-9503-4199-8362-fe008a8e1fef'] Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d68b1c9e-3698-418a-8345-74ffcc71d009 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Request method failure captured: Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: request: PUT /compute/v2.1/os-security-groups/28e13dd6-3251-4c7f-bc14-2f9909518a24 HTTP/1.1 Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 102 Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_wPmYrWc2yYYp5hR4HFmRrbDQUMCO7KFiqKLT8VNjLJl-PMimGKYuFZ5ym4DICUbUGe9mjpvnjgM29yJxy-oA-gqct8wexkFGnYd6qO3GwMrbcFMEpNoWgM1GITvJVoJHuDjP1uZjT7uv2Pz0wzUrWw0MS4kwdQBtdHh9lRvAqdK_I Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4d93c1a352364eac941e465c7c3ae287 Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d93c1a352364eac941e465c7c3ae287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d93c1a352364eac941e465c7c3ae287"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d93c1a352364eac941e465c7c3ae287", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d93c1a352364eac941e465c7c3ae287"}]}] Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4d93c1a352364eac941e465c7c3ae287 Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945 Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-SecurityGroupsNegativeTestJSON-1637033945-project Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 95754d47b200458b9b5ae4cabeb0a4fe Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1637033945-project Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: {"security_group": {"name": "tempest-sg-2090468089", "description": "tempest-description-1533536974"}} Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: method: Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: exception: Security group 28e13dd6-3251-4c7f-bc14-2f9909518a24 does not exist Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-06ebbd42-9503-4199-8362-fe008a8e1fef'] Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '28e13dd6-3251-4c7f-bc14-2f9909518a24', 'body': {'security_group': {'name': 'tempest-sg-2090468089', 'description': 'tempest-description-1533536974'}}} Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 26 14:37:09.321447 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 28e13dd6-3251-4c7f-bc14-2f9909518a24 does not exist Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ebbd42-9503-4199-8362-fe008a8e1fef'] Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 28e13dd6-3251-4c7f-bc14-2f9909518a24 does not exist Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ebbd42-9503-4199-8362-fe008a8e1fef'] Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 28e13dd6-3251-4c7f-bc14-2f9909518a24 does not exist Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ebbd42-9503-4199-8362-fe008a8e1fef'] Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 28e13dd6-3251-4c7f-bc14-2f9909518a24 does not exist Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06ebbd42-9503-4199-8362-fe008a8e1fef'] Jul 26 14:37:09.325532 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:37:09.332401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d68b1c9e-3698-418a-8345-74ffcc71d009 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] Returning 404 to user: Security group 28e13dd6-3251-4c7f-bc14-2f9909518a24 does not exist Jul 26 14:37:09.332401 n-d-833090-9 devstack@n-api.service[119478]: Neutron server returns request_ids: ['req-06ebbd42-9503-4199-8362-fe008a8e1fef'] {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:37:09.334525 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d68b1c9e-3698-418a-8345-74ffcc71d009 tempest-SecurityGroupsNegativeTestJSON-1637033945 tempest-SecurityGroupsNegativeTestJSON-1637033945-project] 10.222.0.70 "PUT /compute/v2.1/os-security-groups/28e13dd6-3251-4c7f-bc14-2f9909518a24" status: 404 len: 194 microversion: 2.1 time: 1.177055 Jul 26 14:37:09.335402 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2428/4971] 10.222.0.70 () {60 vars in 1290 bytes} [Tue Jul 26 14:37:08 2022] PUT /compute/v2.1/os-security-groups/28e13dd6-3251-4c7f-bc14-2f9909518a24 => generated 194 bytes in 1179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:37:09.509031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e7ae6fe9-ee4b-4eb3-81dc-34c09a269412 req-e6161d4f-fea2-488e-a1aa-e56857e56651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872dc503-096d-43b3-8297-8c0a426cf057", "tag": "b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:37:09.539080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e7ae6fe9-ee4b-4eb3-81dc-34c09a269412 req-e6161d4f-fea2-488e-a1aa-e56857e56651 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:09.541679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e7ae6fe9-ee4b-4eb3-81dc-34c09a269412 req-e6161d4f-fea2-488e-a1aa-e56857e56651 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:09.566725 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e7ae6fe9-ee4b-4eb3-81dc-34c09a269412 req-e6161d4f-fea2-488e-a1aa-e56857e56651 service nova] Creating event network-changed:b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8 for instance 872dc503-096d-43b3-8297-8c0a426cf057 on n-h1-833090-9 Jul 26 14:37:09.572891 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e7ae6fe9-ee4b-4eb3-81dc-34c09a269412 req-e6161d4f-fea2-488e-a1aa-e56857e56651 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067620 Jul 26 14:37:09.574071 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2544/4972] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:37:25.531079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-c9f18111-3cc6-4f19-818a-5a4db2cb38a8 req-762641d9-edc1-40dd-9aad-ee89f5ce80c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872dc503-096d-43b3-8297-8c0a426cf057", "tag": "b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:37:25.593095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:25.608227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:25.613679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c9f18111-3cc6-4f19-818a-5a4db2cb38a8 req-762641d9-edc1-40dd-9aad-ee89f5ce80c3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:25.629863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c9f18111-3cc6-4f19-818a-5a4db2cb38a8 req-762641d9-edc1-40dd-9aad-ee89f5ce80c3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:25.674187 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-c9f18111-3cc6-4f19-818a-5a4db2cb38a8 req-762641d9-edc1-40dd-9aad-ee89f5ce80c3 service nova] Creating event network-changed:b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8 for instance 872dc503-096d-43b3-8297-8c0a426cf057 on n-h1-833090-9 Jul 26 14:37:25.692857 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-c9f18111-3cc6-4f19-818a-5a4db2cb38a8 req-762641d9-edc1-40dd-9aad-ee89f5ce80c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168452 Jul 26 14:37:25.701074 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2545/4973] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:37:25.989730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b534ba3a-08a4-44bc-b720-26d97e2e0f7d tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:25.991280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b534ba3a-08a4-44bc-b720-26d97e2e0f7d tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:26.019237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b534ba3a-08a4-44bc-b720-26d97e2e0f7d tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:26.021388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b534ba3a-08a4-44bc-b720-26d97e2e0f7d tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:26.025468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b534ba3a-08a4-44bc-b720-26d97e2e0f7d tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:26.031294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b534ba3a-08a4-44bc-b720-26d97e2e0f7d tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:26.216534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b534ba3a-08a4-44bc-b720-26d97e2e0f7d tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:37:26.414104 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b534ba3a-08a4-44bc-b720-26d97e2e0f7d tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "DELETE /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 204 len: 0 microversion: 2.1 time: 0.907919 Jul 26 14:37:26.418908 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2429/4974] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:37:25 2022] DELETE /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:37:26.426189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8ff2ef42-77bc-4e68-ba99-aa33ffc6309f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:26.427098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8ff2ef42-77bc-4e68-ba99-aa33ffc6309f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:26.450899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ff2ef42-77bc-4e68-ba99-aa33ffc6309f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:26.451559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ff2ef42-77bc-4e68-ba99-aa33ffc6309f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:26.458650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ff2ef42-77bc-4e68-ba99-aa33ffc6309f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:26.464233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ff2ef42-77bc-4e68-ba99-aa33ffc6309f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:28.985891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8ff2ef42-77bc-4e68-ba99-aa33ffc6309f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:37:29.004229 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8ff2ef42-77bc-4e68-ba99-aa33ffc6309f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1583 microversion: 2.1 time: 2.582762 Jul 26 14:37:29.005618 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2546/4975] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:37:26 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1583 bytes in 2586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:30.031886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6c9d106-8230-45cd-ab36-7842c9a3dc9f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:30.032847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e6c9d106-8230-45cd-ab36-7842c9a3dc9f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:30.054899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6c9d106-8230-45cd-ab36-7842c9a3dc9f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:30.055365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6c9d106-8230-45cd-ab36-7842c9a3dc9f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:30.056334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6c9d106-8230-45cd-ab36-7842c9a3dc9f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:30.056871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6c9d106-8230-45cd-ab36-7842c9a3dc9f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:30.731531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6c9d106-8230-45cd-ab36-7842c9a3dc9f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:37:30.763275 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6c9d106-8230-45cd-ab36-7842c9a3dc9f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1464 microversion: 2.1 time: 0.735726 Jul 26 14:37:30.782316 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2430/4976] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:37:30 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1464 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:37:31.591687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-aace5ee1-2aa6-4c0f-9af9-b4a66c0781f8 req-2dbef8f7-37df-4f0a-a1bd-282c5270df18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872dc503-096d-43b3-8297-8c0a426cf057", "name": "network-vif-deleted", "tag": "b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:37:31.627136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-aace5ee1-2aa6-4c0f-9af9-b4a66c0781f8 req-2dbef8f7-37df-4f0a-a1bd-282c5270df18 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:31.627776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-aace5ee1-2aa6-4c0f-9af9-b4a66c0781f8 req-2dbef8f7-37df-4f0a-a1bd-282c5270df18 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:31.682961 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-aace5ee1-2aa6-4c0f-9af9-b4a66c0781f8 req-2dbef8f7-37df-4f0a-a1bd-282c5270df18 service nova] Creating event network-vif-deleted:b922a3c0-3229-4b99-8e0a-2ec3aa5df8a8 for instance 872dc503-096d-43b3-8297-8c0a426cf057 on n-h1-833090-9 Jul 26 14:37:31.700300 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-aace5ee1-2aa6-4c0f-9af9-b4a66c0781f8 req-2dbef8f7-37df-4f0a-a1bd-282c5270df18 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115185 Jul 26 14:37:31.703131 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2547/4977] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:37:31.793011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca927238-c18d-4ec1-884c-2a8e866e1b85 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:31.793011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ca927238-c18d-4ec1-884c-2a8e866e1b85 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:31.804194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca927238-c18d-4ec1-884c-2a8e866e1b85 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:31.804650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca927238-c18d-4ec1-884c-2a8e866e1b85 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:31.805431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca927238-c18d-4ec1-884c-2a8e866e1b85 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:31.805997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca927238-c18d-4ec1-884c-2a8e866e1b85 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:32.821181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ca927238-c18d-4ec1-884c-2a8e866e1b85 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:37:32.834295 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ca927238-c18d-4ec1-884c-2a8e866e1b85 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1230 microversion: 2.1 time: 1.047161 Jul 26 14:37:32.850570 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2431/4978] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:37:31 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1230 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:33.859666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ec4cc86c-93e9-4635-a2b5-09977f158a17 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:33.861162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ec4cc86c-93e9-4635-a2b5-09977f158a17 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:33.891285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec4cc86c-93e9-4635-a2b5-09977f158a17 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:33.891759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec4cc86c-93e9-4635-a2b5-09977f158a17 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:33.902733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec4cc86c-93e9-4635-a2b5-09977f158a17 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:33.903272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec4cc86c-93e9-4635-a2b5-09977f158a17 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:34.230909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ec4cc86c-93e9-4635-a2b5-09977f158a17 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:37:34.246719 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ec4cc86c-93e9-4635-a2b5-09977f158a17 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1230 microversion: 2.1 time: 0.394148 Jul 26 14:37:34.263828 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2548/4979] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:37:33 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1230 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:35.276545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c968a12e-b2f0-469c-877a-e7ad870d918f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:35.278013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c968a12e-b2f0-469c-877a-e7ad870d918f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:35.290887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c968a12e-b2f0-469c-877a-e7ad870d918f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:35.293443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c968a12e-b2f0-469c-877a-e7ad870d918f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:35.294673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c968a12e-b2f0-469c-877a-e7ad870d918f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:35.295842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c968a12e-b2f0-469c-877a-e7ad870d918f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:35.659730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c968a12e-b2f0-469c-877a-e7ad870d918f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:37:35.694993 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c968a12e-b2f0-469c-877a-e7ad870d918f tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1230 microversion: 2.1 time: 0.422662 Jul 26 14:37:35.715367 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2432/4980] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:37:35 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1230 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:36.724276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5f279f6b-602e-4a37-95c1-5c063ac1c8cd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:36.725609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5f279f6b-602e-4a37-95c1-5c063ac1c8cd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:36.742880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f279f6b-602e-4a37-95c1-5c063ac1c8cd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:36.745613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f279f6b-602e-4a37-95c1-5c063ac1c8cd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:36.748742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f279f6b-602e-4a37-95c1-5c063ac1c8cd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:36.749417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f279f6b-602e-4a37-95c1-5c063ac1c8cd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:37.229913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5f279f6b-602e-4a37-95c1-5c063ac1c8cd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:37:37.243712 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5f279f6b-602e-4a37-95c1-5c063ac1c8cd tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1230 microversion: 2.1 time: 0.521397 Jul 26 14:37:37.244581 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2549/4981] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:37:36 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1230 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:38.267148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-27f8a12e-6c75-43da-8a51-34e2e2eb82a1 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:38.268841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-27f8a12e-6c75-43da-8a51-34e2e2eb82a1 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:38.292232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27f8a12e-6c75-43da-8a51-34e2e2eb82a1 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:38.293093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27f8a12e-6c75-43da-8a51-34e2e2eb82a1 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:38.294145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27f8a12e-6c75-43da-8a51-34e2e2eb82a1 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:38.294810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27f8a12e-6c75-43da-8a51-34e2e2eb82a1 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:38.777729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-27f8a12e-6c75-43da-8a51-34e2e2eb82a1 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:37:38.789698 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-27f8a12e-6c75-43da-8a51-34e2e2eb82a1 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1230 microversion: 2.1 time: 0.527276 Jul 26 14:37:38.791594 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2433/4982] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:37:38 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1230 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:39.814805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56010cd5-7f3e-4714-9a8c-65f4f724552b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:39.815461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56010cd5-7f3e-4714-9a8c-65f4f724552b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:39.840057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56010cd5-7f3e-4714-9a8c-65f4f724552b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:39.846564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56010cd5-7f3e-4714-9a8c-65f4f724552b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:39.849002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56010cd5-7f3e-4714-9a8c-65f4f724552b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:39.854566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56010cd5-7f3e-4714-9a8c-65f4f724552b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:40.138178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56010cd5-7f3e-4714-9a8c-65f4f724552b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:37:40.153827 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56010cd5-7f3e-4714-9a8c-65f4f724552b tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1230 microversion: 2.1 time: 0.341743 Jul 26 14:37:40.156659 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2550/4983] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:37:39 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1230 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:41.180150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6e15a0b-05f1-48b3-bd14-6563b71f61fe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:41.181967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6e15a0b-05f1-48b3-bd14-6563b71f61fe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:41.190711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6e15a0b-05f1-48b3-bd14-6563b71f61fe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:41.196385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6e15a0b-05f1-48b3-bd14-6563b71f61fe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:41.201722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6e15a0b-05f1-48b3-bd14-6563b71f61fe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:41.202528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6e15a0b-05f1-48b3-bd14-6563b71f61fe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:41.580016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c6e15a0b-05f1-48b3-bd14-6563b71f61fe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bafff185a894f20ba51b63a5617fa83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c7b4c084a64c3cbc0a4422d8ae8f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:37:41.592778 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6e15a0b-05f1-48b3-bd14-6563b71f61fe tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 200 len: 1230 microversion: 2.1 time: 0.417318 Jul 26 14:37:41.593381 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2434/4984] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:37:41 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 1230 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:37:42.615824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3d9cce03-85da-43de-9c1d-47889c381902 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:42.617242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3d9cce03-85da-43de-9c1d-47889c381902 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] [instance: 872dc503-096d-43b3-8297-8c0a426cf057] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:37:42.631992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d9cce03-85da-43de-9c1d-47889c381902 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:42.634937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d9cce03-85da-43de-9c1d-47889c381902 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:42.638763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d9cce03-85da-43de-9c1d-47889c381902 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:37:42.639775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d9cce03-85da-43de-9c1d-47889c381902 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:37:42.680554 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-3d9cce03-85da-43de-9c1d-47889c381902 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] HTTP exception thrown: Instance 872dc503-096d-43b3-8297-8c0a426cf057 could not be found. Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3d9cce03-85da-43de-9c1d-47889c381902 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Request method failure captured: Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 HTTP/1.1 Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_rjaaafr4mq5a0Rm5ytkzDO23XendTtdsznNE7k9JfoF29iYBQ3_2m-0urPn_i1ug52aKZygox_OkIoEAAgHSkXnpesc6y9UOImFYF499qTOdfgNiWmZZkPLReXD7MBfV9tTMjwCVrQQakX9TcnlTujzNmQ1d52-NbMO2_AiHhj4Xc Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 81c7b4c084a64c3cbc0a4422d8ae8f15 Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestVolumeBackupRestore-2022388017 Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81c7b4c084a64c3cbc0a4422d8ae8f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81c7b4c084a64c3cbc0a4422d8ae8f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81c7b4c084a64c3cbc0a4422d8ae8f15", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81c7b4c084a64c3cbc0a4422d8ae8f15"}]}] Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestVolumeBackupRestore-2022388017 Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 81c7b4c084a64c3cbc0a4422d8ae8f15 Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2022388017 Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestVolumeBackupRestore-2022388017-project Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6bafff185a894f20ba51b63a5617fa83 Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestVolumeBackupRestore-2022388017-project Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 872dc503-096d-43b3-8297-8c0a426cf057 could not be found. Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '872dc503-096d-43b3-8297-8c0a426cf057'} Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872dc503-096d-43b3-8297-8c0a426cf057 could not be found. Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872dc503-096d-43b3-8297-8c0a426cf057 could not be found. Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:37:42.689260 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:42.695045 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:37:42.695045 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:37:42.695045 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:37:42.695045 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:37:42.695045 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:37:42.695045 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872dc503-096d-43b3-8297-8c0a426cf057 could not be found. Jul 26 14:37:42.695045 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:37:42.699383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3d9cce03-85da-43de-9c1d-47889c381902 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Returning 404 to user: Instance 872dc503-096d-43b3-8297-8c0a426cf057 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:37:42.703536 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3d9cce03-85da-43de-9c1d-47889c381902 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057" status: 404 len: 111 microversion: 2.1 time: 0.093206 Jul 26 14:37:42.706224 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2551/4985] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:37:42 2022] GET /compute/v2.1/servers/872dc503-096d-43b3-8297-8c0a426cf057 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:37:43.428388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0ed07847-4a8f-4c3f-8679-58db8d2c1a51 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] Calling method '.version_select at 0x7f87993ad820>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:37:43.470329 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0ed07847-4a8f-4c3f-8679-58db8d2c1a51 tempest-TestVolumeBackupRestore-2022388017 tempest-TestVolumeBackupRestore-2022388017-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1083626827" status: 202 len: 0 microversion: 2.1 time: 0.046026 Jul 26 14:37:43.470926 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2435/4986] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Jul 26 14:37:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1083626827 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:37:56.313809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=14 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:56.314802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=30 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:37:56.682425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-548d0b1b-d6c1-4299-ae52-4780cdbd7ee7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'create', calling method: .version_select at 0x7f879945a3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-100308099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTD2yZlfUUjrW3JH09k99Nzvg48LV9n2B+PY57kKee80O4xK5B48oKtzOHkojJcFyNEPqsfgGWIgqEbJ01unJ+p0aYztxPEfSS1Uu8BpTLEi34XNIjmjRqUBwRqoVelAQ=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:37:56.714950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-548d0b1b-d6c1-4299-ae52-4780cdbd7ee7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:37:56.730253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-548d0b1b-d6c1-4299-ae52-4780cdbd7ee7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for user 2ace0ada06df49f189f02e59039c2dd8 and project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:37:56.769404 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [None req-548d0b1b-d6c1-4299-ae52-4780cdbd7ee7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [164a6d72-fc25-48d3-9ea9-de7d68fca0a8] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 14:37:57.781354 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [None req-548d0b1b-d6c1-4299-ae52-4780cdbd7ee7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [164a6d72-fc25-48d3-9ea9-de7d68fca0a8] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 54506. Jul 26 14:37:57.809306 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-548d0b1b-d6c1-4299-ae52-4780cdbd7ee7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.505553 Jul 26 14:37:57.818383 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2552/4987] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:37:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:37:58.652391 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 14:37:58.652865 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 14:37:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 14:38:00.688286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:00.689840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:00.886042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7cf57309-0192-4a14-9675-7300fdc36b7e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Action: 'create', calling method: .version_select at 0x7f8786e80af0>, body: {"keypair": {"name": "tempest-keypair-1249818897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl8WYoYoE7hKArRg4xJsMEdPGngJmtrO8+TmziliOc/U1dts6CKYxQcw9WIpA5k1Dik/jFOCWINTLv9lNkuZp/DrpJbqqNif9VNupwNwYJhEIkvAOFSNlTbeDH0f3xQSA=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:38:00.943256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-7cf57309-0192-4a14-9675-7300fdc36b7e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Getting quotas for project 090816cf27a24b288321f72946ba0ae5. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:38:00.959647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-7cf57309-0192-4a14-9675-7300fdc36b7e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Getting quotas for user 652030dfa72f45fda873b2c86919360a and project 090816cf27a24b288321f72946ba0ae5. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:38:01.023744 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7cf57309-0192-4a14-9675-7300fdc36b7e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.343545 Jul 26 14:38:01.028104 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2436/4988] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:38:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:38:29.154995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1691633773", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "c3c2a628-97ec-4eab-aa75-d40532b8d266"}], "key_name": "tempest-TestNetworkAdvancedServerOps-100308099", "security_groups": [{"name": "tempest-secgroup-smoke-1808521971"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:38:29.190102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:29.192309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:30.476825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] validate_networks() for [('c3c2a628-97ec-4eab-aa75-d40532b8d266', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:38:33.701758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:38:33.702362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:38:33.702660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:38:33.703078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:38:33.703509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:38:33.728998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:33.735196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:33.736221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:33.736691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:33.802002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:38:33.821806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for user 2ace0ada06df49f189f02e59039c2dd8 and project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:38:33.859195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:38:33.861585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:38:34.096828 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e2c3baf2-bd9e-4273-a796-d98531ab3baa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.948694 Jul 26 14:38:34.104765 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2553/4989] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:38:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 4957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:38:34.119222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:34.120022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:34.128100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5f4ffdaa-e0e0-4128-8010-e44089c4d2fa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:34.128872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5f4ffdaa-e0e0-4128-8010-e44089c4d2fa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:35.816702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5f4ffdaa-e0e0-4128-8010-e44089c4d2fa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:35.831693 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5f4ffdaa-e0e0-4128-8010-e44089c4d2fa tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1266 microversion: 2.1 time: 1.716946 Jul 26 14:38:35.832920 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2437/4990] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:34 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1266 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:36.855309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e8cd5e20-93c4-4380-ac6b-75fe4bf3cdde tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:36.856797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e8cd5e20-93c4-4380-ac6b-75fe4bf3cdde tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:36.893607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8cd5e20-93c4-4380-ac6b-75fe4bf3cdde tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:36.894048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8cd5e20-93c4-4380-ac6b-75fe4bf3cdde tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:36.899601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8cd5e20-93c4-4380-ac6b-75fe4bf3cdde tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:36.902265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8cd5e20-93c4-4380-ac6b-75fe4bf3cdde tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:37.178063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e8cd5e20-93c4-4380-ac6b-75fe4bf3cdde tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:37.192419 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e8cd5e20-93c4-4380-ac6b-75fe4bf3cdde tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1324 microversion: 2.1 time: 0.338893 Jul 26 14:38:37.194462 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2554/4991] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:36 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:38.215333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-33075908-8a33-401d-9273-4cd1506a3a0a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:38.216039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-33075908-8a33-401d-9273-4cd1506a3a0a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:38.230042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33075908-8a33-401d-9273-4cd1506a3a0a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:38.230508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33075908-8a33-401d-9273-4cd1506a3a0a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:38.231609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33075908-8a33-401d-9273-4cd1506a3a0a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:38.231730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-33075908-8a33-401d-9273-4cd1506a3a0a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:38.898609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-33075908-8a33-401d-9273-4cd1506a3a0a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:38.907460 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-33075908-8a33-401d-9273-4cd1506a3a0a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1324 microversion: 2.1 time: 0.696432 Jul 26 14:38:38.920776 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2438/4992] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:38 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1324 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:39.938960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-982194fa-a09e-4fcd-9354-0b5a5af8f471 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:39.940363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-982194fa-a09e-4fcd-9354-0b5a5af8f471 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:39.948293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-982194fa-a09e-4fcd-9354-0b5a5af8f471 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:39.949849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-982194fa-a09e-4fcd-9354-0b5a5af8f471 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:39.950955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-982194fa-a09e-4fcd-9354-0b5a5af8f471 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:39.951858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-982194fa-a09e-4fcd-9354-0b5a5af8f471 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:40.239537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-982194fa-a09e-4fcd-9354-0b5a5af8f471 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:40.257013 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-982194fa-a09e-4fcd-9354-0b5a5af8f471 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1324 microversion: 2.1 time: 0.330042 Jul 26 14:38:40.258171 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2555/4993] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:39 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:41.279499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d3813b31-9001-450a-9e4f-b5c067c22ee1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:41.280289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d3813b31-9001-450a-9e4f-b5c067c22ee1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:41.306236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3813b31-9001-450a-9e4f-b5c067c22ee1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:41.308686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3813b31-9001-450a-9e4f-b5c067c22ee1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:41.309618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3813b31-9001-450a-9e4f-b5c067c22ee1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:41.311123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3813b31-9001-450a-9e4f-b5c067c22ee1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:42.415999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d3813b31-9001-450a-9e4f-b5c067c22ee1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:42.434919 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d3813b31-9001-450a-9e4f-b5c067c22ee1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1392 microversion: 2.1 time: 1.159400 Jul 26 14:38:42.438225 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2439/4994] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:41 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1392 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:43.465145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-adf43941-f44c-421e-b1d9-a681d0a580c2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:43.467496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-adf43941-f44c-421e-b1d9-a681d0a580c2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:43.494465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf43941-f44c-421e-b1d9-a681d0a580c2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:43.503147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf43941-f44c-421e-b1d9-a681d0a580c2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:43.503147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf43941-f44c-421e-b1d9-a681d0a580c2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:43.503147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf43941-f44c-421e-b1d9-a681d0a580c2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:43.780215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:43.840801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:44.077460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-adf43941-f44c-421e-b1d9-a681d0a580c2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:44.092570 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-adf43941-f44c-421e-b1d9-a681d0a580c2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1392 microversion: 2.1 time: 0.632090 Jul 26 14:38:44.112956 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2556/4995] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:43 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1392 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:45.123553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1cc2f8d1-2c45-462a-8320-dc2c54315265 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:45.124992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1cc2f8d1-2c45-462a-8320-dc2c54315265 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:45.134962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cc2f8d1-2c45-462a-8320-dc2c54315265 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:45.144823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cc2f8d1-2c45-462a-8320-dc2c54315265 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:45.145962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cc2f8d1-2c45-462a-8320-dc2c54315265 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:45.146921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cc2f8d1-2c45-462a-8320-dc2c54315265 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:45.828572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:45.878458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2d93643b-9cc5-4bf8-9426-f42922b00e8b req-cc3f231e-5d98-4c03-bb44-c6081ddaee1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72bf68c7-e471-4236-952d-53fcc3003e78", "tag": "78f3d958-6986-490e-bd50-e9782c557924"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:38:45.915708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2d93643b-9cc5-4bf8-9426-f42922b00e8b req-cc3f231e-5d98-4c03-bb44-c6081ddaee1f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:45.932211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2d93643b-9cc5-4bf8-9426-f42922b00e8b req-cc3f231e-5d98-4c03-bb44-c6081ddaee1f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:45.960828 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2d93643b-9cc5-4bf8-9426-f42922b00e8b req-cc3f231e-5d98-4c03-bb44-c6081ddaee1f service nova] Creating event network-changed:78f3d958-6986-490e-bd50-e9782c557924 for instance 72bf68c7-e471-4236-952d-53fcc3003e78 on n-h2-833090-9 Jul 26 14:38:46.005300 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2d93643b-9cc5-4bf8-9426-f42922b00e8b req-cc3f231e-5d98-4c03-bb44-c6081ddaee1f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137413 Jul 26 14:38:46.014927 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2557/4996] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:38:46.545392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1cc2f8d1-2c45-462a-8320-dc2c54315265 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:46.558403 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1cc2f8d1-2c45-462a-8320-dc2c54315265 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1392 microversion: 2.1 time: 1.434909 Jul 26 14:38:46.561312 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2440/4997] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:45 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1392 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:46.612515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-130926465", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b17441f1-19fd-4a80-8a44-6db688ba9aca"}], "security_groups": [{"name": "tempest-securitygroup--1994793575"}], "key_name": "tempest-keypair-1249818897", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "efcc2ac8-6cbf-48b0-9b13-4b729ecd6424", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:38:47.215156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] validate_networks() for [('b17441f1-19fd-4a80-8a44-6db688ba9aca', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:38:47.587754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-15e947e8-7837-42ba-9769-36f9e45189c0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:47.591476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-15e947e8-7837-42ba-9769-36f9e45189c0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:47.613550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15e947e8-7837-42ba-9769-36f9e45189c0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:47.615120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15e947e8-7837-42ba-9769-36f9e45189c0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:47.616138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15e947e8-7837-42ba-9769-36f9e45189c0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:47.616910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15e947e8-7837-42ba-9769-36f9e45189c0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:48.139009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-15e947e8-7837-42ba-9769-36f9e45189c0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:48.148241 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-15e947e8-7837-42ba-9769-36f9e45189c0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1392 microversion: 2.1 time: 0.569959 Jul 26 14:38:48.168063 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2441/4998] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:47 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1392 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:48.494835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Getting quotas for project 090816cf27a24b288321f72946ba0ae5. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:38:48.508659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Getting quotas for user 652030dfa72f45fda873b2c86919360a and project 090816cf27a24b288321f72946ba0ae5. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:38:48.535915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:38:48.536763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:38:48.537594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:38:48.538762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:38:48.540210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:38:48.592390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:48.593000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:48.595817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:48.596647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:48.693031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Getting quotas for project 090816cf27a24b288321f72946ba0ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:38:48.705156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Getting quotas for user 652030dfa72f45fda873b2c86919360a and project 090816cf27a24b288321f72946ba0ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:38:48.908299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:38:48.911181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='efcc2ac8-6cbf-48b0-9b13-4b729ecd6424',volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:38:49.192844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c993928f-3eda-4002-867d-1f15eda06849 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:49.193747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c993928f-3eda-4002-867d-1f15eda06849 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:49.214377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c993928f-3eda-4002-867d-1f15eda06849 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:49.214883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c993928f-3eda-4002-867d-1f15eda06849 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:49.218688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c993928f-3eda-4002-867d-1f15eda06849 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:49.220138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c993928f-3eda-4002-867d-1f15eda06849 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:49.251246 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-58847bf1-5ce7-4eb7-9fb5-9941c827b515 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.644368 Jul 26 14:38:49.256791 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2558/4999] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:38:46 2022] POST /compute/v2.1/servers => generated 407 bytes in 2651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:38:49.270910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d3be9d82-2a95-48ff-8ede-9c8c9a76ad3b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:49.275417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d3be9d82-2a95-48ff-8ede-9c8c9a76ad3b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:50.064340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d3be9d82-2a95-48ff-8ede-9c8c9a76ad3b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:50.077713 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d3be9d82-2a95-48ff-8ede-9c8c9a76ad3b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1121 microversion: 2.1 time: 0.818389 Jul 26 14:38:50.080769 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2559/5000] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:49 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1121 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:51.103589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8d1a5be9-6730-44f5-b2ca-34fa28dea837 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:51.106758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8d1a5be9-6730-44f5-b2ca-34fa28dea837 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:51.133180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d1a5be9-6730-44f5-b2ca-34fa28dea837 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:51.134401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d1a5be9-6730-44f5-b2ca-34fa28dea837 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:51.135776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d1a5be9-6730-44f5-b2ca-34fa28dea837 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:51.140620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8d1a5be9-6730-44f5-b2ca-34fa28dea837 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:51.858480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c993928f-3eda-4002-867d-1f15eda06849 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:51.878393 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c993928f-3eda-4002-867d-1f15eda06849 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1392 microversion: 2.1 time: 2.701102 Jul 26 14:38:51.891993 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2442/5001] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:49 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1392 bytes in 2703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:52.006734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8d1a5be9-6730-44f5-b2ca-34fa28dea837 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:52.020526 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8d1a5be9-6730-44f5-b2ca-34fa28dea837 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1219 microversion: 2.1 time: 0.922489 Jul 26 14:38:52.024629 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2560/5002] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:51 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1219 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:52.908025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bdec54a9-b15c-41ed-a529-45998a378bc5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:52.909586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bdec54a9-b15c-41ed-a529-45998a378bc5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:52.927708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bdec54a9-b15c-41ed-a529-45998a378bc5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:52.928203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bdec54a9-b15c-41ed-a529-45998a378bc5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:52.931884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bdec54a9-b15c-41ed-a529-45998a378bc5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:52.932541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bdec54a9-b15c-41ed-a529-45998a378bc5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:53.049446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-356e9858-446e-45bc-9129-9a703715e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:53.050274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-356e9858-446e-45bc-9129-9a703715e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:53.065827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-356e9858-446e-45bc-9129-9a703715e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:53.066456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-356e9858-446e-45bc-9129-9a703715e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:53.067396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-356e9858-446e-45bc-9129-9a703715e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:53.072604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-356e9858-446e-45bc-9129-9a703715e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:53.303558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-356e9858-446e-45bc-9129-9a703715e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:53.315404 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-356e9858-446e-45bc-9129-9a703715e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1237 microversion: 2.1 time: 0.272487 Jul 26 14:38:53.339149 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2561/5003] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:53 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1237 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:53.675873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bdec54a9-b15c-41ed-a529-45998a378bc5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:53.709780 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bdec54a9-b15c-41ed-a529-45998a378bc5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1392 microversion: 2.1 time: 0.807826 Jul 26 14:38:53.714850 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2443/5004] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:52 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1392 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:54.347551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aa933890-b7f4-4296-89ee-7007631c581b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:54.348398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aa933890-b7f4-4296-89ee-7007631c581b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:54.367537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa933890-b7f4-4296-89ee-7007631c581b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:54.368187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa933890-b7f4-4296-89ee-7007631c581b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:54.373361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa933890-b7f4-4296-89ee-7007631c581b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:54.374047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa933890-b7f4-4296-89ee-7007631c581b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:54.735867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f1fbcad8-186c-4397-9573-a92ec1edd8da tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:54.739520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f1fbcad8-186c-4397-9573-a92ec1edd8da tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:54.753732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1fbcad8-186c-4397-9573-a92ec1edd8da tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:54.756803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1fbcad8-186c-4397-9573-a92ec1edd8da tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:54.757885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1fbcad8-186c-4397-9573-a92ec1edd8da tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:54.760841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1fbcad8-186c-4397-9573-a92ec1edd8da tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:55.481778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa933890-b7f4-4296-89ee-7007631c581b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:55.502159 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aa933890-b7f4-4296-89ee-7007631c581b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1305 microversion: 2.1 time: 1.158545 Jul 26 14:38:55.530512 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2562/5005] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:54 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1305 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:56.489149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f1fbcad8-186c-4397-9573-a92ec1edd8da tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:56.503256 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f1fbcad8-186c-4397-9573-a92ec1edd8da tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1392 microversion: 2.1 time: 1.771126 Jul 26 14:38:56.505904 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2444/5006] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:54 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1392 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:56.522757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4e7e6e26-3c97-42ac-98aa-9d064262453b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:56.523528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4e7e6e26-3c97-42ac-98aa-9d064262453b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:56.540329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e7e6e26-3c97-42ac-98aa-9d064262453b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:56.540821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e7e6e26-3c97-42ac-98aa-9d064262453b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:56.541655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e7e6e26-3c97-42ac-98aa-9d064262453b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:56.548348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e7e6e26-3c97-42ac-98aa-9d064262453b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:57.438904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f0e98901-3388-42cc-be45-159c13413bdc req-a8f558af-f25e-4643-adb0-64522bf88cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bf68c7-e471-4236-952d-53fcc3003e78", "name": "network-vif-plugged", "status": "completed", "tag": "78f3d958-6986-490e-bd50-e9782c557924"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:38:57.471419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f0e98901-3388-42cc-be45-159c13413bdc req-a8f558af-f25e-4643-adb0-64522bf88cdc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:57.473765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f0e98901-3388-42cc-be45-159c13413bdc req-a8f558af-f25e-4643-adb0-64522bf88cdc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:57.511618 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f0e98901-3388-42cc-be45-159c13413bdc req-a8f558af-f25e-4643-adb0-64522bf88cdc service nova] Creating event network-vif-plugged:78f3d958-6986-490e-bd50-e9782c557924 for instance 72bf68c7-e471-4236-952d-53fcc3003e78 on n-h2-833090-9 Jul 26 14:38:57.523286 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f0e98901-3388-42cc-be45-159c13413bdc req-a8f558af-f25e-4643-adb0-64522bf88cdc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089914 Jul 26 14:38:57.529033 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2445/5007] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:38:57.543541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-31bf8e6e-2d9e-4fe5-8f9c-23a876d2666c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:57.544301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-31bf8e6e-2d9e-4fe5-8f9c-23a876d2666c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:57.577822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31bf8e6e-2d9e-4fe5-8f9c-23a876d2666c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:57.586522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31bf8e6e-2d9e-4fe5-8f9c-23a876d2666c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:57.587411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31bf8e6e-2d9e-4fe5-8f9c-23a876d2666c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:57.587847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31bf8e6e-2d9e-4fe5-8f9c-23a876d2666c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:58.275106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4e7e6e26-3c97-42ac-98aa-9d064262453b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:58.289721 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4e7e6e26-3c97-42ac-98aa-9d064262453b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1305 microversion: 2.1 time: 1.767822 Jul 26 14:38:58.290354 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2563/5008] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:56 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1305 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:58.715211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31bf8e6e-2d9e-4fe5-8f9c-23a876d2666c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:38:58.749425 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-31bf8e6e-2d9e-4fe5-8f9c-23a876d2666c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1392 microversion: 2.1 time: 1.217530 Jul 26 14:38:58.750039 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2446/5009] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:57 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1392 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:38:59.065798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1dad6156-9a89-4c7d-beaa-b7aa0dd049bd req-d4b6c99e-e3ea-45d3-86ee-bd85c79e5aed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e8fe5d-a576-4b9e-8f16-43bd401179d7", "tag": "cf9ef131-6e59-4eb3-9a3b-4480da5bb14f"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:38:59.082449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:59.093472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1dad6156-9a89-4c7d-beaa-b7aa0dd049bd req-d4b6c99e-e3ea-45d3-86ee-bd85c79e5aed service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:59.094576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1dad6156-9a89-4c7d-beaa-b7aa0dd049bd req-d4b6c99e-e3ea-45d3-86ee-bd85c79e5aed service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:59.131685 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1dad6156-9a89-4c7d-beaa-b7aa0dd049bd req-d4b6c99e-e3ea-45d3-86ee-bd85c79e5aed service nova] Creating event network-changed:cf9ef131-6e59-4eb3-9a3b-4480da5bb14f for instance 47e8fe5d-a576-4b9e-8f16-43bd401179d7 on n-h1-833090-9 Jul 26 14:38:59.140853 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1dad6156-9a89-4c7d-beaa-b7aa0dd049bd req-d4b6c99e-e3ea-45d3-86ee-bd85c79e5aed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080225 Jul 26 14:38:59.142385 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2564/5010] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:38:59.311249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6248853c-ce8c-4072-832e-9d3550033b90 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:59.311891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6248853c-ce8c-4072-832e-9d3550033b90 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:59.329967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6248853c-ce8c-4072-832e-9d3550033b90 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:59.330497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6248853c-ce8c-4072-832e-9d3550033b90 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:59.331304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6248853c-ce8c-4072-832e-9d3550033b90 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:59.331735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6248853c-ce8c-4072-832e-9d3550033b90 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:59.774298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb00f0b8-d965-4771-b504-f0bbb8643b3b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:38:59.775941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cb00f0b8-d965-4771-b504-f0bbb8643b3b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:38:59.801804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:38:59.814095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb00f0b8-d965-4771-b504-f0bbb8643b3b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:59.815220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb00f0b8-d965-4771-b504-f0bbb8643b3b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:59.816798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb00f0b8-d965-4771-b504-f0bbb8643b3b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:38:59.817577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb00f0b8-d965-4771-b504-f0bbb8643b3b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:38:59.832899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=51 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:00.016032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6248853c-ce8c-4072-832e-9d3550033b90 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:00.043487 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6248853c-ce8c-4072-832e-9d3550033b90 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1305 microversion: 2.1 time: 0.736604 Jul 26 14:39:00.046731 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2447/5011] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:59 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1305 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:00.077264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:00.480840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cb00f0b8-d965-4771-b504-f0bbb8643b3b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:00.495914 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cb00f0b8-d965-4771-b504-f0bbb8643b3b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1564 microversion: 2.1 time: 0.728422 Jul 26 14:39:00.511117 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2565/5012] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:38:59 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1564 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:00.518649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-234e87eb-7504-4a7b-8dd1-b0e3a341c2a5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:00.518649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-234e87eb-7504-4a7b-8dd1-b0e3a341c2a5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:00.544674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-234e87eb-7504-4a7b-8dd1-b0e3a341c2a5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:00.550644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-234e87eb-7504-4a7b-8dd1-b0e3a341c2a5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:00.566853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-234e87eb-7504-4a7b-8dd1-b0e3a341c2a5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:00.574558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-234e87eb-7504-4a7b-8dd1-b0e3a341c2a5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:01.067068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6adafd1b-860a-4416-815e-682f71688418 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:01.067778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6adafd1b-860a-4416-815e-682f71688418 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:01.080993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6adafd1b-860a-4416-815e-682f71688418 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:01.089352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6adafd1b-860a-4416-815e-682f71688418 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:01.090392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6adafd1b-860a-4416-815e-682f71688418 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:01.090862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6adafd1b-860a-4416-815e-682f71688418 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:02.640592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-234e87eb-7504-4a7b-8dd1-b0e3a341c2a5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:02.654681 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-234e87eb-7504-4a7b-8dd1-b0e3a341c2a5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1564 microversion: 2.1 time: 2.142282 Jul 26 14:39:02.655541 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2448/5013] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:00 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1564 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:02.722246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6adafd1b-860a-4416-815e-682f71688418 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:02.738235 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6adafd1b-860a-4416-815e-682f71688418 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1305 microversion: 2.1 time: 1.674042 Jul 26 14:39:02.753860 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2566/5014] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:01 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1305 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:03.762086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4351c654-de35-4e09-b339-1f59b00caf95 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:03.762719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4351c654-de35-4e09-b339-1f59b00caf95 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:03.791828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4351c654-de35-4e09-b339-1f59b00caf95 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:03.793226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4351c654-de35-4e09-b339-1f59b00caf95 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:03.794305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4351c654-de35-4e09-b339-1f59b00caf95 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:03.794900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4351c654-de35-4e09-b339-1f59b00caf95 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:04.364731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4351c654-de35-4e09-b339-1f59b00caf95 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:04.378852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=67 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:04.390514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4351c654-de35-4e09-b339-1f59b00caf95 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1293 microversion: 2.1 time: 0.633330 Jul 26 14:39:04.397941 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2449/5015] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:03 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1293 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:05.416252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08980116-1381-4314-b579-a9953022e6dc tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:05.417744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08980116-1381-4314-b579-a9953022e6dc tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:05.438723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08980116-1381-4314-b579-a9953022e6dc tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:05.439850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08980116-1381-4314-b579-a9953022e6dc tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:05.442527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08980116-1381-4314-b579-a9953022e6dc tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:05.444720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08980116-1381-4314-b579-a9953022e6dc tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:05.997947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-08980116-1381-4314-b579-a9953022e6dc tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:06.013135 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08980116-1381-4314-b579-a9953022e6dc tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1293 microversion: 2.1 time: 0.600402 Jul 26 14:39:06.030078 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2567/5016] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:05 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1293 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:07.054680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fad8a8a0-bcd0-4bcc-9227-db22d4a534fb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:07.055578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fad8a8a0-bcd0-4bcc-9227-db22d4a534fb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:07.067589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=29 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:07.071847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fad8a8a0-bcd0-4bcc-9227-db22d4a534fb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:07.073055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fad8a8a0-bcd0-4bcc-9227-db22d4a534fb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:07.073988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fad8a8a0-bcd0-4bcc-9227-db22d4a534fb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:07.074510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fad8a8a0-bcd0-4bcc-9227-db22d4a534fb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:07.620080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fad8a8a0-bcd0-4bcc-9227-db22d4a534fb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:07.633107 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fad8a8a0-bcd0-4bcc-9227-db22d4a534fb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1293 microversion: 2.1 time: 0.595904 Jul 26 14:39:07.648734 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2450/5017] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:07 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1293 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:08.450670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-754340584", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "a6e484ec-0951-45dd-9b52-ba91f55d022b"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:39:08.544114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] validate_networks() for [('a6e484ec-0951-45dd-9b52-ba91f55d022b', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:39:08.661376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22df41ea-a748-4041-9fd2-1608cfd84453 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:08.662879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22df41ea-a748-4041-9fd2-1608cfd84453 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:08.688884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22df41ea-a748-4041-9fd2-1608cfd84453 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:08.692289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22df41ea-a748-4041-9fd2-1608cfd84453 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:08.693556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22df41ea-a748-4041-9fd2-1608cfd84453 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:08.694260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-22df41ea-a748-4041-9fd2-1608cfd84453 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:09.570829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22df41ea-a748-4041-9fd2-1608cfd84453 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:09.603548 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22df41ea-a748-4041-9fd2-1608cfd84453 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1293 microversion: 2.1 time: 0.951660 Jul 26 14:39:09.610597 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2451/5018] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:08 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1293 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:09.635414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-40e3927d-8b17-4540-9503-a13086f12cfe tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:09.638084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-40e3927d-8b17-4540-9503-a13086f12cfe tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:09.661677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40e3927d-8b17-4540-9503-a13086f12cfe tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:09.665112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40e3927d-8b17-4540-9503-a13086f12cfe tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:09.668212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40e3927d-8b17-4540-9503-a13086f12cfe tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:09.668992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40e3927d-8b17-4540-9503-a13086f12cfe tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:10.081061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-40e3927d-8b17-4540-9503-a13086f12cfe tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:10.098058 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-40e3927d-8b17-4540-9503-a13086f12cfe tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1564 microversion: 2.1 time: 0.481461 Jul 26 14:39:10.111977 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2452/5019] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:09 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1564 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:10.113595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:39:10.114543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:39:10.119388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:39:10.121222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:39:10.121941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:39:10.151623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:10.153399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:10.156013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:10.161183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:10.202540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Getting quotas for project ad588279d6564baba27c0ca81b75e24e. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:39:10.209543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Getting quotas for user e7c7403de78e445f928839681bc13c38 and project ad588279d6564baba27c0ca81b75e24e. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:39:10.232400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:39:10.235588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:39:10.314730 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7780d388-27ae-4727-8fbf-ba983f7f3183 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.100208 Jul 26 14:39:10.315819 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2568/5020] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:39:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:39:10.337567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-078ba7d1-7465-4a23-9f1c-5730127ad818 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:10.338567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-078ba7d1-7465-4a23-9f1c-5730127ad818 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:10.471122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-669092f1-30f6-45d6-b972-ce5ccc08397c req-089fa98d-6d63-4356-bff4-3635ece5ae37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72bf68c7-e471-4236-952d-53fcc3003e78", "tag": "78f3d958-6986-490e-bd50-e9782c557924"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:39:10.490272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-078ba7d1-7465-4a23-9f1c-5730127ad818 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:10.497931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-669092f1-30f6-45d6-b972-ce5ccc08397c req-089fa98d-6d63-4356-bff4-3635ece5ae37 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:10.499082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-669092f1-30f6-45d6-b972-ce5ccc08397c req-089fa98d-6d63-4356-bff4-3635ece5ae37 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:10.506058 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-078ba7d1-7465-4a23-9f1c-5730127ad818 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1213 microversion: 2.1 time: 0.177446 Jul 26 14:39:10.522185 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2569/5021] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:10 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:10.536247 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-669092f1-30f6-45d6-b972-ce5ccc08397c req-089fa98d-6d63-4356-bff4-3635ece5ae37 service nova] Creating event network-changed:78f3d958-6986-490e-bd50-e9782c557924 for instance 72bf68c7-e471-4236-952d-53fcc3003e78 on n-h2-833090-9 Jul 26 14:39:10.554797 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-669092f1-30f6-45d6-b972-ce5ccc08397c req-089fa98d-6d63-4356-bff4-3635ece5ae37 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.449183 Jul 26 14:39:10.556630 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2453/5022] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:39:10.631272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-656e1354-9b77-4054-9ab7-3da6730ea535 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:10.632812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-656e1354-9b77-4054-9ab7-3da6730ea535 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:10.651563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-656e1354-9b77-4054-9ab7-3da6730ea535 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:10.653810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-656e1354-9b77-4054-9ab7-3da6730ea535 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:10.656382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-656e1354-9b77-4054-9ab7-3da6730ea535 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:10.656880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-656e1354-9b77-4054-9ab7-3da6730ea535 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:11.326305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-656e1354-9b77-4054-9ab7-3da6730ea535 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:11.345054 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-656e1354-9b77-4054-9ab7-3da6730ea535 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1293 microversion: 2.1 time: 0.716113 Jul 26 14:39:11.348407 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2570/5023] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:10 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1293 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:11.532138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5234ac15-fb15-4e9a-b0ee-739d47141fe5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:11.534685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5234ac15-fb15-4e9a-b0ee-739d47141fe5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:11.688663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5234ac15-fb15-4e9a-b0ee-739d47141fe5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:11.702560 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5234ac15-fb15-4e9a-b0ee-739d47141fe5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1213 microversion: 2.1 time: 0.173659 Jul 26 14:39:11.716216 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2454/5024] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:11 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:12.373448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fb4b0d6d-a840-403b-ad17-fe5ef0fb86f9 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:12.374342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fb4b0d6d-a840-403b-ad17-fe5ef0fb86f9 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:12.400348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb4b0d6d-a840-403b-ad17-fe5ef0fb86f9 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:12.401496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb4b0d6d-a840-403b-ad17-fe5ef0fb86f9 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:12.402703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb4b0d6d-a840-403b-ad17-fe5ef0fb86f9 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:12.403396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb4b0d6d-a840-403b-ad17-fe5ef0fb86f9 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:12.728133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cd8613ac-21e0-4fa6-9016-46c13a42884a tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:12.728657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cd8613ac-21e0-4fa6-9016-46c13a42884a tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:12.742930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd8613ac-21e0-4fa6-9016-46c13a42884a tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:12.749643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd8613ac-21e0-4fa6-9016-46c13a42884a tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:12.750673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd8613ac-21e0-4fa6-9016-46c13a42884a tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:12.751284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd8613ac-21e0-4fa6-9016-46c13a42884a tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:13.283213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cd8613ac-21e0-4fa6-9016-46c13a42884a tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:13.304535 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cd8613ac-21e0-4fa6-9016-46c13a42884a tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1273 microversion: 2.1 time: 0.572114 Jul 26 14:39:13.319865 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2455/5025] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:12 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1273 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:13.876957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fb4b0d6d-a840-403b-ad17-fe5ef0fb86f9 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:13.887331 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fb4b0d6d-a840-403b-ad17-fe5ef0fb86f9 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1293 microversion: 2.1 time: 1.518398 Jul 26 14:39:13.901937 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2571/5026] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:12 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1293 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:14.327128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c0561ff-8708-4289-aa18-fd5ae6719477 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:14.327679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0c0561ff-8708-4289-aa18-fd5ae6719477 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:14.342141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0561ff-8708-4289-aa18-fd5ae6719477 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:14.344123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0561ff-8708-4289-aa18-fd5ae6719477 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:14.349393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0561ff-8708-4289-aa18-fd5ae6719477 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:14.349902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0561ff-8708-4289-aa18-fd5ae6719477 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:14.803014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0c0561ff-8708-4289-aa18-fd5ae6719477 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:14.811899 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c0561ff-8708-4289-aa18-fd5ae6719477 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1271 microversion: 2.1 time: 0.489732 Jul 26 14:39:14.828654 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2456/5027] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:14 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1271 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:14.921605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a12c531d-950a-46bc-9559-c175e70808f6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:14.922910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a12c531d-950a-46bc-9559-c175e70808f6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:14.941054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a12c531d-950a-46bc-9559-c175e70808f6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:14.941424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a12c531d-950a-46bc-9559-c175e70808f6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:14.942256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a12c531d-950a-46bc-9559-c175e70808f6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:14.942705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a12c531d-950a-46bc-9559-c175e70808f6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:15.457328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-af246183-a456-4716-89a3-188b98f751c3 req-3a8437b6-60ae-4277-8cbd-56ee6b4c2165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e8fe5d-a576-4b9e-8f16-43bd401179d7", "name": "network-vif-plugged", "status": "completed", "tag": "cf9ef131-6e59-4eb3-9a3b-4480da5bb14f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:39:15.477669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-af246183-a456-4716-89a3-188b98f751c3 req-3a8437b6-60ae-4277-8cbd-56ee6b4c2165 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:15.478167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-af246183-a456-4716-89a3-188b98f751c3 req-3a8437b6-60ae-4277-8cbd-56ee6b4c2165 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:15.511107 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-af246183-a456-4716-89a3-188b98f751c3 req-3a8437b6-60ae-4277-8cbd-56ee6b4c2165 service nova] Creating event network-vif-plugged:cf9ef131-6e59-4eb3-9a3b-4480da5bb14f for instance 47e8fe5d-a576-4b9e-8f16-43bd401179d7 on n-h1-833090-9 Jul 26 14:39:15.520893 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-af246183-a456-4716-89a3-188b98f751c3 req-3a8437b6-60ae-4277-8cbd-56ee6b4c2165 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210637 Jul 26 14:39:15.522592 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2457/5028] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:39:15.596867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a12c531d-950a-46bc-9559-c175e70808f6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:15.605548 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a12c531d-950a-46bc-9559-c175e70808f6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1293 microversion: 2.1 time: 0.687987 Jul 26 14:39:15.606162 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2572/5029] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:14 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1293 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:15.845578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e941eb1b-14bc-4a3e-8e98-7cb56c5e6cbb tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:15.847104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e941eb1b-14bc-4a3e-8e98-7cb56c5e6cbb tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:15.866459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e941eb1b-14bc-4a3e-8e98-7cb56c5e6cbb tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:15.870434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e941eb1b-14bc-4a3e-8e98-7cb56c5e6cbb tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:15.875517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e941eb1b-14bc-4a3e-8e98-7cb56c5e6cbb tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:15.876955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e941eb1b-14bc-4a3e-8e98-7cb56c5e6cbb tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:16.047249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e941eb1b-14bc-4a3e-8e98-7cb56c5e6cbb tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:16.056209 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e941eb1b-14bc-4a3e-8e98-7cb56c5e6cbb tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1271 microversion: 2.1 time: 0.216596 Jul 26 14:39:16.072545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2458/5030] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:15 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:16.641999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36711721-9e58-49b1-9d5b-7bf4eba8034e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:16.644477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-36711721-9e58-49b1-9d5b-7bf4eba8034e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:16.656473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36711721-9e58-49b1-9d5b-7bf4eba8034e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:16.661271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36711721-9e58-49b1-9d5b-7bf4eba8034e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:16.665290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36711721-9e58-49b1-9d5b-7bf4eba8034e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:16.675890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36711721-9e58-49b1-9d5b-7bf4eba8034e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:17.079078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1c6033a5-f2e9-459f-9165-c127aac51dca tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:17.079707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1c6033a5-f2e9-459f-9165-c127aac51dca tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:17.093260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1c6033a5-f2e9-459f-9165-c127aac51dca tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:17.100563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1c6033a5-f2e9-459f-9165-c127aac51dca tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:17.102877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1c6033a5-f2e9-459f-9165-c127aac51dca tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:17.103494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1c6033a5-f2e9-459f-9165-c127aac51dca tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:17.205371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-36711721-9e58-49b1-9d5b-7bf4eba8034e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:17.229138 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-36711721-9e58-49b1-9d5b-7bf4eba8034e tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1293 microversion: 2.1 time: 0.594605 Jul 26 14:39:17.230472 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2573/5031] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:16 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1293 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:18.254883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-368663db-7dbb-4e49-887e-f408e00b048d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:18.257155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-368663db-7dbb-4e49-887e-f408e00b048d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:18.273775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-368663db-7dbb-4e49-887e-f408e00b048d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:18.276144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-368663db-7dbb-4e49-887e-f408e00b048d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:18.279082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-368663db-7dbb-4e49-887e-f408e00b048d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:18.281018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-368663db-7dbb-4e49-887e-f408e00b048d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:18.381579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1c6033a5-f2e9-459f-9165-c127aac51dca tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:18.393116 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1c6033a5-f2e9-459f-9165-c127aac51dca tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1313 microversion: 2.1 time: 1.318084 Jul 26 14:39:18.394525 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2459/5032] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:17 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1313 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:18.800753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-368663db-7dbb-4e49-887e-f408e00b048d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:18.815887 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-368663db-7dbb-4e49-887e-f408e00b048d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1484 microversion: 2.1 time: 0.565461 Jul 26 14:39:18.816158 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2574/5033] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:18 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1484 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:18.837913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f86e5178-eb7c-455e-91ad-c7735c801046 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:18.838848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f86e5178-eb7c-455e-91ad-c7735c801046 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:18.846286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f86e5178-eb7c-455e-91ad-c7735c801046 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:18.847128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f86e5178-eb7c-455e-91ad-c7735c801046 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:18.848205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f86e5178-eb7c-455e-91ad-c7735c801046 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:18.848871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f86e5178-eb7c-455e-91ad-c7735c801046 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:19.085166 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f86e5178-eb7c-455e-91ad-c7735c801046 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.251787 Jul 26 14:39:19.093756 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2460/5034] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:39:18 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7/os-interface => generated 284 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:39:19.416845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f71afad7-533f-46e7-b314-d987c630bc0f tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:19.418214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f71afad7-533f-46e7-b314-d987c630bc0f tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:19.435736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f71afad7-533f-46e7-b314-d987c630bc0f tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:19.446122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f71afad7-533f-46e7-b314-d987c630bc0f tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:19.447207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f71afad7-533f-46e7-b314-d987c630bc0f tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:19.447918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f71afad7-533f-46e7-b314-d987c630bc0f tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:19.970218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f71afad7-533f-46e7-b314-d987c630bc0f tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:19.989624 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f71afad7-533f-46e7-b314-d987c630bc0f tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1313 microversion: 2.1 time: 0.578298 Jul 26 14:39:19.996248 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2575/5035] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:19 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:20.182388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-35b4c303-34ee-4794-89b3-48c003351b04 req-22719afc-1b6c-4540-8f8a-5ced93eb5e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee477489-615e-4841-b0ad-58637aa8f992", "tag": "8c44072a-f34e-47e0-b0e8-0a8d7e2cb58f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:39:20.208287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-35b4c303-34ee-4794-89b3-48c003351b04 req-22719afc-1b6c-4540-8f8a-5ced93eb5e6b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:20.208847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-35b4c303-34ee-4794-89b3-48c003351b04 req-22719afc-1b6c-4540-8f8a-5ced93eb5e6b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:20.256389 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-35b4c303-34ee-4794-89b3-48c003351b04 req-22719afc-1b6c-4540-8f8a-5ced93eb5e6b service nova] Creating event network-changed:8c44072a-f34e-47e0-b0e8-0a8d7e2cb58f for instance ee477489-615e-4841-b0ad-58637aa8f992 on n-h2-833090-9 Jul 26 14:39:20.266816 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-35b4c303-34ee-4794-89b3-48c003351b04 req-22719afc-1b6c-4540-8f8a-5ced93eb5e6b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091024 Jul 26 14:39:20.276761 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2461/5036] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:39:21.022180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7f6108f4-0df3-459f-b4ae-782c1cbe4064 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:21.024911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7f6108f4-0df3-459f-b4ae-782c1cbe4064 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:21.033901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.036303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:21.041266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f6108f4-0df3-459f-b4ae-782c1cbe4064 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:21.046600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f6108f4-0df3-459f-b4ae-782c1cbe4064 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:21.047826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f6108f4-0df3-459f-b4ae-782c1cbe4064 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:21.050740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f6108f4-0df3-459f-b4ae-782c1cbe4064 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:22.397246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7f6108f4-0df3-459f-b4ae-782c1cbe4064 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:22.415833 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7f6108f4-0df3-459f-b4ae-782c1cbe4064 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1313 microversion: 2.1 time: 1.401470 Jul 26 14:39:22.417887 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2576/5037] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:21 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1313 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:23.443502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-25e596da-597b-4e65-a198-89fb62c5fdab tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:23.444966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-25e596da-597b-4e65-a198-89fb62c5fdab tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:23.449045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:23.464122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25e596da-597b-4e65-a198-89fb62c5fdab tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:23.464792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25e596da-597b-4e65-a198-89fb62c5fdab tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:23.465585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25e596da-597b-4e65-a198-89fb62c5fdab tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:23.466028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25e596da-597b-4e65-a198-89fb62c5fdab tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:23.826308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-25e596da-597b-4e65-a198-89fb62c5fdab tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:23.840588 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-25e596da-597b-4e65-a198-89fb62c5fdab tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1313 microversion: 2.1 time: 0.401570 Jul 26 14:39:23.841017 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2462/5038] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:23 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:24.014447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-65e76f64-e797-486f-8268-7af7f3a4778a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:24.015014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-65e76f64-e797-486f-8268-7af7f3a4778a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:24.028124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-df0625c6-833d-480b-8371-5a20c9417dc0 req-7a03e4af-77b2-47f6-b653-4b4760ae2a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e8fe5d-a576-4b9e-8f16-43bd401179d7", "tag": "cf9ef131-6e59-4eb3-9a3b-4480da5bb14f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:39:24.028577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65e76f64-e797-486f-8268-7af7f3a4778a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:24.029627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65e76f64-e797-486f-8268-7af7f3a4778a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:24.031045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65e76f64-e797-486f-8268-7af7f3a4778a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:24.032287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65e76f64-e797-486f-8268-7af7f3a4778a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:24.051522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-df0625c6-833d-480b-8371-5a20c9417dc0 req-7a03e4af-77b2-47f6-b653-4b4760ae2a0b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:24.054356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-df0625c6-833d-480b-8371-5a20c9417dc0 req-7a03e4af-77b2-47f6-b653-4b4760ae2a0b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:24.086220 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-df0625c6-833d-480b-8371-5a20c9417dc0 req-7a03e4af-77b2-47f6-b653-4b4760ae2a0b service nova] Creating event network-changed:cf9ef131-6e59-4eb3-9a3b-4480da5bb14f for instance 47e8fe5d-a576-4b9e-8f16-43bd401179d7 on n-h1-833090-9 Jul 26 14:39:24.095607 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-df0625c6-833d-480b-8371-5a20c9417dc0 req-7a03e4af-77b2-47f6-b653-4b4760ae2a0b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076476 Jul 26 14:39:24.097527 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2463/5039] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:39:24.581430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-65e76f64-e797-486f-8268-7af7f3a4778a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:24.597372 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-65e76f64-e797-486f-8268-7af7f3a4778a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1484 microversion: 2.1 time: 0.587737 Jul 26 14:39:24.611981 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2577/5040] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:24 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1484 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:24.876474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-48f80533-7738-4c30-90b5-18ad75251d87 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:24.877447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-48f80533-7738-4c30-90b5-18ad75251d87 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:24.905770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48f80533-7738-4c30-90b5-18ad75251d87 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:24.906253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48f80533-7738-4c30-90b5-18ad75251d87 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:24.907075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48f80533-7738-4c30-90b5-18ad75251d87 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:24.907535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-48f80533-7738-4c30-90b5-18ad75251d87 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:25.619731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-48f80533-7738-4c30-90b5-18ad75251d87 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:25.642466 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-48f80533-7738-4c30-90b5-18ad75251d87 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1313 microversion: 2.1 time: 0.785145 Jul 26 14:39:25.643458 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2464/5041] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:24 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:26.670089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-91fb6ba6-69ed-42ab-8abd-b44f89bcc6e7 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:26.671445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-91fb6ba6-69ed-42ab-8abd-b44f89bcc6e7 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:26.685648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91fb6ba6-69ed-42ab-8abd-b44f89bcc6e7 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:26.686125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91fb6ba6-69ed-42ab-8abd-b44f89bcc6e7 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:26.689485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91fb6ba6-69ed-42ab-8abd-b44f89bcc6e7 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:26.690107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-91fb6ba6-69ed-42ab-8abd-b44f89bcc6e7 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:27.217341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-91fb6ba6-69ed-42ab-8abd-b44f89bcc6e7 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:27.227127 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-91fb6ba6-69ed-42ab-8abd-b44f89bcc6e7 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1313 microversion: 2.1 time: 0.561475 Jul 26 14:39:27.228331 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2578/5042] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:26 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:28.250680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d61561b0-fa63-4a48-a8b9-3bf54907e6f2 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:28.251441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d61561b0-fa63-4a48-a8b9-3bf54907e6f2 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:28.262541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d61561b0-fa63-4a48-a8b9-3bf54907e6f2 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:28.263160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d61561b0-fa63-4a48-a8b9-3bf54907e6f2 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:28.263877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d61561b0-fa63-4a48-a8b9-3bf54907e6f2 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:28.264514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d61561b0-fa63-4a48-a8b9-3bf54907e6f2 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:28.703364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d61561b0-fa63-4a48-a8b9-3bf54907e6f2 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:28.717570 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d61561b0-fa63-4a48-a8b9-3bf54907e6f2 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1313 microversion: 2.1 time: 0.471042 Jul 26 14:39:28.721007 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2465/5043] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:28 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:28.805312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a087a629-bd5e-47bc-afbe-1129e8383707 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:39:28.809361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a087a629-bd5e-47bc-afbe-1129e8383707 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:28.831135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a087a629-bd5e-47bc-afbe-1129e8383707 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:28.832855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a087a629-bd5e-47bc-afbe-1129e8383707 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:28.834791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a087a629-bd5e-47bc-afbe-1129e8383707 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:28.836315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a087a629-bd5e-47bc-afbe-1129e8383707 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:28.918073 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a087a629-bd5e-47bc-afbe-1129e8383707 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78/action" status: 200 len: 24565 microversion: 2.1 time: 0.121797 Jul 26 14:39:28.918788 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2579/5044] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:39:28 2022] POST /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78/action => generated 24565 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:39:28.960678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a058d919-4c6d-4bf6-b006-ef31ae6ee551 req-e1306567-7584-48a2-836b-0230855cde64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee477489-615e-4841-b0ad-58637aa8f992", "name": "network-vif-plugged", "status": "completed", "tag": "8c44072a-f34e-47e0-b0e8-0a8d7e2cb58f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:39:28.998235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a058d919-4c6d-4bf6-b006-ef31ae6ee551 req-e1306567-7584-48a2-836b-0230855cde64 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:28.998679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a058d919-4c6d-4bf6-b006-ef31ae6ee551 req-e1306567-7584-48a2-836b-0230855cde64 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:29.022097 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a058d919-4c6d-4bf6-b006-ef31ae6ee551 req-e1306567-7584-48a2-836b-0230855cde64 service nova] Creating event network-vif-plugged:8c44072a-f34e-47e0-b0e8-0a8d7e2cb58f for instance ee477489-615e-4841-b0ad-58637aa8f992 on n-h2-833090-9 Jul 26 14:39:29.046964 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a058d919-4c6d-4bf6-b006-ef31ae6ee551 req-e1306567-7584-48a2-836b-0230855cde64 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092470 Jul 26 14:39:29.061204 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2466/5045] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:39:29.745985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3ef272d-5118-42ba-858d-d1f5ffb408f0 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:29.746988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3ef272d-5118-42ba-858d-d1f5ffb408f0 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:29.764192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3ef272d-5118-42ba-858d-d1f5ffb408f0 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:29.766268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3ef272d-5118-42ba-858d-d1f5ffb408f0 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:29.769393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3ef272d-5118-42ba-858d-d1f5ffb408f0 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:29.773372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3ef272d-5118-42ba-858d-d1f5ffb408f0 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:30.143295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a3ef272d-5118-42ba-858d-d1f5ffb408f0 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:30.147731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=82 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:30.158752 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a3ef272d-5118-42ba-858d-d1f5ffb408f0 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1313 microversion: 2.1 time: 0.418920 Jul 26 14:39:30.174605 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2580/5046] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:29 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:31.184676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-141c3d2f-1baf-46ce-8f1d-8a9ebe923bed tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:31.185392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-141c3d2f-1baf-46ce-8f1d-8a9ebe923bed tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:31.209408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-141c3d2f-1baf-46ce-8f1d-8a9ebe923bed tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:31.210085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-141c3d2f-1baf-46ce-8f1d-8a9ebe923bed tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:31.210982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-141c3d2f-1baf-46ce-8f1d-8a9ebe923bed tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:31.211507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-141c3d2f-1baf-46ce-8f1d-8a9ebe923bed tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:31.511482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-141c3d2f-1baf-46ce-8f1d-8a9ebe923bed tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:31.520648 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-141c3d2f-1baf-46ce-8f1d-8a9ebe923bed tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1497 microversion: 2.1 time: 0.340746 Jul 26 14:39:31.521419 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2467/5047] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:31 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1497 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:37.577747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7fefc1d3-1f59-4691-ad88-870ce40eeb97 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:37.581803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7fefc1d3-1f59-4691-ad88-870ce40eeb97 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:37.604640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:37.650360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fefc1d3-1f59-4691-ad88-870ce40eeb97 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:37.656421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fefc1d3-1f59-4691-ad88-870ce40eeb97 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:37.666757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fefc1d3-1f59-4691-ad88-870ce40eeb97 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:37.671603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fefc1d3-1f59-4691-ad88-870ce40eeb97 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:37.855360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7fefc1d3-1f59-4691-ad88-870ce40eeb97 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:39:38.147967 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7fefc1d3-1f59-4691-ad88-870ce40eeb97 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 204 len: 0 microversion: 2.1 time: 0.577054 Jul 26 14:39:38.150485 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2581/5048] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:39:37 2022] DELETE /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:38.160927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae22d44f-4cd2-40a1-b91b-8e0bf929284e tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:38.162186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ae22d44f-4cd2-40a1-b91b-8e0bf929284e tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:38.173207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=38 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:38.176640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae22d44f-4cd2-40a1-b91b-8e0bf929284e tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:38.177514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae22d44f-4cd2-40a1-b91b-8e0bf929284e tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:38.180467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae22d44f-4cd2-40a1-b91b-8e0bf929284e tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:38.181446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae22d44f-4cd2-40a1-b91b-8e0bf929284e tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:38.190254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=82 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:38.755008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ae22d44f-4cd2-40a1-b91b-8e0bf929284e tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:38.782668 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ae22d44f-4cd2-40a1-b91b-8e0bf929284e tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1503 microversion: 2.1 time: 0.626534 Jul 26 14:39:38.785282 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2468/5049] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:38 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1503 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:39.825191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1e1003f6-4297-4bf0-b826-7f7b36f7f622 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:39.828411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1e1003f6-4297-4bf0-b826-7f7b36f7f622 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:39.838876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e1003f6-4297-4bf0-b826-7f7b36f7f622 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:39.839505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e1003f6-4297-4bf0-b826-7f7b36f7f622 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:39.840514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e1003f6-4297-4bf0-b826-7f7b36f7f622 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:39.841249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e1003f6-4297-4bf0-b826-7f7b36f7f622 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:40.109043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-76ef1cf4-4bc9-41fb-8718-e38329a4a930 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:40.110307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76ef1cf4-4bc9-41fb-8718-e38329a4a930 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:40.129425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76ef1cf4-4bc9-41fb-8718-e38329a4a930 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:40.134023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76ef1cf4-4bc9-41fb-8718-e38329a4a930 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:40.136283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76ef1cf4-4bc9-41fb-8718-e38329a4a930 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:40.139114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76ef1cf4-4bc9-41fb-8718-e38329a4a930 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:40.457464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1e1003f6-4297-4bf0-b826-7f7b36f7f622 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:40.473503 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1e1003f6-4297-4bf0-b826-7f7b36f7f622 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1503 microversion: 2.1 time: 0.658888 Jul 26 14:39:40.474471 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2582/5050] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:39 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1503 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:40.925429 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-76ef1cf4-4bc9-41fb-8718-e38329a4a930 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1834 microversion: 2.1 time: 0.821330 Jul 26 14:39:40.930258 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2469/5051] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:40 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1834 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:40.960583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7077adf8-4997-45ff-8021-ff1a53c52758 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:40.961379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7077adf8-4997-45ff-8021-ff1a53c52758 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:41.005798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7077adf8-4997-45ff-8021-ff1a53c52758 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:41.008782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7077adf8-4997-45ff-8021-ff1a53c52758 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:41.010946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7077adf8-4997-45ff-8021-ff1a53c52758 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:41.013064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7077adf8-4997-45ff-8021-ff1a53c52758 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:41.369930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7077adf8-4997-45ff-8021-ff1a53c52758 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:41.380136 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7077adf8-4997-45ff-8021-ff1a53c52758 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1683 microversion: 2.1 time: 0.425932 Jul 26 14:39:41.386453 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2583/5052] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:40 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1683 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:41.500072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c8d5452-bd81-4599-a65b-ca1b942e6cc9 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:41.501571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c8d5452-bd81-4599-a65b-ca1b942e6cc9 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:41.531870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c8d5452-bd81-4599-a65b-ca1b942e6cc9 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:41.534228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c8d5452-bd81-4599-a65b-ca1b942e6cc9 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:41.535274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c8d5452-bd81-4599-a65b-ca1b942e6cc9 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:41.539630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c8d5452-bd81-4599-a65b-ca1b942e6cc9 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:41.874996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b489c71-7b4f-40e7-9122-0aa97087f2d4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:39:41.877759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7b489c71-7b4f-40e7-9122-0aa97087f2d4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:41.893779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b489c71-7b4f-40e7-9122-0aa97087f2d4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:41.894392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b489c71-7b4f-40e7-9122-0aa97087f2d4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:41.895216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b489c71-7b4f-40e7-9122-0aa97087f2d4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:41.895655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b489c71-7b4f-40e7-9122-0aa97087f2d4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:41.911901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7c8d5452-bd81-4599-a65b-ca1b942e6cc9 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7403de78e445f928839681bc13c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad588279d6564baba27c0ca81b75e24e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:41.934021 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c8d5452-bd81-4599-a65b-ca1b942e6cc9 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 200 len: 1461 microversion: 2.1 time: 0.437608 Jul 26 14:39:41.948526 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2470/5053] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:41 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 1461 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:42.010296 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b489c71-7b4f-40e7-9122-0aa97087f2d4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78/action" status: 200 len: 32641 microversion: 2.1 time: 0.145186 Jul 26 14:39:42.018544 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2584/5054] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:39:41 2022] POST /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78/action => generated 32641 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:39:42.213053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c051b930-b9a8-4701-95c8-9d15268f1ad8 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:39:42.213752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c051b930-b9a8-4701-95c8-9d15268f1ad8 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:42.243552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c051b930-b9a8-4701-95c8-9d15268f1ad8 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:42.249589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c051b930-b9a8-4701-95c8-9d15268f1ad8 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:42.251165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c051b930-b9a8-4701-95c8-9d15268f1ad8 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:42.252067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c051b930-b9a8-4701-95c8-9d15268f1ad8 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:42.330047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-321e098b-0df7-4c6f-a7ee-84ef3bd92e0f req-dcbc5b52-8244-43ec-b2c6-488b0b261e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee477489-615e-4841-b0ad-58637aa8f992", "name": "network-vif-deleted", "tag": "8c44072a-f34e-47e0-b0e8-0a8d7e2cb58f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:39:42.375552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-321e098b-0df7-4c6f-a7ee-84ef3bd92e0f req-dcbc5b52-8244-43ec-b2c6-488b0b261e44 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:42.378203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-321e098b-0df7-4c6f-a7ee-84ef3bd92e0f req-dcbc5b52-8244-43ec-b2c6-488b0b261e44 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:42.451756 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-321e098b-0df7-4c6f-a7ee-84ef3bd92e0f req-dcbc5b52-8244-43ec-b2c6-488b0b261e44 service nova] Creating event network-vif-deleted:8c44072a-f34e-47e0-b0e8-0a8d7e2cb58f for instance ee477489-615e-4841-b0ad-58637aa8f992 on n-h2-833090-9 Jul 26 14:39:42.462145 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-321e098b-0df7-4c6f-a7ee-84ef3bd92e0f req-dcbc5b52-8244-43ec-b2c6-488b0b261e44 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.471095 Jul 26 14:39:42.465460 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2471/5055] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:39:42.966524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c051b930-b9a8-4701-95c8-9d15268f1ad8 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b65671a725e54791895ce4dae0cc612f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e3592211f04adfa75cb067cc8e22ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:42.967468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c051b930-b9a8-4701-95c8-9d15268f1ad8 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] flavor_id is None. Assuming migration. {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 14:39:42.968214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c051b930-b9a8-4701-95c8-9d15268f1ad8 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 14:39:42.999249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d8a3099-583e-4bb5-a699-df2a4864f2c5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:43.004335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d8a3099-583e-4bb5-a699-df2a4864f2c5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] [instance: ee477489-615e-4841-b0ad-58637aa8f992] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:43.046062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d8a3099-583e-4bb5-a699-df2a4864f2c5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:43.046674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d8a3099-583e-4bb5-a699-df2a4864f2c5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:43.047700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d8a3099-583e-4bb5-a699-df2a4864f2c5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:43.049048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d8a3099-583e-4bb5-a699-df2a4864f2c5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:43.194250 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-0d8a3099-583e-4bb5-a699-df2a4864f2c5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] HTTP exception thrown: Instance ee477489-615e-4841-b0ad-58637aa8f992 could not be found. Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d8a3099-583e-4bb5-a699-df2a4864f2c5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Request method failure captured: Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 HTTP/1.1 Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_yHBbKBzjDK364VZ8BM660jzt8_S8WQjVgL4TaZ2CgXcIr2iFtBXdo3MYgXpAUuKt3vPPxQrWr2fj8KuuXuvMoiIy-2xggAQCTv_MBDDzFhDyZ_G6BRzcz_8F8nReiy9T2PhyutVNIzTFzdN1fBpOoaSNwTjPkMQ6eXbG_8kXJm5hU Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: ad588279d6564baba27c0ca81b75e24e Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-VolumesActionsTest-1210994762 Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ad588279d6564baba27c0ca81b75e24e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ad588279d6564baba27c0ca81b75e24e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ad588279d6564baba27c0ca81b75e24e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ad588279d6564baba27c0ca81b75e24e"}]}] Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-VolumesActionsTest-1210994762 Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: ad588279d6564baba27c0ca81b75e24e Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-VolumesActionsTest-1210994762 Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-VolumesActionsTest-1210994762-project Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: e7c7403de78e445f928839681bc13c38 Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-VolumesActionsTest-1210994762-project Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance ee477489-615e-4841-b0ad-58637aa8f992 could not be found. Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'ee477489-615e-4841-b0ad-58637aa8f992'} Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee477489-615e-4841-b0ad-58637aa8f992 could not be found. Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee477489-615e-4841-b0ad-58637aa8f992 could not be found. Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:39:43.197688 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:39:43.208243 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:39:43.208243 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:39:43.208243 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:39:43.208243 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:39:43.208243 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:39:43.208243 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee477489-615e-4841-b0ad-58637aa8f992 could not be found. Jul 26 14:39:43.208243 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:39:43.212878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d8a3099-583e-4bb5-a699-df2a4864f2c5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] Returning 404 to user: Instance ee477489-615e-4841-b0ad-58637aa8f992 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:39:43.228402 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d8a3099-583e-4bb5-a699-df2a4864f2c5 tempest-VolumesActionsTest-1210994762 tempest-VolumesActionsTest-1210994762-project] 10.222.0.70 "GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992" status: 404 len: 111 microversion: 2.1 time: 0.239300 Jul 26 14:39:43.231768 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2472/5056] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:42 2022] GET /compute/v2.1/servers/ee477489-615e-4841-b0ad-58637aa8f992 => generated 111 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:39:44.628770 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c051b930-b9a8-4701-95c8-9d15268f1ad8 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78/action" status: 202 len: 0 microversion: 2.1 time: 2.419163 Jul 26 14:39:44.638716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-267208bf-be31-4317-9b38-86cd117886c4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:44.639379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-267208bf-be31-4317-9b38-86cd117886c4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:44.649020 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2585/5057] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:39:42 2022] POST /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78/action => generated 0 bytes in 2441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:39:44.660430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-267208bf-be31-4317-9b38-86cd117886c4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:44.662197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-267208bf-be31-4317-9b38-86cd117886c4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:44.663758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-267208bf-be31-4317-9b38-86cd117886c4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:44.664489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-267208bf-be31-4317-9b38-86cd117886c4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:45.191153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-267208bf-be31-4317-9b38-86cd117886c4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:45.207807 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-267208bf-be31-4317-9b38-86cd117886c4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1692 microversion: 2.1 time: 0.573281 Jul 26 14:39:45.208503 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2473/5058] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:44 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1692 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:46.234721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0861e557-9925-4128-bfb7-1c1e87904970 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:46.236233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0861e557-9925-4128-bfb7-1c1e87904970 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:46.255242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0861e557-9925-4128-bfb7-1c1e87904970 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:46.268404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0861e557-9925-4128-bfb7-1c1e87904970 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:46.271132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0861e557-9925-4128-bfb7-1c1e87904970 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:46.271609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0861e557-9925-4128-bfb7-1c1e87904970 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:46.908723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0861e557-9925-4128-bfb7-1c1e87904970 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:46.917948 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0861e557-9925-4128-bfb7-1c1e87904970 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1692 microversion: 2.1 time: 0.687688 Jul 26 14:39:46.932720 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2586/5059] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:46 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1692 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:47.944582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e77b9c42-ba91-4f3e-b513-81bc94ba058f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:47.946427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e77b9c42-ba91-4f3e-b513-81bc94ba058f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:47.976833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e77b9c42-ba91-4f3e-b513-81bc94ba058f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:47.977976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e77b9c42-ba91-4f3e-b513-81bc94ba058f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:47.978839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e77b9c42-ba91-4f3e-b513-81bc94ba058f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:47.979283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e77b9c42-ba91-4f3e-b513-81bc94ba058f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:48.659647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e77b9c42-ba91-4f3e-b513-81bc94ba058f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:48.674829 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e77b9c42-ba91-4f3e-b513-81bc94ba058f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1692 microversion: 2.1 time: 0.733740 Jul 26 14:39:48.689121 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2474/5060] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:47 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1692 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:49.701414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3a3e9f0-b364-42de-bb23-7d0e1a703b0d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:49.702950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b3a3e9f0-b364-42de-bb23-7d0e1a703b0d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:49.719084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3a3e9f0-b364-42de-bb23-7d0e1a703b0d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:49.720505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3a3e9f0-b364-42de-bb23-7d0e1a703b0d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:49.723799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3a3e9f0-b364-42de-bb23-7d0e1a703b0d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:49.729216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3a3e9f0-b364-42de-bb23-7d0e1a703b0d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:50.168386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3a3e9f0-b364-42de-bb23-7d0e1a703b0d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:50.178776 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3a3e9f0-b364-42de-bb23-7d0e1a703b0d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1692 microversion: 2.1 time: 0.481331 Jul 26 14:39:50.182663 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2587/5061] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:49 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1692 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:51.225983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8f0dffe5-dd99-4b61-9332-40d19f702599 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:51.233024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8f0dffe5-dd99-4b61-9332-40d19f702599 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:51.264165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f0dffe5-dd99-4b61-9332-40d19f702599 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:51.270342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f0dffe5-dd99-4b61-9332-40d19f702599 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:51.270887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f0dffe5-dd99-4b61-9332-40d19f702599 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:51.271469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f0dffe5-dd99-4b61-9332-40d19f702599 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:51.819517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8f0dffe5-dd99-4b61-9332-40d19f702599 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:51.837191 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8f0dffe5-dd99-4b61-9332-40d19f702599 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1697 microversion: 2.1 time: 0.625143 Jul 26 14:39:51.838253 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2475/5062] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:51 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1697 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:52.861991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b1915162-dc2f-4265-9d1f-249746cd22ea tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:52.862713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b1915162-dc2f-4265-9d1f-249746cd22ea tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:52.873979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1915162-dc2f-4265-9d1f-249746cd22ea tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:52.881994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1915162-dc2f-4265-9d1f-249746cd22ea tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:52.883875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1915162-dc2f-4265-9d1f-249746cd22ea tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:52.888857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1915162-dc2f-4265-9d1f-249746cd22ea tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:53.307761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1915162-dc2f-4265-9d1f-249746cd22ea tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:53.320492 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b1915162-dc2f-4265-9d1f-249746cd22ea tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1697 microversion: 2.1 time: 0.462480 Jul 26 14:39:53.342949 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2588/5063] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:52 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1697 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:54.356616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b6b19865-5989-4c7f-8d55-eeebe0740e70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:54.358601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b6b19865-5989-4c7f-8d55-eeebe0740e70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:54.371792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6b19865-5989-4c7f-8d55-eeebe0740e70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:54.375590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6b19865-5989-4c7f-8d55-eeebe0740e70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:54.377341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6b19865-5989-4c7f-8d55-eeebe0740e70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:54.377817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6b19865-5989-4c7f-8d55-eeebe0740e70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:54.924621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b6b19865-5989-4c7f-8d55-eeebe0740e70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:54.937662 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b6b19865-5989-4c7f-8d55-eeebe0740e70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1697 microversion: 2.1 time: 0.582215 Jul 26 14:39:54.938909 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2476/5064] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:54 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1697 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:55.962469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1828c89c-3414-467a-8c8f-adc43d24cabd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:55.963094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1828c89c-3414-467a-8c8f-adc43d24cabd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:55.984077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1828c89c-3414-467a-8c8f-adc43d24cabd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:55.987088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1828c89c-3414-467a-8c8f-adc43d24cabd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:55.989377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1828c89c-3414-467a-8c8f-adc43d24cabd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:55.993796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1828c89c-3414-467a-8c8f-adc43d24cabd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:56.601687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1828c89c-3414-467a-8c8f-adc43d24cabd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:56.616142 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1828c89c-3414-467a-8c8f-adc43d24cabd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1697 microversion: 2.1 time: 0.656256 Jul 26 14:39:56.633804 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2589/5065] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:55 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1697 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:57.644206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a0424bc8-806f-4ba6-9483-b1406fe9de70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:57.645620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a0424bc8-806f-4ba6-9483-b1406fe9de70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:57.674938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a0424bc8-806f-4ba6-9483-b1406fe9de70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:57.677180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a0424bc8-806f-4ba6-9483-b1406fe9de70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:57.681046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a0424bc8-806f-4ba6-9483-b1406fe9de70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:57.684138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a0424bc8-806f-4ba6-9483-b1406fe9de70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:57.728893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ff6a9ba7-aafa-4c70-98b9-d0f8a7b886d6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:57.737793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ff6a9ba7-aafa-4c70-98b9-d0f8a7b886d6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:57.743283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ff6a9ba7-aafa-4c70-98b9-d0f8a7b886d6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Searching by: {'deleted': False, 'project_id': '090816cf27a24b288321f72946ba0ae5'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:39:57.758403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff6a9ba7-aafa-4c70-98b9-d0f8a7b886d6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:57.759043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff6a9ba7-aafa-4c70-98b9-d0f8a7b886d6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:57.759678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff6a9ba7-aafa-4c70-98b9-d0f8a7b886d6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:57.764584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff6a9ba7-aafa-4c70-98b9-d0f8a7b886d6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:57.841038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-ff6a9ba7-aafa-4c70-98b9-d0f8a7b886d6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:39:57.901488 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ff6a9ba7-aafa-4c70-98b9-d0f8a7b886d6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.176669 Jul 26 14:39:57.903862 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2590/5066] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 14:39:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:39:57.916893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:57.929312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:57.930468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Searching by: {'deleted': False, 'project_id': '090816cf27a24b288321f72946ba0ae5'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 14:39:57.940868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:57.941643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:57.942655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:57.943318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:57.985695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 14:39:58.101588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:58.110272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:58.111273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:58.469652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a0424bc8-806f-4ba6-9483-b1406fe9de70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:39:58.499177 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a0424bc8-806f-4ba6-9483-b1406fe9de70 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1697 microversion: 2.1 time: 0.860075 Jul 26 14:39:58.500610 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2477/5067] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:57 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1697 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:39:58.591044 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b9be92ad-d087-41bb-8134-882bbcd28d0d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.678744 Jul 26 14:39:58.600499 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2591/5068] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:39:57 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:39:58.627774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6a2cee74-52f9-410f-9fb0-83faaad44099 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:58.647666 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6a2cee74-52f9-410f-9fb0-83faaad44099 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024063 Jul 26 14:39:58.657252 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2478/5069] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Jul 26 14:39:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:39:59.033109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-97b7eb7a-1098-4d85-af5c-863b876b9f3a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:59.034799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-97b7eb7a-1098-4d85-af5c-863b876b9f3a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:59.051820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b7eb7a-1098-4d85-af5c-863b876b9f3a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:59.054035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b7eb7a-1098-4d85-af5c-863b876b9f3a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:59.068324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b7eb7a-1098-4d85-af5c-863b876b9f3a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:59.069748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b7eb7a-1098-4d85-af5c-863b876b9f3a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:59.126433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-97b7eb7a-1098-4d85-af5c-863b876b9f3a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:39:59.220520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:39:59.376448 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-97b7eb7a-1098-4d85-af5c-863b876b9f3a tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "DELETE /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 204 len: 0 microversion: 2.1 time: 0.348702 Jul 26 14:39:59.379044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2592/5070] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:39:59 2022] DELETE /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:39:59.389339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-578b38bb-738c-4d79-94c7-833382718aa5 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:59.390371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-578b38bb-738c-4d79-94c7-833382718aa5 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:59.418630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-578b38bb-738c-4d79-94c7-833382718aa5 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:59.438836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-578b38bb-738c-4d79-94c7-833382718aa5 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:59.439901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-578b38bb-738c-4d79-94c7-833382718aa5 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:59.440405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-578b38bb-738c-4d79-94c7-833382718aa5 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:59.534066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6f7db204-7aa5-49fd-af35-2dd892c8b8a7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:39:59.534812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6f7db204-7aa5-49fd-af35-2dd892c8b8a7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:39:59.559822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f7db204-7aa5-49fd-af35-2dd892c8b8a7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:59.560483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f7db204-7aa5-49fd-af35-2dd892c8b8a7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:39:59.561352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f7db204-7aa5-49fd-af35-2dd892c8b8a7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:39:59.561814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f7db204-7aa5-49fd-af35-2dd892c8b8a7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:00.019268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6f7db204-7aa5-49fd-af35-2dd892c8b8a7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:00.031663 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6f7db204-7aa5-49fd-af35-2dd892c8b8a7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1697 microversion: 2.1 time: 0.503303 Jul 26 14:40:00.033280 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2593/5071] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:59 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1697 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:00.234238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-578b38bb-738c-4d79-94c7-833382718aa5 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:00.253913 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-578b38bb-738c-4d79-94c7-833382718aa5 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1608 microversion: 2.1 time: 0.870069 Jul 26 14:40:00.255380 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2479/5072] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:39:59 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1608 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:01.054038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-88b2aeaa-7be8-4b69-bbbd-b80fba19c7f8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:01.054837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-88b2aeaa-7be8-4b69-bbbd-b80fba19c7f8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:01.068425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88b2aeaa-7be8-4b69-bbbd-b80fba19c7f8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:01.077632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88b2aeaa-7be8-4b69-bbbd-b80fba19c7f8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:01.080038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88b2aeaa-7be8-4b69-bbbd-b80fba19c7f8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:01.082224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88b2aeaa-7be8-4b69-bbbd-b80fba19c7f8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:01.280488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f5d350e4-622e-4e92-9ffd-7a69a6b07042 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:01.284789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f5d350e4-622e-4e92-9ffd-7a69a6b07042 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:01.313057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f5d350e4-622e-4e92-9ffd-7a69a6b07042 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:01.313550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f5d350e4-622e-4e92-9ffd-7a69a6b07042 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:01.319569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f5d350e4-622e-4e92-9ffd-7a69a6b07042 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:01.320071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f5d350e4-622e-4e92-9ffd-7a69a6b07042 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:02.890116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-88b2aeaa-7be8-4b69-bbbd-b80fba19c7f8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:02.897995 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-88b2aeaa-7be8-4b69-bbbd-b80fba19c7f8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1697 microversion: 2.1 time: 1.848276 Jul 26 14:40:02.898723 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2594/5073] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:01 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1697 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:02.964301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f5d350e4-622e-4e92-9ffd-7a69a6b07042 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:02.997996 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f5d350e4-622e-4e92-9ffd-7a69a6b07042 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1608 microversion: 2.1 time: 1.720931 Jul 26 14:40:03.007986 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2480/5074] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:01 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1608 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:40:03.921064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-246a1b8d-6f3e-4447-9436-ce38f671ebd0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:03.922409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-246a1b8d-6f3e-4447-9436-ce38f671ebd0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:03.945470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-246a1b8d-6f3e-4447-9436-ce38f671ebd0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:03.950064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-246a1b8d-6f3e-4447-9436-ce38f671ebd0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:03.955255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-246a1b8d-6f3e-4447-9436-ce38f671ebd0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:03.956701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-246a1b8d-6f3e-4447-9436-ce38f671ebd0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:04.031517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-54cae969-7798-4802-96c5-a1266a0efdcd tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:04.032270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-54cae969-7798-4802-96c5-a1266a0efdcd tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:04.048883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54cae969-7798-4802-96c5-a1266a0efdcd tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:04.049483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54cae969-7798-4802-96c5-a1266a0efdcd tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:04.050902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54cae969-7798-4802-96c5-a1266a0efdcd tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:04.051429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54cae969-7798-4802-96c5-a1266a0efdcd tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:04.440161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-54cae969-7798-4802-96c5-a1266a0efdcd tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:04.452261 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-54cae969-7798-4802-96c5-a1266a0efdcd tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1540 microversion: 2.1 time: 0.424865 Jul 26 14:40:04.456227 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2481/5075] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:04 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1540 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:04.983227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-246a1b8d-6f3e-4447-9436-ce38f671ebd0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:04.997378 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-246a1b8d-6f3e-4447-9436-ce38f671ebd0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1697 microversion: 2.1 time: 1.082237 Jul 26 14:40:05.000668 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2595/5076] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:03 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1697 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:05.480953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e271ab31-71f0-4532-918c-63c2e99b57bb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:05.481603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e271ab31-71f0-4532-918c-63c2e99b57bb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:05.526864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e271ab31-71f0-4532-918c-63c2e99b57bb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:05.532214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e271ab31-71f0-4532-918c-63c2e99b57bb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:05.540152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e271ab31-71f0-4532-918c-63c2e99b57bb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:05.547091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e271ab31-71f0-4532-918c-63c2e99b57bb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:06.022577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5f268d03-72a0-41f9-9b24-de08e0d9ee35 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:06.024136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5f268d03-72a0-41f9-9b24-de08e0d9ee35 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:06.061203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f268d03-72a0-41f9-9b24-de08e0d9ee35 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:06.071151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f268d03-72a0-41f9-9b24-de08e0d9ee35 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:06.093191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f268d03-72a0-41f9-9b24-de08e0d9ee35 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:06.101244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f268d03-72a0-41f9-9b24-de08e0d9ee35 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:06.118511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e271ab31-71f0-4532-918c-63c2e99b57bb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:06.126850 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e271ab31-71f0-4532-918c-63c2e99b57bb tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1540 microversion: 2.1 time: 0.656023 Jul 26 14:40:06.139791 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2482/5077] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:05 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1540 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:06.406609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-110082d2-c722-4dc2-9c80-3dabb12030fd req-540b61d3-3095-4b36-a2ab-89d2e340910a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e8fe5d-a576-4b9e-8f16-43bd401179d7", "name": "network-vif-deleted", "tag": "cf9ef131-6e59-4eb3-9a3b-4480da5bb14f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:06.444935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-110082d2-c722-4dc2-9c80-3dabb12030fd req-540b61d3-3095-4b36-a2ab-89d2e340910a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:06.449045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-110082d2-c722-4dc2-9c80-3dabb12030fd req-540b61d3-3095-4b36-a2ab-89d2e340910a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:06.499804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-110082d2-c722-4dc2-9c80-3dabb12030fd req-540b61d3-3095-4b36-a2ab-89d2e340910a service nova] Creating event network-vif-deleted:cf9ef131-6e59-4eb3-9a3b-4480da5bb14f for instance 47e8fe5d-a576-4b9e-8f16-43bd401179d7 on n-h1-833090-9 Jul 26 14:40:06.518945 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-110082d2-c722-4dc2-9c80-3dabb12030fd req-540b61d3-3095-4b36-a2ab-89d2e340910a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115789 Jul 26 14:40:06.523206 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2483/5078] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:40:06.582843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5f268d03-72a0-41f9-9b24-de08e0d9ee35 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:06.597397 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5f268d03-72a0-41f9-9b24-de08e0d9ee35 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1697 microversion: 2.1 time: 0.579546 Jul 26 14:40:06.604122 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2596/5079] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:06 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1697 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:40:07.165798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef078df6-7d4b-4e6b-96bb-c1c976869531 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:07.166459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ef078df6-7d4b-4e6b-96bb-c1c976869531 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:07.186842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef078df6-7d4b-4e6b-96bb-c1c976869531 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:07.196849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef078df6-7d4b-4e6b-96bb-c1c976869531 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:07.200748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef078df6-7d4b-4e6b-96bb-c1c976869531 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:07.201412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef078df6-7d4b-4e6b-96bb-c1c976869531 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:07.430568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ef078df6-7d4b-4e6b-96bb-c1c976869531 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:07.440161 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ef078df6-7d4b-4e6b-96bb-c1c976869531 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1252 microversion: 2.1 time: 0.282138 Jul 26 14:40:07.445431 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2484/5080] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:07 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1252 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:07.630247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a74451d-4b97-4157-823e-a518c3d5a398 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:07.632353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1a74451d-4b97-4157-823e-a518c3d5a398 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:07.655874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a74451d-4b97-4157-823e-a518c3d5a398 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:07.661568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a74451d-4b97-4157-823e-a518c3d5a398 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:07.668881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a74451d-4b97-4157-823e-a518c3d5a398 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:07.671232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a74451d-4b97-4157-823e-a518c3d5a398 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:07.963585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:08.095272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:08.170186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1a74451d-4b97-4157-823e-a518c3d5a398 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:08.182374 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1a74451d-4b97-4157-823e-a518c3d5a398 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1697 microversion: 2.1 time: 0.557200 Jul 26 14:40:08.184622 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2597/5081] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:07 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1697 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:08.473024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fb3abeec-9250-496b-ab4a-09f6a2e6e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:08.477230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fb3abeec-9250-496b-ab4a-09f6a2e6e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:08.484548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=34 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:08.520140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb3abeec-9250-496b-ab4a-09f6a2e6e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:08.522978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb3abeec-9250-496b-ab4a-09f6a2e6e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:08.525683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb3abeec-9250-496b-ab4a-09f6a2e6e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:08.526782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb3abeec-9250-496b-ab4a-09f6a2e6e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:08.541111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=84 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:08.837573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb3abeec-9250-496b-ab4a-09f6a2e6e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:08.854915 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fb3abeec-9250-496b-ab4a-09f6a2e6e051 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1252 microversion: 2.1 time: 0.389758 Jul 26 14:40:08.857983 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2485/5082] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:08 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1252 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:09.210590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9f4e010-4aa9-4e17-bb84-ba639ecff4cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:09.211185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a9f4e010-4aa9-4e17-bb84-ba639ecff4cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:09.228335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:09.230102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9f4e010-4aa9-4e17-bb84-ba639ecff4cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:09.230572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9f4e010-4aa9-4e17-bb84-ba639ecff4cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:09.237310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9f4e010-4aa9-4e17-bb84-ba639ecff4cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:09.237855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9f4e010-4aa9-4e17-bb84-ba639ecff4cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:09.876113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cf27a863-99dd-477e-a257-91ce403b368d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:09.877401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cf27a863-99dd-477e-a257-91ce403b368d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:09.914342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf27a863-99dd-477e-a257-91ce403b368d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:09.921769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf27a863-99dd-477e-a257-91ce403b368d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:09.925953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf27a863-99dd-477e-a257-91ce403b368d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:09.929571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf27a863-99dd-477e-a257-91ce403b368d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:10.072166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cf27a863-99dd-477e-a257-91ce403b368d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:10.088261 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cf27a863-99dd-477e-a257-91ce403b368d tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1252 microversion: 2.1 time: 0.215828 Jul 26 14:40:10.105552 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2486/5083] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:09 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1252 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:10.107023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-25a37e0a-7c8d-49f9-8b67-14b4c491272d req-dc1edd67-8a09-42c6-b6c0-1a80aada0ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bf68c7-e471-4236-952d-53fcc3003e78", "name": "network-vif-unplugged", "status": "completed", "tag": "78f3d958-6986-490e-bd50-e9782c557924"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:10.146380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-25a37e0a-7c8d-49f9-8b67-14b4c491272d req-dc1edd67-8a09-42c6-b6c0-1a80aada0ea3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:10.151056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-25a37e0a-7c8d-49f9-8b67-14b4c491272d req-dc1edd67-8a09-42c6-b6c0-1a80aada0ea3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:10.205998 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-25a37e0a-7c8d-49f9-8b67-14b4c491272d req-dc1edd67-8a09-42c6-b6c0-1a80aada0ea3 service nova] Creating event network-vif-unplugged:78f3d958-6986-490e-bd50-e9782c557924 for instance 72bf68c7-e471-4236-952d-53fcc3003e78 on n-h1-833090-9 Jul 26 14:40:10.221163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-25a37e0a-7c8d-49f9-8b67-14b4c491272d req-dc1edd67-8a09-42c6-b6c0-1a80aada0ea3 service nova] Instance 72bf68c7-e471-4236-952d-53fcc3003e78 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:40:10.261323 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-25a37e0a-7c8d-49f9-8b67-14b4c491272d req-dc1edd67-8a09-42c6-b6c0-1a80aada0ea3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166860 Jul 26 14:40:10.262027 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2487/5084] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:40:11.113885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-25d1e199-f594-45b8-baba-19f47e3aceb6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:11.115927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-25d1e199-f594-45b8-baba-19f47e3aceb6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:11.136433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25d1e199-f594-45b8-baba-19f47e3aceb6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:11.138653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25d1e199-f594-45b8-baba-19f47e3aceb6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:11.141417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25d1e199-f594-45b8-baba-19f47e3aceb6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:11.142583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25d1e199-f594-45b8-baba-19f47e3aceb6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:11.238671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a9f4e010-4aa9-4e17-bb84-ba639ecff4cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:11.247634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a9f4e010-4aa9-4e17-bb84-ba639ecff4cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1696 microversion: 2.1 time: 2.041458 Jul 26 14:40:11.250532 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2598/5085] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:09 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1696 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:11.499505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-25d1e199-f594-45b8-baba-19f47e3aceb6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:11.512758 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-25d1e199-f594-45b8-baba-19f47e3aceb6 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1252 microversion: 2.1 time: 0.403490 Jul 26 14:40:11.518281 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2488/5086] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:11 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1252 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:40:12.274836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-15c978c0-e6a2-4909-8219-69a1a2086d9f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:12.276280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-15c978c0-e6a2-4909-8219-69a1a2086d9f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:12.301508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15c978c0-e6a2-4909-8219-69a1a2086d9f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:12.305637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15c978c0-e6a2-4909-8219-69a1a2086d9f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:12.306861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15c978c0-e6a2-4909-8219-69a1a2086d9f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:12.309061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15c978c0-e6a2-4909-8219-69a1a2086d9f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:12.539488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b4a80d1-7f49-4f59-9c3f-2d3a2c7b5193 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:12.540303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b4a80d1-7f49-4f59-9c3f-2d3a2c7b5193 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:12.555530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b4a80d1-7f49-4f59-9c3f-2d3a2c7b5193 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:12.556654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b4a80d1-7f49-4f59-9c3f-2d3a2c7b5193 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:12.558752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b4a80d1-7f49-4f59-9c3f-2d3a2c7b5193 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:12.561933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b4a80d1-7f49-4f59-9c3f-2d3a2c7b5193 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:12.981512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b4a80d1-7f49-4f59-9c3f-2d3a2c7b5193 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:12.995776 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b4a80d1-7f49-4f59-9c3f-2d3a2c7b5193 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1252 microversion: 2.1 time: 0.460962 Jul 26 14:40:13.012267 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2489/5087] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:12 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1252 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:40:13.026194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ae4fab8c-b58d-422f-9d0c-9016a7effd1b req-f62acfce-c2d6-4bbe-b290-7c8da8c7440e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72bf68c7-e471-4236-952d-53fcc3003e78", "tag": "78f3d958-6986-490e-bd50-e9782c557924"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:13.049926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ae4fab8c-b58d-422f-9d0c-9016a7effd1b req-f62acfce-c2d6-4bbe-b290-7c8da8c7440e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:13.052335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ae4fab8c-b58d-422f-9d0c-9016a7effd1b req-f62acfce-c2d6-4bbe-b290-7c8da8c7440e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:13.111903 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ae4fab8c-b58d-422f-9d0c-9016a7effd1b req-f62acfce-c2d6-4bbe-b290-7c8da8c7440e service nova] Creating event network-changed:78f3d958-6986-490e-bd50-e9782c557924 for instance 72bf68c7-e471-4236-952d-53fcc3003e78 on n-h1-833090-9 Jul 26 14:40:13.168270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-ae4fab8c-b58d-422f-9d0c-9016a7effd1b req-f62acfce-c2d6-4bbe-b290-7c8da8c7440e service nova] Instance 72bf68c7-e471-4236-952d-53fcc3003e78 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:40:13.202273 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ae4fab8c-b58d-422f-9d0c-9016a7effd1b req-f62acfce-c2d6-4bbe-b290-7c8da8c7440e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179631 Jul 26 14:40:13.208126 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2490/5088] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:40:13.266200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-15c978c0-e6a2-4909-8219-69a1a2086d9f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:13.279054 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-15c978c0-e6a2-4909-8219-69a1a2086d9f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1696 microversion: 2.1 time: 1.008082 Jul 26 14:40:13.283795 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2599/5089] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:12 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1696 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:14.035127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3f58a8f7-9f0b-4dcd-a0cd-05ed69c8d7d7 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:14.036579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3f58a8f7-9f0b-4dcd-a0cd-05ed69c8d7d7 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:14.060038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f58a8f7-9f0b-4dcd-a0cd-05ed69c8d7d7 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:14.060618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f58a8f7-9f0b-4dcd-a0cd-05ed69c8d7d7 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:14.063490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f58a8f7-9f0b-4dcd-a0cd-05ed69c8d7d7 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:14.065652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f58a8f7-9f0b-4dcd-a0cd-05ed69c8d7d7 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:14.283165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3f58a8f7-9f0b-4dcd-a0cd-05ed69c8d7d7 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:14.295351 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3f58a8f7-9f0b-4dcd-a0cd-05ed69c8d7d7 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1252 microversion: 2.1 time: 0.265877 Jul 26 14:40:14.300707 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2491/5090] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:14 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1252 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:14.313884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5503bb67-ad64-4ddf-bc4f-4b3114b79e75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:14.314511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5503bb67-ad64-4ddf-bc4f-4b3114b79e75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:14.335460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5503bb67-ad64-4ddf-bc4f-4b3114b79e75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:14.335915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5503bb67-ad64-4ddf-bc4f-4b3114b79e75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:14.336741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5503bb67-ad64-4ddf-bc4f-4b3114b79e75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:14.337184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5503bb67-ad64-4ddf-bc4f-4b3114b79e75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:14.843525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5503bb67-ad64-4ddf-bc4f-4b3114b79e75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:14.854175 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5503bb67-ad64-4ddf-bc4f-4b3114b79e75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1696 microversion: 2.1 time: 0.544690 Jul 26 14:40:14.857987 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2600/5091] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:14 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1696 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:15.324910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-effb96bd-fe35-40fa-92d0-dc7806ae366b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:15.325517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-effb96bd-fe35-40fa-92d0-dc7806ae366b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:15.352041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-effb96bd-fe35-40fa-92d0-dc7806ae366b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:15.352948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-effb96bd-fe35-40fa-92d0-dc7806ae366b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:15.353955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-effb96bd-fe35-40fa-92d0-dc7806ae366b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:15.354592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-effb96bd-fe35-40fa-92d0-dc7806ae366b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:15.515826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-effb96bd-fe35-40fa-92d0-dc7806ae366b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:15.526526 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-effb96bd-fe35-40fa-92d0-dc7806ae366b tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1252 microversion: 2.1 time: 0.205359 Jul 26 14:40:15.540468 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2492/5092] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:15 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1252 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:15.883658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-61418921-2f97-4176-b5cc-27101cef374e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:15.884952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-61418921-2f97-4176-b5cc-27101cef374e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:15.902122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61418921-2f97-4176-b5cc-27101cef374e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:15.902851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61418921-2f97-4176-b5cc-27101cef374e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:15.903660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61418921-2f97-4176-b5cc-27101cef374e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:15.904343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61418921-2f97-4176-b5cc-27101cef374e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:16.387851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-61418921-2f97-4176-b5cc-27101cef374e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:16.400348 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-61418921-2f97-4176-b5cc-27101cef374e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1694 microversion: 2.1 time: 0.521296 Jul 26 14:40:16.401551 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2601/5093] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:15 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1694 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:16.561529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-21d313cf-7f6e-4a90-aeae-caedafbbd775 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:16.562329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-21d313cf-7f6e-4a90-aeae-caedafbbd775 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:16.574136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21d313cf-7f6e-4a90-aeae-caedafbbd775 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:16.589885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21d313cf-7f6e-4a90-aeae-caedafbbd775 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:16.597422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21d313cf-7f6e-4a90-aeae-caedafbbd775 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:16.598463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21d313cf-7f6e-4a90-aeae-caedafbbd775 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:16.880199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-21d313cf-7f6e-4a90-aeae-caedafbbd775 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '652030dfa72f45fda873b2c86919360a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090816cf27a24b288321f72946ba0ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:16.898569 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-21d313cf-7f6e-4a90-aeae-caedafbbd775 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 200 len: 1252 microversion: 2.1 time: 0.338163 Jul 26 14:40:16.908838 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2493/5094] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:16 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 1252 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:17.458603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b4586f49-9e2b-44c0-8a9d-24e4e4c191a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:17.460665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b4586f49-9e2b-44c0-8a9d-24e4e4c191a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:17.472952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4586f49-9e2b-44c0-8a9d-24e4e4c191a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:17.474153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4586f49-9e2b-44c0-8a9d-24e4e4c191a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:17.476511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4586f49-9e2b-44c0-8a9d-24e4e4c191a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:17.477586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4586f49-9e2b-44c0-8a9d-24e4e4c191a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:17.923728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9eceb05-72d1-49e7-a6d9-e9036e854f22 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:17.925283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d9eceb05-72d1-49e7-a6d9-e9036e854f22 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] [instance: 47e8fe5d-a576-4b9e-8f16-43bd401179d7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:17.966464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9eceb05-72d1-49e7-a6d9-e9036e854f22 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:17.970016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9eceb05-72d1-49e7-a6d9-e9036e854f22 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:17.973933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9eceb05-72d1-49e7-a6d9-e9036e854f22 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:17.979629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9eceb05-72d1-49e7-a6d9-e9036e854f22 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:18.040001 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d9eceb05-72d1-49e7-a6d9-e9036e854f22 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] HTTP exception thrown: Instance 47e8fe5d-a576-4b9e-8f16-43bd401179d7 could not be found. Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9eceb05-72d1-49e7-a6d9-e9036e854f22 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Request method failure captured: Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 HTTP/1.1 Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_xIcMUMRQqF-4jrvCqBw_S-iJKYi6urJr-LyI3AAaaEjUU2v2oU20Dnvx9PjOqIu6VwYnvsreNlFG_3CuhWH9zWEFdxoP6MfavBNEpWfT0XqQjHT3jgRCAO3_frpoALkYbisbCnpy_yCf7eZ6ZM_L-rrNbKdom7EdVEYBpOHfaPxlk Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 090816cf27a24b288321f72946ba0ae5 Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersTestBootFromVolume-388870121 Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/090816cf27a24b288321f72946ba0ae5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/090816cf27a24b288321f72946ba0ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_090816cf27a24b288321f72946ba0ae5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/090816cf27a24b288321f72946ba0ae5"}]}] Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersTestBootFromVolume-388870121 Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 090816cf27a24b288321f72946ba0ae5 Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersTestBootFromVolume-388870121 Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersTestBootFromVolume-388870121-project Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 652030dfa72f45fda873b2c86919360a Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersTestBootFromVolume-388870121-project Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 47e8fe5d-a576-4b9e-8f16-43bd401179d7 could not be found. Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '47e8fe5d-a576-4b9e-8f16-43bd401179d7'} Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e8fe5d-a576-4b9e-8f16-43bd401179d7 could not be found. Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e8fe5d-a576-4b9e-8f16-43bd401179d7 could not be found. Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:40:18.046454 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:40:18.051788 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:40:18.051788 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:40:18.051788 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:40:18.051788 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:40:18.051788 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:40:18.051788 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e8fe5d-a576-4b9e-8f16-43bd401179d7 could not be found. Jul 26 14:40:18.051788 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:40:18.051788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9eceb05-72d1-49e7-a6d9-e9036e854f22 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Returning 404 to user: Instance 47e8fe5d-a576-4b9e-8f16-43bd401179d7 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:40:18.051788 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d9eceb05-72d1-49e7-a6d9-e9036e854f22 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7" status: 404 len: 111 microversion: 2.1 time: 0.130653 Jul 26 14:40:18.059468 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2494/5095] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:17 2022] GET /compute/v2.1/servers/47e8fe5d-a576-4b9e-8f16-43bd401179d7 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:40:18.073727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fd337806-08de-49be-b78e-88c158e9d448 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] Calling method '.version_select at 0x7f8799304790>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:18.139110 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fd337806-08de-49be-b78e-88c158e9d448 tempest-ServersTestBootFromVolume-388870121 tempest-ServersTestBootFromVolume-388870121-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249818897" status: 202 len: 0 microversion: 2.1 time: 0.074049 Jul 26 14:40:18.139762 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2495/5096] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:40:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249818897 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:40:18.237524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b4586f49-9e2b-44c0-8a9d-24e4e4c191a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:18.249934 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b4586f49-9e2b-44c0-8a9d-24e4e4c191a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1691 microversion: 2.1 time: 0.826438 Jul 26 14:40:18.252736 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2602/5097] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:17 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1691 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:18.283031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-193f7a1d-ae96-4ae2-8f45-1328617cb9a1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:18.283597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-193f7a1d-ae96-4ae2-8f45-1328617cb9a1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:18.318106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-193f7a1d-ae96-4ae2-8f45-1328617cb9a1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:18.324100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-193f7a1d-ae96-4ae2-8f45-1328617cb9a1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:18.325091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-193f7a1d-ae96-4ae2-8f45-1328617cb9a1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:18.325558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-193f7a1d-ae96-4ae2-8f45-1328617cb9a1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:18.701852 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-193f7a1d-ae96-4ae2-8f45-1328617cb9a1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78/action" status: 204 len: 0 microversion: 2.1 time: 0.424442 Jul 26 14:40:18.715338 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2496/5098] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:40:18 2022] POST /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78/action => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:18.719437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5645935e-aef4-403c-90c3-ec364e7d964f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:18.720169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5645935e-aef4-403c-90c3-ec364e7d964f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:18.743573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5645935e-aef4-403c-90c3-ec364e7d964f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:18.748744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5645935e-aef4-403c-90c3-ec364e7d964f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:18.752899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5645935e-aef4-403c-90c3-ec364e7d964f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:18.758581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5645935e-aef4-403c-90c3-ec364e7d964f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:19.681320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5645935e-aef4-403c-90c3-ec364e7d964f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:19.694364 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5645935e-aef4-403c-90c3-ec364e7d964f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1691 microversion: 2.1 time: 0.978884 Jul 26 14:40:19.721454 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2603/5099] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:18 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1691 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:20.727773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2937c9e8-1b3e-4e4d-a89a-c91fcef70971 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:20.728769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2937c9e8-1b3e-4e4d-a89a-c91fcef70971 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:20.751777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2937c9e8-1b3e-4e4d-a89a-c91fcef70971 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:20.754352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2937c9e8-1b3e-4e4d-a89a-c91fcef70971 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:20.755523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2937c9e8-1b3e-4e4d-a89a-c91fcef70971 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:20.773023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2937c9e8-1b3e-4e4d-a89a-c91fcef70971 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:22.385818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2937c9e8-1b3e-4e4d-a89a-c91fcef70971 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:22.410118 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2937c9e8-1b3e-4e4d-a89a-c91fcef70971 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1691 microversion: 2.1 time: 1.688129 Jul 26 14:40:22.434640 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2497/5100] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:20 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1691 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:22.530067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d3502994-8b19-491e-8eea-bbb2ec1915fd req-a8e4b57c-8862-4e9c-8093-8c99acc844c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bf68c7-e471-4236-952d-53fcc3003e78", "name": "network-vif-plugged", "status": "completed", "tag": "78f3d958-6986-490e-bd50-e9782c557924"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:22.582946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d3502994-8b19-491e-8eea-bbb2ec1915fd req-a8e4b57c-8862-4e9c-8093-8c99acc844c3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:22.588439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d3502994-8b19-491e-8eea-bbb2ec1915fd req-a8e4b57c-8862-4e9c-8093-8c99acc844c3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:22.622403 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d3502994-8b19-491e-8eea-bbb2ec1915fd req-a8e4b57c-8862-4e9c-8093-8c99acc844c3 service nova] Creating event network-vif-plugged:78f3d958-6986-490e-bd50-e9782c557924 for instance 72bf68c7-e471-4236-952d-53fcc3003e78 on n-h1-833090-9 Jul 26 14:40:22.639518 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d3502994-8b19-491e-8eea-bbb2ec1915fd req-a8e4b57c-8862-4e9c-8093-8c99acc844c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113414 Jul 26 14:40:22.643432 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2604/5101] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:40:23.437236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0ab6a26a-b6c8-453d-9174-23757f126033 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:23.437881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0ab6a26a-b6c8-453d-9174-23757f126033 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:23.456380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ab6a26a-b6c8-453d-9174-23757f126033 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:23.457380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ab6a26a-b6c8-453d-9174-23757f126033 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:23.458643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ab6a26a-b6c8-453d-9174-23757f126033 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:23.459563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0ab6a26a-b6c8-453d-9174-23757f126033 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:25.415578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0ab6a26a-b6c8-453d-9174-23757f126033 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:25.425517 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0ab6a26a-b6c8-453d-9174-23757f126033 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1683 microversion: 2.1 time: 1.996183 Jul 26 14:40:25.450489 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2498/5102] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:23 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1683 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:41.823763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-07a5c424-c2d0-4998-a97d-6757c06db0b8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:41.826568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-07a5c424-c2d0-4998-a97d-6757c06db0b8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:41.848577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=13 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:41.851682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:41.857968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07a5c424-c2d0-4998-a97d-6757c06db0b8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:41.858575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07a5c424-c2d0-4998-a97d-6757c06db0b8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:41.861531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07a5c424-c2d0-4998-a97d-6757c06db0b8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:41.862324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07a5c424-c2d0-4998-a97d-6757c06db0b8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:41.975689 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-07a5c424-c2d0-4998-a97d-6757c06db0b8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78/action" status: 200 len: 24580 microversion: 2.1 time: 0.157282 Jul 26 14:40:41.984186 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2605/5103] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:40:41 2022] POST /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78/action => generated 24580 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:40:42.870001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1250774327", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:42.887545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:42.889023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:42.993196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] validate_networks() for None {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:40:45.344661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:40:45.345326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:40:45.345567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:40:45.345991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:40:45.346417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:40:45.372593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:45.373062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:45.373892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:45.374345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:45.431530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Getting quotas for project 93f32991ab554926859439915923a80f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:40:45.454154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Getting quotas for user d393019e0a27411aad2c41054ee6fad1 and project 93f32991ab554926859439915923a80f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:40:45.508783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:40:45.511100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:40:45.681908 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-79dbf1bd-76b8-43c0-9e7b-f8dc76abc93f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.811569 Jul 26 14:40:45.683256 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2499/5104] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:40:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:40:45.696372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f24dbbc-d008-4eed-96a6-0580f041fccd tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:45.697230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f24dbbc-d008-4eed-96a6-0580f041fccd tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:46.052594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f24dbbc-d008-4eed-96a6-0580f041fccd tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:46.065332 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f24dbbc-d008-4eed-96a6-0580f041fccd tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1214 microversion: 2.1 time: 0.374548 Jul 26 14:40:46.071518 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2606/5105] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:45 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1214 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:47.089491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-def4d3fc-e6a3-456a-879d-e35efd0760d8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:47.090197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-def4d3fc-e6a3-456a-879d-e35efd0760d8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:47.124796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-def4d3fc-e6a3-456a-879d-e35efd0760d8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:47.125276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-def4d3fc-e6a3-456a-879d-e35efd0760d8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:47.126204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-def4d3fc-e6a3-456a-879d-e35efd0760d8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:47.132389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-def4d3fc-e6a3-456a-879d-e35efd0760d8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:47.537898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-def4d3fc-e6a3-456a-879d-e35efd0760d8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:47.554524 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-def4d3fc-e6a3-456a-879d-e35efd0760d8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1266 microversion: 2.1 time: 0.468948 Jul 26 14:40:47.555803 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2500/5106] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:47 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1266 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:48.344495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6cdbc57c-42ce-45b6-aae4-fcfc1874ea94 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:48.347506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6cdbc57c-42ce-45b6-aae4-fcfc1874ea94 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:48.380100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cdbc57c-42ce-45b6-aae4-fcfc1874ea94 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:48.388933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cdbc57c-42ce-45b6-aae4-fcfc1874ea94 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:48.403216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cdbc57c-42ce-45b6-aae4-fcfc1874ea94 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:48.408485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cdbc57c-42ce-45b6-aae4-fcfc1874ea94 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:48.598700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6202fec4-9afc-41cd-bfb5-bc8fd1aae8dc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:48.601268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6202fec4-9afc-41cd-bfb5-bc8fd1aae8dc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:48.646368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6202fec4-9afc-41cd-bfb5-bc8fd1aae8dc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:48.648127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6202fec4-9afc-41cd-bfb5-bc8fd1aae8dc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:48.649071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6202fec4-9afc-41cd-bfb5-bc8fd1aae8dc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:48.649840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6202fec4-9afc-41cd-bfb5-bc8fd1aae8dc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:48.916980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6202fec4-9afc-41cd-bfb5-bc8fd1aae8dc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:48.927609 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6202fec4-9afc-41cd-bfb5-bc8fd1aae8dc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1272 microversion: 2.1 time: 0.355603 Jul 26 14:40:48.930896 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2501/5107] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:48 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1272 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:49.335766 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6cdbc57c-42ce-45b6-aae4-fcfc1874ea94 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1834 microversion: 2.1 time: 0.996442 Jul 26 14:40:49.348026 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2607/5108] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:48 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1834 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:49.954389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5b75089e-e921-418f-9635-4c255d1210c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:49.955657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b75089e-e921-418f-9635-4c255d1210c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:49.971740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b75089e-e921-418f-9635-4c255d1210c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:49.972654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b75089e-e921-418f-9635-4c255d1210c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:49.973650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b75089e-e921-418f-9635-4c255d1210c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:49.980680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b75089e-e921-418f-9635-4c255d1210c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:50.269540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5b75089e-e921-418f-9635-4c255d1210c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:50.296935 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5b75089e-e921-418f-9635-4c255d1210c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1272 microversion: 2.1 time: 0.346825 Jul 26 14:40:50.300427 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2502/5109] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:49 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1272 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:51.331731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d3adb3b0-e5c2-4d9d-bece-b2ca43f47215 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:51.334479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d3adb3b0-e5c2-4d9d-bece-b2ca43f47215 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:51.354332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3adb3b0-e5c2-4d9d-bece-b2ca43f47215 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:51.357082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3adb3b0-e5c2-4d9d-bece-b2ca43f47215 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:51.359816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3adb3b0-e5c2-4d9d-bece-b2ca43f47215 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:51.370103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3adb3b0-e5c2-4d9d-bece-b2ca43f47215 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:51.545345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ac00dfa1-400d-419a-9f71-830e972e1ce5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:51.546571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ac00dfa1-400d-419a-9f71-830e972e1ce5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:51.556826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac00dfa1-400d-419a-9f71-830e972e1ce5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:51.557291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac00dfa1-400d-419a-9f71-830e972e1ce5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:51.561340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac00dfa1-400d-419a-9f71-830e972e1ce5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:51.561807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac00dfa1-400d-419a-9f71-830e972e1ce5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:51.610236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ac00dfa1-400d-419a-9f71-830e972e1ce5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:40:51.762020 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ac00dfa1-400d-419a-9f71-830e972e1ce5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "DELETE /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 204 len: 0 microversion: 2.1 time: 0.220221 Jul 26 14:40:51.770687 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2503/5110] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:40:51 2022] DELETE /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:40:51.779214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e896aff8-1519-4dbb-9448-48d6484dd63f req-5e717c0f-9bae-416f-ae64-127be5664928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72bf68c7-e471-4236-952d-53fcc3003e78", "tag": "78f3d958-6986-490e-bd50-e9782c557924"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:51.824755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e896aff8-1519-4dbb-9448-48d6484dd63f req-5e717c0f-9bae-416f-ae64-127be5664928 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:51.825305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e896aff8-1519-4dbb-9448-48d6484dd63f req-5e717c0f-9bae-416f-ae64-127be5664928 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:51.840806 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e896aff8-1519-4dbb-9448-48d6484dd63f req-5e717c0f-9bae-416f-ae64-127be5664928 service nova] Creating event network-changed:78f3d958-6986-490e-bd50-e9782c557924 for instance 72bf68c7-e471-4236-952d-53fcc3003e78 on n-h1-833090-9 Jul 26 14:40:51.846639 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e896aff8-1519-4dbb-9448-48d6484dd63f req-5e717c0f-9bae-416f-ae64-127be5664928 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073336 Jul 26 14:40:51.847260 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2504/5111] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:40:51.859221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-753b2a51-d978-4735-a927-2f4d4a03df2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:51.861684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-753b2a51-d978-4735-a927-2f4d4a03df2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:51.867331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d3adb3b0-e5c2-4d9d-bece-b2ca43f47215 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:51.887251 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d3adb3b0-e5c2-4d9d-bece-b2ca43f47215 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1272 microversion: 2.1 time: 0.565579 Jul 26 14:40:51.891115 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2608/5112] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:51 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1272 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:51.897062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-753b2a51-d978-4735-a927-2f4d4a03df2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:51.898157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-753b2a51-d978-4735-a927-2f4d4a03df2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:51.899251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-753b2a51-d978-4735-a927-2f4d4a03df2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:51.900245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-753b2a51-d978-4735-a927-2f4d4a03df2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:52.683514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-753b2a51-d978-4735-a927-2f4d4a03df2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:52.716354 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-753b2a51-d978-4735-a927-2f4d4a03df2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1689 microversion: 2.1 time: 0.863095 Jul 26 14:40:52.730613 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2505/5113] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:51 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1689 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:52.912021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4b152a60-9652-4629-994c-94a86f074bb2 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:52.912980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4b152a60-9652-4629-994c-94a86f074bb2 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:52.943922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b152a60-9652-4629-994c-94a86f074bb2 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:52.944738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b152a60-9652-4629-994c-94a86f074bb2 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:52.956903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b152a60-9652-4629-994c-94a86f074bb2 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:52.957289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4b152a60-9652-4629-994c-94a86f074bb2 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:53.718214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-639123051", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "d927f8d9-44ac-4e59-9f5d-5fe1e5a73fd4"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:53.832316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] validate_networks() for [('d927f8d9-44ac-4e59-9f5d-5fe1e5a73fd4', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:40:54.462638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4b152a60-9652-4629-994c-94a86f074bb2 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:54.478750 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4b152a60-9652-4629-994c-94a86f074bb2 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1314 microversion: 2.1 time: 1.572174 Jul 26 14:40:54.485179 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2609/5114] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:52 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1314 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:54.502187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ef17a54-26aa-422a-b9ab-a9389bbbb2b1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:54.503907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1ef17a54-26aa-422a-b9ab-a9389bbbb2b1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:54.556730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ef17a54-26aa-422a-b9ab-a9389bbbb2b1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:54.557385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ef17a54-26aa-422a-b9ab-a9389bbbb2b1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:54.558265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ef17a54-26aa-422a-b9ab-a9389bbbb2b1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:54.558718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ef17a54-26aa-422a-b9ab-a9389bbbb2b1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:55.403045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.486071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:55.612542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:40:55.613168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:40:55.613844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:40:55.614588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:40:55.615526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:40:55.641401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:55.660992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:55.663051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:55.668766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:55.735784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Getting quotas for project 90129695ce014db2aa0e9c50894edb92. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:40:55.742592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Getting quotas for user ad23087765a74a15a65ecbfd3e9bba98 and project 90129695ce014db2aa0e9c50894edb92. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:40:55.763584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:40:55.773663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:40:55.910897 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-25c816d4-70a7-40dc-9c5b-1e2970988ceb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.578723 Jul 26 14:40:55.924497 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2506/5115] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:40:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:40:55.933818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d5bc18b3-a6b0-437f-922f-f95138bac2d7 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:55.936478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d5bc18b3-a6b0-437f-922f-f95138bac2d7 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:55.980428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5bc18b3-a6b0-437f-922f-f95138bac2d7 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:55.980884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5bc18b3-a6b0-437f-922f-f95138bac2d7 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:55.983596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5bc18b3-a6b0-437f-922f-f95138bac2d7 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:55.984271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5bc18b3-a6b0-437f-922f-f95138bac2d7 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:56.058428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:40:56.380299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ef17a54-26aa-422a-b9ab-a9389bbbb2b1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:56.393164 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ef17a54-26aa-422a-b9ab-a9389bbbb2b1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1689 microversion: 2.1 time: 1.904343 Jul 26 14:40:56.393838 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2610/5116] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:54 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1689 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:56.411549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-339cbc2c-103e-4078-9808-f14482814383 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:56.412630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-339cbc2c-103e-4078-9808-f14482814383 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:56.663061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-339cbc2c-103e-4078-9808-f14482814383 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:56.691922 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-339cbc2c-103e-4078-9808-f14482814383 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1216 microversion: 2.1 time: 0.295406 Jul 26 14:40:56.698664 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2611/5117] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:56 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1216 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:57.198521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5bc18b3-a6b0-437f-922f-f95138bac2d7 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:57.211830 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d5bc18b3-a6b0-437f-922f-f95138bac2d7 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1314 microversion: 2.1 time: 1.285774 Jul 26 14:40:57.214009 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2507/5118] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:55 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1314 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:57.236873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-3f09836e-cb77-4c6d-8f5c-b9898d588e6f req-1c99c527-b1b1-48e1-86f8-d1e9ed31380d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bf68c7-e471-4236-952d-53fcc3003e78", "name": "network-vif-deleted", "tag": "78f3d958-6986-490e-bd50-e9782c557924"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:57.270956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3f09836e-cb77-4c6d-8f5c-b9898d588e6f req-1c99c527-b1b1-48e1-86f8-d1e9ed31380d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:57.279837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3f09836e-cb77-4c6d-8f5c-b9898d588e6f req-1c99c527-b1b1-48e1-86f8-d1e9ed31380d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:57.334226 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-3f09836e-cb77-4c6d-8f5c-b9898d588e6f req-1c99c527-b1b1-48e1-86f8-d1e9ed31380d service nova] Creating event network-vif-deleted:78f3d958-6986-490e-bd50-e9782c557924 for instance 72bf68c7-e471-4236-952d-53fcc3003e78 on n-h1-833090-9 Jul 26 14:40:57.355216 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-3f09836e-cb77-4c6d-8f5c-b9898d588e6f req-1c99c527-b1b1-48e1-86f8-d1e9ed31380d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122547 Jul 26 14:40:57.363120 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2612/5119] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:40:57.415310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:57.415976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:57.436707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:57.440366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:57.441709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:57.445149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:57.542731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:57.543581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:57.544412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lazy-loading 'fault' on Instance uuid 72bf68c7-e471-4236-952d-53fcc3003e78 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:40:57.715869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:57.729077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c125330a-64d7-46c5-b0e8-35e23e6b46e8 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:57.729855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c125330a-64d7-46c5-b0e8-35e23e6b46e8 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:57.733906 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-73915005-4ffb-4f1e-869b-bc3782ce1e14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 200 len: 1356 microversion: 2.1 time: 0.320889 Jul 26 14:40:57.735175 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2508/5120] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:57 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 1356 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:57.743635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c125330a-64d7-46c5-b0e8-35e23e6b46e8 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:57.744161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c125330a-64d7-46c5-b0e8-35e23e6b46e8 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:57.744972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c125330a-64d7-46c5-b0e8-35e23e6b46e8 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:57.745430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c125330a-64d7-46c5-b0e8-35e23e6b46e8 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:58.019083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c125330a-64d7-46c5-b0e8-35e23e6b46e8 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:58.029968 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c125330a-64d7-46c5-b0e8-35e23e6b46e8 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1268 microversion: 2.1 time: 0.312319 Jul 26 14:40:58.060923 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2613/5121] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:57 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1268 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:58.258142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-99e9702e-0374-4fe4-bd8b-f303b24ae2c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:58.260337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-99e9702e-0374-4fe4-bd8b-f303b24ae2c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:58.274235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99e9702e-0374-4fe4-bd8b-f303b24ae2c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:58.299408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99e9702e-0374-4fe4-bd8b-f303b24ae2c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:58.301307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99e9702e-0374-4fe4-bd8b-f303b24ae2c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:58.302981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-99e9702e-0374-4fe4-bd8b-f303b24ae2c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:58.762223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dfdf298f-bc3b-4a02-b973-7cd4bdf6ff14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:58.763818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dfdf298f-bc3b-4a02-b973-7cd4bdf6ff14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 72bf68c7-e471-4236-952d-53fcc3003e78] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:58.775573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfdf298f-bc3b-4a02-b973-7cd4bdf6ff14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:58.785066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfdf298f-bc3b-4a02-b973-7cd4bdf6ff14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:58.785991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfdf298f-bc3b-4a02-b973-7cd4bdf6ff14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:58.790076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dfdf298f-bc3b-4a02-b973-7cd4bdf6ff14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:58.842284 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-dfdf298f-bc3b-4a02-b973-7cd4bdf6ff14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] HTTP exception thrown: Instance 72bf68c7-e471-4236-952d-53fcc3003e78 could not be found. Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dfdf298f-bc3b-4a02-b973-7cd4bdf6ff14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Request method failure captured: Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 HTTP/1.1 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_xB-Zf_NVFk2LpZd5X0S1bF9Sihh0sVd3cVjP7q1Wb09Bi_CbMlSEWs2yYdcOyVXXKNohoIUlLtBITBGHLSNiRsoBSNoqWwMtL7vcjKUvwFncHYEdNqCZrXhBJGT_E7Ar_K6PwdXlw_F45EECw6xOMVI7rp06FaJ1098k3HxOxEoI4 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 1f899f15d3284d9d8b7f9509f1017944 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f899f15d3284d9d8b7f9509f1017944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f899f15d3284d9d8b7f9509f1017944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f899f15d3284d9d8b7f9509f1017944", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f899f15d3284d9d8b7f9509f1017944"}]}] Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 1f899f15d3284d9d8b7f9509f1017944 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestNetworkAdvancedServerOps-1920705595-project Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 2ace0ada06df49f189f02e59039c2dd8 Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1920705595-project Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 72bf68c7-e471-4236-952d-53fcc3003e78 could not be found. Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '72bf68c7-e471-4236-952d-53fcc3003e78'} Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72bf68c7-e471-4236-952d-53fcc3003e78 could not be found. Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72bf68c7-e471-4236-952d-53fcc3003e78 could not be found. Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:40:58.845110 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:40:58.850408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:40:58.850408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:40:58.850408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:40:58.850408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:40:58.850408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:40:58.850408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:40:58.850408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72bf68c7-e471-4236-952d-53fcc3003e78 could not be found. Jul 26 14:40:58.850408 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:40:58.857568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dfdf298f-bc3b-4a02-b973-7cd4bdf6ff14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Returning 404 to user: Instance 72bf68c7-e471-4236-952d-53fcc3003e78 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:40:58.865724 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dfdf298f-bc3b-4a02-b973-7cd4bdf6ff14 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78" status: 404 len: 111 microversion: 2.1 time: 0.108416 Jul 26 14:40:58.869064 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2614/5122] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:58 2022] GET /compute/v2.1/servers/72bf68c7-e471-4236-952d-53fcc3003e78 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:40:58.944478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-99e9702e-0374-4fe4-bd8b-f303b24ae2c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:58.955662 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-99e9702e-0374-4fe4-bd8b-f303b24ae2c6 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1314 microversion: 2.1 time: 0.720668 Jul 26 14:40:58.956296 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2509/5123] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:58 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:59.053989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bd787b87-a9e1-4e6a-9b6e-3765021753e0 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:59.054626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bd787b87-a9e1-4e6a-9b6e-3765021753e0 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:59.065337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd787b87-a9e1-4e6a-9b6e-3765021753e0 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:59.071992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd787b87-a9e1-4e6a-9b6e-3765021753e0 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:59.072853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd787b87-a9e1-4e6a-9b6e-3765021753e0 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:59.073311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd787b87-a9e1-4e6a-9b6e-3765021753e0 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:59.853116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-810f53c9-0734-4bce-ac61-0f8883ab64ec req-a964be27-ea51-4da0-80e0-b771204bbe5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358b56fe-a34a-4182-8b74-b97c49efb388", "tag": "3bc61f27-8089-493a-a8cb-889c33e83641"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:40:59.884762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-810f53c9-0734-4bce-ac61-0f8883ab64ec req-a964be27-ea51-4da0-80e0-b771204bbe5a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:59.885238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-810f53c9-0734-4bce-ac61-0f8883ab64ec req-a964be27-ea51-4da0-80e0-b771204bbe5a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:59.921807 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-810f53c9-0734-4bce-ac61-0f8883ab64ec req-a964be27-ea51-4da0-80e0-b771204bbe5a service nova] Creating event network-changed:3bc61f27-8089-493a-a8cb-889c33e83641 for instance 358b56fe-a34a-4182-8b74-b97c49efb388 on n-h2-833090-9 Jul 26 14:40:59.931331 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-810f53c9-0734-4bce-ac61-0f8883ab64ec req-a964be27-ea51-4da0-80e0-b771204bbe5a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082069 Jul 26 14:40:59.935679 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2510/5124] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:40:59.946907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bd787b87-a9e1-4e6a-9b6e-3765021753e0 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:40:59.955802 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bd787b87-a9e1-4e6a-9b6e-3765021753e0 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1274 microversion: 2.1 time: 0.906545 Jul 26 14:40:59.957414 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2615/5125] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:59 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1274 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:40:59.979699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-210eee6e-36d6-4474-a298-300ed19ba3c8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:40:59.980448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-210eee6e-36d6-4474-a298-300ed19ba3c8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:40:59.988702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-210eee6e-36d6-4474-a298-300ed19ba3c8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:59.989951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-210eee6e-36d6-4474-a298-300ed19ba3c8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:40:59.990946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-210eee6e-36d6-4474-a298-300ed19ba3c8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:40:59.992207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-210eee6e-36d6-4474-a298-300ed19ba3c8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:00.587107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-210eee6e-36d6-4474-a298-300ed19ba3c8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:00.594993 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-210eee6e-36d6-4474-a298-300ed19ba3c8 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1314 microversion: 2.1 time: 0.620072 Jul 26 14:41:00.608475 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2511/5126] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:40:59 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:00.982536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-971e06ec-1519-4413-bc90-c201ce92a9fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:00.983269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-971e06ec-1519-4413-bc90-c201ce92a9fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:01.004500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-971e06ec-1519-4413-bc90-c201ce92a9fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:01.006778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-971e06ec-1519-4413-bc90-c201ce92a9fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:01.009912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-971e06ec-1519-4413-bc90-c201ce92a9fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:01.012457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-971e06ec-1519-4413-bc90-c201ce92a9fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:01.264470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-971e06ec-1519-4413-bc90-c201ce92a9fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:01.282623 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-971e06ec-1519-4413-bc90-c201ce92a9fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1274 microversion: 2.1 time: 0.304734 Jul 26 14:41:01.284491 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2616/5127] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:00 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1274 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:01.617361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a5ef648c-59ad-45a8-b4ad-af10551f9b00 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:01.617852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a5ef648c-59ad-45a8-b4ad-af10551f9b00 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:01.626983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5ef648c-59ad-45a8-b4ad-af10551f9b00 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:01.631926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5ef648c-59ad-45a8-b4ad-af10551f9b00 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:01.635141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5ef648c-59ad-45a8-b4ad-af10551f9b00 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:01.635761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5ef648c-59ad-45a8-b4ad-af10551f9b00 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:02.305998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73a3be94-d900-4a41-954e-d62c881a728b tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:02.307209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-73a3be94-d900-4a41-954e-d62c881a728b tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:02.325958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73a3be94-d900-4a41-954e-d62c881a728b tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:02.326686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73a3be94-d900-4a41-954e-d62c881a728b tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:02.327688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73a3be94-d900-4a41-954e-d62c881a728b tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:02.328384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73a3be94-d900-4a41-954e-d62c881a728b tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:02.801226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a5ef648c-59ad-45a8-b4ad-af10551f9b00 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:02.813179 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a5ef648c-59ad-45a8-b4ad-af10551f9b00 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1314 microversion: 2.1 time: 1.199935 Jul 26 14:41:02.817103 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2512/5128] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:01 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1314 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:03.220628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-73a3be94-d900-4a41-954e-d62c881a728b tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:03.232889 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-73a3be94-d900-4a41-954e-d62c881a728b tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1316 microversion: 2.1 time: 0.929699 Jul 26 14:41:03.235075 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2617/5129] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:02 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1316 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:41:03.836304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4788ccf9-8305-4569-84de-ed20f3cd18e1 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:03.836942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4788ccf9-8305-4569-84de-ed20f3cd18e1 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:03.874538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4788ccf9-8305-4569-84de-ed20f3cd18e1 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:03.875255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4788ccf9-8305-4569-84de-ed20f3cd18e1 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:03.876286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4788ccf9-8305-4569-84de-ed20f3cd18e1 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:03.877060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4788ccf9-8305-4569-84de-ed20f3cd18e1 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:04.259654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c65566f5-74b7-4c7a-b73d-e08664f697c7 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:04.260892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c65566f5-74b7-4c7a-b73d-e08664f697c7 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:04.269056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c65566f5-74b7-4c7a-b73d-e08664f697c7 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:04.270053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c65566f5-74b7-4c7a-b73d-e08664f697c7 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:04.271820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c65566f5-74b7-4c7a-b73d-e08664f697c7 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:04.272456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c65566f5-74b7-4c7a-b73d-e08664f697c7 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:05.227740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4788ccf9-8305-4569-84de-ed20f3cd18e1 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:05.273481 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4788ccf9-8305-4569-84de-ed20f3cd18e1 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1314 microversion: 2.1 time: 1.432515 Jul 26 14:41:05.276275 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2513/5130] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:03 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1314 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:05.509833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c65566f5-74b7-4c7a-b73d-e08664f697c7 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:05.533290 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c65566f5-74b7-4c7a-b73d-e08664f697c7 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1316 microversion: 2.1 time: 1.280097 Jul 26 14:41:05.553457 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2618/5131] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:04 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1316 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:06.296110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e79fd597-59cf-4064-b936-7d7013bd22df tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:06.296762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e79fd597-59cf-4064-b936-7d7013bd22df tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:06.300468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:06.305654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:06.347740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e79fd597-59cf-4064-b936-7d7013bd22df tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:06.351319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e79fd597-59cf-4064-b936-7d7013bd22df tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:06.357723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e79fd597-59cf-4064-b936-7d7013bd22df tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:06.363368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e79fd597-59cf-4064-b936-7d7013bd22df tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:06.560737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-761c87da-0b44-40dc-883f-33bdfd03386a tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:06.561641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-761c87da-0b44-40dc-883f-33bdfd03386a tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:06.594864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-761c87da-0b44-40dc-883f-33bdfd03386a tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:06.604191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-761c87da-0b44-40dc-883f-33bdfd03386a tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:06.605286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-761c87da-0b44-40dc-883f-33bdfd03386a tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:06.608773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-761c87da-0b44-40dc-883f-33bdfd03386a tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:06.717442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:07.644977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e79fd597-59cf-4064-b936-7d7013bd22df tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:07.665012 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e79fd597-59cf-4064-b936-7d7013bd22df tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1314 microversion: 2.1 time: 1.373730 Jul 26 14:41:07.667313 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2514/5132] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:06 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1314 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:41:07.678717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2e90e947-6c67-461f-890d-65f6c01d82af req-84f87674-4ebd-4f8b-afab-bea22d5beb92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8db9f8-ad37-4aa8-8c0a-91d327fbe303", "tag": "0a131c17-1a95-4139-99ff-cc7e5076c036"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:07.704008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2e90e947-6c67-461f-890d-65f6c01d82af req-84f87674-4ebd-4f8b-afab-bea22d5beb92 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:07.704524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2e90e947-6c67-461f-890d-65f6c01d82af req-84f87674-4ebd-4f8b-afab-bea22d5beb92 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:07.731266 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2e90e947-6c67-461f-890d-65f6c01d82af req-84f87674-4ebd-4f8b-afab-bea22d5beb92 service nova] Creating event network-changed:0a131c17-1a95-4139-99ff-cc7e5076c036 for instance 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 on n-h1-833090-9 Jul 26 14:41:07.743968 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2e90e947-6c67-461f-890d-65f6c01d82af req-84f87674-4ebd-4f8b-afab-bea22d5beb92 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073501 Jul 26 14:41:07.746545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2515/5133] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:07.779553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-761c87da-0b44-40dc-883f-33bdfd03386a tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:07.790560 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-761c87da-0b44-40dc-883f-33bdfd03386a tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1316 microversion: 2.1 time: 1.234265 Jul 26 14:41:07.816412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-426f0823-ee0e-4259-b190-11544a2ece43 req-6e82ae4b-ce53-4c7d-b9c7-a7621f34cca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358b56fe-a34a-4182-8b74-b97c49efb388", "name": "network-vif-plugged", "status": "completed", "tag": "3bc61f27-8089-493a-a8cb-889c33e83641"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:07.823175 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2619/5134] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:06 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1316 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:07.829618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-426f0823-ee0e-4259-b190-11544a2ece43 req-6e82ae4b-ce53-4c7d-b9c7-a7621f34cca1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:07.830075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-426f0823-ee0e-4259-b190-11544a2ece43 req-6e82ae4b-ce53-4c7d-b9c7-a7621f34cca1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:07.846231 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-426f0823-ee0e-4259-b190-11544a2ece43 req-6e82ae4b-ce53-4c7d-b9c7-a7621f34cca1 service nova] Creating event network-vif-plugged:3bc61f27-8089-493a-a8cb-889c33e83641 for instance 358b56fe-a34a-4182-8b74-b97c49efb388 on n-h2-833090-9 Jul 26 14:41:07.852680 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-426f0823-ee0e-4259-b190-11544a2ece43 req-6e82ae4b-ce53-4c7d-b9c7-a7621f34cca1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040273 Jul 26 14:41:07.853666 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2516/5135] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:08.690700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ea3f1c78-9cea-4a56-ac8a-fe77b15880cc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:08.691589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ea3f1c78-9cea-4a56-ac8a-fe77b15880cc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:08.723143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea3f1c78-9cea-4a56-ac8a-fe77b15880cc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:08.724322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea3f1c78-9cea-4a56-ac8a-fe77b15880cc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:08.726645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea3f1c78-9cea-4a56-ac8a-fe77b15880cc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:08.728594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea3f1c78-9cea-4a56-ac8a-fe77b15880cc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:08.824488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a50e4f87-7649-4e6c-b785-9023b6953acb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:08.825225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a50e4f87-7649-4e6c-b785-9023b6953acb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:08.849260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a50e4f87-7649-4e6c-b785-9023b6953acb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:08.849772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a50e4f87-7649-4e6c-b785-9023b6953acb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:08.851037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a50e4f87-7649-4e6c-b785-9023b6953acb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:08.853659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a50e4f87-7649-4e6c-b785-9023b6953acb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:08.902098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:09.324874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a50e4f87-7649-4e6c-b785-9023b6953acb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:09.335426 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a50e4f87-7649-4e6c-b785-9023b6953acb tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1316 microversion: 2.1 time: 0.521381 Jul 26 14:41:09.337360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ea3f1c78-9cea-4a56-ac8a-fe77b15880cc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:09.343012 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2517/5136] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:08 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:09.362175 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ea3f1c78-9cea-4a56-ac8a-fe77b15880cc tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1314 microversion: 2.1 time: 0.677126 Jul 26 14:41:09.364939 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2620/5137] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:08 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:10.374441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c9967c1-40d5-4837-9ae1-4c2927a1dd41 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:10.375105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c9967c1-40d5-4837-9ae1-4c2927a1dd41 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:10.395060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-432c132e-da4b-499e-81f9-1c7d340abf0f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:10.401713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c9967c1-40d5-4837-9ae1-4c2927a1dd41 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:10.402189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c9967c1-40d5-4837-9ae1-4c2927a1dd41 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:10.407268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c9967c1-40d5-4837-9ae1-4c2927a1dd41 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:10.410180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-432c132e-da4b-499e-81f9-1c7d340abf0f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:10.420476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c9967c1-40d5-4837-9ae1-4c2927a1dd41 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:10.485989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-432c132e-da4b-499e-81f9-1c7d340abf0f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:10.486826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-432c132e-da4b-499e-81f9-1c7d340abf0f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:10.487886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-432c132e-da4b-499e-81f9-1c7d340abf0f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:10.489192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-432c132e-da4b-499e-81f9-1c7d340abf0f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:11.026803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-432c132e-da4b-499e-81f9-1c7d340abf0f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:11.039228 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-432c132e-da4b-499e-81f9-1c7d340abf0f tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1464 microversion: 2.1 time: 0.649906 Jul 26 14:41:11.046337 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2621/5138] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:10 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1464 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:11.076959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-62fe7650-8972-4cb0-b6d4-8d983abab48c tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5236a8b7-f915-47f9-b91a-aa88a2d72df2", "device": "/dev/sdb"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:11.082615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-62fe7650-8972-4cb0-b6d4-8d983abab48c tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:11.096411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62fe7650-8972-4cb0-b6d4-8d983abab48c tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:11.100463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62fe7650-8972-4cb0-b6d4-8d983abab48c tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:11.101806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62fe7650-8972-4cb0-b6d4-8d983abab48c tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:11.104435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-62fe7650-8972-4cb0-b6d4-8d983abab48c tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:11.665812 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-62fe7650-8972-4cb0-b6d4-8d983abab48c tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "POST /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.595753 Jul 26 14:41:11.667919 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2622/5139] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:41:11 2022] POST /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388/os-volume_attachments => generated 194 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:11.875783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c9967c1-40d5-4837-9ae1-4c2927a1dd41 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:11.896057 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c9967c1-40d5-4837-9ae1-4c2927a1dd41 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1316 microversion: 2.1 time: 1.530349 Jul 26 14:41:11.908120 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2518/5140] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:10 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1316 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:12.240463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af64b0c7-d606-4d36-a32e-18853445e25f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '.version_select at 0x7f87875c0040>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:12.276803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=41 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:12.301856 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af64b0c7-d606-4d36-a32e-18853445e25f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-100308099" status: 202 len: 0 microversion: 2.1 time: 0.069056 Jul 26 14:41:12.308683 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2623/5141] 10.222.0.70 () {58 vars in 1281 bytes} [Tue Jul 26 14:41:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-100308099 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:41:12.347184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05f15cf0-4b37-4f89-aeb7-63fe6cb8bd75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'create', calling method: .version_select at 0x7f8787f0f4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-800761028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJr9EmowhbO2SJWoDOsnCx/HZDlnP2tmsAcDIAd9DrKrS0jwQd9Ydp56dhP0tnDH0YnCIuTOFlmJcwG1zZf9emR7WMKp4+QUNUMVMtahp3TvQY8k5vLg/YcpDvleeSkJuA=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:12.371882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-05f15cf0-4b37-4f89-aeb7-63fe6cb8bd75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:41:12.383491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-05f15cf0-4b37-4f89-aeb7-63fe6cb8bd75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for user 2ace0ada06df49f189f02e59039c2dd8 and project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:41:12.437785 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05f15cf0-4b37-4f89-aeb7-63fe6cb8bd75 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.095704 Jul 26 14:41:12.440172 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2519/5142] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:41:12 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:12.926533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e7b9abc2-0a45-4e30-8eab-8cb4552e9b17 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:12.927872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e7b9abc2-0a45-4e30-8eab-8cb4552e9b17 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:12.945471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7b9abc2-0a45-4e30-8eab-8cb4552e9b17 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:12.948569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7b9abc2-0a45-4e30-8eab-8cb4552e9b17 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:12.949564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7b9abc2-0a45-4e30-8eab-8cb4552e9b17 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:12.950552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7b9abc2-0a45-4e30-8eab-8cb4552e9b17 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:13.019071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:13.432377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e7b9abc2-0a45-4e30-8eab-8cb4552e9b17 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:13.443786 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e7b9abc2-0a45-4e30-8eab-8cb4552e9b17 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1316 microversion: 2.1 time: 0.522178 Jul 26 14:41:13.444432 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2624/5143] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:12 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:13.725147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e12ba11b-87e2-4be4-a6c4-771a302c022c req-e36afc9d-49ff-4653-ae5b-4210a7b65aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8db9f8-ad37-4aa8-8c0a-91d327fbe303", "name": "network-vif-plugged", "status": "completed", "tag": "0a131c17-1a95-4139-99ff-cc7e5076c036"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:13.754852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:13.763972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e12ba11b-87e2-4be4-a6c4-771a302c022c req-e36afc9d-49ff-4653-ae5b-4210a7b65aa5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:13.767429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e12ba11b-87e2-4be4-a6c4-771a302c022c req-e36afc9d-49ff-4653-ae5b-4210a7b65aa5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:13.812553 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e12ba11b-87e2-4be4-a6c4-771a302c022c req-e36afc9d-49ff-4653-ae5b-4210a7b65aa5 service nova] Creating event network-vif-plugged:0a131c17-1a95-4139-99ff-cc7e5076c036 for instance 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 on n-h1-833090-9 Jul 26 14:41:13.832838 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e12ba11b-87e2-4be4-a6c4-771a302c022c req-e36afc9d-49ff-4653-ae5b-4210a7b65aa5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114538 Jul 26 14:41:13.839512 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2520/5144] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:14.465659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-774ea4a9-23d0-41e8-9678-d8805fdf8bf5 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:14.466881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-774ea4a9-23d0-41e8-9678-d8805fdf8bf5 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:14.486261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-774ea4a9-23d0-41e8-9678-d8805fdf8bf5 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:14.489952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-774ea4a9-23d0-41e8-9678-d8805fdf8bf5 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:14.493980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-774ea4a9-23d0-41e8-9678-d8805fdf8bf5 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:14.494683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-774ea4a9-23d0-41e8-9678-d8805fdf8bf5 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:14.795066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-774ea4a9-23d0-41e8-9678-d8805fdf8bf5 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:14.806964 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-774ea4a9-23d0-41e8-9678-d8805fdf8bf5 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1316 microversion: 2.1 time: 0.346072 Jul 26 14:41:14.808282 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2625/5145] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:14 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:15.848349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-578dba44-37e5-4a77-a61e-f677de4663fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:15.860540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-578dba44-37e5-4a77-a61e-f677de4663fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:15.902721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-578dba44-37e5-4a77-a61e-f677de4663fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:15.918063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-578dba44-37e5-4a77-a61e-f677de4663fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:15.925809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-578dba44-37e5-4a77-a61e-f677de4663fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:15.928146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-578dba44-37e5-4a77-a61e-f677de4663fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:16.540318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-578dba44-37e5-4a77-a61e-f677de4663fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:16.554196 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-578dba44-37e5-4a77-a61e-f677de4663fd tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1504 microversion: 2.1 time: 0.723705 Jul 26 14:41:16.556198 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2521/5146] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:15 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1504 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:41:16.590704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ed0d10b-c25f-4002-81c9-25a29280b521 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:16.591995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2ed0d10b-c25f-4002-81c9-25a29280b521 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:16.606182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ed0d10b-c25f-4002-81c9-25a29280b521 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:16.607303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ed0d10b-c25f-4002-81c9-25a29280b521 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:16.609149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ed0d10b-c25f-4002-81c9-25a29280b521 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:16.612292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ed0d10b-c25f-4002-81c9-25a29280b521 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:16.696224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2ed0d10b-c25f-4002-81c9-25a29280b521 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:16.698828 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ed0d10b-c25f-4002-81c9-25a29280b521 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303/os-instance-actions/req-25c816d4-70a7-40dc-9c5b-1e2970988ceb" status: 200 len: 313 microversion: 2.1 time: 0.113615 Jul 26 14:41:16.701073 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2626/5147] 10.222.0.70 () {58 vars in 1419 bytes} [Tue Jul 26 14:41:16 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303/os-instance-actions/req-25c816d4-70a7-40dc-9c5b-1e2970988ceb => generated 313 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:16.715167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-422b0a1c-6d2a-432d-a579-6b93b844847d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:16.719429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-422b0a1c-6d2a-432d-a579-6b93b844847d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:16.726169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-422b0a1c-6d2a-432d-a579-6b93b844847d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:16.726878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-422b0a1c-6d2a-432d-a579-6b93b844847d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:16.727830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-422b0a1c-6d2a-432d-a579-6b93b844847d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:16.728451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-422b0a1c-6d2a-432d-a579-6b93b844847d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:16.822214 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-422b0a1c-6d2a-432d-a579-6b93b844847d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "POST /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303/action" status: 202 len: 0 microversion: 2.1 time: 0.109699 Jul 26 14:41:16.832959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8924f471-c01e-4af8-901f-31b722801d3f tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:16.833950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8924f471-c01e-4af8-901f-31b722801d3f tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:16.839576 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2522/5148] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:41:16 2022] POST /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:41:16.844718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8924f471-c01e-4af8-901f-31b722801d3f tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:16.849132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8924f471-c01e-4af8-901f-31b722801d3f tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:16.850130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8924f471-c01e-4af8-901f-31b722801d3f tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:16.852884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8924f471-c01e-4af8-901f-31b722801d3f tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:17.686556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8924f471-c01e-4af8-901f-31b722801d3f tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:17.707788 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8924f471-c01e-4af8-901f-31b722801d3f tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1506 microversion: 2.1 time: 0.878889 Jul 26 14:41:17.711589 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2627/5149] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:16 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1506 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:18.738802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-196f9198-3739-4722-9224-ee40fc18e066 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:18.740122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-196f9198-3739-4722-9224-ee40fc18e066 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:18.764959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-196f9198-3739-4722-9224-ee40fc18e066 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:18.765434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-196f9198-3739-4722-9224-ee40fc18e066 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:18.768462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-196f9198-3739-4722-9224-ee40fc18e066 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:18.769634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-196f9198-3739-4722-9224-ee40fc18e066 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:19.903346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-196f9198-3739-4722-9224-ee40fc18e066 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:19.924865 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-196f9198-3739-4722-9224-ee40fc18e066 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1506 microversion: 2.1 time: 1.192138 Jul 26 14:41:19.971583 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2523/5150] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:18 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1506 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:20.969003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ad0a8acf-0e11-4c0b-9e5b-1ce78038f230 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:20.969969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ad0a8acf-0e11-4c0b-9e5b-1ce78038f230 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:21.001177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad0a8acf-0e11-4c0b-9e5b-1ce78038f230 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:21.004073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad0a8acf-0e11-4c0b-9e5b-1ce78038f230 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:21.008755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad0a8acf-0e11-4c0b-9e5b-1ce78038f230 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:21.009320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad0a8acf-0e11-4c0b-9e5b-1ce78038f230 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:21.998253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ad0a8acf-0e11-4c0b-9e5b-1ce78038f230 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:22.002240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-130846197", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "8383dd65-4e49-4bc5-9ebb-21e169d7c56a"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:22.018730 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ad0a8acf-0e11-4c0b-9e5b-1ce78038f230 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1504 microversion: 2.1 time: 1.057577 Jul 26 14:41:22.019406 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2628/5151] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:20 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1504 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:22.058564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7373a257-abf2-47e2-b1c5-f120769ca575 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '.version_select at 0x7f8786fe33a0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:22.066187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7373a257-abf2-47e2-b1c5-f120769ca575 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:22.079853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7373a257-abf2-47e2-b1c5-f120769ca575 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:22.085270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7373a257-abf2-47e2-b1c5-f120769ca575 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:22.092113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7373a257-abf2-47e2-b1c5-f120769ca575 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:22.096872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7373a257-abf2-47e2-b1c5-f120769ca575 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:22.173382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] validate_networks() for [('8383dd65-4e49-4bc5-9ebb-21e169d7c56a', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:41:22.228655 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7373a257-abf2-47e2-b1c5-f120769ca575 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.173719 Jul 26 14:41:22.230467 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2629/5152] 10.222.0.70 () {58 vars in 1296 bytes} [Tue Jul 26 14:41:22 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303/os-instance-actions => generated 611 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:22.244269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3465f03-a3fb-4b2a-91f2-a28bb8b15924 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:22.245011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3465f03-a3fb-4b2a-91f2-a28bb8b15924 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:22.263914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3465f03-a3fb-4b2a-91f2-a28bb8b15924 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:22.267300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3465f03-a3fb-4b2a-91f2-a28bb8b15924 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:22.268177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3465f03-a3fb-4b2a-91f2-a28bb8b15924 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:22.269879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3465f03-a3fb-4b2a-91f2-a28bb8b15924 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:22.356263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3465f03-a3fb-4b2a-91f2-a28bb8b15924 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:41:22.395231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:22.632251 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a3465f03-a3fb-4b2a-91f2-a28bb8b15924 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 204 len: 0 microversion: 2.1 time: 0.392020 Jul 26 14:41:22.636117 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2630/5153] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:41:22 2022] DELETE /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:41:22.650139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-955285e7-13bc-4e2e-8d9f-4c8363e12814 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:22.654983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-955285e7-13bc-4e2e-8d9f-4c8363e12814 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:22.664598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-955285e7-13bc-4e2e-8d9f-4c8363e12814 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:22.665089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-955285e7-13bc-4e2e-8d9f-4c8363e12814 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:22.665871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-955285e7-13bc-4e2e-8d9f-4c8363e12814 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:22.666313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-955285e7-13bc-4e2e-8d9f-4c8363e12814 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:23.819279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-955285e7-13bc-4e2e-8d9f-4c8363e12814 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:23.832436 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-955285e7-13bc-4e2e-8d9f-4c8363e12814 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1510 microversion: 2.1 time: 1.194868 Jul 26 14:41:23.836960 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2631/5154] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:22 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1510 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:24.129380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:41:24.130053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:41:24.130972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:41:24.131457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:41:24.131888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:41:24.149898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:24.154256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:24.155386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:24.155855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:24.220631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Getting quotas for project 46e01d4215b24ad3bb9ad02eeb4d43f4. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:41:24.235255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Getting quotas for user 589ac18fc441466badefd04839cc8f3e and project 46e01d4215b24ad3bb9ad02eeb4d43f4. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:41:24.263841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:41:24.272620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:41:24.396037 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1809d3ba-a905-4c20-b266-6e763cee52f6 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.400431 Jul 26 14:41:24.421493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6fa851d6-dc6e-4992-b5b1-941fce80a0ad tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:24.422287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6fa851d6-dc6e-4992-b5b1-941fce80a0ad tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:24.433643 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2524/5155] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:41:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:41:24.669632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6fa851d6-dc6e-4992-b5b1-941fce80a0ad tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:24.678696 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6fa851d6-dc6e-4992-b5b1-941fce80a0ad tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1213 microversion: 2.1 time: 0.260970 Jul 26 14:41:24.691085 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2632/5156] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:24 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1213 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:24.865267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-698aea73-c0ff-4312-9673-03333231cc9d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:24.866178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-698aea73-c0ff-4312-9673-03333231cc9d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:24.881628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-698aea73-c0ff-4312-9673-03333231cc9d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:24.883228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-698aea73-c0ff-4312-9673-03333231cc9d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:24.884527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-698aea73-c0ff-4312-9673-03333231cc9d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:24.885344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-698aea73-c0ff-4312-9673-03333231cc9d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:25.685817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-698aea73-c0ff-4312-9673-03333231cc9d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:25.715848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-11f80e45-f52f-4586-b827-a078dae24a99 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:25.717397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-11f80e45-f52f-4586-b827-a078dae24a99 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:25.748366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11f80e45-f52f-4586-b827-a078dae24a99 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:25.749588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11f80e45-f52f-4586-b827-a078dae24a99 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:25.750493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11f80e45-f52f-4586-b827-a078dae24a99 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:25.757652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11f80e45-f52f-4586-b827-a078dae24a99 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:25.758302 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-698aea73-c0ff-4312-9673-03333231cc9d tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1510 microversion: 2.1 time: 0.893125 Jul 26 14:41:25.767876 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2525/5157] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:24 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1510 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:26.506515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-11f80e45-f52f-4586-b827-a078dae24a99 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:26.523034 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-11f80e45-f52f-4586-b827-a078dae24a99 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1265 microversion: 2.1 time: 0.813900 Jul 26 14:41:26.555979 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2633/5158] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:25 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1265 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:26.800719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dc7427f5-685d-43b4-b884-383bccbb5ea3 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:26.801473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dc7427f5-685d-43b4-b884-383bccbb5ea3 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:26.850938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-edde3891-3f16-4110-b021-f2374e116555 req-7a44decd-a172-4695-9222-c1a7f0a36403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8db9f8-ad37-4aa8-8c0a-91d327fbe303", "name": "network-vif-deleted", "tag": "0a131c17-1a95-4139-99ff-cc7e5076c036"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:26.874768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc7427f5-685d-43b4-b884-383bccbb5ea3 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:26.878254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc7427f5-685d-43b4-b884-383bccbb5ea3 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:26.882907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc7427f5-685d-43b4-b884-383bccbb5ea3 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:26.883659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc7427f5-685d-43b4-b884-383bccbb5ea3 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:26.934172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-edde3891-3f16-4110-b021-f2374e116555 req-7a44decd-a172-4695-9222-c1a7f0a36403 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:26.937395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-edde3891-3f16-4110-b021-f2374e116555 req-7a44decd-a172-4695-9222-c1a7f0a36403 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:26.995569 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-edde3891-3f16-4110-b021-f2374e116555 req-7a44decd-a172-4695-9222-c1a7f0a36403 service nova] Creating event network-vif-deleted:0a131c17-1a95-4139-99ff-cc7e5076c036 for instance 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 on n-h1-833090-9 Jul 26 14:41:27.012713 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-edde3891-3f16-4110-b021-f2374e116555 req-7a44decd-a172-4695-9222-c1a7f0a36403 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163878 Jul 26 14:41:27.015727 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2634/5159] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:27.144757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dc7427f5-685d-43b4-b884-383bccbb5ea3 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad23087765a74a15a65ecbfd3e9bba98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90129695ce014db2aa0e9c50894edb92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:27.163256 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dc7427f5-685d-43b4-b884-383bccbb5ea3 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 200 len: 1301 microversion: 2.1 time: 0.367603 Jul 26 14:41:27.163867 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2526/5160] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:26 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 1301 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:41:27.573266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2f39e218-e087-4b6c-8205-4c43f62b4e70 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:27.574422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2f39e218-e087-4b6c-8205-4c43f62b4e70 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:27.592965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f39e218-e087-4b6c-8205-4c43f62b4e70 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:27.594860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f39e218-e087-4b6c-8205-4c43f62b4e70 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:27.597436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f39e218-e087-4b6c-8205-4c43f62b4e70 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:27.598259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f39e218-e087-4b6c-8205-4c43f62b4e70 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:27.775190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2f39e218-e087-4b6c-8205-4c43f62b4e70 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:27.809240 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2f39e218-e087-4b6c-8205-4c43f62b4e70 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1271 microversion: 2.1 time: 0.226601 Jul 26 14:41:27.823464 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2635/5161] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:27 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:28.185003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7d27e2f-35f6-459b-bbca-6b9f51942193 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:28.185746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c7d27e2f-35f6-459b-bbca-6b9f51942193 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] [instance: 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:28.204804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7d27e2f-35f6-459b-bbca-6b9f51942193 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:28.205275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7d27e2f-35f6-459b-bbca-6b9f51942193 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:28.215517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7d27e2f-35f6-459b-bbca-6b9f51942193 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:28.220844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7d27e2f-35f6-459b-bbca-6b9f51942193 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:28.272125 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c7d27e2f-35f6-459b-bbca-6b9f51942193 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] HTTP exception thrown: Instance 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 could not be found. Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7d27e2f-35f6-459b-bbca-6b9f51942193 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Request method failure captured: Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 HTTP/1.1 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_z09LRiIOzP3D35Vf4IrpOXGEVVFaoy82fFoJK20r0X6G1ZtN5m3d0dGwBReKWyX2Aez3RZXvzgN2tXKk8IzEmFjKlfeXcVnhKizxDLekxebSPl5bCpniIFCNelQ7KuXoNmiZJ_rgAUMMOPQKsOxBntiioupBTJ72nDX8odWS1j6l0 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 90129695ce014db2aa0e9c50894edb92 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-InstanceActionsTestJSON-1224126887 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/90129695ce014db2aa0e9c50894edb92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/90129695ce014db2aa0e9c50894edb92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_90129695ce014db2aa0e9c50894edb92", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/90129695ce014db2aa0e9c50894edb92"}]}] Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-InstanceActionsTestJSON-1224126887 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 90129695ce014db2aa0e9c50894edb92 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1224126887 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-InstanceActionsTestJSON-1224126887-project Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ad23087765a74a15a65ecbfd3e9bba98 Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-InstanceActionsTestJSON-1224126887-project Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 could not be found. Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '1c8db9f8-ad37-4aa8-8c0a-91d327fbe303'} Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 could not be found. Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 could not be found. Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:41:28.280354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:41:28.287943 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:41:28.287943 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:41:28.287943 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:41:28.287943 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:41:28.287943 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:41:28.287943 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 could not be found. Jul 26 14:41:28.287943 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:41:28.290614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7d27e2f-35f6-459b-bbca-6b9f51942193 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] Returning 404 to user: Instance 1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:41:28.294444 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c7d27e2f-35f6-459b-bbca-6b9f51942193 tempest-InstanceActionsTestJSON-1224126887 tempest-InstanceActionsTestJSON-1224126887-project] 10.222.0.70 "GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303" status: 404 len: 111 microversion: 2.1 time: 0.113736 Jul 26 14:41:28.297265 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2527/5162] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:28 2022] GET /compute/v2.1/servers/1c8db9f8-ad37-4aa8-8c0a-91d327fbe303 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:41:28.834539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c9322e9c-33bd-46fc-8897-895adee815b2 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:28.836890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c9322e9c-33bd-46fc-8897-895adee815b2 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:28.862814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9322e9c-33bd-46fc-8897-895adee815b2 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:28.865489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9322e9c-33bd-46fc-8897-895adee815b2 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:28.868702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9322e9c-33bd-46fc-8897-895adee815b2 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:28.869534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9322e9c-33bd-46fc-8897-895adee815b2 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:29.226298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c9322e9c-33bd-46fc-8897-895adee815b2 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:29.245339 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c9322e9c-33bd-46fc-8897-895adee815b2 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1271 microversion: 2.1 time: 0.417110 Jul 26 14:41:29.259325 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2636/5163] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:28 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1271 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:30.277875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d7cded1e-2cd3-49fd-8407-ace515e6d303 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:30.279235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d7cded1e-2cd3-49fd-8407-ace515e6d303 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:30.295983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7cded1e-2cd3-49fd-8407-ace515e6d303 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:30.296458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7cded1e-2cd3-49fd-8407-ace515e6d303 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:30.297548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7cded1e-2cd3-49fd-8407-ace515e6d303 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:30.300500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7cded1e-2cd3-49fd-8407-ace515e6d303 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:30.406661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d7cded1e-2cd3-49fd-8407-ace515e6d303 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:30.418243 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d7cded1e-2cd3-49fd-8407-ace515e6d303 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1271 microversion: 2.1 time: 0.145243 Jul 26 14:41:30.428753 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2528/5164] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:30 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:31.441019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-41aa8609-75c1-4757-89e9-aec32c77a715 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:31.446245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-41aa8609-75c1-4757-89e9-aec32c77a715 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:31.475096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41aa8609-75c1-4757-89e9-aec32c77a715 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:31.477170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41aa8609-75c1-4757-89e9-aec32c77a715 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:31.481242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41aa8609-75c1-4757-89e9-aec32c77a715 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:31.482498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41aa8609-75c1-4757-89e9-aec32c77a715 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:32.419592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-41aa8609-75c1-4757-89e9-aec32c77a715 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:32.439169 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-41aa8609-75c1-4757-89e9-aec32c77a715 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1313 microversion: 2.1 time: 1.002060 Jul 26 14:41:32.441408 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2637/5165] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:31 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1313 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:33.472688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-276e086f-22ad-4eaf-b6d4-e72224756819 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:33.474077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-276e086f-22ad-4eaf-b6d4-e72224756819 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:33.494952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-276e086f-22ad-4eaf-b6d4-e72224756819 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:33.495788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-276e086f-22ad-4eaf-b6d4-e72224756819 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:33.496823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-276e086f-22ad-4eaf-b6d4-e72224756819 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:33.497477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-276e086f-22ad-4eaf-b6d4-e72224756819 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:33.938848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-276e086f-22ad-4eaf-b6d4-e72224756819 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:33.948894 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-276e086f-22ad-4eaf-b6d4-e72224756819 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1313 microversion: 2.1 time: 0.480451 Jul 26 14:41:33.950247 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2529/5166] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:33 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:34.970867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-99c4bd2a-414a-48c1-85a8-f6124728b560 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:34.971492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-99c4bd2a-414a-48c1-85a8-f6124728b560 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:34.990624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:35.000005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99c4bd2a-414a-48c1-85a8-f6124728b560 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:35.002961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99c4bd2a-414a-48c1-85a8-f6124728b560 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:35.008039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99c4bd2a-414a-48c1-85a8-f6124728b560 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:35.008785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99c4bd2a-414a-48c1-85a8-f6124728b560 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:35.053683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-272152038", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "67ea8999-414b-4f48-b580-acd0597759fb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-800761028", "security_groups": [{"name": "tempest-secgroup-smoke-679578598"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:35.075531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:35.079122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:35.464248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] validate_networks() for [('67ea8999-414b-4f48-b580-acd0597759fb', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:41:35.878466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99c4bd2a-414a-48c1-85a8-f6124728b560 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:35.890278 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-99c4bd2a-414a-48c1-85a8-f6124728b560 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1313 microversion: 2.1 time: 0.923263 Jul 26 14:41:35.906936 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2638/5167] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:34 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1313 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:35.918099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-862a4c7d-353a-4f59-b1fd-36b4c2b477f4 req-befbeae1-5765-41ed-87ab-5888855da7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "531851b3-ca95-4b82-8597-cf8bef73617e", "tag": "5cfd4342-099c-462d-a11f-052fdd386b12"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:35.958240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-862a4c7d-353a-4f59-b1fd-36b4c2b477f4 req-befbeae1-5765-41ed-87ab-5888855da7c7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:35.961522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-862a4c7d-353a-4f59-b1fd-36b4c2b477f4 req-befbeae1-5765-41ed-87ab-5888855da7c7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:35.992515 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-862a4c7d-353a-4f59-b1fd-36b4c2b477f4 req-befbeae1-5765-41ed-87ab-5888855da7c7 service nova] Creating event network-changed:5cfd4342-099c-462d-a11f-052fdd386b12 for instance 531851b3-ca95-4b82-8597-cf8bef73617e on n-h1-833090-9 Jul 26 14:41:35.999544 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-862a4c7d-353a-4f59-b1fd-36b4c2b477f4 req-befbeae1-5765-41ed-87ab-5888855da7c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089558 Jul 26 14:41:36.005499 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2639/5168] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:36.927738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-94c74a0e-be13-4f52-8000-504eb118c2ae tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:36.929795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-94c74a0e-be13-4f52-8000-504eb118c2ae tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:36.954819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94c74a0e-be13-4f52-8000-504eb118c2ae tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:36.955284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94c74a0e-be13-4f52-8000-504eb118c2ae tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:36.960457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94c74a0e-be13-4f52-8000-504eb118c2ae tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:36.961533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94c74a0e-be13-4f52-8000-504eb118c2ae tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:37.146768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:41:37.147358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:41:37.147978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:41:37.148538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:41:37.149067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:41:37.176304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:37.179399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:37.183084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:37.185770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:37.285341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:41:37.311513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for user 2ace0ada06df49f189f02e59039c2dd8 and project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:41:37.378324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:41:37.393344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:41:37.517241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-94c74a0e-be13-4f52-8000-504eb118c2ae tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:37.534546 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-94c74a0e-be13-4f52-8000-504eb118c2ae tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1313 microversion: 2.1 time: 0.620176 Jul 26 14:41:37.542609 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2640/5169] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:36 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1313 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:37.561935 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-76192ed4-d7e6-43a8-825d-736795337eaf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.512205 Jul 26 14:41:37.575395 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2530/5170] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:41:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:41:37.581483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d397b0a6-d9a4-4963-99f7-ea40aa919f22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:37.582286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d397b0a6-d9a4-4963-99f7-ea40aa919f22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:37.858699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d397b0a6-d9a4-4963-99f7-ea40aa919f22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:37.868223 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d397b0a6-d9a4-4963-99f7-ea40aa919f22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1265 microversion: 2.1 time: 0.291103 Jul 26 14:41:37.880097 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2641/5171] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:37 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:38.568373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c5e42fba-fe5d-442d-a913-52fb0284e358 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:38.571299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c5e42fba-fe5d-442d-a913-52fb0284e358 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:38.610674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5e42fba-fe5d-442d-a913-52fb0284e358 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:38.616643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5e42fba-fe5d-442d-a913-52fb0284e358 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:38.618436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5e42fba-fe5d-442d-a913-52fb0284e358 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:38.624454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5e42fba-fe5d-442d-a913-52fb0284e358 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:38.905401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-45107f26-c974-425d-8751-931c1637ea73 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:38.906734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-45107f26-c974-425d-8751-931c1637ea73 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:38.924313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-45107f26-c974-425d-8751-931c1637ea73 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:38.925169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-45107f26-c974-425d-8751-931c1637ea73 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:38.926209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-45107f26-c974-425d-8751-931c1637ea73 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:38.927477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-45107f26-c974-425d-8751-931c1637ea73 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:38.971919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:39.140323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-45107f26-c974-425d-8751-931c1637ea73 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:39.163247 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-45107f26-c974-425d-8751-931c1637ea73 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1269 microversion: 2.1 time: 0.262762 Jul 26 14:41:39.167300 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2642/5172] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:38 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:39.530310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c5e42fba-fe5d-442d-a913-52fb0284e358 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:39.540088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:39.543656 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c5e42fba-fe5d-442d-a913-52fb0284e358 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1313 microversion: 2.1 time: 0.980864 Jul 26 14:41:39.550256 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2531/5173] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:38 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1313 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:40.198632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d4c2b2ba-3297-45c8-bc57-60728b2eacc3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:40.199331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d4c2b2ba-3297-45c8-bc57-60728b2eacc3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:40.263404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4c2b2ba-3297-45c8-bc57-60728b2eacc3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:40.268904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4c2b2ba-3297-45c8-bc57-60728b2eacc3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:40.273051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4c2b2ba-3297-45c8-bc57-60728b2eacc3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:40.273863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4c2b2ba-3297-45c8-bc57-60728b2eacc3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:40.573971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b4eae184-6abc-47ab-b976-e6c233d4a84c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:40.574673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b4eae184-6abc-47ab-b976-e6c233d4a84c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:40.587173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d4c2b2ba-3297-45c8-bc57-60728b2eacc3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:40.603786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4eae184-6abc-47ab-b976-e6c233d4a84c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:40.605472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4eae184-6abc-47ab-b976-e6c233d4a84c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:40.607824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4eae184-6abc-47ab-b976-e6c233d4a84c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:40.609860 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d4c2b2ba-3297-45c8-bc57-60728b2eacc3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1335 microversion: 2.1 time: 0.418025 Jul 26 14:41:40.610608 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2643/5174] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:40 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1335 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:40.611295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b4eae184-6abc-47ab-b976-e6c233d4a84c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:41.330736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b4eae184-6abc-47ab-b976-e6c233d4a84c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:41.352097 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b4eae184-6abc-47ab-b976-e6c233d4a84c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1313 microversion: 2.1 time: 0.782393 Jul 26 14:41:41.354212 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2532/5175] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:40 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1313 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:41.639130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5d80048f-d6db-479a-8baa-e554108fc910 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:41.640575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5d80048f-d6db-479a-8baa-e554108fc910 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:41.655527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d80048f-d6db-479a-8baa-e554108fc910 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:41.656381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d80048f-d6db-479a-8baa-e554108fc910 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:41.660746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d80048f-d6db-479a-8baa-e554108fc910 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:41.662417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d80048f-d6db-479a-8baa-e554108fc910 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:41.895644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5d80048f-d6db-479a-8baa-e554108fc910 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:41.909560 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5d80048f-d6db-479a-8baa-e554108fc910 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1323 microversion: 2.1 time: 0.274149 Jul 26 14:41:41.910092 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2644/5176] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:41 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:42.384262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9a1a6971-53f7-42b7-9c72-f2275710b555 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:42.386300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9a1a6971-53f7-42b7-9c72-f2275710b555 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:42.409318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a1a6971-53f7-42b7-9c72-f2275710b555 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:42.417116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a1a6971-53f7-42b7-9c72-f2275710b555 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:42.419032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a1a6971-53f7-42b7-9c72-f2275710b555 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:42.423320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a1a6971-53f7-42b7-9c72-f2275710b555 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:42.759445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a1a6971-53f7-42b7-9c72-f2275710b555 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:42.777321 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9a1a6971-53f7-42b7-9c72-f2275710b555 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1313 microversion: 2.1 time: 0.403162 Jul 26 14:41:42.779508 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2533/5177] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:42 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:42.937914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5f23a37d-c7f2-41d2-9ecb-e651819e33ec tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:42.938543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5f23a37d-c7f2-41d2-9ecb-e651819e33ec tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:42.950201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:42.956147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f23a37d-c7f2-41d2-9ecb-e651819e33ec tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:42.956841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f23a37d-c7f2-41d2-9ecb-e651819e33ec tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:42.961639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f23a37d-c7f2-41d2-9ecb-e651819e33ec tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:42.962581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f23a37d-c7f2-41d2-9ecb-e651819e33ec tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:43.604674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-afefc716-6b42-41f0-a9c7-16f9bf165b21 req-3f30bc17-0124-4136-b0ff-fc6b292a68b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531851b3-ca95-4b82-8597-cf8bef73617e", "name": "network-vif-plugged", "status": "completed", "tag": "5cfd4342-099c-462d-a11f-052fdd386b12"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:43.661713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-afefc716-6b42-41f0-a9c7-16f9bf165b21 req-3f30bc17-0124-4136-b0ff-fc6b292a68b2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:43.662309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-afefc716-6b42-41f0-a9c7-16f9bf165b21 req-3f30bc17-0124-4136-b0ff-fc6b292a68b2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:43.743807 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-afefc716-6b42-41f0-a9c7-16f9bf165b21 req-3f30bc17-0124-4136-b0ff-fc6b292a68b2 service nova] Creating event network-vif-plugged:5cfd4342-099c-462d-a11f-052fdd386b12 for instance 531851b3-ca95-4b82-8597-cf8bef73617e on n-h1-833090-9 Jul 26 14:41:43.769836 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-afefc716-6b42-41f0-a9c7-16f9bf165b21 req-3f30bc17-0124-4136-b0ff-fc6b292a68b2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176542 Jul 26 14:41:43.780357 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2534/5178] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:41:43.803385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5f23a37d-c7f2-41d2-9ecb-e651819e33ec tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:43.821689 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5f23a37d-c7f2-41d2-9ecb-e651819e33ec tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1390 microversion: 2.1 time: 0.888501 Jul 26 14:41:43.822088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f49790fb-9bc6-4683-b49c-da365d59e9f1 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:43.822813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f49790fb-9bc6-4683-b49c-da365d59e9f1 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:43.824938 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2645/5179] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:42 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1390 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:43.855055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f49790fb-9bc6-4683-b49c-da365d59e9f1 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:43.868716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f49790fb-9bc6-4683-b49c-da365d59e9f1 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:43.886188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f49790fb-9bc6-4683-b49c-da365d59e9f1 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:43.887104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f49790fb-9bc6-4683-b49c-da365d59e9f1 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:44.805981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f49790fb-9bc6-4683-b49c-da365d59e9f1 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:44.819306 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f49790fb-9bc6-4683-b49c-da365d59e9f1 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1313 microversion: 2.1 time: 1.001818 Jul 26 14:41:44.820791 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2535/5180] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:43 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1313 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:41:44.850342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83bc9778-26ac-46ff-b2eb-68c73df0175c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:44.855259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-83bc9778-26ac-46ff-b2eb-68c73df0175c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:44.877091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83bc9778-26ac-46ff-b2eb-68c73df0175c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:44.878175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83bc9778-26ac-46ff-b2eb-68c73df0175c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:44.892512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83bc9778-26ac-46ff-b2eb-68c73df0175c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:44.894198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83bc9778-26ac-46ff-b2eb-68c73df0175c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:45.847265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9a8c2e9a-7a03-458c-a259-d50c6447c294 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:45.847897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9a8c2e9a-7a03-458c-a259-d50c6447c294 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:45.875301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-83bc9778-26ac-46ff-b2eb-68c73df0175c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:45.894631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a8c2e9a-7a03-458c-a259-d50c6447c294 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:45.895109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a8c2e9a-7a03-458c-a259-d50c6447c294 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:45.896725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a8c2e9a-7a03-458c-a259-d50c6447c294 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:45.897307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a8c2e9a-7a03-458c-a259-d50c6447c294 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:45.920677 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-83bc9778-26ac-46ff-b2eb-68c73df0175c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1390 microversion: 2.1 time: 1.075581 Jul 26 14:41:45.936602 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2646/5181] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:44 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1390 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:46.607049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a8c2e9a-7a03-458c-a259-d50c6447c294 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:46.617429 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9a8c2e9a-7a03-458c-a259-d50c6447c294 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1495 microversion: 2.1 time: 0.774250 Jul 26 14:41:46.637921 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2536/5182] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:45 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1495 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:46.823310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a716b809-e070-4c4b-950c-4d7d9a960f7b req-2249c10b-3f86-4367-805b-da51915e2155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:46.853841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a716b809-e070-4c4b-950c-4d7d9a960f7b req-2249c10b-3f86-4367-805b-da51915e2155 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:46.865872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a716b809-e070-4c4b-950c-4d7d9a960f7b req-2249c10b-3f86-4367-805b-da51915e2155 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:46.925377 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a716b809-e070-4c4b-950c-4d7d9a960f7b req-2249c10b-3f86-4367-805b-da51915e2155 service nova] Creating event network-changed:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h2-833090-9 Jul 26 14:41:46.948906 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a716b809-e070-4c4b-950c-4d7d9a960f7b req-2249c10b-3f86-4367-805b-da51915e2155 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129985 Jul 26 14:41:46.950088 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2647/5183] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:46.961336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d425cb53-82a6-4054-9c11-ef42085e53c3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:46.962227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d425cb53-82a6-4054-9c11-ef42085e53c3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:46.985725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:47.001070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d425cb53-82a6-4054-9c11-ef42085e53c3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:47.001912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d425cb53-82a6-4054-9c11-ef42085e53c3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:47.013546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d425cb53-82a6-4054-9c11-ef42085e53c3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:47.019608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d425cb53-82a6-4054-9c11-ef42085e53c3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:47.226139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:47.344604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:47.789200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-876c6656-eed8-46f9-9154-a0c6562915a4 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:47.790218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-876c6656-eed8-46f9-9154-a0c6562915a4 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:47.807350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-876c6656-eed8-46f9-9154-a0c6562915a4 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:47.811485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-876c6656-eed8-46f9-9154-a0c6562915a4 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:47.813836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-876c6656-eed8-46f9-9154-a0c6562915a4 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:47.815990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-876c6656-eed8-46f9-9154-a0c6562915a4 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:47.862939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:41:47.867089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-876c6656-eed8-46f9-9154-a0c6562915a4 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:41:47.870525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d425cb53-82a6-4054-9c11-ef42085e53c3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:47.889912 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d425cb53-82a6-4054-9c11-ef42085e53c3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1390 microversion: 2.1 time: 0.925202 Jul 26 14:41:47.900639 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2537/5184] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:46 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1390 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:48.076070 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-876c6656-eed8-46f9-9154-a0c6562915a4 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "DELETE /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 204 len: 0 microversion: 2.1 time: 0.290959 Jul 26 14:41:48.084348 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2648/5185] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:41:47 2022] DELETE /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:41:48.091994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f963fc21-9f40-481e-84b4-4826337751da tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:48.092845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f963fc21-9f40-481e-84b4-4826337751da tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:48.119979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f963fc21-9f40-481e-84b4-4826337751da tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:48.120458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f963fc21-9f40-481e-84b4-4826337751da tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:48.126795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f963fc21-9f40-481e-84b4-4826337751da tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:48.127490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f963fc21-9f40-481e-84b4-4826337751da tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:48.514248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f963fc21-9f40-481e-84b4-4826337751da tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:48.523163 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f963fc21-9f40-481e-84b4-4826337751da tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1501 microversion: 2.1 time: 0.435272 Jul 26 14:41:48.529980 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2538/5186] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:48 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1501 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:48.934915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-04b1ea77-cac7-4e35-9091-91eda4689149 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:48.936246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-04b1ea77-cac7-4e35-9091-91eda4689149 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:48.964409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04b1ea77-cac7-4e35-9091-91eda4689149 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:48.966175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04b1ea77-cac7-4e35-9091-91eda4689149 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:48.969151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04b1ea77-cac7-4e35-9091-91eda4689149 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:48.969847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-04b1ea77-cac7-4e35-9091-91eda4689149 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:49.553114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ab98264b-0b62-47b7-8061-a548e7a63e59 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:49.554568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ab98264b-0b62-47b7-8061-a548e7a63e59 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:49.573008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab98264b-0b62-47b7-8061-a548e7a63e59 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:49.587615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab98264b-0b62-47b7-8061-a548e7a63e59 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:49.587615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab98264b-0b62-47b7-8061-a548e7a63e59 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:49.617247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab98264b-0b62-47b7-8061-a548e7a63e59 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:49.964184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-04b1ea77-cac7-4e35-9091-91eda4689149 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:49.980233 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-04b1ea77-cac7-4e35-9091-91eda4689149 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1390 microversion: 2.1 time: 1.060089 Jul 26 14:41:49.993072 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2649/5187] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:48 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1390 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:50.178306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ab98264b-0b62-47b7-8061-a548e7a63e59 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:50.189059 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ab98264b-0b62-47b7-8061-a548e7a63e59 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1501 microversion: 2.1 time: 0.640454 Jul 26 14:41:50.191668 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2539/5188] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:49 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1501 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:50.800636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-52579698-519a-49cf-bd48-74b05715c749 req-d4d45094-e86a-4818-a544-3d44b8b78f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "531851b3-ca95-4b82-8597-cf8bef73617e", "name": "network-vif-deleted", "tag": "5cfd4342-099c-462d-a11f-052fdd386b12"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:50.829413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-52579698-519a-49cf-bd48-74b05715c749 req-d4d45094-e86a-4818-a544-3d44b8b78f61 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:50.831315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-52579698-519a-49cf-bd48-74b05715c749 req-d4d45094-e86a-4818-a544-3d44b8b78f61 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:50.852410 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-52579698-519a-49cf-bd48-74b05715c749 req-d4d45094-e86a-4818-a544-3d44b8b78f61 service nova] Creating event network-vif-deleted:5cfd4342-099c-462d-a11f-052fdd386b12 for instance 531851b3-ca95-4b82-8597-cf8bef73617e on n-h1-833090-9 Jul 26 14:41:50.858180 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-52579698-519a-49cf-bd48-74b05715c749 req-d4d45094-e86a-4818-a544-3d44b8b78f61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061163 Jul 26 14:41:50.860377 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2650/5189] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:41:51.003124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5e6389c1-51d7-4b80-b79f-14fa3bea30e6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:51.003736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5e6389c1-51d7-4b80-b79f-14fa3bea30e6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:51.023308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e6389c1-51d7-4b80-b79f-14fa3bea30e6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:51.024046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e6389c1-51d7-4b80-b79f-14fa3bea30e6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:51.025114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e6389c1-51d7-4b80-b79f-14fa3bea30e6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:51.029089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e6389c1-51d7-4b80-b79f-14fa3bea30e6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:51.215703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:51.218218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:51.246179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:51.247115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:51.253606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:51.255481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:51.352536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:51.355452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:51.356195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lazy-loading 'fault' on Instance uuid 531851b3-ca95-4b82-8597-cf8bef73617e {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:41:51.898150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:51.917656 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba9124d1-2698-4a74-8d01-013f5a54f390 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 200 len: 1303 microversion: 2.1 time: 0.707871 Jul 26 14:41:51.918939 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2651/5190] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:51 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 1303 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:52.416689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5e6389c1-51d7-4b80-b79f-14fa3bea30e6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:52.439619 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5e6389c1-51d7-4b80-b79f-14fa3bea30e6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1390 microversion: 2.1 time: 1.436940 Jul 26 14:41:52.461798 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2540/5191] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:50 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1390 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:52.951433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a49d9e1c-6766-46be-858c-c297e087086a tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:52.952246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a49d9e1c-6766-46be-858c-c297e087086a tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 531851b3-ca95-4b82-8597-cf8bef73617e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:52.969484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a49d9e1c-6766-46be-858c-c297e087086a tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:52.969945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a49d9e1c-6766-46be-858c-c297e087086a tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:52.976008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a49d9e1c-6766-46be-858c-c297e087086a tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:52.976667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a49d9e1c-6766-46be-858c-c297e087086a tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:53.022762 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a49d9e1c-6766-46be-858c-c297e087086a tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] HTTP exception thrown: Instance 531851b3-ca95-4b82-8597-cf8bef73617e could not be found. Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a49d9e1c-6766-46be-858c-c297e087086a tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Request method failure captured: Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e HTTP/1.1 Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_0NjFgxFbLSJjDg6SeHzzIRlGa1vYa22HQLfPrBGy-8wd3qgze2VO5aaHi8g7-VZYobR8WkqPTbBDc_Mb1S_4Y1OGm8uNXPQhOPcMn9MEeWdCHhjNp_xKGqfpt6qC0yWssgdZZVP6jJECTWqV6EU4_w4lWlAdetpKb4-Soy5TFA_bs Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 46e01d4215b24ad3bb9ad02eeb4d43f4 Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-VolumesActionsTest-1646934151 Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46e01d4215b24ad3bb9ad02eeb4d43f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46e01d4215b24ad3bb9ad02eeb4d43f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46e01d4215b24ad3bb9ad02eeb4d43f4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46e01d4215b24ad3bb9ad02eeb4d43f4"}]}] Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-VolumesActionsTest-1646934151 Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 46e01d4215b24ad3bb9ad02eeb4d43f4 Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-VolumesActionsTest-1646934151 Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-VolumesActionsTest-1646934151-project Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 589ac18fc441466badefd04839cc8f3e Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-VolumesActionsTest-1646934151-project Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 531851b3-ca95-4b82-8597-cf8bef73617e could not be found. Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '531851b3-ca95-4b82-8597-cf8bef73617e'} Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531851b3-ca95-4b82-8597-cf8bef73617e could not be found. Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531851b3-ca95-4b82-8597-cf8bef73617e could not be found. Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:41:53.030542 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:41:53.038354 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:41:53.038354 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:41:53.038354 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:41:53.038354 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:41:53.038354 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:41:53.038354 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531851b3-ca95-4b82-8597-cf8bef73617e could not be found. Jul 26 14:41:53.038354 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:41:53.042118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a49d9e1c-6766-46be-858c-c297e087086a tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Returning 404 to user: Instance 531851b3-ca95-4b82-8597-cf8bef73617e could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:41:53.043817 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a49d9e1c-6766-46be-858c-c297e087086a tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e" status: 404 len: 111 microversion: 2.1 time: 0.098496 Jul 26 14:41:53.044790 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2652/5192] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:52 2022] GET /compute/v2.1/servers/531851b3-ca95-4b82-8597-cf8bef73617e => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:41:53.402368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-35807505", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "8383dd65-4e49-4bc5-9ebb-21e169d7c56a"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:53.468960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-de6f28b5-6bdb-4456-a1f4-2ed963609f53 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:53.470298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-de6f28b5-6bdb-4456-a1f4-2ed963609f53 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:53.494972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de6f28b5-6bdb-4456-a1f4-2ed963609f53 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:53.495798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de6f28b5-6bdb-4456-a1f4-2ed963609f53 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:53.505336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de6f28b5-6bdb-4456-a1f4-2ed963609f53 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:53.505336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de6f28b5-6bdb-4456-a1f4-2ed963609f53 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:53.570310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] validate_networks() for [('8383dd65-4e49-4bc5-9ebb-21e169d7c56a', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:41:54.669874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-de6f28b5-6bdb-4456-a1f4-2ed963609f53 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:54.691560 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-de6f28b5-6bdb-4456-a1f4-2ed963609f53 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1390 microversion: 2.1 time: 1.228329 Jul 26 14:41:54.701915 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2653/5193] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:53 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1390 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:41:55.725161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1693dda3-5710-4233-bae1-53cd3717b0b9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:55.725961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1693dda3-5710-4233-bae1-53cd3717b0b9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:55.742768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1693dda3-5710-4233-bae1-53cd3717b0b9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:55.752648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1693dda3-5710-4233-bae1-53cd3717b0b9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:55.754094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1693dda3-5710-4233-bae1-53cd3717b0b9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:55.756219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1693dda3-5710-4233-bae1-53cd3717b0b9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:55.827800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:41:55.828436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:41:55.828966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:41:55.829499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:41:55.830092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:41:55.860798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:55.862447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:55.866037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:55.868899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:55.930744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Getting quotas for project 46e01d4215b24ad3bb9ad02eeb4d43f4. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:41:55.948568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Getting quotas for user 589ac18fc441466badefd04839cc8f3e and project 46e01d4215b24ad3bb9ad02eeb4d43f4. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:41:55.980701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:41:55.985642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:41:56.138331 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-53af47be-a771-4d3d-94d8-35bfda54e806 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.740654 Jul 26 14:41:56.140942 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2541/5194] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:41:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:41:56.163308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c8b5c37-39af-45c9-bbed-1202f6503479 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:56.167416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c8b5c37-39af-45c9-bbed-1202f6503479 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:56.490599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c8b5c37-39af-45c9-bbed-1202f6503479 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:56.501874 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c8b5c37-39af-45c9-bbed-1202f6503479 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1212 microversion: 2.1 time: 0.350767 Jul 26 14:41:56.525148 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2542/5195] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:56 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1212 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:56.778483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1693dda3-5710-4233-bae1-53cd3717b0b9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:56.796767 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1693dda3-5710-4233-bae1-53cd3717b0b9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1390 microversion: 2.1 time: 1.076520 Jul 26 14:41:56.804891 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2654/5196] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:55 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1390 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:57.525998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-637b8a20-785c-472c-b71b-20af07c6fe3c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:57.526735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-637b8a20-785c-472c-b71b-20af07c6fe3c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:57.570189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-637b8a20-785c-472c-b71b-20af07c6fe3c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:57.570650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-637b8a20-785c-472c-b71b-20af07c6fe3c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:57.571446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-637b8a20-785c-472c-b71b-20af07c6fe3c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:57.571892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-637b8a20-785c-472c-b71b-20af07c6fe3c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:57.778361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-637b8a20-785c-472c-b71b-20af07c6fe3c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:57.789858 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-637b8a20-785c-472c-b71b-20af07c6fe3c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1208 microversion: 2.1 time: 0.268332 Jul 26 14:41:57.791883 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2543/5197] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:57 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1208 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:57.834157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-65062895-27e7-4077-b6cf-0edccc3b3b0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:57.836892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-65062895-27e7-4077-b6cf-0edccc3b3b0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:57.865451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65062895-27e7-4077-b6cf-0edccc3b3b0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:57.866954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65062895-27e7-4077-b6cf-0edccc3b3b0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:57.871395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65062895-27e7-4077-b6cf-0edccc3b3b0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:57.879918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-65062895-27e7-4077-b6cf-0edccc3b3b0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:58.150539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-70eb3bd3-5ca1-4c41-88c6-c324646bbd9e req-c5287f2d-98ff-4345-8161-938475494115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "name": "network-vif-plugged", "status": "completed", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:41:58.182418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-70eb3bd3-5ca1-4c41-88c6-c324646bbd9e req-c5287f2d-98ff-4345-8161-938475494115 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:58.183360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-70eb3bd3-5ca1-4c41-88c6-c324646bbd9e req-c5287f2d-98ff-4345-8161-938475494115 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:58.241525 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-70eb3bd3-5ca1-4c41-88c6-c324646bbd9e req-c5287f2d-98ff-4345-8161-938475494115 service nova] Creating event network-vif-plugged:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h2-833090-9 Jul 26 14:41:58.250388 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-70eb3bd3-5ca1-4c41-88c6-c324646bbd9e req-c5287f2d-98ff-4345-8161-938475494115 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104531 Jul 26 14:41:58.252804 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2544/5198] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:41:58.682036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-65062895-27e7-4077-b6cf-0edccc3b3b0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:58.698278 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-65062895-27e7-4077-b6cf-0edccc3b3b0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1390 microversion: 2.1 time: 0.873718 Jul 26 14:41:58.704725 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2655/5199] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:57 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1390 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:58.816519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8f2cdfd5-dbc6-4631-b3bf-e9446e21741f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:58.818492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8f2cdfd5-dbc6-4631-b3bf-e9446e21741f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:58.836516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f2cdfd5-dbc6-4631-b3bf-e9446e21741f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:58.837130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f2cdfd5-dbc6-4631-b3bf-e9446e21741f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:58.838255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f2cdfd5-dbc6-4631-b3bf-e9446e21741f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:58.838814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f2cdfd5-dbc6-4631-b3bf-e9446e21741f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:58.982220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8f2cdfd5-dbc6-4631-b3bf-e9446e21741f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:41:58.991684 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8f2cdfd5-dbc6-4631-b3bf-e9446e21741f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1270 microversion: 2.1 time: 0.180600 Jul 26 14:41:58.994655 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2545/5200] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:58 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:41:59.726509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9a9492c-ab5f-4aff-bd1d-e558da887c98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:41:59.727666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d9a9492c-ab5f-4aff-bd1d-e558da887c98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:41:59.749575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9a9492c-ab5f-4aff-bd1d-e558da887c98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:59.750054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9a9492c-ab5f-4aff-bd1d-e558da887c98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:41:59.752282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9a9492c-ab5f-4aff-bd1d-e558da887c98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:41:59.752420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9a9492c-ab5f-4aff-bd1d-e558da887c98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:00.014741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fcade20f-a255-4522-a787-57ea454529ac tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:00.016519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fcade20f-a255-4522-a787-57ea454529ac tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:00.048384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcade20f-a255-4522-a787-57ea454529ac tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:00.049375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcade20f-a255-4522-a787-57ea454529ac tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:00.053621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcade20f-a255-4522-a787-57ea454529ac tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:00.054728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcade20f-a255-4522-a787-57ea454529ac tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:00.229093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d9a9492c-ab5f-4aff-bd1d-e558da887c98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:00.253051 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d9a9492c-ab5f-4aff-bd1d-e558da887c98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1390 microversion: 2.1 time: 0.531401 Jul 26 14:42:00.273497 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2656/5201] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:41:59 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1390 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:00.292704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fcade20f-a255-4522-a787-57ea454529ac tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:00.310195 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fcade20f-a255-4522-a787-57ea454529ac tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1270 microversion: 2.1 time: 0.298046 Jul 26 14:42:00.314202 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2546/5202] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:00 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1270 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:42:01.276929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c28391ce-94c2-45d6-b5c1-f0cb5fe03fed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:01.277563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c28391ce-94c2-45d6-b5c1-f0cb5fe03fed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:01.289864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c28391ce-94c2-45d6-b5c1-f0cb5fe03fed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:01.290334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c28391ce-94c2-45d6-b5c1-f0cb5fe03fed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:01.291136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c28391ce-94c2-45d6-b5c1-f0cb5fe03fed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:01.291593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c28391ce-94c2-45d6-b5c1-f0cb5fe03fed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:01.334932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9202072f-eb26-46be-a3a0-c3ddccfb2c54 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:01.336677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9202072f-eb26-46be-a3a0-c3ddccfb2c54 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:01.345434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9202072f-eb26-46be-a3a0-c3ddccfb2c54 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:01.349321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9202072f-eb26-46be-a3a0-c3ddccfb2c54 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:01.350410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9202072f-eb26-46be-a3a0-c3ddccfb2c54 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:01.351246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9202072f-eb26-46be-a3a0-c3ddccfb2c54 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:01.791665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c28391ce-94c2-45d6-b5c1-f0cb5fe03fed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:01.806404 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c28391ce-94c2-45d6-b5c1-f0cb5fe03fed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1562 microversion: 2.1 time: 0.533565 Jul 26 14:42:01.833794 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2657/5203] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:01 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1562 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:01.839666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71b3d64b-badd-429b-a0cd-9d12e9deca47 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:01.856992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71b3d64b-badd-429b-a0cd-9d12e9deca47 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:01.871904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71b3d64b-badd-429b-a0cd-9d12e9deca47 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:01.873939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71b3d64b-badd-429b-a0cd-9d12e9deca47 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:01.876975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71b3d64b-badd-429b-a0cd-9d12e9deca47 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:01.877451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9202072f-eb26-46be-a3a0-c3ddccfb2c54 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:01.882276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71b3d64b-badd-429b-a0cd-9d12e9deca47 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:01.892850 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9202072f-eb26-46be-a3a0-c3ddccfb2c54 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1312 microversion: 2.1 time: 0.564951 Jul 26 14:42:01.897553 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2547/5204] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:01 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1312 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:42:02.494362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-71b3d64b-badd-429b-a0cd-9d12e9deca47 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:02.509981 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71b3d64b-badd-429b-a0cd-9d12e9deca47 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1562 microversion: 2.1 time: 0.673407 Jul 26 14:42:02.531212 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2658/5205] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:01 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1562 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:02.928477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e8734d96-3661-4819-bfcb-2ebbd5fdcf95 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:02.929106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e8734d96-3661-4819-bfcb-2ebbd5fdcf95 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:02.947630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8734d96-3661-4819-bfcb-2ebbd5fdcf95 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:02.948127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8734d96-3661-4819-bfcb-2ebbd5fdcf95 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:02.948926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8734d96-3661-4819-bfcb-2ebbd5fdcf95 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:02.949371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8734d96-3661-4819-bfcb-2ebbd5fdcf95 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:03.296546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1a757a71-871a-468b-a1d9-53cf583504ae req-7619cd61-6b98-4691-9478-4c838d187ecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "797935c0-8ef7-4df2-be33-91fb11a65afe", "tag": "4d41bfd3-bc8d-44f8-9fd2-95d6277c4e04"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:03.338554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1a757a71-871a-468b-a1d9-53cf583504ae req-7619cd61-6b98-4691-9478-4c838d187ecd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:03.339348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1a757a71-871a-468b-a1d9-53cf583504ae req-7619cd61-6b98-4691-9478-4c838d187ecd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:03.377012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:03.380432 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1a757a71-871a-468b-a1d9-53cf583504ae req-7619cd61-6b98-4691-9478-4c838d187ecd service nova] Creating event network-changed:4d41bfd3-bc8d-44f8-9fd2-95d6277c4e04 for instance 797935c0-8ef7-4df2-be33-91fb11a65afe on n-h1-833090-9 Jul 26 14:42:03.387913 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1a757a71-871a-468b-a1d9-53cf583504ae req-7619cd61-6b98-4691-9478-4c838d187ecd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110681 Jul 26 14:42:03.389305 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2659/5206] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:42:03.808251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e8734d96-3661-4819-bfcb-2ebbd5fdcf95 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:03.828599 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e8734d96-3661-4819-bfcb-2ebbd5fdcf95 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1312 microversion: 2.1 time: 0.914060 Jul 26 14:42:03.829540 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2548/5207] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:02 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1312 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:04.799680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-682ad3e1-26f9-4c07-99c6-f4c4166fdcb2 tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Action: 'create', calling method: .version_select at 0x7f8786c25d30>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:04.852288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d870a273-ad2c-413c-8059-5544f6fc2d51 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:04.853256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d870a273-ad2c-413c-8059-5544f6fc2d51 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:04.864200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-682ad3e1-26f9-4c07-99c6-f4c4166fdcb2 tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Getting quotas for project 4c3eddf13f764212b0af35ad610c7c09. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:42:04.876703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d870a273-ad2c-413c-8059-5544f6fc2d51 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:04.882185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d870a273-ad2c-413c-8059-5544f6fc2d51 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:04.885216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d870a273-ad2c-413c-8059-5544f6fc2d51 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:04.886603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-682ad3e1-26f9-4c07-99c6-f4c4166fdcb2 tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Getting quotas for user 36a13bb1b8004e639ba9db70e876d131 and project 4c3eddf13f764212b0af35ad610c7c09. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:42:04.887241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d870a273-ad2c-413c-8059-5544f6fc2d51 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:04.983611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-682ad3e1-26f9-4c07-99c6-f4c4166fdcb2 tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Getting quotas for project 4c3eddf13f764212b0af35ad610c7c09. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:42:04.992673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-682ad3e1-26f9-4c07-99c6-f4c4166fdcb2 tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Getting quotas for user 36a13bb1b8004e639ba9db70e876d131 and project 4c3eddf13f764212b0af35ad610c7c09. Resources: {'server_groups'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:42:05.009725 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-682ad3e1-26f9-4c07-99c6-f4c4166fdcb2 tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.495322 Jul 26 14:42:05.010782 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2660/5208] 10.222.0.70 () {62 vars in 1214 bytes} [Tue Jul 26 14:42:04 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:05.034579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dbeee71a-82d0-4510-b9e2-e25a386bc6ee tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:05.048166 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dbeee71a-82d0-4510-b9e2-e25a386bc6ee tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.021407 Jul 26 14:42:05.050304 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2661/5209] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Jul 26 14:42:05 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:05.063261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-136f73bc-0dea-48f4-9cfc-f38a3721613d tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:05.077897 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-136f73bc-0dea-48f4-9cfc-f38a3721613d tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/67dafc65-28f8-4786-8f7f-cca547b65f23" status: 200 len: 235 microversion: 2.64 time: 0.019547 Jul 26 14:42:05.079128 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2662/5210] 10.222.0.70 () {60 vars in 1304 bytes} [Tue Jul 26 14:42:05 2022] GET /compute/v2.1/os-server-groups/67dafc65-28f8-4786-8f7f-cca547b65f23 => generated 235 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:05.089454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f2bc3e75-b3cd-4a15-9b1f-adcbfdaf4376 tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:05.135759 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f2bc3e75-b3cd-4a15-9b1f-adcbfdaf4376 tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/67dafc65-28f8-4786-8f7f-cca547b65f23" status: 204 len: 0 microversion: 2.64 time: 0.049949 Jul 26 14:42:05.147881 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2663/5211] 10.222.0.70 () {60 vars in 1307 bytes} [Tue Jul 26 14:42:05 2022] DELETE /compute/v2.1/os-server-groups/67dafc65-28f8-4786-8f7f-cca547b65f23 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 14:42:05.153246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-19e91a4e-e18d-4a9b-a5a5-9d3a201f4b8a tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:05.173856 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-19e91a4e-e18d-4a9b-a5a5-9d3a201f4b8a tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] HTTP exception thrown: Instance group 67dafc65-28f8-4786-8f7f-cca547b65f23 could not be found. Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-19e91a4e-e18d-4a9b-a5a5-9d3a201f4b8a tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Request method failure captured: Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/os-server-groups/67dafc65-28f8-4786-8f7f-cca547b65f23 HTTP/1.1 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_08SIkV5NRYvza6Kc-thEWsUOwz4CjRggeNsIvZUww4qHd2MYzcqIC6jnLYQoxUoavTfmBK-M_7i1uJgk3Pmnwm8yXPnz5RS71pwH4pA4ujqErH1_6piFdpWgrWjeQL0bRFIkIdP6_c-bQm6V31FgjU-pbtL8iNSjjhtns3ItjHqtE Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Openstack-Nova-Api-Version: 2.64 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4c3eddf13f764212b0af35ad610c7c09 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerGroup264TestJSON-1301071244 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4c3eddf13f764212b0af35ad610c7c09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4c3eddf13f764212b0af35ad610c7c09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4c3eddf13f764212b0af35ad610c7c09", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4c3eddf13f764212b0af35ad610c7c09"}]}] Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerGroup264TestJSON-1301071244 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4c3eddf13f764212b0af35ad610c7c09 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1301071244 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerGroup264TestJSON-1301071244-project Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 36a13bb1b8004e639ba9db70e876d131 Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerGroup264TestJSON-1301071244-project Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance group 67dafc65-28f8-4786-8f7f-cca547b65f23 could not be found. Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '67dafc65-28f8-4786-8f7f-cca547b65f23'} Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 67dafc65-28f8-4786-8f7f-cca547b65f23 could not be found. Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 67dafc65-28f8-4786-8f7f-cca547b65f23 could not be found. Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:42:05.175885 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:42:05.180899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:42:05.180899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:42:05.180899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:42:05.180899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:42:05.180899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 67dafc65-28f8-4786-8f7f-cca547b65f23 could not be found. Jul 26 14:42:05.180899 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:42:05.183166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-19e91a4e-e18d-4a9b-a5a5-9d3a201f4b8a tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] Returning 404 to user: Instance group 67dafc65-28f8-4786-8f7f-cca547b65f23 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:42:05.184295 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-19e91a4e-e18d-4a9b-a5a5-9d3a201f4b8a tempest-ServerGroup264TestJSON-1301071244 tempest-ServerGroup264TestJSON-1301071244-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/67dafc65-28f8-4786-8f7f-cca547b65f23" status: 404 len: 117 microversion: 2.64 time: 0.035118 Jul 26 14:42:05.188677 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2664/5212] 10.222.0.70 () {60 vars in 1307 bytes} [Tue Jul 26 14:42:05 2022] DELETE /compute/v2.1/os-server-groups/67dafc65-28f8-4786-8f7f-cca547b65f23 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:42:05.243431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d870a273-ad2c-413c-8059-5544f6fc2d51 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:05.254188 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d870a273-ad2c-413c-8059-5544f6fc2d51 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1312 microversion: 2.1 time: 0.407296 Jul 26 14:42:05.260424 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2549/5213] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:04 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1312 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:42:06.281896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d84cfa6-b411-4a61-9a08-bbc96bb91191 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:06.283086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2d84cfa6-b411-4a61-9a08-bbc96bb91191 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:06.295847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d84cfa6-b411-4a61-9a08-bbc96bb91191 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:06.296341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d84cfa6-b411-4a61-9a08-bbc96bb91191 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:06.297138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d84cfa6-b411-4a61-9a08-bbc96bb91191 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:06.297588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d84cfa6-b411-4a61-9a08-bbc96bb91191 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:07.363245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2d84cfa6-b411-4a61-9a08-bbc96bb91191 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:07.376412 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d84cfa6-b411-4a61-9a08-bbc96bb91191 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1312 microversion: 2.1 time: 1.098444 Jul 26 14:42:07.381396 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2665/5214] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:06 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1312 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:07.529195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d4a6775-8432-4803-af2a-e9c7f152b91f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:07.533035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7d4a6775-8432-4803-af2a-e9c7f152b91f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:07.545900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-0191212e-ad7d-43f9-a488-729d57373fe3 req-a30950c6-d8ac-4fa7-9539-157e0ad719d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:07.559753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:07.562798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:07.565000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d4a6775-8432-4803-af2a-e9c7f152b91f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:07.567350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0191212e-ad7d-43f9-a488-729d57373fe3 req-a30950c6-d8ac-4fa7-9539-157e0ad719d6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:07.568135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d4a6775-8432-4803-af2a-e9c7f152b91f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:07.592778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0191212e-ad7d-43f9-a488-729d57373fe3 req-a30950c6-d8ac-4fa7-9539-157e0ad719d6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:07.594108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d4a6775-8432-4803-af2a-e9c7f152b91f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:07.600684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d4a6775-8432-4803-af2a-e9c7f152b91f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:07.650736 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-0191212e-ad7d-43f9-a488-729d57373fe3 req-a30950c6-d8ac-4fa7-9539-157e0ad719d6 service nova] Creating event network-changed:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h2-833090-9 Jul 26 14:42:07.674944 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-0191212e-ad7d-43f9-a488-729d57373fe3 req-a30950c6-d8ac-4fa7-9539-157e0ad719d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132548 Jul 26 14:42:07.682788 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2666/5215] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:42:08.400438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-760e2794-af74-4218-9927-dce210eabf38 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:08.401841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-760e2794-af74-4218-9927-dce210eabf38 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:08.425821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-760e2794-af74-4218-9927-dce210eabf38 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:08.427331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-760e2794-af74-4218-9927-dce210eabf38 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:08.428355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-760e2794-af74-4218-9927-dce210eabf38 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:08.428961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-760e2794-af74-4218-9927-dce210eabf38 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:08.905034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d4a6775-8432-4803-af2a-e9c7f152b91f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:08.917269 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7d4a6775-8432-4803-af2a-e9c7f152b91f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1562 microversion: 2.1 time: 1.392318 Jul 26 14:42:08.920029 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2550/5216] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:07 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1562 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:09.667707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-760e2794-af74-4218-9927-dce210eabf38 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:09.677005 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-760e2794-af74-4218-9927-dce210eabf38 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1312 microversion: 2.1 time: 1.281798 Jul 26 14:42:09.681046 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2667/5217] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:08 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1312 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:42:09.797634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-6344a740-1e78-43be-ad7d-7458f959f9ad req-94d24157-e098-45fb-96b0-8f268d937d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "797935c0-8ef7-4df2-be33-91fb11a65afe", "name": "network-vif-plugged", "status": "completed", "tag": "4d41bfd3-bc8d-44f8-9fd2-95d6277c4e04"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:09.843420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6344a740-1e78-43be-ad7d-7458f959f9ad req-94d24157-e098-45fb-96b0-8f268d937d56 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:09.847532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6344a740-1e78-43be-ad7d-7458f959f9ad req-94d24157-e098-45fb-96b0-8f268d937d56 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:09.907707 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-6344a740-1e78-43be-ad7d-7458f959f9ad req-94d24157-e098-45fb-96b0-8f268d937d56 service nova] Creating event network-vif-plugged:4d41bfd3-bc8d-44f8-9fd2-95d6277c4e04 for instance 797935c0-8ef7-4df2-be33-91fb11a65afe on n-h1-833090-9 Jul 26 14:42:09.925698 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-6344a740-1e78-43be-ad7d-7458f959f9ad req-94d24157-e098-45fb-96b0-8f268d937d56 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140412 Jul 26 14:42:09.926839 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2551/5218] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:42:10.704141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5609d2f-c023-4e9a-8900-6483b5f9f54c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:10.705578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d5609d2f-c023-4e9a-8900-6483b5f9f54c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:10.727811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5609d2f-c023-4e9a-8900-6483b5f9f54c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:10.729323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5609d2f-c023-4e9a-8900-6483b5f9f54c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:10.732198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5609d2f-c023-4e9a-8900-6483b5f9f54c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:10.733164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5609d2f-c023-4e9a-8900-6483b5f9f54c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:11.083490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d5609d2f-c023-4e9a-8900-6483b5f9f54c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:11.091404 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5609d2f-c023-4e9a-8900-6483b5f9f54c tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1312 microversion: 2.1 time: 0.392364 Jul 26 14:42:11.092270 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2668/5219] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:10 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1312 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:12.120926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d572baa-fc4b-4d9c-a723-0e7800263223 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:12.121909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d572baa-fc4b-4d9c-a723-0e7800263223 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:12.138728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d572baa-fc4b-4d9c-a723-0e7800263223 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:12.140436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d572baa-fc4b-4d9c-a723-0e7800263223 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:12.143642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d572baa-fc4b-4d9c-a723-0e7800263223 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:12.144173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d572baa-fc4b-4d9c-a723-0e7800263223 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:12.183722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:12.705890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0d572baa-fc4b-4d9c-a723-0e7800263223 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:12.735019 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d572baa-fc4b-4d9c-a723-0e7800263223 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1495 microversion: 2.1 time: 0.621413 Jul 26 14:42:12.739428 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2552/5220] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:12 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1495 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:13.884145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d520269a-8074-4d66-b14c-5529c8fa255f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:13.884664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d520269a-8074-4d66-b14c-5529c8fa255f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:13.888759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:13.895334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d520269a-8074-4d66-b14c-5529c8fa255f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:13.896439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d520269a-8074-4d66-b14c-5529c8fa255f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:13.897522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d520269a-8074-4d66-b14c-5529c8fa255f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:13.897976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d520269a-8074-4d66-b14c-5529c8fa255f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:13.971447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d520269a-8074-4d66-b14c-5529c8fa255f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:42:14.129700 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d520269a-8074-4d66-b14c-5529c8fa255f tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "DELETE /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 204 len: 0 microversion: 2.1 time: 0.250835 Jul 26 14:42:14.133135 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2669/5221] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:42:13 2022] DELETE /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:42:14.149341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-644dc0c3-8f7f-4aa3-914b-e5e3c7a1a89d tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:14.150544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-644dc0c3-8f7f-4aa3-914b-e5e3c7a1a89d tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:14.167162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-644dc0c3-8f7f-4aa3-914b-e5e3c7a1a89d tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:14.167660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-644dc0c3-8f7f-4aa3-914b-e5e3c7a1a89d tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:14.168654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-644dc0c3-8f7f-4aa3-914b-e5e3c7a1a89d tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:14.169282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-644dc0c3-8f7f-4aa3-914b-e5e3c7a1a89d tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:14.502127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-644dc0c3-8f7f-4aa3-914b-e5e3c7a1a89d tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:14.514650 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-644dc0c3-8f7f-4aa3-914b-e5e3c7a1a89d tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1501 microversion: 2.1 time: 0.375537 Jul 26 14:42:14.519405 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2553/5222] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:14 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1501 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:15.546023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-909a4a37-5e54-45e6-805d-d28f4ae7abbf tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:15.547373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-909a4a37-5e54-45e6-805d-d28f4ae7abbf tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:15.551714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:15.567269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-909a4a37-5e54-45e6-805d-d28f4ae7abbf tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:15.568227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-909a4a37-5e54-45e6-805d-d28f4ae7abbf tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:15.569195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-909a4a37-5e54-45e6-805d-d28f4ae7abbf tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:15.575385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-909a4a37-5e54-45e6-805d-d28f4ae7abbf tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:16.013172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-909a4a37-5e54-45e6-805d-d28f4ae7abbf tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:16.025578 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-909a4a37-5e54-45e6-805d-d28f4ae7abbf tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1501 microversion: 2.1 time: 0.484015 Jul 26 14:42:16.031756 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2670/5223] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:15 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1501 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:42:16.758406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e2573002-be07-4cf5-855f-5e457c0831ae req-bd7499e0-3f61-4256-9e20-57ea03923e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "797935c0-8ef7-4df2-be33-91fb11a65afe", "name": "network-vif-deleted", "tag": "4d41bfd3-bc8d-44f8-9fd2-95d6277c4e04"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:16.784553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e2573002-be07-4cf5-855f-5e457c0831ae req-bd7499e0-3f61-4256-9e20-57ea03923e52 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:16.786560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e2573002-be07-4cf5-855f-5e457c0831ae req-bd7499e0-3f61-4256-9e20-57ea03923e52 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:16.809486 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e2573002-be07-4cf5-855f-5e457c0831ae req-bd7499e0-3f61-4256-9e20-57ea03923e52 service nova] Creating event network-vif-deleted:4d41bfd3-bc8d-44f8-9fd2-95d6277c4e04 for instance 797935c0-8ef7-4df2-be33-91fb11a65afe on n-h1-833090-9 Jul 26 14:42:16.824079 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e2573002-be07-4cf5-855f-5e457c0831ae req-bd7499e0-3f61-4256-9e20-57ea03923e52 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075144 Jul 26 14:42:16.833005 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2554/5224] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:42:17.062717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:17.064365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:17.078570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:17.080958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:17.081947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:17.083133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:17.133069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:17.134045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:17.134756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lazy-loading 'fault' on Instance uuid 797935c0-8ef7-4df2-be33-91fb11a65afe {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:42:17.221077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '589ac18fc441466badefd04839cc8f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e01d4215b24ad3bb9ad02eeb4d43f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:17.240699 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cb459690-7bf5-4b8c-ba0f-e37f1d9f90b3 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 200 len: 1302 microversion: 2.1 time: 0.178007 Jul 26 14:42:17.250019 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2671/5225] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:17 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 1302 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:18.276709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4bd7560e-cfa8-456c-841e-4d414d0cfb79 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:18.278368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4bd7560e-cfa8-456c-841e-4d414d0cfb79 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] [instance: 797935c0-8ef7-4df2-be33-91fb11a65afe] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:18.282907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:18.300175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bd7560e-cfa8-456c-841e-4d414d0cfb79 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:18.302365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bd7560e-cfa8-456c-841e-4d414d0cfb79 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:18.304273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bd7560e-cfa8-456c-841e-4d414d0cfb79 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:18.305015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bd7560e-cfa8-456c-841e-4d414d0cfb79 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:18.342623 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-4bd7560e-cfa8-456c-841e-4d414d0cfb79 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] HTTP exception thrown: Instance 797935c0-8ef7-4df2-be33-91fb11a65afe could not be found. Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4bd7560e-cfa8-456c-841e-4d414d0cfb79 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Request method failure captured: Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe HTTP/1.1 Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_0NjFgxFbLSJjDg6SeHzzIRlGa1vYa22HQLfPrBGy-8wd3qgze2VO5aaHi8g7-VZYobR8WkqPTbBDc_Mb1S_4Y1OGm8uNXPQhOPcMn9MEeWdCHhjNp_xKGqfpt6qC0yWssgdZZVP6jJECTWqV6EU4_w4lWlAdetpKb4-Soy5TFA_bs Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 46e01d4215b24ad3bb9ad02eeb4d43f4 Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-VolumesActionsTest-1646934151 Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46e01d4215b24ad3bb9ad02eeb4d43f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46e01d4215b24ad3bb9ad02eeb4d43f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46e01d4215b24ad3bb9ad02eeb4d43f4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46e01d4215b24ad3bb9ad02eeb4d43f4"}]}] Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-VolumesActionsTest-1646934151 Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 46e01d4215b24ad3bb9ad02eeb4d43f4 Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-VolumesActionsTest-1646934151 Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-VolumesActionsTest-1646934151-project Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 589ac18fc441466badefd04839cc8f3e Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-VolumesActionsTest-1646934151-project Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 797935c0-8ef7-4df2-be33-91fb11a65afe could not be found. Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '797935c0-8ef7-4df2-be33-91fb11a65afe'} Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 797935c0-8ef7-4df2-be33-91fb11a65afe could not be found. Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 797935c0-8ef7-4df2-be33-91fb11a65afe could not be found. Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:42:18.344669 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:42:18.349306 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:42:18.349306 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:42:18.349306 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:42:18.349306 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:42:18.349306 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:42:18.349306 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 797935c0-8ef7-4df2-be33-91fb11a65afe could not be found. Jul 26 14:42:18.349306 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:42:18.351849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4bd7560e-cfa8-456c-841e-4d414d0cfb79 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] Returning 404 to user: Instance 797935c0-8ef7-4df2-be33-91fb11a65afe could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:42:18.352939 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4bd7560e-cfa8-456c-841e-4d414d0cfb79 tempest-VolumesActionsTest-1646934151 tempest-VolumesActionsTest-1646934151-project] 10.222.0.70 "GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe" status: 404 len: 111 microversion: 2.1 time: 0.084716 Jul 26 14:42:18.360515 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2555/5226] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:18 2022] GET /compute/v2.1/servers/797935c0-8ef7-4df2-be33-91fb11a65afe => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:42:27.538725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1564652870", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:27.570657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:27.573426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:27.771603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:42:28.342557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:42:28.343220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:42:28.343846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:42:28.344609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:42:28.344941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:42:28.361734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:28.362193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:28.363182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:28.369963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:28.437703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Getting quotas for project 7ca911c561c94fe9a530d11df857cf46. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:42:28.473637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Getting quotas for user cb24fc036a3e4ebd961e7a246b44be6b and project 7ca911c561c94fe9a530d11df857cf46. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:42:28.501541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:42:28.519470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:42:28.728253 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [3483da47-2347-4c3e-b342-6ede8a93bfbc] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 14:42:29.737442 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [3483da47-2347-4c3e-b342-6ede8a93bfbc] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 60828. Jul 26 14:42:29.745000 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a182c639-a5ef-4eca-8ab2-dfc80fc39816 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.218252 Jul 26 14:42:29.746316 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2672/5227] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:42:29.757762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0948de74-a27f-495e-9144-1e04ca730e91 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:29.758385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0948de74-a27f-495e-9144-1e04ca730e91 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:29.804764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:29.811677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=15 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:30.085852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0948de74-a27f-495e-9144-1e04ca730e91 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:30.111564 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0948de74-a27f-495e-9144-1e04ca730e91 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1215 microversion: 2.1 time: 0.355343 Jul 26 14:42:30.112258 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2556/5228] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:29 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1215 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:30.889127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6cd77fb0-c809-4a3e-a90d-56c85656cece tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:30.891484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6cd77fb0-c809-4a3e-a90d-56c85656cece tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:30.931302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cd77fb0-c809-4a3e-a90d-56c85656cece tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:30.934866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cd77fb0-c809-4a3e-a90d-56c85656cece tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:30.936002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cd77fb0-c809-4a3e-a90d-56c85656cece tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:30.938323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cd77fb0-c809-4a3e-a90d-56c85656cece tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:31.142790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e150d50b-a03d-4dbb-82a6-b80e46fbaa16 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:31.145193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e150d50b-a03d-4dbb-82a6-b80e46fbaa16 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:31.149186 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6cd77fb0-c809-4a3e-a90d-56c85656cece tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63/action" status: 200 len: 24564 microversion: 2.1 time: 0.263803 Jul 26 14:42:31.158758 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2673/5229] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:42:30 2022] POST /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63/action => generated 24564 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:31.219314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e150d50b-a03d-4dbb-82a6-b80e46fbaa16 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:31.226292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e150d50b-a03d-4dbb-82a6-b80e46fbaa16 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:31.227484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e150d50b-a03d-4dbb-82a6-b80e46fbaa16 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:31.232550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e150d50b-a03d-4dbb-82a6-b80e46fbaa16 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:31.629718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e150d50b-a03d-4dbb-82a6-b80e46fbaa16 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:31.642576 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e150d50b-a03d-4dbb-82a6-b80e46fbaa16 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1219 microversion: 2.1 time: 0.508674 Jul 26 14:42:31.647837 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2557/5230] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:31 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1219 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:32.686771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d1b1d7f8-f80e-4bfc-8ad0-33b6d2d6ba2c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:32.688985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d1b1d7f8-f80e-4bfc-8ad0-33b6d2d6ba2c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:32.731573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1b1d7f8-f80e-4bfc-8ad0-33b6d2d6ba2c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:32.732144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1b1d7f8-f80e-4bfc-8ad0-33b6d2d6ba2c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:32.739285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1b1d7f8-f80e-4bfc-8ad0-33b6d2d6ba2c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:32.747126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1b1d7f8-f80e-4bfc-8ad0-33b6d2d6ba2c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:33.226569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d1b1d7f8-f80e-4bfc-8ad0-33b6d2d6ba2c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:33.240199 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d1b1d7f8-f80e-4bfc-8ad0-33b6d2d6ba2c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1285 microversion: 2.1 time: 0.570739 Jul 26 14:42:33.240984 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2674/5231] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:32 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1285 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:34.275803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3b34e26b-fe0f-4a30-996c-c35d9421038c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:34.277165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3b34e26b-fe0f-4a30-996c-c35d9421038c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:34.292381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b34e26b-fe0f-4a30-996c-c35d9421038c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:34.306941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b34e26b-fe0f-4a30-996c-c35d9421038c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:34.310644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b34e26b-fe0f-4a30-996c-c35d9421038c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:34.313104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b34e26b-fe0f-4a30-996c-c35d9421038c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:34.912563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3b34e26b-fe0f-4a30-996c-c35d9421038c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:34.925800 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3b34e26b-fe0f-4a30-996c-c35d9421038c tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1273 microversion: 2.1 time: 0.653562 Jul 26 14:42:34.941661 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2558/5232] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:34 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1273 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:35.967736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-24d6f294-5c8a-42ed-96db-b6558a82bfa7 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:35.969518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-24d6f294-5c8a-42ed-96db-b6558a82bfa7 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:35.990496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24d6f294-5c8a-42ed-96db-b6558a82bfa7 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:36.000225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24d6f294-5c8a-42ed-96db-b6558a82bfa7 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:36.004305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24d6f294-5c8a-42ed-96db-b6558a82bfa7 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:36.010556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24d6f294-5c8a-42ed-96db-b6558a82bfa7 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:36.354385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-24d6f294-5c8a-42ed-96db-b6558a82bfa7 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:36.375899 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-24d6f294-5c8a-42ed-96db-b6558a82bfa7 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1273 microversion: 2.1 time: 0.412385 Jul 26 14:42:36.397021 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2675/5233] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:35 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1273 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:37.405031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9a9afba4-99cf-4e7c-9e8a-6b62f6014dab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:37.409083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9a9afba4-99cf-4e7c-9e8a-6b62f6014dab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:37.475026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a9afba4-99cf-4e7c-9e8a-6b62f6014dab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:37.475570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a9afba4-99cf-4e7c-9e8a-6b62f6014dab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:37.488059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a9afba4-99cf-4e7c-9e8a-6b62f6014dab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:37.497692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a9afba4-99cf-4e7c-9e8a-6b62f6014dab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:38.408690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a9afba4-99cf-4e7c-9e8a-6b62f6014dab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:38.444393 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9a9afba4-99cf-4e7c-9e8a-6b62f6014dab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1315 microversion: 2.1 time: 1.033853 Jul 26 14:42:38.446195 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2559/5234] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:37 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1315 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:39.468523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a9bf564-4e8b-4a8a-b5c4-4043842f6aa9 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:39.469201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a9bf564-4e8b-4a8a-b5c4-4043842f6aa9 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:39.472711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:39.475097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:39.502379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a9bf564-4e8b-4a8a-b5c4-4043842f6aa9 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:39.502843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a9bf564-4e8b-4a8a-b5c4-4043842f6aa9 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:39.511833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a9bf564-4e8b-4a8a-b5c4-4043842f6aa9 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:39.512407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a9bf564-4e8b-4a8a-b5c4-4043842f6aa9 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:40.097917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a9bf564-4e8b-4a8a-b5c4-4043842f6aa9 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:40.117064 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a9bf564-4e8b-4a8a-b5c4-4043842f6aa9 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1315 microversion: 2.1 time: 0.652869 Jul 26 14:42:40.168024 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2676/5235] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:39 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:40.290066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:40.701621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6e2651ea-43d9-4318-8477-f0e4a93b2643 req-de74cdf0-9a9a-4180-9e19-f31bcde9dd5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de8b65e-1003-48f9-bec9-f9ec35bc33aa", "tag": "5ede600d-0285-444a-8421-ee937a82e5f7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:40.748022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6e2651ea-43d9-4318-8477-f0e4a93b2643 req-de74cdf0-9a9a-4180-9e19-f31bcde9dd5d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:40.748755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6e2651ea-43d9-4318-8477-f0e4a93b2643 req-de74cdf0-9a9a-4180-9e19-f31bcde9dd5d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:40.801388 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6e2651ea-43d9-4318-8477-f0e4a93b2643 req-de74cdf0-9a9a-4180-9e19-f31bcde9dd5d service nova] Creating event network-changed:5ede600d-0285-444a-8421-ee937a82e5f7 for instance 3de8b65e-1003-48f9-bec9-f9ec35bc33aa on n-h1-833090-9 Jul 26 14:42:40.808567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1443111498", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:40.861032 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6e2651ea-43d9-4318-8477-f0e4a93b2643 req-de74cdf0-9a9a-4180-9e19-f31bcde9dd5d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167818 Jul 26 14:42:40.862340 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2677/5236] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 26 14:42:40.978566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] validate_networks() for [('0b33547d-5625-46f7-9a04-72573fd2ba05', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:42:41.142375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4cefeb0f-1650-45e2-aef9-c29b6d1d3d58 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:41.143091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4cefeb0f-1650-45e2-aef9-c29b6d1d3d58 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:41.159151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cefeb0f-1650-45e2-aef9-c29b6d1d3d58 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:41.159665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cefeb0f-1650-45e2-aef9-c29b6d1d3d58 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:41.161097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cefeb0f-1650-45e2-aef9-c29b6d1d3d58 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:41.164552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4cefeb0f-1650-45e2-aef9-c29b6d1d3d58 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:41.883495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4cefeb0f-1650-45e2-aef9-c29b6d1d3d58 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:41.892259 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4cefeb0f-1650-45e2-aef9-c29b6d1d3d58 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1315 microversion: 2.1 time: 0.755755 Jul 26 14:42:41.900918 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2678/5237] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:41 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:42.281560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-34d1d1fc-5305-4c0d-b0df-3c47e2bee759 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:42.282526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-34d1d1fc-5305-4c0d-b0df-3c47e2bee759 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:42.313954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34d1d1fc-5305-4c0d-b0df-3c47e2bee759 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:42.314561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34d1d1fc-5305-4c0d-b0df-3c47e2bee759 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:42.315438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34d1d1fc-5305-4c0d-b0df-3c47e2bee759 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:42.315897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34d1d1fc-5305-4c0d-b0df-3c47e2bee759 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:43.267216 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-34d1d1fc-5305-4c0d-b0df-3c47e2bee759 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1832 microversion: 2.1 time: 0.984814 Jul 26 14:42:43.269444 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2679/5238] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:42 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1832 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:43.303035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-82169343-6945-4e00-bf40-2d873ec0fcab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:43.304835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-82169343-6945-4e00-bf40-2d873ec0fcab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:43.333958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82169343-6945-4e00-bf40-2d873ec0fcab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:43.336545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82169343-6945-4e00-bf40-2d873ec0fcab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:43.337687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82169343-6945-4e00-bf40-2d873ec0fcab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:43.340548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82169343-6945-4e00-bf40-2d873ec0fcab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:43.400801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:42:43.412400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:42:43.413329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:42:43.414740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:42:43.415421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:42:43.470609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:43.471985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:43.491034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:43.491204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:43.607406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Getting quotas for project 7386a23b259b4c4091637972951a3f0e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:42:43.630833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Getting quotas for user ca1aaf9a4ab74a829ef94a7d54c683cd and project 7386a23b259b4c4091637972951a3f0e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:42:43.705682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:42:43.720168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:42:43.812527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-82169343-6945-4e00-bf40-2d873ec0fcab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:43.834142 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-82169343-6945-4e00-bf40-2d873ec0fcab tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1315 microversion: 2.1 time: 0.557769 Jul 26 14:42:43.835707 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2680/5239] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:43 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:43.862143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ac957463-585f-471a-8f77-5aa84c747a3a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:43.862934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ac957463-585f-471a-8f77-5aa84c747a3a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:43.902469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac957463-585f-471a-8f77-5aa84c747a3a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:43.903269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac957463-585f-471a-8f77-5aa84c747a3a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:43.905250 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-938b9164-b721-4f44-bd9a-b04245c19973 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.623082 Jul 26 14:42:43.906920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac957463-585f-471a-8f77-5aa84c747a3a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:43.908666 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2560/5240] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:42:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 3628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:42:43.908975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ac957463-585f-471a-8f77-5aa84c747a3a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:43.920605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b8f5084d-cb90-4472-ae73-7b3264c66da4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:43.927139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b8f5084d-cb90-4472-ae73-7b3264c66da4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:44.411036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b8f5084d-cb90-4472-ae73-7b3264c66da4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:44.418867 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b8f5084d-cb90-4472-ae73-7b3264c66da4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1222 microversion: 2.1 time: 0.502280 Jul 26 14:42:44.432233 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2561/5241] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:43 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1222 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:42:44.545539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1978692972", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:44.768517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] validate_networks() for [('0b33547d-5625-46f7-9a04-72573fd2ba05', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:42:45.589293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ac957463-585f-471a-8f77-5aa84c747a3a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:45.600368 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ac957463-585f-471a-8f77-5aa84c747a3a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1681 microversion: 2.1 time: 1.755245 Jul 26 14:42:45.601033 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2681/5242] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:43 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1681 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:45.652348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6ced493-86b1-494f-af02-4823ac79a34e tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:45.653052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e6ced493-86b1-494f-af02-4823ac79a34e tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:45.683653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6ced493-86b1-494f-af02-4823ac79a34e tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:45.684172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6ced493-86b1-494f-af02-4823ac79a34e tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:45.684975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6ced493-86b1-494f-af02-4823ac79a34e tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:45.685423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6ced493-86b1-494f-af02-4823ac79a34e tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:46.541079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e6ced493-86b1-494f-af02-4823ac79a34e tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:46.560213 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e6ced493-86b1-494f-af02-4823ac79a34e tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1315 microversion: 2.1 time: 0.957335 Jul 26 14:42:46.562406 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2682/5243] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:45 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1315 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:46.599404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-95c12aeb-3acb-4e60-9430-d54596f21beb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:46.604265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-95c12aeb-3acb-4e60-9430-d54596f21beb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:46.623281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95c12aeb-3acb-4e60-9430-d54596f21beb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:46.623793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95c12aeb-3acb-4e60-9430-d54596f21beb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:46.624827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95c12aeb-3acb-4e60-9430-d54596f21beb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:46.625278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-95c12aeb-3acb-4e60-9430-d54596f21beb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:46.751167 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-95c12aeb-3acb-4e60-9430-d54596f21beb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63/action" status: 200 len: 32632 microversion: 2.1 time: 0.171322 Jul 26 14:42:46.752225 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2683/5244] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:42:46 2022] POST /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63/action => generated 32632 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:42:46.920530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9791a865-242f-461c-9c9e-c6b201093a15 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:46.921138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9791a865-242f-461c-9c9e-c6b201093a15 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:46.934982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9791a865-242f-461c-9c9e-c6b201093a15 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:46.945783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9791a865-242f-461c-9c9e-c6b201093a15 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:46.948863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9791a865-242f-461c-9c9e-c6b201093a15 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:46.963322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9791a865-242f-461c-9c9e-c6b201093a15 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:47.070240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9791a865-242f-461c-9c9e-c6b201093a15 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b65671a725e54791895ce4dae0cc612f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e3592211f04adfa75cb067cc8e22ba', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:47.073758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9791a865-242f-461c-9c9e-c6b201093a15 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] flavor_id is None. Assuming migration. {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 26 14:42:47.076256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9791a865-242f-461c-9c9e-c6b201093a15 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 14:42:47.383761 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9791a865-242f-461c-9c9e-c6b201093a15 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63/action" status: 202 len: 0 microversion: 2.1 time: 0.468138 Jul 26 14:42:47.384440 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2684/5245] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:42:46 2022] POST /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:42:47.398848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00fad7d0-c759-4799-9795-a81a6d9d99e0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:47.412913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00fad7d0-c759-4799-9795-a81a6d9d99e0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:47.444784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00fad7d0-c759-4799-9795-a81a6d9d99e0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:47.445596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00fad7d0-c759-4799-9795-a81a6d9d99e0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:47.447807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00fad7d0-c759-4799-9795-a81a6d9d99e0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:47.452124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00fad7d0-c759-4799-9795-a81a6d9d99e0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:47.998805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:42:47.999342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:42:47.999724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:42:48.000179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:42:48.000605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:42:48.024111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:48.024575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:48.025401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:48.025852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:48.126882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Getting quotas for project 7386a23b259b4c4091637972951a3f0e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:42:48.157674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Getting quotas for user ca1aaf9a4ab74a829ef94a7d54c683cd and project 7386a23b259b4c4091637972951a3f0e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:42:48.239274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:42:48.243599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:42:48.335642 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d3de2cf2-67b3-496c-a869-de3e4a09617c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.794471 Jul 26 14:42:48.337297 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2562/5246] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:42:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 3797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:42:48.343905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae4bbcc7-c1d9-402d-b79d-ce503b4a204f tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:48.344902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ae4bbcc7-c1d9-402d-b79d-ce503b4a204f tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:48.352552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae4bbcc7-c1d9-402d-b79d-ce503b4a204f tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:48.354216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae4bbcc7-c1d9-402d-b79d-ce503b4a204f tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:48.357535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae4bbcc7-c1d9-402d-b79d-ce503b4a204f tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:48.358256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae4bbcc7-c1d9-402d-b79d-ce503b4a204f tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:48.489625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-00fad7d0-c759-4799-9795-a81a6d9d99e0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:48.500887 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-00fad7d0-c759-4799-9795-a81a6d9d99e0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1690 microversion: 2.1 time: 1.107563 Jul 26 14:42:48.505309 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2685/5247] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:47 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1690 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:48.522679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21bc0ed5-5f27-42fa-b77b-bce7f90817f7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:48.528109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-21bc0ed5-5f27-42fa-b77b-bce7f90817f7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:48.712931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-21bc0ed5-5f27-42fa-b77b-bce7f90817f7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:48.720732 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-21bc0ed5-5f27-42fa-b77b-bce7f90817f7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1222 microversion: 2.1 time: 0.211075 Jul 26 14:42:48.723224 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2686/5248] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:48 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1222 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:48.923310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ae4bbcc7-c1d9-402d-b79d-ce503b4a204f tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:48.946338 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ae4bbcc7-c1d9-402d-b79d-ce503b4a204f tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1315 microversion: 2.1 time: 0.602556 Jul 26 14:42:48.949144 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2563/5249] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:48 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:49.529432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-10de5f38-3893-41c1-b739-c7f1dd8534a0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:49.530127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-10de5f38-3893-41c1-b739-c7f1dd8534a0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:49.557839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10de5f38-3893-41c1-b739-c7f1dd8534a0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:49.559246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10de5f38-3893-41c1-b739-c7f1dd8534a0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:49.561327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10de5f38-3893-41c1-b739-c7f1dd8534a0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:49.562789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-10de5f38-3893-41c1-b739-c7f1dd8534a0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:49.746752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c1f3fc7-2040-472e-898c-b36f5b3123cb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:49.747384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5c1f3fc7-2040-472e-898c-b36f5b3123cb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:49.758771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c1f3fc7-2040-472e-898c-b36f5b3123cb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:49.759254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c1f3fc7-2040-472e-898c-b36f5b3123cb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:49.762202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c1f3fc7-2040-472e-898c-b36f5b3123cb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:49.762665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c1f3fc7-2040-472e-898c-b36f5b3123cb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:50.107644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5c1f3fc7-2040-472e-898c-b36f5b3123cb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:50.128940 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5c1f3fc7-2040-472e-898c-b36f5b3123cb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1226 microversion: 2.1 time: 0.386044 Jul 26 14:42:50.129756 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2564/5250] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:49 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1226 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:42:50.149041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-390fcf42-b61f-4fc3-a1ca-41ba370fc86d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:50.151141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-390fcf42-b61f-4fc3-a1ca-41ba370fc86d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:50.167263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-390fcf42-b61f-4fc3-a1ca-41ba370fc86d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:50.167643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-390fcf42-b61f-4fc3-a1ca-41ba370fc86d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:50.168729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-390fcf42-b61f-4fc3-a1ca-41ba370fc86d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:50.183518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-390fcf42-b61f-4fc3-a1ca-41ba370fc86d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:50.251750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-10de5f38-3893-41c1-b739-c7f1dd8534a0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:50.264110 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-10de5f38-3893-41c1-b739-c7f1dd8534a0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1690 microversion: 2.1 time: 0.739207 Jul 26 14:42:50.270847 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2687/5251] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:49 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1690 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:50.746396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6d661d80-e40c-4425-b167-78d9987f6ecd req-ffdafbf7-d1c2-44ae-b138-3b8772c176eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de8b65e-1003-48f9-bec9-f9ec35bc33aa", "name": "network-vif-plugged", "status": "completed", "tag": "5ede600d-0285-444a-8421-ee937a82e5f7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:50.802473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6d661d80-e40c-4425-b167-78d9987f6ecd req-ffdafbf7-d1c2-44ae-b138-3b8772c176eb service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:50.812553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6d661d80-e40c-4425-b167-78d9987f6ecd req-ffdafbf7-d1c2-44ae-b138-3b8772c176eb service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:50.877595 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6d661d80-e40c-4425-b167-78d9987f6ecd req-ffdafbf7-d1c2-44ae-b138-3b8772c176eb service nova] Creating event network-vif-plugged:5ede600d-0285-444a-8421-ee937a82e5f7 for instance 3de8b65e-1003-48f9-bec9-f9ec35bc33aa on n-h1-833090-9 Jul 26 14:42:50.905155 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6d661d80-e40c-4425-b167-78d9987f6ecd req-ffdafbf7-d1c2-44ae-b138-3b8772c176eb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162635 Jul 26 14:42:50.918253 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2688/5252] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:42:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:42:51.152208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c0802f83-1bdb-47cb-ab61-7e21ebd3982b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:51.154204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0802f83-1bdb-47cb-ab61-7e21ebd3982b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:51.165335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0802f83-1bdb-47cb-ab61-7e21ebd3982b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:51.166210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0802f83-1bdb-47cb-ab61-7e21ebd3982b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:51.167276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0802f83-1bdb-47cb-ab61-7e21ebd3982b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:51.167974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0802f83-1bdb-47cb-ab61-7e21ebd3982b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:51.915111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c0802f83-1bdb-47cb-ab61-7e21ebd3982b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:51.937619 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c0802f83-1bdb-47cb-ab61-7e21ebd3982b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1280 microversion: 2.1 time: 0.789609 Jul 26 14:42:51.938984 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2689/5253] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:51 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1280 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:51.950793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5bfd917a-5a81-4b63-a99a-fc22e5b15dcb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:51.952350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5bfd917a-5a81-4b63-a99a-fc22e5b15dcb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:51.967002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bfd917a-5a81-4b63-a99a-fc22e5b15dcb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:51.970930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bfd917a-5a81-4b63-a99a-fc22e5b15dcb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:51.972080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bfd917a-5a81-4b63-a99a-fc22e5b15dcb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:51.974200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bfd917a-5a81-4b63-a99a-fc22e5b15dcb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:52.050113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:52.802306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-390fcf42-b61f-4fc3-a1ca-41ba370fc86d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:52.821866 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-390fcf42-b61f-4fc3-a1ca-41ba370fc86d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1315 microversion: 2.1 time: 2.683757 Jul 26 14:42:52.828963 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2565/5254] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:50 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1315 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:52.920363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5bfd917a-5a81-4b63-a99a-fc22e5b15dcb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:52.935175 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5bfd917a-5a81-4b63-a99a-fc22e5b15dcb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1690 microversion: 2.1 time: 0.994672 Jul 26 14:42:52.936065 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2690/5255] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:51 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1690 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:52.960259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea404666-c4a4-4924-bc3d-051b7e3a449e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:52.961057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ea404666-c4a4-4924-bc3d-051b7e3a449e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:52.976139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea404666-c4a4-4924-bc3d-051b7e3a449e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:52.989223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea404666-c4a4-4924-bc3d-051b7e3a449e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:52.997345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea404666-c4a4-4924-bc3d-051b7e3a449e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:52.997965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea404666-c4a4-4924-bc3d-051b7e3a449e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:53.263592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ea404666-c4a4-4924-bc3d-051b7e3a449e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:53.287496 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ea404666-c4a4-4924-bc3d-051b7e3a449e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1280 microversion: 2.1 time: 0.332548 Jul 26 14:42:53.292202 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2566/5256] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:52 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1280 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:53.884028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dade8808-80b0-4be4-87c9-e7141693d8e6 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:53.887247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dade8808-80b0-4be4-87c9-e7141693d8e6 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:53.989863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-432a1028-2918-4c53-9e19-3c462ccf546a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:53.992028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-432a1028-2918-4c53-9e19-3c462ccf546a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:54.041645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dade8808-80b0-4be4-87c9-e7141693d8e6 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:54.043372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dade8808-80b0-4be4-87c9-e7141693d8e6 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:54.046618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dade8808-80b0-4be4-87c9-e7141693d8e6 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:54.047446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dade8808-80b0-4be4-87c9-e7141693d8e6 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:54.058949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-432a1028-2918-4c53-9e19-3c462ccf546a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:54.064506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-432a1028-2918-4c53-9e19-3c462ccf546a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:54.065721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-432a1028-2918-4c53-9e19-3c462ccf546a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:54.083658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-432a1028-2918-4c53-9e19-3c462ccf546a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:54.856184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dade8808-80b0-4be4-87c9-e7141693d8e6 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:54.862189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-432a1028-2918-4c53-9e19-3c462ccf546a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:54.889157 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-432a1028-2918-4c53-9e19-3c462ccf546a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1690 microversion: 2.1 time: 0.905680 Jul 26 14:42:54.891398 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dade8808-80b0-4be4-87c9-e7141693d8e6 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1315 microversion: 2.1 time: 1.020564 Jul 26 14:42:54.893761 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2691/5257] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:53 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1315 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:54.908153 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2567/5258] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:53 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1690 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:54.916844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eed30ab1-fc73-4df3-aeda-350c7f07a641 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:54.917494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eed30ab1-fc73-4df3-aeda-350c7f07a641 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:54.940860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed30ab1-fc73-4df3-aeda-350c7f07a641 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:54.943105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed30ab1-fc73-4df3-aeda-350c7f07a641 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:54.944292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed30ab1-fc73-4df3-aeda-350c7f07a641 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:54.947096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed30ab1-fc73-4df3-aeda-350c7f07a641 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:55.727057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eed30ab1-fc73-4df3-aeda-350c7f07a641 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:55.757760 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eed30ab1-fc73-4df3-aeda-350c7f07a641 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1322 microversion: 2.1 time: 0.858932 Jul 26 14:42:55.772443 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2692/5259] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:54 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1322 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:55.931420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-13b53512-02d7-4d72-97b2-134294d401f5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:55.932338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-13b53512-02d7-4d72-97b2-134294d401f5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:55.941395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13b53512-02d7-4d72-97b2-134294d401f5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:55.945912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f179077d-9be4-4aa7-a1f3-e027d449952d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:55.952001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f179077d-9be4-4aa7-a1f3-e027d449952d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:55.953496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13b53512-02d7-4d72-97b2-134294d401f5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:55.954317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13b53512-02d7-4d72-97b2-134294d401f5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:55.954783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13b53512-02d7-4d72-97b2-134294d401f5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:55.980692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f179077d-9be4-4aa7-a1f3-e027d449952d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:55.981716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f179077d-9be4-4aa7-a1f3-e027d449952d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:55.982695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f179077d-9be4-4aa7-a1f3-e027d449952d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:55.986921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f179077d-9be4-4aa7-a1f3-e027d449952d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:57.027095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-13b53512-02d7-4d72-97b2-134294d401f5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:57.042052 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-13b53512-02d7-4d72-97b2-134294d401f5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 1.114476 Jul 26 14:42:57.043120 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2693/5260] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:55 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:57.051661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-3c6c7122-3db3-4d28-a5a9-89ec48feac79 req-1b4c1c36-331d-498c-851f-6b0e9b63285e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aae76411-a3af-4e21-a827-39d6ae08c182", "tag": "70cd542c-ed29-4360-9fb8-5bda314558f0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:57.093789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3c6c7122-3db3-4d28-a5a9-89ec48feac79 req-1b4c1c36-331d-498c-851f-6b0e9b63285e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:57.116152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3c6c7122-3db3-4d28-a5a9-89ec48feac79 req-1b4c1c36-331d-498c-851f-6b0e9b63285e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:57.147050 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-3c6c7122-3db3-4d28-a5a9-89ec48feac79 req-1b4c1c36-331d-498c-851f-6b0e9b63285e service nova] Creating event network-changed:70cd542c-ed29-4360-9fb8-5bda314558f0 for instance aae76411-a3af-4e21-a827-39d6ae08c182 on n-h2-833090-9 Jul 26 14:42:57.163105 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-3c6c7122-3db3-4d28-a5a9-89ec48feac79 req-1b4c1c36-331d-498c-851f-6b0e9b63285e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118459 Jul 26 14:42:57.168809 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2694/5261] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:42:57.186850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-88d05e86-955e-4ef5-b8c9-1589b3283dfa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:57.188944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-88d05e86-955e-4ef5-b8c9-1589b3283dfa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:57.206649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88d05e86-955e-4ef5-b8c9-1589b3283dfa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:57.209015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88d05e86-955e-4ef5-b8c9-1589b3283dfa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:57.210093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88d05e86-955e-4ef5-b8c9-1589b3283dfa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:57.212059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-88d05e86-955e-4ef5-b8c9-1589b3283dfa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:57.264812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f179077d-9be4-4aa7-a1f3-e027d449952d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:57.292834 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f179077d-9be4-4aa7-a1f3-e027d449952d tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1465 microversion: 2.1 time: 1.368748 Jul 26 14:42:57.297261 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2568/5262] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:55 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1465 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:57.405211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-806fee6e-60ae-459a-9f81-920f47e8f813 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:57.406963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-806fee6e-60ae-459a-9f81-920f47e8f813 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:57.508610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-806fee6e-60ae-459a-9f81-920f47e8f813 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:57.509077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-806fee6e-60ae-459a-9f81-920f47e8f813 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:57.526869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-806fee6e-60ae-459a-9f81-920f47e8f813 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:57.527630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-806fee6e-60ae-459a-9f81-920f47e8f813 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:57.647896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-806fee6e-60ae-459a-9f81-920f47e8f813 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:42:57.696153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-88d05e86-955e-4ef5-b8c9-1589b3283dfa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:57.716963 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-88d05e86-955e-4ef5-b8c9-1589b3283dfa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1322 microversion: 2.1 time: 0.546504 Jul 26 14:42:57.722043 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2695/5263] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:57 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1322 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:57.944570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b9f6c0ad-6df7-465e-b452-38f6f3c31a19 req-2dacd467-e810-40dc-b9c3-42efc2a8deee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c77f907e-8855-4f3f-bbf3-690ea1872bc1", "tag": "a9e62da7-b32a-4e16-bb2e-ca3c69efee0d"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:42:57.964510 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-806fee6e-60ae-459a-9f81-920f47e8f813 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 204 len: 0 microversion: 2.1 time: 0.564778 Jul 26 14:42:57.969366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:57.973346 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2569/5264] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:42:57 2022] DELETE /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:42:57.982392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef71dfe7-c314-4d7e-bb50-d33d05a7e012 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:57.989272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b9f6c0ad-6df7-465e-b452-38f6f3c31a19 req-2dacd467-e810-40dc-b9c3-42efc2a8deee service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:57.992410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b9f6c0ad-6df7-465e-b452-38f6f3c31a19 req-2dacd467-e810-40dc-b9c3-42efc2a8deee service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:57.994054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ef71dfe7-c314-4d7e-bb50-d33d05a7e012 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:58.014231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef71dfe7-c314-4d7e-bb50-d33d05a7e012 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:58.015179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef71dfe7-c314-4d7e-bb50-d33d05a7e012 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:58.018242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef71dfe7-c314-4d7e-bb50-d33d05a7e012 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:58.018866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef71dfe7-c314-4d7e-bb50-d33d05a7e012 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:58.037681 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b9f6c0ad-6df7-465e-b452-38f6f3c31a19 req-2dacd467-e810-40dc-b9c3-42efc2a8deee service nova] Creating event network-changed:a9e62da7-b32a-4e16-bb2e-ca3c69efee0d for instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 on n-h1-833090-9 Jul 26 14:42:58.089347 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b9f6c0ad-6df7-465e-b452-38f6f3c31a19 req-2dacd467-e810-40dc-b9c3-42efc2a8deee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164345 Jul 26 14:42:58.096209 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2696/5265] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:42:58.124492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:58.214111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=14 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:58.524482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ad3e4b86-9b38-4cb5-9a23-5662198cc898 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:58.525786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ad3e4b86-9b38-4cb5-9a23-5662198cc898 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:58.567224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad3e4b86-9b38-4cb5-9a23-5662198cc898 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:58.571711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad3e4b86-9b38-4cb5-9a23-5662198cc898 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:58.573215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad3e4b86-9b38-4cb5-9a23-5662198cc898 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:58.580803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad3e4b86-9b38-4cb5-9a23-5662198cc898 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:58.665960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ef71dfe7-c314-4d7e-bb50-d33d05a7e012 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:58.674153 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ef71dfe7-c314-4d7e-bb50-d33d05a7e012 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1471 microversion: 2.1 time: 0.695903 Jul 26 14:42:58.683537 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2570/5266] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:57 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1471 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:58.728196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:42:58.743941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5755178d-2dd4-4abd-a045-ef2b05078319 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:58.744904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5755178d-2dd4-4abd-a045-ef2b05078319 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:58.756617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5755178d-2dd4-4abd-a045-ef2b05078319 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:58.769273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5755178d-2dd4-4abd-a045-ef2b05078319 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:58.770962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5755178d-2dd4-4abd-a045-ef2b05078319 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:58.771776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5755178d-2dd4-4abd-a045-ef2b05078319 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:59.070570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ad3e4b86-9b38-4cb5-9a23-5662198cc898 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:59.095685 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ad3e4b86-9b38-4cb5-9a23-5662198cc898 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 0.991738 Jul 26 14:42:59.096335 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2697/5267] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:58 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:42:59.388473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5755178d-2dd4-4abd-a045-ef2b05078319 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:42:59.403856 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5755178d-2dd4-4abd-a045-ef2b05078319 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1322 microversion: 2.1 time: 0.666302 Jul 26 14:42:59.420840 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2571/5268] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:58 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:42:59.709717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-31008439-6255-4413-b95c-77ae4c8b6aeb tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:59.710356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-31008439-6255-4413-b95c-77ae4c8b6aeb tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:42:59.727880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31008439-6255-4413-b95c-77ae4c8b6aeb tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:59.797240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31008439-6255-4413-b95c-77ae4c8b6aeb tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:59.802041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31008439-6255-4413-b95c-77ae4c8b6aeb tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:59.805849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31008439-6255-4413-b95c-77ae4c8b6aeb tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:00.122932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7b7a4baa-5e8f-4ed5-afd6-b85c5f4dd476 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:00.123788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7b7a4baa-5e8f-4ed5-afd6-b85c5f4dd476 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:00.132755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:00.140890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b7a4baa-5e8f-4ed5-afd6-b85c5f4dd476 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:00.141262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b7a4baa-5e8f-4ed5-afd6-b85c5f4dd476 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:00.168078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b7a4baa-5e8f-4ed5-afd6-b85c5f4dd476 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:00.170513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7b7a4baa-5e8f-4ed5-afd6-b85c5f4dd476 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:00.219464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:01.355461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-31008439-6255-4413-b95c-77ae4c8b6aeb tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:01.365326 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-31008439-6255-4413-b95c-77ae4c8b6aeb tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1471 microversion: 2.1 time: 1.660348 Jul 26 14:43:01.374070 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2698/5269] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:42:59 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1471 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:01.380395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7b7a4baa-5e8f-4ed5-afd6-b85c5f4dd476 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:01.390313 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7b7a4baa-5e8f-4ed5-afd6-b85c5f4dd476 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 1.271400 Jul 26 14:43:01.390899 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2572/5270] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:00 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:01.398646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca3ac303-4f67-4692-abf1-803c364c1fe6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:01.408161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ca3ac303-4f67-4692-abf1-803c364c1fe6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:01.434352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca3ac303-4f67-4692-abf1-803c364c1fe6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:01.440111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca3ac303-4f67-4692-abf1-803c364c1fe6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:01.442111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca3ac303-4f67-4692-abf1-803c364c1fe6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:01.445624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca3ac303-4f67-4692-abf1-803c364c1fe6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:02.252692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ca3ac303-4f67-4692-abf1-803c364c1fe6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:02.284840 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca3ac303-4f67-4692-abf1-803c364c1fe6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1322 microversion: 2.1 time: 0.904995 Jul 26 14:43:02.288580 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2699/5271] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:01 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1322 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:02.367468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-206bac5e-543f-42d6-bc77-c46cb2bf013e req-f51f39de-43f7-406b-947d-8ec0b80304ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de8b65e-1003-48f9-bec9-f9ec35bc33aa", "name": "network-vif-deleted", "tag": "5ede600d-0285-444a-8421-ee937a82e5f7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:02.397475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0608412a-ac85-4aa3-83bb-03ffc8f70e97 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:02.398132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0608412a-ac85-4aa3-83bb-03ffc8f70e97 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:02.415786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0608412a-ac85-4aa3-83bb-03ffc8f70e97 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:02.421826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-206bac5e-543f-42d6-bc77-c46cb2bf013e req-f51f39de-43f7-406b-947d-8ec0b80304ba service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:02.422686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-206bac5e-543f-42d6-bc77-c46cb2bf013e req-f51f39de-43f7-406b-947d-8ec0b80304ba service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:02.426010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0608412a-ac85-4aa3-83bb-03ffc8f70e97 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:02.427431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0608412a-ac85-4aa3-83bb-03ffc8f70e97 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:02.427897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0608412a-ac85-4aa3-83bb-03ffc8f70e97 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:02.493812 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-206bac5e-543f-42d6-bc77-c46cb2bf013e req-f51f39de-43f7-406b-947d-8ec0b80304ba service nova] Creating event network-vif-deleted:5ede600d-0285-444a-8421-ee937a82e5f7 for instance 3de8b65e-1003-48f9-bec9-f9ec35bc33aa on n-h1-833090-9 Jul 26 14:43:02.517337 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-206bac5e-543f-42d6-bc77-c46cb2bf013e req-f51f39de-43f7-406b-947d-8ec0b80304ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153923 Jul 26 14:43:02.529099 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2573/5272] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:43:02.561110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3e2adc2f-56bf-4ae1-9a34-50b416e9626c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:02.561788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3e2adc2f-56bf-4ae1-9a34-50b416e9626c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:02.586110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e2adc2f-56bf-4ae1-9a34-50b416e9626c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:02.586568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e2adc2f-56bf-4ae1-9a34-50b416e9626c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:02.587376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e2adc2f-56bf-4ae1-9a34-50b416e9626c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:02.587817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e2adc2f-56bf-4ae1-9a34-50b416e9626c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:02.710107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0608412a-ac85-4aa3-83bb-03ffc8f70e97 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb24fc036a3e4ebd961e7a246b44be6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca911c561c94fe9a530d11df857cf46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:02.745213 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0608412a-ac85-4aa3-83bb-03ffc8f70e97 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 200 len: 1300 microversion: 2.1 time: 0.348988 Jul 26 14:43:02.747107 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2700/5273] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:02 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 1300 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:03.014215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3e2adc2f-56bf-4ae1-9a34-50b416e9626c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:03.033358 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3e2adc2f-56bf-4ae1-9a34-50b416e9626c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 0.502366 Jul 26 14:43:03.036113 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2574/5274] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:02 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:03.310807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29468ab3-d4ad-4434-8707-50aef6dc1bbb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:03.311853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-29468ab3-d4ad-4434-8707-50aef6dc1bbb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:03.334803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29468ab3-d4ad-4434-8707-50aef6dc1bbb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:03.338372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29468ab3-d4ad-4434-8707-50aef6dc1bbb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:03.340213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29468ab3-d4ad-4434-8707-50aef6dc1bbb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:03.342682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29468ab3-d4ad-4434-8707-50aef6dc1bbb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:03.777615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-15dc84a6-2f84-44cd-828e-381717ca4839 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:03.778941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-15dc84a6-2f84-44cd-828e-381717ca4839 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] [instance: 3de8b65e-1003-48f9-bec9-f9ec35bc33aa] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:03.799138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15dc84a6-2f84-44cd-828e-381717ca4839 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:03.799603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15dc84a6-2f84-44cd-828e-381717ca4839 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:03.803911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15dc84a6-2f84-44cd-828e-381717ca4839 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:03.806412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15dc84a6-2f84-44cd-828e-381717ca4839 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:03.852789 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-15dc84a6-2f84-44cd-828e-381717ca4839 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] HTTP exception thrown: Instance 3de8b65e-1003-48f9-bec9-f9ec35bc33aa could not be found. Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-15dc84a6-2f84-44cd-828e-381717ca4839 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Request method failure captured: Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa HTTP/1.1 Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_1PB19HWsTHjOUE7EqJD9EAJuHzkTm0RxiuyfUAUFELfFmzyKF2V3-DID3UHf6PzrpJI2CDvC4zHN3bBzig1M8LCQNhrcE4hUxwYlX_nLZUDDbHearWZ8TqgIBICAAZyvFfAjODGnm6q1giyb67x0kur5Qw1jKlszRLMqndhLQ7u1g Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 7ca911c561c94fe9a530d11df857cf46 Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-VolumesNegativeTest-64609183 Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7ca911c561c94fe9a530d11df857cf46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7ca911c561c94fe9a530d11df857cf46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7ca911c561c94fe9a530d11df857cf46", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7ca911c561c94fe9a530d11df857cf46"}]}] Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-VolumesNegativeTest-64609183 Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 7ca911c561c94fe9a530d11df857cf46 Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-VolumesNegativeTest-64609183 Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-VolumesNegativeTest-64609183-project Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: cb24fc036a3e4ebd961e7a246b44be6b Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-VolumesNegativeTest-64609183-project Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 3de8b65e-1003-48f9-bec9-f9ec35bc33aa could not be found. Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '3de8b65e-1003-48f9-bec9-f9ec35bc33aa'} Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de8b65e-1003-48f9-bec9-f9ec35bc33aa could not be found. Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de8b65e-1003-48f9-bec9-f9ec35bc33aa could not be found. Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:43:03.854884 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:43:03.860556 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:43:03.860556 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:43:03.860556 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:43:03.860556 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:43:03.860556 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:43:03.860556 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de8b65e-1003-48f9-bec9-f9ec35bc33aa could not be found. Jul 26 14:43:03.860556 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:43:03.867973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-15dc84a6-2f84-44cd-828e-381717ca4839 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] Returning 404 to user: Instance 3de8b65e-1003-48f9-bec9-f9ec35bc33aa could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:43:03.869183 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-15dc84a6-2f84-44cd-828e-381717ca4839 tempest-VolumesNegativeTest-64609183 tempest-VolumesNegativeTest-64609183-project] 10.222.0.70 "GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa" status: 404 len: 111 microversion: 2.1 time: 0.100889 Jul 26 14:43:03.871269 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2575/5275] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:03 2022] GET /compute/v2.1/servers/3de8b65e-1003-48f9-bec9-f9ec35bc33aa => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:43:04.063172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de16d42a-f7e6-41aa-9bec-32730dd7c3cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:04.064634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-de16d42a-f7e6-41aa-9bec-32730dd7c3cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:04.080792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de16d42a-f7e6-41aa-9bec-32730dd7c3cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:04.081259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de16d42a-f7e6-41aa-9bec-32730dd7c3cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:04.082180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de16d42a-f7e6-41aa-9bec-32730dd7c3cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:04.082929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de16d42a-f7e6-41aa-9bec-32730dd7c3cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:04.632849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-29468ab3-d4ad-4434-8707-50aef6dc1bbb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:04.644823 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-29468ab3-d4ad-4434-8707-50aef6dc1bbb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1322 microversion: 2.1 time: 1.337650 Jul 26 14:43:04.647546 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2701/5276] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:03 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1322 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:04.662540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9cd67d89-cd56-4816-b36f-ddfe8f4ca86c req-2df16e60-1130-4e50-88a4-a1aff3f535c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae76411-a3af-4e21-a827-39d6ae08c182", "name": "network-vif-plugged", "status": "completed", "tag": "70cd542c-ed29-4360-9fb8-5bda314558f0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:04.704231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9cd67d89-cd56-4816-b36f-ddfe8f4ca86c req-2df16e60-1130-4e50-88a4-a1aff3f535c4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:04.706017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9cd67d89-cd56-4816-b36f-ddfe8f4ca86c req-2df16e60-1130-4e50-88a4-a1aff3f535c4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:04.751566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-de16d42a-f7e6-41aa-9bec-32730dd7c3cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:04.822580 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-de16d42a-f7e6-41aa-9bec-32730dd7c3cd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 0.762720 Jul 26 14:43:04.825550 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2576/5277] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:04 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:04.827504 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9cd67d89-cd56-4816-b36f-ddfe8f4ca86c req-2df16e60-1130-4e50-88a4-a1aff3f535c4 service nova] Creating event network-vif-plugged:70cd542c-ed29-4360-9fb8-5bda314558f0 for instance aae76411-a3af-4e21-a827-39d6ae08c182 on n-h2-833090-9 Jul 26 14:43:04.846842 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9cd67d89-cd56-4816-b36f-ddfe8f4ca86c req-2df16e60-1130-4e50-88a4-a1aff3f535c4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197300 Jul 26 14:43:04.849355 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2702/5278] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:43:05.684445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cdb6b257-083f-4e43-b710-cdde8ed96021 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:05.693499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cdb6b257-083f-4e43-b710-cdde8ed96021 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:05.788580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cdb6b257-083f-4e43-b710-cdde8ed96021 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:05.789379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cdb6b257-083f-4e43-b710-cdde8ed96021 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:05.813875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cdb6b257-083f-4e43-b710-cdde8ed96021 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:05.814618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cdb6b257-083f-4e43-b710-cdde8ed96021 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:05.853961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6dfcdf30-d7d0-4cde-80a1-0e7411288619 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:05.873395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6dfcdf30-d7d0-4cde-80a1-0e7411288619 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:05.920711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dfcdf30-d7d0-4cde-80a1-0e7411288619 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:05.921521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dfcdf30-d7d0-4cde-80a1-0e7411288619 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:05.922750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dfcdf30-d7d0-4cde-80a1-0e7411288619 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:05.923564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dfcdf30-d7d0-4cde-80a1-0e7411288619 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:06.470774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cdb6b257-083f-4e43-b710-cdde8ed96021 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:06.489713 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cdb6b257-083f-4e43-b710-cdde8ed96021 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1322 microversion: 2.1 time: 0.814862 Jul 26 14:43:06.508858 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2577/5279] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:05 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1322 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:06.623355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6dfcdf30-d7d0-4cde-80a1-0e7411288619 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:06.636178 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6dfcdf30-d7d0-4cde-80a1-0e7411288619 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 0.792570 Jul 26 14:43:06.641177 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2703/5280] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:05 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:06.877531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b30a99b0-9fb5-4e3e-bb0e-f7d8560b4b50 req-e2eec97f-776a-4635-ab78-8d54e9b17783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c77f907e-8855-4f3f-bbf3-690ea1872bc1", "name": "network-vif-plugged", "status": "completed", "tag": "a9e62da7-b32a-4e16-bb2e-ca3c69efee0d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:06.917650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b30a99b0-9fb5-4e3e-bb0e-f7d8560b4b50 req-e2eec97f-776a-4635-ab78-8d54e9b17783 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:06.918101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b30a99b0-9fb5-4e3e-bb0e-f7d8560b4b50 req-e2eec97f-776a-4635-ab78-8d54e9b17783 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:06.989170 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b30a99b0-9fb5-4e3e-bb0e-f7d8560b4b50 req-e2eec97f-776a-4635-ab78-8d54e9b17783 service nova] Creating event network-vif-plugged:a9e62da7-b32a-4e16-bb2e-ca3c69efee0d for instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 on n-h1-833090-9 Jul 26 14:43:07.008137 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b30a99b0-9fb5-4e3e-bb0e-f7d8560b4b50 req-e2eec97f-776a-4635-ab78-8d54e9b17783 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136836 Jul 26 14:43:07.008766 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2578/5281] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:43:07.520914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ceaef926-cf74-416f-b993-a43e339f7902 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:07.522624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ceaef926-cf74-416f-b993-a43e339f7902 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:07.544407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ceaef926-cf74-416f-b993-a43e339f7902 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:07.544869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ceaef926-cf74-416f-b993-a43e339f7902 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:07.548251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ceaef926-cf74-416f-b993-a43e339f7902 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:07.551630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ceaef926-cf74-416f-b993-a43e339f7902 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:07.700728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87db665f-c8d3-4d9f-a8bd-98ff5243c17d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:07.701721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-87db665f-c8d3-4d9f-a8bd-98ff5243c17d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:07.718676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87db665f-c8d3-4d9f-a8bd-98ff5243c17d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:07.721320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87db665f-c8d3-4d9f-a8bd-98ff5243c17d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:07.722500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87db665f-c8d3-4d9f-a8bd-98ff5243c17d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:07.725254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87db665f-c8d3-4d9f-a8bd-98ff5243c17d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:08.158006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ceaef926-cf74-416f-b993-a43e339f7902 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:08.195521 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ceaef926-cf74-416f-b993-a43e339f7902 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1322 microversion: 2.1 time: 0.681952 Jul 26 14:43:08.196166 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2704/5282] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:07 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1322 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:08.389434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-87db665f-c8d3-4d9f-a8bd-98ff5243c17d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:08.411565 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-87db665f-c8d3-4d9f-a8bd-98ff5243c17d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 0.718303 Jul 26 14:43:08.414766 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2579/5283] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:07 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:09.221508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed955695-014d-4f9f-a084-5e814d4847aa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:09.228319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ed955695-014d-4f9f-a084-5e814d4847aa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:09.250077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed955695-014d-4f9f-a084-5e814d4847aa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:09.250547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed955695-014d-4f9f-a084-5e814d4847aa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:09.251448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed955695-014d-4f9f-a084-5e814d4847aa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:09.251967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed955695-014d-4f9f-a084-5e814d4847aa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:09.447747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dbea17f1-defb-4c5f-9ff0-3556583318e5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:09.456426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dbea17f1-defb-4c5f-9ff0-3556583318e5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:09.490318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbea17f1-defb-4c5f-9ff0-3556583318e5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:09.490779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbea17f1-defb-4c5f-9ff0-3556583318e5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:09.492823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbea17f1-defb-4c5f-9ff0-3556583318e5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:09.493273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dbea17f1-defb-4c5f-9ff0-3556583318e5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:09.631456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ed955695-014d-4f9f-a084-5e814d4847aa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:09.642223 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed955695-014d-4f9f-a084-5e814d4847aa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1515 microversion: 2.1 time: 0.424551 Jul 26 14:43:09.648820 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2705/5284] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:09 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1515 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:09.674216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-19f201dd-40ff-41a4-8668-e5510d6ca6c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:09.697908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-19f201dd-40ff-41a4-8668-e5510d6ca6c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:09.730304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19f201dd-40ff-41a4-8668-e5510d6ca6c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:09.732192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19f201dd-40ff-41a4-8668-e5510d6ca6c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:09.733034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19f201dd-40ff-41a4-8668-e5510d6ca6c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:09.736607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19f201dd-40ff-41a4-8668-e5510d6ca6c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:09.809616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-19f201dd-40ff-41a4-8668-e5510d6ca6c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lazy-loading 'flavor' on Instance uuid c77f907e-8855-4f3f-bbf3-690ea1872bc1 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:43:09.995922 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-19f201dd-40ff-41a4-8668-e5510d6ca6c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1/action" status: 200 len: 32 microversion: 2.1 time: 0.323643 Jul 26 14:43:10.001984 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2706/5285] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:43:09 2022] POST /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1/action => generated 32 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:43:10.012723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a63dbc83-fef5-45ac-8b57-cf1c28fcaecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:10.013444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a63dbc83-fef5-45ac-8b57-cf1c28fcaecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:10.026401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dbea17f1-defb-4c5f-9ff0-3556583318e5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:10.033316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a63dbc83-fef5-45ac-8b57-cf1c28fcaecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:10.033799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a63dbc83-fef5-45ac-8b57-cf1c28fcaecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:10.034635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a63dbc83-fef5-45ac-8b57-cf1c28fcaecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:10.036035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a63dbc83-fef5-45ac-8b57-cf1c28fcaecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:10.041394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:10.077534 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dbea17f1-defb-4c5f-9ff0-3556583318e5 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 0.640127 Jul 26 14:43:10.084341 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2580/5286] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:09 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:10.303334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a63dbc83-fef5-45ac-8b57-cf1c28fcaecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:10.316274 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a63dbc83-fef5-45ac-8b57-cf1c28fcaecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.308934 Jul 26 14:43:10.340897 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2707/5287] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:10 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:11.099491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cff2c584-d37d-4c86-a795-304d2a2371dc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:11.108386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cff2c584-d37d-4c86-a795-304d2a2371dc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:11.156872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cff2c584-d37d-4c86-a795-304d2a2371dc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:11.161085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cff2c584-d37d-4c86-a795-304d2a2371dc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:11.162819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cff2c584-d37d-4c86-a795-304d2a2371dc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:11.164545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cff2c584-d37d-4c86-a795-304d2a2371dc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:11.349026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5d62e4ed-c140-4f21-a4f0-ba33e4c1021c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:11.350499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5d62e4ed-c140-4f21-a4f0-ba33e4c1021c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:11.375354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d62e4ed-c140-4f21-a4f0-ba33e4c1021c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:11.375970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d62e4ed-c140-4f21-a4f0-ba33e4c1021c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:11.376975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d62e4ed-c140-4f21-a4f0-ba33e4c1021c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:11.379624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d62e4ed-c140-4f21-a4f0-ba33e4c1021c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:11.963697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cff2c584-d37d-4c86-a795-304d2a2371dc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:11.983911 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cff2c584-d37d-4c86-a795-304d2a2371dc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 0.877792 Jul 26 14:43:12.002072 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2581/5288] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:11 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:12.215253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5d62e4ed-c140-4f21-a4f0-ba33e4c1021c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:12.240126 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5d62e4ed-c140-4f21-a4f0-ba33e4c1021c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.895214 Jul 26 14:43:12.241852 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2708/5289] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:11 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:13.007732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da8a0179-493c-42a8-8758-96e314fbc9d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:13.009975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-da8a0179-493c-42a8-8758-96e314fbc9d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:13.036493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da8a0179-493c-42a8-8758-96e314fbc9d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:13.040149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da8a0179-493c-42a8-8758-96e314fbc9d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:13.040149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da8a0179-493c-42a8-8758-96e314fbc9d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:13.040149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da8a0179-493c-42a8-8758-96e314fbc9d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:13.261440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d28a563f-756c-409b-ae05-f600188f7c58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:13.262762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d28a563f-756c-409b-ae05-f600188f7c58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:13.278896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28a563f-756c-409b-ae05-f600188f7c58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:13.288774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28a563f-756c-409b-ae05-f600188f7c58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:13.289636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28a563f-756c-409b-ae05-f600188f7c58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:13.290097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28a563f-756c-409b-ae05-f600188f7c58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:13.322757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-da8a0179-493c-42a8-8758-96e314fbc9d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:13.334244 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-da8a0179-493c-42a8-8758-96e314fbc9d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 0.331295 Jul 26 14:43:13.335490 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2582/5290] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:13 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:13.656896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d28a563f-756c-409b-ae05-f600188f7c58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:13.671456 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d28a563f-756c-409b-ae05-f600188f7c58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.411217 Jul 26 14:43:13.673360 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2709/5291] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:13 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:14.357512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-90a6bd92-86e0-433c-8270-d29a76a569ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:14.358127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-90a6bd92-86e0-433c-8270-d29a76a569ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:14.384687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90a6bd92-86e0-433c-8270-d29a76a569ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:14.385155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90a6bd92-86e0-433c-8270-d29a76a569ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:14.385957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90a6bd92-86e0-433c-8270-d29a76a569ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:14.386406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90a6bd92-86e0-433c-8270-d29a76a569ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:14.695583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3138f96-d15b-4651-b8cf-b429521204b1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:14.697021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3138f96-d15b-4651-b8cf-b429521204b1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:14.720905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3138f96-d15b-4651-b8cf-b429521204b1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:14.722143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3138f96-d15b-4651-b8cf-b429521204b1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:14.723389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3138f96-d15b-4651-b8cf-b429521204b1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:14.725386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3138f96-d15b-4651-b8cf-b429521204b1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:15.104278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-90a6bd92-86e0-433c-8270-d29a76a569ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:15.126178 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-90a6bd92-86e0-433c-8270-d29a76a569ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 0.772654 Jul 26 14:43:15.130302 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2583/5292] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:14 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:15.671356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a3138f96-d15b-4651-b8cf-b429521204b1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:15.680371 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a3138f96-d15b-4651-b8cf-b429521204b1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.989310 Jul 26 14:43:15.700605 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2710/5293] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:14 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:16.163751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6a5a70c5-1140-4e7b-a144-a717613c02d8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:16.165113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6a5a70c5-1140-4e7b-a144-a717613c02d8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:16.173618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a5a70c5-1140-4e7b-a144-a717613c02d8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:16.174378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a5a70c5-1140-4e7b-a144-a717613c02d8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:16.175554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a5a70c5-1140-4e7b-a144-a717613c02d8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:16.176274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a5a70c5-1140-4e7b-a144-a717613c02d8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:16.710148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c95130db-9ca2-454d-8ebe-e46f8f23c8f0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:16.711447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c95130db-9ca2-454d-8ebe-e46f8f23c8f0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:16.728575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c95130db-9ca2-454d-8ebe-e46f8f23c8f0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:16.729211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c95130db-9ca2-454d-8ebe-e46f8f23c8f0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:16.731351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c95130db-9ca2-454d-8ebe-e46f8f23c8f0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:16.739025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c95130db-9ca2-454d-8ebe-e46f8f23c8f0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:17.060621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6a5a70c5-1140-4e7b-a144-a717613c02d8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:17.100573 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6a5a70c5-1140-4e7b-a144-a717613c02d8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1695 microversion: 2.1 time: 0.952493 Jul 26 14:43:17.107764 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2584/5294] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:16 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1695 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:17.561144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c95130db-9ca2-454d-8ebe-e46f8f23c8f0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:17.580688 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c95130db-9ca2-454d-8ebe-e46f8f23c8f0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.873909 Jul 26 14:43:17.598835 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2711/5295] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:16 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:18.126791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2b3d189c-095c-448d-bbda-faaf810daa63 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:18.129619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2b3d189c-095c-448d-bbda-faaf810daa63 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:18.171902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b3d189c-095c-448d-bbda-faaf810daa63 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:18.180705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b3d189c-095c-448d-bbda-faaf810daa63 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:18.181580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b3d189c-095c-448d-bbda-faaf810daa63 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:18.182037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2b3d189c-095c-448d-bbda-faaf810daa63 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:18.606654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a7bc69fc-7854-4d5c-8d91-9b57fcbd2146 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:18.608054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a7bc69fc-7854-4d5c-8d91-9b57fcbd2146 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:18.633773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7bc69fc-7854-4d5c-8d91-9b57fcbd2146 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:18.645608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7bc69fc-7854-4d5c-8d91-9b57fcbd2146 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:18.652122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7bc69fc-7854-4d5c-8d91-9b57fcbd2146 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:18.653257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7bc69fc-7854-4d5c-8d91-9b57fcbd2146 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:18.686196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2b3d189c-095c-448d-bbda-faaf810daa63 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:18.712300 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2b3d189c-095c-448d-bbda-faaf810daa63 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1694 microversion: 2.1 time: 0.583422 Jul 26 14:43:18.717288 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2585/5296] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:18 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1694 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:18.910612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a12142f7-b2a4-4a8c-89d5-3ef297bf1358 req-109dc8ca-80f3-4fbc-8eaf-bef0b3aebfe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "name": "network-vif-unplugged", "status": "completed", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:18.931616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a12142f7-b2a4-4a8c-89d5-3ef297bf1358 req-109dc8ca-80f3-4fbc-8eaf-bef0b3aebfe1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:18.932292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a12142f7-b2a4-4a8c-89d5-3ef297bf1358 req-109dc8ca-80f3-4fbc-8eaf-bef0b3aebfe1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:18.968310 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a12142f7-b2a4-4a8c-89d5-3ef297bf1358 req-109dc8ca-80f3-4fbc-8eaf-bef0b3aebfe1 service nova] Creating event network-vif-unplugged:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h1-833090-9 Jul 26 14:43:18.989614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-a12142f7-b2a4-4a8c-89d5-3ef297bf1358 req-109dc8ca-80f3-4fbc-8eaf-bef0b3aebfe1 service nova] Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:43:19.018048 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a12142f7-b2a4-4a8c-89d5-3ef297bf1358 req-109dc8ca-80f3-4fbc-8eaf-bef0b3aebfe1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115127 Jul 26 14:43:19.026663 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2586/5297] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:43:19.375674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a7bc69fc-7854-4d5c-8d91-9b57fcbd2146 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:19.402358 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a7bc69fc-7854-4d5c-8d91-9b57fcbd2146 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.800238 Jul 26 14:43:19.408091 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2712/5298] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:18 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:19.747357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a6eafa06-f05a-430c-a7e0-61944ceed12c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:19.748907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a6eafa06-f05a-430c-a7e0-61944ceed12c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:19.757658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6eafa06-f05a-430c-a7e0-61944ceed12c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:19.758609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6eafa06-f05a-430c-a7e0-61944ceed12c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:19.759594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6eafa06-f05a-430c-a7e0-61944ceed12c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:19.760780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6eafa06-f05a-430c-a7e0-61944ceed12c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:20.431186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43168fb7-c39c-4563-ae76-25f42b351599 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:20.436475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-43168fb7-c39c-4563-ae76-25f42b351599 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:20.469544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a6eafa06-f05a-430c-a7e0-61944ceed12c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:20.478194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43168fb7-c39c-4563-ae76-25f42b351599 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:20.488529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43168fb7-c39c-4563-ae76-25f42b351599 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:20.490720 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a6eafa06-f05a-430c-a7e0-61944ceed12c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1694 microversion: 2.1 time: 0.750834 Jul 26 14:43:20.491410 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2587/5299] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:19 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1694 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:20.493151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43168fb7-c39c-4563-ae76-25f42b351599 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:20.500974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43168fb7-c39c-4563-ae76-25f42b351599 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:21.096162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ee089378-29f2-40d2-88b0-a6b1c1328034 req-f9da0e25-0832-4bd0-b798-195f0927ac40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:21.110995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ee089378-29f2-40d2-88b0-a6b1c1328034 req-f9da0e25-0832-4bd0-b798-195f0927ac40 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:21.111620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ee089378-29f2-40d2-88b0-a6b1c1328034 req-f9da0e25-0832-4bd0-b798-195f0927ac40 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:21.182839 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ee089378-29f2-40d2-88b0-a6b1c1328034 req-f9da0e25-0832-4bd0-b798-195f0927ac40 service nova] Creating event network-changed:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h1-833090-9 Jul 26 14:43:21.217338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-ee089378-29f2-40d2-88b0-a6b1c1328034 req-f9da0e25-0832-4bd0-b798-195f0927ac40 service nova] Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:43:21.239456 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ee089378-29f2-40d2-88b0-a6b1c1328034 req-f9da0e25-0832-4bd0-b798-195f0927ac40 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155898 Jul 26 14:43:21.243623 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2588/5300] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 26 14:43:21.529952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-15d0711e-a47d-485f-b3e4-d42f71a3be5b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:21.531056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-15d0711e-a47d-485f-b3e4-d42f71a3be5b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:21.542017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15d0711e-a47d-485f-b3e4-d42f71a3be5b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:21.545174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15d0711e-a47d-485f-b3e4-d42f71a3be5b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:21.547254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15d0711e-a47d-485f-b3e4-d42f71a3be5b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:21.552627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-15d0711e-a47d-485f-b3e4-d42f71a3be5b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:22.149875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-15d0711e-a47d-485f-b3e4-d42f71a3be5b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:22.164237 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-15d0711e-a47d-485f-b3e4-d42f71a3be5b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1694 microversion: 2.1 time: 0.638999 Jul 26 14:43:22.171255 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2589/5301] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:21 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1694 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:22.209809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43168fb7-c39c-4563-ae76-25f42b351599 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:22.225990 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43168fb7-c39c-4563-ae76-25f42b351599 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 1.802325 Jul 26 14:43:22.234972 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2713/5302] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:20 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:23.192958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7386f61d-ab68-4c42-91ef-dbb22d8b6de4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:23.194014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7386f61d-ab68-4c42-91ef-dbb22d8b6de4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:23.214282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7386f61d-ab68-4c42-91ef-dbb22d8b6de4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:23.217917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7386f61d-ab68-4c42-91ef-dbb22d8b6de4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:23.220564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7386f61d-ab68-4c42-91ef-dbb22d8b6de4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:23.221185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7386f61d-ab68-4c42-91ef-dbb22d8b6de4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:23.258617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-232ea04b-226a-437d-acf0-ee165aeaa7a0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:23.259909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-232ea04b-226a-437d-acf0-ee165aeaa7a0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:23.269781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-232ea04b-226a-437d-acf0-ee165aeaa7a0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:23.270166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-232ea04b-226a-437d-acf0-ee165aeaa7a0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:23.271312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-232ea04b-226a-437d-acf0-ee165aeaa7a0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:23.271933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-232ea04b-226a-437d-acf0-ee165aeaa7a0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:23.848216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-232ea04b-226a-437d-acf0-ee165aeaa7a0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:23.858020 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-232ea04b-226a-437d-acf0-ee165aeaa7a0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.604256 Jul 26 14:43:23.863206 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2714/5303] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:23 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:24.115886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7386f61d-ab68-4c42-91ef-dbb22d8b6de4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:24.138744 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7386f61d-ab68-4c42-91ef-dbb22d8b6de4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1692 microversion: 2.1 time: 0.951711 Jul 26 14:43:24.142666 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2590/5304] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:23 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1692 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:24.885430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-02fdc07e-628e-4424-8bf6-7811a1ee313d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:24.886264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-02fdc07e-628e-4424-8bf6-7811a1ee313d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:24.902117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02fdc07e-628e-4424-8bf6-7811a1ee313d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:24.902499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02fdc07e-628e-4424-8bf6-7811a1ee313d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:24.903513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02fdc07e-628e-4424-8bf6-7811a1ee313d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:24.904025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02fdc07e-628e-4424-8bf6-7811a1ee313d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:25.166439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d6f43a1-5bce-42ea-a012-5ded3db90c6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:25.166985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d6f43a1-5bce-42ea-a012-5ded3db90c6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:25.174547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d6f43a1-5bce-42ea-a012-5ded3db90c6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:25.176287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d6f43a1-5bce-42ea-a012-5ded3db90c6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:25.177369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d6f43a1-5bce-42ea-a012-5ded3db90c6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:25.177827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d6f43a1-5bce-42ea-a012-5ded3db90c6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:25.201750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:25.419215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-02fdc07e-628e-4424-8bf6-7811a1ee313d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:25.454862 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-02fdc07e-628e-4424-8bf6-7811a1ee313d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.573048 Jul 26 14:43:25.456312 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2715/5305] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:24 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:25.557937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0d6f43a1-5bce-42ea-a012-5ded3db90c6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:25.567647 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d6f43a1-5bce-42ea-a012-5ded3db90c6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1689 microversion: 2.1 time: 0.405291 Jul 26 14:43:25.584847 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2591/5306] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:25 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1689 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:25.591551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3868aec5-b921-4bba-b999-9ad0f528e0b3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:25.592140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3868aec5-b921-4bba-b999-9ad0f528e0b3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:25.599785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3868aec5-b921-4bba-b999-9ad0f528e0b3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:25.600280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3868aec5-b921-4bba-b999-9ad0f528e0b3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:25.601694 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3868aec5-b921-4bba-b999-9ad0f528e0b3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:25.602389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3868aec5-b921-4bba-b999-9ad0f528e0b3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:25.783908 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3868aec5-b921-4bba-b999-9ad0f528e0b3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63/action" status: 202 len: 0 microversion: 2.1 time: 0.195981 Jul 26 14:43:25.785985 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2716/5307] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:43:25 2022] POST /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:43:25.802962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-959190aa-ae87-4f7e-aa79-4cfe22f26fbc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:25.808159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-959190aa-ae87-4f7e-aa79-4cfe22f26fbc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:25.825686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-959190aa-ae87-4f7e-aa79-4cfe22f26fbc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:25.826424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-959190aa-ae87-4f7e-aa79-4cfe22f26fbc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:25.838821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-959190aa-ae87-4f7e-aa79-4cfe22f26fbc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:25.840140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-959190aa-ae87-4f7e-aa79-4cfe22f26fbc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:26.131616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-959190aa-ae87-4f7e-aa79-4cfe22f26fbc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:26.139540 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-959190aa-ae87-4f7e-aa79-4cfe22f26fbc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1688 microversion: 2.1 time: 0.346312 Jul 26 14:43:26.140163 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2592/5308] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:25 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1688 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:26.196391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d1e456b9-5c57-4503-8d87-e4b23a441497 req-df39e7cc-0b7d-4446-b39a-7c470ff6e33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "name": "network-vif-plugged", "status": "completed", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:26.226335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d1e456b9-5c57-4503-8d87-e4b23a441497 req-df39e7cc-0b7d-4446-b39a-7c470ff6e33e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:26.227021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d1e456b9-5c57-4503-8d87-e4b23a441497 req-df39e7cc-0b7d-4446-b39a-7c470ff6e33e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:26.257657 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d1e456b9-5c57-4503-8d87-e4b23a441497 req-df39e7cc-0b7d-4446-b39a-7c470ff6e33e service nova] Creating event network-vif-plugged:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h1-833090-9 Jul 26 14:43:26.265309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-d1e456b9-5c57-4503-8d87-e4b23a441497 req-df39e7cc-0b7d-4446-b39a-7c470ff6e33e service nova] Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:43:26.283421 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d1e456b9-5c57-4503-8d87-e4b23a441497 req-df39e7cc-0b7d-4446-b39a-7c470ff6e33e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093048 Jul 26 14:43:26.284838 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2717/5309] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:43:26.479042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e50e0391-9637-48bc-8a54-1421de1dcbb2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:26.479977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e50e0391-9637-48bc-8a54-1421de1dcbb2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:26.492273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e50e0391-9637-48bc-8a54-1421de1dcbb2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:26.492968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e50e0391-9637-48bc-8a54-1421de1dcbb2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:26.494837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e50e0391-9637-48bc-8a54-1421de1dcbb2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:26.495466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e50e0391-9637-48bc-8a54-1421de1dcbb2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:26.970956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e50e0391-9637-48bc-8a54-1421de1dcbb2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:27.001885 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e50e0391-9637-48bc-8a54-1421de1dcbb2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.527650 Jul 26 14:43:27.038043 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2593/5310] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:26 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:27.164128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aa465bfa-4b42-4c69-97f6-d7209a07adce tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:27.165177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aa465bfa-4b42-4c69-97f6-d7209a07adce tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:27.173345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa465bfa-4b42-4c69-97f6-d7209a07adce tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:27.175500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa465bfa-4b42-4c69-97f6-d7209a07adce tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:27.176575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa465bfa-4b42-4c69-97f6-d7209a07adce tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:27.177003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa465bfa-4b42-4c69-97f6-d7209a07adce tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:27.478560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa465bfa-4b42-4c69-97f6-d7209a07adce tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:27.494602 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aa465bfa-4b42-4c69-97f6-d7209a07adce tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1688 microversion: 2.1 time: 0.333344 Jul 26 14:43:27.500923 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2718/5311] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:27 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1688 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:28.032038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8bf757d9-7040-4b2c-84a4-2bf6047cff69 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:28.032665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8bf757d9-7040-4b2c-84a4-2bf6047cff69 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:28.044796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bf757d9-7040-4b2c-84a4-2bf6047cff69 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:28.045255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bf757d9-7040-4b2c-84a4-2bf6047cff69 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:28.053789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bf757d9-7040-4b2c-84a4-2bf6047cff69 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:28.054402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bf757d9-7040-4b2c-84a4-2bf6047cff69 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:28.437622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8bf757d9-7040-4b2c-84a4-2bf6047cff69 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:28.448983 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8bf757d9-7040-4b2c-84a4-2bf6047cff69 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.421927 Jul 26 14:43:28.452206 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2594/5312] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:28 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:28.519221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-93ff5ea1-5e0b-4dc3-a6dc-2e44f0108c42 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:28.521103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-93ff5ea1-5e0b-4dc3-a6dc-2e44f0108c42 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:28.531104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=50 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:28.533154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93ff5ea1-5e0b-4dc3-a6dc-2e44f0108c42 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:28.538583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93ff5ea1-5e0b-4dc3-a6dc-2e44f0108c42 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:28.539467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93ff5ea1-5e0b-4dc3-a6dc-2e44f0108c42 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:28.539922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93ff5ea1-5e0b-4dc3-a6dc-2e44f0108c42 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:29.038339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-93ff5ea1-5e0b-4dc3-a6dc-2e44f0108c42 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:29.056728 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-93ff5ea1-5e0b-4dc3-a6dc-2e44f0108c42 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1688 microversion: 2.1 time: 0.541681 Jul 26 14:43:29.060152 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2719/5313] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:28 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1688 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:29.476976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-832e4b08-04a3-4075-bbd0-dc17486a54c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:29.478166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-832e4b08-04a3-4075-bbd0-dc17486a54c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:29.498780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-832e4b08-04a3-4075-bbd0-dc17486a54c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:29.499506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-832e4b08-04a3-4075-bbd0-dc17486a54c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:29.500761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-832e4b08-04a3-4075-bbd0-dc17486a54c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:29.501561 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-832e4b08-04a3-4075-bbd0-dc17486a54c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:30.081213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b827d3f5-5b91-431c-aa1c-bbcd1e224d4e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:30.082061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b827d3f5-5b91-431c-aa1c-bbcd1e224d4e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:30.091398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b827d3f5-5b91-431c-aa1c-bbcd1e224d4e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:30.092030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b827d3f5-5b91-431c-aa1c-bbcd1e224d4e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:30.093399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b827d3f5-5b91-431c-aa1c-bbcd1e224d4e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:30.094105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b827d3f5-5b91-431c-aa1c-bbcd1e224d4e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:30.315619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-832e4b08-04a3-4075-bbd0-dc17486a54c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:30.346698 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-832e4b08-04a3-4075-bbd0-dc17486a54c5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.874518 Jul 26 14:43:30.350100 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2595/5314] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:29 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:31.049258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b827d3f5-5b91-431c-aa1c-bbcd1e224d4e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:31.058302 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b827d3f5-5b91-431c-aa1c-bbcd1e224d4e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1688 microversion: 2.1 time: 0.981797 Jul 26 14:43:31.070579 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2720/5315] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:30 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1688 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:31.371244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-60072d02-9c9c-428c-a89b-f712f9ac384a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:31.372085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-60072d02-9c9c-428c-a89b-f712f9ac384a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:31.380966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=48 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:31.387936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60072d02-9c9c-428c-a89b-f712f9ac384a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:31.395905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60072d02-9c9c-428c-a89b-f712f9ac384a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:31.397164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60072d02-9c9c-428c-a89b-f712f9ac384a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:31.397868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60072d02-9c9c-428c-a89b-f712f9ac384a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:32.095270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1eef9046-e272-4a0a-9f90-f1963ef8953c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:32.095913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1eef9046-e272-4a0a-9f90-f1963ef8953c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:32.115267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1eef9046-e272-4a0a-9f90-f1963ef8953c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:32.116047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1eef9046-e272-4a0a-9f90-f1963ef8953c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:32.117029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1eef9046-e272-4a0a-9f90-f1963ef8953c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:32.123310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1eef9046-e272-4a0a-9f90-f1963ef8953c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:32.239179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-60072d02-9c9c-428c-a89b-f712f9ac384a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:32.253360 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-60072d02-9c9c-428c-a89b-f712f9ac384a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.886095 Jul 26 14:43:32.261272 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2596/5316] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:31 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:32.882588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1eef9046-e272-4a0a-9f90-f1963ef8953c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:32.896072 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1eef9046-e272-4a0a-9f90-f1963ef8953c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1688 microversion: 2.1 time: 0.803936 Jul 26 14:43:32.917067 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2721/5317] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:32 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1688 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:32.921093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-5c163f42-bd76-46d6-a8a9-133b40fca125 req-18a4bbe2-6fde-4de5-8e81-bcbe36c0095e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "name": "network-vif-unplugged", "status": "completed", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:32.962639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5c163f42-bd76-46d6-a8a9-133b40fca125 req-18a4bbe2-6fde-4de5-8e81-bcbe36c0095e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:32.963717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5c163f42-bd76-46d6-a8a9-133b40fca125 req-18a4bbe2-6fde-4de5-8e81-bcbe36c0095e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:33.006272 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-5c163f42-bd76-46d6-a8a9-133b40fca125 req-18a4bbe2-6fde-4de5-8e81-bcbe36c0095e service nova] Creating event network-vif-unplugged:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h2-833090-9 Jul 26 14:43:33.027150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-5c163f42-bd76-46d6-a8a9-133b40fca125 req-18a4bbe2-6fde-4de5-8e81-bcbe36c0095e service nova] Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:43:33.065505 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-5c163f42-bd76-46d6-a8a9-133b40fca125 req-18a4bbe2-6fde-4de5-8e81-bcbe36c0095e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148319 Jul 26 14:43:33.067937 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2597/5318] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:43:33.301889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf722aa6-4a88-4bac-ac63-67f0b24636af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:33.303461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bf722aa6-4a88-4bac-ac63-67f0b24636af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:33.337217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf722aa6-4a88-4bac-ac63-67f0b24636af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:33.337868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf722aa6-4a88-4bac-ac63-67f0b24636af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:33.339080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf722aa6-4a88-4bac-ac63-67f0b24636af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:33.339542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf722aa6-4a88-4bac-ac63-67f0b24636af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:33.379743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:33.934631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d7c475eb-eb11-420c-9193-20455f8a2372 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:33.936350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d7c475eb-eb11-420c-9193-20455f8a2372 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:33.977065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7c475eb-eb11-420c-9193-20455f8a2372 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:33.977530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7c475eb-eb11-420c-9193-20455f8a2372 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:33.978481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7c475eb-eb11-420c-9193-20455f8a2372 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:33.994840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d7c475eb-eb11-420c-9193-20455f8a2372 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:34.915916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bf722aa6-4a88-4bac-ac63-67f0b24636af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:34.933582 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bf722aa6-4a88-4bac-ac63-67f0b24636af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 1.644498 Jul 26 14:43:34.947261 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2722/5319] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:33 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:35.326747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d7c475eb-eb11-420c-9193-20455f8a2372 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:35.352575 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d7c475eb-eb11-420c-9193-20455f8a2372 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1688 microversion: 2.1 time: 1.424119 Jul 26 14:43:35.370958 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2598/5320] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:33 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1688 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:35.653926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2718afca-1c0c-49ea-a30c-21667fb7fff0 req-62559e31-205d-4da8-89dc-17d37b197086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:35.678338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2718afca-1c0c-49ea-a30c-21667fb7fff0 req-62559e31-205d-4da8-89dc-17d37b197086 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:35.678802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2718afca-1c0c-49ea-a30c-21667fb7fff0 req-62559e31-205d-4da8-89dc-17d37b197086 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:35.721499 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2718afca-1c0c-49ea-a30c-21667fb7fff0 req-62559e31-205d-4da8-89dc-17d37b197086 service nova] Creating event network-changed:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h2-833090-9 Jul 26 14:43:35.746057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-2718afca-1c0c-49ea-a30c-21667fb7fff0 req-62559e31-205d-4da8-89dc-17d37b197086 service nova] Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 14:43:35.787646 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2718afca-1c0c-49ea-a30c-21667fb7fff0 req-62559e31-205d-4da8-89dc-17d37b197086 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136816 Jul 26 14:43:35.788505 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2723/5321] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:43:35.960962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ceb7ef0-2d0f-426e-95c0-d38fd50bd07e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:35.961588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ceb7ef0-2d0f-426e-95c0-d38fd50bd07e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:35.985110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ceb7ef0-2d0f-426e-95c0-d38fd50bd07e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:35.996464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ceb7ef0-2d0f-426e-95c0-d38fd50bd07e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:36.000320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ceb7ef0-2d0f-426e-95c0-d38fd50bd07e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:36.001254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ceb7ef0-2d0f-426e-95c0-d38fd50bd07e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:36.410985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-852e4af8-4757-42d5-8b0c-6fa71be96c6d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:36.415122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-852e4af8-4757-42d5-8b0c-6fa71be96c6d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:36.442209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-852e4af8-4757-42d5-8b0c-6fa71be96c6d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:36.446000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-852e4af8-4757-42d5-8b0c-6fa71be96c6d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:36.447216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-852e4af8-4757-42d5-8b0c-6fa71be96c6d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:36.448969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-852e4af8-4757-42d5-8b0c-6fa71be96c6d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:36.884212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8ceb7ef0-2d0f-426e-95c0-d38fd50bd07e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:36.903047 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ceb7ef0-2d0f-426e-95c0-d38fd50bd07e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 0.947602 Jul 26 14:43:36.908384 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2599/5322] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:35 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:37.240759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-852e4af8-4757-42d5-8b0c-6fa71be96c6d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:37.252290 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-852e4af8-4757-42d5-8b0c-6fa71be96c6d tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1688 microversion: 2.1 time: 0.869081 Jul 26 14:43:37.257359 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2724/5323] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:36 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1688 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:37.932181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-40d3aff9-b5aa-443c-addd-9a5af1c29c79 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:37.933368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-40d3aff9-b5aa-443c-addd-9a5af1c29c79 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:37.945748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40d3aff9-b5aa-443c-addd-9a5af1c29c79 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:37.948898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40d3aff9-b5aa-443c-addd-9a5af1c29c79 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:37.951909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40d3aff9-b5aa-443c-addd-9a5af1c29c79 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:37.952841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40d3aff9-b5aa-443c-addd-9a5af1c29c79 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:38.283669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-acd9387a-71ef-4c97-8d9d-20f4b2db2571 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:38.284365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-acd9387a-71ef-4c97-8d9d-20f4b2db2571 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:38.298317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acd9387a-71ef-4c97-8d9d-20f4b2db2571 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:38.298793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acd9387a-71ef-4c97-8d9d-20f4b2db2571 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:38.299703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acd9387a-71ef-4c97-8d9d-20f4b2db2571 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:38.300865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-acd9387a-71ef-4c97-8d9d-20f4b2db2571 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:39.342240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-40d3aff9-b5aa-443c-addd-9a5af1c29c79 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:39.365473 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-40d3aff9-b5aa-443c-addd-9a5af1c29c79 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1521 microversion: 2.1 time: 1.434262 Jul 26 14:43:39.368469 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2600/5324] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:37 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1521 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:39.382106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7a7b2d3b-6272-4d6b-84d4-be32d7f7da34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:39.383040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7a7b2d3b-6272-4d6b-84d4-be32d7f7da34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:39.394961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a7b2d3b-6272-4d6b-84d4-be32d7f7da34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:39.396268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a7b2d3b-6272-4d6b-84d4-be32d7f7da34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:39.397747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a7b2d3b-6272-4d6b-84d4-be32d7f7da34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:39.398637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a7b2d3b-6272-4d6b-84d4-be32d7f7da34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:39.898892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-acd9387a-71ef-4c97-8d9d-20f4b2db2571 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:39.921807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-7a7b2d3b-6272-4d6b-84d4-be32d7f7da34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lazy-loading 'services' on Instance uuid 358b56fe-a34a-4182-8b74-b97c49efb388 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:43:39.935515 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-acd9387a-71ef-4c97-8d9d-20f4b2db2571 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1688 microversion: 2.1 time: 1.651796 Jul 26 14:43:39.943601 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2725/5325] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:38 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1688 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:40.179360 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7a7b2d3b-6272-4d6b-84d4-be32d7f7da34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388/os-volume_attachments/5236a8b7-f915-47f9-b91a-aa88a2d72df2" status: 202 len: 0 microversion: 2.1 time: 0.808381 Jul 26 14:43:40.183399 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2601/5326] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:43:39 2022] DELETE /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388/os-volume_attachments/5236a8b7-f915-47f9-b91a-aa88a2d72df2 => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:43:40.409372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a640954f-529f-41e6-b2c7-451839060600 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:40.411057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a640954f-529f-41e6-b2c7-451839060600 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:40.475259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a640954f-529f-41e6-b2c7-451839060600 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:40.476050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a640954f-529f-41e6-b2c7-451839060600 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:40.505239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a640954f-529f-41e6-b2c7-451839060600 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:40.506499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a640954f-529f-41e6-b2c7-451839060600 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:40.962009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a640954f-529f-41e6-b2c7-451839060600 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:40.977354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9337f909-6183-45ae-a42f-318e5247a940 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:40.983839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9337f909-6183-45ae-a42f-318e5247a940 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:41.016998 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a640954f-529f-41e6-b2c7-451839060600 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1501 microversion: 2.1 time: 0.614527 Jul 26 14:43:41.017611 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2726/5327] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:40 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1501 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:41.027687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9337f909-6183-45ae-a42f-318e5247a940 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:41.028189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9337f909-6183-45ae-a42f-318e5247a940 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:41.040455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9337f909-6183-45ae-a42f-318e5247a940 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:41.043710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9337f909-6183-45ae-a42f-318e5247a940 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:41.052548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-47027098-49ab-4f15-9602-8fe7deab61f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:41.061289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47027098-49ab-4f15-9602-8fe7deab61f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:41.090017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47027098-49ab-4f15-9602-8fe7deab61f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:41.090490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47027098-49ab-4f15-9602-8fe7deab61f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:41.091404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47027098-49ab-4f15-9602-8fe7deab61f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:41.091861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47027098-49ab-4f15-9602-8fe7deab61f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:42.313512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9337f909-6183-45ae-a42f-318e5247a940 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:42.334000 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9337f909-6183-45ae-a42f-318e5247a940 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1681 microversion: 2.1 time: 1.363983 Jul 26 14:43:42.336995 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2602/5328] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:40 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1681 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:42.348970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1fdef0b9-2ec7-4219-a6cd-5f92b380f924 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Action: 'create', calling method: .version_select at 0x7f8786f14dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-703677133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZ+RXJY5qCR0J8/1H+W4zbOPmXFYyvhgW3cJyk2B8+zcN4OL2sk/NwfUwlliziGZj3fFT2lK8eP9hhuQOitsKwxPUJkfFilYm5nKJI32+xzTZRUAOR9+IsIrK4I/ykvLA=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:42.423408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-1fdef0b9-2ec7-4219-a6cd-5f92b380f924 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for project 54967e3bd292459a81121b90b03fde3b. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:43:42.449934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-1fdef0b9-2ec7-4219-a6cd-5f92b380f924 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for user 5e1adb391e2f425892a83762aaa6eb43 and project 54967e3bd292459a81121b90b03fde3b. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:43:42.581670 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1fdef0b9-2ec7-4219-a6cd-5f92b380f924 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.243028 Jul 26 14:43:42.582641 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2603/5329] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:43:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:43:42.736621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47027098-49ab-4f15-9602-8fe7deab61f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:42.760975 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-47027098-49ab-4f15-9602-8fe7deab61f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1514 microversion: 2.1 time: 1.710062 Jul 26 14:43:42.762848 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2727/5330] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:41 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1514 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:42.806160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-09bc184d-8a5e-4176-8a4a-a1348aacd248 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:42.806160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-09bc184d-8a5e-4176-8a4a-a1348aacd248 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 8e7fa87a-8fa5-46f1-b282-82b0a54e3c04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:42.823943 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-09bc184d-8a5e-4176-8a4a-a1348aacd248 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] HTTP exception thrown: Instance 8e7fa87a-8fa5-46f1-b282-82b0a54e3c04 could not be found. Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-09bc184d-8a5e-4176-8a4a-a1348aacd248 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Request method failure captured: Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/8e7fa87a-8fa5-46f1-b282-82b0a54e3c04/action HTTP/1.1 Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 14 Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_1f6ZzJX0S01b_Op3EoMNcBZEG-kX6NKBmC9y8eYSEGGvW2IzzGDCwRHyopc8xJm4faZa9Jll31j2AyA8-1nj2TIW6-NxgVw70z941LrxxyqTc1krrtQixKuVoRbZbeVXl3oq2yJDnuG60YY3irOdy923OsfCXhYNJbHMgyTRh4Lb0 Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7386a23b259b4c4091637972951a3f0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}] Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ca1aaf9a4ab74a829ef94a7d54c683cd Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: {"rescue": {}} Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 8e7fa87a-8fa5-46f1-b282-82b0a54e3c04 could not be found. Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '8e7fa87a-8fa5-46f1-b282-82b0a54e3c04', 'body': {'rescue': {}}} Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e7fa87a-8fa5-46f1-b282-82b0a54e3c04 could not be found. Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e7fa87a-8fa5-46f1-b282-82b0a54e3c04 could not be found. Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:43:42.836550 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:43:42.847775 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:43:42.847775 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:43:42.847775 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:43:42.847775 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:43:42.847775 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e7fa87a-8fa5-46f1-b282-82b0a54e3c04 could not be found. Jul 26 14:43:42.847775 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:43:42.853360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-09bc184d-8a5e-4176-8a4a-a1348aacd248 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Returning 404 to user: Instance 8e7fa87a-8fa5-46f1-b282-82b0a54e3c04 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:43:42.859126 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-09bc184d-8a5e-4176-8a4a-a1348aacd248 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/8e7fa87a-8fa5-46f1-b282-82b0a54e3c04/action" status: 404 len: 111 microversion: 2.1 time: 0.072930 Jul 26 14:43:42.880261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-22a1c15e-f9ae-4503-b3c0-e1b2003e442a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:42.883722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-22a1c15e-f9ae-4503-b3c0-e1b2003e442a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:42.886907 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2604/5331] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:43:42 2022] POST /compute/v2.1/servers/8e7fa87a-8fa5-46f1-b282-82b0a54e3c04/action => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:43:42.902774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22a1c15e-f9ae-4503-b3c0-e1b2003e442a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:42.905000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22a1c15e-f9ae-4503-b3c0-e1b2003e442a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:42.907899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22a1c15e-f9ae-4503-b3c0-e1b2003e442a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:42.908961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-22a1c15e-f9ae-4503-b3c0-e1b2003e442a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:43.210408 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-22a1c15e-f9ae-4503-b3c0-e1b2003e442a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action" status: 202 len: 0 microversion: 2.1 time: 0.338368 Jul 26 14:43:43.220072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-78acccf2-2ba0-4b29-9cdc-9e18ee0a82f3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:43.221041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-78acccf2-2ba0-4b29-9cdc-9e18ee0a82f3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:43.230586 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2728/5332] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:43:42 2022] POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:43:43.233846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78acccf2-2ba0-4b29-9cdc-9e18ee0a82f3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:43.248983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78acccf2-2ba0-4b29-9cdc-9e18ee0a82f3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:43.250179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78acccf2-2ba0-4b29-9cdc-9e18ee0a82f3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:43.250637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78acccf2-2ba0-4b29-9cdc-9e18ee0a82f3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:45.040199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-78acccf2-2ba0-4b29-9cdc-9e18ee0a82f3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:45.060086 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-78acccf2-2ba0-4b29-9cdc-9e18ee0a82f3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1519 microversion: 2.1 time: 1.837739 Jul 26 14:43:45.061534 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2605/5333] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:43 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1519 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:46.085180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-47c98ed0-fecd-4a41-896b-2d668ad2337f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:46.086631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-47c98ed0-fecd-4a41-896b-2d668ad2337f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:46.108974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47c98ed0-fecd-4a41-896b-2d668ad2337f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:46.118115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47c98ed0-fecd-4a41-896b-2d668ad2337f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:46.121060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47c98ed0-fecd-4a41-896b-2d668ad2337f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:46.123119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-47c98ed0-fecd-4a41-896b-2d668ad2337f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:46.203222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7dfd5f8c-def7-4e6d-8420-33095381774b req-57351d32-a33c-4808-ab84-f17d4007e0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "name": "network-vif-plugged", "status": "completed", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:46.251871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7dfd5f8c-def7-4e6d-8420-33095381774b req-57351d32-a33c-4808-ab84-f17d4007e0af service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:46.260296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7dfd5f8c-def7-4e6d-8420-33095381774b req-57351d32-a33c-4808-ab84-f17d4007e0af service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:46.298075 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7dfd5f8c-def7-4e6d-8420-33095381774b req-57351d32-a33c-4808-ab84-f17d4007e0af service nova] Creating event network-vif-plugged:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h2-833090-9 Jul 26 14:43:46.315046 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7dfd5f8c-def7-4e6d-8420-33095381774b req-57351d32-a33c-4808-ab84-f17d4007e0af service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115454 Jul 26 14:43:46.320591 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2606/5334] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:43:46.422589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-684699781", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "5f27a995-ec35-4d5e-ac40-69603ad6b846"}], "key_name": "tempest-TestNetworkBasicOps-703677133", "security_groups": [{"name": "tempest-secgroup-smoke-119529428"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:46.723735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] validate_networks() for [('5f27a995-ec35-4d5e-ac40-69603ad6b846', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:43:47.008710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-47c98ed0-fecd-4a41-896b-2d668ad2337f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:47.016615 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-47c98ed0-fecd-4a41-896b-2d668ad2337f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1499 microversion: 2.1 time: 0.937048 Jul 26 14:43:47.046197 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2729/5335] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:46 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1499 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:47.059003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:47.062684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:47.078229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:47.079298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:47.080518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:47.081255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:47.128224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lazy-loading 'flavor' on Instance uuid aae76411-a3af-4e21-a827-39d6ae08c182 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:43:47.146079 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] HTTP exception thrown: Cannot 'rescue' instance aae76411-a3af-4e21-a827-39d6ae08c182 while it is in vm_state paused Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Request method failure captured: Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action HTTP/1.1 Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 14 Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_1f6ZzJX0S01b_Op3EoMNcBZEG-kX6NKBmC9y8eYSEGGvW2IzzGDCwRHyopc8xJm4faZa9Jll31j2AyA8-1nj2TIW6-NxgVw70z941LrxxyqTc1krrtQixKuVoRbZbeVXl3oq2yJDnuG60YY3irOdy923OsfCXhYNJbHMgyTRh4Lb0 Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7386a23b259b4c4091637972951a3f0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}] Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ca1aaf9a4ab74a829ef94a7d54c683cd Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: {"rescue": {}} Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: exception: Cannot 'rescue' instance aae76411-a3af-4e21-a827-39d6ae08c182 while it is in vm_state paused Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'aae76411-a3af-4e21-a827-39d6ae08c182', 'body': {'rescue': {}}} Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aae76411-a3af-4e21-a827-39d6ae08c182 in vm_state paused. Cannot rescue while the instance is in this state. Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance aae76411-a3af-4e21-a827-39d6ae08c182 while it is in vm_state paused Jul 26 14:43:47.148075 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance aae76411-a3af-4e21-a827-39d6ae08c182 while it is in vm_state paused Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Returning 409 to user: Cannot 'rescue' instance aae76411-a3af-4e21-a827-39d6ae08c182 while it is in vm_state paused {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:43:47.153183 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-168bdbb1-e8be-45d8-af38-d72c49060d9e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action" status: 409 len: 144 microversion: 2.1 time: 0.102000 Jul 26 14:43:47.154939 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2730/5336] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:43:47 2022] POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action => generated 144 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:43:47.160066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d4e26f26-f8e5-4bdf-861c-e29721d6e2d1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:47.160066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d4e26f26-f8e5-4bdf-861c-e29721d6e2d1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:47.166912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4e26f26-f8e5-4bdf-861c-e29721d6e2d1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:47.167392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4e26f26-f8e5-4bdf-861c-e29721d6e2d1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:47.168200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4e26f26-f8e5-4bdf-861c-e29721d6e2d1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:47.168664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4e26f26-f8e5-4bdf-861c-e29721d6e2d1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:47.329727 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d4e26f26-f8e5-4bdf-861c-e29721d6e2d1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action" status: 202 len: 0 microversion: 2.1 time: 0.174963 Jul 26 14:43:47.330394 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2731/5337] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:43:47 2022] POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:43:47.359967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-20d784a6-0049-48ea-b3a2-c0ab1e91112f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:47.366175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-20d784a6-0049-48ea-b3a2-c0ab1e91112f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:47.384007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20d784a6-0049-48ea-b3a2-c0ab1e91112f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:47.384755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20d784a6-0049-48ea-b3a2-c0ab1e91112f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:47.387902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20d784a6-0049-48ea-b3a2-c0ab1e91112f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:47.388615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20d784a6-0049-48ea-b3a2-c0ab1e91112f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:47.922974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:43:47.923454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:43:47.923938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:43:47.924581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:43:47.925180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:43:47.938992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:47.939451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:47.940302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:47.945545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:47.991404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for project 54967e3bd292459a81121b90b03fde3b. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:43:47.998021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for user 5e1adb391e2f425892a83762aaa6eb43 and project 54967e3bd292459a81121b90b03fde3b. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:43:48.005354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-20d784a6-0049-48ea-b3a2-c0ab1e91112f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:48.014848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:43:48.017804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:43:48.025791 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-20d784a6-0049-48ea-b3a2-c0ab1e91112f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1506 microversion: 2.1 time: 0.678358 Jul 26 14:43:48.029810 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2732/5338] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:47 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1506 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:48.098366 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-58672961-9d7b-4276-8778-da13246d5edf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.690506 Jul 26 14:43:48.106014 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2607/5339] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:43:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:43:48.124663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ab24f3d6-61eb-4729-b21e-c0d476ed94fa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:48.125317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ab24f3d6-61eb-4729-b21e-c0d476ed94fa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:48.273767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ab24f3d6-61eb-4729-b21e-c0d476ed94fa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:48.281395 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ab24f3d6-61eb-4729-b21e-c0d476ed94fa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1247 microversion: 2.1 time: 0.174169 Jul 26 14:43:48.284112 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2733/5340] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:48 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1247 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:49.052081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-28a0b924-2605-4b73-b80e-ef3e14580730 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:49.052967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-28a0b924-2605-4b73-b80e-ef3e14580730 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:49.072334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-28a0b924-2605-4b73-b80e-ef3e14580730 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:49.075018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-28a0b924-2605-4b73-b80e-ef3e14580730 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:49.078233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-28a0b924-2605-4b73-b80e-ef3e14580730 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:49.079538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-28a0b924-2605-4b73-b80e-ef3e14580730 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:49.315175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-019d107f-9afc-49a8-8c18-dae472e49c9e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:49.316565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-019d107f-9afc-49a8-8c18-dae472e49c9e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:49.357271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-019d107f-9afc-49a8-8c18-dae472e49c9e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:49.358247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-019d107f-9afc-49a8-8c18-dae472e49c9e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:49.362108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-019d107f-9afc-49a8-8c18-dae472e49c9e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:49.368113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-019d107f-9afc-49a8-8c18-dae472e49c9e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:49.423503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-28a0b924-2605-4b73-b80e-ef3e14580730 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:49.440159 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-28a0b924-2605-4b73-b80e-ef3e14580730 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1506 microversion: 2.1 time: 0.396470 Jul 26 14:43:49.444218 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2608/5341] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:49 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:49.568544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-019d107f-9afc-49a8-8c18-dae472e49c9e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:49.584719 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-019d107f-9afc-49a8-8c18-dae472e49c9e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1251 microversion: 2.1 time: 0.277286 Jul 26 14:43:49.599741 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2734/5342] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:49 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1251 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:50.475101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-69cabb77-2907-4a01-8034-250dc17d3931 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:50.476777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-69cabb77-2907-4a01-8034-250dc17d3931 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:50.491433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69cabb77-2907-4a01-8034-250dc17d3931 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:50.492204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69cabb77-2907-4a01-8034-250dc17d3931 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:50.494941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69cabb77-2907-4a01-8034-250dc17d3931 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:50.496802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-69cabb77-2907-4a01-8034-250dc17d3931 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:50.611356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5d9c287d-f627-49f9-82a8-69214b364b38 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:50.614710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5d9c287d-f627-49f9-82a8-69214b364b38 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:50.658307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d9c287d-f627-49f9-82a8-69214b364b38 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:50.660126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d9c287d-f627-49f9-82a8-69214b364b38 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:50.664258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d9c287d-f627-49f9-82a8-69214b364b38 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:50.666366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5d9c287d-f627-49f9-82a8-69214b364b38 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:50.742141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-69cabb77-2907-4a01-8034-250dc17d3931 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:50.755078 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-69cabb77-2907-4a01-8034-250dc17d3931 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1506 microversion: 2.1 time: 0.289591 Jul 26 14:43:50.768598 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2609/5343] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:50 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:50.833300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5d9c287d-f627-49f9-82a8-69214b364b38 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:50.845553 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5d9c287d-f627-49f9-82a8-69214b364b38 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1251 microversion: 2.1 time: 0.242651 Jul 26 14:43:50.861577 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2735/5344] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:50 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1251 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:51.637642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-89316abc-56da-4d6c-adc8-7cbd4a710a9b tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:51.638452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-89316abc-56da-4d6c-adc8-7cbd4a710a9b tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:51.652262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89316abc-56da-4d6c-adc8-7cbd4a710a9b tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:51.652849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89316abc-56da-4d6c-adc8-7cbd4a710a9b tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:51.653763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89316abc-56da-4d6c-adc8-7cbd4a710a9b tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:51.654315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-89316abc-56da-4d6c-adc8-7cbd4a710a9b tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:51.703655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-89316abc-56da-4d6c-adc8-7cbd4a710a9b tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:43:51.752359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:51.797218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ce86f91c-cbdd-43ab-b3b8-237817de82b3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:51.798638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ce86f91c-cbdd-43ab-b3b8-237817de82b3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:51.827611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce86f91c-cbdd-43ab-b3b8-237817de82b3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:51.829152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce86f91c-cbdd-43ab-b3b8-237817de82b3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:51.832379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce86f91c-cbdd-43ab-b3b8-237817de82b3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:51.833259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce86f91c-cbdd-43ab-b3b8-237817de82b3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:51.890807 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-89316abc-56da-4d6c-adc8-7cbd4a710a9b tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 204 len: 0 microversion: 2.1 time: 0.256456 Jul 26 14:43:51.896789 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2610/5345] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:43:51 2022] DELETE /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:43:51.898342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55f78f56-d400-4cc5-a0cc-93d9aa1457e4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:51.903070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-55f78f56-d400-4cc5-a0cc-93d9aa1457e4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:51.907616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55f78f56-d400-4cc5-a0cc-93d9aa1457e4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:51.908212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55f78f56-d400-4cc5-a0cc-93d9aa1457e4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:51.909121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55f78f56-d400-4cc5-a0cc-93d9aa1457e4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:51.910392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55f78f56-d400-4cc5-a0cc-93d9aa1457e4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:52.057910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-55f78f56-d400-4cc5-a0cc-93d9aa1457e4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:52.072341 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-55f78f56-d400-4cc5-a0cc-93d9aa1457e4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1251 microversion: 2.1 time: 0.178591 Jul 26 14:43:52.073419 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2611/5346] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:51 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1251 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:52.081856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3ef944cd-df2d-45f0-a34f-316af7b1c498 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:52.089864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3ef944cd-df2d-45f0-a34f-316af7b1c498 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:52.118488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ef944cd-df2d-45f0-a34f-316af7b1c498 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:52.129898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ef944cd-df2d-45f0-a34f-316af7b1c498 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:52.131410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ef944cd-df2d-45f0-a34f-316af7b1c498 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:52.131979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ef944cd-df2d-45f0-a34f-316af7b1c498 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:52.417579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ce86f91c-cbdd-43ab-b3b8-237817de82b3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:52.429575 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ce86f91c-cbdd-43ab-b3b8-237817de82b3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1506 microversion: 2.1 time: 0.654269 Jul 26 14:43:52.430571 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2736/5347] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:51 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1506 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:52.460851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3ef944cd-df2d-45f0-a34f-316af7b1c498 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:52.469514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3ef944cd-df2d-45f0-a34f-316af7b1c498 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1516 microversion: 2.1 time: 0.394790 Jul 26 14:43:52.470777 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2612/5348] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:52 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1516 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:53.111735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9ff3f3a9-3e27-43e2-9e7a-7015e3bc3f90 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:53.113806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9ff3f3a9-3e27-43e2-9e7a-7015e3bc3f90 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:53.124489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ff3f3a9-3e27-43e2-9e7a-7015e3bc3f90 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:53.126126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ff3f3a9-3e27-43e2-9e7a-7015e3bc3f90 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:53.127216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ff3f3a9-3e27-43e2-9e7a-7015e3bc3f90 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:53.129006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ff3f3a9-3e27-43e2-9e7a-7015e3bc3f90 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:53.249970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ff3f3a9-3e27-43e2-9e7a-7015e3bc3f90 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:53.266876 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9ff3f3a9-3e27-43e2-9e7a-7015e3bc3f90 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1251 microversion: 2.1 time: 0.159749 Jul 26 14:43:53.268474 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2737/5349] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:53 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1251 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:53.466939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3a350bce-b962-450f-bf86-b8901f4b1689 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:53.476572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3a350bce-b962-450f-bf86-b8901f4b1689 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:53.513639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b916abd7-baac-4168-be06-283fab8fc324 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:53.514874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b916abd7-baac-4168-be06-283fab8fc324 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:53.525748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b916abd7-baac-4168-be06-283fab8fc324 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:53.526533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b916abd7-baac-4168-be06-283fab8fc324 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:53.527745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b916abd7-baac-4168-be06-283fab8fc324 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:53.528434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b916abd7-baac-4168-be06-283fab8fc324 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:53.546235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a350bce-b962-450f-bf86-b8901f4b1689 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:53.548322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a350bce-b962-450f-bf86-b8901f4b1689 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:53.553657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a350bce-b962-450f-bf86-b8901f4b1689 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:53.555027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a350bce-b962-450f-bf86-b8901f4b1689 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:53.571318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:54.194257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b916abd7-baac-4168-be06-283fab8fc324 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:54.213853 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b916abd7-baac-4168-be06-283fab8fc324 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1470 microversion: 2.1 time: 0.705897 Jul 26 14:43:54.214095 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2738/5350] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:53 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1470 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:54.291341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-565d004b-a79a-451d-9f48-7f75e11e1162 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:54.292399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-565d004b-a79a-451d-9f48-7f75e11e1162 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:54.302012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-565d004b-a79a-451d-9f48-7f75e11e1162 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:54.303254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-565d004b-a79a-451d-9f48-7f75e11e1162 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:54.304608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-565d004b-a79a-451d-9f48-7f75e11e1162 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:54.305348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-565d004b-a79a-451d-9f48-7f75e11e1162 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:54.650644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3a350bce-b962-450f-bf86-b8901f4b1689 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:54.682611 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3a350bce-b962-450f-bf86-b8901f4b1689 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1506 microversion: 2.1 time: 1.221659 Jul 26 14:43:54.685169 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2613/5351] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:53 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1506 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:54.731543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-565d004b-a79a-451d-9f48-7f75e11e1162 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:54.755767 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-565d004b-a79a-451d-9f48-7f75e11e1162 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1243 microversion: 2.1 time: 0.468880 Jul 26 14:43:54.758499 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2739/5352] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:54 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1243 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:55.261453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-086773b1-fd0f-41c4-a036-38733fd1bf92 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:55.262625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-086773b1-fd0f-41c4-a036-38733fd1bf92 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:55.308656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086773b1-fd0f-41c4-a036-38733fd1bf92 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:55.309123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086773b1-fd0f-41c4-a036-38733fd1bf92 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:55.309963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086773b1-fd0f-41c4-a036-38733fd1bf92 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:55.310554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086773b1-fd0f-41c4-a036-38733fd1bf92 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:55.717281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7f216d05-05fa-4d11-887e-759a577968af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:55.718140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7f216d05-05fa-4d11-887e-759a577968af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:55.730224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f216d05-05fa-4d11-887e-759a577968af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:55.731020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f216d05-05fa-4d11-887e-759a577968af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:55.732078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f216d05-05fa-4d11-887e-759a577968af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:55.732714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f216d05-05fa-4d11-887e-759a577968af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:55.745920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-086773b1-fd0f-41c4-a036-38733fd1bf92 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:55.776895 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-086773b1-fd0f-41c4-a036-38733fd1bf92 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1470 microversion: 2.1 time: 0.537085 Jul 26 14:43:55.792988 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2614/5353] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:55 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1470 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:55.814288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d075f78e-f0cb-4f5f-8620-7dcac849f45a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:55.816354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d075f78e-f0cb-4f5f-8620-7dcac849f45a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:55.843760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d075f78e-f0cb-4f5f-8620-7dcac849f45a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:55.844716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d075f78e-f0cb-4f5f-8620-7dcac849f45a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:55.845812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d075f78e-f0cb-4f5f-8620-7dcac849f45a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:55.850784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d075f78e-f0cb-4f5f-8620-7dcac849f45a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:56.012607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d075f78e-f0cb-4f5f-8620-7dcac849f45a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:56.027038 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d075f78e-f0cb-4f5f-8620-7dcac849f45a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1243 microversion: 2.1 time: 0.227503 Jul 26 14:43:56.041064 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2615/5354] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:55 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1243 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:56.182304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7f216d05-05fa-4d11-887e-759a577968af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:56.192274 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7f216d05-05fa-4d11-887e-759a577968af tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1514 microversion: 2.1 time: 0.480696 Jul 26 14:43:56.194394 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2740/5355] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:55 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1514 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:56.808228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-763366dd-30e1-481a-ab00-3041586704ac tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:56.810561 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-763366dd-30e1-481a-ab00-3041586704ac tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:56.833295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-763366dd-30e1-481a-ab00-3041586704ac tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:56.834395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-763366dd-30e1-481a-ab00-3041586704ac tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:56.851583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-763366dd-30e1-481a-ab00-3041586704ac tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:56.854215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-763366dd-30e1-481a-ab00-3041586704ac tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:57.055393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e81be4f8-d944-495d-85cd-36b6e14d9403 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:57.057141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e81be4f8-d944-495d-85cd-36b6e14d9403 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:57.073700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e81be4f8-d944-495d-85cd-36b6e14d9403 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:57.074312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e81be4f8-d944-495d-85cd-36b6e14d9403 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:57.075223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e81be4f8-d944-495d-85cd-36b6e14d9403 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:57.076080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e81be4f8-d944-495d-85cd-36b6e14d9403 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:57.422821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e81be4f8-d944-495d-85cd-36b6e14d9403 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:57.449255 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e81be4f8-d944-495d-85cd-36b6e14d9403 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1299 microversion: 2.1 time: 0.400771 Jul 26 14:43:57.454309 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2741/5356] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:57 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1299 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:57.688776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-763366dd-30e1-481a-ab00-3041586704ac tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:57.704449 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-763366dd-30e1-481a-ab00-3041586704ac tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1470 microversion: 2.1 time: 0.904498 Jul 26 14:43:57.707315 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2616/5357] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:56 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1470 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:43:58.479570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1d99354c-935f-4b32-8d0c-d2a2538c7e34 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:58.483587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1d99354c-935f-4b32-8d0c-d2a2538c7e34 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:58.488226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:58.502344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d99354c-935f-4b32-8d0c-d2a2538c7e34 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:58.503781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d99354c-935f-4b32-8d0c-d2a2538c7e34 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:58.509069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d99354c-935f-4b32-8d0c-d2a2538c7e34 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:58.509069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d99354c-935f-4b32-8d0c-d2a2538c7e34 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:58.702214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1d99354c-935f-4b32-8d0c-d2a2538c7e34 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:58.722351 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1d99354c-935f-4b32-8d0c-d2a2538c7e34 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1305 microversion: 2.1 time: 0.246494 Jul 26 14:43:58.723258 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2742/5358] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:58 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1305 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:58.729234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8039ecc9-2a4e-4057-aa15-73560e81be14 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:58.730355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8039ecc9-2a4e-4057-aa15-73560e81be14 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:58.738804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:58.739534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:58.747692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8039ecc9-2a4e-4057-aa15-73560e81be14 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:58.771594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8039ecc9-2a4e-4057-aa15-73560e81be14 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:58.773369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8039ecc9-2a4e-4057-aa15-73560e81be14 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:58.777998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8039ecc9-2a4e-4057-aa15-73560e81be14 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:58.866868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f126072b-f157-4301-94d5-5911a94cb707 req-c2da11c9-443b-4d43-a044-3d4881cdc0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358b56fe-a34a-4182-8b74-b97c49efb388", "name": "network-vif-deleted", "tag": "3bc61f27-8089-493a-a8cb-889c33e83641"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:58.884450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=50 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:58.886426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f126072b-f157-4301-94d5-5911a94cb707 req-c2da11c9-443b-4d43-a044-3d4881cdc0b8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:58.887258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f126072b-f157-4301-94d5-5911a94cb707 req-c2da11c9-443b-4d43-a044-3d4881cdc0b8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:58.922932 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f126072b-f157-4301-94d5-5911a94cb707 req-c2da11c9-443b-4d43-a044-3d4881cdc0b8 service nova] Creating event network-vif-deleted:3bc61f27-8089-493a-a8cb-889c33e83641 for instance 358b56fe-a34a-4182-8b74-b97c49efb388 on n-h2-833090-9 Jul 26 14:43:58.930580 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f126072b-f157-4301-94d5-5911a94cb707 req-c2da11c9-443b-4d43-a044-3d4881cdc0b8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069219 Jul 26 14:43:58.942459 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2743/5359] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:43:58.974612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8039ecc9-2a4e-4057-aa15-73560e81be14 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd393019e0a27411aad2c41054ee6fad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93f32991ab554926859439915923a80f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:43:58.989999 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8039ecc9-2a4e-4057-aa15-73560e81be14 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 200 len: 1428 microversion: 2.1 time: 0.265415 Jul 26 14:43:58.991851 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2617/5360] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:58 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 1428 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:59.312454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d3abdca2-0c8f-4233-83d1-1e6327469bdb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:59.314977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d3abdca2-0c8f-4233-83d1-1e6327469bdb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:59.327580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3abdca2-0c8f-4233-83d1-1e6327469bdb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:59.328170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3abdca2-0c8f-4233-83d1-1e6327469bdb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:59.329578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3abdca2-0c8f-4233-83d1-1e6327469bdb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:59.330313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d3abdca2-0c8f-4233-83d1-1e6327469bdb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:59.395466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-d3abdca2-0c8f-4233-83d1-1e6327469bdb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lazy-loading 'flavor' on Instance uuid aae76411-a3af-4e21-a827-39d6ae08c182 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:43:59.573575 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d3abdca2-0c8f-4233-83d1-1e6327469bdb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action" status: 200 len: 32 microversion: 2.1 time: 0.262552 Jul 26 14:43:59.574936 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2744/5361] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:43:59 2022] POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action => generated 32 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 14:43:59.592131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9f411803-0bfb-4fdb-9f99-aa76dfd0f05c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:59.604386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9f411803-0bfb-4fdb-9f99-aa76dfd0f05c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:59.632295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f411803-0bfb-4fdb-9f99-aa76dfd0f05c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:59.636508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f411803-0bfb-4fdb-9f99-aa76dfd0f05c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:59.640134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f411803-0bfb-4fdb-9f99-aa76dfd0f05c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:59.640797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f411803-0bfb-4fdb-9f99-aa76dfd0f05c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:59.746990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-52178288-a4fb-432f-986a-45f009b84846 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:59.747889 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-52178288-a4fb-432f-986a-45f009b84846 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:43:59.760126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52178288-a4fb-432f-986a-45f009b84846 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:59.765736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52178288-a4fb-432f-986a-45f009b84846 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:43:59.766881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52178288-a4fb-432f-986a-45f009b84846 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:43:59.778480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-52178288-a4fb-432f-986a-45f009b84846 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:00.333462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9f411803-0bfb-4fdb-9f99-aa76dfd0f05c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:00.348119 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9f411803-0bfb-4fdb-9f99-aa76dfd0f05c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.760439 Jul 26 14:44:00.350913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-52178288-a4fb-432f-986a-45f009b84846 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:00.351090 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2618/5362] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:59 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:00.360876 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-52178288-a4fb-432f-986a-45f009b84846 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1372 microversion: 2.1 time: 0.619208 Jul 26 14:44:00.363430 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2745/5363] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:43:59 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1372 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:00.384926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c2fbab7f-2912-4803-98d2-4537c034ac34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:00.388509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c2fbab7f-2912-4803-98d2-4537c034ac34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] [instance: 358b56fe-a34a-4182-8b74-b97c49efb388] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:00.432842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c2fbab7f-2912-4803-98d2-4537c034ac34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:00.433380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c2fbab7f-2912-4803-98d2-4537c034ac34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:00.434426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c2fbab7f-2912-4803-98d2-4537c034ac34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:00.435911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c2fbab7f-2912-4803-98d2-4537c034ac34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:00.468567 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c2fbab7f-2912-4803-98d2-4537c034ac34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] HTTP exception thrown: Instance 358b56fe-a34a-4182-8b74-b97c49efb388 could not be found. Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c2fbab7f-2912-4803-98d2-4537c034ac34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Request method failure captured: Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 HTTP/1.1 Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_zmHptNJpexpwO4dJ8sfI78J7Fz18mGahUELeU4SpF4aSGrCUpH4Yq0oz_e0RLTVhHiCul9vRngTLqveVFK1sCNEeQDVtCAxEPHWUCFWQO_d_BMEfTYUandaocriX44SJNzhQK5rULQFTAv2YGCoGvJkGoVKFS5b1fJCpXFF3J5L0o Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 93f32991ab554926859439915923a80f Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-VolumesBackupsTest-1230676899 Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/93f32991ab554926859439915923a80f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/93f32991ab554926859439915923a80f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_93f32991ab554926859439915923a80f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/93f32991ab554926859439915923a80f"}]}] Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-VolumesBackupsTest-1230676899 Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 93f32991ab554926859439915923a80f Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-VolumesBackupsTest-1230676899 Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-VolumesBackupsTest-1230676899-project Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: d393019e0a27411aad2c41054ee6fad1 Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-VolumesBackupsTest-1230676899-project Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 358b56fe-a34a-4182-8b74-b97c49efb388 could not be found. Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '358b56fe-a34a-4182-8b74-b97c49efb388'} Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 358b56fe-a34a-4182-8b74-b97c49efb388 could not be found. Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 358b56fe-a34a-4182-8b74-b97c49efb388 could not be found. Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:00.476418 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:44:00.481760 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:00.481760 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:00.481760 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:00.481760 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:44:00.481760 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:44:00.481760 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 358b56fe-a34a-4182-8b74-b97c49efb388 could not be found. Jul 26 14:44:00.481760 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:44:00.481760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c2fbab7f-2912-4803-98d2-4537c034ac34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] Returning 404 to user: Instance 358b56fe-a34a-4182-8b74-b97c49efb388 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:44:00.481760 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c2fbab7f-2912-4803-98d2-4537c034ac34 tempest-VolumesBackupsTest-1230676899 tempest-VolumesBackupsTest-1230676899-project] 10.222.0.70 "GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388" status: 404 len: 111 microversion: 2.1 time: 0.121944 Jul 26 14:44:00.481760 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2619/5364] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:00 2022] GET /compute/v2.1/servers/358b56fe-a34a-4182-8b74-b97c49efb388 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:44:01.381031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a5347b06-69f2-44d9-9ae4-75033df2c71b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:01.382431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a5347b06-69f2-44d9-9ae4-75033df2c71b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:01.392645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5347b06-69f2-44d9-9ae4-75033df2c71b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:01.518062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5347b06-69f2-44d9-9ae4-75033df2c71b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:01.650498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6fb7d230-4c72-45ad-b48d-41800b85cea1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:01.650498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6fb7d230-4c72-45ad-b48d-41800b85cea1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:01.650498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:01.653370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5347b06-69f2-44d9-9ae4-75033df2c71b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:01.653370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a5347b06-69f2-44d9-9ae4-75033df2c71b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:01.653942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6fb7d230-4c72-45ad-b48d-41800b85cea1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:01.653942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6fb7d230-4c72-45ad-b48d-41800b85cea1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:01.653942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6fb7d230-4c72-45ad-b48d-41800b85cea1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:01.653942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6fb7d230-4c72-45ad-b48d-41800b85cea1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:02.342688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a5347b06-69f2-44d9-9ae4-75033df2c71b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:02.355538 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a5347b06-69f2-44d9-9ae4-75033df2c71b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.982115 Jul 26 14:44:02.358427 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2746/5365] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:01 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:02.507025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6fb7d230-4c72-45ad-b48d-41800b85cea1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:02.521088 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6fb7d230-4c72-45ad-b48d-41800b85cea1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1372 microversion: 2.1 time: 1.125843 Jul 26 14:44:02.522226 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2620/5366] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:01 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1372 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:03.107180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4eab01eb-e3a7-4a65-b390-59ec95d54c37 req-709b9973-91ae-4a50-8827-706f31c544a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd4ea991-3f52-4e13-a1fa-eebad7166577", "tag": "a6d67ae6-7bc4-4ab6-a09c-34ea992b22f0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:03.122954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4eab01eb-e3a7-4a65-b390-59ec95d54c37 req-709b9973-91ae-4a50-8827-706f31c544a8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:03.124379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4eab01eb-e3a7-4a65-b390-59ec95d54c37 req-709b9973-91ae-4a50-8827-706f31c544a8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:03.142248 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4eab01eb-e3a7-4a65-b390-59ec95d54c37 req-709b9973-91ae-4a50-8827-706f31c544a8 service nova] Creating event network-changed:a6d67ae6-7bc4-4ab6-a09c-34ea992b22f0 for instance bd4ea991-3f52-4e13-a1fa-eebad7166577 on n-h2-833090-9 Jul 26 14:44:03.156486 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4eab01eb-e3a7-4a65-b390-59ec95d54c37 req-709b9973-91ae-4a50-8827-706f31c544a8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056356 Jul 26 14:44:03.160766 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2747/5367] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:03.387363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-91a6e059-2852-4cc1-be47-c804991884c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:03.388135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-91a6e059-2852-4cc1-be47-c804991884c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:03.458230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91a6e059-2852-4cc1-be47-c804991884c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:03.469393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91a6e059-2852-4cc1-be47-c804991884c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:03.471041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91a6e059-2852-4cc1-be47-c804991884c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:03.473403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91a6e059-2852-4cc1-be47-c804991884c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:03.544563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-61b88615-1df1-43bc-ae16-25f39d63b4a4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:03.545674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-61b88615-1df1-43bc-ae16-25f39d63b4a4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:03.556943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61b88615-1df1-43bc-ae16-25f39d63b4a4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:03.560613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61b88615-1df1-43bc-ae16-25f39d63b4a4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:03.563892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61b88615-1df1-43bc-ae16-25f39d63b4a4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:03.564572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61b88615-1df1-43bc-ae16-25f39d63b4a4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:04.278268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-91a6e059-2852-4cc1-be47-c804991884c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:04.288229 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-91a6e059-2852-4cc1-be47-c804991884c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.907250 Jul 26 14:44:04.295684 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2621/5368] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:03 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:04.316371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-61b88615-1df1-43bc-ae16-25f39d63b4a4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:04.340142 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-61b88615-1df1-43bc-ae16-25f39d63b4a4 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1372 microversion: 2.1 time: 0.800566 Jul 26 14:44:04.356929 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2748/5369] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:03 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1372 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:05.336273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9823138-4983-4a37-9df1-8d0018522a28 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:05.337052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d9823138-4983-4a37-9df1-8d0018522a28 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:05.349599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9823138-4983-4a37-9df1-8d0018522a28 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:05.350787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9823138-4983-4a37-9df1-8d0018522a28 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:05.354341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9823138-4983-4a37-9df1-8d0018522a28 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:05.355384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9823138-4983-4a37-9df1-8d0018522a28 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:05.368414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-239252f1-4d11-426c-8358-235c1a2712ca tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:05.369059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-239252f1-4d11-426c-8358-235c1a2712ca tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:05.383574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-239252f1-4d11-426c-8358-235c1a2712ca tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:05.387655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-239252f1-4d11-426c-8358-235c1a2712ca tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:05.397177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-239252f1-4d11-426c-8358-235c1a2712ca tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:05.412715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-239252f1-4d11-426c-8358-235c1a2712ca tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:05.825058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d9823138-4983-4a37-9df1-8d0018522a28 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:05.841354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-239252f1-4d11-426c-8358-235c1a2712ca tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:05.850456 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d9823138-4983-4a37-9df1-8d0018522a28 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.523910 Jul 26 14:44:05.855011 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2622/5370] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:05 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:05.858963 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-239252f1-4d11-426c-8358-235c1a2712ca tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1372 microversion: 2.1 time: 0.496854 Jul 26 14:44:05.890222 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2749/5371] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:05 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1372 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:06.876412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-db399506-2a94-4d9b-a4ab-0f78f31964b6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:06.877169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-db399506-2a94-4d9b-a4ab-0f78f31964b6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:06.888388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db399506-2a94-4d9b-a4ab-0f78f31964b6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:06.891703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db399506-2a94-4d9b-a4ab-0f78f31964b6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:06.897180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db399506-2a94-4d9b-a4ab-0f78f31964b6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:06.897837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-db399506-2a94-4d9b-a4ab-0f78f31964b6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:06.900331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ff46185-bc9e-4549-b676-1147f9c24fd8 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:06.901109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1ff46185-bc9e-4549-b676-1147f9c24fd8 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:06.919223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ff46185-bc9e-4549-b676-1147f9c24fd8 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:06.922689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ff46185-bc9e-4549-b676-1147f9c24fd8 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:06.923886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ff46185-bc9e-4549-b676-1147f9c24fd8 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:06.925053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ff46185-bc9e-4549-b676-1147f9c24fd8 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:07.267055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-db399506-2a94-4d9b-a4ab-0f78f31964b6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:07.280514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-db399506-2a94-4d9b-a4ab-0f78f31964b6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.407623 Jul 26 14:44:07.296812 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2623/5372] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:06 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:07.325277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ff46185-bc9e-4549-b676-1147f9c24fd8 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:07.338423 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ff46185-bc9e-4549-b676-1147f9c24fd8 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1372 microversion: 2.1 time: 0.444598 Jul 26 14:44:07.339134 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2750/5373] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:06 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1372 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:08.307523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-101fb207-3546-4fdb-93bd-93993f3332fa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:08.309045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-101fb207-3546-4fdb-93bd-93993f3332fa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:08.321842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-101fb207-3546-4fdb-93bd-93993f3332fa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:08.324943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-101fb207-3546-4fdb-93bd-93993f3332fa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:08.330470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-101fb207-3546-4fdb-93bd-93993f3332fa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:08.331219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-101fb207-3546-4fdb-93bd-93993f3332fa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:08.366209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ffd13778-db6e-417f-b2b0-bb59aa5a0993 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:08.367485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ffd13778-db6e-417f-b2b0-bb59aa5a0993 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:08.394761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffd13778-db6e-417f-b2b0-bb59aa5a0993 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:08.395245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffd13778-db6e-417f-b2b0-bb59aa5a0993 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:08.404418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffd13778-db6e-417f-b2b0-bb59aa5a0993 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:08.406995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffd13778-db6e-417f-b2b0-bb59aa5a0993 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:08.908451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-101fb207-3546-4fdb-93bd-93993f3332fa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:08.936993 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-101fb207-3546-4fdb-93bd-93993f3332fa tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.630553 Jul 26 14:44:08.952910 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2624/5374] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:08 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:08.998683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ffd13778-db6e-417f-b2b0-bb59aa5a0993 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:09.014736 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ffd13778-db6e-417f-b2b0-bb59aa5a0993 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1372 microversion: 2.1 time: 0.652970 Jul 26 14:44:09.015995 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2751/5375] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:08 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1372 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:09.965640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aca95b80-d0f2-481e-b4e4-98ef5a899609 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:09.966274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aca95b80-d0f2-481e-b4e4-98ef5a899609 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:09.992268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aca95b80-d0f2-481e-b4e4-98ef5a899609 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:09.992674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aca95b80-d0f2-481e-b4e4-98ef5a899609 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:09.993525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aca95b80-d0f2-481e-b4e4-98ef5a899609 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:09.993973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aca95b80-d0f2-481e-b4e4-98ef5a899609 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:10.048558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4089aacd-0362-40cf-a049-5d4512a36cc0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:10.050663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4089aacd-0362-40cf-a049-5d4512a36cc0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:10.073085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4089aacd-0362-40cf-a049-5d4512a36cc0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:10.075789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4089aacd-0362-40cf-a049-5d4512a36cc0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:10.077004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4089aacd-0362-40cf-a049-5d4512a36cc0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:10.079458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4089aacd-0362-40cf-a049-5d4512a36cc0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:10.381194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aca95b80-d0f2-481e-b4e4-98ef5a899609 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:10.389708 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aca95b80-d0f2-481e-b4e4-98ef5a899609 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.430935 Jul 26 14:44:10.404794 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2625/5376] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:09 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:10.450723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4089aacd-0362-40cf-a049-5d4512a36cc0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:10.463863 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4089aacd-0362-40cf-a049-5d4512a36cc0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1372 microversion: 2.1 time: 0.427612 Jul 26 14:44:10.475975 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2752/5377] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:10 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1372 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:10.483209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-04a2cf32-cd41-4723-a61f-9fab9fb17d34 req-8b7d5e6b-0433-4c11-9553-5f1a6d02899c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd4ea991-3f52-4e13-a1fa-eebad7166577", "name": "network-vif-plugged", "status": "completed", "tag": "a6d67ae6-7bc4-4ab6-a09c-34ea992b22f0"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:10.494589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-04a2cf32-cd41-4723-a61f-9fab9fb17d34 req-8b7d5e6b-0433-4c11-9553-5f1a6d02899c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:10.495108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-04a2cf32-cd41-4723-a61f-9fab9fb17d34 req-8b7d5e6b-0433-4c11-9553-5f1a6d02899c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:10.508793 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-04a2cf32-cd41-4723-a61f-9fab9fb17d34 req-8b7d5e6b-0433-4c11-9553-5f1a6d02899c service nova] Creating event network-vif-plugged:a6d67ae6-7bc4-4ab6-a09c-34ea992b22f0 for instance bd4ea991-3f52-4e13-a1fa-eebad7166577 on n-h2-833090-9 Jul 26 14:44:10.515784 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-04a2cf32-cd41-4723-a61f-9fab9fb17d34 req-8b7d5e6b-0433-4c11-9553-5f1a6d02899c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035447 Jul 26 14:44:10.516646 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2626/5378] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:11.418666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af8ff517-3733-462d-988d-c5bde07ede0e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:11.423200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af8ff517-3733-462d-988d-c5bde07ede0e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:11.441861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8ff517-3733-462d-988d-c5bde07ede0e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:11.442515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8ff517-3733-462d-988d-c5bde07ede0e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:11.450373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8ff517-3733-462d-988d-c5bde07ede0e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:11.457834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8ff517-3733-462d-988d-c5bde07ede0e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:11.490476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6a6acd52-0787-41b9-a9e9-da4368e5d52b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:11.491842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6a6acd52-0787-41b9-a9e9-da4368e5d52b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:11.515045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a6acd52-0787-41b9-a9e9-da4368e5d52b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:11.523487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a6acd52-0787-41b9-a9e9-da4368e5d52b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:11.528255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a6acd52-0787-41b9-a9e9-da4368e5d52b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:11.528255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a6acd52-0787-41b9-a9e9-da4368e5d52b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:11.611418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:12.162817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6a6acd52-0787-41b9-a9e9-da4368e5d52b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:12.179804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6a6acd52-0787-41b9-a9e9-da4368e5d52b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1372 microversion: 2.1 time: 0.696259 Jul 26 14:44:12.180456 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2627/5379] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:11 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1372 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:12.208903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af8ff517-3733-462d-988d-c5bde07ede0e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:12.221059 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af8ff517-3733-462d-988d-c5bde07ede0e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.810292 Jul 26 14:44:12.236129 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2753/5380] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:11 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:13.220720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4758bb85-61ec-4eef-9b9a-4c0440fb268a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:13.221389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4758bb85-61ec-4eef-9b9a-4c0440fb268a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:13.233078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4758bb85-61ec-4eef-9b9a-4c0440fb268a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:13.233989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4758bb85-61ec-4eef-9b9a-4c0440fb268a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:13.235004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4758bb85-61ec-4eef-9b9a-4c0440fb268a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:13.235646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4758bb85-61ec-4eef-9b9a-4c0440fb268a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:13.248122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8cd6d8fb-e464-4815-84b3-c1e9aa6a6234 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:13.248821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8cd6d8fb-e464-4815-84b3-c1e9aa6a6234 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:13.265860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cd6d8fb-e464-4815-84b3-c1e9aa6a6234 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:13.267007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cd6d8fb-e464-4815-84b3-c1e9aa6a6234 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:13.268545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cd6d8fb-e464-4815-84b3-c1e9aa6a6234 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:13.269721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8cd6d8fb-e464-4815-84b3-c1e9aa6a6234 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:13.301413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:13.646734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4758bb85-61ec-4eef-9b9a-4c0440fb268a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:13.657827 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4758bb85-61ec-4eef-9b9a-4c0440fb268a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1544 microversion: 2.1 time: 0.443501 Jul 26 14:44:13.669832 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2628/5381] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:13 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1544 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:13.684667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-16c9a11f-d096-450f-aea1-dde7692a4d14 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:13.685524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-16c9a11f-d096-450f-aea1-dde7692a4d14 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:13.696126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16c9a11f-d096-450f-aea1-dde7692a4d14 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:13.696819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16c9a11f-d096-450f-aea1-dde7692a4d14 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:13.697845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16c9a11f-d096-450f-aea1-dde7692a4d14 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:13.698543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16c9a11f-d096-450f-aea1-dde7692a4d14 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:13.714511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8cd6d8fb-e464-4815-84b3-c1e9aa6a6234 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:13.725145 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8cd6d8fb-e464-4815-84b3-c1e9aa6a6234 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.481606 Jul 26 14:44:13.740000 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2754/5382] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:13 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:13.943190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-16c9a11f-d096-450f-aea1-dde7692a4d14 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:13.962397 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-16c9a11f-d096-450f-aea1-dde7692a4d14 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1544 microversion: 2.1 time: 0.283489 Jul 26 14:44:13.963095 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2629/5383] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:13 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1544 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:14.755965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71a73cf7-bc80-437e-850d-17e20a14d8f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:14.757881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71a73cf7-bc80-437e-850d-17e20a14d8f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:14.772609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71a73cf7-bc80-437e-850d-17e20a14d8f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:14.774944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71a73cf7-bc80-437e-850d-17e20a14d8f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:14.777436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71a73cf7-bc80-437e-850d-17e20a14d8f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:14.779883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71a73cf7-bc80-437e-850d-17e20a14d8f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:14.787263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6c5e5d6d-2ecc-404d-82cc-44931d504a2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:14.797227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6c5e5d6d-2ecc-404d-82cc-44931d504a2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:14.826413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c5e5d6d-2ecc-404d-82cc-44931d504a2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:14.828222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c5e5d6d-2ecc-404d-82cc-44931d504a2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:14.829114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c5e5d6d-2ecc-404d-82cc-44931d504a2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:14.829612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c5e5d6d-2ecc-404d-82cc-44931d504a2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:15.007831 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6c5e5d6d-2ecc-404d-82cc-44931d504a2e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63/action" status: 200 len: 63134 microversion: 2.1 time: 0.236592 Jul 26 14:44:15.009339 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2630/5384] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:44:14 2022] POST /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63/action => generated 63134 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:44:15.193747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-71a73cf7-bc80-437e-850d-17e20a14d8f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:15.218892 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71a73cf7-bc80-437e-850d-17e20a14d8f1 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.473763 Jul 26 14:44:15.240724 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2755/5385] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:14 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:16.250245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-70b5b1d9-9006-459f-88ee-08cb843e1e89 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:16.252244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-70b5b1d9-9006-459f-88ee-08cb843e1e89 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:16.304353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b5b1d9-9006-459f-88ee-08cb843e1e89 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:16.321862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b5b1d9-9006-459f-88ee-08cb843e1e89 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:16.323536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b5b1d9-9006-459f-88ee-08cb843e1e89 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:16.328221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-70b5b1d9-9006-459f-88ee-08cb843e1e89 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:16.667437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-70b5b1d9-9006-459f-88ee-08cb843e1e89 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:16.682318 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-70b5b1d9-9006-459f-88ee-08cb843e1e89 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.440254 Jul 26 14:44:16.685742 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2631/5386] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:16 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:17.720463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a8d355bc-fb55-4cb9-9971-1fde3259ccf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:17.723274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a8d355bc-fb55-4cb9-9971-1fde3259ccf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:17.740938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8d355bc-fb55-4cb9-9971-1fde3259ccf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:17.741672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8d355bc-fb55-4cb9-9971-1fde3259ccf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:17.746399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8d355bc-fb55-4cb9-9971-1fde3259ccf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:17.747186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a8d355bc-fb55-4cb9-9971-1fde3259ccf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:18.074294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a8d355bc-fb55-4cb9-9971-1fde3259ccf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:18.103807 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a8d355bc-fb55-4cb9-9971-1fde3259ccf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.395152 Jul 26 14:44:18.135851 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2756/5387] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:17 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:18.539237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-71e536c2-5018-42f4-8be9-e57518d0b45b req-2592d7cb-cb06-4574-b4bb-a07b45528125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd4ea991-3f52-4e13-a1fa-eebad7166577", "tag": "a6d67ae6-7bc4-4ab6-a09c-34ea992b22f0"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:18.560552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-71e536c2-5018-42f4-8be9-e57518d0b45b req-2592d7cb-cb06-4574-b4bb-a07b45528125 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:18.560932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-71e536c2-5018-42f4-8be9-e57518d0b45b req-2592d7cb-cb06-4574-b4bb-a07b45528125 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:18.603578 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-71e536c2-5018-42f4-8be9-e57518d0b45b req-2592d7cb-cb06-4574-b4bb-a07b45528125 service nova] Creating event network-changed:a6d67ae6-7bc4-4ab6-a09c-34ea992b22f0 for instance bd4ea991-3f52-4e13-a1fa-eebad7166577 on n-h2-833090-9 Jul 26 14:44:18.635253 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-71e536c2-5018-42f4-8be9-e57518d0b45b req-2592d7cb-cb06-4574-b4bb-a07b45528125 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.428595 Jul 26 14:44:18.637764 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2632/5388] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:19.145519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5815814-8a50-4f55-9542-b47d1561117d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:19.146481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d5815814-8a50-4f55-9542-b47d1561117d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:19.167598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5815814-8a50-4f55-9542-b47d1561117d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:19.170708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5815814-8a50-4f55-9542-b47d1561117d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:19.173136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5815814-8a50-4f55-9542-b47d1561117d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:19.176391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5815814-8a50-4f55-9542-b47d1561117d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:19.605771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d5815814-8a50-4f55-9542-b47d1561117d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:19.619624 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5815814-8a50-4f55-9542-b47d1561117d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.479972 Jul 26 14:44:19.621164 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2757/5389] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:19 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:20.647510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-371b7016-b4d0-499a-96a9-5c9df59d213b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:20.649149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-371b7016-b4d0-499a-96a9-5c9df59d213b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:20.680398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-371b7016-b4d0-499a-96a9-5c9df59d213b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:20.683181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-371b7016-b4d0-499a-96a9-5c9df59d213b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:20.686006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-371b7016-b4d0-499a-96a9-5c9df59d213b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:20.688149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-371b7016-b4d0-499a-96a9-5c9df59d213b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:21.015791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-371b7016-b4d0-499a-96a9-5c9df59d213b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:21.026058 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-371b7016-b4d0-499a-96a9-5c9df59d213b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.384331 Jul 26 14:44:21.035609 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2633/5390] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:20 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:22.058408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-93414c62-41eb-443c-8a7c-b08fc257b9bb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:22.059808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-93414c62-41eb-443c-8a7c-b08fc257b9bb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:22.075499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93414c62-41eb-443c-8a7c-b08fc257b9bb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:22.082707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93414c62-41eb-443c-8a7c-b08fc257b9bb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:22.084089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93414c62-41eb-443c-8a7c-b08fc257b9bb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:22.086593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93414c62-41eb-443c-8a7c-b08fc257b9bb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:22.391413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-93414c62-41eb-443c-8a7c-b08fc257b9bb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:22.403055 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-93414c62-41eb-443c-8a7c-b08fc257b9bb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.349142 Jul 26 14:44:22.405104 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2758/5391] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:22 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:23.435562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d3f090aa-7953-4895-b4a5-fd73eab3fa6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:23.436688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d3f090aa-7953-4895-b4a5-fd73eab3fa6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:23.477214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3f090aa-7953-4895-b4a5-fd73eab3fa6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:23.480391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3f090aa-7953-4895-b4a5-fd73eab3fa6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:23.487768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3f090aa-7953-4895-b4a5-fd73eab3fa6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:23.488741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3f090aa-7953-4895-b4a5-fd73eab3fa6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:23.871592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d3f090aa-7953-4895-b4a5-fd73eab3fa6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:23.885960 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d3f090aa-7953-4895-b4a5-fd73eab3fa6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1500 microversion: 2.1 time: 0.459414 Jul 26 14:44:23.887394 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2634/5392] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:23 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1500 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:23.912155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00e8e4d4-5050-439f-98d5-1c0d294cff49 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba0cdea7-cc7c-4693-abfa-9d28064b3103"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:23.914701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00e8e4d4-5050-439f-98d5-1c0d294cff49 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:23.935127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e8e4d4-5050-439f-98d5-1c0d294cff49 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:23.935988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e8e4d4-5050-439f-98d5-1c0d294cff49 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:23.937004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e8e4d4-5050-439f-98d5-1c0d294cff49 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:23.937655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e8e4d4-5050-439f-98d5-1c0d294cff49 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:23.992463 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-00e8e4d4-5050-439f-98d5-1c0d294cff49 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] HTTP exception thrown: Cannot 'attach_volume' instance aae76411-a3af-4e21-a827-39d6ae08c182 while it is in vm_state rescued Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00e8e4d4-5050-439f-98d5-1c0d294cff49 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Request method failure captured: Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/os-volume_attachments HTTP/1.1 Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 74 Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_1f6ZzJX0S01b_Op3EoMNcBZEG-kX6NKBmC9y8eYSEGGvW2IzzGDCwRHyopc8xJm4faZa9Jll31j2AyA8-1nj2TIW6-NxgVw70z941LrxxyqTc1krrtQixKuVoRbZbeVXl3oq2yJDnuG60YY3irOdy923OsfCXhYNJbHMgyTRh4Lb0 Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7386a23b259b4c4091637972951a3f0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}] Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ca1aaf9a4ab74a829ef94a7d54c683cd Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: {"volumeAttachment": {"volumeId": "ba0cdea7-cc7c-4693-abfa-9d28064b3103"}} Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: exception: Cannot 'attach_volume' instance aae76411-a3af-4e21-a827-39d6ae08c182 while it is in vm_state rescued Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'server_id': 'aae76411-a3af-4e21-a827-39d6ae08c182', 'body': {'volumeAttachment': {'volumeId': 'ba0cdea7-cc7c-4693-abfa-9d28064b3103'}}} Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aae76411-a3af-4e21-a827-39d6ae08c182 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 14:44:24.005744 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance aae76411-a3af-4e21-a827-39d6ae08c182 while it is in vm_state rescued Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance aae76411-a3af-4e21-a827-39d6ae08c182 while it is in vm_state rescued Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00e8e4d4-5050-439f-98d5-1c0d294cff49 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Returning 409 to user: Cannot 'attach_volume' instance aae76411-a3af-4e21-a827-39d6ae08c182 while it is in vm_state rescued {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-00e8e4d4-5050-439f-98d5-1c0d294cff49 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.100354 Jul 26 14:44:24.013327 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2759/5393] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:44:23 2022] POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/os-volume_attachments => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:44:24.018829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-543d6a2a-9080-4e32-aa88-58cd477bb520 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:24.019360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-543d6a2a-9080-4e32-aa88-58cd477bb520 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:24.045417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-543d6a2a-9080-4e32-aa88-58cd477bb520 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:24.048261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-543d6a2a-9080-4e32-aa88-58cd477bb520 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:24.053592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-543d6a2a-9080-4e32-aa88-58cd477bb520 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:24.054424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-543d6a2a-9080-4e32-aa88-58cd477bb520 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:24.240259 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-543d6a2a-9080-4e32-aa88-58cd477bb520 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action" status: 202 len: 0 microversion: 2.1 time: 0.223155 Jul 26 14:44:24.241993 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2635/5394] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:44:24 2022] POST /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:44:24.253378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3184d6d3-c3d3-4710-a13b-16b7dc44d746 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:24.254031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3184d6d3-c3d3-4710-a13b-16b7dc44d746 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:24.261519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3184d6d3-c3d3-4710-a13b-16b7dc44d746 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:24.263017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3184d6d3-c3d3-4710-a13b-16b7dc44d746 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:24.263836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3184d6d3-c3d3-4710-a13b-16b7dc44d746 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:24.264326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3184d6d3-c3d3-4710-a13b-16b7dc44d746 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:24.780705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3184d6d3-c3d3-4710-a13b-16b7dc44d746 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:24.823189 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3184d6d3-c3d3-4710-a13b-16b7dc44d746 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1508 microversion: 2.1 time: 0.573772 Jul 26 14:44:24.827764 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2760/5395] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:24 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:25.855248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b53a6b31-5fb2-46fb-ad3a-f552d5e34e32 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:25.857648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b53a6b31-5fb2-46fb-ad3a-f552d5e34e32 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:25.887120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b53a6b31-5fb2-46fb-ad3a-f552d5e34e32 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:25.900785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b53a6b31-5fb2-46fb-ad3a-f552d5e34e32 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:25.902218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b53a6b31-5fb2-46fb-ad3a-f552d5e34e32 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:25.902902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b53a6b31-5fb2-46fb-ad3a-f552d5e34e32 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:26.304823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b53a6b31-5fb2-46fb-ad3a-f552d5e34e32 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:26.329048 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b53a6b31-5fb2-46fb-ad3a-f552d5e34e32 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1508 microversion: 2.1 time: 0.482907 Jul 26 14:44:26.330089 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2636/5396] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:25 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1508 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:26.685424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7fc62faa-5e8e-4bc8-841a-c4102a96497c tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:26.688385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7fc62faa-5e8e-4bc8-841a-c4102a96497c tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:26.707771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fc62faa-5e8e-4bc8-841a-c4102a96497c tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:26.708812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fc62faa-5e8e-4bc8-841a-c4102a96497c tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:26.711540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fc62faa-5e8e-4bc8-841a-c4102a96497c tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:26.712250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fc62faa-5e8e-4bc8-841a-c4102a96497c tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:26.958539 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7fc62faa-5e8e-4bc8-841a-c4102a96497c tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1832 microversion: 2.1 time: 0.785062 Jul 26 14:44:26.959616 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2761/5397] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:26 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1832 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:27.371262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-270d1410-fe00-421d-b329-c7040244860b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:27.372663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-270d1410-fe00-421d-b329-c7040244860b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:27.403329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-270d1410-fe00-421d-b329-c7040244860b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:27.423995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-270d1410-fe00-421d-b329-c7040244860b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:27.429808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-270d1410-fe00-421d-b329-c7040244860b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:27.435467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-270d1410-fe00-421d-b329-c7040244860b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:27.838141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-270d1410-fe00-421d-b329-c7040244860b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:27.849614 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-270d1410-fe00-421d-b329-c7040244860b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1508 microversion: 2.1 time: 0.486248 Jul 26 14:44:27.850413 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2637/5398] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:27 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1508 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:28.889337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e763ff4e-0dcb-4736-ac61-329407e5274b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:28.890733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e763ff4e-0dcb-4736-ac61-329407e5274b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:28.910779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e763ff4e-0dcb-4736-ac61-329407e5274b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:28.911725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e763ff4e-0dcb-4736-ac61-329407e5274b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:28.914984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e763ff4e-0dcb-4736-ac61-329407e5274b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:28.917172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e763ff4e-0dcb-4736-ac61-329407e5274b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:29.219502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e763ff4e-0dcb-4736-ac61-329407e5274b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:29.233216 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e763ff4e-0dcb-4736-ac61-329407e5274b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1514 microversion: 2.1 time: 0.352210 Jul 26 14:44:29.236326 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2762/5399] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:28 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:29.321315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f741b817-3c48-45d0-bf79-88d9984d3b31 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:29.321828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f741b817-3c48-45d0-bf79-88d9984d3b31 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:29.331198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-38f066d3-d1c9-40b6-b77c-27fa9eb36042 req-0d77d2b0-54f3-4a75-a748-575307989f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:29.343696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=40 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:29.344585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f741b817-3c48-45d0-bf79-88d9984d3b31 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:29.345148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f741b817-3c48-45d0-bf79-88d9984d3b31 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:29.351184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f741b817-3c48-45d0-bf79-88d9984d3b31 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:29.351715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f741b817-3c48-45d0-bf79-88d9984d3b31 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:29.354484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-38f066d3-d1c9-40b6-b77c-27fa9eb36042 req-0d77d2b0-54f3-4a75-a748-575307989f8b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:29.355744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-38f066d3-d1c9-40b6-b77c-27fa9eb36042 req-0d77d2b0-54f3-4a75-a748-575307989f8b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:29.386282 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-38f066d3-d1c9-40b6-b77c-27fa9eb36042 req-0d77d2b0-54f3-4a75-a748-575307989f8b service nova] Creating event network-changed:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h2-833090-9 Jul 26 14:44:29.394338 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-38f066d3-d1c9-40b6-b77c-27fa9eb36042 req-0d77d2b0-54f3-4a75-a748-575307989f8b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069930 Jul 26 14:44:29.395296 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2763/5400] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:29.432903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f741b817-3c48-45d0-bf79-88d9984d3b31 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:44:29.654184 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f741b817-3c48-45d0-bf79-88d9984d3b31 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 204 len: 0 microversion: 2.1 time: 0.335125 Jul 26 14:44:29.657449 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2638/5401] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:44:29 2022] DELETE /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:44:29.678542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ede8f251-4136-4f37-b789-a5970f55db27 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:29.680947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ede8f251-4136-4f37-b789-a5970f55db27 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:29.726695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ede8f251-4136-4f37-b789-a5970f55db27 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:29.733195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ede8f251-4136-4f37-b789-a5970f55db27 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:29.739408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ede8f251-4136-4f37-b789-a5970f55db27 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:29.742393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ede8f251-4136-4f37-b789-a5970f55db27 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:30.164314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ede8f251-4136-4f37-b789-a5970f55db27 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:30.176170 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ede8f251-4136-4f37-b789-a5970f55db27 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1687 microversion: 2.1 time: 0.513032 Jul 26 14:44:30.177743 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2764/5402] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:29 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1687 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:31.216252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2623a527-97aa-4533-b96f-b4a60e409b5a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:31.217339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2623a527-97aa-4533-b96f-b4a60e409b5a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:31.243330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2623a527-97aa-4533-b96f-b4a60e409b5a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:31.247445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2623a527-97aa-4533-b96f-b4a60e409b5a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:31.251548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2623a527-97aa-4533-b96f-b4a60e409b5a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:31.253471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2623a527-97aa-4533-b96f-b4a60e409b5a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:32.158666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2623a527-97aa-4533-b96f-b4a60e409b5a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:32.173099 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2623a527-97aa-4533-b96f-b4a60e409b5a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1687 microversion: 2.1 time: 0.970297 Jul 26 14:44:32.175914 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2639/5403] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:31 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1687 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:32.556850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f09495d6-8c87-4ac2-83c5-ace0c691c1fb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'create', calling method: .version_select at 0x7f8787d6c9d0>, body: {"keypair": {"name": "tempest-keypair-869598790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaux+hLGSFkB4PSbtX843U3WlINZju9i78PkhU8lwEm6hun7SqkxxBvYicceOVvAWqKHfrEas+sUlZZk6k9jWOdMs09VEaJVqHsgR22yu5MwgZIh8ZkthdA/8pQgcpBRw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:32.586579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f09495d6-8c87-4ac2-83c5-ace0c691c1fb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Getting quotas for project 7386a23b259b4c4091637972951a3f0e. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:44:32.600904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f09495d6-8c87-4ac2-83c5-ace0c691c1fb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Getting quotas for user ca1aaf9a4ab74a829ef94a7d54c683cd and project 7386a23b259b4c4091637972951a3f0e. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:44:32.651553 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f09495d6-8c87-4ac2-83c5-ace0c691c1fb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099493 Jul 26 14:44:32.652678 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2765/5404] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:44:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:33.201061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fd41bc95-1590-4727-bcd0-02e8bf7ffa30 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:33.201715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fd41bc95-1590-4727-bcd0-02e8bf7ffa30 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:33.213211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:33.215862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd41bc95-1590-4727-bcd0-02e8bf7ffa30 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:33.216357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd41bc95-1590-4727-bcd0-02e8bf7ffa30 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:33.217657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd41bc95-1590-4727-bcd0-02e8bf7ffa30 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:33.218111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd41bc95-1590-4727-bcd0-02e8bf7ffa30 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:33.993636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fd41bc95-1590-4727-bcd0-02e8bf7ffa30 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:34.019926 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fd41bc95-1590-4727-bcd0-02e8bf7ffa30 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1687 microversion: 2.1 time: 0.823309 Jul 26 14:44:34.020885 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2640/5405] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:33 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1687 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:34.353982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-16ed0104-e8b8-4bfc-ac2c-ab0b8beb3b62 req-52f81596-5ca9-415d-ad63-3fe6f8f59ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba8e107-65ea-46d7-aeb1-29b743c9ed63", "name": "network-vif-deleted", "tag": "b8483898-b6f3-408b-8a5b-14d1aef2d115"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:34.372256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-16ed0104-e8b8-4bfc-ac2c-ab0b8beb3b62 req-52f81596-5ca9-415d-ad63-3fe6f8f59ef5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:34.373212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-16ed0104-e8b8-4bfc-ac2c-ab0b8beb3b62 req-52f81596-5ca9-415d-ad63-3fe6f8f59ef5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:34.394307 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-16ed0104-e8b8-4bfc-ac2c-ab0b8beb3b62 req-52f81596-5ca9-415d-ad63-3fe6f8f59ef5 service nova] Creating event network-vif-deleted:b8483898-b6f3-408b-8a5b-14d1aef2d115 for instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 on n-h2-833090-9 Jul 26 14:44:34.410020 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-16ed0104-e8b8-4bfc-ac2c-ab0b8beb3b62 req-52f81596-5ca9-415d-ad63-3fe6f8f59ef5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063017 Jul 26 14:44:34.424201 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2766/5406] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:44:35.061822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:35.064281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:35.075887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:35.076522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:35.077974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:35.078629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:35.196487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:35.209763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:35.211219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lazy-loading 'fault' on Instance uuid 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:44:35.305739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:35.322308 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2391b597-436b-4cb5-b863-a921c7bb4a67 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 200 len: 1355 microversion: 2.1 time: 0.269096 Jul 26 14:44:35.322907 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2641/5407] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:35 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 1355 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:36.365385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50f08de6-1e20-4685-98d5-34518f35ccbd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:36.366665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-50f08de6-1e20-4685-98d5-34518f35ccbd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 8ba8e107-65ea-46d7-aeb1-29b743c9ed63] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:36.397194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50f08de6-1e20-4685-98d5-34518f35ccbd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:36.398033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50f08de6-1e20-4685-98d5-34518f35ccbd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:36.416501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50f08de6-1e20-4685-98d5-34518f35ccbd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:36.417315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50f08de6-1e20-4685-98d5-34518f35ccbd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:36.458281 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-50f08de6-1e20-4685-98d5-34518f35ccbd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] HTTP exception thrown: Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 could not be found. Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50f08de6-1e20-4685-98d5-34518f35ccbd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Request method failure captured: Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 HTTP/1.1 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_xB-Zf_NVFk2LpZd5X0S1bF9Sihh0sVd3cVjP7q1Wb09Bi_CbMlSEWs2yYdcOyVXXKNohoIUlLtBITBGHLSNiRsoBSNoqWwMtL7vcjKUvwFncHYEdNqCZrXhBJGT_E7Ar_K6PwdXlw_F45EECw6xOMVI7rp06FaJ1098k3HxOxEoI4 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 1f899f15d3284d9d8b7f9509f1017944 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f899f15d3284d9d8b7f9509f1017944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f899f15d3284d9d8b7f9509f1017944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f899f15d3284d9d8b7f9509f1017944", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f899f15d3284d9d8b7f9509f1017944"}]}] Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 1f899f15d3284d9d8b7f9509f1017944 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestNetworkAdvancedServerOps-1920705595-project Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 2ace0ada06df49f189f02e59039c2dd8 Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1920705595-project Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 could not be found. Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '8ba8e107-65ea-46d7-aeb1-29b743c9ed63'} Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 could not be found. Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 could not be found. Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:44:36.465697 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:36.469458 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:44:36.469458 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:36.469458 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:36.469458 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:36.469458 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:44:36.469458 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:44:36.469458 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 could not be found. Jul 26 14:44:36.469458 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:44:36.471497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50f08de6-1e20-4685-98d5-34518f35ccbd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Returning 404 to user: Instance 8ba8e107-65ea-46d7-aeb1-29b743c9ed63 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:44:36.474137 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-50f08de6-1e20-4685-98d5-34518f35ccbd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63" status: 404 len: 111 microversion: 2.1 time: 0.119006 Jul 26 14:44:36.475369 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2767/5408] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:36 2022] GET /compute/v2.1/servers/8ba8e107-65ea-46d7-aeb1-29b743c9ed63 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:44:36.735843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1092378075", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0b33547d-5625-46f7-9a04-72573fd2ba05"}], "security_groups": [{"name": "tempest-securitygroup--1975560233"}], "key_name": "tempest-keypair-869598790", "user_data": "}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:37.048267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] validate_networks() for [('0b33547d-5625-46f7-9a04-72573fd2ba05', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:44:37.803398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:44:37.804389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:44:37.805275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:44:37.806094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:44:37.806655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:44:37.823898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:37.826630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:37.829072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:37.829510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:37.850193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:37.875354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Getting quotas for project 7386a23b259b4c4091637972951a3f0e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:44:37.882205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Getting quotas for user ca1aaf9a4ab74a829ef94a7d54c683cd and project 7386a23b259b4c4091637972951a3f0e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:44:37.901844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:44:37.906250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:44:37.968251 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2f39652b-c149-45a3-b097-a8801a479b4e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.237308 Jul 26 14:44:37.976898 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2642/5409] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:44:36 2022] POST /compute/v2.1/servers => generated 409 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:44:37.982122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b44286f3-ae25-4279-b551-1f363783dd47 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:37.982904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b44286f3-ae25-4279-b551-1f363783dd47 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:38.165111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b44286f3-ae25-4279-b551-1f363783dd47 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:38.182756 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b44286f3-ae25-4279-b551-1f363783dd47 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1245 microversion: 2.1 time: 0.205249 Jul 26 14:44:38.197121 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2768/5410] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:37 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1245 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:39.212446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fe96c89a-2a87-4b5c-a615-988f8bc502ba tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:39.213178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fe96c89a-2a87-4b5c-a615-988f8bc502ba tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:39.247578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe96c89a-2a87-4b5c-a615-988f8bc502ba tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:39.248631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe96c89a-2a87-4b5c-a615-988f8bc502ba tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:39.249975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe96c89a-2a87-4b5c-a615-988f8bc502ba tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:39.250515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe96c89a-2a87-4b5c-a615-988f8bc502ba tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:39.404082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fe96c89a-2a87-4b5c-a615-988f8bc502ba tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:39.415562 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fe96c89a-2a87-4b5c-a615-988f8bc502ba tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1297 microversion: 2.1 time: 0.211053 Jul 26 14:44:39.431727 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2643/5411] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:39 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1297 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:40.443039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-97b6e5e7-5564-445c-820a-165ad8476f21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:40.444247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-97b6e5e7-5564-445c-820a-165ad8476f21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:40.466721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b6e5e7-5564-445c-820a-165ad8476f21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:40.467361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b6e5e7-5564-445c-820a-165ad8476f21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:40.468566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b6e5e7-5564-445c-820a-165ad8476f21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:40.469131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b6e5e7-5564-445c-820a-165ad8476f21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:40.671586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-97b6e5e7-5564-445c-820a-165ad8476f21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:40.684090 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-97b6e5e7-5564-445c-820a-165ad8476f21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1303 microversion: 2.1 time: 0.249506 Jul 26 14:44:40.700431 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2769/5412] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:40 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:41.709481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6ada9d8e-1137-4097-bec6-6ce8dd6230a9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:41.710899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6ada9d8e-1137-4097-bec6-6ce8dd6230a9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:41.749515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ada9d8e-1137-4097-bec6-6ce8dd6230a9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:41.756057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ada9d8e-1137-4097-bec6-6ce8dd6230a9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:41.758031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ada9d8e-1137-4097-bec6-6ce8dd6230a9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:41.758846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ada9d8e-1137-4097-bec6-6ce8dd6230a9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:42.231939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6ada9d8e-1137-4097-bec6-6ce8dd6230a9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:42.242639 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6ada9d8e-1137-4097-bec6-6ce8dd6230a9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1371 microversion: 2.1 time: 0.539087 Jul 26 14:44:42.244167 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2644/5413] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:41 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1371 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:43.265286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b04ccf73-3588-4938-a6be-447afe6fec34 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:43.265921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b04ccf73-3588-4938-a6be-447afe6fec34 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:43.278426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b04ccf73-3588-4938-a6be-447afe6fec34 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:43.281887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b04ccf73-3588-4938-a6be-447afe6fec34 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:43.288442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b04ccf73-3588-4938-a6be-447afe6fec34 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:43.298473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b04ccf73-3588-4938-a6be-447afe6fec34 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:43.367031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=68 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:43.640639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-bf963715-93ed-4931-99c5-ad074f11871e req-f0a41fbd-2248-46ac-8e3f-5b39e3884253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ee36bc-0796-4af3-a631-93e2060ca82d", "tag": "a8a183a7-5f4c-4925-a69c-f17c5aa3fea8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:43.679683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bf963715-93ed-4931-99c5-ad074f11871e req-f0a41fbd-2248-46ac-8e3f-5b39e3884253 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:43.680169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bf963715-93ed-4931-99c5-ad074f11871e req-f0a41fbd-2248-46ac-8e3f-5b39e3884253 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:43.727390 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-bf963715-93ed-4931-99c5-ad074f11871e req-f0a41fbd-2248-46ac-8e3f-5b39e3884253 service nova] Creating event network-changed:a8a183a7-5f4c-4925-a69c-f17c5aa3fea8 for instance 05ee36bc-0796-4af3-a631-93e2060ca82d on n-h1-833090-9 Jul 26 14:44:43.743207 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-bf963715-93ed-4931-99c5-ad074f11871e req-f0a41fbd-2248-46ac-8e3f-5b39e3884253 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106669 Jul 26 14:44:43.743865 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2645/5414] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:44:44.081677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b04ccf73-3588-4938-a6be-447afe6fec34 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:44.092304 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b04ccf73-3588-4938-a6be-447afe6fec34 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1371 microversion: 2.1 time: 0.831038 Jul 26 14:44:44.101214 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2770/5415] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:43 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1371 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:44.304433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7891f26b-3642-4106-a0a4-dc275099689a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '.version_select at 0x7f878794d8b0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:44.368042 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7891f26b-3642-4106-a0a4-dc275099689a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-800761028" status: 202 len: 0 microversion: 2.1 time: 0.068410 Jul 26 14:44:44.369202 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2646/5416] 10.222.0.70 () {58 vars in 1281 bytes} [Tue Jul 26 14:44:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-800761028 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:44:44.419874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5c0f4eaa-7461-42cd-a5fc-e323f1499e01 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'create', calling method: .version_select at 0x7f8787fd6a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-262738288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKf6eHt/tRQ8lc/tH7L1GlN0MjNILPamKtSlUQ1Lgox0zsbLtpsaccciIWTy0wF7Ven2Z+yFn5CoGskK+6ek1Vj7EAx6dvSlRW43EUrHXo8AV/aDu+hjyZ7meYRqxFZIyQ=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:44.442758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-5c0f4eaa-7461-42cd-a5fc-e323f1499e01 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:44:44.451073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-5c0f4eaa-7461-42cd-a5fc-e323f1499e01 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for user 2ace0ada06df49f189f02e59039c2dd8 and project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:44:44.482049 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5c0f4eaa-7461-42cd-a5fc-e323f1499e01 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.066253 Jul 26 14:44:44.488154 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2771/5417] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:44:44 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:45.131224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8d62fa7d-8ee0-438e-96eb-e6fea206ffab tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:45.132664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8d62fa7d-8ee0-438e-96eb-e6fea206ffab tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:45.147063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d62fa7d-8ee0-438e-96eb-e6fea206ffab tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:45.147523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d62fa7d-8ee0-438e-96eb-e6fea206ffab tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:45.148351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d62fa7d-8ee0-438e-96eb-e6fea206ffab tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:45.148796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8d62fa7d-8ee0-438e-96eb-e6fea206ffab tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:45.955114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8d62fa7d-8ee0-438e-96eb-e6fea206ffab tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:45.981157 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8d62fa7d-8ee0-438e-96eb-e6fea206ffab tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1371 microversion: 2.1 time: 0.859256 Jul 26 14:44:45.982008 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2647/5418] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:45 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1371 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:46.185228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1f0a7fbc-070d-451f-85d3-b8bdcc0bfdb6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:46.187499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1f0a7fbc-070d-451f-85d3-b8bdcc0bfdb6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:46.220488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f0a7fbc-070d-451f-85d3-b8bdcc0bfdb6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:46.220956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f0a7fbc-070d-451f-85d3-b8bdcc0bfdb6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:46.222309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f0a7fbc-070d-451f-85d3-b8bdcc0bfdb6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:46.222762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f0a7fbc-070d-451f-85d3-b8bdcc0bfdb6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:46.394100 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1f0a7fbc-070d-451f-85d3-b8bdcc0bfdb6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "POST /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577/action" status: 200 len: 24546 microversion: 2.1 time: 0.212448 Jul 26 14:44:46.396300 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2772/5419] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:44:46 2022] POST /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577/action => generated 24546 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:44:47.003736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-35427c1b-81ea-4b0e-a2a9-e09f4139ac9d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:47.005064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-35427c1b-81ea-4b0e-a2a9-e09f4139ac9d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:47.014721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35427c1b-81ea-4b0e-a2a9-e09f4139ac9d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:47.016653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35427c1b-81ea-4b0e-a2a9-e09f4139ac9d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:47.017655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35427c1b-81ea-4b0e-a2a9-e09f4139ac9d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:47.019014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35427c1b-81ea-4b0e-a2a9-e09f4139ac9d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:47.327509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-35427c1b-81ea-4b0e-a2a9-e09f4139ac9d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:47.346286 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-35427c1b-81ea-4b0e-a2a9-e09f4139ac9d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1371 microversion: 2.1 time: 0.346736 Jul 26 14:44:47.347530 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2648/5420] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:46 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1371 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:48.375888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63ea6b61-8973-433a-981d-10606c19da3f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:48.382092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63ea6b61-8973-433a-981d-10606c19da3f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:48.392198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63ea6b61-8973-433a-981d-10606c19da3f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:48.393124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63ea6b61-8973-433a-981d-10606c19da3f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:48.394500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63ea6b61-8973-433a-981d-10606c19da3f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:48.395207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63ea6b61-8973-433a-981d-10606c19da3f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:48.518973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:48.523186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:48.701928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63ea6b61-8973-433a-981d-10606c19da3f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:48.722718 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63ea6b61-8973-433a-981d-10606c19da3f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1371 microversion: 2.1 time: 0.354454 Jul 26 14:44:48.723807 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2773/5421] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:48 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1371 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:48.748232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-656fb376-8bcc-46f2-b1d7-87ac564a027c req-cedfa7dd-46d0-4d96-a27e-224067ac8954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ee36bc-0796-4af3-a631-93e2060ca82d", "name": "network-vif-plugged", "status": "completed", "tag": "a8a183a7-5f4c-4925-a69c-f17c5aa3fea8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:48.761231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-656fb376-8bcc-46f2-b1d7-87ac564a027c req-cedfa7dd-46d0-4d96-a27e-224067ac8954 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:48.762399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-656fb376-8bcc-46f2-b1d7-87ac564a027c req-cedfa7dd-46d0-4d96-a27e-224067ac8954 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:48.777863 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-656fb376-8bcc-46f2-b1d7-87ac564a027c req-cedfa7dd-46d0-4d96-a27e-224067ac8954 service nova] Creating event network-vif-plugged:a8a183a7-5f4c-4925-a69c-f17c5aa3fea8 for instance 05ee36bc-0796-4af3-a631-93e2060ca82d on n-h1-833090-9 Jul 26 14:44:48.784656 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-656fb376-8bcc-46f2-b1d7-87ac564a027c req-cedfa7dd-46d0-4d96-a27e-224067ac8954 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285498 Jul 26 14:44:48.785626 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2649/5422] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:44:49.753231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3497f261-1917-4782-984c-a5c81c645a46 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:49.754153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3497f261-1917-4782-984c-a5c81c645a46 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:49.763195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3497f261-1917-4782-984c-a5c81c645a46 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:49.763913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3497f261-1917-4782-984c-a5c81c645a46 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:49.764966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3497f261-1917-4782-984c-a5c81c645a46 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:49.765620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3497f261-1917-4782-984c-a5c81c645a46 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:49.965363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3497f261-1917-4782-984c-a5c81c645a46 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:49.978155 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3497f261-1917-4782-984c-a5c81c645a46 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1371 microversion: 2.1 time: 0.229393 Jul 26 14:44:49.979399 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2774/5423] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:49 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:51.021932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b6167171-de08-4976-be91-5e24b2217d2a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:51.021932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b6167171-de08-4976-be91-5e24b2217d2a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:51.035369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6167171-de08-4976-be91-5e24b2217d2a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:51.036187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6167171-de08-4976-be91-5e24b2217d2a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:51.037798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6167171-de08-4976-be91-5e24b2217d2a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:51.038800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b6167171-de08-4976-be91-5e24b2217d2a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:51.615087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b6167171-de08-4976-be91-5e24b2217d2a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:44:51.666684 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b6167171-de08-4976-be91-5e24b2217d2a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1563 microversion: 2.1 time: 0.666547 Jul 26 14:44:51.667872 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2650/5424] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:50 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1563 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:51.697739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e64fca5d-993f-4a56-8659-bebfdb58d749 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:51.701573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e64fca5d-993f-4a56-8659-bebfdb58d749 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:44:51.727855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e64fca5d-993f-4a56-8659-bebfdb58d749 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:51.729202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e64fca5d-993f-4a56-8659-bebfdb58d749 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:51.731158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e64fca5d-993f-4a56-8659-bebfdb58d749 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:51.732501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e64fca5d-993f-4a56-8659-bebfdb58d749 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:51.946313 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e64fca5d-993f-4a56-8659-bebfdb58d749 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255894 Jul 26 14:44:51.957822 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2775/5425] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:44:51 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:55.374524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ae921750-f232-498f-a6e3-a54390d4d490 req-77bc4e35-3c73-45b6-a385-2c63164c6196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ee36bc-0796-4af3-a631-93e2060ca82d", "tag": "a8a183a7-5f4c-4925-a69c-f17c5aa3fea8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:55.389924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ae921750-f232-498f-a6e3-a54390d4d490 req-77bc4e35-3c73-45b6-a385-2c63164c6196 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:55.399427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ae921750-f232-498f-a6e3-a54390d4d490 req-77bc4e35-3c73-45b6-a385-2c63164c6196 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:55.449571 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ae921750-f232-498f-a6e3-a54390d4d490 req-77bc4e35-3c73-45b6-a385-2c63164c6196 service nova] Creating event network-changed:a8a183a7-5f4c-4925-a69c-f17c5aa3fea8 for instance 05ee36bc-0796-4af3-a631-93e2060ca82d on n-h1-833090-9 Jul 26 14:44:55.472247 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ae921750-f232-498f-a6e3-a54390d4d490 req-77bc4e35-3c73-45b6-a385-2c63164c6196 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336767 Jul 26 14:44:55.473244 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2651/5426] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:58.201503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=10 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:58.209911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-321682766", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "57b6a9a4-13db-4fb0-8833-c62b06860f11"}], "key_name": "tempest-TestNetworkAdvancedServerOps-262738288", "security_groups": [{"name": "tempest-secgroup-smoke-107301803"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:58.503165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] validate_networks() for [('57b6a9a4-13db-4fb0-8833-c62b06860f11', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:44:59.723344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:44:59.724470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:44:59.725134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:44:59.725687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:44:59.726267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:44:59.731894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:59.747010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:59.748041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:59.749071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:44:59.749864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:44:59.803546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:44:59.812309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for user 2ace0ada06df49f189f02e59039c2dd8 and project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:44:59.852617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:44:59.856122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:44:59.950336 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e13baa45-5a1d-4c3c-ae7b-9bee03be87bb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.750276 Jul 26 14:44:59.962721 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2776/5427] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:44:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:44:59.967963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1e3a35c1-6a8e-45d5-8824-1934d441cea4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:59.975072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1e3a35c1-6a8e-45d5-8824-1934d441cea4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:00.126054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1e3a35c1-6a8e-45d5-8824-1934d441cea4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:00.149804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1e3a35c1-6a8e-45d5-8824-1934d441cea4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1265 microversion: 2.1 time: 0.181346 Jul 26 14:45:00.158346 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2652/5428] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:44:59 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:45:01.198580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-13c64548-ea01-44ae-80a8-6d8641ad3ffd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:01.200032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-13c64548-ea01-44ae-80a8-6d8641ad3ffd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:01.224245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13c64548-ea01-44ae-80a8-6d8641ad3ffd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:01.225096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13c64548-ea01-44ae-80a8-6d8641ad3ffd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:01.226171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13c64548-ea01-44ae-80a8-6d8641ad3ffd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:01.226798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13c64548-ea01-44ae-80a8-6d8641ad3ffd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:01.446700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-13c64548-ea01-44ae-80a8-6d8641ad3ffd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:01.461288 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-13c64548-ea01-44ae-80a8-6d8641ad3ffd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1269 microversion: 2.1 time: 0.267733 Jul 26 14:45:01.477313 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2777/5429] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:01 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1269 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:02.485068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-75b756c5-527a-4a38-afc7-2e419fc21c52 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:02.487298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-75b756c5-527a-4a38-afc7-2e419fc21c52 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:02.497721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75b756c5-527a-4a38-afc7-2e419fc21c52 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:02.498483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75b756c5-527a-4a38-afc7-2e419fc21c52 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:02.499674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75b756c5-527a-4a38-afc7-2e419fc21c52 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:02.500538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-75b756c5-527a-4a38-afc7-2e419fc21c52 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:02.742583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-75b756c5-527a-4a38-afc7-2e419fc21c52 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:02.775776 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-75b756c5-527a-4a38-afc7-2e419fc21c52 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1323 microversion: 2.1 time: 0.295125 Jul 26 14:45:02.785475 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2653/5430] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:02 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:03.817076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fa14b1aa-cd17-4cbb-ab07-d7e9ce24be23 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:03.817854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fa14b1aa-cd17-4cbb-ab07-d7e9ce24be23 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:03.843640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa14b1aa-cd17-4cbb-ab07-d7e9ce24be23 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:03.844939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa14b1aa-cd17-4cbb-ab07-d7e9ce24be23 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:03.848830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa14b1aa-cd17-4cbb-ab07-d7e9ce24be23 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:03.856775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fa14b1aa-cd17-4cbb-ab07-d7e9ce24be23 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:04.203592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fa14b1aa-cd17-4cbb-ab07-d7e9ce24be23 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:04.216913 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fa14b1aa-cd17-4cbb-ab07-d7e9ce24be23 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1390 microversion: 2.1 time: 0.405791 Jul 26 14:45:04.227987 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2778/5431] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:03 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1390 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:05.273450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9770f6d9-1fae-4fb8-ab0d-057514bc7d1e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:05.282925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9770f6d9-1fae-4fb8-ab0d-057514bc7d1e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:05.294739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:05.312365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9770f6d9-1fae-4fb8-ab0d-057514bc7d1e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:05.312970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9770f6d9-1fae-4fb8-ab0d-057514bc7d1e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:05.313871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9770f6d9-1fae-4fb8-ab0d-057514bc7d1e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:05.315116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9770f6d9-1fae-4fb8-ab0d-057514bc7d1e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:05.495731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a68adc99-dba3-4de5-b14c-6d31d7ca6dec req-50725c02-4f73-44b5-a549-de6af9535309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04017d0a-b2a7-43f6-89b7-dd7078716109", "tag": "6dd56902-bd9a-4e87-a5aa-87bd37cc1b61"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:05.520972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a68adc99-dba3-4de5-b14c-6d31d7ca6dec req-50725c02-4f73-44b5-a549-de6af9535309 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:05.526841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a68adc99-dba3-4de5-b14c-6d31d7ca6dec req-50725c02-4f73-44b5-a549-de6af9535309 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:05.556124 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a68adc99-dba3-4de5-b14c-6d31d7ca6dec req-50725c02-4f73-44b5-a549-de6af9535309 service nova] Creating event network-changed:6dd56902-bd9a-4e87-a5aa-87bd37cc1b61 for instance 04017d0a-b2a7-43f6-89b7-dd7078716109 on n-h2-833090-9 Jul 26 14:45:05.568662 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a68adc99-dba3-4de5-b14c-6d31d7ca6dec req-50725c02-4f73-44b5-a549-de6af9535309 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078093 Jul 26 14:45:05.574023 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2779/5432] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:05.924757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9770f6d9-1fae-4fb8-ab0d-057514bc7d1e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:05.936123 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9770f6d9-1fae-4fb8-ab0d-057514bc7d1e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1390 microversion: 2.1 time: 0.684914 Jul 26 14:45:05.936591 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2654/5433] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:05 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1390 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:06.800200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-79772be0-f432-426a-a16f-ee561efa8c1a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Action: 'create', calling method: .version_select at 0x7f8786d57a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-230295393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0G32Aye0Juv4C4pfUDPHVpaOdovm4oD9898qEoec6IXyjIB4lRK1Ii1+sFzLYeYBv/Q2GxhSnikQSCoFbEZnwxEb9mBZ07rRrsgQFjWgikSGUTVeEsqXfflfv75/QC2w=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:06.834059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-79772be0-f432-426a-a16f-ee561efa8c1a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for project 54967e3bd292459a81121b90b03fde3b. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:45:06.843941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-79772be0-f432-426a-a16f-ee561efa8c1a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for user 5e1adb391e2f425892a83762aaa6eb43 and project 54967e3bd292459a81121b90b03fde3b. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:45:06.891084 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-79772be0-f432-426a-a16f-ee561efa8c1a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.096789 Jul 26 14:45:06.899874 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2780/5434] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:45:06 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:06.976492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1a726344-e5be-4858-9f83-bb3b694247eb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:06.977455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1a726344-e5be-4858-9f83-bb3b694247eb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:07.020244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a726344-e5be-4858-9f83-bb3b694247eb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:07.024323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a726344-e5be-4858-9f83-bb3b694247eb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:07.028701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a726344-e5be-4858-9f83-bb3b694247eb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:07.029248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a726344-e5be-4858-9f83-bb3b694247eb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:07.686407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1a726344-e5be-4858-9f83-bb3b694247eb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:07.700685 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1a726344-e5be-4858-9f83-bb3b694247eb tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1390 microversion: 2.1 time: 0.731883 Jul 26 14:45:07.720323 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2655/5435] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:06 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1390 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:08.727826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d72f3fc2-e082-4409-870e-206b48920b5f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:08.730283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d72f3fc2-e082-4409-870e-206b48920b5f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:08.757567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d72f3fc2-e082-4409-870e-206b48920b5f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:08.759083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d72f3fc2-e082-4409-870e-206b48920b5f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:08.762046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d72f3fc2-e082-4409-870e-206b48920b5f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:08.764339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d72f3fc2-e082-4409-870e-206b48920b5f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:09.153721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d72f3fc2-e082-4409-870e-206b48920b5f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:09.166611 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d72f3fc2-e082-4409-870e-206b48920b5f tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1390 microversion: 2.1 time: 0.442278 Jul 26 14:45:09.168742 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2781/5436] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:08 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1390 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:09.671519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-93671443", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "b61b8f2e-f515-4626-b8d2-054fa222112a"}], "key_name": "tempest-TestNetworkBasicOps-230295393", "security_groups": [{"name": "tempest-secgroup-smoke-1538273368"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:09.857691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] validate_networks() for [('b61b8f2e-f515-4626-b8d2-054fa222112a', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:45:10.135325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:10.203198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bd421e9a-2baa-469b-b5a6-28b98398c378 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:10.203752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bd421e9a-2baa-469b-b5a6-28b98398c378 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:10.220758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:10.226143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd421e9a-2baa-469b-b5a6-28b98398c378 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:10.226607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd421e9a-2baa-469b-b5a6-28b98398c378 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:10.227464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd421e9a-2baa-469b-b5a6-28b98398c378 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:10.228118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd421e9a-2baa-469b-b5a6-28b98398c378 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:10.501919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bd421e9a-2baa-469b-b5a6-28b98398c378 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:10.518185 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bd421e9a-2baa-469b-b5a6-28b98398c378 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1390 microversion: 2.1 time: 0.331069 Jul 26 14:45:10.522221 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2782/5437] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:10 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1390 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:10.756783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:45:10.757395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:45:10.758380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:45:10.758903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:45:10.759430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:45:10.773346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:10.773939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:10.775006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:10.775661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:10.787720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=56 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:10.801886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for project 54967e3bd292459a81121b90b03fde3b. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:45:10.809327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for user 5e1adb391e2f425892a83762aaa6eb43 and project 54967e3bd292459a81121b90b03fde3b. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:45:10.837527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:45:10.841469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:45:10.914647 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ff6c5e6-2d5f-44d0-893c-193442d41d8b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.246897 Jul 26 14:45:10.922902 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2656/5438] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:45:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:45:10.927516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d6271e2-9e18-441c-a445-5d30fd3710c5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:10.928198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2d6271e2-9e18-441c-a445-5d30fd3710c5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:11.046047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2d6271e2-9e18-441c-a445-5d30fd3710c5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:11.056861 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d6271e2-9e18-441c-a445-5d30fd3710c5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1246 microversion: 2.1 time: 0.133293 Jul 26 14:45:11.057798 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2783/5439] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:10 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1246 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:11.542474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3a816b9f-f6d3-4a59-8ca6-f5345159f8f6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:11.543031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3a816b9f-f6d3-4a59-8ca6-f5345159f8f6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:11.554367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a816b9f-f6d3-4a59-8ca6-f5345159f8f6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:11.555070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a816b9f-f6d3-4a59-8ca6-f5345159f8f6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:11.556119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a816b9f-f6d3-4a59-8ca6-f5345159f8f6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:11.557874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3a816b9f-f6d3-4a59-8ca6-f5345159f8f6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:11.850636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3a816b9f-f6d3-4a59-8ca6-f5345159f8f6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:11.869650 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3a816b9f-f6d3-4a59-8ca6-f5345159f8f6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1390 microversion: 2.1 time: 0.331669 Jul 26 14:45:11.870676 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2657/5440] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:11 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1390 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:12.079019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57145d79-d11c-489f-8303-7939fc300f3a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:12.079715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-57145d79-d11c-489f-8303-7939fc300f3a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:12.087895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57145d79-d11c-489f-8303-7939fc300f3a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:12.088436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57145d79-d11c-489f-8303-7939fc300f3a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:12.090151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57145d79-d11c-489f-8303-7939fc300f3a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:12.090151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57145d79-d11c-489f-8303-7939fc300f3a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:12.231588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-57145d79-d11c-489f-8303-7939fc300f3a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:12.255537 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57145d79-d11c-489f-8303-7939fc300f3a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1242 microversion: 2.1 time: 0.180308 Jul 26 14:45:12.256539 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2784/5441] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:12 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1242 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:45:12.610224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2799c5d1-cd9b-4807-b85d-6855845b84ac req-3561c4c6-617f-4840-af84-4301a209ac7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04017d0a-b2a7-43f6-89b7-dd7078716109", "name": "network-vif-plugged", "status": "completed", "tag": "6dd56902-bd9a-4e87-a5aa-87bd37cc1b61"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:12.630053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2799c5d1-cd9b-4807-b85d-6855845b84ac req-3561c4c6-617f-4840-af84-4301a209ac7d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:12.630862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2799c5d1-cd9b-4807-b85d-6855845b84ac req-3561c4c6-617f-4840-af84-4301a209ac7d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:12.673081 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2799c5d1-cd9b-4807-b85d-6855845b84ac req-3561c4c6-617f-4840-af84-4301a209ac7d service nova] Creating event network-vif-plugged:6dd56902-bd9a-4e87-a5aa-87bd37cc1b61 for instance 04017d0a-b2a7-43f6-89b7-dd7078716109 on n-h2-833090-9 Jul 26 14:45:12.685797 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2799c5d1-cd9b-4807-b85d-6855845b84ac req-3561c4c6-617f-4840-af84-4301a209ac7d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079150 Jul 26 14:45:12.688948 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2658/5442] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:12.899437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f63a56c8-97f7-4fbe-85e5-b404c77f01bd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:12.900415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f63a56c8-97f7-4fbe-85e5-b404c77f01bd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:12.920938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f63a56c8-97f7-4fbe-85e5-b404c77f01bd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:12.921422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f63a56c8-97f7-4fbe-85e5-b404c77f01bd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:12.922305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f63a56c8-97f7-4fbe-85e5-b404c77f01bd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:12.922969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f63a56c8-97f7-4fbe-85e5-b404c77f01bd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:13.256927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f63a56c8-97f7-4fbe-85e5-b404c77f01bd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:13.267664 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f63a56c8-97f7-4fbe-85e5-b404c77f01bd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1390 microversion: 2.1 time: 0.373531 Jul 26 14:45:13.269091 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2785/5443] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:12 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1390 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:13.296791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-afa4621b-b151-45bd-aebe-166de990b2f5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:13.298233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-afa4621b-b151-45bd-aebe-166de990b2f5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:13.313725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afa4621b-b151-45bd-aebe-166de990b2f5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:13.316365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afa4621b-b151-45bd-aebe-166de990b2f5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:13.319690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afa4621b-b151-45bd-aebe-166de990b2f5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:13.320290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afa4621b-b151-45bd-aebe-166de990b2f5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:13.427371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-afa4621b-b151-45bd-aebe-166de990b2f5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:13.440190 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-afa4621b-b151-45bd-aebe-166de990b2f5 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1304 microversion: 2.1 time: 0.150194 Jul 26 14:45:13.440931 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2659/5444] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:13 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:14.307404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b52d2d88-7b83-4b9e-94a9-92cbe5100ce7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:14.308146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b52d2d88-7b83-4b9e-94a9-92cbe5100ce7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:14.326975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b52d2d88-7b83-4b9e-94a9-92cbe5100ce7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:14.327782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b52d2d88-7b83-4b9e-94a9-92cbe5100ce7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:14.329812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b52d2d88-7b83-4b9e-94a9-92cbe5100ce7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:14.332658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b52d2d88-7b83-4b9e-94a9-92cbe5100ce7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:14.347188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=66 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:14.484774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-daeda16a-07d8-4414-95ba-640ba0b365aa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:14.489704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-daeda16a-07d8-4414-95ba-640ba0b365aa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:14.500011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-daeda16a-07d8-4414-95ba-640ba0b365aa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:14.500981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-daeda16a-07d8-4414-95ba-640ba0b365aa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:14.501931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-daeda16a-07d8-4414-95ba-640ba0b365aa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:14.503486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-daeda16a-07d8-4414-95ba-640ba0b365aa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:14.757887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b52d2d88-7b83-4b9e-94a9-92cbe5100ce7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:14.778482 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b52d2d88-7b83-4b9e-94a9-92cbe5100ce7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1390 microversion: 2.1 time: 0.475726 Jul 26 14:45:14.791510 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2786/5445] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:14 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1390 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:45:15.010778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-daeda16a-07d8-4414-95ba-640ba0b365aa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:15.034282 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-daeda16a-07d8-4414-95ba-640ba0b365aa tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1372 microversion: 2.1 time: 0.549673 Jul 26 14:45:15.036470 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2660/5446] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:14 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1372 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:15.593131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1608e166-8e2a-4c00-abaa-46f90760de69 req-0004c0f5-d5bf-43da-b338-e2eb81202029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1446dd90-9bc1-45a2-ace0-eb284689339c", "tag": "5bb6ef53-acf5-4cf8-bf20-077aa8aec989"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:15.640363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1608e166-8e2a-4c00-abaa-46f90760de69 req-0004c0f5-d5bf-43da-b338-e2eb81202029 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:15.640823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1608e166-8e2a-4c00-abaa-46f90760de69 req-0004c0f5-d5bf-43da-b338-e2eb81202029 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:15.660911 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1608e166-8e2a-4c00-abaa-46f90760de69 req-0004c0f5-d5bf-43da-b338-e2eb81202029 service nova] Creating event network-changed:5bb6ef53-acf5-4cf8-bf20-077aa8aec989 for instance 1446dd90-9bc1-45a2-ace0-eb284689339c on n-h1-833090-9 Jul 26 14:45:15.667548 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1608e166-8e2a-4c00-abaa-46f90760de69 req-0004c0f5-d5bf-43da-b338-e2eb81202029 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082229 Jul 26 14:45:15.668661 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2787/5447] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:15.813745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bf982820-fbae-45b4-a948-5789681b1ced tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:15.815585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bf982820-fbae-45b4-a948-5789681b1ced tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:15.826452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf982820-fbae-45b4-a948-5789681b1ced tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:15.826921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf982820-fbae-45b4-a948-5789681b1ced tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:15.828722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf982820-fbae-45b4-a948-5789681b1ced tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:15.829438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bf982820-fbae-45b4-a948-5789681b1ced tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:16.016841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bf982820-fbae-45b4-a948-5789681b1ced tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:16.025675 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bf982820-fbae-45b4-a948-5789681b1ced tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1561 microversion: 2.1 time: 0.216838 Jul 26 14:45:16.027127 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2661/5448] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:15 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1561 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:45:16.056647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e5af5880-279b-4045-a229-fd72b0be0e0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:16.057416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e5af5880-279b-4045-a229-fd72b0be0e0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:16.059687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0999bbd7-b128-4a82-8472-9b978f2af41b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:16.060553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0999bbd7-b128-4a82-8472-9b978f2af41b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:16.070065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0999bbd7-b128-4a82-8472-9b978f2af41b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:16.070534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0999bbd7-b128-4a82-8472-9b978f2af41b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:16.071508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0999bbd7-b128-4a82-8472-9b978f2af41b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:16.072148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0999bbd7-b128-4a82-8472-9b978f2af41b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:16.075178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5af5880-279b-4045-a229-fd72b0be0e0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:16.075794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5af5880-279b-4045-a229-fd72b0be0e0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:16.077236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5af5880-279b-4045-a229-fd72b0be0e0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:16.078155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5af5880-279b-4045-a229-fd72b0be0e0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:16.323585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e5af5880-279b-4045-a229-fd72b0be0e0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:16.336151 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e5af5880-279b-4045-a229-fd72b0be0e0c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1561 microversion: 2.1 time: 0.290611 Jul 26 14:45:16.340996 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2788/5449] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:16 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1561 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:16.342166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0999bbd7-b128-4a82-8472-9b978f2af41b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:16.350277 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0999bbd7-b128-4a82-8472-9b978f2af41b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1372 microversion: 2.1 time: 0.294509 Jul 26 14:45:16.364661 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2662/5450] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:16 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1372 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:17.374080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-abb086e1-80b2-4dd5-829a-71bee70f4f80 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:17.374703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-abb086e1-80b2-4dd5-829a-71bee70f4f80 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:17.386794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abb086e1-80b2-4dd5-829a-71bee70f4f80 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:17.387317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abb086e1-80b2-4dd5-829a-71bee70f4f80 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:17.388141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abb086e1-80b2-4dd5-829a-71bee70f4f80 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:17.390747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-abb086e1-80b2-4dd5-829a-71bee70f4f80 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:18.029454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-abb086e1-80b2-4dd5-829a-71bee70f4f80 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:18.044000 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-abb086e1-80b2-4dd5-829a-71bee70f4f80 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1372 microversion: 2.1 time: 0.673353 Jul 26 14:45:18.048326 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2789/5451] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:17 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1372 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:45:19.071511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81f26bc3-71e7-4e26-8297-21799f1071dd tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:19.072797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-81f26bc3-71e7-4e26-8297-21799f1071dd tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:19.093938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81f26bc3-71e7-4e26-8297-21799f1071dd tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:19.094399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81f26bc3-71e7-4e26-8297-21799f1071dd tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:19.095197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81f26bc3-71e7-4e26-8297-21799f1071dd tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:19.104223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81f26bc3-71e7-4e26-8297-21799f1071dd tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:19.147475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83437315-b28c-4d53-b6f7-29c941149f13 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:19.148127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-83437315-b28c-4d53-b6f7-29c941149f13 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:19.158079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83437315-b28c-4d53-b6f7-29c941149f13 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:19.159424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83437315-b28c-4d53-b6f7-29c941149f13 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:19.175672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83437315-b28c-4d53-b6f7-29c941149f13 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:19.176430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83437315-b28c-4d53-b6f7-29c941149f13 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:19.528647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-83437315-b28c-4d53-b6f7-29c941149f13 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:19.538980 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-83437315-b28c-4d53-b6f7-29c941149f13 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1561 microversion: 2.1 time: 0.396265 Jul 26 14:45:19.553339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-81f26bc3-71e7-4e26-8297-21799f1071dd tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:19.559415 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2790/5452] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:19 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1561 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:45:19.566159 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-81f26bc3-71e7-4e26-8297-21799f1071dd tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1372 microversion: 2.1 time: 0.495021 Jul 26 14:45:19.566572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7e872784-5233-4260-a24c-42de23b58f64 req-5e074440-f04b-473c-b9f5-d1d8d4ca8ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04017d0a-b2a7-43f6-89b7-dd7078716109", "tag": "6dd56902-bd9a-4e87-a5aa-87bd37cc1b61"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:19.566807 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2663/5453] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:19 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1372 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:45:19.593940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7e872784-5233-4260-a24c-42de23b58f64 req-5e074440-f04b-473c-b9f5-d1d8d4ca8ab7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:19.594763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7e872784-5233-4260-a24c-42de23b58f64 req-5e074440-f04b-473c-b9f5-d1d8d4ca8ab7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:19.623520 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7e872784-5233-4260-a24c-42de23b58f64 req-5e074440-f04b-473c-b9f5-d1d8d4ca8ab7 service nova] Creating event network-changed:6dd56902-bd9a-4e87-a5aa-87bd37cc1b61 for instance 04017d0a-b2a7-43f6-89b7-dd7078716109 on n-h2-833090-9 Jul 26 14:45:19.638233 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7e872784-5233-4260-a24c-42de23b58f64 req-5e074440-f04b-473c-b9f5-d1d8d4ca8ab7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077406 Jul 26 14:45:19.639570 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2791/5454] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:20.588811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f40b45df-4a2f-4fa6-995c-18f4c96540cf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:20.589996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f40b45df-4a2f-4fa6-995c-18f4c96540cf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:20.600755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f40b45df-4a2f-4fa6-995c-18f4c96540cf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:20.601218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f40b45df-4a2f-4fa6-995c-18f4c96540cf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:20.602012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f40b45df-4a2f-4fa6-995c-18f4c96540cf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:20.602458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f40b45df-4a2f-4fa6-995c-18f4c96540cf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:20.740971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2cd25cda-7301-4501-a772-ab90fa04c137 req-46869117-505c-4bbe-b2a7-9f348cb2cda1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1446dd90-9bc1-45a2-ace0-eb284689339c", "name": "network-vif-plugged", "status": "completed", "tag": "5bb6ef53-acf5-4cf8-bf20-077aa8aec989"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:20.774912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2cd25cda-7301-4501-a772-ab90fa04c137 req-46869117-505c-4bbe-b2a7-9f348cb2cda1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:20.775722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2cd25cda-7301-4501-a772-ab90fa04c137 req-46869117-505c-4bbe-b2a7-9f348cb2cda1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:20.788388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:20.809773 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2cd25cda-7301-4501-a772-ab90fa04c137 req-46869117-505c-4bbe-b2a7-9f348cb2cda1 service nova] Creating event network-vif-plugged:5bb6ef53-acf5-4cf8-bf20-077aa8aec989 for instance 1446dd90-9bc1-45a2-ace0-eb284689339c on n-h1-833090-9 Jul 26 14:45:20.820312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:20.821520 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2cd25cda-7301-4501-a772-ab90fa04c137 req-46869117-505c-4bbe-b2a7-9f348cb2cda1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085094 Jul 26 14:45:20.824597 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2792/5455] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:45:20.961520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f40b45df-4a2f-4fa6-995c-18f4c96540cf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:20.985212 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f40b45df-4a2f-4fa6-995c-18f4c96540cf tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1372 microversion: 2.1 time: 0.400387 Jul 26 14:45:20.991990 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2664/5456] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:20 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1372 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:22.017990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-80a469b5-90b9-406f-af58-fb0ca526f354 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:22.019455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-80a469b5-90b9-406f-af58-fb0ca526f354 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:22.023857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:22.043798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80a469b5-90b9-406f-af58-fb0ca526f354 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:22.045554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80a469b5-90b9-406f-af58-fb0ca526f354 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:22.048372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80a469b5-90b9-406f-af58-fb0ca526f354 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:22.048836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80a469b5-90b9-406f-af58-fb0ca526f354 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:22.290147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-80a469b5-90b9-406f-af58-fb0ca526f354 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:22.300738 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-80a469b5-90b9-406f-af58-fb0ca526f354 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1372 microversion: 2.1 time: 0.289539 Jul 26 14:45:22.318527 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2793/5457] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:22 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1372 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:23.322718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fde57de7-7b81-471c-9207-db2ed229ed42 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:23.324086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fde57de7-7b81-471c-9207-db2ed229ed42 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:23.332406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fde57de7-7b81-471c-9207-db2ed229ed42 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:23.333134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fde57de7-7b81-471c-9207-db2ed229ed42 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:23.334261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fde57de7-7b81-471c-9207-db2ed229ed42 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:23.334859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fde57de7-7b81-471c-9207-db2ed229ed42 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:23.526353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fde57de7-7b81-471c-9207-db2ed229ed42 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:23.539222 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fde57de7-7b81-471c-9207-db2ed229ed42 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1544 microversion: 2.1 time: 0.220334 Jul 26 14:45:23.540325 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2665/5458] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:23 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1544 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:23.561206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ea1b90f-b929-4b5e-b157-37881c1bfc9f tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:23.562523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ea1b90f-b929-4b5e-b157-37881c1bfc9f tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:23.571931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ea1b90f-b929-4b5e-b157-37881c1bfc9f tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:23.573754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ea1b90f-b929-4b5e-b157-37881c1bfc9f tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:23.574549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ea1b90f-b929-4b5e-b157-37881c1bfc9f tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:23.574994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ea1b90f-b929-4b5e-b157-37881c1bfc9f tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:23.753147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7ea1b90f-b929-4b5e-b157-37881c1bfc9f tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:23.763337 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ea1b90f-b929-4b5e-b157-37881c1bfc9f tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1544 microversion: 2.1 time: 0.206670 Jul 26 14:45:23.767437 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2794/5459] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:23 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1544 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:29.329801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-092881fc-df6a-4554-97af-a2e64dfb6abc tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bda53201-1b28-46b0-a7b7-abb813a46436"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:29.341651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-092881fc-df6a-4554-97af-a2e64dfb6abc tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:29.351943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-092881fc-df6a-4554-97af-a2e64dfb6abc tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:29.352764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-092881fc-df6a-4554-97af-a2e64dfb6abc tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:29.353780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-092881fc-df6a-4554-97af-a2e64dfb6abc tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:29.354443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-092881fc-df6a-4554-97af-a2e64dfb6abc tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:29.694129 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-092881fc-df6a-4554-97af-a2e64dfb6abc tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365560 Jul 26 14:45:29.694802 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2666/5460] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:45:29 2022] POST /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:42.284915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb30aee6-2fc3-489e-8751-ca688aeddca2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:42.288638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cb30aee6-2fc3-489e-8751-ca688aeddca2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:42.292682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:42.294350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=41 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:42.305493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb30aee6-2fc3-489e-8751-ca688aeddca2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:42.306376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb30aee6-2fc3-489e-8751-ca688aeddca2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:42.308506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb30aee6-2fc3-489e-8751-ca688aeddca2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:42.309198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb30aee6-2fc3-489e-8751-ca688aeddca2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:42.375447 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cb30aee6-2fc3-489e-8751-ca688aeddca2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109/action" status: 200 len: 24567 microversion: 2.1 time: 0.097774 Jul 26 14:45:42.376335 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2795/5461] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:45:42 2022] POST /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109/action => generated 24567 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:45:45.277667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:45.279905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:45.286877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a028c343-31ed-4789-9b33-8d4e96ad6ea2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:45.289735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a028c343-31ed-4789-9b33-8d4e96ad6ea2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:45.299643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a028c343-31ed-4789-9b33-8d4e96ad6ea2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:45.300620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a028c343-31ed-4789-9b33-8d4e96ad6ea2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:45.301508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a028c343-31ed-4789-9b33-8d4e96ad6ea2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:45.302026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a028c343-31ed-4789-9b33-8d4e96ad6ea2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:45.338743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-a028c343-31ed-4789-9b33-8d4e96ad6ea2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lazy-loading 'flavor' on Instance uuid 05ee36bc-0796-4af3-a631-93e2060ca82d {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:45:45.522417 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a028c343-31ed-4789-9b33-8d4e96ad6ea2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/action" status: 200 len: 32 microversion: 2.1 time: 0.244384 Jul 26 14:45:45.523303 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2667/5462] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:45:45 2022] POST /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/action => generated 32 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:45:45.536429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2232011a-d5d6-4e6a-a4d0-10f22e057dce tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:45.538975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2232011a-d5d6-4e6a-a4d0-10f22e057dce tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:45.557044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2232011a-d5d6-4e6a-a4d0-10f22e057dce tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:45.557671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2232011a-d5d6-4e6a-a4d0-10f22e057dce tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:45.558628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2232011a-d5d6-4e6a-a4d0-10f22e057dce tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:45.559249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2232011a-d5d6-4e6a-a4d0-10f22e057dce tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:45.793076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2232011a-d5d6-4e6a-a4d0-10f22e057dce tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:45.818652 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2232011a-d5d6-4e6a-a4d0-10f22e057dce tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.287932 Jul 26 14:45:45.819574 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2796/5463] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:45 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:46.846755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-31245a26-f7d8-4985-848e-76a522206152 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:46.848469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-31245a26-f7d8-4985-848e-76a522206152 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:46.856476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31245a26-f7d8-4985-848e-76a522206152 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:46.857495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31245a26-f7d8-4985-848e-76a522206152 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:46.858287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31245a26-f7d8-4985-848e-76a522206152 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:46.858733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31245a26-f7d8-4985-848e-76a522206152 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:47.019002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31245a26-f7d8-4985-848e-76a522206152 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:47.031906 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-31245a26-f7d8-4985-848e-76a522206152 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.192051 Jul 26 14:45:47.032530 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2668/5464] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:46 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:48.057453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0622a51b-4e30-47bb-b89e-5830b29570c0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:48.059617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0622a51b-4e30-47bb-b89e-5830b29570c0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:48.079434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0622a51b-4e30-47bb-b89e-5830b29570c0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:48.081534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0622a51b-4e30-47bb-b89e-5830b29570c0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:48.082608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0622a51b-4e30-47bb-b89e-5830b29570c0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:48.083710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0622a51b-4e30-47bb-b89e-5830b29570c0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:48.322796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0622a51b-4e30-47bb-b89e-5830b29570c0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:48.336697 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0622a51b-4e30-47bb-b89e-5830b29570c0 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.286405 Jul 26 14:45:48.339488 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2797/5465] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:48 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:49.359627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cb6f471e-2bfc-494a-9eac-b8009a93fd67 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:49.360891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cb6f471e-2bfc-494a-9eac-b8009a93fd67 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:49.372836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb6f471e-2bfc-494a-9eac-b8009a93fd67 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:49.373501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb6f471e-2bfc-494a-9eac-b8009a93fd67 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:49.374473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb6f471e-2bfc-494a-9eac-b8009a93fd67 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:49.375089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb6f471e-2bfc-494a-9eac-b8009a93fd67 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:49.679784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb6f471e-2bfc-494a-9eac-b8009a93fd67 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:49.698217 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cb6f471e-2bfc-494a-9eac-b8009a93fd67 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.344244 Jul 26 14:45:49.715693 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2669/5466] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:49 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:50.111659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e586d6c3-06fa-45ea-8752-23f108b1c99c tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:50.115612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e586d6c3-06fa-45ea-8752-23f108b1c99c tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:50.127287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e586d6c3-06fa-45ea-8752-23f108b1c99c tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:50.129095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e586d6c3-06fa-45ea-8752-23f108b1c99c tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:50.130131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e586d6c3-06fa-45ea-8752-23f108b1c99c tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:50.130773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e586d6c3-06fa-45ea-8752-23f108b1c99c tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:50.175892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e586d6c3-06fa-45ea-8752-23f108b1c99c tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:45:50.315646 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e586d6c3-06fa-45ea-8752-23f108b1c99c tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 204 len: 0 microversion: 2.1 time: 0.211396 Jul 26 14:45:50.316471 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2798/5467] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:45:50 2022] DELETE /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:45:50.326470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-abbd5280-5849-4671-91cf-eae6c3594112 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:50.327164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-abbd5280-5849-4671-91cf-eae6c3594112 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:50.337106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abbd5280-5849-4671-91cf-eae6c3594112 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:50.337565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abbd5280-5849-4671-91cf-eae6c3594112 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:50.338363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abbd5280-5849-4671-91cf-eae6c3594112 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:50.338802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-abbd5280-5849-4671-91cf-eae6c3594112 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:50.709281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-abbd5280-5849-4671-91cf-eae6c3594112 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:50.726354 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-abbd5280-5849-4671-91cf-eae6c3594112 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1550 microversion: 2.1 time: 0.405163 Jul 26 14:45:50.727476 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2670/5468] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:50 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1550 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:50.729896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8da6b4f5-0dd1-4257-9b24-db285ce4f6ea tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:50.734388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8da6b4f5-0dd1-4257-9b24-db285ce4f6ea tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:50.747856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8da6b4f5-0dd1-4257-9b24-db285ce4f6ea tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:50.752329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8da6b4f5-0dd1-4257-9b24-db285ce4f6ea tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:50.753826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8da6b4f5-0dd1-4257-9b24-db285ce4f6ea tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:50.755269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8da6b4f5-0dd1-4257-9b24-db285ce4f6ea tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:51.003698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8da6b4f5-0dd1-4257-9b24-db285ce4f6ea tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:51.014608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8da6b4f5-0dd1-4257-9b24-db285ce4f6ea tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.291756 Jul 26 14:45:51.015428 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2799/5469] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:50 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:51.754496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ed52bee5-32f7-4fdf-982d-3efae5955bec tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:51.755113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ed52bee5-32f7-4fdf-982d-3efae5955bec tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:51.763922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed52bee5-32f7-4fdf-982d-3efae5955bec tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:51.765142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed52bee5-32f7-4fdf-982d-3efae5955bec tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:51.766111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed52bee5-32f7-4fdf-982d-3efae5955bec tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:51.766693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed52bee5-32f7-4fdf-982d-3efae5955bec tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:52.039973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9b287226-df64-4717-a078-bcc2fb2342ec tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:52.040609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9b287226-df64-4717-a078-bcc2fb2342ec tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:52.051550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b287226-df64-4717-a078-bcc2fb2342ec tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:52.056991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b287226-df64-4717-a078-bcc2fb2342ec tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:52.058016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b287226-df64-4717-a078-bcc2fb2342ec tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:52.058487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9b287226-df64-4717-a078-bcc2fb2342ec tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:52.095247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ed52bee5-32f7-4fdf-982d-3efae5955bec tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:52.113047 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ed52bee5-32f7-4fdf-982d-3efae5955bec tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1550 microversion: 2.1 time: 0.359614 Jul 26 14:45:52.116591 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2671/5470] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:51 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1550 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:52.363365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9b287226-df64-4717-a078-bcc2fb2342ec tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:52.373253 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9b287226-df64-4717-a078-bcc2fb2342ec tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.338433 Jul 26 14:45:52.374693 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2800/5471] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:52 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:52.670650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-0553ffe1-52b7-4ec9-bc5a-37ad097deb08 req-d4e74bd4-8627-4f09-bebf-1302eae22ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1446dd90-9bc1-45a2-ace0-eb284689339c", "name": "network-vif-deleted", "tag": "5bb6ef53-acf5-4cf8-bf20-077aa8aec989"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:52.694163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0553ffe1-52b7-4ec9-bc5a-37ad097deb08 req-d4e74bd4-8627-4f09-bebf-1302eae22ac5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:52.697762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0553ffe1-52b7-4ec9-bc5a-37ad097deb08 req-d4e74bd4-8627-4f09-bebf-1302eae22ac5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:52.716692 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-0553ffe1-52b7-4ec9-bc5a-37ad097deb08 req-d4e74bd4-8627-4f09-bebf-1302eae22ac5 service nova] Creating event network-vif-deleted:5bb6ef53-acf5-4cf8-bf20-077aa8aec989 for instance 1446dd90-9bc1-45a2-ace0-eb284689339c on n-h1-833090-9 Jul 26 14:45:52.726748 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-0553ffe1-52b7-4ec9-bc5a-37ad097deb08 req-d4e74bd4-8627-4f09-bebf-1302eae22ac5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059987 Jul 26 14:45:52.727425 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2672/5472] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:53.139464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:53.140323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:53.168354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:53.169144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:53.175451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:53.183264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:53.262652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:53.263112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:53.263634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lazy-loading 'fault' on Instance uuid 1446dd90-9bc1-45a2-ace0-eb284689339c {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:45:53.345039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:53.353736 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71861787-d4bf-491b-a566-52bed9433647 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 200 len: 1336 microversion: 2.1 time: 0.219389 Jul 26 14:45:53.372541 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2801/5473] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:53 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 1336 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:53.401733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad998e25-bcd8-4c28-afeb-2e75722fcb6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:53.402447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ad998e25-bcd8-4c28-afeb-2e75722fcb6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:53.417644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad998e25-bcd8-4c28-afeb-2e75722fcb6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:53.418347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad998e25-bcd8-4c28-afeb-2e75722fcb6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:53.419477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad998e25-bcd8-4c28-afeb-2e75722fcb6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:53.420216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad998e25-bcd8-4c28-afeb-2e75722fcb6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:53.420643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-98c85c85-4b17-41f6-a9e0-ef51c74ea36a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:53.421505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-98c85c85-4b17-41f6-a9e0-ef51c74ea36a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:53.432080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98c85c85-4b17-41f6-a9e0-ef51c74ea36a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:53.432543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98c85c85-4b17-41f6-a9e0-ef51c74ea36a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:53.433332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98c85c85-4b17-41f6-a9e0-ef51c74ea36a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:53.440556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-98c85c85-4b17-41f6-a9e0-ef51c74ea36a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:53.789600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ad998e25-bcd8-4c28-afeb-2e75722fcb6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:53.827855 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad998e25-bcd8-4c28-afeb-2e75722fcb6b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.431070 Jul 26 14:45:53.829219 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2673/5474] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:53 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:53.907631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-98c85c85-4b17-41f6-a9e0-ef51c74ea36a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:53.928140 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-98c85c85-4b17-41f6-a9e0-ef51c74ea36a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1679 microversion: 2.1 time: 0.511535 Jul 26 14:45:53.928953 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2802/5475] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:53 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1679 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:54.063045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-843ca5e0-fa55-4247-8c9a-6d1afd5ef15b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:54.066163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-843ca5e0-fa55-4247-8c9a-6d1afd5ef15b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:54.073027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-843ca5e0-fa55-4247-8c9a-6d1afd5ef15b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:54.073708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-843ca5e0-fa55-4247-8c9a-6d1afd5ef15b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:54.074660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-843ca5e0-fa55-4247-8c9a-6d1afd5ef15b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:54.075266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-843ca5e0-fa55-4247-8c9a-6d1afd5ef15b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:54.178912 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-843ca5e0-fa55-4247-8c9a-6d1afd5ef15b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109/action" status: 200 len: 32639 microversion: 2.1 time: 0.120235 Jul 26 14:45:54.190535 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2674/5476] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:45:54 2022] POST /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109/action => generated 32639 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:45:54.359225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-183f046e-4bc0-45ee-82d5-ee259877e622 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:54.360528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-183f046e-4bc0-45ee-82d5-ee259877e622 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:54.369477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-183f046e-4bc0-45ee-82d5-ee259877e622 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:54.370444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-183f046e-4bc0-45ee-82d5-ee259877e622 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:54.371608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-183f046e-4bc0-45ee-82d5-ee259877e622 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:54.374550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-183f046e-4bc0-45ee-82d5-ee259877e622 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:54.382055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fbd653e4-2894-428f-a9c7-68cb91fe4e54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:54.383684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fbd653e4-2894-428f-a9c7-68cb91fe4e54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 1446dd90-9bc1-45a2-ace0-eb284689339c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:54.398380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fbd653e4-2894-428f-a9c7-68cb91fe4e54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:54.402794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fbd653e4-2894-428f-a9c7-68cb91fe4e54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:54.404715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fbd653e4-2894-428f-a9c7-68cb91fe4e54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:54.406439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fbd653e4-2894-428f-a9c7-68cb91fe4e54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:54.441752 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-fbd653e4-2894-428f-a9c7-68cb91fe4e54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] HTTP exception thrown: Instance 1446dd90-9bc1-45a2-ace0-eb284689339c could not be found. Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fbd653e4-2894-428f-a9c7-68cb91fe4e54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Request method failure captured: Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c HTTP/1.1 Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_2I2HtxkIUudDNkoI2Wp2KO1NGiK8pwDFUZm6R4O3GshAnU9tliPKB_OWOwSDCuuypMoONAlZtfr36nG85E3my7AtpI-8XnylZIHt_xKtM1L0lJR0HLIww-vyd-kFAjoMxe2o588f2z5WZ5-9aNiqIqlaTBpAqUYv5zHPYMcKvythU Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 54967e3bd292459a81121b90b03fde3b Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestNetworkBasicOps-1511396651 Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/54967e3bd292459a81121b90b03fde3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/54967e3bd292459a81121b90b03fde3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_54967e3bd292459a81121b90b03fde3b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/54967e3bd292459a81121b90b03fde3b"}]}] Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestNetworkBasicOps-1511396651 Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 54967e3bd292459a81121b90b03fde3b Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestNetworkBasicOps-1511396651 Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestNetworkBasicOps-1511396651-project Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 5e1adb391e2f425892a83762aaa6eb43 Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestNetworkBasicOps-1511396651-project Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 1446dd90-9bc1-45a2-ace0-eb284689339c could not be found. Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '1446dd90-9bc1-45a2-ace0-eb284689339c'} Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1446dd90-9bc1-45a2-ace0-eb284689339c could not be found. Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1446dd90-9bc1-45a2-ace0-eb284689339c could not be found. Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:45:54.443841 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:45:54.448160 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:45:54.448160 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:45:54.448160 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:45:54.448160 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:45:54.448160 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:45:54.448160 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1446dd90-9bc1-45a2-ace0-eb284689339c could not be found. Jul 26 14:45:54.448160 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:45:54.453407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fbd653e4-2894-428f-a9c7-68cb91fe4e54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Returning 404 to user: Instance 1446dd90-9bc1-45a2-ace0-eb284689339c could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:45:54.454463 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fbd653e4-2894-428f-a9c7-68cb91fe4e54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c" status: 404 len: 111 microversion: 2.1 time: 0.078438 Jul 26 14:45:54.455962 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2675/5477] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:54 2022] GET /compute/v2.1/servers/1446dd90-9bc1-45a2-ace0-eb284689339c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:45:54.711349 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-183f046e-4bc0-45ee-82d5-ee259877e622 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1830 microversion: 2.1 time: 0.355860 Jul 26 14:45:54.712927 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2803/5478] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:54 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1830 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:54.747507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fa218217-df6f-4e82-8d00-3381ed5cadfc tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:54.750501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fa218217-df6f-4e82-8d00-3381ed5cadfc tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:54.760261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa218217-df6f-4e82-8d00-3381ed5cadfc tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:54.761729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa218217-df6f-4e82-8d00-3381ed5cadfc tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:54.762799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa218217-df6f-4e82-8d00-3381ed5cadfc tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:54.763282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa218217-df6f-4e82-8d00-3381ed5cadfc tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:54.767677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2b5f8b49-770d-41b4-85c7-067580ad5cf6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '.version_select at 0x7f8787f46430>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:54.808688 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2b5f8b49-770d-41b4-85c7-067580ad5cf6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-230295393" status: 202 len: 0 microversion: 2.1 time: 0.045328 Jul 26 14:45:54.809279 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2804/5479] 10.222.0.70 () {58 vars in 1254 bytes} [Tue Jul 26 14:45:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-230295393 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:45:54.854837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-05efe768-50ef-41a6-bbb3-4ae3d8b2c095 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:54.855501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-05efe768-50ef-41a6-bbb3-4ae3d8b2c095 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:54.867061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05efe768-50ef-41a6-bbb3-4ae3d8b2c095 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:54.867863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05efe768-50ef-41a6-bbb3-4ae3d8b2c095 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:54.870927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05efe768-50ef-41a6-bbb3-4ae3d8b2c095 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:54.871800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05efe768-50ef-41a6-bbb3-4ae3d8b2c095 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:55.061092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-05efe768-50ef-41a6-bbb3-4ae3d8b2c095 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:55.082731 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-05efe768-50ef-41a6-bbb3-4ae3d8b2c095 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.231876 Jul 26 14:45:55.101534 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2805/5480] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:54 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:45:55.125255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-fa218217-df6f-4e82-8d00-3381ed5cadfc tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lazy-loading 'flavor' on Instance uuid 04017d0a-b2a7-43f6-89b7-dd7078716109 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:45:55.142100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fa218217-df6f-4e82-8d00-3381ed5cadfc tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Going to try to live migrate instance to another host {{(pid=119478) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 26 14:45:56.118426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b128f4eb-500e-454c-9899-508830df31a6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:56.119691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b128f4eb-500e-454c-9899-508830df31a6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:56.138466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b128f4eb-500e-454c-9899-508830df31a6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:56.138943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b128f4eb-500e-454c-9899-508830df31a6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:56.140123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b128f4eb-500e-454c-9899-508830df31a6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:56.146460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b128f4eb-500e-454c-9899-508830df31a6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:56.544777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b128f4eb-500e-454c-9899-508830df31a6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:56.553944 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b128f4eb-500e-454c-9899-508830df31a6 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.441595 Jul 26 14:45:56.557486 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2806/5481] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:56 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:57.585153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1b216228-06fa-4798-8707-5470cfcd4605 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:57.588029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1b216228-06fa-4798-8707-5470cfcd4605 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:57.623185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b216228-06fa-4798-8707-5470cfcd4605 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:57.625013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b216228-06fa-4798-8707-5470cfcd4605 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:57.627845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b216228-06fa-4798-8707-5470cfcd4605 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:57.628645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b216228-06fa-4798-8707-5470cfcd4605 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:57.901100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1b216228-06fa-4798-8707-5470cfcd4605 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:57.916360 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1b216228-06fa-4798-8707-5470cfcd4605 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.338673 Jul 26 14:45:57.919417 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2807/5482] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:57 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:58.778450 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fa218217-df6f-4e82-8d00-3381ed5cadfc tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109/action" status: 202 len: 0 microversion: 2.1 time: 4.036016 Jul 26 14:45:58.783206 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2676/5483] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:45:54 2022] POST /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109/action => generated 0 bytes in 4038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:45:58.790599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c2e0736a-90b2-48df-830a-80654ba1c5cf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:58.791504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c2e0736a-90b2-48df-830a-80654ba1c5cf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:58.805830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2e0736a-90b2-48df-830a-80654ba1c5cf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:58.809642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2e0736a-90b2-48df-830a-80654ba1c5cf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:58.810584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2e0736a-90b2-48df-830a-80654ba1c5cf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:58.814019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2e0736a-90b2-48df-830a-80654ba1c5cf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:58.860744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-60a55051-be19-4be4-bd64-74cdf2622cb0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:58.863624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-60a55051-be19-4be4-bd64-74cdf2622cb0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:58.915930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60a55051-be19-4be4-bd64-74cdf2622cb0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:58.916423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60a55051-be19-4be4-bd64-74cdf2622cb0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:58.917237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60a55051-be19-4be4-bd64-74cdf2622cb0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:58.926064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60a55051-be19-4be4-bd64-74cdf2622cb0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:59.044301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-60a55051-be19-4be4-bd64-74cdf2622cb0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:45:59.044496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c2e0736a-90b2-48df-830a-80654ba1c5cf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:45:59.054391 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c2e0736a-90b2-48df-830a-80654ba1c5cf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1689 microversion: 2.1 time: 0.269193 Jul 26 14:45:59.055622 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2808/5484] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:58 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1689 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:59.061070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-166fd708-7e3e-4d8d-a496-eccd21743a29 req-2afee55f-1f60-44ba-a4e8-7cb1951e023c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd4ea991-3f52-4e13-a1fa-eebad7166577", "tag": "a6d67ae6-7bc4-4ab6-a09c-34ea992b22f0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:59.072377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-166fd708-7e3e-4d8d-a496-eccd21743a29 req-2afee55f-1f60-44ba-a4e8-7cb1951e023c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:59.073536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-166fd708-7e3e-4d8d-a496-eccd21743a29 req-2afee55f-1f60-44ba-a4e8-7cb1951e023c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:59.086971 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-166fd708-7e3e-4d8d-a496-eccd21743a29 req-2afee55f-1f60-44ba-a4e8-7cb1951e023c service nova] Creating event network-changed:a6d67ae6-7bc4-4ab6-a09c-34ea992b22f0 for instance bd4ea991-3f52-4e13-a1fa-eebad7166577 on n-h2-833090-9 Jul 26 14:45:59.093850 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-166fd708-7e3e-4d8d-a496-eccd21743a29 req-2afee55f-1f60-44ba-a4e8-7cb1951e023c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036218 Jul 26 14:45:59.095007 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2809/5485] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:59.101518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08e0bddf-3836-4685-9a3d-f5cbf9b82a93 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:59.102638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08e0bddf-3836-4685-9a3d-f5cbf9b82a93 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:59.115519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e0bddf-3836-4685-9a3d-f5cbf9b82a93 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:59.116643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e0bddf-3836-4685-9a3d-f5cbf9b82a93 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:59.119007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e0bddf-3836-4685-9a3d-f5cbf9b82a93 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:59.123526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08e0bddf-3836-4685-9a3d-f5cbf9b82a93 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:59.326817 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-60a55051-be19-4be4-bd64-74cdf2622cb0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 204 len: 0 microversion: 2.1 time: 0.470350 Jul 26 14:45:59.327818 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2677/5486] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:45:58 2022] DELETE /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:45:59.350584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-560ebed0-2772-4d49-b66a-9b107263f14a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:59.352448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-560ebed0-2772-4d49-b66a-9b107263f14a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:45:59.378833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-560ebed0-2772-4d49-b66a-9b107263f14a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:59.380484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-560ebed0-2772-4d49-b66a-9b107263f14a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:45:59.384908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-560ebed0-2772-4d49-b66a-9b107263f14a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:45:59.393293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-560ebed0-2772-4d49-b66a-9b107263f14a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:00.417612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-560ebed0-2772-4d49-b66a-9b107263f14a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:00.437092 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-560ebed0-2772-4d49-b66a-9b107263f14a tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1669 microversion: 2.1 time: 1.102695 Jul 26 14:46:00.442781 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2678/5487] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:59 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1669 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:00.446122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-08e0bddf-3836-4685-9a3d-f5cbf9b82a93 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:00.453826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b0c8119a-39ef-4b66-8e19-681ca0f73a49 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:00.454461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b0c8119a-39ef-4b66-8e19-681ca0f73a49 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:00.459476 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08e0bddf-3836-4685-9a3d-f5cbf9b82a93 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 1.362489 Jul 26 14:46:00.461437 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2810/5488] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:45:59 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:00.473357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0c8119a-39ef-4b66-8e19-681ca0f73a49 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:00.479610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0c8119a-39ef-4b66-8e19-681ca0f73a49 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:00.480884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0c8119a-39ef-4b66-8e19-681ca0f73a49 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:00.481714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0c8119a-39ef-4b66-8e19-681ca0f73a49 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:00.951553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b0c8119a-39ef-4b66-8e19-681ca0f73a49 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:00.955564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:00.961029 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b0c8119a-39ef-4b66-8e19-681ca0f73a49 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1689 microversion: 2.1 time: 0.517143 Jul 26 14:46:00.972873 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2679/5489] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:00 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1689 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:01.464564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f4555bca-6af8-41f6-ab55-4d6da53e38b6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:01.465193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f4555bca-6af8-41f6-ab55-4d6da53e38b6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:01.472562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4555bca-6af8-41f6-ab55-4d6da53e38b6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:01.473032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4555bca-6af8-41f6-ab55-4d6da53e38b6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:01.473821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4555bca-6af8-41f6-ab55-4d6da53e38b6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:01.474266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f4555bca-6af8-41f6-ab55-4d6da53e38b6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:01.497887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a23d9a3f-6c72-448c-957f-99dc62ffd4bd tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:01.500054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a23d9a3f-6c72-448c-957f-99dc62ffd4bd tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:01.520944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a23d9a3f-6c72-448c-957f-99dc62ffd4bd tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:01.523204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a23d9a3f-6c72-448c-957f-99dc62ffd4bd tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:01.526189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a23d9a3f-6c72-448c-957f-99dc62ffd4bd tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:01.527204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a23d9a3f-6c72-448c-957f-99dc62ffd4bd tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:01.547984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:02.088963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a23d9a3f-6c72-448c-957f-99dc62ffd4bd tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:02.105242 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a23d9a3f-6c72-448c-957f-99dc62ffd4bd tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.613808 Jul 26 14:46:02.105694 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2680/5490] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:01 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:02.125937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f4555bca-6af8-41f6-ab55-4d6da53e38b6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:02.129806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-76dc8ff7-1041-4812-9c5a-d2874f1f9944 req-4ce575d1-77cb-4663-af62-b3840b31ce2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04017d0a-b2a7-43f6-89b7-dd7078716109", "name": "network-vif-unplugged", "status": "completed", "tag": "6dd56902-bd9a-4e87-a5aa-87bd37cc1b61"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:02.141205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-76dc8ff7-1041-4812-9c5a-d2874f1f9944 req-4ce575d1-77cb-4663-af62-b3840b31ce2f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:02.141834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-76dc8ff7-1041-4812-9c5a-d2874f1f9944 req-4ce575d1-77cb-4663-af62-b3840b31ce2f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:02.145869 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f4555bca-6af8-41f6-ab55-4d6da53e38b6 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1550 microversion: 2.1 time: 0.684261 Jul 26 14:46:02.159779 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2811/5491] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:01 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1550 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:02.170755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f0279dfa-ca35-4450-b27d-2beb7e3575f4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:02.171814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f0279dfa-ca35-4450-b27d-2beb7e3575f4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:02.179439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0279dfa-ca35-4450-b27d-2beb7e3575f4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:02.180709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0279dfa-ca35-4450-b27d-2beb7e3575f4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:02.181842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0279dfa-ca35-4450-b27d-2beb7e3575f4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:02.182530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0279dfa-ca35-4450-b27d-2beb7e3575f4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:02.215461 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-76dc8ff7-1041-4812-9c5a-d2874f1f9944 req-4ce575d1-77cb-4663-af62-b3840b31ce2f service nova] Creating event network-vif-unplugged:6dd56902-bd9a-4e87-a5aa-87bd37cc1b61 for instance 04017d0a-b2a7-43f6-89b7-dd7078716109 on n-h2-833090-9 Jul 26 14:46:02.240999 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-76dc8ff7-1041-4812-9c5a-d2874f1f9944 req-4ce575d1-77cb-4663-af62-b3840b31ce2f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115032 Jul 26 14:46:02.242148 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2681/5492] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:02.644877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ed59b699-f8fd-4c48-80aa-dc33de85584c req-624d453d-583c-42dd-afdc-aeef26437faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd4ea991-3f52-4e13-a1fa-eebad7166577", "name": "network-vif-deleted", "tag": "a6d67ae6-7bc4-4ab6-a09c-34ea992b22f0"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:02.675327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ed59b699-f8fd-4c48-80aa-dc33de85584c req-624d453d-583c-42dd-afdc-aeef26437faf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:02.678151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ed59b699-f8fd-4c48-80aa-dc33de85584c req-624d453d-583c-42dd-afdc-aeef26437faf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:02.761331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f0279dfa-ca35-4450-b27d-2beb7e3575f4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:02.762804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ed59b699-f8fd-4c48-80aa-dc33de85584c req-624d453d-583c-42dd-afdc-aeef26437faf service nova] Creating event network-vif-deleted:a6d67ae6-7bc4-4ab6-a09c-34ea992b22f0 for instance bd4ea991-3f52-4e13-a1fa-eebad7166577 on n-h2-833090-9 Jul 26 14:46:02.790667 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f0279dfa-ca35-4450-b27d-2beb7e3575f4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1689 microversion: 2.1 time: 0.628616 Jul 26 14:46:02.793074 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ed59b699-f8fd-4c48-80aa-dc33de85584c req-624d453d-583c-42dd-afdc-aeef26437faf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153152 Jul 26 14:46:02.793997 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2812/5493] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:02 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1689 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:02.794246 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2682/5494] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:46:03.127234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aba77c31-4eb6-44cc-bebb-0788441e92a4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:03.128233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aba77c31-4eb6-44cc-bebb-0788441e92a4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:03.160370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aba77c31-4eb6-44cc-bebb-0788441e92a4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:03.165647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aba77c31-4eb6-44cc-bebb-0788441e92a4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:03.172549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aba77c31-4eb6-44cc-bebb-0788441e92a4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:03.176878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aba77c31-4eb6-44cc-bebb-0788441e92a4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:03.181475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:03.184872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:03.198842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:03.199781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:03.200813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:03.201420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:03.290783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:03.291256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:03.291736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lazy-loading 'fault' on Instance uuid bd4ea991-3f52-4e13-a1fa-eebad7166577 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:46:03.474541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:03.484324 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-36e4daaf-9d57-4579-a792-66ec23224c2d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 200 len: 1337 microversion: 2.1 time: 0.312625 Jul 26 14:46:03.502570 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2683/5495] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:03 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 1337 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:03.670260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aba77c31-4eb6-44cc-bebb-0788441e92a4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:03.680981 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aba77c31-4eb6-44cc-bebb-0788441e92a4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1733 microversion: 2.1 time: 0.558093 Jul 26 14:46:03.682309 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2813/5496] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:03 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1733 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:03.817862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1a5d0cee-97d7-4248-8aa0-6ab5c0dc7d05 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:03.819239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1a5d0cee-97d7-4248-8aa0-6ab5c0dc7d05 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:03.827781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a5d0cee-97d7-4248-8aa0-6ab5c0dc7d05 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:03.828899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a5d0cee-97d7-4248-8aa0-6ab5c0dc7d05 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:03.831042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a5d0cee-97d7-4248-8aa0-6ab5c0dc7d05 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:03.832145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1a5d0cee-97d7-4248-8aa0-6ab5c0dc7d05 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:04.077670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1a5d0cee-97d7-4248-8aa0-6ab5c0dc7d05 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:04.086914 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1a5d0cee-97d7-4248-8aa0-6ab5c0dc7d05 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1689 microversion: 2.1 time: 0.274522 Jul 26 14:46:04.088351 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2684/5497] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:03 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1689 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:04.285509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a8de3efd-d92e-4880-a5eb-0b682e3e1b6f req-4e7c6f2f-fe19-421d-bcea-3625366bf834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04017d0a-b2a7-43f6-89b7-dd7078716109", "tag": "6dd56902-bd9a-4e87-a5aa-87bd37cc1b61"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:04.307498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a8de3efd-d92e-4880-a5eb-0b682e3e1b6f req-4e7c6f2f-fe19-421d-bcea-3625366bf834 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:04.307885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a8de3efd-d92e-4880-a5eb-0b682e3e1b6f req-4e7c6f2f-fe19-421d-bcea-3625366bf834 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:04.353689 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a8de3efd-d92e-4880-a5eb-0b682e3e1b6f req-4e7c6f2f-fe19-421d-bcea-3625366bf834 service nova] Creating event network-changed:6dd56902-bd9a-4e87-a5aa-87bd37cc1b61 for instance 04017d0a-b2a7-43f6-89b7-dd7078716109 on n-h2-833090-9 Jul 26 14:46:04.359309 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a8de3efd-d92e-4880-a5eb-0b682e3e1b6f req-4e7c6f2f-fe19-421d-bcea-3625366bf834 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078457 Jul 26 14:46:04.360322 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2814/5498] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:04.513325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-356064cf-4cd7-4b9b-a843-3eec95565cc3 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:04.514209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-356064cf-4cd7-4b9b-a843-3eec95565cc3 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: bd4ea991-3f52-4e13-a1fa-eebad7166577] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:04.525366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-356064cf-4cd7-4b9b-a843-3eec95565cc3 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:04.526290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-356064cf-4cd7-4b9b-a843-3eec95565cc3 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:04.532754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-356064cf-4cd7-4b9b-a843-3eec95565cc3 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:04.534094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-356064cf-4cd7-4b9b-a843-3eec95565cc3 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:04.589455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-356064cf-4cd7-4b9b-a843-3eec95565cc3 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] HTTP exception thrown: Instance bd4ea991-3f52-4e13-a1fa-eebad7166577 could not be found. Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-356064cf-4cd7-4b9b-a843-3eec95565cc3 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Request method failure captured: Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 HTTP/1.1 Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_2I2HtxkIUudDNkoI2Wp2KO1NGiK8pwDFUZm6R4O3GshAnU9tliPKB_OWOwSDCuuypMoONAlZtfr36nG85E3my7AtpI-8XnylZIHt_xKtM1L0lJR0HLIww-vyd-kFAjoMxe2o588f2z5WZ5-9aNiqIqlaTBpAqUYv5zHPYMcKvythU Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 54967e3bd292459a81121b90b03fde3b Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestNetworkBasicOps-1511396651 Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/54967e3bd292459a81121b90b03fde3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/54967e3bd292459a81121b90b03fde3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_54967e3bd292459a81121b90b03fde3b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/54967e3bd292459a81121b90b03fde3b"}]}] Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestNetworkBasicOps-1511396651 Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 54967e3bd292459a81121b90b03fde3b Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestNetworkBasicOps-1511396651 Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestNetworkBasicOps-1511396651-project Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 5e1adb391e2f425892a83762aaa6eb43 Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestNetworkBasicOps-1511396651-project Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance bd4ea991-3f52-4e13-a1fa-eebad7166577 could not be found. Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'bd4ea991-3f52-4e13-a1fa-eebad7166577'} Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd4ea991-3f52-4e13-a1fa-eebad7166577 could not be found. Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd4ea991-3f52-4e13-a1fa-eebad7166577 could not be found. Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:46:04.594009 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:04.598793 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:04.598793 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:46:04.598793 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:46:04.598793 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:46:04.598793 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:46:04.598793 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd4ea991-3f52-4e13-a1fa-eebad7166577 could not be found. Jul 26 14:46:04.598793 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:04.608876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-356064cf-4cd7-4b9b-a843-3eec95565cc3 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Returning 404 to user: Instance bd4ea991-3f52-4e13-a1fa-eebad7166577 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:46:04.612501 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-356064cf-4cd7-4b9b-a843-3eec95565cc3 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577" status: 404 len: 111 microversion: 2.1 time: 0.103376 Jul 26 14:46:04.616220 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2685/5499] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:04 2022] GET /compute/v2.1/servers/bd4ea991-3f52-4e13-a1fa-eebad7166577 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:46:04.703697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-331142aa-01d4-417e-89eb-88d9bda8a642 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:04.704554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-331142aa-01d4-417e-89eb-88d9bda8a642 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:04.718559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-331142aa-01d4-417e-89eb-88d9bda8a642 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:04.719033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-331142aa-01d4-417e-89eb-88d9bda8a642 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:04.719858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-331142aa-01d4-417e-89eb-88d9bda8a642 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:04.720337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-331142aa-01d4-417e-89eb-88d9bda8a642 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:05.116615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1843ae38-c30e-4e1d-8754-6e45dc5ab01b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:05.118575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1843ae38-c30e-4e1d-8754-6e45dc5ab01b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:05.146709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1843ae38-c30e-4e1d-8754-6e45dc5ab01b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:05.147659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1843ae38-c30e-4e1d-8754-6e45dc5ab01b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:05.154198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1843ae38-c30e-4e1d-8754-6e45dc5ab01b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:05.158623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1843ae38-c30e-4e1d-8754-6e45dc5ab01b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:05.174183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-331142aa-01d4-417e-89eb-88d9bda8a642 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:05.185521 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-331142aa-01d4-417e-89eb-88d9bda8a642 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1713 microversion: 2.1 time: 0.486092 Jul 26 14:46:05.186772 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2815/5500] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:04 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1713 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:05.504619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-646065a3-d087-497c-aded-bf8ed2d9209d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:05.506001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-646065a3-d087-497c-aded-bf8ed2d9209d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:05.521461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-646065a3-d087-497c-aded-bf8ed2d9209d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:05.522269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-646065a3-d087-497c-aded-bf8ed2d9209d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:05.528627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-646065a3-d087-497c-aded-bf8ed2d9209d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:05.529755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-646065a3-d087-497c-aded-bf8ed2d9209d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:05.734210 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-646065a3-d087-497c-aded-bf8ed2d9209d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] HTTP exception thrown: Cannot 'detach_volume' instance 05ee36bc-0796-4af3-a631-93e2060ca82d while it is in vm_state rescued Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-646065a3-d087-497c-aded-bf8ed2d9209d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Request method failure captured: Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments/bda53201-1b28-46b0-a7b7-abb813a46436 HTTP/1.1 Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_1f6ZzJX0S01b_Op3EoMNcBZEG-kX6NKBmC9y8eYSEGGvW2IzzGDCwRHyopc8xJm4faZa9Jll31j2AyA8-1nj2TIW6-NxgVw70z941LrxxyqTc1krrtQixKuVoRbZbeVXl3oq2yJDnuG60YY3irOdy923OsfCXhYNJbHMgyTRh4Lb0 Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7386a23b259b4c4091637972951a3f0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}] Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ca1aaf9a4ab74a829ef94a7d54c683cd Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: exception: Cannot 'detach_volume' instance 05ee36bc-0796-4af3-a631-93e2060ca82d while it is in vm_state rescued Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'server_id': '05ee36bc-0796-4af3-a631-93e2060ca82d', 'id': 'bda53201-1b28-46b0-a7b7-abb813a46436'} Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05ee36bc-0796-4af3-a631-93e2060ca82d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 05ee36bc-0796-4af3-a631-93e2060ca82d while it is in vm_state rescued Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:46:05.737794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:05.745609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:46:05.745609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:46:05.745609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:46:05.745609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:46:05.745609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 05ee36bc-0796-4af3-a631-93e2060ca82d while it is in vm_state rescued Jul 26 14:46:05.745609 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:46:05.745609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-646065a3-d087-497c-aded-bf8ed2d9209d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Returning 409 to user: Cannot 'detach_volume' instance 05ee36bc-0796-4af3-a631-93e2060ca82d while it is in vm_state rescued {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:46:05.745609 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-646065a3-d087-497c-aded-bf8ed2d9209d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments/bda53201-1b28-46b0-a7b7-abb813a46436" status: 409 len: 152 microversion: 2.1 time: 0.243234 Jul 26 14:46:05.745609 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2816/5501] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:46:05 2022] DELETE /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments/bda53201-1b28-46b0-a7b7-abb813a46436 => generated 152 bytes in 245 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 14:46:05.759013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cafbaa3b-036b-4f8e-bd21-83381193e21d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:05.761496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cafbaa3b-036b-4f8e-bd21-83381193e21d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:05.820508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cafbaa3b-036b-4f8e-bd21-83381193e21d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:05.821370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cafbaa3b-036b-4f8e-bd21-83381193e21d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:05.822856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cafbaa3b-036b-4f8e-bd21-83381193e21d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:05.823711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cafbaa3b-036b-4f8e-bd21-83381193e21d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:05.996455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1843ae38-c30e-4e1d-8754-6e45dc5ab01b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:06.012097 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1843ae38-c30e-4e1d-8754-6e45dc5ab01b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1689 microversion: 2.1 time: 0.901403 Jul 26 14:46:06.015412 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2686/5502] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:05 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1689 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:46:06.085075 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cafbaa3b-036b-4f8e-bd21-83381193e21d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/action" status: 202 len: 0 microversion: 2.1 time: 0.329683 Jul 26 14:46:06.085837 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2817/5503] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:46:05 2022] POST /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:46:06.107442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2be46db8-f41c-4ad2-8b6c-7389c8bc6958 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:06.108625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2be46db8-f41c-4ad2-8b6c-7389c8bc6958 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:06.119144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3775e99c-f5a8-4363-84f2-50689f96bea0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '.version_select at 0x7f8786ee2c10>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:06.128218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be46db8-f41c-4ad2-8b6c-7389c8bc6958 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:06.129066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be46db8-f41c-4ad2-8b6c-7389c8bc6958 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:06.136930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be46db8-f41c-4ad2-8b6c-7389c8bc6958 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:06.137755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2be46db8-f41c-4ad2-8b6c-7389c8bc6958 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:06.246773 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3775e99c-f5a8-4363-84f2-50689f96bea0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-703677133" status: 202 len: 0 microversion: 2.1 time: 0.172629 Jul 26 14:46:06.250026 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2687/5504] 10.222.0.70 () {58 vars in 1254 bytes} [Tue Jul 26 14:46:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-703677133 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:46:06.612076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2be46db8-f41c-4ad2-8b6c-7389c8bc6958 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:06.632006 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2be46db8-f41c-4ad2-8b6c-7389c8bc6958 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1721 microversion: 2.1 time: 0.537332 Jul 26 14:46:06.633024 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2818/5505] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:06 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1721 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:07.055243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9dd383bb-ce62-4d95-9f39-891ab0595e6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:07.055872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9dd383bb-ce62-4d95-9f39-891ab0595e6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:07.074582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9dd383bb-ce62-4d95-9f39-891ab0595e6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:07.075047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9dd383bb-ce62-4d95-9f39-891ab0595e6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:07.075855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9dd383bb-ce62-4d95-9f39-891ab0595e6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:07.076336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9dd383bb-ce62-4d95-9f39-891ab0595e6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:07.543778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9dd383bb-ce62-4d95-9f39-891ab0595e6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:07.563535 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9dd383bb-ce62-4d95-9f39-891ab0595e6a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1689 microversion: 2.1 time: 0.505164 Jul 26 14:46:07.582312 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2688/5506] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:07 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1689 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:07.657127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-41e3a7f8-da7d-4368-97ef-d8a0e1e1ee21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:07.658792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-41e3a7f8-da7d-4368-97ef-d8a0e1e1ee21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:07.680051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41e3a7f8-da7d-4368-97ef-d8a0e1e1ee21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:07.680520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41e3a7f8-da7d-4368-97ef-d8a0e1e1ee21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:07.696609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41e3a7f8-da7d-4368-97ef-d8a0e1e1ee21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:07.697386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41e3a7f8-da7d-4368-97ef-d8a0e1e1ee21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:08.438999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-41e3a7f8-da7d-4368-97ef-d8a0e1e1ee21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:08.455153 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-41e3a7f8-da7d-4368-97ef-d8a0e1e1ee21 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1721 microversion: 2.1 time: 0.804215 Jul 26 14:46:08.455905 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2819/5507] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:07 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1721 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:08.587042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2efdd3d3-e664-437a-aa7c-0ba29a982679 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:08.588987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2efdd3d3-e664-437a-aa7c-0ba29a982679 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:08.601354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2efdd3d3-e664-437a-aa7c-0ba29a982679 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:08.605219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2efdd3d3-e664-437a-aa7c-0ba29a982679 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:08.614446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2efdd3d3-e664-437a-aa7c-0ba29a982679 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:08.615351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2efdd3d3-e664-437a-aa7c-0ba29a982679 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:09.337176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-58a18f90-6c09-4002-b5a1-a80017d5c121 req-8858658d-46ad-4676-90e2-71f4762d1725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04017d0a-b2a7-43f6-89b7-dd7078716109", "name": "network-vif-unplugged", "status": "completed", "tag": "6dd56902-bd9a-4e87-a5aa-87bd37cc1b61"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:09.356922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-58a18f90-6c09-4002-b5a1-a80017d5c121 req-8858658d-46ad-4676-90e2-71f4762d1725 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:09.358953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-58a18f90-6c09-4002-b5a1-a80017d5c121 req-8858658d-46ad-4676-90e2-71f4762d1725 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:09.387062 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-58a18f90-6c09-4002-b5a1-a80017d5c121 req-8858658d-46ad-4676-90e2-71f4762d1725 service nova] Creating event network-vif-unplugged:6dd56902-bd9a-4e87-a5aa-87bd37cc1b61 for instance 04017d0a-b2a7-43f6-89b7-dd7078716109 on n-h2-833090-9 Jul 26 14:46:09.395683 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-58a18f90-6c09-4002-b5a1-a80017d5c121 req-8858658d-46ad-4676-90e2-71f4762d1725 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065360 Jul 26 14:46:09.408731 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2820/5508] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:46:09.477463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e3248c2f-3f04-4891-a41e-fe900b2e3cf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:09.478707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e3248c2f-3f04-4891-a41e-fe900b2e3cf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:09.495133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3248c2f-3f04-4891-a41e-fe900b2e3cf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:09.496849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3248c2f-3f04-4891-a41e-fe900b2e3cf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:09.499640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3248c2f-3f04-4891-a41e-fe900b2e3cf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:09.500139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3248c2f-3f04-4891-a41e-fe900b2e3cf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:09.596938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2efdd3d3-e664-437a-aa7c-0ba29a982679 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:09.613506 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2efdd3d3-e664-437a-aa7c-0ba29a982679 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1689 microversion: 2.1 time: 1.031188 Jul 26 14:46:09.625669 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2689/5509] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:08 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1689 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:46:10.325729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e3248c2f-3f04-4891-a41e-fe900b2e3cf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:10.352205 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e3248c2f-3f04-4891-a41e-fe900b2e3cf7 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1721 microversion: 2.1 time: 0.879240 Jul 26 14:46:10.353177 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2821/5510] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:09 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1721 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:46:10.647539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8c37c872-5f6c-4bc4-a0f8-eae2cb9897a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:10.648393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8c37c872-5f6c-4bc4-a0f8-eae2cb9897a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:10.661233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c37c872-5f6c-4bc4-a0f8-eae2cb9897a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:10.672714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c37c872-5f6c-4bc4-a0f8-eae2cb9897a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:10.674410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c37c872-5f6c-4bc4-a0f8-eae2cb9897a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:10.675020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c37c872-5f6c-4bc4-a0f8-eae2cb9897a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:11.371642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8c37c872-5f6c-4bc4-a0f8-eae2cb9897a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:11.375608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-24a4ab35-07e4-4d87-a3e8-7e6921e1ebd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:11.378675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-24a4ab35-07e4-4d87-a3e8-7e6921e1ebd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:11.382865 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8c37c872-5f6c-4bc4-a0f8-eae2cb9897a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1689 microversion: 2.1 time: 0.739758 Jul 26 14:46:11.391546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24a4ab35-07e4-4d87-a3e8-7e6921e1ebd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:11.395082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24a4ab35-07e4-4d87-a3e8-7e6921e1ebd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:11.396386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24a4ab35-07e4-4d87-a3e8-7e6921e1ebd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:11.397328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24a4ab35-07e4-4d87-a3e8-7e6921e1ebd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:11.415454 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2690/5511] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:10 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1689 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:11.856233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-24a4ab35-07e4-4d87-a3e8-7e6921e1ebd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:11.872573 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-24a4ab35-07e4-4d87-a3e8-7e6921e1ebd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1727 microversion: 2.1 time: 0.501502 Jul 26 14:46:11.894434 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2822/5512] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:11 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1727 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:11.896273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da2e6aa6-8801-4665-9d3e-3c9213992951 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:11.896843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-da2e6aa6-8801-4665-9d3e-3c9213992951 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:11.938017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da2e6aa6-8801-4665-9d3e-3c9213992951 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:11.943112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da2e6aa6-8801-4665-9d3e-3c9213992951 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:11.947610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da2e6aa6-8801-4665-9d3e-3c9213992951 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:11.949219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da2e6aa6-8801-4665-9d3e-3c9213992951 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:12.179086 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-da2e6aa6-8801-4665-9d3e-3c9213992951 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.287518 Jul 26 14:46:12.187596 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2691/5513] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:46:11 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-interface => generated 284 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:12.433194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e9f2aca6-f0b1-4630-979b-74ba84ce9cf0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:12.436671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e9f2aca6-f0b1-4630-979b-74ba84ce9cf0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:12.451898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:12.454650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9f2aca6-f0b1-4630-979b-74ba84ce9cf0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:12.463122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9f2aca6-f0b1-4630-979b-74ba84ce9cf0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:12.464938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9f2aca6-f0b1-4630-979b-74ba84ce9cf0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:12.465722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9f2aca6-f0b1-4630-979b-74ba84ce9cf0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:13.270731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e9f2aca6-f0b1-4630-979b-74ba84ce9cf0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:13.283238 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e9f2aca6-f0b1-4630-979b-74ba84ce9cf0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1689 microversion: 2.1 time: 0.867101 Jul 26 14:46:13.296718 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2823/5514] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:12 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1689 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:14.310048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6f367c88-e197-490a-bbae-712580e03805 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:14.311881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6f367c88-e197-490a-bbae-712580e03805 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:14.344022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f367c88-e197-490a-bbae-712580e03805 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:14.347247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f367c88-e197-490a-bbae-712580e03805 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:14.351993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f367c88-e197-490a-bbae-712580e03805 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:14.353289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f367c88-e197-490a-bbae-712580e03805 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:14.842091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6f367c88-e197-490a-bbae-712580e03805 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:14.862863 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6f367c88-e197-490a-bbae-712580e03805 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1689 microversion: 2.1 time: 0.558104 Jul 26 14:46:14.863466 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2692/5515] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:14 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1689 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:15.731735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-26e91fbc-bd85-45ef-b666-02e06c4eba8f req-6dbdaf3f-5333-4817-a504-e371c4246e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ee36bc-0796-4af3-a631-93e2060ca82d", "tag": "a8a183a7-5f4c-4925-a69c-f17c5aa3fea8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:15.745267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-26e91fbc-bd85-45ef-b666-02e06c4eba8f req-6dbdaf3f-5333-4817-a504-e371c4246e1b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:15.745726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-26e91fbc-bd85-45ef-b666-02e06c4eba8f req-6dbdaf3f-5333-4817-a504-e371c4246e1b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:15.760797 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-26e91fbc-bd85-45ef-b666-02e06c4eba8f req-6dbdaf3f-5333-4817-a504-e371c4246e1b service nova] Creating event network-changed:a8a183a7-5f4c-4925-a69c-f17c5aa3fea8 for instance 05ee36bc-0796-4af3-a631-93e2060ca82d on n-h1-833090-9 Jul 26 14:46:15.768470 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-26e91fbc-bd85-45ef-b666-02e06c4eba8f req-6dbdaf3f-5333-4817-a504-e371c4246e1b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039956 Jul 26 14:46:15.769702 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2824/5516] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:15.886467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0449e1b7-cd41-4b42-8d1c-749c287e68db tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:15.887182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0449e1b7-cd41-4b42-8d1c-749c287e68db tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:15.890354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:15.906528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0449e1b7-cd41-4b42-8d1c-749c287e68db tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:15.922945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0449e1b7-cd41-4b42-8d1c-749c287e68db tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:15.925429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0449e1b7-cd41-4b42-8d1c-749c287e68db tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:15.932767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0449e1b7-cd41-4b42-8d1c-749c287e68db tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:16.291640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0449e1b7-cd41-4b42-8d1c-749c287e68db tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:16.304112 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0449e1b7-cd41-4b42-8d1c-749c287e68db tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1679 microversion: 2.1 time: 0.423098 Jul 26 14:46:16.307106 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2693/5517] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:15 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1679 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:16.334248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b402a966-f675-48e6-96a2-da6a6898a9a4 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:16.335268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b402a966-f675-48e6-96a2-da6a6898a9a4 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:16.347464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b402a966-f675-48e6-96a2-da6a6898a9a4 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:16.347931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b402a966-f675-48e6-96a2-da6a6898a9a4 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:16.348757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b402a966-f675-48e6-96a2-da6a6898a9a4 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:16.349206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b402a966-f675-48e6-96a2-da6a6898a9a4 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:17.142156 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b402a966-f675-48e6-96a2-da6a6898a9a4 tempest-TestNetworkAdvancedServerOps-317019249 tempest-TestNetworkAdvancedServerOps-317019249-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1830 microversion: 2.1 time: 0.813166 Jul 26 14:46:17.144678 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2825/5518] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:16 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1830 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:17.170306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8ffe0ced-656b-4e7e-829f-a6244d547e94 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:17.171672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8ffe0ced-656b-4e7e-829f-a6244d547e94 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:17.184576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ffe0ced-656b-4e7e-829f-a6244d547e94 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:17.185335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ffe0ced-656b-4e7e-829f-a6244d547e94 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:17.186381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ffe0ced-656b-4e7e-829f-a6244d547e94 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:17.187050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8ffe0ced-656b-4e7e-829f-a6244d547e94 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:17.508491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8ffe0ced-656b-4e7e-829f-a6244d547e94 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:17.517306 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8ffe0ced-656b-4e7e-829f-a6244d547e94 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1679 microversion: 2.1 time: 0.350878 Jul 26 14:46:17.521475 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2694/5519] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:17 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1679 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:17.793280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b3fa1eb0-bc04-459a-a393-ea7e38d8b13c req-eaf90cef-5d85-49f6-a158-a5b4a1a1472a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ee36bc-0796-4af3-a631-93e2060ca82d", "tag": "a8a183a7-5f4c-4925-a69c-f17c5aa3fea8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:17.794056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-276c65c0-d77c-446c-adba-cc7b18be28a9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:17.800668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-276c65c0-d77c-446c-adba-cc7b18be28a9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:17.881385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-276c65c0-d77c-446c-adba-cc7b18be28a9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:17.881844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-276c65c0-d77c-446c-adba-cc7b18be28a9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:17.884150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-276c65c0-d77c-446c-adba-cc7b18be28a9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:17.885286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-276c65c0-d77c-446c-adba-cc7b18be28a9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:17.885846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b3fa1eb0-bc04-459a-a393-ea7e38d8b13c req-eaf90cef-5d85-49f6-a158-a5b4a1a1472a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:17.887380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b3fa1eb0-bc04-459a-a393-ea7e38d8b13c req-eaf90cef-5d85-49f6-a158-a5b4a1a1472a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:17.938803 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b3fa1eb0-bc04-459a-a393-ea7e38d8b13c req-eaf90cef-5d85-49f6-a158-a5b4a1a1472a service nova] Creating event network-changed:a8a183a7-5f4c-4925-a69c-f17c5aa3fea8 for instance 05ee36bc-0796-4af3-a631-93e2060ca82d on n-h1-833090-9 Jul 26 14:46:17.963428 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b3fa1eb0-bc04-459a-a393-ea7e38d8b13c req-eaf90cef-5d85-49f6-a158-a5b4a1a1472a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173856 Jul 26 14:46:17.965454 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2826/5520] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:18.014157 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-276c65c0-d77c-446c-adba-cc7b18be28a9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109/action" status: 200 len: 38634 microversion: 2.1 time: 0.226802 Jul 26 14:46:18.015624 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2695/5521] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:46:17 2022] POST /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109/action => generated 38634 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:46:21.438553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-9614e0e8-ac29-4878-9d26-6166a15644cf req-4031214a-d358-4d26-9334-5f130c5f8108 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04017d0a-b2a7-43f6-89b7-dd7078716109", "tag": "6dd56902-bd9a-4e87-a5aa-87bd37cc1b61"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:21.444567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8e1a5a81-771a-4689-9456-13223246fc4c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:21.447402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8e1a5a81-771a-4689-9456-13223246fc4c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:21.465482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e1a5a81-771a-4689-9456-13223246fc4c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:21.466349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e1a5a81-771a-4689-9456-13223246fc4c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:21.467382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e1a5a81-771a-4689-9456-13223246fc4c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:21.472801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e1a5a81-771a-4689-9456-13223246fc4c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:21.476198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9614e0e8-ac29-4878-9d26-6166a15644cf req-4031214a-d358-4d26-9334-5f130c5f8108 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:21.478359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9614e0e8-ac29-4878-9d26-6166a15644cf req-4031214a-d358-4d26-9334-5f130c5f8108 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:21.521594 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-9614e0e8-ac29-4878-9d26-6166a15644cf req-4031214a-d358-4d26-9334-5f130c5f8108 service nova] Creating event network-changed:6dd56902-bd9a-4e87-a5aa-87bd37cc1b61 for instance 04017d0a-b2a7-43f6-89b7-dd7078716109 on n-h1-833090-9 Jul 26 14:46:21.537808 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-9614e0e8-ac29-4878-9d26-6166a15644cf req-4031214a-d358-4d26-9334-5f130c5f8108 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103614 Jul 26 14:46:21.538668 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2696/5522] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:21.553705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8e1a5a81-771a-4689-9456-13223246fc4c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:46:21.748304 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8e1a5a81-771a-4689-9456-13223246fc4c tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "DELETE /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 204 len: 0 microversion: 2.1 time: 0.316310 Jul 26 14:46:21.749055 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2827/5523] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:46:21 2022] DELETE /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:46:21.759315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7fb3d245-5ffe-4e14-820c-4fea3908aed4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:21.760603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7fb3d245-5ffe-4e14-820c-4fea3908aed4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:21.777755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fb3d245-5ffe-4e14-820c-4fea3908aed4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:21.778752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fb3d245-5ffe-4e14-820c-4fea3908aed4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:21.779888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fb3d245-5ffe-4e14-820c-4fea3908aed4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:21.780719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fb3d245-5ffe-4e14-820c-4fea3908aed4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:22.301622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7fb3d245-5ffe-4e14-820c-4fea3908aed4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:22.317881 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7fb3d245-5ffe-4e14-820c-4fea3908aed4 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1685 microversion: 2.1 time: 0.563203 Jul 26 14:46:22.321705 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2697/5524] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:21 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1685 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:23.347568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cdd6d131-92a5-4b3c-be58-bee65c3ef5ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:23.348361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cdd6d131-92a5-4b3c-be58-bee65c3ef5ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:23.359460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdd6d131-92a5-4b3c-be58-bee65c3ef5ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:23.365912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdd6d131-92a5-4b3c-be58-bee65c3ef5ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:23.366803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdd6d131-92a5-4b3c-be58-bee65c3ef5ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:23.368052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cdd6d131-92a5-4b3c-be58-bee65c3ef5ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:23.386872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:23.559546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cdd6d131-92a5-4b3c-be58-bee65c3ef5ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:23.569048 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cdd6d131-92a5-4b3c-be58-bee65c3ef5ca tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1618 microversion: 2.1 time: 0.227250 Jul 26 14:46:23.569849 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2828/5525] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:23 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1618 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:23.807533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3e160b6d-c30b-42e5-983f-d8a9ef570ea2 req-9252fcc3-d5ec-45f2-998d-a4a57be6434e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04017d0a-b2a7-43f6-89b7-dd7078716109", "name": "network-vif-deleted", "tag": "6dd56902-bd9a-4e87-a5aa-87bd37cc1b61"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:23.850441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3e160b6d-c30b-42e5-983f-d8a9ef570ea2 req-9252fcc3-d5ec-45f2-998d-a4a57be6434e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:23.851332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3e160b6d-c30b-42e5-983f-d8a9ef570ea2 req-9252fcc3-d5ec-45f2-998d-a4a57be6434e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:23.877675 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3e160b6d-c30b-42e5-983f-d8a9ef570ea2 req-9252fcc3-d5ec-45f2-998d-a4a57be6434e service nova] Creating event network-vif-deleted:6dd56902-bd9a-4e87-a5aa-87bd37cc1b61 for instance 04017d0a-b2a7-43f6-89b7-dd7078716109 on n-h1-833090-9 Jul 26 14:46:23.890872 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3e160b6d-c30b-42e5-983f-d8a9ef570ea2 req-9252fcc3-d5ec-45f2-998d-a4a57be6434e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088371 Jul 26 14:46:23.894086 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2698/5526] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:24.591355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:24.591992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:24.611092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:24.612741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:24.613727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:24.614082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:24.764492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:24.766358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:24.766856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lazy-loading 'fault' on Instance uuid 04017d0a-b2a7-43f6-89b7-dd7078716109 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:46:24.958881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:24.973199 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-94fb90e5-523b-4ebf-82b0-7069e0f9e4d9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 200 len: 1355 microversion: 2.1 time: 0.386686 Jul 26 14:46:24.977313 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2829/5527] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:24 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 1355 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:26.010156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f29309ee-3f9a-4614-85e4-d56568b9e010 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:26.012783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f29309ee-3f9a-4614-85e4-d56568b9e010 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 04017d0a-b2a7-43f6-89b7-dd7078716109] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:26.032539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f29309ee-3f9a-4614-85e4-d56568b9e010 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:26.033600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f29309ee-3f9a-4614-85e4-d56568b9e010 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:26.034534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f29309ee-3f9a-4614-85e4-d56568b9e010 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:26.035067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f29309ee-3f9a-4614-85e4-d56568b9e010 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:26.092474 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-f29309ee-3f9a-4614-85e4-d56568b9e010 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] HTTP exception thrown: Instance 04017d0a-b2a7-43f6-89b7-dd7078716109 could not be found. Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f29309ee-3f9a-4614-85e4-d56568b9e010 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Request method failure captured: Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 HTTP/1.1 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_xB-Zf_NVFk2LpZd5X0S1bF9Sihh0sVd3cVjP7q1Wb09Bi_CbMlSEWs2yYdcOyVXXKNohoIUlLtBITBGHLSNiRsoBSNoqWwMtL7vcjKUvwFncHYEdNqCZrXhBJGT_E7Ar_K6PwdXlw_F45EECw6xOMVI7rp06FaJ1098k3HxOxEoI4 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 1f899f15d3284d9d8b7f9509f1017944 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f899f15d3284d9d8b7f9509f1017944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f899f15d3284d9d8b7f9509f1017944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f899f15d3284d9d8b7f9509f1017944", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f899f15d3284d9d8b7f9509f1017944"}]}] Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 1f899f15d3284d9d8b7f9509f1017944 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestNetworkAdvancedServerOps-1920705595-project Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 2ace0ada06df49f189f02e59039c2dd8 Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1920705595-project Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 04017d0a-b2a7-43f6-89b7-dd7078716109 could not be found. Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '04017d0a-b2a7-43f6-89b7-dd7078716109'} Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04017d0a-b2a7-43f6-89b7-dd7078716109 could not be found. Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04017d0a-b2a7-43f6-89b7-dd7078716109 could not be found. Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:26.094717 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:46:26.099417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:26.099417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:26.099417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:46:26.099417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:46:26.099417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:46:26.099417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:46:26.099417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04017d0a-b2a7-43f6-89b7-dd7078716109 could not be found. Jul 26 14:46:26.099417 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:26.101628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f29309ee-3f9a-4614-85e4-d56568b9e010 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Returning 404 to user: Instance 04017d0a-b2a7-43f6-89b7-dd7078716109 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:46:26.102860 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f29309ee-3f9a-4614-85e4-d56568b9e010 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109" status: 404 len: 111 microversion: 2.1 time: 0.106111 Jul 26 14:46:26.104018 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2699/5528] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:25 2022] GET /compute/v2.1/servers/04017d0a-b2a7-43f6-89b7-dd7078716109 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:46:27.274969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fd1ab5e7-654b-486c-91f3-543392a6fa50 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:27.276945 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:46:27.276945 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:46:27.278237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd1ab5e7-654b-486c-91f3-543392a6fa50 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:27.278884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd1ab5e7-654b-486c-91f3-543392a6fa50 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:27.280172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd1ab5e7-654b-486c-91f3-543392a6fa50 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:27.284090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd1ab5e7-654b-486c-91f3-543392a6fa50 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:27.383589 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fd1ab5e7-654b-486c-91f3-543392a6fa50 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.439663 Jul 26 14:46:27.386845 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2830/5529] 10.222.0.70 () {58 vars in 1185 bytes} [Tue Jul 26 14:46:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:27.614682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1446659927", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "availability_zone": "nova:n-h1-833090-9", "networks": [{"uuid": "f76e697f-79bb-4d1d-a62e-a9b27053dd44"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:27.796237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] validate_networks() for [('f76e697f-79bb-4d1d-a62e-a9b27053dd44', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:46:29.138945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:46:29.141592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:46:29.143050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:46:29.152436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:46:29.153121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:46:29.173205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:29.174798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:29.177626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:29.179378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:29.235205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Getting quotas for project 114762569ddd4b5682a35d56286e745b. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:46:29.262734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Getting quotas for user fcfd28920663498e9f9e04dbc76d7241 and project 114762569ddd4b5682a35d56286e745b. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:46:29.320321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:46:29.332900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:46:29.435298 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c890c96b-68ef-45de-a2f9-7d3d3b6a4e01 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824874 Jul 26 14:46:29.437976 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2700/5530] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:46:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:46:29.448649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4466348-76c2-49f1-b321-08269a59810b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:29.449279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e4466348-76c2-49f1-b321-08269a59810b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:29.725164 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4466348-76c2-49f1-b321-08269a59810b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1329 microversion: 2.1 time: 0.280061 Jul 26 14:46:29.731269 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2831/5531] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:29 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1329 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:46:30.771753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-88f26960-7208-4255-acf3-06b5ce3fb07b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:30.772564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-88f26960-7208-4255-acf3-06b5ce3fb07b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:30.812394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-88f26960-7208-4255-acf3-06b5ce3fb07b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:30.813188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-88f26960-7208-4255-acf3-06b5ce3fb07b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:30.824005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-88f26960-7208-4255-acf3-06b5ce3fb07b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:30.824475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-88f26960-7208-4255-acf3-06b5ce3fb07b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:31.148874 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-88f26960-7208-4255-acf3-06b5ce3fb07b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1346 microversion: 2.1 time: 0.382709 Jul 26 14:46:31.151734 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2701/5532] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:30 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1346 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:32.175678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9193f197-a239-4501-aa87-d4bff3dbb196 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:32.176321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9193f197-a239-4501-aa87-d4bff3dbb196 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:32.186990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9193f197-a239-4501-aa87-d4bff3dbb196 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:32.201879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9193f197-a239-4501-aa87-d4bff3dbb196 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:32.203150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9193f197-a239-4501-aa87-d4bff3dbb196 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:32.208743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9193f197-a239-4501-aa87-d4bff3dbb196 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:32.738429 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9193f197-a239-4501-aa87-d4bff3dbb196 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1434 microversion: 2.1 time: 0.566887 Jul 26 14:46:32.747868 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2832/5533] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:32 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1434 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:33.776496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e8d2f287-1658-445c-b373-78f2d308c33d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:33.777883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e8d2f287-1658-445c-b373-78f2d308c33d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:33.798264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8d2f287-1658-445c-b373-78f2d308c33d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:33.799415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8d2f287-1658-445c-b373-78f2d308c33d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:33.802444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8d2f287-1658-445c-b373-78f2d308c33d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:33.802937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e8d2f287-1658-445c-b373-78f2d308c33d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:33.818219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:34.246616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ecef4b5-13ba-4e73-a555-04dc94287343 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Action: 'create', calling method: .version_select at 0x7f8786d9e160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-935496935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIid8Yl9C5PzQxMure4syCGVoenpaeIYoSCRbl9og8hYV7OzqezvFu3biRoaoNmQOc6eRP16jQ9Mz4Gm9sMcYnWajoozkCdyvn2Uv6tQL6wUnKegU51DqMOsL5/i7QqyAw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:34.288510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-5ecef4b5-13ba-4e73-a555-04dc94287343 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for project 54967e3bd292459a81121b90b03fde3b. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:46:34.327079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-5ecef4b5-13ba-4e73-a555-04dc94287343 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for user 5e1adb391e2f425892a83762aaa6eb43 and project 54967e3bd292459a81121b90b03fde3b. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:46:34.404704 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ecef4b5-13ba-4e73-a555-04dc94287343 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.162031 Jul 26 14:46:34.412633 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2833/5534] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:46:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:46:34.604549 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e8d2f287-1658-445c-b373-78f2d308c33d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1464 microversion: 2.1 time: 0.827132 Jul 26 14:46:34.605644 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2702/5535] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:33 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1464 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:35.627787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2c713d73-c591-4c26-b09e-10cb745d020a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:35.628436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2c713d73-c591-4c26-b09e-10cb745d020a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:35.641331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c713d73-c591-4c26-b09e-10cb745d020a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:35.641789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c713d73-c591-4c26-b09e-10cb745d020a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:35.643222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c713d73-c591-4c26-b09e-10cb745d020a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:35.643670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c713d73-c591-4c26-b09e-10cb745d020a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:36.032288 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2c713d73-c591-4c26-b09e-10cb745d020a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1464 microversion: 2.1 time: 0.409271 Jul 26 14:46:36.046886 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2834/5536] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:35 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1464 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:36.133481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b613ca72-f95e-48a9-9c35-46a580ecd12a req-b0da6d62-c89d-490c-8d58-a3512f3d58f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b10ed09-337c-4ff8-af4d-0aedde5827cb", "tag": "8cfeeb1b-44bf-42d3-8476-18d8e95e21d8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:36.192273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b613ca72-f95e-48a9-9c35-46a580ecd12a req-b0da6d62-c89d-490c-8d58-a3512f3d58f2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:36.193627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b613ca72-f95e-48a9-9c35-46a580ecd12a req-b0da6d62-c89d-490c-8d58-a3512f3d58f2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:36.231354 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b613ca72-f95e-48a9-9c35-46a580ecd12a req-b0da6d62-c89d-490c-8d58-a3512f3d58f2 service nova] Creating event network-changed:8cfeeb1b-44bf-42d3-8476-18d8e95e21d8 for instance 3b10ed09-337c-4ff8-af4d-0aedde5827cb on n-h1-833090-9 Jul 26 14:46:36.243048 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b613ca72-f95e-48a9-9c35-46a580ecd12a req-b0da6d62-c89d-490c-8d58-a3512f3d58f2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131424 Jul 26 14:46:36.247741 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2703/5537] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:37.058360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a23a0a1-a4f4-41b2-a48c-44d65bdcc2d9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:37.058989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1a23a0a1-a4f4-41b2-a48c-44d65bdcc2d9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:37.073325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a23a0a1-a4f4-41b2-a48c-44d65bdcc2d9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:37.073787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a23a0a1-a4f4-41b2-a48c-44d65bdcc2d9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:37.074597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a23a0a1-a4f4-41b2-a48c-44d65bdcc2d9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:37.075051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a23a0a1-a4f4-41b2-a48c-44d65bdcc2d9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:37.322565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:37.330115 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1a23a0a1-a4f4-41b2-a48c-44d65bdcc2d9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1464 microversion: 2.1 time: 0.275283 Jul 26 14:46:37.334542 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2835/5538] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:37 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1464 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:38.335756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-70a75ca7-d146-4332-b1db-a88181e0e3d1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '.version_select at 0x7f8786ef6280>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:38.360859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4a5dab15-8f14-47c0-8316-3b445f1d5399 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:38.362769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4a5dab15-8f14-47c0-8316-3b445f1d5399 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:38.381874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a5dab15-8f14-47c0-8316-3b445f1d5399 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:38.382996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a5dab15-8f14-47c0-8316-3b445f1d5399 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:38.386273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a5dab15-8f14-47c0-8316-3b445f1d5399 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:38.388106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a5dab15-8f14-47c0-8316-3b445f1d5399 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:38.396347 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-70a75ca7-d146-4332-b1db-a88181e0e3d1 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-262738288" status: 202 len: 0 microversion: 2.1 time: 0.065688 Jul 26 14:46:38.402433 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2704/5539] 10.222.0.70 () {58 vars in 1281 bytes} [Tue Jul 26 14:46:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-262738288 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:46:38.440366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a3e3a11-cfd0-49d6-b035-804de8e324ed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'create', calling method: .version_select at 0x7f8786e475e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1409261338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4DBw71MbrxwZxv9IE8d1XjAmfvP7JP7SX92Y98/geq6Hm6qtzl82mqeaVeBnuqCoSvij67DBpXX9lIo+Kk0POw4x4zLlgUKXTobQcH5jBz8VeExYmxHorgsBDHloVg4w=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:38.476124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-4a3e3a11-cfd0-49d6-b035-804de8e324ed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:46:38.482949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-4a3e3a11-cfd0-49d6-b035-804de8e324ed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for user 2ace0ada06df49f189f02e59039c2dd8 and project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:46:38.513062 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4a3e3a11-cfd0-49d6-b035-804de8e324ed tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.083644 Jul 26 14:46:38.513849 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2705/5540] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:46:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:39.034246 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4a5dab15-8f14-47c0-8316-3b445f1d5399 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1464 microversion: 2.1 time: 0.679185 Jul 26 14:46:39.036637 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2836/5541] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:38 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1464 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:46:39.491535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:39.497340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-402912495", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "8815e34c-2b6e-42fe-b7ac-11b58c3dc13e"}], "key_name": "tempest-TestNetworkBasicOps-935496935", "security_groups": [{"name": "tempest-secgroup-smoke-338456887"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:39.632874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] validate_networks() for [('8815e34c-2b6e-42fe-b7ac-11b58c3dc13e', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:46:40.058793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-973bf153-d818-4326-b47f-c307cc18aea0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:40.059644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-973bf153-d818-4326-b47f-c307cc18aea0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:40.069785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-973bf153-d818-4326-b47f-c307cc18aea0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:40.070287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-973bf153-d818-4326-b47f-c307cc18aea0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:40.071083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-973bf153-d818-4326-b47f-c307cc18aea0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:40.072674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-973bf153-d818-4326-b47f-c307cc18aea0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:40.329877 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-973bf153-d818-4326-b47f-c307cc18aea0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1464 microversion: 2.1 time: 0.274923 Jul 26 14:46:40.345594 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2837/5542] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:40 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1464 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:40.348479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:46:40.349132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:46:40.349749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:46:40.350029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:46:40.350540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:46:40.364019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:40.364491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:40.365317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:40.365779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:40.391016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for project 54967e3bd292459a81121b90b03fde3b. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:46:40.397590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Getting quotas for user 5e1adb391e2f425892a83762aaa6eb43 and project 54967e3bd292459a81121b90b03fde3b. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:46:40.438079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:46:40.441591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:46:40.519997 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3fd2e4ff-1b40-4ab2-82f7-b3d5714dc63e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.029255 Jul 26 14:46:40.530130 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2706/5543] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:46:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:46:40.544365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9e65b953-c932-44ad-9260-d9baba746678 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:40.545057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9e65b953-c932-44ad-9260-d9baba746678 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:40.794056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9e65b953-c932-44ad-9260-d9baba746678 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:40.802288 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9e65b953-c932-44ad-9260-d9baba746678 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1247 microversion: 2.1 time: 0.263429 Jul 26 14:46:40.804444 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2838/5544] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:40 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1247 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:41.366932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c9a12e07-4fda-4cd7-bd43-485d61239f11 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:41.368868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c9a12e07-4fda-4cd7-bd43-485d61239f11 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:41.396169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9a12e07-4fda-4cd7-bd43-485d61239f11 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:41.399180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9a12e07-4fda-4cd7-bd43-485d61239f11 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:41.400589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9a12e07-4fda-4cd7-bd43-485d61239f11 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:41.404972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c9a12e07-4fda-4cd7-bd43-485d61239f11 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:41.661186 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c9a12e07-4fda-4cd7-bd43-485d61239f11 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1464 microversion: 2.1 time: 0.309503 Jul 26 14:46:41.662372 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2707/5545] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:41 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1464 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:41.829340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b6ec604f-f602-4166-bafc-d4e2d8d59789 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:41.832090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b6ec604f-f602-4166-bafc-d4e2d8d59789 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:41.841289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6ec604f-f602-4166-bafc-d4e2d8d59789 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:41.842222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6ec604f-f602-4166-bafc-d4e2d8d59789 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:41.842986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6ec604f-f602-4166-bafc-d4e2d8d59789 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:41.843523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6ec604f-f602-4166-bafc-d4e2d8d59789 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:41.937428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b6ec604f-f602-4166-bafc-d4e2d8d59789 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:41.951342 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b6ec604f-f602-4166-bafc-d4e2d8d59789 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1299 microversion: 2.1 time: 0.127985 Jul 26 14:46:41.952354 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2839/5546] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:41 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:42.681360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b2e471ca-09bc-4d0d-a3ec-f8ae4d672f24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:42.681977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b2e471ca-09bc-4d0d-a3ec-f8ae4d672f24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:42.690309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2e471ca-09bc-4d0d-a3ec-f8ae4d672f24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:42.691141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2e471ca-09bc-4d0d-a3ec-f8ae4d672f24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:42.699389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2e471ca-09bc-4d0d-a3ec-f8ae4d672f24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:42.701024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2e471ca-09bc-4d0d-a3ec-f8ae4d672f24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:42.953230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-626ed127-b244-473a-beea-119de2ee9516 req-8bb45726-29f7-461c-9dc5-d7d25f45bbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b10ed09-337c-4ff8-af4d-0aedde5827cb", "name": "network-vif-plugged", "status": "completed", "tag": "8cfeeb1b-44bf-42d3-8476-18d8e95e21d8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:42.966804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:42.988939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-626ed127-b244-473a-beea-119de2ee9516 req-8bb45726-29f7-461c-9dc5-d7d25f45bbfd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:42.989634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-626ed127-b244-473a-beea-119de2ee9516 req-8bb45726-29f7-461c-9dc5-d7d25f45bbfd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:43.017366 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-626ed127-b244-473a-beea-119de2ee9516 req-8bb45726-29f7-461c-9dc5-d7d25f45bbfd service nova] Creating event network-vif-plugged:8cfeeb1b-44bf-42d3-8476-18d8e95e21d8 for instance 3b10ed09-337c-4ff8-af4d-0aedde5827cb on n-h1-833090-9 Jul 26 14:46:43.032356 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-626ed127-b244-473a-beea-119de2ee9516 req-8bb45726-29f7-461c-9dc5-d7d25f45bbfd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082247 Jul 26 14:46:43.036950 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2840/5547] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:43.053777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d60a367f-a817-48ae-9625-a4502958a511 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:43.056934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d60a367f-a817-48ae-9625-a4502958a511 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:43.072396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d60a367f-a817-48ae-9625-a4502958a511 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:43.074657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d60a367f-a817-48ae-9625-a4502958a511 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:43.080000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d60a367f-a817-48ae-9625-a4502958a511 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:43.081458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d60a367f-a817-48ae-9625-a4502958a511 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:43.292577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d60a367f-a817-48ae-9625-a4502958a511 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:43.316445 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d60a367f-a817-48ae-9625-a4502958a511 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1305 microversion: 2.1 time: 0.276531 Jul 26 14:46:43.317791 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2841/5548] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:43 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1305 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:43.407504 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b2e471ca-09bc-4d0d-a3ec-f8ae4d672f24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1464 microversion: 2.1 time: 0.725517 Jul 26 14:46:43.410246 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2708/5549] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:42 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1464 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:44.338960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e636b329-0ab4-46d2-adc1-7d1452e629af tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:44.340249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e636b329-0ab4-46d2-adc1-7d1452e629af tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:44.348686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e636b329-0ab4-46d2-adc1-7d1452e629af tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:44.349277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e636b329-0ab4-46d2-adc1-7d1452e629af tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:44.350071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e636b329-0ab4-46d2-adc1-7d1452e629af tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:44.350514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e636b329-0ab4-46d2-adc1-7d1452e629af tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:44.435972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef5d65a2-59ad-4d12-9a7d-60525d56abd9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:44.436628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ef5d65a2-59ad-4d12-9a7d-60525d56abd9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:44.450319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef5d65a2-59ad-4d12-9a7d-60525d56abd9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:44.453024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef5d65a2-59ad-4d12-9a7d-60525d56abd9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:44.457732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef5d65a2-59ad-4d12-9a7d-60525d56abd9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:44.459103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef5d65a2-59ad-4d12-9a7d-60525d56abd9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:45.021275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e636b329-0ab4-46d2-adc1-7d1452e629af tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:45.029161 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e636b329-0ab4-46d2-adc1-7d1452e629af tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1372 microversion: 2.1 time: 0.694148 Jul 26 14:46:45.033724 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2842/5550] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:44 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1372 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:45.133322 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ef5d65a2-59ad-4d12-9a7d-60525d56abd9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1464 microversion: 2.1 time: 0.700711 Jul 26 14:46:45.135902 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2709/5551] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:44 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1464 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:46:45.340406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70a32d7d-8fb0-4a21-aaba-4717d752aecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:45.341427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70a32d7d-8fb0-4a21-aaba-4717d752aecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:45.368568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a32d7d-8fb0-4a21-aaba-4717d752aecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:45.369433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a32d7d-8fb0-4a21-aaba-4717d752aecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:45.372256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a32d7d-8fb0-4a21-aaba-4717d752aecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:45.374800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70a32d7d-8fb0-4a21-aaba-4717d752aecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:45.655472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-70a32d7d-8fb0-4a21-aaba-4717d752aecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lazy-loading 'services' on Instance uuid 05ee36bc-0796-4af3-a631-93e2060ca82d {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:46:45.776244 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70a32d7d-8fb0-4a21-aaba-4717d752aecf tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments/bda53201-1b28-46b0-a7b7-abb813a46436" status: 202 len: 0 microversion: 2.1 time: 0.443449 Jul 26 14:46:45.779806 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2843/5552] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:46:45 2022] DELETE /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments/bda53201-1b28-46b0-a7b7-abb813a46436 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:46:45.793987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-160741dc-79ed-4a37-ac34-01f0742a73b9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:45.797651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-160741dc-79ed-4a37-ac34-01f0742a73b9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:45.828028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-160741dc-79ed-4a37-ac34-01f0742a73b9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:45.833353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-160741dc-79ed-4a37-ac34-01f0742a73b9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:45.834523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-160741dc-79ed-4a37-ac34-01f0742a73b9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:45.837155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-160741dc-79ed-4a37-ac34-01f0742a73b9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:45.953827 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-160741dc-79ed-4a37-ac34-01f0742a73b9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170897 Jul 26 14:46:45.996187 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2710/5553] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:46:45 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:46.057713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8377fdc1-efb8-4d57-8da9-c1f999ca8cd1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:46.058702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8377fdc1-efb8-4d57-8da9-c1f999ca8cd1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:46.071787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-567ef953-1127-413d-8af0-667c305d9ba6 req-9aefa6a8-e05a-457b-a80f-ce7288c2e4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4145de3a-1f5d-4d15-9d88-79393524853b", "tag": "9d13ac50-a939-4278-8a79-1097da0d61a8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:46.075868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8377fdc1-efb8-4d57-8da9-c1f999ca8cd1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:46.079629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:46.102431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8377fdc1-efb8-4d57-8da9-c1f999ca8cd1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:46.103302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8377fdc1-efb8-4d57-8da9-c1f999ca8cd1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:46.105722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-567ef953-1127-413d-8af0-667c305d9ba6 req-9aefa6a8-e05a-457b-a80f-ce7288c2e4ac service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:46.108164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8377fdc1-efb8-4d57-8da9-c1f999ca8cd1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:46.116896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-567ef953-1127-413d-8af0-667c305d9ba6 req-9aefa6a8-e05a-457b-a80f-ce7288c2e4ac service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:46.185376 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-567ef953-1127-413d-8af0-667c305d9ba6 req-9aefa6a8-e05a-457b-a80f-ce7288c2e4ac service nova] Creating event network-changed:9d13ac50-a939-4278-8a79-1097da0d61a8 for instance 4145de3a-1f5d-4d15-9d88-79393524853b on n-h2-833090-9 Jul 26 14:46:46.210798 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-567ef953-1127-413d-8af0-667c305d9ba6 req-9aefa6a8-e05a-457b-a80f-ce7288c2e4ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139784 Jul 26 14:46:46.232267 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2711/5554] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:46:46.247701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ab003c31-35b7-4a53-9b96-aab25d78768e tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:46.253306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ab003c31-35b7-4a53-9b96-aab25d78768e tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:46.297513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab003c31-35b7-4a53-9b96-aab25d78768e tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:46.306147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab003c31-35b7-4a53-9b96-aab25d78768e tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:46.308120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab003c31-35b7-4a53-9b96-aab25d78768e tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:46.309197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab003c31-35b7-4a53-9b96-aab25d78768e tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:47.006774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8377fdc1-efb8-4d57-8da9-c1f999ca8cd1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:47.035061 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8377fdc1-efb8-4d57-8da9-c1f999ca8cd1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1372 microversion: 2.1 time: 0.981441 Jul 26 14:46:47.052538 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2844/5555] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:46 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1372 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:47.104865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-96892bc6-4cca-441f-89b0-a047e23d2721 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:47.121160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-96892bc6-4cca-441f-89b0-a047e23d2721 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:47.153806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96892bc6-4cca-441f-89b0-a047e23d2721 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:47.155295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96892bc6-4cca-441f-89b0-a047e23d2721 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:47.157126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96892bc6-4cca-441f-89b0-a047e23d2721 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:47.159868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96892bc6-4cca-441f-89b0-a047e23d2721 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:47.262560 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ab003c31-35b7-4a53-9b96-aab25d78768e tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1649 microversion: 2.1 time: 1.024868 Jul 26 14:46:47.263113 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-96892bc6-4cca-441f-89b0-a047e23d2721 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207632 Jul 26 14:46:47.264306 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2845/5556] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:46:47 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:47.278326 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2712/5557] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:46 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1649 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:47.290908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2fd004f3-200f-4b39-9361-a69a154b458d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:47.291859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2fd004f3-200f-4b39-9361-a69a154b458d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:47.305336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2fd004f3-200f-4b39-9361-a69a154b458d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:47.306091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2fd004f3-200f-4b39-9361-a69a154b458d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:47.307508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2fd004f3-200f-4b39-9361-a69a154b458d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:47.308157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2fd004f3-200f-4b39-9361-a69a154b458d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:48.087809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eab4e24c-7555-4219-9768-12a59cb172e9 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:48.090812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eab4e24c-7555-4219-9768-12a59cb172e9 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:48.136520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eab4e24c-7555-4219-9768-12a59cb172e9 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:48.141066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eab4e24c-7555-4219-9768-12a59cb172e9 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:48.147715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eab4e24c-7555-4219-9768-12a59cb172e9 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:48.150747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eab4e24c-7555-4219-9768-12a59cb172e9 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:48.340609 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2fd004f3-200f-4b39-9361-a69a154b458d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1649 microversion: 2.1 time: 1.056445 Jul 26 14:46:48.345369 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2846/5558] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:47 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1649 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:48.364942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da1869ef-aaa8-47df-8c7d-250e9100bc6d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:48.376493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-da1869ef-aaa8-47df-8c7d-250e9100bc6d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:48.418929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da1869ef-aaa8-47df-8c7d-250e9100bc6d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:48.435904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da1869ef-aaa8-47df-8c7d-250e9100bc6d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:48.440868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da1869ef-aaa8-47df-8c7d-250e9100bc6d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:48.442016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da1869ef-aaa8-47df-8c7d-250e9100bc6d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:48.551088 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-da1869ef-aaa8-47df-8c7d-250e9100bc6d tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.203012 Jul 26 14:46:48.552458 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2847/5559] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:46:48 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:48.557387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a27ba16-5108-4c25-8945-16f395cea052 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:48.564993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a27ba16-5108-4c25-8945-16f395cea052 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:48.577858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a27ba16-5108-4c25-8945-16f395cea052 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:48.582073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-eab4e24c-7555-4219-9768-12a59cb172e9 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:48.587752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a27ba16-5108-4c25-8945-16f395cea052 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:48.588926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a27ba16-5108-4c25-8945-16f395cea052 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:48.589544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a27ba16-5108-4c25-8945-16f395cea052 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:48.592227 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eab4e24c-7555-4219-9768-12a59cb172e9 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1372 microversion: 2.1 time: 0.512054 Jul 26 14:46:48.594547 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2713/5560] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:48 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1372 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:48.603338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:48.963071 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a27ba16-5108-4c25-8945-16f395cea052 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1649 microversion: 2.1 time: 0.409101 Jul 26 14:46:48.976700 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2848/5561] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:48 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1649 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:49.092131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1642055750", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "availability_zone": "nova:n-h2-833090-9", "networks": [{"uuid": "f76e697f-79bb-4d1d-a62e-a9b27053dd44"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:49.225644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] validate_networks() for [('f76e697f-79bb-4d1d-a62e-a9b27053dd44', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:46:49.566416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0b4f9705-baab-4008-84fa-e5dfbf5a6cd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:49.569991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0b4f9705-baab-4008-84fa-e5dfbf5a6cd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:49.587053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b4f9705-baab-4008-84fa-e5dfbf5a6cd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:49.587683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b4f9705-baab-4008-84fa-e5dfbf5a6cd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:49.588661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b4f9705-baab-4008-84fa-e5dfbf5a6cd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:49.589222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0b4f9705-baab-4008-84fa-e5dfbf5a6cd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:49.676606 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0b4f9705-baab-4008-84fa-e5dfbf5a6cd2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114676 Jul 26 14:46:49.690585 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2849/5562] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:46:49 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:46:49.703036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bd004936-8651-4bef-b0cb-77bc9a10699e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:49.704128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bd004936-8651-4bef-b0cb-77bc9a10699e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:49.712987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd004936-8651-4bef-b0cb-77bc9a10699e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:49.722382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd004936-8651-4bef-b0cb-77bc9a10699e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:49.723240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd004936-8651-4bef-b0cb-77bc9a10699e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:49.723693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd004936-8651-4bef-b0cb-77bc9a10699e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:50.157741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bd004936-8651-4bef-b0cb-77bc9a10699e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:50.172462 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bd004936-8651-4bef-b0cb-77bc9a10699e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1372 microversion: 2.1 time: 0.480335 Jul 26 14:46:50.173807 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2850/5563] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:49 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1372 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:50.375135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:50.429988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=16 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:50.562790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1965863480", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "f716c19c-c93e-4749-a64d-dc0c9eaa849a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1409261338", "security_groups": [{"name": "tempest-secgroup-smoke-1218528179"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:50.582439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:46:50.582439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:46:50.582439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:46:50.583057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:46:50.583752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:46:50.612691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:50.614591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:50.617863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:50.622377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:50.713399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Getting quotas for project 114762569ddd4b5682a35d56286e745b. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:46:50.731360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Getting quotas for user fcfd28920663498e9f9e04dbc76d7241 and project 114762569ddd4b5682a35d56286e745b. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:46:50.773395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:46:50.794117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:46:50.798924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:50.837736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] validate_networks() for [('f716c19c-c93e-4749-a64d-dc0c9eaa849a', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:46:50.912455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-11a40f42-fe61-4fa1-8426-7d6f1ff0a712 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830194 Jul 26 14:46:50.913245 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2714/5564] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:46:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:46:50.925564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b9da45b7-9258-4339-bf47-bd46eb9c21e9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:50.928247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b9da45b7-9258-4339-bf47-bd46eb9c21e9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:50.945293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9da45b7-9258-4339-bf47-bd46eb9c21e9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:50.947858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9da45b7-9258-4339-bf47-bd46eb9c21e9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:50.949622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9da45b7-9258-4339-bf47-bd46eb9c21e9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:50.950409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9da45b7-9258-4339-bf47-bd46eb9c21e9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:51.030321 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b9da45b7-9258-4339-bf47-bd46eb9c21e9 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115555 Jul 26 14:46:51.049184 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2715/5565] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:46:50 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:51.068438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-49168633-801a-4928-8879-f99851003e37 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:51.073072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-49168633-801a-4928-8879-f99851003e37 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:51.296968 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-49168633-801a-4928-8879-f99851003e37 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1329 microversion: 2.1 time: 0.241734 Jul 26 14:46:51.300292 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2716/5566] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:51 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1329 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:51.310588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-09795d31-db41-47c9-b5c7-1669d0734f0d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:51.327265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-09795d31-db41-47c9-b5c7-1669d0734f0d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:51.350107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09795d31-db41-47c9-b5c7-1669d0734f0d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:51.350565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09795d31-db41-47c9-b5c7-1669d0734f0d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:51.351361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09795d31-db41-47c9-b5c7-1669d0734f0d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:51.351800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-09795d31-db41-47c9-b5c7-1669d0734f0d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:51.868572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-09795d31-db41-47c9-b5c7-1669d0734f0d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:51.882379 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-09795d31-db41-47c9-b5c7-1669d0734f0d tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1372 microversion: 2.1 time: 0.580612 Jul 26 14:46:51.883027 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2717/5567] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:51 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1372 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:52.045923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-390f6554-0273-474f-ade3-4e27f30c137c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:52.049474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-390f6554-0273-474f-ade3-4e27f30c137c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:52.067482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-390f6554-0273-474f-ade3-4e27f30c137c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:52.068580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-390f6554-0273-474f-ade3-4e27f30c137c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:52.069581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-390f6554-0273-474f-ade3-4e27f30c137c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:52.070461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-390f6554-0273-474f-ade3-4e27f30c137c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:52.161769 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-390f6554-0273-474f-ade3-4e27f30c137c tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122078 Jul 26 14:46:52.168566 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2718/5568] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:46:52 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:52.317848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6988efea-4453-4d1d-860d-4ea8575cc912 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:52.318478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6988efea-4453-4d1d-860d-4ea8575cc912 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:52.338210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6988efea-4453-4d1d-860d-4ea8575cc912 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:52.338918 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6988efea-4453-4d1d-860d-4ea8575cc912 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:52.339871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6988efea-4453-4d1d-860d-4ea8575cc912 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:52.340491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6988efea-4453-4d1d-860d-4ea8575cc912 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:52.369408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:46:52.369973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:46:52.370598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:46:52.371511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:46:52.372735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:46:52.401009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:52.402804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:52.406927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:52.409429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:52.481243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:46:52.490831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Getting quotas for user 2ace0ada06df49f189f02e59039c2dd8 and project 1f899f15d3284d9d8b7f9509f1017944. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:46:52.531121 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6988efea-4453-4d1d-860d-4ea8575cc912 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1338 microversion: 2.1 time: 0.217645 Jul 26 14:46:52.531728 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2719/5569] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:52 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1338 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:52.568541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:46:52.583991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:46:52.681046 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-801471c4-6ae3-43da-a44f-7bbbffe84286 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.122176 Jul 26 14:46:52.682103 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2851/5570] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:46:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:46:52.693910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9eba7de3-5b99-44c6-b0ea-43fba7ad7808 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:52.694545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9eba7de3-5b99-44c6-b0ea-43fba7ad7808 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:52.844838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9eba7de3-5b99-44c6-b0ea-43fba7ad7808 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:52.853280 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9eba7de3-5b99-44c6-b0ea-43fba7ad7808 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1267 microversion: 2.1 time: 0.163289 Jul 26 14:46:52.853865 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2720/5571] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:52 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:52.906101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ef637011-9a19-42f1-ae7e-021505a909b1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:52.908509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef637011-9a19-42f1-ae7e-021505a909b1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:52.919909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef637011-9a19-42f1-ae7e-021505a909b1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:52.924630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef637011-9a19-42f1-ae7e-021505a909b1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:52.925777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef637011-9a19-42f1-ae7e-021505a909b1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:52.926902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef637011-9a19-42f1-ae7e-021505a909b1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:53.184524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a4198f3b-e38a-428e-b036-af4d9111781e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:53.191768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a4198f3b-e38a-428e-b036-af4d9111781e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:53.227359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4198f3b-e38a-428e-b036-af4d9111781e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:53.240643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4198f3b-e38a-428e-b036-af4d9111781e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:53.243351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4198f3b-e38a-428e-b036-af4d9111781e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:53.244341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4198f3b-e38a-428e-b036-af4d9111781e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:53.362900 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a4198f3b-e38a-428e-b036-af4d9111781e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190131 Jul 26 14:46:53.371555 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2721/5572] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:46:53 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:46:53.540518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ef637011-9a19-42f1-ae7e-021505a909b1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:53.558199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a00e2983-e4e6-4d57-8cee-22d352d6b747 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:53.559164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a00e2983-e4e6-4d57-8cee-22d352d6b747 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:53.571794 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ef637011-9a19-42f1-ae7e-021505a909b1 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1372 microversion: 2.1 time: 0.669774 Jul 26 14:46:53.577382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a00e2983-e4e6-4d57-8cee-22d352d6b747 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:53.577925 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2852/5573] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:52 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1372 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:53.580222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a00e2983-e4e6-4d57-8cee-22d352d6b747 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:53.581206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a00e2983-e4e6-4d57-8cee-22d352d6b747 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:53.581793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a00e2983-e4e6-4d57-8cee-22d352d6b747 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:53.856962 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a00e2983-e4e6-4d57-8cee-22d352d6b747 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1422 microversion: 2.1 time: 0.302955 Jul 26 14:46:53.860387 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2722/5574] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:53 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1422 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:53.879181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-530eb95d-eae6-4624-85e8-52f080b47676 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:53.880550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-530eb95d-eae6-4624-85e8-52f080b47676 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:53.890292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-530eb95d-eae6-4624-85e8-52f080b47676 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:53.897184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-530eb95d-eae6-4624-85e8-52f080b47676 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:53.898419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-530eb95d-eae6-4624-85e8-52f080b47676 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:53.899043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-530eb95d-eae6-4624-85e8-52f080b47676 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:54.094646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-530eb95d-eae6-4624-85e8-52f080b47676 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:54.115016 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-530eb95d-eae6-4624-85e8-52f080b47676 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1271 microversion: 2.1 time: 0.241463 Jul 26 14:46:54.131389 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2853/5575] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:53 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:54.384076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-571f0a4b-bbd2-48e0-801f-838fa9d90a58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:54.386379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-571f0a4b-bbd2-48e0-801f-838fa9d90a58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:54.442233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-571f0a4b-bbd2-48e0-801f-838fa9d90a58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:54.451992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-571f0a4b-bbd2-48e0-801f-838fa9d90a58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:54.453156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-571f0a4b-bbd2-48e0-801f-838fa9d90a58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:54.453494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-571f0a4b-bbd2-48e0-801f-838fa9d90a58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:54.545266 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-571f0a4b-bbd2-48e0-801f-838fa9d90a58 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166319 Jul 26 14:46:54.559323 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2723/5576] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:46:54 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:54.600324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eea58008-39ae-4a36-b8e5-339b7a6c921e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:54.601506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eea58008-39ae-4a36-b8e5-339b7a6c921e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:54.613130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eea58008-39ae-4a36-b8e5-339b7a6c921e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:54.613662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eea58008-39ae-4a36-b8e5-339b7a6c921e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:54.614398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eea58008-39ae-4a36-b8e5-339b7a6c921e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:54.614856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eea58008-39ae-4a36-b8e5-339b7a6c921e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:54.887080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3d6797f-1915-4582-acff-91e1daca2ba2 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:54.887770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f3d6797f-1915-4582-acff-91e1daca2ba2 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:54.900196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3d6797f-1915-4582-acff-91e1daca2ba2 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:54.901124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3d6797f-1915-4582-acff-91e1daca2ba2 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:54.910565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3d6797f-1915-4582-acff-91e1daca2ba2 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:54.912917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3d6797f-1915-4582-acff-91e1daca2ba2 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:55.792359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eea58008-39ae-4a36-b8e5-339b7a6c921e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:55.807295 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eea58008-39ae-4a36-b8e5-339b7a6c921e tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1372 microversion: 2.1 time: 1.211917 Jul 26 14:46:55.810460 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2854/5577] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:54 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1372 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:55.824913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-485b56e6-87b7-4695-89c8-05187211a80b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:55.828802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-485b56e6-87b7-4695-89c8-05187211a80b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:55.841977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-485b56e6-87b7-4695-89c8-05187211a80b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:55.842440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-485b56e6-87b7-4695-89c8-05187211a80b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:55.843230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-485b56e6-87b7-4695-89c8-05187211a80b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:55.843683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-485b56e6-87b7-4695-89c8-05187211a80b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:55.886423 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f3d6797f-1915-4582-acff-91e1daca2ba2 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1464 microversion: 2.1 time: 1.004118 Jul 26 14:46:55.888295 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2724/5578] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:54 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1464 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:46:55.901478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-cd8a1d1b-ecdb-4d6a-b684-82ba063abe06 req-eb5215de-7fda-4b98-bbaa-c52f7563e9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4145de3a-1f5d-4d15-9d88-79393524853b", "name": "network-vif-plugged", "status": "completed", "tag": "9d13ac50-a939-4278-8a79-1097da0d61a8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:55.924654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cd8a1d1b-ecdb-4d6a-b684-82ba063abe06 req-eb5215de-7fda-4b98-bbaa-c52f7563e9d8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:55.925376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cd8a1d1b-ecdb-4d6a-b684-82ba063abe06 req-eb5215de-7fda-4b98-bbaa-c52f7563e9d8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:55.939755 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-cd8a1d1b-ecdb-4d6a-b684-82ba063abe06 req-eb5215de-7fda-4b98-bbaa-c52f7563e9d8 service nova] Creating event network-vif-plugged:9d13ac50-a939-4278-8a79-1097da0d61a8 for instance 4145de3a-1f5d-4d15-9d88-79393524853b on n-h2-833090-9 Jul 26 14:46:55.946248 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-cd8a1d1b-ecdb-4d6a-b684-82ba063abe06 req-eb5215de-7fda-4b98-bbaa-c52f7563e9d8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056512 Jul 26 14:46:55.948195 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2725/5579] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:55.960387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-485b56e6-87b7-4695-89c8-05187211a80b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:55.967567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-300c2f42-c3da-41f5-9509-fe961177fe1b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:55.972606 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-485b56e6-87b7-4695-89c8-05187211a80b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1325 microversion: 2.1 time: 0.157943 Jul 26 14:46:55.973967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-300c2f42-c3da-41f5-9509-fe961177fe1b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:55.974539 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2855/5580] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:55 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:55.999133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-300c2f42-c3da-41f5-9509-fe961177fe1b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:55.999888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-300c2f42-c3da-41f5-9509-fe961177fe1b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:56.001341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-300c2f42-c3da-41f5-9509-fe961177fe1b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:56.002981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-300c2f42-c3da-41f5-9509-fe961177fe1b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:56.030881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:46:56.056053 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-300c2f42-c3da-41f5-9509-fe961177fe1b tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106051 Jul 26 14:46:56.061405 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2726/5581] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:46:55 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:56.833424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-44f2a938-8c53-4ea6-aca2-5f130e55fe53 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:56.834136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-44f2a938-8c53-4ea6-aca2-5f130e55fe53 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:56.846704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44f2a938-8c53-4ea6-aca2-5f130e55fe53 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:56.847568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44f2a938-8c53-4ea6-aca2-5f130e55fe53 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:56.849645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44f2a938-8c53-4ea6-aca2-5f130e55fe53 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:56.850443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44f2a938-8c53-4ea6-aca2-5f130e55fe53 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:56.911675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0ab11ac-2dc4-460d-9363-498998e4fcf6 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:56.912986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c0ab11ac-2dc4-460d-9363-498998e4fcf6 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:56.922337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0ab11ac-2dc4-460d-9363-498998e4fcf6 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:56.923246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0ab11ac-2dc4-460d-9363-498998e4fcf6 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:56.924404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0ab11ac-2dc4-460d-9363-498998e4fcf6 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:56.925033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0ab11ac-2dc4-460d-9363-498998e4fcf6 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:57.455614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-44f2a938-8c53-4ea6-aca2-5f130e55fe53 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:57.467653 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-44f2a938-8c53-4ea6-aca2-5f130e55fe53 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1372 microversion: 2.1 time: 0.638367 Jul 26 14:46:57.469079 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2856/5582] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:56 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1372 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:57.489792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1cce091-c2f2-4f71-b578-eeb23d633de3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:57.491252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f1cce091-c2f2-4f71-b578-eeb23d633de3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:57.498164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1cce091-c2f2-4f71-b578-eeb23d633de3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:57.498868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1cce091-c2f2-4f71-b578-eeb23d633de3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:57.499899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1cce091-c2f2-4f71-b578-eeb23d633de3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:57.501481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1cce091-c2f2-4f71-b578-eeb23d633de3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:57.550306 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c0ab11ac-2dc4-460d-9363-498998e4fcf6 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1464 microversion: 2.1 time: 0.644361 Jul 26 14:46:57.551576 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2727/5583] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:56 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1464 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:46:57.565702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3527bc7f-8ef8-4f99-8f3f-7cee98ff33b9 req-85c3f661-29a5-4f41-8af7-355f8c0c52f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22624f44-4702-4bdf-82a1-3913313d7e32", "tag": "ad4cfc8a-3716-4548-b2af-1937f67c1525"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:57.597237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3527bc7f-8ef8-4f99-8f3f-7cee98ff33b9 req-85c3f661-29a5-4f41-8af7-355f8c0c52f3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:57.600202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3527bc7f-8ef8-4f99-8f3f-7cee98ff33b9 req-85c3f661-29a5-4f41-8af7-355f8c0c52f3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:57.636093 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3527bc7f-8ef8-4f99-8f3f-7cee98ff33b9 req-85c3f661-29a5-4f41-8af7-355f8c0c52f3 service nova] Creating event network-changed:ad4cfc8a-3716-4548-b2af-1937f67c1525 for instance 22624f44-4702-4bdf-82a1-3913313d7e32 on n-h2-833090-9 Jul 26 14:46:57.644141 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3527bc7f-8ef8-4f99-8f3f-7cee98ff33b9 req-85c3f661-29a5-4f41-8af7-355f8c0c52f3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090264 Jul 26 14:46:57.645656 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2728/5584] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:57.654005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1165982c-765a-4b66-961c-ad807c7e6dbe tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:57.656771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1165982c-765a-4b66-961c-ad807c7e6dbe tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:57.665929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1165982c-765a-4b66-961c-ad807c7e6dbe tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:57.666861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1165982c-765a-4b66-961c-ad807c7e6dbe tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:57.667819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1165982c-765a-4b66-961c-ad807c7e6dbe tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:57.668436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1165982c-765a-4b66-961c-ad807c7e6dbe tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:57.719483 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1165982c-765a-4b66-961c-ad807c7e6dbe tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072284 Jul 26 14:46:57.727362 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2729/5585] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:46:57 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:46:57.870472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb94eae5-47b6-453c-bf46-165e0265616a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:57.881817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bb94eae5-47b6-453c-bf46-165e0265616a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:57.915797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb94eae5-47b6-453c-bf46-165e0265616a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:57.919290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb94eae5-47b6-453c-bf46-165e0265616a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:57.920213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb94eae5-47b6-453c-bf46-165e0265616a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:57.925415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb94eae5-47b6-453c-bf46-165e0265616a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:57.991680 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-bb94eae5-47b6-453c-bf46-165e0265616a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] HTTP exception thrown: Cannot 'reboot' instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 while it is in vm_state rescued Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb94eae5-47b6-453c-bf46-165e0265616a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Request method failure captured: Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1/action HTTP/1.1 Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 28 Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_1f6ZzJX0S01b_Op3EoMNcBZEG-kX6NKBmC9y8eYSEGGvW2IzzGDCwRHyopc8xJm4faZa9Jll31j2AyA8-1nj2TIW6-NxgVw70z941LrxxyqTc1krrtQixKuVoRbZbeVXl3oq2yJDnuG60YY3irOdy923OsfCXhYNJbHMgyTRh4Lb0 Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7386a23b259b4c4091637972951a3f0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}] Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ca1aaf9a4ab74a829ef94a7d54c683cd Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: {"reboot": {"type": "HARD"}} Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: exception: Cannot 'reboot' instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 while it is in vm_state rescued Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c77f907e-8855-4f3f-bbf3-690ea1872bc1', 'body': {'reboot': {'type': 'HARD'}}} Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:46:58.002515 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 while it is in vm_state rescued Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 while it is in vm_state rescued Jul 26 14:46:58.007896 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:58.008721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1cce091-c2f2-4f71-b578-eeb23d633de3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:58.010676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb94eae5-47b6-453c-bf46-165e0265616a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Returning 409 to user: Cannot 'reboot' instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 while it is in vm_state rescued {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:46:58.011752 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bb94eae5-47b6-453c-bf46-165e0265616a tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1/action" status: 409 len: 145 microversion: 2.1 time: 0.145333 Jul 26 14:46:58.017226 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2730/5586] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:46:57 2022] POST /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1/action => generated 145 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:46:58.023057 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f1cce091-c2f2-4f71-b578-eeb23d633de3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1393 microversion: 2.1 time: 0.547970 Jul 26 14:46:58.023795 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2857/5587] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:57 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1393 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:58.038589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b0d50fde-8e83-4177-a83e-20b0ff9815df tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:58.046843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b0d50fde-8e83-4177-a83e-20b0ff9815df tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:58.062682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0d50fde-8e83-4177-a83e-20b0ff9815df tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.064355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0d50fde-8e83-4177-a83e-20b0ff9815df tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.067140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0d50fde-8e83-4177-a83e-20b0ff9815df tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.068226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b0d50fde-8e83-4177-a83e-20b0ff9815df tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.134255 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-b0d50fde-8e83-4177-a83e-20b0ff9815df tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] HTTP exception thrown: Cannot 'rebuild' instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 while it is in vm_state rescued Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b0d50fde-8e83-4177-a83e-20b0ff9815df tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Request method failure captured: Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1/action HTTP/1.1 Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 65 Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_1f6ZzJX0S01b_Op3EoMNcBZEG-kX6NKBmC9y8eYSEGGvW2IzzGDCwRHyopc8xJm4faZa9Jll31j2AyA8-1nj2TIW6-NxgVw70z941LrxxyqTc1krrtQixKuVoRbZbeVXl3oq2yJDnuG60YY3irOdy923OsfCXhYNJbHMgyTRh4Lb0 Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7386a23b259b4c4091637972951a3f0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}] Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ca1aaf9a4ab74a829ef94a7d54c683cd Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: exception: Cannot 'rebuild' instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 while it is in vm_state rescued Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c77f907e-8855-4f3f-bbf3-690ea1872bc1', 'body': {'rebuild': {'imageRef': '5fc64a26-e870-4f37-8cf2-dd18e171162e'}}} Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:46:58.137021 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 while it is in vm_state rescued Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 while it is in vm_state rescued Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b0d50fde-8e83-4177-a83e-20b0ff9815df tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Returning 409 to user: Cannot 'rebuild' instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 while it is in vm_state rescued {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b0d50fde-8e83-4177-a83e-20b0ff9815df tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "POST /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1/action" status: 409 len: 146 microversion: 2.1 time: 0.120045 Jul 26 14:46:58.141457 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2731/5588] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:46:58 2022] POST /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1/action => generated 146 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:46:58.153137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4e2a8134-13f9-4410-8276-0f7178822276 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:58.153639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4e2a8134-13f9-4410-8276-0f7178822276 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:58.162521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e2a8134-13f9-4410-8276-0f7178822276 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.163151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e2a8134-13f9-4410-8276-0f7178822276 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.167592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e2a8134-13f9-4410-8276-0f7178822276 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.169591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e2a8134-13f9-4410-8276-0f7178822276 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.205340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4e2a8134-13f9-4410-8276-0f7178822276 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:46:58.363755 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4e2a8134-13f9-4410-8276-0f7178822276 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 204 len: 0 microversion: 2.1 time: 0.213900 Jul 26 14:46:58.364230 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2858/5589] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:46:58 2022] DELETE /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:46:58.372506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-82ceba83-da20-40a5-b758-a848f4d50876 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:58.373148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-82ceba83-da20-40a5-b758-a848f4d50876 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:58.380667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82ceba83-da20-40a5-b758-a848f4d50876 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.381388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82ceba83-da20-40a5-b758-a848f4d50876 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.382350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82ceba83-da20-40a5-b758-a848f4d50876 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.382959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82ceba83-da20-40a5-b758-a848f4d50876 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.496866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6c99ac5b-aaeb-4967-9541-f7f73bc8196b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:58.497844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6c99ac5b-aaeb-4967-9541-f7f73bc8196b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:58.506387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c99ac5b-aaeb-4967-9541-f7f73bc8196b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.506846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c99ac5b-aaeb-4967-9541-f7f73bc8196b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.508223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c99ac5b-aaeb-4967-9541-f7f73bc8196b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.508829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c99ac5b-aaeb-4967-9541-f7f73bc8196b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.891100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-82ceba83-da20-40a5-b758-a848f4d50876 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:58.897743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6c99ac5b-aaeb-4967-9541-f7f73bc8196b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:58.925603 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6c99ac5b-aaeb-4967-9541-f7f73bc8196b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1544 microversion: 2.1 time: 0.436622 Jul 26 14:46:58.941089 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2859/5590] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:58 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1544 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:58.941402 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-82ceba83-da20-40a5-b758-a848f4d50876 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1687 microversion: 2.1 time: 0.556774 Jul 26 14:46:58.941968 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2732/5591] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:58 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1687 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:58.958575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5c56e2fe-8629-4a88-9897-5637424f68f9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:58.958977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fd5c976d-d246-41df-860d-2d0e5d3992db tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:58.959706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fd5c976d-d246-41df-860d-2d0e5d3992db tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:58.960498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5c56e2fe-8629-4a88-9897-5637424f68f9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:58.979697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c56e2fe-8629-4a88-9897-5637424f68f9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.980697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c56e2fe-8629-4a88-9897-5637424f68f9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.981707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd5c976d-d246-41df-860d-2d0e5d3992db tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.982230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c56e2fe-8629-4a88-9897-5637424f68f9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.983676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c56e2fe-8629-4a88-9897-5637424f68f9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.985472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd5c976d-d246-41df-860d-2d0e5d3992db tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:58.989259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd5c976d-d246-41df-860d-2d0e5d3992db tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:58.991248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd5c976d-d246-41df-860d-2d0e5d3992db tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:59.397265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fd5c976d-d246-41df-860d-2d0e5d3992db tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:59.414052 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fd5c976d-d246-41df-860d-2d0e5d3992db tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1544 microversion: 2.1 time: 0.464874 Jul 26 14:46:59.414655 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2733/5592] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:58 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1544 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:59.425170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f815cc0a-c8ed-4dda-aa7c-c0cede5bc98e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:59.425803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f815cc0a-c8ed-4dda-aa7c-c0cede5bc98e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:59.440860 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5c56e2fe-8629-4a88-9897-5637424f68f9 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1464 microversion: 2.1 time: 0.513341 Jul 26 14:46:59.441895 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2860/5593] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:58 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1464 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:59.474093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f815cc0a-c8ed-4dda-aa7c-c0cede5bc98e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:59.475061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f815cc0a-c8ed-4dda-aa7c-c0cede5bc98e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:59.476653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f815cc0a-c8ed-4dda-aa7c-c0cede5bc98e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:59.478353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f815cc0a-c8ed-4dda-aa7c-c0cede5bc98e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:59.819360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-86fee0ae-faf4-48cf-882a-ed019f7e1db7 req-c65712d5-852b-4be2-aa6e-4e2d36d241c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c", "tag": "20747ce4-f67e-4252-9932-52b7be2a6ac0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:46:59.819663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f815cc0a-c8ed-4dda-aa7c-c0cede5bc98e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:46:59.834849 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f815cc0a-c8ed-4dda-aa7c-c0cede5bc98e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1393 microversion: 2.1 time: 0.416814 Jul 26 14:46:59.837956 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2734/5594] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:59 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1393 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:46:59.846183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-86fee0ae-faf4-48cf-882a-ed019f7e1db7 req-c65712d5-852b-4be2-aa6e-4e2d36d241c1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:59.847135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-86fee0ae-faf4-48cf-882a-ed019f7e1db7 req-c65712d5-852b-4be2-aa6e-4e2d36d241c1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:59.869008 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-86fee0ae-faf4-48cf-882a-ed019f7e1db7 req-c65712d5-852b-4be2-aa6e-4e2d36d241c1 service nova] Creating event network-changed:20747ce4-f67e-4252-9932-52b7be2a6ac0 for instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c on n-h1-833090-9 Jul 26 14:46:59.878513 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-86fee0ae-faf4-48cf-882a-ed019f7e1db7 req-c65712d5-852b-4be2-aa6e-4e2d36d241c1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064660 Jul 26 14:46:59.879734 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2861/5595] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:46:59.955619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a4b2055c-32fc-4700-a189-c60965e44ec5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:46:59.956399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a4b2055c-32fc-4700-a189-c60965e44ec5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:46:59.967924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4b2055c-32fc-4700-a189-c60965e44ec5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:59.971336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4b2055c-32fc-4700-a189-c60965e44ec5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:46:59.973488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4b2055c-32fc-4700-a189-c60965e44ec5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:46:59.974980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4b2055c-32fc-4700-a189-c60965e44ec5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:00.310922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a4b2055c-32fc-4700-a189-c60965e44ec5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:00.324782 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a4b2055c-32fc-4700-a189-c60965e44ec5 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1687 microversion: 2.1 time: 0.372257 Jul 26 14:47:00.325415 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2735/5596] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:46:59 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1687 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:00.473657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b690da2d-198e-4cc2-b8a7-76821846249a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:00.474350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b690da2d-198e-4cc2-b8a7-76821846249a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:00.485879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b690da2d-198e-4cc2-b8a7-76821846249a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:00.488876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b690da2d-198e-4cc2-b8a7-76821846249a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:00.492659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b690da2d-198e-4cc2-b8a7-76821846249a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:00.497277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b690da2d-198e-4cc2-b8a7-76821846249a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:00.858622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aaf4302a-d03b-467a-9238-105aa40dcca0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:00.859613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aaf4302a-d03b-467a-9238-105aa40dcca0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:00.872442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:00.878590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aaf4302a-d03b-467a-9238-105aa40dcca0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:00.881872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aaf4302a-d03b-467a-9238-105aa40dcca0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:00.882978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aaf4302a-d03b-467a-9238-105aa40dcca0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:00.888006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aaf4302a-d03b-467a-9238-105aa40dcca0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:01.566302 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b690da2d-198e-4cc2-b8a7-76821846249a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1464 microversion: 2.1 time: 1.099123 Jul 26 14:47:01.596189 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2862/5597] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:00 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1464 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:01.606729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6ae3ff08-df11-4e3d-b74b-edd044ae6856 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:01.607178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6ae3ff08-df11-4e3d-b74b-edd044ae6856 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:01.620520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6ae3ff08-df11-4e3d-b74b-edd044ae6856 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:01.621147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6ae3ff08-df11-4e3d-b74b-edd044ae6856 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:01.621955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6ae3ff08-df11-4e3d-b74b-edd044ae6856 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:01.622391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6ae3ff08-df11-4e3d-b74b-edd044ae6856 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:02.200189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aaf4302a-d03b-467a-9238-105aa40dcca0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:02.211910 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aaf4302a-d03b-467a-9238-105aa40dcca0 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1393 microversion: 2.1 time: 1.358834 Jul 26 14:47:02.223621 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2736/5598] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:00 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1393 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:47:02.413307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6ae3ff08-df11-4e3d-b74b-edd044ae6856 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:02.425994 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6ae3ff08-df11-4e3d-b74b-edd044ae6856 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1687 microversion: 2.1 time: 0.834809 Jul 26 14:47:02.429009 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2863/5599] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:01 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1687 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:02.611857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-18400ecd-434a-4891-bf36-4d0192e423a5 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:02.612801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-18400ecd-434a-4891-bf36-4d0192e423a5 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:02.620090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18400ecd-434a-4891-bf36-4d0192e423a5 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:02.620844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18400ecd-434a-4891-bf36-4d0192e423a5 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:02.621893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18400ecd-434a-4891-bf36-4d0192e423a5 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:02.622599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18400ecd-434a-4891-bf36-4d0192e423a5 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:02.849778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:03.047741 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-18400ecd-434a-4891-bf36-4d0192e423a5 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1464 microversion: 2.1 time: 0.440500 Jul 26 14:47:03.049689 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2737/5600] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:02 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1464 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:03.199062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-3633aedf-c260-4730-8e94-f1c6e0b3311e req-9a5ceb49-8d9f-4b2d-a1bf-b20c70798fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4145de3a-1f5d-4d15-9d88-79393524853b", "tag": "9d13ac50-a939-4278-8a79-1097da0d61a8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:03.216783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:03.218965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:03.222564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3633aedf-c260-4730-8e94-f1c6e0b3311e req-9a5ceb49-8d9f-4b2d-a1bf-b20c70798fcc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:03.223233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3633aedf-c260-4730-8e94-f1c6e0b3311e req-9a5ceb49-8d9f-4b2d-a1bf-b20c70798fcc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:03.244096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b5ee6542-3f1c-4b32-bfd6-3dd4f0ec4ff6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:03.245911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b5ee6542-3f1c-4b32-bfd6-3dd4f0ec4ff6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:03.249944 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-3633aedf-c260-4730-8e94-f1c6e0b3311e req-9a5ceb49-8d9f-4b2d-a1bf-b20c70798fcc service nova] Creating event network-changed:9d13ac50-a939-4278-8a79-1097da0d61a8 for instance 4145de3a-1f5d-4d15-9d88-79393524853b on n-h2-833090-9 Jul 26 14:47:03.261991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5ee6542-3f1c-4b32-bfd6-3dd4f0ec4ff6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:03.266600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5ee6542-3f1c-4b32-bfd6-3dd4f0ec4ff6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:03.268500 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-3633aedf-c260-4730-8e94-f1c6e0b3311e req-9a5ceb49-8d9f-4b2d-a1bf-b20c70798fcc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072998 Jul 26 14:47:03.269520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5ee6542-3f1c-4b32-bfd6-3dd4f0ec4ff6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:03.273074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5ee6542-3f1c-4b32-bfd6-3dd4f0ec4ff6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:03.275465 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2864/5601] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:03.348283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1c8a80bb-e33f-4582-b3f5-4d3e4e804017 req-6fedd15e-727b-4924-b276-6eea9976cfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22624f44-4702-4bdf-82a1-3913313d7e32", "name": "network-vif-plugged", "status": "completed", "tag": "ad4cfc8a-3716-4548-b2af-1937f67c1525"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:03.369008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1c8a80bb-e33f-4582-b3f5-4d3e4e804017 req-6fedd15e-727b-4924-b276-6eea9976cfe8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:03.369910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1c8a80bb-e33f-4582-b3f5-4d3e4e804017 req-6fedd15e-727b-4924-b276-6eea9976cfe8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:03.388717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:03.393589 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1c8a80bb-e33f-4582-b3f5-4d3e4e804017 req-6fedd15e-727b-4924-b276-6eea9976cfe8 service nova] Creating event network-vif-plugged:ad4cfc8a-3716-4548-b2af-1937f67c1525 for instance 22624f44-4702-4bdf-82a1-3913313d7e32 on n-h2-833090-9 Jul 26 14:47:03.404646 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1c8a80bb-e33f-4582-b3f5-4d3e4e804017 req-6fedd15e-727b-4924-b276-6eea9976cfe8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059234 Jul 26 14:47:03.405857 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2865/5602] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:03.473036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85e0fc30-091a-4f98-8dc3-f4f426b9dd48 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:03.474122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85e0fc30-091a-4f98-8dc3-f4f426b9dd48 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:03.483214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85e0fc30-091a-4f98-8dc3-f4f426b9dd48 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:03.483684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85e0fc30-091a-4f98-8dc3-f4f426b9dd48 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:03.485512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85e0fc30-091a-4f98-8dc3-f4f426b9dd48 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:03.487245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85e0fc30-091a-4f98-8dc3-f4f426b9dd48 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:03.902582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-85e0fc30-091a-4f98-8dc3-f4f426b9dd48 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:03.922225 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85e0fc30-091a-4f98-8dc3-f4f426b9dd48 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 200 len: 1619 microversion: 2.1 time: 0.458126 Jul 26 14:47:03.927133 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2866/5603] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:03 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 1619 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:04.071266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-39f454a2-52e8-404c-a495-c80462c4a40b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:04.072247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-39f454a2-52e8-404c-a495-c80462c4a40b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:04.091794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39f454a2-52e8-404c-a495-c80462c4a40b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:04.093798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39f454a2-52e8-404c-a495-c80462c4a40b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:04.094888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39f454a2-52e8-404c-a495-c80462c4a40b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:04.099609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39f454a2-52e8-404c-a495-c80462c4a40b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:05.097645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b5ee6542-3f1c-4b32-bfd6-3dd4f0ec4ff6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:05.127884 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b5ee6542-3f1c-4b32-bfd6-3dd4f0ec4ff6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1393 microversion: 2.1 time: 1.888980 Jul 26 14:47:05.128911 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2738/5604] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:03 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1393 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:47:05.149494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8431aeec-2485-4004-beb2-096bda55539e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:05.150321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8431aeec-2485-4004-beb2-096bda55539e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: 05ee36bc-0796-4af3-a631-93e2060ca82d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:05.159437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8431aeec-2485-4004-beb2-096bda55539e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:05.160498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8431aeec-2485-4004-beb2-096bda55539e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:05.162364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8431aeec-2485-4004-beb2-096bda55539e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:05.163225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8431aeec-2485-4004-beb2-096bda55539e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:05.198210 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8431aeec-2485-4004-beb2-096bda55539e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] HTTP exception thrown: Instance 05ee36bc-0796-4af3-a631-93e2060ca82d could not be found. Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8431aeec-2485-4004-beb2-096bda55539e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Request method failure captured: Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d HTTP/1.1 Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_1f6ZzJX0S01b_Op3EoMNcBZEG-kX6NKBmC9y8eYSEGGvW2IzzGDCwRHyopc8xJm4faZa9Jll31j2AyA8-1nj2TIW6-NxgVw70z941LrxxyqTc1krrtQixKuVoRbZbeVXl3oq2yJDnuG60YY3irOdy923OsfCXhYNJbHMgyTRh4Lb0 Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7386a23b259b4c4091637972951a3f0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}] Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ca1aaf9a4ab74a829ef94a7d54c683cd Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 05ee36bc-0796-4af3-a631-93e2060ca82d could not be found. Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '05ee36bc-0796-4af3-a631-93e2060ca82d'} Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ee36bc-0796-4af3-a631-93e2060ca82d could not be found. Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ee36bc-0796-4af3-a631-93e2060ca82d could not be found. Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:05.200712 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:05.207555 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:05.207555 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:05.207555 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:05.207555 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:47:05.207555 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:47:05.207555 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ee36bc-0796-4af3-a631-93e2060ca82d could not be found. Jul 26 14:47:05.207555 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:05.207555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8431aeec-2485-4004-beb2-096bda55539e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Returning 404 to user: Instance 05ee36bc-0796-4af3-a631-93e2060ca82d could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:47:05.207555 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8431aeec-2485-4004-beb2-096bda55539e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d" status: 404 len: 111 microversion: 2.1 time: 0.064426 Jul 26 14:47:05.212219 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2739/5605] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:05 2022] GET /compute/v2.1/servers/05ee36bc-0796-4af3-a631-93e2060ca82d => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:47:05.223714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-274995e4-b019-45eb-8d8d-b0130395a2fb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '.version_select at 0x7f8786ef63a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:05.266465 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-274995e4-b019-45eb-8d8d-b0130395a2fb tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-869598790" status: 202 len: 0 microversion: 2.1 time: 0.050317 Jul 26 14:47:05.268710 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2740/5606] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Jul 26 14:47:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-869598790 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:47:05.302392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a8bc0084-82e9-4eaa-bb88-139d5356483d req-aeccd715-098c-40a1-8745-856747ebc9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ee36bc-0796-4af3-a631-93e2060ca82d", "name": "network-vif-deleted", "tag": "a8a183a7-5f4c-4925-a69c-f17c5aa3fea8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:05.336803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a8bc0084-82e9-4eaa-bb88-139d5356483d req-aeccd715-098c-40a1-8745-856747ebc9c7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:05.338513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a8bc0084-82e9-4eaa-bb88-139d5356483d req-aeccd715-098c-40a1-8745-856747ebc9c7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:05.366788 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a8bc0084-82e9-4eaa-bb88-139d5356483d req-aeccd715-098c-40a1-8745-856747ebc9c7 service nova] Creating event network-vif-deleted:a8a183a7-5f4c-4925-a69c-f17c5aa3fea8 for instance 05ee36bc-0796-4af3-a631-93e2060ca82d on n-h1-833090-9 Jul 26 14:47:05.378038 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a8bc0084-82e9-4eaa-bb88-139d5356483d req-aeccd715-098c-40a1-8745-856747ebc9c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080419 Jul 26 14:47:05.379104 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2741/5607] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:47:05.449685 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-39f454a2-52e8-404c-a495-c80462c4a40b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1464 microversion: 2.1 time: 1.382248 Jul 26 14:47:05.464613 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2867/5608] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:04 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1464 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:06.166462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02f39545-7ee4-4742-a8a6-e05d3ddd8a51 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:06.171066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-02f39545-7ee4-4742-a8a6-e05d3ddd8a51 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:06.194104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02f39545-7ee4-4742-a8a6-e05d3ddd8a51 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:06.194770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02f39545-7ee4-4742-a8a6-e05d3ddd8a51 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:06.195752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02f39545-7ee4-4742-a8a6-e05d3ddd8a51 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:06.196537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02f39545-7ee4-4742-a8a6-e05d3ddd8a51 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:06.473518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f7244620-2102-429e-9677-0410fc1e233f tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:06.474480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f7244620-2102-429e-9677-0410fc1e233f tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:06.482674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f7244620-2102-429e-9677-0410fc1e233f tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:06.483408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f7244620-2102-429e-9677-0410fc1e233f tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:06.485439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f7244620-2102-429e-9677-0410fc1e233f tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:06.486078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f7244620-2102-429e-9677-0410fc1e233f tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:06.526657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-02f39545-7ee4-4742-a8a6-e05d3ddd8a51 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:06.540671 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-02f39545-7ee4-4742-a8a6-e05d3ddd8a51 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1393 microversion: 2.1 time: 0.383720 Jul 26 14:47:06.541283 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2742/5609] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:06 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1393 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:47:07.051623 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f7244620-2102-429e-9677-0410fc1e233f tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1648 microversion: 2.1 time: 0.583252 Jul 26 14:47:07.052778 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2868/5610] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:06 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1648 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:07.075077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d3a8f96b-1c8c-48a6-8fec-0d1af8019c20 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:07.075869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d3a8f96b-1c8c-48a6-8fec-0d1af8019c20 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:07.095720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3a8f96b-1c8c-48a6-8fec-0d1af8019c20 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:07.096896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3a8f96b-1c8c-48a6-8fec-0d1af8019c20 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:07.109709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3a8f96b-1c8c-48a6-8fec-0d1af8019c20 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:07.111737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d3a8f96b-1c8c-48a6-8fec-0d1af8019c20 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:07.384076 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d3a8f96b-1c8c-48a6-8fec-0d1af8019c20 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1648 microversion: 2.1 time: 0.312990 Jul 26 14:47:07.396022 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2743/5611] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:07 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1648 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:07.406508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4bad3ce2-98ae-47f2-b089-b5a07d007c35 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:07.407286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4bad3ce2-98ae-47f2-b089-b5a07d007c35 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:07.418711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bad3ce2-98ae-47f2-b089-b5a07d007c35 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:07.420815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bad3ce2-98ae-47f2-b089-b5a07d007c35 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:07.422489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bad3ce2-98ae-47f2-b089-b5a07d007c35 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:07.424335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4bad3ce2-98ae-47f2-b089-b5a07d007c35 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:07.564246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4867f7c2-6a26-4335-9125-024db0f2417a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:07.564880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4867f7c2-6a26-4335-9125-024db0f2417a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:07.583990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4867f7c2-6a26-4335-9125-024db0f2417a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:07.584642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4867f7c2-6a26-4335-9125-024db0f2417a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:07.585280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4867f7c2-6a26-4335-9125-024db0f2417a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:07.585731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4867f7c2-6a26-4335-9125-024db0f2417a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:07.748022 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4bad3ce2-98ae-47f2-b089-b5a07d007c35 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1648 microversion: 2.1 time: 0.345285 Jul 26 14:47:07.762614 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2869/5612] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:07 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1648 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:07.775424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00690e42-f273-433c-a572-5b2a4ac3247a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:07.776308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00690e42-f273-433c-a572-5b2a4ac3247a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:07.783677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00690e42-f273-433c-a572-5b2a4ac3247a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:07.784851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00690e42-f273-433c-a572-5b2a4ac3247a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:07.785904 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00690e42-f273-433c-a572-5b2a4ac3247a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:07.786871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00690e42-f273-433c-a572-5b2a4ac3247a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:07.834512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00690e42-f273-433c-a572-5b2a4ac3247a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:47:08.030381 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-00690e42-f273-433c-a572-5b2a4ac3247a tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 204 len: 0 microversion: 2.1 time: 0.258871 Jul 26 14:47:08.031701 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2870/5613] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:47:07 2022] DELETE /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:47:08.041334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9936f60b-9ba7-4592-8c9f-06068be31797 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:08.042121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9936f60b-9ba7-4592-8c9f-06068be31797 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:08.067397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4867f7c2-6a26-4335-9125-024db0f2417a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:08.070007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9936f60b-9ba7-4592-8c9f-06068be31797 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:08.071160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9936f60b-9ba7-4592-8c9f-06068be31797 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:08.077378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9936f60b-9ba7-4592-8c9f-06068be31797 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:08.078566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9936f60b-9ba7-4592-8c9f-06068be31797 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:08.084288 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4867f7c2-6a26-4335-9125-024db0f2417a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1393 microversion: 2.1 time: 0.523432 Jul 26 14:47:08.085044 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2744/5614] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:07 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1393 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:08.471750 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9936f60b-9ba7-4592-8c9f-06068be31797 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1654 microversion: 2.1 time: 0.434700 Jul 26 14:47:08.476870 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2871/5615] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:08 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1654 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:47:09.123908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ed66aa0b-f836-4d15-b170-dda8b00d7f5e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:09.124723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ed66aa0b-f836-4d15-b170-dda8b00d7f5e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:09.135148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed66aa0b-f836-4d15-b170-dda8b00d7f5e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:09.135852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed66aa0b-f836-4d15-b170-dda8b00d7f5e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:09.136879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed66aa0b-f836-4d15-b170-dda8b00d7f5e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:09.137683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed66aa0b-f836-4d15-b170-dda8b00d7f5e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:09.465946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ed66aa0b-f836-4d15-b170-dda8b00d7f5e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:09.484909 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ed66aa0b-f836-4d15-b170-dda8b00d7f5e tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1393 microversion: 2.1 time: 0.365109 Jul 26 14:47:09.485501 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2745/5616] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:09 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1393 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:09.498733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c0748f81-bda5-4d0d-b131-2f439df031c4 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:09.499505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0748f81-bda5-4d0d-b131-2f439df031c4 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:09.523355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0748f81-bda5-4d0d-b131-2f439df031c4 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:09.529558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0748f81-bda5-4d0d-b131-2f439df031c4 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:09.530607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0748f81-bda5-4d0d-b131-2f439df031c4 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:09.531073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0748f81-bda5-4d0d-b131-2f439df031c4 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:09.855545 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c0748f81-bda5-4d0d-b131-2f439df031c4 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1654 microversion: 2.1 time: 0.353739 Jul 26 14:47:09.861041 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2872/5617] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:09 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1654 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:10.521210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0db8fe17-09ed-49a1-af8e-9ddcf80d448a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:10.521851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0db8fe17-09ed-49a1-af8e-9ddcf80d448a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:10.532166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db8fe17-09ed-49a1-af8e-9ddcf80d448a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:10.533313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db8fe17-09ed-49a1-af8e-9ddcf80d448a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:10.534422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db8fe17-09ed-49a1-af8e-9ddcf80d448a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:10.535090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db8fe17-09ed-49a1-af8e-9ddcf80d448a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:10.582650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=100 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:10.874022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0db8fe17-09ed-49a1-af8e-9ddcf80d448a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:10.884726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57acd2f8-d249-4cfb-93a4-aefd400acf24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:10.885891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-57acd2f8-d249-4cfb-93a4-aefd400acf24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:10.910935 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0db8fe17-09ed-49a1-af8e-9ddcf80d448a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1393 microversion: 2.1 time: 0.394389 Jul 26 14:47:10.911546 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2746/5618] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:10 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1393 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:10.928746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57acd2f8-d249-4cfb-93a4-aefd400acf24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:10.929461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57acd2f8-d249-4cfb-93a4-aefd400acf24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:10.930429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57acd2f8-d249-4cfb-93a4-aefd400acf24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:10.931078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57acd2f8-d249-4cfb-93a4-aefd400acf24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:10.971800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a38662e9-b352-432f-a843-c927df097d7a req-11925420-5bae-44de-a1c7-ad8a7d12a60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22624f44-4702-4bdf-82a1-3913313d7e32", "name": "network-vif-deleted", "tag": "ad4cfc8a-3716-4548-b2af-1937f67c1525"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:11.024635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a38662e9-b352-432f-a843-c927df097d7a req-11925420-5bae-44de-a1c7-ad8a7d12a60c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:11.025091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a38662e9-b352-432f-a843-c927df097d7a req-11925420-5bae-44de-a1c7-ad8a7d12a60c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:11.079010 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a38662e9-b352-432f-a843-c927df097d7a req-11925420-5bae-44de-a1c7-ad8a7d12a60c service nova] Creating event network-vif-deleted:ad4cfc8a-3716-4548-b2af-1937f67c1525 for instance 22624f44-4702-4bdf-82a1-3913313d7e32 on n-h2-833090-9 Jul 26 14:47:11.096902 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a38662e9-b352-432f-a843-c927df097d7a req-11925420-5bae-44de-a1c7-ad8a7d12a60c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126958 Jul 26 14:47:11.097937 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2747/5619] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:11.135630 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57acd2f8-d249-4cfb-93a4-aefd400acf24 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 200 len: 1612 microversion: 2.1 time: 0.254852 Jul 26 14:47:11.145435 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2873/5620] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:10 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 1612 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:47:11.692247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-9f788e47-6080-44bd-ac2c-ef9b53cef40c req-619befea-126e-4005-a46b-452b80c52968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c", "name": "network-vif-plugged", "status": "completed", "tag": "20747ce4-f67e-4252-9932-52b7be2a6ac0"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:11.711901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9f788e47-6080-44bd-ac2c-ef9b53cef40c req-619befea-126e-4005-a46b-452b80c52968 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:11.712455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9f788e47-6080-44bd-ac2c-ef9b53cef40c req-619befea-126e-4005-a46b-452b80c52968 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:11.775103 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-9f788e47-6080-44bd-ac2c-ef9b53cef40c req-619befea-126e-4005-a46b-452b80c52968 service nova] Creating event network-vif-plugged:20747ce4-f67e-4252-9932-52b7be2a6ac0 for instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c on n-h1-833090-9 Jul 26 14:47:11.789096 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-9f788e47-6080-44bd-ac2c-ef9b53cef40c req-619befea-126e-4005-a46b-452b80c52968 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104263 Jul 26 14:47:11.795919 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2748/5621] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:11.937492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae095d52-cd53-4d7c-9e1e-d58aff38f535 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:11.938421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ae095d52-cd53-4d7c-9e1e-d58aff38f535 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:11.947323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae095d52-cd53-4d7c-9e1e-d58aff38f535 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:11.954185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae095d52-cd53-4d7c-9e1e-d58aff38f535 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:11.957905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae095d52-cd53-4d7c-9e1e-d58aff38f535 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:11.959091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae095d52-cd53-4d7c-9e1e-d58aff38f535 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:12.162950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb2d8180-7cfb-43e3-bd9c-f8c4c9b054b0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:12.163680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eb2d8180-7cfb-43e3-bd9c-f8c4c9b054b0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 22624f44-4702-4bdf-82a1-3913313d7e32] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:12.205489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb2d8180-7cfb-43e3-bd9c-f8c4c9b054b0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:12.205967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb2d8180-7cfb-43e3-bd9c-f8c4c9b054b0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:12.209573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb2d8180-7cfb-43e3-bd9c-f8c4c9b054b0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:12.210033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb2d8180-7cfb-43e3-bd9c-f8c4c9b054b0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:12.293221 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-eb2d8180-7cfb-43e3-bd9c-f8c4c9b054b0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] HTTP exception thrown: Instance 22624f44-4702-4bdf-82a1-3913313d7e32 could not be found. Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb2d8180-7cfb-43e3-bd9c-f8c4c9b054b0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Request method failure captured: Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 HTTP/1.1 Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_5CMhw6BJm7QfAonT6sGwUaDql5qKwTGABiNSiA8VFuawjh9krPfv74250TM40-50SB57zNtgKo0pu5vz6ZiufSzHfb4AR5ZfYz8xpImtS1qWD1ezcL0TzadaZZNugFbfSugsxbAKaZPOZtRWpRsjRGAaJXiTElke_YlIgPtC8XWn4 Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 114762569ddd4b5682a35d56286e745b Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestServerMultinode-37467808 Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/114762569ddd4b5682a35d56286e745b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/114762569ddd4b5682a35d56286e745b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_114762569ddd4b5682a35d56286e745b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/114762569ddd4b5682a35d56286e745b"}]}] Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestServerMultinode-37467808 Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 114762569ddd4b5682a35d56286e745b Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestServerMultinode-37467808 Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestServerMultinode-37467808-project-admin Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: fcfd28920663498e9f9e04dbc76d7241 Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestServerMultinode-37467808-project-admin Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 22624f44-4702-4bdf-82a1-3913313d7e32 could not be found. Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '22624f44-4702-4bdf-82a1-3913313d7e32'} Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22624f44-4702-4bdf-82a1-3913313d7e32 could not be found. Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22624f44-4702-4bdf-82a1-3913313d7e32 could not be found. Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:12.294942 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:12.303720 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:12.303720 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:12.303720 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:12.303720 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:47:12.303720 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:47:12.303720 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22624f44-4702-4bdf-82a1-3913313d7e32 could not be found. Jul 26 14:47:12.303720 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:12.306128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb2d8180-7cfb-43e3-bd9c-f8c4c9b054b0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Returning 404 to user: Instance 22624f44-4702-4bdf-82a1-3913313d7e32 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:47:12.307099 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eb2d8180-7cfb-43e3-bd9c-f8c4c9b054b0 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32" status: 404 len: 111 microversion: 2.1 time: 0.149917 Jul 26 14:47:12.313555 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2749/5622] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:12 2022] GET /compute/v2.1/servers/22624f44-4702-4bdf-82a1-3913313d7e32 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:47:12.356187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44092150-ab60-4b68-89ef-76282fbb305b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:12.357035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44092150-ab60-4b68-89ef-76282fbb305b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:12.359487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:12.389464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44092150-ab60-4b68-89ef-76282fbb305b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:12.389902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44092150-ab60-4b68-89ef-76282fbb305b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:12.390709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44092150-ab60-4b68-89ef-76282fbb305b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:12.391158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44092150-ab60-4b68-89ef-76282fbb305b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:12.432847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ae095d52-cd53-4d7c-9e1e-d58aff38f535 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:12.452427 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ae095d52-cd53-4d7c-9e1e-d58aff38f535 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1393 microversion: 2.1 time: 0.516779 Jul 26 14:47:12.456510 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2874/5623] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:11 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1393 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:12.522655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44092150-ab60-4b68-89ef-76282fbb305b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:47:12.675129 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-44092150-ab60-4b68-89ef-76282fbb305b tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 204 len: 0 microversion: 2.1 time: 0.357812 Jul 26 14:47:12.677613 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2750/5624] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:47:12 2022] DELETE /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:47:12.685569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3fdfae4d-e12f-489c-b00b-a0c54f4d7628 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:12.686192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3fdfae4d-e12f-489c-b00b-a0c54f4d7628 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:12.700605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fdfae4d-e12f-489c-b00b-a0c54f4d7628 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:12.703219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fdfae4d-e12f-489c-b00b-a0c54f4d7628 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:12.704091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fdfae4d-e12f-489c-b00b-a0c54f4d7628 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:12.706717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3fdfae4d-e12f-489c-b00b-a0c54f4d7628 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:13.211722 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3fdfae4d-e12f-489c-b00b-a0c54f4d7628 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1655 microversion: 2.1 time: 0.528111 Jul 26 14:47:13.216513 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2875/5625] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:12 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1655 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:13.482445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ebd43345-a421-424d-8db5-a9663f7c8c22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:13.484288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ebd43345-a421-424d-8db5-a9663f7c8c22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:13.506683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd43345-a421-424d-8db5-a9663f7c8c22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:13.508834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd43345-a421-424d-8db5-a9663f7c8c22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:13.516618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd43345-a421-424d-8db5-a9663f7c8c22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:13.521148 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebd43345-a421-424d-8db5-a9663f7c8c22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:14.034410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ebd43345-a421-424d-8db5-a9663f7c8c22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:14.067431 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ebd43345-a421-424d-8db5-a9663f7c8c22 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1393 microversion: 2.1 time: 0.590609 Jul 26 14:47:14.072118 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2751/5626] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:13 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1393 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:14.238949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-86ee1eed-5053-4e6d-8b69-fd95a9d05337 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:14.239578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-86ee1eed-5053-4e6d-8b69-fd95a9d05337 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:14.242949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:14.252633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-86ee1eed-5053-4e6d-8b69-fd95a9d05337 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:14.253093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-86ee1eed-5053-4e6d-8b69-fd95a9d05337 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:14.253891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-86ee1eed-5053-4e6d-8b69-fd95a9d05337 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:14.254336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-86ee1eed-5053-4e6d-8b69-fd95a9d05337 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:14.945359 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-86ee1eed-5053-4e6d-8b69-fd95a9d05337 tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1655 microversion: 2.1 time: 0.710817 Jul 26 14:47:14.946456 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2876/5627] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:14 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1655 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:15.092076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1b8212d8-4d42-44b9-bdec-31b140a95e98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:15.093253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1b8212d8-4d42-44b9-bdec-31b140a95e98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:15.119193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b8212d8-4d42-44b9-bdec-31b140a95e98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:15.120840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b8212d8-4d42-44b9-bdec-31b140a95e98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:15.125138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b8212d8-4d42-44b9-bdec-31b140a95e98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:15.125595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b8212d8-4d42-44b9-bdec-31b140a95e98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:15.440845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1b8212d8-4d42-44b9-bdec-31b140a95e98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:15.458278 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1b8212d8-4d42-44b9-bdec-31b140a95e98 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1564 microversion: 2.1 time: 0.363188 Jul 26 14:47:15.458972 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2752/5628] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:15 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1564 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:15.504614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d046788-279b-4c5e-9287-d499e0bde8d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:15.508286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2d046788-279b-4c5e-9287-d499e0bde8d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:15.538661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d046788-279b-4c5e-9287-d499e0bde8d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:15.539201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d046788-279b-4c5e-9287-d499e0bde8d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:15.543361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d046788-279b-4c5e-9287-d499e0bde8d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:15.543871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d046788-279b-4c5e-9287-d499e0bde8d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:15.976973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fdd53239-da0a-4e23-971e-e1333eb553be tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:15.977768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fdd53239-da0a-4e23-971e-e1333eb553be tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:15.998067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdd53239-da0a-4e23-971e-e1333eb553be tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:15.998898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdd53239-da0a-4e23-971e-e1333eb553be tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:16.000344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdd53239-da0a-4e23-971e-e1333eb553be tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:16.001689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fdd53239-da0a-4e23-971e-e1333eb553be tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:16.447240 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fdd53239-da0a-4e23-971e-e1333eb553be tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 200 len: 1613 microversion: 2.1 time: 0.477067 Jul 26 14:47:16.467169 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2753/5629] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:15 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 1613 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:47:16.535289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-dbbc1278-a371-4a4b-b456-dd93c9dd9b5f req-a0e24e9b-7258-45fb-9224-8139a7516f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b10ed09-337c-4ff8-af4d-0aedde5827cb", "name": "network-vif-deleted", "tag": "8cfeeb1b-44bf-42d3-8476-18d8e95e21d8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:16.566611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-dbbc1278-a371-4a4b-b456-dd93c9dd9b5f req-a0e24e9b-7258-45fb-9224-8139a7516f44 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:16.570801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-dbbc1278-a371-4a4b-b456-dd93c9dd9b5f req-a0e24e9b-7258-45fb-9224-8139a7516f44 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:16.615991 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-dbbc1278-a371-4a4b-b456-dd93c9dd9b5f req-a0e24e9b-7258-45fb-9224-8139a7516f44 service nova] Creating event network-vif-deleted:8cfeeb1b-44bf-42d3-8476-18d8e95e21d8 for instance 3b10ed09-337c-4ff8-af4d-0aedde5827cb on n-h1-833090-9 Jul 26 14:47:16.629590 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-dbbc1278-a371-4a4b-b456-dd93c9dd9b5f req-a0e24e9b-7258-45fb-9224-8139a7516f44 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100275 Jul 26 14:47:16.633923 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2754/5630] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:47:16.736567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2d046788-279b-4c5e-9287-d499e0bde8d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:16.753266 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d046788-279b-4c5e-9287-d499e0bde8d3 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1564 microversion: 2.1 time: 1.274907 Jul 26 14:47:16.757191 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2877/5631] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:15 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1564 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:17.518444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-964685a6-6f14-4c41-80dc-5060544e890d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:17.520355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-964685a6-6f14-4c41-80dc-5060544e890d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] [instance: 3b10ed09-337c-4ff8-af4d-0aedde5827cb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:17.529913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-964685a6-6f14-4c41-80dc-5060544e890d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:17.530979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-964685a6-6f14-4c41-80dc-5060544e890d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:17.531975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-964685a6-6f14-4c41-80dc-5060544e890d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:17.532766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-964685a6-6f14-4c41-80dc-5060544e890d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:17.552756 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-964685a6-6f14-4c41-80dc-5060544e890d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] HTTP exception thrown: Instance 3b10ed09-337c-4ff8-af4d-0aedde5827cb could not be found. Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-964685a6-6f14-4c41-80dc-5060544e890d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Request method failure captured: Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb HTTP/1.1 Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_5CMhw6BJm7QfAonT6sGwUaDql5qKwTGABiNSiA8VFuawjh9krPfv74250TM40-50SB57zNtgKo0pu5vz6ZiufSzHfb4AR5ZfYz8xpImtS1qWD1ezcL0TzadaZZNugFbfSugsxbAKaZPOZtRWpRsjRGAaJXiTElke_YlIgPtC8XWn4 Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 114762569ddd4b5682a35d56286e745b Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestServerMultinode-37467808 Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/114762569ddd4b5682a35d56286e745b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/114762569ddd4b5682a35d56286e745b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_114762569ddd4b5682a35d56286e745b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/114762569ddd4b5682a35d56286e745b"}]}] Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestServerMultinode-37467808 Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 114762569ddd4b5682a35d56286e745b Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestServerMultinode-37467808 Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestServerMultinode-37467808-project-admin Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: fcfd28920663498e9f9e04dbc76d7241 Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestServerMultinode-37467808-project-admin Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 3b10ed09-337c-4ff8-af4d-0aedde5827cb could not be found. Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '3b10ed09-337c-4ff8-af4d-0aedde5827cb'} Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b10ed09-337c-4ff8-af4d-0aedde5827cb could not be found. Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b10ed09-337c-4ff8-af4d-0aedde5827cb could not be found. Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:17.554997 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:17.559796 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:17.559796 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:17.559796 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:17.559796 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:47:17.559796 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:47:17.559796 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b10ed09-337c-4ff8-af4d-0aedde5827cb could not be found. Jul 26 14:47:17.559796 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:17.562196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-964685a6-6f14-4c41-80dc-5060544e890d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] Returning 404 to user: Instance 3b10ed09-337c-4ff8-af4d-0aedde5827cb could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:47:17.563447 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-964685a6-6f14-4c41-80dc-5060544e890d tempest-TestServerMultinode-37467808 tempest-TestServerMultinode-37467808-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb" status: 404 len: 111 microversion: 2.1 time: 0.081770 Jul 26 14:47:17.584084 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2755/5632] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:17 2022] GET /compute/v2.1/servers/3b10ed09-337c-4ff8-af4d-0aedde5827cb => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:47:18.139512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7e589e20-a9bf-4c5b-9c3a-4810080b4393 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:18.140131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e589e20-a9bf-4c5b-9c3a-4810080b4393 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:18.148731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e589e20-a9bf-4c5b-9c3a-4810080b4393 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:18.149611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e589e20-a9bf-4c5b-9c3a-4810080b4393 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:18.150697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e589e20-a9bf-4c5b-9c3a-4810080b4393 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:18.151386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e589e20-a9bf-4c5b-9c3a-4810080b4393 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:18.193345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e589e20-a9bf-4c5b-9c3a-4810080b4393 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:47:18.334328 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7e589e20-a9bf-4c5b-9c3a-4810080b4393 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 204 len: 0 microversion: 2.1 time: 0.201224 Jul 26 14:47:18.340117 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2878/5633] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:47:18 2022] DELETE /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:47:18.346759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d299645e-2893-4b1f-a7d8-030363b54a5e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:18.347442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d299645e-2893-4b1f-a7d8-030363b54a5e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:18.357279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d299645e-2893-4b1f-a7d8-030363b54a5e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:18.359062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d299645e-2893-4b1f-a7d8-030363b54a5e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:18.360020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d299645e-2893-4b1f-a7d8-030363b54a5e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:18.363432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d299645e-2893-4b1f-a7d8-030363b54a5e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:18.761600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d299645e-2893-4b1f-a7d8-030363b54a5e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:18.782924 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d299645e-2893-4b1f-a7d8-030363b54a5e tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1507 microversion: 2.1 time: 0.437186 Jul 26 14:47:18.796637 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2756/5634] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:18 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1507 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:19.808702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-67c5d4da-c665-4411-9f67-840c90234060 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:19.810108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-67c5d4da-c665-4411-9f67-840c90234060 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:19.859070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67c5d4da-c665-4411-9f67-840c90234060 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:19.862032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67c5d4da-c665-4411-9f67-840c90234060 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:19.887190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67c5d4da-c665-4411-9f67-840c90234060 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:19.890399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67c5d4da-c665-4411-9f67-840c90234060 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:19.905807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:20.335131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-67c5d4da-c665-4411-9f67-840c90234060 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:20.354153 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-67c5d4da-c665-4411-9f67-840c90234060 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1507 microversion: 2.1 time: 0.543948 Jul 26 14:47:20.384569 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2879/5635] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:19 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1507 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:20.821319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e9cd2ab-1fbe-48ed-ba86-886f4f413edc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:20.823641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e9cd2ab-1fbe-48ed-ba86-886f4f413edc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:20.828323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e2aedfa6-b079-4d8a-8bbe-11d68e033d44 req-27befff5-a814-485d-a789-2affbc935b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c", "tag": "20747ce4-f67e-4252-9932-52b7be2a6ac0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:20.841535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e9cd2ab-1fbe-48ed-ba86-886f4f413edc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:20.853209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e2aedfa6-b079-4d8a-8bbe-11d68e033d44 req-27befff5-a814-485d-a789-2affbc935b67 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:20.853666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e2aedfa6-b079-4d8a-8bbe-11d68e033d44 req-27befff5-a814-485d-a789-2affbc935b67 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:20.872615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e9cd2ab-1fbe-48ed-ba86-886f4f413edc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:20.874904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e9cd2ab-1fbe-48ed-ba86-886f4f413edc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:20.880789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e9cd2ab-1fbe-48ed-ba86-886f4f413edc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:20.883511 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e2aedfa6-b079-4d8a-8bbe-11d68e033d44 req-27befff5-a814-485d-a789-2affbc935b67 service nova] Creating event network-changed:20747ce4-f67e-4252-9932-52b7be2a6ac0 for instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c on n-h1-833090-9 Jul 26 14:47:20.896895 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e2aedfa6-b079-4d8a-8bbe-11d68e033d44 req-27befff5-a814-485d-a789-2affbc935b67 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073118 Jul 26 14:47:20.902244 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2880/5636] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:21.261297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2e9cd2ab-1fbe-48ed-ba86-886f4f413edc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:21.273513 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e9cd2ab-1fbe-48ed-ba86-886f4f413edc tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1564 microversion: 2.1 time: 0.456836 Jul 26 14:47:21.274105 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2757/5637] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:20 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1564 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:21.393707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-15ecae82-8d4a-4097-a30d-352240026127 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:21.395879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-15ecae82-8d4a-4097-a30d-352240026127 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:21.415530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15ecae82-8d4a-4097-a30d-352240026127 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:21.416017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15ecae82-8d4a-4097-a30d-352240026127 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:21.417016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15ecae82-8d4a-4097-a30d-352240026127 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:21.417586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15ecae82-8d4a-4097-a30d-352240026127 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:22.062986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-15ecae82-8d4a-4097-a30d-352240026127 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:22.101516 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-15ecae82-8d4a-4097-a30d-352240026127 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 200 len: 1507 microversion: 2.1 time: 0.713331 Jul 26 14:47:22.119686 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2881/5638] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:21 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 1507 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:22.962603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f419fdf2-5659-4f66-92b1-02af413f5bcd req-b421b51c-dd47-4621-91bb-76bcfac3d5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c77f907e-8855-4f3f-bbf3-690ea1872bc1", "name": "network-vif-deleted", "tag": "a9e62da7-b32a-4e16-bb2e-ca3c69efee0d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:22.989096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f419fdf2-5659-4f66-92b1-02af413f5bcd req-b421b51c-dd47-4621-91bb-76bcfac3d5ed service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:22.989875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f419fdf2-5659-4f66-92b1-02af413f5bcd req-b421b51c-dd47-4621-91bb-76bcfac3d5ed service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:23.067930 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f419fdf2-5659-4f66-92b1-02af413f5bcd req-b421b51c-dd47-4621-91bb-76bcfac3d5ed service nova] Creating event network-vif-deleted:a9e62da7-b32a-4e16-bb2e-ca3c69efee0d for instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 on n-h1-833090-9 Jul 26 14:47:23.081839 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f419fdf2-5659-4f66-92b1-02af413f5bcd req-b421b51c-dd47-4621-91bb-76bcfac3d5ed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122848 Jul 26 14:47:23.083150 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2758/5639] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:23.130162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-830bdef7-837d-449b-a87b-ceb0ee3494c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:23.131607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-830bdef7-837d-449b-a87b-ceb0ee3494c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: c77f907e-8855-4f3f-bbf3-690ea1872bc1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:23.144805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-830bdef7-837d-449b-a87b-ceb0ee3494c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:23.145614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-830bdef7-837d-449b-a87b-ceb0ee3494c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:23.146635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-830bdef7-837d-449b-a87b-ceb0ee3494c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:23.147564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-830bdef7-837d-449b-a87b-ceb0ee3494c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:23.204399 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-830bdef7-837d-449b-a87b-ceb0ee3494c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] HTTP exception thrown: Instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 could not be found. Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-830bdef7-837d-449b-a87b-ceb0ee3494c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Request method failure captured: Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 HTTP/1.1 Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_1f6ZzJX0S01b_Op3EoMNcBZEG-kX6NKBmC9y8eYSEGGvW2IzzGDCwRHyopc8xJm4faZa9Jll31j2AyA8-1nj2TIW6-NxgVw70z941LrxxyqTc1krrtQixKuVoRbZbeVXl3oq2yJDnuG60YY3irOdy923OsfCXhYNJbHMgyTRh4Lb0 Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7386a23b259b4c4091637972951a3f0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}] Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ca1aaf9a4ab74a829ef94a7d54c683cd Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 could not be found. Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c77f907e-8855-4f3f-bbf3-690ea1872bc1'} Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 could not be found. Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 could not be found. Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:23.207254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:47:23.211773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:23.211773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:23.211773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:23.211773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:47:23.211773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:47:23.211773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 could not be found. Jul 26 14:47:23.211773 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:47:23.214368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-830bdef7-837d-449b-a87b-ceb0ee3494c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Returning 404 to user: Instance c77f907e-8855-4f3f-bbf3-690ea1872bc1 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:47:23.215512 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-830bdef7-837d-449b-a87b-ceb0ee3494c4 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1" status: 404 len: 111 microversion: 2.1 time: 0.091948 Jul 26 14:47:23.219866 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2882/5640] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:23 2022] GET /compute/v2.1/servers/c77f907e-8855-4f3f-bbf3-690ea1872bc1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:47:23.230345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-591873f2-7c05-46d3-9c76-999d3cc1e7ef tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:23.234471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-591873f2-7c05-46d3-9c76-999d3cc1e7ef tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:23.254108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-591873f2-7c05-46d3-9c76-999d3cc1e7ef tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:23.254676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-591873f2-7c05-46d3-9c76-999d3cc1e7ef tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:23.257723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-591873f2-7c05-46d3-9c76-999d3cc1e7ef tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:23.258297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-591873f2-7c05-46d3-9c76-999d3cc1e7ef tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:23.304290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-591873f2-7c05-46d3-9c76-999d3cc1e7ef tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:47:23.512929 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-591873f2-7c05-46d3-9c76-999d3cc1e7ef tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 204 len: 0 microversion: 2.1 time: 0.290146 Jul 26 14:47:23.513576 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2759/5641] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:47:23 2022] DELETE /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:47:23.524202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-801bb4f1-c64d-40b6-9c96-ce56085a3aff tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:23.524850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-801bb4f1-c64d-40b6-9c96-ce56085a3aff tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:23.534685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-801bb4f1-c64d-40b6-9c96-ce56085a3aff tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:23.535375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-801bb4f1-c64d-40b6-9c96-ce56085a3aff tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:23.536773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-801bb4f1-c64d-40b6-9c96-ce56085a3aff tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:23.537645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-801bb4f1-c64d-40b6-9c96-ce56085a3aff tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:23.825604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-801bb4f1-c64d-40b6-9c96-ce56085a3aff tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:23.838662 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-801bb4f1-c64d-40b6-9c96-ce56085a3aff tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.320517 Jul 26 14:47:23.855487 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2883/5642] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:23 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:24.883041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-570b9c01-437e-4ae4-bf12-322dfd46b7e3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:24.885876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-570b9c01-437e-4ae4-bf12-322dfd46b7e3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:24.897930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-570b9c01-437e-4ae4-bf12-322dfd46b7e3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:24.898792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-570b9c01-437e-4ae4-bf12-322dfd46b7e3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:24.899814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-570b9c01-437e-4ae4-bf12-322dfd46b7e3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:24.900933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-570b9c01-437e-4ae4-bf12-322dfd46b7e3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:25.124121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-570b9c01-437e-4ae4-bf12-322dfd46b7e3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:25.134342 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-570b9c01-437e-4ae4-bf12-322dfd46b7e3 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.269166 Jul 26 14:47:25.136025 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2760/5643] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:24 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:25.654436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3502a203-c8cf-4601-8503-dc17f9f62f99 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1277089127", "availability_zone": "foo_zone"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:25.658572 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:25.658572 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:47:25.659217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.aggregate [None req-3502a203-c8cf-4601-8503-dc17f9f62f99 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Generated uuid 5838a9f3-aecc-4b67-9550-9a9c921339d0 for aggregate {{(pid=119479) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 26 14:47:25.746508 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3502a203-c8cf-4601-8503-dc17f9f62f99 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.391308 Jul 26 14:47:25.749180 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2884/5644] 10.222.0.70 () {60 vars in 1164 bytes} [Tue Jul 26 14:47:25 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:25.766073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b6bf53e-5076-4fe7-a799-bb4cca421b0b tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:25.774201 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:25.774201 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:47:25.829889 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b6bf53e-5076-4fe7-a799-bb4cca421b0b tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.068773 Jul 26 14:47:25.833258 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2761/5645] 10.222.0.70 () {60 vars in 1194 bytes} [Tue Jul 26 14:47:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:25.844728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1a56f1ce-6b1b-4af7-8422-c56d9b88222f tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:25.848048 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:25.848048 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:47:25.851270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a56f1ce-6b1b-4af7-8422-c56d9b88222f tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:25.851847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a56f1ce-6b1b-4af7-8422-c56d9b88222f tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:25.856057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a56f1ce-6b1b-4af7-8422-c56d9b88222f tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:25.857192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1a56f1ce-6b1b-4af7-8422-c56d9b88222f tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:25.914606 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1a56f1ce-6b1b-4af7-8422-c56d9b88222f tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.074098 Jul 26 14:47:25.916085 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2885/5646] 10.222.0.70 () {58 vars in 1176 bytes} [Tue Jul 26 14:47:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:47:25.937425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e1cfd915-6518-4c0b-aca6-ea703153d583 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:25.938388 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:25.938388 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:47:25.956845 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e1cfd915-6518-4c0b-aca6-ea703153d583 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.031517 Jul 26 14:47:25.957961 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2762/5647] 10.222.0.70 () {58 vars in 1143 bytes} [Tue Jul 26 14:47:25 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:25.977474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7c964855-f73d-452c-a395-456f359bf568 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-9"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:25.978867 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:25.978867 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:47:25.997957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c964855-f73d-452c-a395-456f359bf568 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:25.998386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c964855-f73d-452c-a395-456f359bf568 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:26.160915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-76a20d14-750c-4e75-90d9-c7d3fc3bbf29 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:26.161943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76a20d14-750c-4e75-90d9-c7d3fc3bbf29 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:26.212131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76a20d14-750c-4e75-90d9-c7d3fc3bbf29 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:26.215669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76a20d14-750c-4e75-90d9-c7d3fc3bbf29 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:26.216913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76a20d14-750c-4e75-90d9-c7d3fc3bbf29 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:26.222080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76a20d14-750c-4e75-90d9-c7d3fc3bbf29 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:26.632857 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7c964855-f73d-452c-a395-456f359bf568 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.667244 Jul 26 14:47:26.634082 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2886/5648] 10.222.0.70 () {60 vars in 1194 bytes} [Tue Jul 26 14:47:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:26.648490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fc144aca-f47e-4921-9ecd-759cf98a1011 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:26.654984 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:26.654984 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:47:26.671467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-76a20d14-750c-4e75-90d9-c7d3fc3bbf29 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:26.697067 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-76a20d14-750c-4e75-90d9-c7d3fc3bbf29 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.542710 Jul 26 14:47:26.700021 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2763/5649] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:26 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:26.716183 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fc144aca-f47e-4921-9ecd-759cf98a1011 tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.070854 Jul 26 14:47:26.717257 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2887/5650] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:47:26 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:26.729945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-83370f14-b2b4-459e-8e3e-08f750896fba tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-465027884", "availability_zone": "foo_zone"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:26.859285 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:26.859285 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:47:26.934175 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-83370f14-b2b4-459e-8e3e-08f750896fba tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.208482 Jul 26 14:47:26.935296 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2764/5651] 10.222.0.70 () {60 vars in 1173 bytes} [Tue Jul 26 14:47:26 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:26.946978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9ec69f44-df89-4418-8563-1a1d2c486c3e tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:26.950215 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:26.950215 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:47:26.997342 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9ec69f44-df89-4418-8563-1a1d2c486c3e tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.054579 Jul 26 14:47:26.998403 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2888/5652] 10.222.0.70 () {60 vars in 1194 bytes} [Tue Jul 26 14:47:26 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:27.014406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4bec3f89-3c2a-48bb-948b-fb5a0957c2cb tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:27.015266 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:27.015266 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:47:27.042355 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4bec3f89-3c2a-48bb-948b-fb5a0957c2cb tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.036203 Jul 26 14:47:27.045004 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2765/5653] 10.222.0.70 () {58 vars in 1152 bytes} [Tue Jul 26 14:47:27 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:27.057805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-387e6639-e534-41b9-b3d8-88af5fcdb32a tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-9"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:27.061977 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:27.061977 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:47:27.074255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-387e6639-e534-41b9-b3d8-88af5fcdb32a tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:27.075046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-387e6639-e534-41b9-b3d8-88af5fcdb32a tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:27.377297 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-387e6639-e534-41b9-b3d8-88af5fcdb32a tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.323308 Jul 26 14:47:27.379172 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2889/5654] 10.222.0.70 () {60 vars in 1194 bytes} [Tue Jul 26 14:47:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:27.406747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f16cefe0-7e26-40cf-b0c9-e6977d8c2bcb tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:27.408334 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:47:27.408334 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 14:47:27.481317 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f16cefe0-7e26-40cf-b0c9-e6977d8c2bcb tempest-TestAggregatesBasicOps-450993497 tempest-TestAggregatesBasicOps-450993497-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.073062 Jul 26 14:47:27.483384 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2766/5655] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Jul 26 14:47:27 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 26 14:47:27.723576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e70a8e83-8687-4e3f-9286-8034b56fd60f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:27.724514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e70a8e83-8687-4e3f-9286-8034b56fd60f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:27.737622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e70a8e83-8687-4e3f-9286-8034b56fd60f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:27.737995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e70a8e83-8687-4e3f-9286-8034b56fd60f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:27.739136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e70a8e83-8687-4e3f-9286-8034b56fd60f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:27.739581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e70a8e83-8687-4e3f-9286-8034b56fd60f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:28.533056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e70a8e83-8687-4e3f-9286-8034b56fd60f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:28.543928 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e70a8e83-8687-4e3f-9286-8034b56fd60f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1520 microversion: 2.1 time: 0.824832 Jul 26 14:47:28.544676 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2890/5656] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:27 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1520 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:29.121584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-061c9858-aef4-4d5e-ba52-7844a00c5b54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:29.125078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-061c9858-aef4-4d5e-ba52-7844a00c5b54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:29.139431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-061c9858-aef4-4d5e-ba52-7844a00c5b54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:29.139898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-061c9858-aef4-4d5e-ba52-7844a00c5b54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:29.146926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-061c9858-aef4-4d5e-ba52-7844a00c5b54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:29.147640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-061c9858-aef4-4d5e-ba52-7844a00c5b54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:29.241774 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-061c9858-aef4-4d5e-ba52-7844a00c5b54 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "POST /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b/action" status: 200 len: 24562 microversion: 2.1 time: 0.125106 Jul 26 14:47:29.242604 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2767/5657] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:47:29 2022] POST /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b/action => generated 24562 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:47:29.567997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-075ef2a7-3d59-4725-bf8d-e98032b6214f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:29.569198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-075ef2a7-3d59-4725-bf8d-e98032b6214f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:29.584240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-075ef2a7-3d59-4725-bf8d-e98032b6214f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:29.590270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-075ef2a7-3d59-4725-bf8d-e98032b6214f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:29.598977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-075ef2a7-3d59-4725-bf8d-e98032b6214f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:29.599452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-075ef2a7-3d59-4725-bf8d-e98032b6214f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:29.820138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-075ef2a7-3d59-4725-bf8d-e98032b6214f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca1aaf9a4ab74a829ef94a7d54c683cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7386a23b259b4c4091637972951a3f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:29.830239 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-075ef2a7-3d59-4725-bf8d-e98032b6214f tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 200 len: 1478 microversion: 2.1 time: 0.266701 Jul 26 14:47:29.831562 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2891/5658] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:29 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 1478 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:29.858631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a2a1131b-12cb-4b40-9081-1fff7a7ca236 req-2aeaaf2f-b007-46f1-be2f-39957fcd9b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aae76411-a3af-4e21-a827-39d6ae08c182", "name": "network-vif-deleted", "tag": "70cd542c-ed29-4360-9fb8-5bda314558f0"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:29.889537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a2a1131b-12cb-4b40-9081-1fff7a7ca236 req-2aeaaf2f-b007-46f1-be2f-39957fcd9b8b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:29.891099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a2a1131b-12cb-4b40-9081-1fff7a7ca236 req-2aeaaf2f-b007-46f1-be2f-39957fcd9b8b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:29.919736 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a2a1131b-12cb-4b40-9081-1fff7a7ca236 req-2aeaaf2f-b007-46f1-be2f-39957fcd9b8b service nova] Creating event network-vif-deleted:70cd542c-ed29-4360-9fb8-5bda314558f0 for instance aae76411-a3af-4e21-a827-39d6ae08c182 on n-h2-833090-9 Jul 26 14:47:29.925265 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a2a1131b-12cb-4b40-9081-1fff7a7ca236 req-2aeaaf2f-b007-46f1-be2f-39957fcd9b8b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070970 Jul 26 14:47:29.925915 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2768/5659] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:30.854916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9672a1f4-000d-4c6c-85aa-2e9467d6acc2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:30.855554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9672a1f4-000d-4c6c-85aa-2e9467d6acc2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] [instance: aae76411-a3af-4e21-a827-39d6ae08c182] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:30.868580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9672a1f4-000d-4c6c-85aa-2e9467d6acc2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:30.869512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9672a1f4-000d-4c6c-85aa-2e9467d6acc2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:30.870725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9672a1f4-000d-4c6c-85aa-2e9467d6acc2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:30.871409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9672a1f4-000d-4c6c-85aa-2e9467d6acc2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:30.890684 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-9672a1f4-000d-4c6c-85aa-2e9467d6acc2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] HTTP exception thrown: Instance aae76411-a3af-4e21-a827-39d6ae08c182 could not be found. Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9672a1f4-000d-4c6c-85aa-2e9467d6acc2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Request method failure captured: Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 HTTP/1.1 Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_1f6ZzJX0S01b_Op3EoMNcBZEG-kX6NKBmC9y8eYSEGGvW2IzzGDCwRHyopc8xJm4faZa9Jll31j2AyA8-1nj2TIW6-NxgVw70z941LrxxyqTc1krrtQixKuVoRbZbeVXl3oq2yJDnuG60YY3irOdy923OsfCXhYNJbHMgyTRh4Lb0 Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7386a23b259b4c4091637972951a3f0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7386a23b259b4c4091637972951a3f0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7386a23b259b4c4091637972951a3f0e"}]}] Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 7386a23b259b4c4091637972951a3f0e Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-469318876 Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ca1aaf9a4ab74a829ef94a7d54c683cd Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerRescueNegativeTestJSON-469318876-project Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance aae76411-a3af-4e21-a827-39d6ae08c182 could not be found. Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'aae76411-a3af-4e21-a827-39d6ae08c182'} Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aae76411-a3af-4e21-a827-39d6ae08c182 could not be found. Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aae76411-a3af-4e21-a827-39d6ae08c182 could not be found. Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:30.892599 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:47:30.897820 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:30.897820 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:30.897820 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:30.897820 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:47:30.897820 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:47:30.897820 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aae76411-a3af-4e21-a827-39d6ae08c182 could not be found. Jul 26 14:47:30.897820 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:47:30.897820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9672a1f4-000d-4c6c-85aa-2e9467d6acc2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] Returning 404 to user: Instance aae76411-a3af-4e21-a827-39d6ae08c182 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:47:30.899301 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9672a1f4-000d-4c6c-85aa-2e9467d6acc2 tempest-ServerRescueNegativeTestJSON-469318876 tempest-ServerRescueNegativeTestJSON-469318876-project] 10.222.0.70 "GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182" status: 404 len: 111 microversion: 2.1 time: 0.048217 Jul 26 14:47:30.900542 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2892/5660] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:30 2022] GET /compute/v2.1/servers/aae76411-a3af-4e21-a827-39d6ae08c182 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:47:38.285987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a2a1131b-12cb-4b40-9081-1fff7a7ca236 req-2aeaaf2f-b007-46f1-be2f-39957fcd9b8b service nova] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:38.288771 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a2a1131b-12cb-4b40-9081-1fff7a7ca236 req-2aeaaf2f-b007-46f1-be2f-39957fcd9b8b service nova] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005766 Jul 26 14:47:38.289838 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2769/5661] 10.222.0.70 () {56 vars in 886 bytes} [Tue Jul 26 14:47:38 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 26 14:47:40.066748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:40.075426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8aeed06e-bc29-479e-93ab-8f7a6aeec553 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:40.083600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8aeed06e-bc29-479e-93ab-8f7a6aeec553 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:40.103458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8aeed06e-bc29-479e-93ab-8f7a6aeec553 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:40.104941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8aeed06e-bc29-479e-93ab-8f7a6aeec553 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:40.106136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8aeed06e-bc29-479e-93ab-8f7a6aeec553 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:40.107066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8aeed06e-bc29-479e-93ab-8f7a6aeec553 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:40.213109 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8aeed06e-bc29-479e-93ab-8f7a6aeec553 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c/action" status: 200 len: 24568 microversion: 2.1 time: 0.147726 Jul 26 14:47:40.214373 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2893/5662] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:47:40 2022] POST /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c/action => generated 24568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:47:40.411505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:40.416877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:40.425168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f8020a15-680e-4c16-ba39-9cae8eb4d6d0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:40.433796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f8020a15-680e-4c16-ba39-9cae8eb4d6d0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:40.449884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8020a15-680e-4c16-ba39-9cae8eb4d6d0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:40.456191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8020a15-680e-4c16-ba39-9cae8eb4d6d0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:40.457485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8020a15-680e-4c16-ba39-9cae8eb4d6d0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:40.458268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8020a15-680e-4c16-ba39-9cae8eb4d6d0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:40.569690 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f8020a15-680e-4c16-ba39-9cae8eb4d6d0 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "POST /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b/action" status: 200 len: 32624 microversion: 2.1 time: 0.159618 Jul 26 14:47:40.571454 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2770/5663] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:47:40 2022] POST /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b/action => generated 32624 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:47:43.037902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3aa9e6fa-b08f-4594-beb7-500eea78f875 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:43.038586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3aa9e6fa-b08f-4594-beb7-500eea78f875 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:43.050170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3aa9e6fa-b08f-4594-beb7-500eea78f875 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:43.050663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3aa9e6fa-b08f-4594-beb7-500eea78f875 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:43.051448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3aa9e6fa-b08f-4594-beb7-500eea78f875 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:43.051902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3aa9e6fa-b08f-4594-beb7-500eea78f875 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:43.072213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-06ac7ba4-d132-4900-9d57-f9adfc593e03 req-f49e8420-799b-429b-89d8-f2b7a11a39f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4145de3a-1f5d-4d15-9d88-79393524853b", "tag": "9d13ac50-a939-4278-8a79-1097da0d61a8"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:43.100631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-06ac7ba4-d132-4900-9d57-f9adfc593e03 req-f49e8420-799b-429b-89d8-f2b7a11a39f4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:43.101114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-06ac7ba4-d132-4900-9d57-f9adfc593e03 req-f49e8420-799b-429b-89d8-f2b7a11a39f4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:43.160547 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-06ac7ba4-d132-4900-9d57-f9adfc593e03 req-f49e8420-799b-429b-89d8-f2b7a11a39f4 service nova] Creating event network-changed:9d13ac50-a939-4278-8a79-1097da0d61a8 for instance 4145de3a-1f5d-4d15-9d88-79393524853b on n-h2-833090-9 Jul 26 14:47:43.170461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3aa9e6fa-b08f-4594-beb7-500eea78f875 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:47:43.171524 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-06ac7ba4-d132-4900-9d57-f9adfc593e03 req-f49e8420-799b-429b-89d8-f2b7a11a39f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105930 Jul 26 14:47:43.202174 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2771/5664] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:47:43.363985 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3aa9e6fa-b08f-4594-beb7-500eea78f875 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 204 len: 0 microversion: 2.1 time: 0.331315 Jul 26 14:47:43.365195 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2894/5665] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:47:43 2022] DELETE /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:47:43.375076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4f54fad4-c890-4b27-85e5-8135330e83b2 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:43.376861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4f54fad4-c890-4b27-85e5-8135330e83b2 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:43.399987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f54fad4-c890-4b27-85e5-8135330e83b2 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:43.400454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f54fad4-c890-4b27-85e5-8135330e83b2 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:43.409039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f54fad4-c890-4b27-85e5-8135330e83b2 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:43.410397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f54fad4-c890-4b27-85e5-8135330e83b2 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:43.740539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4f54fad4-c890-4b27-85e5-8135330e83b2 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:43.750808 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4f54fad4-c890-4b27-85e5-8135330e83b2 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1669 microversion: 2.1 time: 0.380930 Jul 26 14:47:43.753150 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2772/5666] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:43 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1669 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:44.775657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70366195-6cd2-4d37-9dbb-bc3ea4a79b67 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:44.777002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70366195-6cd2-4d37-9dbb-bc3ea4a79b67 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:44.780356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:44.823849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70366195-6cd2-4d37-9dbb-bc3ea4a79b67 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:44.828922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70366195-6cd2-4d37-9dbb-bc3ea4a79b67 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:44.830272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70366195-6cd2-4d37-9dbb-bc3ea4a79b67 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:44.830935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70366195-6cd2-4d37-9dbb-bc3ea4a79b67 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:45.580034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70366195-6cd2-4d37-9dbb-bc3ea4a79b67 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:45.599367 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70366195-6cd2-4d37-9dbb-bc3ea4a79b67 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1669 microversion: 2.1 time: 0.827394 Jul 26 14:47:45.601652 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2895/5667] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:44 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1669 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:47:46.626493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8092d482-3861-4108-9627-918c1f319d6b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:46.628016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8092d482-3861-4108-9627-918c1f319d6b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:46.643413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8092d482-3861-4108-9627-918c1f319d6b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:46.643883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8092d482-3861-4108-9627-918c1f319d6b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:46.645424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8092d482-3861-4108-9627-918c1f319d6b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:46.647032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8092d482-3861-4108-9627-918c1f319d6b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:47.037450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8092d482-3861-4108-9627-918c1f319d6b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e1adb391e2f425892a83762aaa6eb43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54967e3bd292459a81121b90b03fde3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:47.046622 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8092d482-3861-4108-9627-918c1f319d6b tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 200 len: 1669 microversion: 2.1 time: 0.426828 Jul 26 14:47:47.047199 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2773/5668] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:46 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 1669 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:47.218299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2ad41042-d029-476c-a81b-56a2af1b5fcd req-67f547fc-7b0d-40eb-b51f-90088349e317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4145de3a-1f5d-4d15-9d88-79393524853b", "name": "network-vif-deleted", "tag": "9d13ac50-a939-4278-8a79-1097da0d61a8"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:47.233787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2ad41042-d029-476c-a81b-56a2af1b5fcd req-67f547fc-7b0d-40eb-b51f-90088349e317 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:47.234246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2ad41042-d029-476c-a81b-56a2af1b5fcd req-67f547fc-7b0d-40eb-b51f-90088349e317 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:47.249437 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2ad41042-d029-476c-a81b-56a2af1b5fcd req-67f547fc-7b0d-40eb-b51f-90088349e317 service nova] Creating event network-vif-deleted:9d13ac50-a939-4278-8a79-1097da0d61a8 for instance 4145de3a-1f5d-4d15-9d88-79393524853b on n-h2-833090-9 Jul 26 14:47:47.255676 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2ad41042-d029-476c-a81b-56a2af1b5fcd req-67f547fc-7b0d-40eb-b51f-90088349e317 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041151 Jul 26 14:47:47.257277 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2896/5669] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:48.069258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c6960d4-0970-48b0-9089-7eeeeff6daea tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:48.070704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0c6960d4-0970-48b0-9089-7eeeeff6daea tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] [instance: 4145de3a-1f5d-4d15-9d88-79393524853b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:48.079034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c6960d4-0970-48b0-9089-7eeeeff6daea tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:48.079718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c6960d4-0970-48b0-9089-7eeeeff6daea tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:48.080704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c6960d4-0970-48b0-9089-7eeeeff6daea tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:48.084180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c6960d4-0970-48b0-9089-7eeeeff6daea tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:48.100439 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-0c6960d4-0970-48b0-9089-7eeeeff6daea tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] HTTP exception thrown: Instance 4145de3a-1f5d-4d15-9d88-79393524853b could not be found. Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c6960d4-0970-48b0-9089-7eeeeff6daea tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Request method failure captured: Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b HTTP/1.1 Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_2I2HtxkIUudDNkoI2Wp2KO1NGiK8pwDFUZm6R4O3GshAnU9tliPKB_OWOwSDCuuypMoONAlZtfr36nG85E3my7AtpI-8XnylZIHt_xKtM1L0lJR0HLIww-vyd-kFAjoMxe2o588f2z5WZ5-9aNiqIqlaTBpAqUYv5zHPYMcKvythU Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 54967e3bd292459a81121b90b03fde3b Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestNetworkBasicOps-1511396651 Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/54967e3bd292459a81121b90b03fde3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/54967e3bd292459a81121b90b03fde3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_54967e3bd292459a81121b90b03fde3b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/54967e3bd292459a81121b90b03fde3b"}]}] Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestNetworkBasicOps-1511396651 Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 54967e3bd292459a81121b90b03fde3b Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestNetworkBasicOps-1511396651 Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestNetworkBasicOps-1511396651-project Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 5e1adb391e2f425892a83762aaa6eb43 Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestNetworkBasicOps-1511396651-project Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 4145de3a-1f5d-4d15-9d88-79393524853b could not be found. Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4145de3a-1f5d-4d15-9d88-79393524853b'} Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4145de3a-1f5d-4d15-9d88-79393524853b could not be found. Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4145de3a-1f5d-4d15-9d88-79393524853b could not be found. Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:47:48.102624 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:48.107387 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:47:48.107387 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:47:48.107387 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:47:48.107387 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:47:48.107387 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:47:48.107387 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4145de3a-1f5d-4d15-9d88-79393524853b could not be found. Jul 26 14:47:48.107387 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:47:48.109164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c6960d4-0970-48b0-9089-7eeeeff6daea tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Returning 404 to user: Instance 4145de3a-1f5d-4d15-9d88-79393524853b could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:47:48.110240 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c6960d4-0970-48b0-9089-7eeeeff6daea tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b" status: 404 len: 111 microversion: 2.1 time: 0.045331 Jul 26 14:47:48.125129 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2774/5670] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:48 2022] GET /compute/v2.1/servers/4145de3a-1f5d-4d15-9d88-79393524853b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:47:48.351079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2224659f-95db-4898-8e8b-80a134822562 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] Calling method '.version_select at 0x7f8786a28790>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:48.390206 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2224659f-95db-4898-8e8b-80a134822562 tempest-TestNetworkBasicOps-1511396651 tempest-TestNetworkBasicOps-1511396651-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-935496935" status: 202 len: 0 microversion: 2.1 time: 0.043166 Jul 26 14:47:48.401391 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2897/5671] 10.222.0.70 () {58 vars in 1254 bytes} [Tue Jul 26 14:47:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-935496935 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:47:50.225262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-63827bc4-f209-4102-9b4d-0ceb52aa3e18 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: .version_select at 0x7f87993d6430>, body: {"keypair": {"name": "tempest-keypair-973313680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEnMlIPhilVW10ifHGNlSlHjtIRU+ps6AT8ZDIzIajpJtyqIWuIXethgZQWY6ag66HA8S7kJCwkzQkwz9k4wPdFCHcTEDxGx+9QCjllDvDUiTmEzbvoRIuti5Rn/rw75g=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:50.244145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-63827bc4-f209-4102-9b4d-0ceb52aa3e18 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:47:50.250655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-63827bc4-f209-4102-9b4d-0ceb52aa3e18 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for user df60439bde7a40938de3990499a342fc and project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:47:50.281128 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-63827bc4-f209-4102-9b4d-0ceb52aa3e18 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253628 Jul 26 14:47:50.282342 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2775/5672] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:47:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:47:51.227710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:51.231308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:51.247988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:51.248727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:51.249763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:51.250428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:51.289883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:47:51.358454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:47:51.359034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:47:51.359630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:47:51.360713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:47:51.361258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:47:51.498577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:51.505467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:51.506292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:51.508148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:51.508822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:51.546096 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2879cd9f-e52d-416b-9092-f3e17dd539c6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c/action" status: 202 len: 1136 microversion: 2.1 time: 0.323418 Jul 26 14:47:51.546932 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2898/5673] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:47:51 2022] POST /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c/action => generated 1136 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 26 14:47:51.565479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-04db7885-41b6-4003-beb3-d91cc6380aba tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:51.566159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-04db7885-41b6-4003-beb3-d91cc6380aba tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:51.573276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04db7885-41b6-4003-beb3-d91cc6380aba tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:51.574040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04db7885-41b6-4003-beb3-d91cc6380aba tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:51.575685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04db7885-41b6-4003-beb3-d91cc6380aba tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:51.576347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04db7885-41b6-4003-beb3-d91cc6380aba tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:51.833646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-04db7885-41b6-4003-beb3-d91cc6380aba tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:51.853923 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-04db7885-41b6-4003-beb3-d91cc6380aba tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.293272 Jul 26 14:47:51.869664 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2776/5674] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:51 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:52.878033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cad9dd1a-0892-4bbc-a581-10ebb1600058 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:52.878657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cad9dd1a-0892-4bbc-a581-10ebb1600058 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:52.898040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cad9dd1a-0892-4bbc-a581-10ebb1600058 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:52.899043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cad9dd1a-0892-4bbc-a581-10ebb1600058 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:52.900405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cad9dd1a-0892-4bbc-a581-10ebb1600058 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:52.901005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cad9dd1a-0892-4bbc-a581-10ebb1600058 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:53.207217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cad9dd1a-0892-4bbc-a581-10ebb1600058 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:53.220353 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cad9dd1a-0892-4bbc-a581-10ebb1600058 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.346509 Jul 26 14:47:53.224320 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2899/5675] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:52 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:53.771790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1924215888", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bea5649-0c21-48c4-9c64-ad69cc72b39d"}], "security_groups": [{"name": "tempest-securitygroup--1851904042"}], "key_name": "tempest-keypair-973313680", "user_data": "}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:53.958556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] validate_networks() for [('5bea5649-0c21-48c4-9c64-ad69cc72b39d', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:47:54.248360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-44b686a1-9b0e-4ec7-93a0-c938265815a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:54.248984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-44b686a1-9b0e-4ec7-93a0-c938265815a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:54.261960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44b686a1-9b0e-4ec7-93a0-c938265815a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:54.262438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44b686a1-9b0e-4ec7-93a0-c938265815a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:54.263241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44b686a1-9b0e-4ec7-93a0-c938265815a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:54.263693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-44b686a1-9b0e-4ec7-93a0-c938265815a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:54.606266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-44b686a1-9b0e-4ec7-93a0-c938265815a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:54.624821 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-44b686a1-9b0e-4ec7-93a0-c938265815a8 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.380137 Jul 26 14:47:54.625797 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2900/5676] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:54 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:47:54.732014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:47:54.732520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:47:54.733205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:47:54.733781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:47:54.734511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:47:54.746132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:54.746729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:54.747487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:54.747922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:54.784684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:47:54.795130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for user df60439bde7a40938de3990499a342fc and project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:47:54.831620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:47:54.834031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:47:54.891527 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7f961afe-0339-4ced-8a96-8c31f830a923 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.124794 Jul 26 14:47:54.892431 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2777/5677] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:47:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:47:54.913918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f0b176b9-d1e2-4f2c-812e-5aa9b8e1289b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:54.914950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f0b176b9-d1e2-4f2c-812e-5aa9b8e1289b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:55.064755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f0b176b9-d1e2-4f2c-812e-5aa9b8e1289b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:55.075680 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f0b176b9-d1e2-4f2c-812e-5aa9b8e1289b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1241 microversion: 2.1 time: 0.175790 Jul 26 14:47:55.076311 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2901/5678] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:54 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:55.647784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bc4dc5ce-58e2-43a8-a6c9-4316cbdac4d2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:55.648621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bc4dc5ce-58e2-43a8-a6c9-4316cbdac4d2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:55.656001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc4dc5ce-58e2-43a8-a6c9-4316cbdac4d2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:55.671122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc4dc5ce-58e2-43a8-a6c9-4316cbdac4d2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:55.673457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc4dc5ce-58e2-43a8-a6c9-4316cbdac4d2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:55.674450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bc4dc5ce-58e2-43a8-a6c9-4316cbdac4d2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:55.835616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bc4dc5ce-58e2-43a8-a6c9-4316cbdac4d2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:55.846809 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bc4dc5ce-58e2-43a8-a6c9-4316cbdac4d2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.204642 Jul 26 14:47:55.847617 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2778/5679] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:55 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:56.097206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4273d095-3a1f-42c2-befb-ec74cb24b536 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:56.097836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4273d095-3a1f-42c2-befb-ec74cb24b536 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:56.105827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4273d095-3a1f-42c2-befb-ec74cb24b536 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:56.106188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4273d095-3a1f-42c2-befb-ec74cb24b536 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:56.106975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4273d095-3a1f-42c2-befb-ec74cb24b536 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:56.107421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4273d095-3a1f-42c2-befb-ec74cb24b536 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:56.195464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4273d095-3a1f-42c2-befb-ec74cb24b536 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:56.204956 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4273d095-3a1f-42c2-befb-ec74cb24b536 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1293 microversion: 2.1 time: 0.111345 Jul 26 14:47:56.207381 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2902/5680] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:56 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:56.868649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64649cc3-e311-4e58-841e-474d992b5301 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:56.870001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-64649cc3-e311-4e58-841e-474d992b5301 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:56.879414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64649cc3-e311-4e58-841e-474d992b5301 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:56.880173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64649cc3-e311-4e58-841e-474d992b5301 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:56.881195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64649cc3-e311-4e58-841e-474d992b5301 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:56.881793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64649cc3-e311-4e58-841e-474d992b5301 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:57.121050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64649cc3-e311-4e58-841e-474d992b5301 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:57.143213 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64649cc3-e311-4e58-841e-474d992b5301 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.278187 Jul 26 14:47:57.152872 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2779/5681] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:56 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:57.234151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f2bed660-7b87-4cfa-875b-6f1194bc1a59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:57.242784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f2bed660-7b87-4cfa-875b-6f1194bc1a59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:57.253023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2bed660-7b87-4cfa-875b-6f1194bc1a59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:57.253442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2bed660-7b87-4cfa-875b-6f1194bc1a59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:57.254735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2bed660-7b87-4cfa-875b-6f1194bc1a59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:57.255340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2bed660-7b87-4cfa-875b-6f1194bc1a59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:57.510354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f2bed660-7b87-4cfa-875b-6f1194bc1a59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:57.528436 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f2bed660-7b87-4cfa-875b-6f1194bc1a59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1367 microversion: 2.1 time: 0.303386 Jul 26 14:47:57.531057 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2903/5682] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:57 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:58.271028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-33b3a459-f636-47b2-a4cb-b55f695bdfdc req-bbf5d857-80f9-4aa8-a3c0-a7003823de65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cab1cb2-39b4-475e-aa98-74de17b0ec99", "tag": "945f81a4-2ce3-4197-a947-8b533bf0aa5c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:58.296120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-33b3a459-f636-47b2-a4cb-b55f695bdfdc req-bbf5d857-80f9-4aa8-a3c0-a7003823de65 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:58.296584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-33b3a459-f636-47b2-a4cb-b55f695bdfdc req-bbf5d857-80f9-4aa8-a3c0-a7003823de65 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:58.350793 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-33b3a459-f636-47b2-a4cb-b55f695bdfdc req-bbf5d857-80f9-4aa8-a3c0-a7003823de65 service nova] Creating event network-changed:945f81a4-2ce3-4197-a947-8b533bf0aa5c for instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 on n-h2-833090-9 Jul 26 14:47:58.370525 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-33b3a459-f636-47b2-a4cb-b55f695bdfdc req-bbf5d857-80f9-4aa8-a3c0-a7003823de65 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103562 Jul 26 14:47:58.373632 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2904/5683] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:47:58.560687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fcbd9584-5676-4aff-b901-be388fc409fb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:58.561439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fcbd9584-5676-4aff-b901-be388fc409fb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:58.581563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcbd9584-5676-4aff-b901-be388fc409fb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:58.582016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcbd9584-5676-4aff-b901-be388fc409fb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:58.590068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcbd9584-5676-4aff-b901-be388fc409fb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:58.591563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fcbd9584-5676-4aff-b901-be388fc409fb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:58.689745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a2a9388-9917-4061-bf2d-b6dcc80f4a36 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:47:58.691767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4a2a9388-9917-4061-bf2d-b6dcc80f4a36 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:47:58.710648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a2a9388-9917-4061-bf2d-b6dcc80f4a36 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:58.711439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a2a9388-9917-4061-bf2d-b6dcc80f4a36 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:58.712393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a2a9388-9917-4061-bf2d-b6dcc80f4a36 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:47:58.713039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a2a9388-9917-4061-bf2d-b6dcc80f4a36 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:47:59.039556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fcbd9584-5676-4aff-b901-be388fc409fb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:59.045156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4a2a9388-9917-4061-bf2d-b6dcc80f4a36 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:47:59.051253 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fcbd9584-5676-4aff-b901-be388fc409fb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1367 microversion: 2.1 time: 0.503190 Jul 26 14:47:59.052314 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2905/5684] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:58 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1367 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:59.058773 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4a2a9388-9917-4061-bf2d-b6dcc80f4a36 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.894204 Jul 26 14:47:59.073294 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2780/5685] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:47:58 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:47:59.280006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-39c04185-9cae-41a7-ad63-f1edd3a24c97 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Action: 'create', calling method: .version_select at 0x7f8786ab98b0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-219361403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4Y0fFOeuvdX1RrD0FGhGokplSMViJb3KuUp33Fl4oqU5IQqFWLqGX3azQu93kUV9Zzer4WZSo3Ov2NbvE3isDRZqzO2KyfD08VnnVemmTn7uw2byfWI/aPT4e+npKHXg=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:47:59.303791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-39c04185-9cae-41a7-ad63-f1edd3a24c97 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Getting quotas for project fa53fd3479a24e56a740525e76245361. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:47:59.310333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-39c04185-9cae-41a7-ad63-f1edd3a24c97 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Getting quotas for user 6ef520f8dced4624b10319dff4fb924a and project fa53fd3479a24e56a740525e76245361. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:47:59.335964 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-39c04185-9cae-41a7-ad63-f1edd3a24c97 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.282081 Jul 26 14:47:59.336698 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2906/5686] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:47:59 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:48:00.073226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-61166e5e-7031-4392-b00c-c578d8a03e73 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:00.073921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-61166e5e-7031-4392-b00c-c578d8a03e73 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:00.083689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61166e5e-7031-4392-b00c-c578d8a03e73 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:00.084173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61166e5e-7031-4392-b00c-c578d8a03e73 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:00.084961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61166e5e-7031-4392-b00c-c578d8a03e73 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:00.085399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61166e5e-7031-4392-b00c-c578d8a03e73 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:00.088917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c2191c88-31f1-46cf-bce1-f26ebcf1d4f7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:00.089844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c2191c88-31f1-46cf-bce1-f26ebcf1d4f7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:00.107838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2191c88-31f1-46cf-bce1-f26ebcf1d4f7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:00.108754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2191c88-31f1-46cf-bce1-f26ebcf1d4f7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:00.109650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2191c88-31f1-46cf-bce1-f26ebcf1d4f7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:00.112365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2191c88-31f1-46cf-bce1-f26ebcf1d4f7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:00.755642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c2191c88-31f1-46cf-bce1-f26ebcf1d4f7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:00.775901 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c2191c88-31f1-46cf-bce1-f26ebcf1d4f7 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.694548 Jul 26 14:48:00.776520 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2907/5687] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:00 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:00.785007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-61166e5e-7031-4392-b00c-c578d8a03e73 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:00.794502 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-61166e5e-7031-4392-b00c-c578d8a03e73 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1367 microversion: 2.1 time: 0.725471 Jul 26 14:48:00.795873 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2781/5688] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:00 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1367 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:01.802864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae85ac76-bca6-4cb0-b292-6de7733e2847 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:01.804168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ae85ac76-bca6-4cb0-b292-6de7733e2847 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:01.817801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae85ac76-bca6-4cb0-b292-6de7733e2847 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:01.818539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae85ac76-bca6-4cb0-b292-6de7733e2847 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:01.819505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae85ac76-bca6-4cb0-b292-6de7733e2847 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:01.820276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae85ac76-bca6-4cb0-b292-6de7733e2847 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:01.826459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-11d1104f-b7fa-448b-864f-96b8d73eae0a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:01.831921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-11d1104f-b7fa-448b-864f-96b8d73eae0a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:01.861766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11d1104f-b7fa-448b-864f-96b8d73eae0a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:01.862512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11d1104f-b7fa-448b-864f-96b8d73eae0a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:01.863519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11d1104f-b7fa-448b-864f-96b8d73eae0a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:01.864157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-11d1104f-b7fa-448b-864f-96b8d73eae0a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:02.165293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ae85ac76-bca6-4cb0-b292-6de7733e2847 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:02.176155 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ae85ac76-bca6-4cb0-b292-6de7733e2847 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.381559 Jul 26 14:48:02.176769 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2908/5689] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:01 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:02.231121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-11d1104f-b7fa-448b-864f-96b8d73eae0a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:02.245047 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-11d1104f-b7fa-448b-864f-96b8d73eae0a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1367 microversion: 2.1 time: 0.427904 Jul 26 14:48:02.245736 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2782/5690] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:01 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:03.199506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-28d1ba53-6d63-4562-84cc-e5ccdbd02924 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:03.200895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-28d1ba53-6d63-4562-84cc-e5ccdbd02924 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:03.210691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28d1ba53-6d63-4562-84cc-e5ccdbd02924 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:03.211456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28d1ba53-6d63-4562-84cc-e5ccdbd02924 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:03.212832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28d1ba53-6d63-4562-84cc-e5ccdbd02924 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:03.213483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28d1ba53-6d63-4562-84cc-e5ccdbd02924 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:03.276223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f2049202-0ff7-42ed-86b1-a926b9b6f856 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:03.294493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f2049202-0ff7-42ed-86b1-a926b9b6f856 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:03.324422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2049202-0ff7-42ed-86b1-a926b9b6f856 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:03.327262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2049202-0ff7-42ed-86b1-a926b9b6f856 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:03.328188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2049202-0ff7-42ed-86b1-a926b9b6f856 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:03.332810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2049202-0ff7-42ed-86b1-a926b9b6f856 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:03.474112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-28d1ba53-6d63-4562-84cc-e5ccdbd02924 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:03.486729 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-28d1ba53-6d63-4562-84cc-e5ccdbd02924 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.287876 Jul 26 14:48:03.487369 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2909/5691] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:03 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:03.571410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f2049202-0ff7-42ed-86b1-a926b9b6f856 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:03.580557 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f2049202-0ff7-42ed-86b1-a926b9b6f856 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1367 microversion: 2.1 time: 0.311079 Jul 26 14:48:03.593030 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2783/5692] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:03 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:03.839509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-0604e47a-2431-4b61-a54c-1f1ddd974058 req-37a5258d-de5f-4c6b-9fd3-a3219d5b32ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cab1cb2-39b4-475e-aa98-74de17b0ec99", "name": "network-vif-plugged", "status": "completed", "tag": "945f81a4-2ce3-4197-a947-8b533bf0aa5c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:03.852724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0604e47a-2431-4b61-a54c-1f1ddd974058 req-37a5258d-de5f-4c6b-9fd3-a3219d5b32ac service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:03.853111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0604e47a-2431-4b61-a54c-1f1ddd974058 req-37a5258d-de5f-4c6b-9fd3-a3219d5b32ac service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:03.871347 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-0604e47a-2431-4b61-a54c-1f1ddd974058 req-37a5258d-de5f-4c6b-9fd3-a3219d5b32ac service nova] Creating event network-vif-plugged:945f81a4-2ce3-4197-a947-8b533bf0aa5c for instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 on n-h2-833090-9 Jul 26 14:48:03.879925 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-0604e47a-2431-4b61-a54c-1f1ddd974058 req-37a5258d-de5f-4c6b-9fd3-a3219d5b32ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044483 Jul 26 14:48:03.880899 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2910/5693] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:48:04.517405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-45ae077b-d00d-49a9-873e-1ac6703d6757 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:04.518863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-45ae077b-d00d-49a9-873e-1ac6703d6757 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:04.529715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45ae077b-d00d-49a9-873e-1ac6703d6757 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:04.530620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45ae077b-d00d-49a9-873e-1ac6703d6757 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:04.532270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45ae077b-d00d-49a9-873e-1ac6703d6757 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:04.533363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45ae077b-d00d-49a9-873e-1ac6703d6757 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:04.606664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5de78fa8-becb-4c85-99d3-ba112ea06e5f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:04.612806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5de78fa8-becb-4c85-99d3-ba112ea06e5f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:04.653007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5de78fa8-becb-4c85-99d3-ba112ea06e5f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:04.654397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5de78fa8-becb-4c85-99d3-ba112ea06e5f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:04.655170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5de78fa8-becb-4c85-99d3-ba112ea06e5f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:04.674324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5de78fa8-becb-4c85-99d3-ba112ea06e5f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:04.767308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:04.817009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:04.959940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-45ae077b-d00d-49a9-873e-1ac6703d6757 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:04.978096 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-45ae077b-d00d-49a9-873e-1ac6703d6757 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.462766 Jul 26 14:48:04.994606 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2784/5694] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:04 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:05.012560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5de78fa8-becb-4c85-99d3-ba112ea06e5f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:05.029088 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5de78fa8-becb-4c85-99d3-ba112ea06e5f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1367 microversion: 2.1 time: 0.429450 Jul 26 14:48:05.044688 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2911/5695] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:04 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1367 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:06.003136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-78673483-2bb5-4333-8f5a-ae987b0300e9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:06.004108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-78673483-2bb5-4333-8f5a-ae987b0300e9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:06.019321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78673483-2bb5-4333-8f5a-ae987b0300e9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:06.020487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78673483-2bb5-4333-8f5a-ae987b0300e9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:06.023815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78673483-2bb5-4333-8f5a-ae987b0300e9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:06.024595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78673483-2bb5-4333-8f5a-ae987b0300e9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:06.055678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4effa037-dabf-4745-88ba-fcd0a2a71ddb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:06.056364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4effa037-dabf-4745-88ba-fcd0a2a71ddb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:06.073849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4effa037-dabf-4745-88ba-fcd0a2a71ddb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:06.074314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4effa037-dabf-4745-88ba-fcd0a2a71ddb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:06.075182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4effa037-dabf-4745-88ba-fcd0a2a71ddb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:06.075536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4effa037-dabf-4745-88ba-fcd0a2a71ddb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:06.359993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-78673483-2bb5-4333-8f5a-ae987b0300e9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:06.366882 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-78673483-2bb5-4333-8f5a-ae987b0300e9 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.368868 Jul 26 14:48:06.384181 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2785/5696] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:05 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:06.441610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4effa037-dabf-4745-88ba-fcd0a2a71ddb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:06.452236 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4effa037-dabf-4745-88ba-fcd0a2a71ddb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1555 microversion: 2.1 time: 0.400609 Jul 26 14:48:06.453159 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2912/5697] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:06 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1555 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:06.476125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1782a763-5e0c-49a9-8763-af09d6e613f0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:06.476703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1782a763-5e0c-49a9-8763-af09d6e613f0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:06.488708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1782a763-5e0c-49a9-8763-af09d6e613f0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:06.492938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1782a763-5e0c-49a9-8763-af09d6e613f0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:06.494024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1782a763-5e0c-49a9-8763-af09d6e613f0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:06.494579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1782a763-5e0c-49a9-8763-af09d6e613f0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:06.650810 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1782a763-5e0c-49a9-8763-af09d6e613f0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178071 Jul 26 14:48:06.652787 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2786/5698] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:48:06 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:48:07.367895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-195644713-access_point-1909270467", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "31b79282-5da8-4e01-8fb1-9605607a6bd9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-219361403", "security_groups": [{"name": "tempest-secgroup_access--1068373672"}, {"name": "tempest-secgroup_general--1419763935"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:07.390802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c3c54b6-5a86-433a-ba52-d8da3097eabf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:07.392110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c3c54b6-5a86-433a-ba52-d8da3097eabf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:07.413692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c3c54b6-5a86-433a-ba52-d8da3097eabf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:07.417881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c3c54b6-5a86-433a-ba52-d8da3097eabf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:07.418992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c3c54b6-5a86-433a-ba52-d8da3097eabf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:07.419663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c3c54b6-5a86-433a-ba52-d8da3097eabf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:08.334593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c3c54b6-5a86-433a-ba52-d8da3097eabf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:08.336182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] validate_networks() for [('31b79282-5da8-4e01-8fb1-9605607a6bd9', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:48:08.348396 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c3c54b6-5a86-433a-ba52-d8da3097eabf tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1691 microversion: 2.1 time: 0.962449 Jul 26 14:48:08.349685 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2787/5699] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:07 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1691 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:09.045121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7cd1d94b-6c81-419c-ba18-5bc73bbe5bd3 req-f7527db9-eaa8-4dd9-acac-6bc5d542c264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cab1cb2-39b4-475e-aa98-74de17b0ec99", "tag": "945f81a4-2ce3-4197-a947-8b533bf0aa5c"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:09.070440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7cd1d94b-6c81-419c-ba18-5bc73bbe5bd3 req-f7527db9-eaa8-4dd9-acac-6bc5d542c264 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:09.071313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7cd1d94b-6c81-419c-ba18-5bc73bbe5bd3 req-f7527db9-eaa8-4dd9-acac-6bc5d542c264 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:09.084561 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7cd1d94b-6c81-419c-ba18-5bc73bbe5bd3 req-f7527db9-eaa8-4dd9-acac-6bc5d542c264 service nova] Creating event network-changed:945f81a4-2ce3-4197-a947-8b533bf0aa5c for instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 on n-h2-833090-9 Jul 26 14:48:09.091783 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7cd1d94b-6c81-419c-ba18-5bc73bbe5bd3 req-f7527db9-eaa8-4dd9-acac-6bc5d542c264 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050272 Jul 26 14:48:09.092808 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2788/5700] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:48:09.202230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:48:09.203269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:48:09.205335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:48:09.206367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:48:09.207267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:48:09.226495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:09.228383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:09.229413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:09.230154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:09.258541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Getting quotas for project fa53fd3479a24e56a740525e76245361. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:48:09.264680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Getting quotas for user 6ef520f8dced4624b10319dff4fb924a and project fa53fd3479a24e56a740525e76245361. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:48:09.310234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:48:09.315876 n-d-833090-9 devstack@n-api.service[119479]: WARNING nova.utils [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-195644713-access_point-1909270467 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-195644713-acc Jul 26 14:48:09.328415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:48:09.378130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2f3fab9c-cfda-406d-a8af-c8069d1a8a79 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:09.379057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2f3fab9c-cfda-406d-a8af-c8069d1a8a79 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:09.405970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f3fab9c-cfda-406d-a8af-c8069d1a8a79 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:09.405970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f3fab9c-cfda-406d-a8af-c8069d1a8a79 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:09.405970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f3fab9c-cfda-406d-a8af-c8069d1a8a79 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:09.405970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f3fab9c-cfda-406d-a8af-c8069d1a8a79 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:09.415388 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f0478bb4-da80-482e-b437-fbd72f820536 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 2.050041 Jul 26 14:48:09.421139 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2913/5701] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:48:07 2022] POST /compute/v2.1/servers => generated 458 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:48:09.463092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43bacd97-7282-4813-9de9-80dac94c79e0 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:09.463737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-43bacd97-7282-4813-9de9-80dac94c79e0 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:09.688940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43bacd97-7282-4813-9de9-80dac94c79e0 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:09.696835 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43bacd97-7282-4813-9de9-80dac94c79e0 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1293 microversion: 2.1 time: 0.263580 Jul 26 14:48:09.697435 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2914/5702] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:09 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1293 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:10.234840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2f3fab9c-cfda-406d-a8af-c8069d1a8a79 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:10.243421 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2f3fab9c-cfda-406d-a8af-c8069d1a8a79 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1697 microversion: 2.1 time: 0.874085 Jul 26 14:48:10.246930 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2789/5703] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:09 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1697 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:48:10.724501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dd7aaa60-93f5-4266-82ae-706f86480eb4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:10.725184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dd7aaa60-93f5-4266-82ae-706f86480eb4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:10.739513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd7aaa60-93f5-4266-82ae-706f86480eb4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:10.740061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd7aaa60-93f5-4266-82ae-706f86480eb4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:10.740834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd7aaa60-93f5-4266-82ae-706f86480eb4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:10.747584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd7aaa60-93f5-4266-82ae-706f86480eb4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:10.823208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dd7aaa60-93f5-4266-82ae-706f86480eb4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:10.833851 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dd7aaa60-93f5-4266-82ae-706f86480eb4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1297 microversion: 2.1 time: 0.114450 Jul 26 14:48:10.835720 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2915/5704] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:10 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1297 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:11.270071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ed9a7eef-66de-4f26-b086-16fe811e6d96 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:11.270710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ed9a7eef-66de-4f26-b086-16fe811e6d96 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:11.280628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:11.283223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed9a7eef-66de-4f26-b086-16fe811e6d96 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:11.283900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed9a7eef-66de-4f26-b086-16fe811e6d96 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:11.284916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed9a7eef-66de-4f26-b086-16fe811e6d96 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:11.285543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed9a7eef-66de-4f26-b086-16fe811e6d96 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:11.289376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:11.481074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ed9a7eef-66de-4f26-b086-16fe811e6d96 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:11.499290 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ed9a7eef-66de-4f26-b086-16fe811e6d96 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1682 microversion: 2.1 time: 0.234067 Jul 26 14:48:11.513063 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2790/5705] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:11 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:11.858660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-516d41db-ecf3-4692-8051-6715133f65e3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:11.859847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-516d41db-ecf3-4692-8051-6715133f65e3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:11.870948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-516d41db-ecf3-4692-8051-6715133f65e3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:11.871676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-516d41db-ecf3-4692-8051-6715133f65e3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:11.872709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-516d41db-ecf3-4692-8051-6715133f65e3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:11.873326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-516d41db-ecf3-4692-8051-6715133f65e3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:11.953633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-516d41db-ecf3-4692-8051-6715133f65e3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:11.963380 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-516d41db-ecf3-4692-8051-6715133f65e3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1351 microversion: 2.1 time: 0.112039 Jul 26 14:48:11.964700 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2916/5706] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:11 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:12.987026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9f662833-86f6-42d7-a047-b6b4c334bc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:12.987639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9f662833-86f6-42d7-a047-b6b4c334bc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:12.995577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f662833-86f6-42d7-a047-b6b4c334bc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:12.995785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f662833-86f6-42d7-a047-b6b4c334bc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:12.996448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f662833-86f6-42d7-a047-b6b4c334bc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:12.996890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9f662833-86f6-42d7-a047-b6b4c334bc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:13.161265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9f662833-86f6-42d7-a047-b6b4c334bc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:13.178713 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9f662833-86f6-42d7-a047-b6b4c334bc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1471 microversion: 2.1 time: 0.190582 Jul 26 14:48:13.179939 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2791/5707] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:12 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:48:13.353454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-19f515f2-e456-4ba2-87ea-510061e4fa2a req-736b7cf7-2e87-4517-9b2a-c11485bf4349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c", "name": "network-vif-plugged", "status": "completed", "tag": "20747ce4-f67e-4252-9932-52b7be2a6ac0"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:13.367997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-19f515f2-e456-4ba2-87ea-510061e4fa2a req-736b7cf7-2e87-4517-9b2a-c11485bf4349 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:13.368753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-19f515f2-e456-4ba2-87ea-510061e4fa2a req-736b7cf7-2e87-4517-9b2a-c11485bf4349 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:13.389705 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-19f515f2-e456-4ba2-87ea-510061e4fa2a req-736b7cf7-2e87-4517-9b2a-c11485bf4349 service nova] Creating event network-vif-plugged:20747ce4-f67e-4252-9932-52b7be2a6ac0 for instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c on n-h1-833090-9 Jul 26 14:48:13.396856 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-19f515f2-e456-4ba2-87ea-510061e4fa2a req-736b7cf7-2e87-4517-9b2a-c11485bf4349 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047457 Jul 26 14:48:13.398122 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2917/5708] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:48:13.515621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3fd695e9-be73-460b-abc6-911a3e4f43bb req-69206730-3691-4e77-8440-07e40106a6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dede0882-4384-4b70-966d-fe81c61be70c", "tag": "891f5306-1e24-4a8c-93bb-a060303aabc4"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:13.545182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3fd695e9-be73-460b-abc6-911a3e4f43bb req-69206730-3691-4e77-8440-07e40106a6e1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:13.546745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3fd695e9-be73-460b-abc6-911a3e4f43bb req-69206730-3691-4e77-8440-07e40106a6e1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:13.561088 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3fd695e9-be73-460b-abc6-911a3e4f43bb req-69206730-3691-4e77-8440-07e40106a6e1 service nova] Creating event network-changed:891f5306-1e24-4a8c-93bb-a060303aabc4 for instance dede0882-4384-4b70-966d-fe81c61be70c on n-h1-833090-9 Jul 26 14:48:13.568302 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3fd695e9-be73-460b-abc6-911a3e4f43bb req-69206730-3691-4e77-8440-07e40106a6e1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058543 Jul 26 14:48:13.568926 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2792/5709] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:48:14.206747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0776ee36-1fb0-47b3-9973-4f901b6cbaca tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:14.207576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0776ee36-1fb0-47b3-9973-4f901b6cbaca tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:14.213851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0776ee36-1fb0-47b3-9973-4f901b6cbaca tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:14.214310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0776ee36-1fb0-47b3-9973-4f901b6cbaca tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:14.215091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0776ee36-1fb0-47b3-9973-4f901b6cbaca tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:14.215530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0776ee36-1fb0-47b3-9973-4f901b6cbaca tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:14.236413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:14.381623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0776ee36-1fb0-47b3-9973-4f901b6cbaca tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:14.389199 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0776ee36-1fb0-47b3-9973-4f901b6cbaca tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1471 microversion: 2.1 time: 0.187650 Jul 26 14:48:14.393744 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2918/5710] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:14 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:15.415191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c862e71f-d7f3-4565-a02c-3bf80f8f2aa3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:15.415904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c862e71f-d7f3-4565-a02c-3bf80f8f2aa3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:15.422401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c862e71f-d7f3-4565-a02c-3bf80f8f2aa3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:15.423077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c862e71f-d7f3-4565-a02c-3bf80f8f2aa3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:15.423884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c862e71f-d7f3-4565-a02c-3bf80f8f2aa3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:15.424357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c862e71f-d7f3-4565-a02c-3bf80f8f2aa3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:15.578558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c862e71f-d7f3-4565-a02c-3bf80f8f2aa3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:15.587422 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c862e71f-d7f3-4565-a02c-3bf80f8f2aa3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1471 microversion: 2.1 time: 0.177572 Jul 26 14:48:15.588044 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2793/5711] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:15 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:16.609473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8af774e3-3c12-496d-a423-3ce7a7f11e04 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:16.610142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8af774e3-3c12-496d-a423-3ce7a7f11e04 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:16.614739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:16.619082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8af774e3-3c12-496d-a423-3ce7a7f11e04 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:16.619557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8af774e3-3c12-496d-a423-3ce7a7f11e04 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:16.620391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8af774e3-3c12-496d-a423-3ce7a7f11e04 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:16.620841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8af774e3-3c12-496d-a423-3ce7a7f11e04 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:16.776727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8af774e3-3c12-496d-a423-3ce7a7f11e04 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:16.784591 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8af774e3-3c12-496d-a423-3ce7a7f11e04 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1471 microversion: 2.1 time: 0.179034 Jul 26 14:48:16.785163 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2919/5712] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:16 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:17.806207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b27ff9ef-959d-40cf-861e-d0fe93c9fb8f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:17.806915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b27ff9ef-959d-40cf-861e-d0fe93c9fb8f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:17.815042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b27ff9ef-959d-40cf-861e-d0fe93c9fb8f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:17.815500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b27ff9ef-959d-40cf-861e-d0fe93c9fb8f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:17.816343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b27ff9ef-959d-40cf-861e-d0fe93c9fb8f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:17.816789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b27ff9ef-959d-40cf-861e-d0fe93c9fb8f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:17.985841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b27ff9ef-959d-40cf-861e-d0fe93c9fb8f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:17.997073 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b27ff9ef-959d-40cf-861e-d0fe93c9fb8f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1471 microversion: 2.1 time: 0.194803 Jul 26 14:48:17.997918 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2794/5713] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:17 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:19.021406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e281d773-998b-43c7-9b36-eab9b1db11ba tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:19.022799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e281d773-998b-43c7-9b36-eab9b1db11ba tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:19.030382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e281d773-998b-43c7-9b36-eab9b1db11ba tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:19.030859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e281d773-998b-43c7-9b36-eab9b1db11ba tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:19.031645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e281d773-998b-43c7-9b36-eab9b1db11ba tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:19.032167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e281d773-998b-43c7-9b36-eab9b1db11ba tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:19.198026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e281d773-998b-43c7-9b36-eab9b1db11ba tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:19.206382 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e281d773-998b-43c7-9b36-eab9b1db11ba tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1471 microversion: 2.1 time: 0.189446 Jul 26 14:48:19.206984 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2920/5714] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:19 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:19.369724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-72c03f96-26ab-4f53-8360-582c04ce23c6 req-bd0dd248-ba57-43ef-a52b-3133d09725dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dede0882-4384-4b70-966d-fe81c61be70c", "name": "network-vif-plugged", "status": "completed", "tag": "891f5306-1e24-4a8c-93bb-a060303aabc4"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:19.382182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-72c03f96-26ab-4f53-8360-582c04ce23c6 req-bd0dd248-ba57-43ef-a52b-3133d09725dc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:19.382705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-72c03f96-26ab-4f53-8360-582c04ce23c6 req-bd0dd248-ba57-43ef-a52b-3133d09725dc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:19.394902 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-72c03f96-26ab-4f53-8360-582c04ce23c6 req-bd0dd248-ba57-43ef-a52b-3133d09725dc service nova] Creating event network-vif-plugged:891f5306-1e24-4a8c-93bb-a060303aabc4 for instance dede0882-4384-4b70-966d-fe81c61be70c on n-h1-833090-9 Jul 26 14:48:19.401113 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-72c03f96-26ab-4f53-8360-582c04ce23c6 req-bd0dd248-ba57-43ef-a52b-3133d09725dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035255 Jul 26 14:48:19.402095 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2795/5715] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:48:20.228654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d48a18dc-1694-4924-8772-2401586713c4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:20.229395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d48a18dc-1694-4924-8772-2401586713c4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:20.231526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:20.232417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=14 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:20.239782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d48a18dc-1694-4924-8772-2401586713c4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:20.240274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d48a18dc-1694-4924-8772-2401586713c4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:20.241060 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d48a18dc-1694-4924-8772-2401586713c4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:20.241510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d48a18dc-1694-4924-8772-2401586713c4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:20.404892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d48a18dc-1694-4924-8772-2401586713c4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:20.416080 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d48a18dc-1694-4924-8772-2401586713c4 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1471 microversion: 2.1 time: 0.189863 Jul 26 14:48:20.416080 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2921/5716] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:20 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:21.439120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8111cb95-d4a9-4c6b-ae9e-a4a53a93fa62 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:21.439840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8111cb95-d4a9-4c6b-ae9e-a4a53a93fa62 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:21.454528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8111cb95-d4a9-4c6b-ae9e-a4a53a93fa62 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:21.455125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8111cb95-d4a9-4c6b-ae9e-a4a53a93fa62 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:21.456302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8111cb95-d4a9-4c6b-ae9e-a4a53a93fa62 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:21.456751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8111cb95-d4a9-4c6b-ae9e-a4a53a93fa62 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:21.619250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8111cb95-d4a9-4c6b-ae9e-a4a53a93fa62 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:21.628363 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8111cb95-d4a9-4c6b-ae9e-a4a53a93fa62 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1643 microversion: 2.1 time: 0.194381 Jul 26 14:48:21.628941 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2796/5717] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:21 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1643 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:48:21.649912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2f511faf-afd9-478b-9525-24134d43fafe tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:21.650577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2f511faf-afd9-478b-9525-24134d43fafe tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:21.658513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f511faf-afd9-478b-9525-24134d43fafe tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:21.659094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f511faf-afd9-478b-9525-24134d43fafe tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:21.660094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f511faf-afd9-478b-9525-24134d43fafe tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:21.660681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2f511faf-afd9-478b-9525-24134d43fafe tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:21.851365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2f511faf-afd9-478b-9525-24134d43fafe tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:21.859200 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2f511faf-afd9-478b-9525-24134d43fafe tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1643 microversion: 2.1 time: 0.213152 Jul 26 14:48:21.859823 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2922/5718] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:21 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1643 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:21.880434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2a72a06b-6e10-4433-8798-0616ac126e48 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:21.881084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2a72a06b-6e10-4433-8798-0616ac126e48 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:21.887174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a72a06b-6e10-4433-8798-0616ac126e48 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:21.887630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a72a06b-6e10-4433-8798-0616ac126e48 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:21.888424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a72a06b-6e10-4433-8798-0616ac126e48 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:21.888859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a72a06b-6e10-4433-8798-0616ac126e48 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:22.162244 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2a72a06b-6e10-4433-8798-0616ac126e48 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1794 microversion: 2.1 time: 0.285510 Jul 26 14:48:22.163158 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2797/5719] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:21 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1794 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:23.973745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ff1d8749-c64c-4b05-9a4d-07164cab8dae req-9d5b5adf-9ee4-40d7-b36c-a4eebe7aec62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dede0882-4384-4b70-966d-fe81c61be70c", "tag": "891f5306-1e24-4a8c-93bb-a060303aabc4"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:24.004732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ff1d8749-c64c-4b05-9a4d-07164cab8dae req-9d5b5adf-9ee4-40d7-b36c-a4eebe7aec62 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:24.005180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ff1d8749-c64c-4b05-9a4d-07164cab8dae req-9d5b5adf-9ee4-40d7-b36c-a4eebe7aec62 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:24.022813 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ff1d8749-c64c-4b05-9a4d-07164cab8dae req-9d5b5adf-9ee4-40d7-b36c-a4eebe7aec62 service nova] Creating event network-changed:891f5306-1e24-4a8c-93bb-a060303aabc4 for instance dede0882-4384-4b70-966d-fe81c61be70c on n-h1-833090-9 Jul 26 14:48:24.028530 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ff1d8749-c64c-4b05-9a4d-07164cab8dae req-9d5b5adf-9ee4-40d7-b36c-a4eebe7aec62 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058628 Jul 26 14:48:24.029570 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2923/5720] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:48:37.745903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eeeaefe1-86b4-46ad-a23a-40ccf825d317 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:37.748259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eeeaefe1-86b4-46ad-a23a-40ccf825d317 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:37.751051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=15 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:37.751933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=39 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:37.758885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eeeaefe1-86b4-46ad-a23a-40ccf825d317 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:37.759333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eeeaefe1-86b4-46ad-a23a-40ccf825d317 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:37.760132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eeeaefe1-86b4-46ad-a23a-40ccf825d317 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:37.760569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eeeaefe1-86b4-46ad-a23a-40ccf825d317 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:37.813291 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eeeaefe1-86b4-46ad-a23a-40ccf825d317 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "POST /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c/action" status: 200 len: 24568 microversion: 2.1 time: 0.071149 Jul 26 14:48:37.820855 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2798/5721] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:48:37 2022] POST /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c/action => generated 24568 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:48:43.552665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=9 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:43.553483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=29 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:48:43.567135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8323efd6-f91e-46e5-bab4-afd6982f5479 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:43.567742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8323efd6-f91e-46e5-bab4-afd6982f5479 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:43.575447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8323efd6-f91e-46e5-bab4-afd6982f5479 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:43.575898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8323efd6-f91e-46e5-bab4-afd6982f5479 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:43.576861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8323efd6-f91e-46e5-bab4-afd6982f5479 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:43.577143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8323efd6-f91e-46e5-bab4-afd6982f5479 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:43.614265 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8323efd6-f91e-46e5-bab4-afd6982f5479 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/ips" status: 200 len: 148 microversion: 2.1 time: 0.065164 Jul 26 14:48:43.614881 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2924/5722] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:48:43 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/ips => generated 148 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:48:45.073227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fca61de4-1c43-4c03-bdfd-fcd0e7b9cce3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94f04608-37b8-4700-a3ea-4fb02485732c"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:45.076593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fca61de4-1c43-4c03-bdfd-fcd0e7b9cce3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:45.086571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fca61de4-1c43-4c03-bdfd-fcd0e7b9cce3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:45.086916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fca61de4-1c43-4c03-bdfd-fcd0e7b9cce3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:45.087642 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fca61de4-1c43-4c03-bdfd-fcd0e7b9cce3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:45.088221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fca61de4-1c43-4c03-bdfd-fcd0e7b9cce3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:45.536187 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fca61de4-1c43-4c03-bdfd-fcd0e7b9cce3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467174 Jul 26 14:48:45.537092 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2799/5723] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:48:45 2022] POST /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:48:50.060739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-78a3956f-82cd-4d94-9fe0-de31b73f53a6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:50.062004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-78a3956f-82cd-4d94-9fe0-de31b73f53a6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:50.067213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-fe136e5d-54d9-45e1-ad52-994ce45838c2 req-d7c97270-c3c8-410e-8264-a3a3392f9853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c", "tag": "20747ce4-f67e-4252-9932-52b7be2a6ac0"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:50.071642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78a3956f-82cd-4d94-9fe0-de31b73f53a6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:50.072499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78a3956f-82cd-4d94-9fe0-de31b73f53a6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:50.073528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78a3956f-82cd-4d94-9fe0-de31b73f53a6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:50.074358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78a3956f-82cd-4d94-9fe0-de31b73f53a6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:50.084769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fe136e5d-54d9-45e1-ad52-994ce45838c2 req-d7c97270-c3c8-410e-8264-a3a3392f9853 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:50.085220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fe136e5d-54d9-45e1-ad52-994ce45838c2 req-d7c97270-c3c8-410e-8264-a3a3392f9853 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:50.099293 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-fe136e5d-54d9-45e1-ad52-994ce45838c2 req-d7c97270-c3c8-410e-8264-a3a3392f9853 service nova] Creating event network-changed:20747ce4-f67e-4252-9932-52b7be2a6ac0 for instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c on n-h1-833090-9 Jul 26 14:48:50.110615 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-fe136e5d-54d9-45e1-ad52-994ce45838c2 req-d7c97270-c3c8-410e-8264-a3a3392f9853 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048509 Jul 26 14:48:50.112596 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2800/5724] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:48:50.129327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-78a3956f-82cd-4d94-9fe0-de31b73f53a6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:48:50.261057 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-78a3956f-82cd-4d94-9fe0-de31b73f53a6 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 204 len: 0 microversion: 2.1 time: 0.204358 Jul 26 14:48:50.263771 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2925/5725] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:48:50 2022] DELETE /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:48:50.275097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-79935204-9ef5-4f5e-bdd8-b8c4f531b60a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:50.276165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-79935204-9ef5-4f5e-bdd8-b8c4f531b60a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:50.284908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79935204-9ef5-4f5e-bdd8-b8c4f531b60a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:50.285854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79935204-9ef5-4f5e-bdd8-b8c4f531b60a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:50.286832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79935204-9ef5-4f5e-bdd8-b8c4f531b60a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:50.287494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79935204-9ef5-4f5e-bdd8-b8c4f531b60a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:50.497034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-79935204-9ef5-4f5e-bdd8-b8c4f531b60a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:50.505776 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-79935204-9ef5-4f5e-bdd8-b8c4f531b60a tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1688 microversion: 2.1 time: 0.237656 Jul 26 14:48:50.512709 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2801/5726] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:50 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1688 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:48:51.529488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f19a09e5-1e56-4fc8-97d6-06da896049a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:51.530216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f19a09e5-1e56-4fc8-97d6-06da896049a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:51.551579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f19a09e5-1e56-4fc8-97d6-06da896049a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:51.552187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f19a09e5-1e56-4fc8-97d6-06da896049a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:51.553203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f19a09e5-1e56-4fc8-97d6-06da896049a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:51.553851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f19a09e5-1e56-4fc8-97d6-06da896049a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:51.955591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f19a09e5-1e56-4fc8-97d6-06da896049a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ace0ada06df49f189f02e59039c2dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f899f15d3284d9d8b7f9509f1017944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:48:51.964880 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f19a09e5-1e56-4fc8-97d6-06da896049a2 tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 200 len: 1688 microversion: 2.1 time: 0.439960 Jul 26 14:48:51.975117 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2926/5727] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:51 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 1688 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:48:52.290128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-6a3ce21d-4b52-493b-8895-bc11341d8496 req-a4ee9c43-3a35-4b74-89c1-39680634be78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c", "name": "network-vif-deleted", "tag": "20747ce4-f67e-4252-9932-52b7be2a6ac0"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:52.305098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6a3ce21d-4b52-493b-8895-bc11341d8496 req-a4ee9c43-3a35-4b74-89c1-39680634be78 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:52.305756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6a3ce21d-4b52-493b-8895-bc11341d8496 req-a4ee9c43-3a35-4b74-89c1-39680634be78 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:52.319592 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-6a3ce21d-4b52-493b-8895-bc11341d8496 req-a4ee9c43-3a35-4b74-89c1-39680634be78 service nova] Creating event network-vif-deleted:20747ce4-f67e-4252-9932-52b7be2a6ac0 for instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c on n-h1-833090-9 Jul 26 14:48:52.325801 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-6a3ce21d-4b52-493b-8895-bc11341d8496 req-a4ee9c43-3a35-4b74-89c1-39680634be78 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039940 Jul 26 14:48:52.326406 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2802/5728] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:48:52.992141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85d5ca40-c874-4395-9769-dd4c6b1f941b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:52.992769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85d5ca40-c874-4395-9769-dd4c6b1f941b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] [instance: 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:48:52.999878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d5ca40-c874-4395-9769-dd4c6b1f941b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:53.000387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d5ca40-c874-4395-9769-dd4c6b1f941b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:53.001169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d5ca40-c874-4395-9769-dd4c6b1f941b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:48:53.001612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85d5ca40-c874-4395-9769-dd4c6b1f941b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:48:53.015743 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-85d5ca40-c874-4395-9769-dd4c6b1f941b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] HTTP exception thrown: Instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c could not be found. Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85d5ca40-c874-4395-9769-dd4c6b1f941b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Request method failure captured: Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c HTTP/1.1 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_xB-Zf_NVFk2LpZd5X0S1bF9Sihh0sVd3cVjP7q1Wb09Bi_CbMlSEWs2yYdcOyVXXKNohoIUlLtBITBGHLSNiRsoBSNoqWwMtL7vcjKUvwFncHYEdNqCZrXhBJGT_E7Ar_K6PwdXlw_F45EECw6xOMVI7rp06FaJ1098k3HxOxEoI4 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 1f899f15d3284d9d8b7f9509f1017944 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f899f15d3284d9d8b7f9509f1017944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f899f15d3284d9d8b7f9509f1017944"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f899f15d3284d9d8b7f9509f1017944", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f899f15d3284d9d8b7f9509f1017944"}]}] Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 1f899f15d3284d9d8b7f9509f1017944 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1920705595 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestNetworkAdvancedServerOps-1920705595-project Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 2ace0ada06df49f189f02e59039c2dd8 Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1920705595-project Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c could not be found. Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c'} Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c could not be found. Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c could not be found. Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:48:53.017432 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c could not be found. Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85d5ca40-c874-4395-9769-dd4c6b1f941b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Returning 404 to user: Instance 5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85d5ca40-c874-4395-9769-dd4c6b1f941b tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c" status: 404 len: 111 microversion: 2.1 time: 0.031089 Jul 26 14:48:53.022024 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2927/5729] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:48:52 2022] GET /compute/v2.1/servers/5bf0f05c-cd1f-4af3-a417-a5d585bc3a1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:48:56.642356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1c9801d9-ddac-44c0-9848-d62503b441bd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] Calling method '.version_select at 0x7f8786c4f3a0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:48:56.669574 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1c9801d9-ddac-44c0-9848-d62503b441bd tempest-TestNetworkAdvancedServerOps-1920705595 tempest-TestNetworkAdvancedServerOps-1920705595-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1409261338" status: 202 len: 0 microversion: 2.1 time: 0.032595 Jul 26 14:48:56.670163 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2803/5730] 10.222.0.70 () {58 vars in 1284 bytes} [Tue Jul 26 14:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1409261338 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:48:57.502317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-544e60be-4b33-451d-a830-1adb1c332891 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: .version_select at 0x7f8786a3d4c0>, body: {"keypair": {"name": "tempest-keypair-872493025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQIz6fg9CY4LpRd4G/OnxsTqd0mg1K64IANXtoHTG1Musen6shn8sAhs8MKkvgNv9/E1+hVs7LKAoGX1uIvYXmNdE9YdlLD7xi4k7YmsYyB1fqg6hyabuRarvp669EnEw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:57.524599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-544e60be-4b33-451d-a830-1adb1c332891 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:48:57.533160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-544e60be-4b33-451d-a830-1adb1c332891 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for user df60439bde7a40938de3990499a342fc and project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:48:57.566623 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-544e60be-4b33-451d-a830-1adb1c332891 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069935 Jul 26 14:48:57.584620 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2928/5731] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:48:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:48:59.297724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1889754478", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bea5649-0c21-48c4-9c64-ad69cc72b39d"}], "security_groups": [{"name": "tempest-securitygroup--895468009"}], "key_name": "tempest-keypair-872493025", "user_data": "}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:48:59.519489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] validate_networks() for [('5bea5649-0c21-48c4-9c64-ad69cc72b39d', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:49:00.630956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:49:00.631591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:49:00.631845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:49:00.632826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:49:00.633252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:49:00.644550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:00.644925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:00.645791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:00.646420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:00.666897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:49:00.672461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for user df60439bde7a40938de3990499a342fc and project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:49:00.685435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:49:00.687846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:49:00.740213 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-61e946fe-6132-4912-9fe9-21e504e6e41c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.454222 Jul 26 14:49:00.741197 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2804/5732] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:48:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:49:00.754171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a69a2cc-1d3c-426a-bd44-1fef49d77f37 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:00.754802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9a69a2cc-1d3c-426a-bd44-1fef49d77f37 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:00.821817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9a69a2cc-1d3c-426a-bd44-1fef49d77f37 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:00.835922 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9a69a2cc-1d3c-426a-bd44-1fef49d77f37 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1241 microversion: 2.1 time: 0.087039 Jul 26 14:49:00.852197 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2929/5733] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:00 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:01.862837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6746a1db-7c08-4e12-93ee-2c38d7777147 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:01.864122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6746a1db-7c08-4e12-93ee-2c38d7777147 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:01.871255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6746a1db-7c08-4e12-93ee-2c38d7777147 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:01.872027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6746a1db-7c08-4e12-93ee-2c38d7777147 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:01.873007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6746a1db-7c08-4e12-93ee-2c38d7777147 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:01.873609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6746a1db-7c08-4e12-93ee-2c38d7777147 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:02.054850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6746a1db-7c08-4e12-93ee-2c38d7777147 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:02.073179 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6746a1db-7c08-4e12-93ee-2c38d7777147 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1301 microversion: 2.1 time: 0.217882 Jul 26 14:49:02.073780 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2805/5734] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:01 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1301 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:03.098342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0a67f72-4e4e-416b-9d76-e1cfa9f29dd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:03.102008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0a67f72-4e4e-416b-9d76-e1cfa9f29dd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:03.109212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:03.122277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0a67f72-4e4e-416b-9d76-e1cfa9f29dd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:03.122967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0a67f72-4e4e-416b-9d76-e1cfa9f29dd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:03.127557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0a67f72-4e4e-416b-9d76-e1cfa9f29dd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:03.129101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0a67f72-4e4e-416b-9d76-e1cfa9f29dd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:03.577993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0a67f72-4e4e-416b-9d76-e1cfa9f29dd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:03.591620 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0a67f72-4e4e-416b-9d76-e1cfa9f29dd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1366 microversion: 2.1 time: 0.499308 Jul 26 14:49:03.597416 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2930/5735] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:03 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:04.621565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-780c8d67-08b1-4318-a28b-e3c7d45d76b9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:04.622185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-780c8d67-08b1-4318-a28b-e3c7d45d76b9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:04.637290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-780c8d67-08b1-4318-a28b-e3c7d45d76b9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:04.642420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-780c8d67-08b1-4318-a28b-e3c7d45d76b9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:04.646976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-780c8d67-08b1-4318-a28b-e3c7d45d76b9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:04.651035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-780c8d67-08b1-4318-a28b-e3c7d45d76b9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:05.117755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-da9165d7-e013-4ace-95f3-e762750b2b45 req-fa083f56-4911-474a-93db-e6101db1d600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b5a306-b891-483d-a413-266c1c94e576", "tag": "070c9d12-a53f-4f2c-ab48-a3d69723f172"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:05.139186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-da9165d7-e013-4ace-95f3-e762750b2b45 req-fa083f56-4911-474a-93db-e6101db1d600 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:05.140548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-da9165d7-e013-4ace-95f3-e762750b2b45 req-fa083f56-4911-474a-93db-e6101db1d600 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:05.182200 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-da9165d7-e013-4ace-95f3-e762750b2b45 req-fa083f56-4911-474a-93db-e6101db1d600 service nova] Creating event network-changed:070c9d12-a53f-4f2c-ab48-a3d69723f172 for instance f3b5a306-b891-483d-a413-266c1c94e576 on n-h2-833090-9 Jul 26 14:49:05.194355 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-da9165d7-e013-4ace-95f3-e762750b2b45 req-fa083f56-4911-474a-93db-e6101db1d600 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087439 Jul 26 14:49:05.197112 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2931/5736] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:49:05.267094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-780c8d67-08b1-4318-a28b-e3c7d45d76b9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:05.280952 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-780c8d67-08b1-4318-a28b-e3c7d45d76b9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1366 microversion: 2.1 time: 0.661684 Jul 26 14:49:05.281578 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2806/5737] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:04 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1366 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:06.306389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-34ee33a6-d8fc-44a1-94ed-a5cf66cbfc79 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:06.307113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-34ee33a6-d8fc-44a1-94ed-a5cf66cbfc79 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:06.320623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34ee33a6-d8fc-44a1-94ed-a5cf66cbfc79 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:06.321169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34ee33a6-d8fc-44a1-94ed-a5cf66cbfc79 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:06.321868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34ee33a6-d8fc-44a1-94ed-a5cf66cbfc79 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:06.322310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34ee33a6-d8fc-44a1-94ed-a5cf66cbfc79 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:06.350010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1860919555", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "d681414c-390d-41df-9df4-e5b0ca33234f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-219361403", "security_groups": []}, "os:scheduler_hints": {"different_host": ["dede0882-4384-4b70-966d-fe81c61be70c"]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:06.483430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] validate_networks() for [('d681414c-390d-41df-9df4-e5b0ca33234f', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:49:06.682841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-34ee33a6-d8fc-44a1-94ed-a5cf66cbfc79 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:06.694544 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-34ee33a6-d8fc-44a1-94ed-a5cf66cbfc79 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1366 microversion: 2.1 time: 0.392721 Jul 26 14:49:06.695394 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2932/5738] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:06 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:49:07.351314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:49:07.352217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:49:07.352522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:49:07.353190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:49:07.353587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:49:07.372919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:07.382069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:07.383066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:07.389110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:07.417230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Getting quotas for project fa53fd3479a24e56a740525e76245361. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:49:07.425638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Getting quotas for user 6ef520f8dced4624b10319dff4fb924a and project fa53fd3479a24e56a740525e76245361. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:49:07.460086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:49:07.462382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:49:07.521240 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-65d2990c-1d31-4d70-a6a6-3b185747f971 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.175385 Jul 26 14:49:07.534362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3aaef802-8788-43cd-8ab8-af9490e56675 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:07.534991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3aaef802-8788-43cd-8ab8-af9490e56675 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:07.539256 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2807/5739] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:49:06 2022] POST /compute/v2.1/servers => generated 361 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:49:07.717650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d4fd8c0f-b575-486f-bb5e-fb5237a854b4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:07.718587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d4fd8c0f-b575-486f-bb5e-fb5237a854b4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:07.728272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4fd8c0f-b575-486f-bb5e-fb5237a854b4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:07.728915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4fd8c0f-b575-486f-bb5e-fb5237a854b4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:07.730711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4fd8c0f-b575-486f-bb5e-fb5237a854b4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:07.731476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4fd8c0f-b575-486f-bb5e-fb5237a854b4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:08.080787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3aaef802-8788-43cd-8ab8-af9490e56675 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:08.090700 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3aaef802-8788-43cd-8ab8-af9490e56675 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1241 microversion: 2.1 time: 0.560781 Jul 26 14:49:08.092978 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2933/5740] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:07 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1241 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:08.257770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d4fd8c0f-b575-486f-bb5e-fb5237a854b4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:08.260231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:08.270007 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d4fd8c0f-b575-486f-bb5e-fb5237a854b4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1366 microversion: 2.1 time: 0.557126 Jul 26 14:49:08.270613 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2808/5741] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:07 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:09.119470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-75d0777a-2a48-40d4-b8eb-8f1925e09f64 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:09.120151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-75d0777a-2a48-40d4-b8eb-8f1925e09f64 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:09.146605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75d0777a-2a48-40d4-b8eb-8f1925e09f64 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:09.147215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75d0777a-2a48-40d4-b8eb-8f1925e09f64 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:09.159588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75d0777a-2a48-40d4-b8eb-8f1925e09f64 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:09.160200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75d0777a-2a48-40d4-b8eb-8f1925e09f64 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:09.302212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff02b8bc-7ac0-407d-81db-30ae36a994eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:09.302828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ff02b8bc-7ac0-407d-81db-30ae36a994eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:09.305839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:09.311024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-75d0777a-2a48-40d4-b8eb-8f1925e09f64 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:09.320064 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-75d0777a-2a48-40d4-b8eb-8f1925e09f64 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1299 microversion: 2.1 time: 0.204721 Jul 26 14:49:09.320900 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2934/5742] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:09 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:09.334904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff02b8bc-7ac0-407d-81db-30ae36a994eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:09.335361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff02b8bc-7ac0-407d-81db-30ae36a994eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:09.338980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff02b8bc-7ac0-407d-81db-30ae36a994eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:09.339657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff02b8bc-7ac0-407d-81db-30ae36a994eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:09.964872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ff02b8bc-7ac0-407d-81db-30ae36a994eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:09.981557 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff02b8bc-7ac0-407d-81db-30ae36a994eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1366 microversion: 2.1 time: 0.685196 Jul 26 14:49:09.987528 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2809/5743] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:09 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1366 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:10.017591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-09a37e88-e13a-416f-8ee4-00b4259d6baa req-0b02a7fd-7c8d-4ff7-a115-b338554ad24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b5a306-b891-483d-a413-266c1c94e576", "name": "network-vif-plugged", "status": "completed", "tag": "070c9d12-a53f-4f2c-ab48-a3d69723f172"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:10.053086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-09a37e88-e13a-416f-8ee4-00b4259d6baa req-0b02a7fd-7c8d-4ff7-a115-b338554ad24a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:10.057047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-09a37e88-e13a-416f-8ee4-00b4259d6baa req-0b02a7fd-7c8d-4ff7-a115-b338554ad24a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:10.086806 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-09a37e88-e13a-416f-8ee4-00b4259d6baa req-0b02a7fd-7c8d-4ff7-a115-b338554ad24a service nova] Creating event network-vif-plugged:070c9d12-a53f-4f2c-ab48-a3d69723f172 for instance f3b5a306-b891-483d-a413-266c1c94e576 on n-h2-833090-9 Jul 26 14:49:10.116825 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-09a37e88-e13a-416f-8ee4-00b4259d6baa req-0b02a7fd-7c8d-4ff7-a115-b338554ad24a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102694 Jul 26 14:49:10.130014 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2935/5744] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:10.346069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-58b0be34-1f1c-41f5-91fb-3c33046b71bc tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:10.347421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-58b0be34-1f1c-41f5-91fb-3c33046b71bc tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:10.355398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58b0be34-1f1c-41f5-91fb-3c33046b71bc tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:10.356186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58b0be34-1f1c-41f5-91fb-3c33046b71bc tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:10.357138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58b0be34-1f1c-41f5-91fb-3c33046b71bc tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:10.361013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58b0be34-1f1c-41f5-91fb-3c33046b71bc tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:10.525838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-58b0be34-1f1c-41f5-91fb-3c33046b71bc tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:10.534469 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-58b0be34-1f1c-41f5-91fb-3c33046b71bc tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1299 microversion: 2.1 time: 0.191862 Jul 26 14:49:10.535555 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2810/5745] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:10 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1299 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:11.009127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23fc5ace-a5dc-45e9-b21e-d13772a4b980 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:11.010457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-23fc5ace-a5dc-45e9-b21e-d13772a4b980 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:11.030258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23fc5ace-a5dc-45e9-b21e-d13772a4b980 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:11.030638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23fc5ace-a5dc-45e9-b21e-d13772a4b980 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:11.031392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23fc5ace-a5dc-45e9-b21e-d13772a4b980 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:11.032178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23fc5ace-a5dc-45e9-b21e-d13772a4b980 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:11.080952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-698ad34d-6c76-4858-b7b4-a4f6754ada2d req-310fa248-c6d6-44c0-bf90-08dd81f7fe1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5d774be-2c8a-4b5f-bfd1-a42cc919fdee", "tag": "e484bef7-763e-4a8c-81e3-8b6d16099ac7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:11.097760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-698ad34d-6c76-4858-b7b4-a4f6754ada2d req-310fa248-c6d6-44c0-bf90-08dd81f7fe1c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:11.098577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-698ad34d-6c76-4858-b7b4-a4f6754ada2d req-310fa248-c6d6-44c0-bf90-08dd81f7fe1c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:11.113042 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-698ad34d-6c76-4858-b7b4-a4f6754ada2d req-310fa248-c6d6-44c0-bf90-08dd81f7fe1c service nova] Creating event network-changed:e484bef7-763e-4a8c-81e3-8b6d16099ac7 for instance f5d774be-2c8a-4b5f-bfd1-a42cc919fdee on n-h2-833090-9 Jul 26 14:49:11.119862 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-698ad34d-6c76-4858-b7b4-a4f6754ada2d req-310fa248-c6d6-44c0-bf90-08dd81f7fe1c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044656 Jul 26 14:49:11.121083 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2811/5746] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:49:11.262982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23fc5ace-a5dc-45e9-b21e-d13772a4b980 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:11.272107 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23fc5ace-a5dc-45e9-b21e-d13772a4b980 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1366 microversion: 2.1 time: 0.272062 Jul 26 14:49:11.280722 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2936/5747] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:10 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:11.567331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5721662b-ed42-4cf7-9815-e6d6996e917e tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:11.569372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5721662b-ed42-4cf7-9815-e6d6996e917e tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:11.590141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5721662b-ed42-4cf7-9815-e6d6996e917e tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:11.590943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5721662b-ed42-4cf7-9815-e6d6996e917e tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:11.592912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5721662b-ed42-4cf7-9815-e6d6996e917e tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:11.596739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5721662b-ed42-4cf7-9815-e6d6996e917e tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:11.755466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5721662b-ed42-4cf7-9815-e6d6996e917e tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:11.767188 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5721662b-ed42-4cf7-9815-e6d6996e917e tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1299 microversion: 2.1 time: 0.213068 Jul 26 14:49:11.768415 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2812/5748] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:11 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1299 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:12.296444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-840bdb50-fb2f-4633-92e0-9dfac75d1d10 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:12.297223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-840bdb50-fb2f-4633-92e0-9dfac75d1d10 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:12.305245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-840bdb50-fb2f-4633-92e0-9dfac75d1d10 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:12.305721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-840bdb50-fb2f-4633-92e0-9dfac75d1d10 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:12.306582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-840bdb50-fb2f-4633-92e0-9dfac75d1d10 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:12.307208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-840bdb50-fb2f-4633-92e0-9dfac75d1d10 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:12.523094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-840bdb50-fb2f-4633-92e0-9dfac75d1d10 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:12.531340 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-840bdb50-fb2f-4633-92e0-9dfac75d1d10 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1554 microversion: 2.1 time: 0.239096 Jul 26 14:49:12.531904 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2937/5749] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:12 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1554 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:12.554014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5a898774-8c45-4d65-9975-abd4078257eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:12.554696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5a898774-8c45-4d65-9975-abd4078257eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:12.563417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a898774-8c45-4d65-9975-abd4078257eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:12.565066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a898774-8c45-4d65-9975-abd4078257eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:12.566385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a898774-8c45-4d65-9975-abd4078257eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:12.566990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a898774-8c45-4d65-9975-abd4078257eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:12.702819 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5a898774-8c45-4d65-9975-abd4078257eb tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152878 Jul 26 14:49:12.704008 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2813/5750] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:49:12 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:49:12.791579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d01a1ff5-aed8-493d-a65b-52bbbbe183c2 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:12.792400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d01a1ff5-aed8-493d-a65b-52bbbbe183c2 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:12.800014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d01a1ff5-aed8-493d-a65b-52bbbbe183c2 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:12.800824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d01a1ff5-aed8-493d-a65b-52bbbbe183c2 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:12.801920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d01a1ff5-aed8-493d-a65b-52bbbbe183c2 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:12.802609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d01a1ff5-aed8-493d-a65b-52bbbbe183c2 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:12.958386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d01a1ff5-aed8-493d-a65b-52bbbbe183c2 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:12.966984 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d01a1ff5-aed8-493d-a65b-52bbbbe183c2 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1299 microversion: 2.1 time: 0.179443 Jul 26 14:49:12.967891 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2938/5751] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:12 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1299 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:13.872224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-1609e207-0231-45c9-bb1c-9caa79f282ab req-ec795951-bbcd-445d-977e-1ab6909d0494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3b5a306-b891-483d-a413-266c1c94e576", "tag": "070c9d12-a53f-4f2c-ab48-a3d69723f172"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:13.881915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1609e207-0231-45c9-bb1c-9caa79f282ab req-ec795951-bbcd-445d-977e-1ab6909d0494 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:13.882365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1609e207-0231-45c9-bb1c-9caa79f282ab req-ec795951-bbcd-445d-977e-1ab6909d0494 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:13.895742 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-1609e207-0231-45c9-bb1c-9caa79f282ab req-ec795951-bbcd-445d-977e-1ab6909d0494 service nova] Creating event network-changed:070c9d12-a53f-4f2c-ab48-a3d69723f172 for instance f3b5a306-b891-483d-a413-266c1c94e576 on n-h2-833090-9 Jul 26 14:49:13.902190 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-1609e207-0231-45c9-bb1c-9caa79f282ab req-ec795951-bbcd-445d-977e-1ab6909d0494 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034572 Jul 26 14:49:13.902854 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2814/5752] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:13.990390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7e4f3774-03f6-4ba6-887c-f00ccebbd991 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:13.991699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7e4f3774-03f6-4ba6-887c-f00ccebbd991 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:13.998486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:14.000339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e4f3774-03f6-4ba6-887c-f00ccebbd991 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:14.001009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e4f3774-03f6-4ba6-887c-f00ccebbd991 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:14.002786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e4f3774-03f6-4ba6-887c-f00ccebbd991 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:14.003760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7e4f3774-03f6-4ba6-887c-f00ccebbd991 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:14.131656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7e4f3774-03f6-4ba6-887c-f00ccebbd991 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:14.146688 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7e4f3774-03f6-4ba6-887c-f00ccebbd991 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1299 microversion: 2.1 time: 0.160134 Jul 26 14:49:14.148265 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2939/5753] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:13 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:15.171345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-62aefafd-2906-4172-afe3-f21e449ac61b tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:15.172091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-62aefafd-2906-4172-afe3-f21e449ac61b tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:15.179042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62aefafd-2906-4172-afe3-f21e449ac61b tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:15.179521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62aefafd-2906-4172-afe3-f21e449ac61b tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:15.180507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62aefafd-2906-4172-afe3-f21e449ac61b tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:15.180957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-62aefafd-2906-4172-afe3-f21e449ac61b tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:15.268933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-62aefafd-2906-4172-afe3-f21e449ac61b tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:15.276797 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-62aefafd-2906-4172-afe3-f21e449ac61b tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1299 microversion: 2.1 time: 0.110553 Jul 26 14:49:15.277429 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2815/5754] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:15 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:49:16.300420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-908bd50e-8e92-4d4e-be1e-87590c8a5f17 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:16.301039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-908bd50e-8e92-4d4e-be1e-87590c8a5f17 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:16.308043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-908bd50e-8e92-4d4e-be1e-87590c8a5f17 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:16.308981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-908bd50e-8e92-4d4e-be1e-87590c8a5f17 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:16.310426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-908bd50e-8e92-4d4e-be1e-87590c8a5f17 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:16.311100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-908bd50e-8e92-4d4e-be1e-87590c8a5f17 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:16.418145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-908bd50e-8e92-4d4e-be1e-87590c8a5f17 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:16.433810 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-908bd50e-8e92-4d4e-be1e-87590c8a5f17 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1299 microversion: 2.1 time: 0.138899 Jul 26 14:49:16.434815 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2940/5755] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:16 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:17.456876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee8a299a-e762-4f29-aaf4-4bfdacb3c250 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:17.458047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ee8a299a-e762-4f29-aaf4-4bfdacb3c250 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:17.463012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:17.463806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=12 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:17.469793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee8a299a-e762-4f29-aaf4-4bfdacb3c250 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:17.470257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee8a299a-e762-4f29-aaf4-4bfdacb3c250 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:17.471698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee8a299a-e762-4f29-aaf4-4bfdacb3c250 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:17.472181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee8a299a-e762-4f29-aaf4-4bfdacb3c250 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:17.559848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ee8a299a-e762-4f29-aaf4-4bfdacb3c250 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:17.569913 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ee8a299a-e762-4f29-aaf4-4bfdacb3c250 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1299 microversion: 2.1 time: 0.117465 Jul 26 14:49:17.570514 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2816/5756] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:17 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:17.606105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e06e3023-a0ca-4ea3-a907-6a534f855175 req-6a765eb7-fe83-4a40-a080-1342d43f9ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d774be-2c8a-4b5f-bfd1-a42cc919fdee", "name": "network-vif-plugged", "status": "completed", "tag": "e484bef7-763e-4a8c-81e3-8b6d16099ac7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:17.620083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e06e3023-a0ca-4ea3-a907-6a534f855175 req-6a765eb7-fe83-4a40-a080-1342d43f9ba5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:17.620919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e06e3023-a0ca-4ea3-a907-6a534f855175 req-6a765eb7-fe83-4a40-a080-1342d43f9ba5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:17.633386 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e06e3023-a0ca-4ea3-a907-6a534f855175 req-6a765eb7-fe83-4a40-a080-1342d43f9ba5 service nova] Creating event network-vif-plugged:e484bef7-763e-4a8c-81e3-8b6d16099ac7 for instance f5d774be-2c8a-4b5f-bfd1-a42cc919fdee on n-h2-833090-9 Jul 26 14:49:17.638792 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e06e3023-a0ca-4ea3-a907-6a534f855175 req-6a765eb7-fe83-4a40-a080-1342d43f9ba5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037468 Jul 26 14:49:17.639658 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2941/5757] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:18.592502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-68c088af-c62b-4c77-a5cd-9f7ed16ba92d tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:18.593158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-68c088af-c62b-4c77-a5cd-9f7ed16ba92d tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:18.600647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68c088af-c62b-4c77-a5cd-9f7ed16ba92d tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:18.601394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68c088af-c62b-4c77-a5cd-9f7ed16ba92d tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:18.602216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68c088af-c62b-4c77-a5cd-9f7ed16ba92d tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:18.602694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68c088af-c62b-4c77-a5cd-9f7ed16ba92d tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:18.705913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-68c088af-c62b-4c77-a5cd-9f7ed16ba92d tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:18.717152 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-68c088af-c62b-4c77-a5cd-9f7ed16ba92d tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1299 microversion: 2.1 time: 0.128390 Jul 26 14:49:18.718084 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2817/5758] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:18 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:19.738987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:19.744944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7852f023-b7e0-4d95-9ae2-bccfd10339e1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:19.745664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7852f023-b7e0-4d95-9ae2-bccfd10339e1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:19.752838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7852f023-b7e0-4d95-9ae2-bccfd10339e1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:19.753304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7852f023-b7e0-4d95-9ae2-bccfd10339e1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:19.754093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7852f023-b7e0-4d95-9ae2-bccfd10339e1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:19.754545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7852f023-b7e0-4d95-9ae2-bccfd10339e1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:19.845383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7852f023-b7e0-4d95-9ae2-bccfd10339e1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:19.853477 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7852f023-b7e0-4d95-9ae2-bccfd10339e1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1472 microversion: 2.1 time: 0.115525 Jul 26 14:49:19.854047 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2942/5759] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:19 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1472 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:19.876444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-68627d13-d5c4-40ac-8a66-eba40a8f76aa tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:19.877898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-68627d13-d5c4-40ac-8a66-eba40a8f76aa tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:19.890923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68627d13-d5c4-40ac-8a66-eba40a8f76aa tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:19.891508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68627d13-d5c4-40ac-8a66-eba40a8f76aa tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:19.892368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68627d13-d5c4-40ac-8a66-eba40a8f76aa tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:19.893531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68627d13-d5c4-40ac-8a66-eba40a8f76aa tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:19.984209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-68627d13-d5c4-40ac-8a66-eba40a8f76aa tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:19.993132 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-68627d13-d5c4-40ac-8a66-eba40a8f76aa tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1472 microversion: 2.1 time: 0.120908 Jul 26 14:49:19.993646 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2818/5760] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:19 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1472 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:20.013493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-506c7c2b-0379-426a-a9f8-1ddae3e510c2 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:20.014141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-506c7c2b-0379-426a-a9f8-1ddae3e510c2 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:20.021410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-506c7c2b-0379-426a-a9f8-1ddae3e510c2 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:20.021410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-506c7c2b-0379-426a-a9f8-1ddae3e510c2 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:20.022182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-506c7c2b-0379-426a-a9f8-1ddae3e510c2 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:20.022624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-506c7c2b-0379-426a-a9f8-1ddae3e510c2 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:20.114060 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-506c7c2b-0379-426a-a9f8-1ddae3e510c2 tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1623 microversion: 2.1 time: 0.101874 Jul 26 14:49:20.114679 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2943/5761] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:20 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1623 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:20.135444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce15dd1f-7f1f-4c4e-bac3-6586b7cf8d5f tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:20.136393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce15dd1f-7f1f-4c4e-bac3-6586b7cf8d5f tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:20.143350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce15dd1f-7f1f-4c4e-bac3-6586b7cf8d5f tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:20.144015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce15dd1f-7f1f-4c4e-bac3-6586b7cf8d5f tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:20.144887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce15dd1f-7f1f-4c4e-bac3-6586b7cf8d5f tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:20.145411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce15dd1f-7f1f-4c4e-bac3-6586b7cf8d5f tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:20.292008 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce15dd1f-7f1f-4c4e-bac3-6586b7cf8d5f tempest-TestSecurityGroupsBasicOps-671294857 tempest-TestSecurityGroupsBasicOps-671294857-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1912 microversion: 2.1 time: 0.160182 Jul 26 14:49:20.292599 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2819/5762] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:20 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1912 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:20.358328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7341421e-ef4b-4d2d-9054-3e7eab6f6909 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:20.358849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7341421e-ef4b-4d2d-9054-3e7eab6f6909 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:20.365785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7341421e-ef4b-4d2d-9054-3e7eab6f6909 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:20.366250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7341421e-ef4b-4d2d-9054-3e7eab6f6909 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:20.367035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7341421e-ef4b-4d2d-9054-3e7eab6f6909 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:20.367782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7341421e-ef4b-4d2d-9054-3e7eab6f6909 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:20.395460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7341421e-ef4b-4d2d-9054-3e7eab6f6909 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:49:20.481045 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7341421e-ef4b-4d2d-9054-3e7eab6f6909 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 204 len: 0 microversion: 2.1 time: 0.126350 Jul 26 14:49:20.481837 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2944/5763] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:49:20 2022] DELETE /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:49:20.490978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-256d7f97-dffe-4d91-a99d-39e1cd231803 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:20.491893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-256d7f97-dffe-4d91-a99d-39e1cd231803 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:20.498167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-256d7f97-dffe-4d91-a99d-39e1cd231803 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:20.498665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-256d7f97-dffe-4d91-a99d-39e1cd231803 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:20.499693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-256d7f97-dffe-4d91-a99d-39e1cd231803 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:20.500200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-256d7f97-dffe-4d91-a99d-39e1cd231803 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:20.598407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-256d7f97-dffe-4d91-a99d-39e1cd231803 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:20.609591 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-256d7f97-dffe-4d91-a99d-39e1cd231803 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1478 microversion: 2.1 time: 0.122885 Jul 26 14:49:20.610594 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2820/5764] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:20 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1478 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:21.641464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ef7ffa69-af50-47a8-83c2-14b202c44e50 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:21.642170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef7ffa69-af50-47a8-83c2-14b202c44e50 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:21.650857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef7ffa69-af50-47a8-83c2-14b202c44e50 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:21.651319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef7ffa69-af50-47a8-83c2-14b202c44e50 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:21.652152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef7ffa69-af50-47a8-83c2-14b202c44e50 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:21.652606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef7ffa69-af50-47a8-83c2-14b202c44e50 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:21.753721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ef7ffa69-af50-47a8-83c2-14b202c44e50 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:21.759235 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ef7ffa69-af50-47a8-83c2-14b202c44e50 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1478 microversion: 2.1 time: 0.122081 Jul 26 14:49:21.759806 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2945/5765] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:21 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1478 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:22.579191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-0d9901db-6f95-40ea-b095-9cb23e71dc3a req-d44233f2-00dd-4ef6-941f-729678b08c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5d774be-2c8a-4b5f-bfd1-a42cc919fdee", "name": "network-vif-deleted", "tag": "e484bef7-763e-4a8c-81e3-8b6d16099ac7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:22.592757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0d9901db-6f95-40ea-b095-9cb23e71dc3a req-d44233f2-00dd-4ef6-941f-729678b08c4e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:22.593496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-0d9901db-6f95-40ea-b095-9cb23e71dc3a req-d44233f2-00dd-4ef6-941f-729678b08c4e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:22.612657 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-0d9901db-6f95-40ea-b095-9cb23e71dc3a req-d44233f2-00dd-4ef6-941f-729678b08c4e service nova] Creating event network-vif-deleted:e484bef7-763e-4a8c-81e3-8b6d16099ac7 for instance f5d774be-2c8a-4b5f-bfd1-a42cc919fdee on n-h2-833090-9 Jul 26 14:49:22.618703 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-0d9901db-6f95-40ea-b095-9cb23e71dc3a req-d44233f2-00dd-4ef6-941f-729678b08c4e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043259 Jul 26 14:49:22.620272 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2821/5766] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:22.787775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:22.788602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:22.797231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:22.797743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:22.798553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:22.799990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:22.837023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:22.837401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:22.837863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lazy-loading 'fault' on Instance uuid f5d774be-2c8a-4b5f-bfd1-a42cc919fdee {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:49:23.235472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:23.244856 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63c6f35a-f20e-491c-9500-f0e1e7a5fc1f tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 200 len: 1331 microversion: 2.1 time: 0.461875 Jul 26 14:49:23.245449 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2946/5767] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:22 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 1331 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:24.269387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-67b63b85-dc3a-4002-9c4b-be241f22819a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:24.270201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-67b63b85-dc3a-4002-9c4b-be241f22819a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: f5d774be-2c8a-4b5f-bfd1-a42cc919fdee] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:24.276948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67b63b85-dc3a-4002-9c4b-be241f22819a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:24.277391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67b63b85-dc3a-4002-9c4b-be241f22819a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:24.278176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67b63b85-dc3a-4002-9c4b-be241f22819a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:24.278620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67b63b85-dc3a-4002-9c4b-be241f22819a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:24.295094 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-67b63b85-dc3a-4002-9c4b-be241f22819a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] HTTP exception thrown: Instance f5d774be-2c8a-4b5f-bfd1-a42cc919fdee could not be found. Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-67b63b85-dc3a-4002-9c4b-be241f22819a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Request method failure captured: Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee HTTP/1.1 Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_6cMHea_Y5D3-c8qLeeZSfVbqWC7mb_n63SdtUuUF5eAuLas8zwHpFYDf-lkpiMB5gW3HxiwDuxcOhedKjfgKVmgxH53pGMHAaRqNGlOqmtUbzLobNljiWl3HqCCwKNWRqmCgUYNScr4ikMwMO4OtWjCdw9gzuKRT6NwSAr5Qoy8co Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: fa53fd3479a24e56a740525e76245361 Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-195644713 Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa53fd3479a24e56a740525e76245361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fa53fd3479a24e56a740525e76245361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fa53fd3479a24e56a740525e76245361", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa53fd3479a24e56a740525e76245361"}]}] Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestSecurityGroupsBasicOps-195644713 Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: fa53fd3479a24e56a740525e76245361 Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-195644713 Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestSecurityGroupsBasicOps-195644713-project Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6ef520f8dced4624b10319dff4fb924a Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestSecurityGroupsBasicOps-195644713-project Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance f5d774be-2c8a-4b5f-bfd1-a42cc919fdee could not be found. Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'f5d774be-2c8a-4b5f-bfd1-a42cc919fdee'} Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5d774be-2c8a-4b5f-bfd1-a42cc919fdee could not be found. Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5d774be-2c8a-4b5f-bfd1-a42cc919fdee could not be found. Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:49:24.296861 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:49:24.301677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:49:24.301677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:49:24.301677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:49:24.301677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:49:24.301677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:49:24.301677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5d774be-2c8a-4b5f-bfd1-a42cc919fdee could not be found. Jul 26 14:49:24.301677 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:49:24.301677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-67b63b85-dc3a-4002-9c4b-be241f22819a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Returning 404 to user: Instance f5d774be-2c8a-4b5f-bfd1-a42cc919fdee could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:49:24.301677 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-67b63b85-dc3a-4002-9c4b-be241f22819a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee" status: 404 len: 111 microversion: 2.1 time: 0.034220 Jul 26 14:49:24.301677 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2822/5768] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:24 2022] GET /compute/v2.1/servers/f5d774be-2c8a-4b5f-bfd1-a42cc919fdee => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:49:29.109963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cb4b824c-9a59-463f-8696-fc3e0f47e339 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:29.113109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cb4b824c-9a59-463f-8696-fc3e0f47e339 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:29.119679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4b824c-9a59-463f-8696-fc3e0f47e339 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:29.120609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4b824c-9a59-463f-8696-fc3e0f47e339 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:29.120979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4b824c-9a59-463f-8696-fc3e0f47e339 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:29.121430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4b824c-9a59-463f-8696-fc3e0f47e339 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:29.157554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cb4b824c-9a59-463f-8696-fc3e0f47e339 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:49:29.259939 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cb4b824c-9a59-463f-8696-fc3e0f47e339 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 204 len: 0 microversion: 2.1 time: 0.154484 Jul 26 14:49:29.260760 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2823/5769] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:49:29 2022] DELETE /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:49:29.270589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a5e8b47f-4931-484c-815d-9012f8e37f78 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:29.271584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a5e8b47f-4931-484c-815d-9012f8e37f78 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:29.279700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5e8b47f-4931-484c-815d-9012f8e37f78 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:29.280295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5e8b47f-4931-484c-815d-9012f8e37f78 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:29.281206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5e8b47f-4931-484c-815d-9012f8e37f78 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:29.281924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a5e8b47f-4931-484c-815d-9012f8e37f78 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:29.305218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-588b6c12-9778-4fc6-8a53-c7433021de64 req-2e413e4d-0b2c-49ff-a966-349b32d8dd39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dede0882-4384-4b70-966d-fe81c61be70c", "tag": "891f5306-1e24-4a8c-93bb-a060303aabc4"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:29.318358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-588b6c12-9778-4fc6-8a53-c7433021de64 req-2e413e4d-0b2c-49ff-a966-349b32d8dd39 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:29.319224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-588b6c12-9778-4fc6-8a53-c7433021de64 req-2e413e4d-0b2c-49ff-a966-349b32d8dd39 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:29.339930 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-588b6c12-9778-4fc6-8a53-c7433021de64 req-2e413e4d-0b2c-49ff-a966-349b32d8dd39 service nova] Creating event network-changed:891f5306-1e24-4a8c-93bb-a060303aabc4 for instance dede0882-4384-4b70-966d-fe81c61be70c on n-h1-833090-9 Jul 26 14:49:29.346878 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-588b6c12-9778-4fc6-8a53-c7433021de64 req-2e413e4d-0b2c-49ff-a966-349b32d8dd39 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242085 Jul 26 14:49:29.348108 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2947/5770] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:29.494845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a5e8b47f-4931-484c-815d-9012f8e37f78 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:29.511242 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a5e8b47f-4931-484c-815d-9012f8e37f78 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1767 microversion: 2.1 time: 0.244465 Jul 26 14:49:29.514713 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2824/5771] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:29 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1767 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:49:30.536269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f3009f3d-a0f4-417f-bb18-b0f8e12520b3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:30.537057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f3009f3d-a0f4-417f-bb18-b0f8e12520b3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:30.545713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f3009f3d-a0f4-417f-bb18-b0f8e12520b3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:30.546175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f3009f3d-a0f4-417f-bb18-b0f8e12520b3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:30.546957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f3009f3d-a0f4-417f-bb18-b0f8e12520b3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:30.547399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f3009f3d-a0f4-417f-bb18-b0f8e12520b3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:30.553224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:31.154322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f3009f3d-a0f4-417f-bb18-b0f8e12520b3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef520f8dced4624b10319dff4fb924a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa53fd3479a24e56a740525e76245361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:31.177325 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f3009f3d-a0f4-417f-bb18-b0f8e12520b3 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 200 len: 1767 microversion: 2.1 time: 0.646658 Jul 26 14:49:31.178488 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2948/5772] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:30 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 1767 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:31.364360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f2835570-fa5c-457b-9383-2988d54013a4 req-19359b88-1515-4f71-aae6-5774df509b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dede0882-4384-4b70-966d-fe81c61be70c", "name": "network-vif-deleted", "tag": "891f5306-1e24-4a8c-93bb-a060303aabc4"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:31.396827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f2835570-fa5c-457b-9383-2988d54013a4 req-19359b88-1515-4f71-aae6-5774df509b85 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:31.406420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f2835570-fa5c-457b-9383-2988d54013a4 req-19359b88-1515-4f71-aae6-5774df509b85 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:31.429489 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f2835570-fa5c-457b-9383-2988d54013a4 req-19359b88-1515-4f71-aae6-5774df509b85 service nova] Creating event network-vif-deleted:891f5306-1e24-4a8c-93bb-a060303aabc4 for instance dede0882-4384-4b70-966d-fe81c61be70c on n-h1-833090-9 Jul 26 14:49:31.439134 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f2835570-fa5c-457b-9383-2988d54013a4 req-19359b88-1515-4f71-aae6-5774df509b85 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078806 Jul 26 14:49:31.441679 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2825/5773] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:32.200193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae3112f2-e59c-4751-972f-a0a085b9c8b1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:32.200819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ae3112f2-e59c-4751-972f-a0a085b9c8b1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] [instance: dede0882-4384-4b70-966d-fe81c61be70c] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:32.208931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae3112f2-e59c-4751-972f-a0a085b9c8b1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:32.209439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae3112f2-e59c-4751-972f-a0a085b9c8b1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:32.210509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae3112f2-e59c-4751-972f-a0a085b9c8b1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:32.211003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae3112f2-e59c-4751-972f-a0a085b9c8b1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:32.227063 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-ae3112f2-e59c-4751-972f-a0a085b9c8b1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] HTTP exception thrown: Instance dede0882-4384-4b70-966d-fe81c61be70c could not be found. Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae3112f2-e59c-4751-972f-a0a085b9c8b1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Request method failure captured: Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c HTTP/1.1 Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_6cMHea_Y5D3-c8qLeeZSfVbqWC7mb_n63SdtUuUF5eAuLas8zwHpFYDf-lkpiMB5gW3HxiwDuxcOhedKjfgKVmgxH53pGMHAaRqNGlOqmtUbzLobNljiWl3HqCCwKNWRqmCgUYNScr4ikMwMO4OtWjCdw9gzuKRT6NwSAr5Qoy8co Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: fa53fd3479a24e56a740525e76245361 Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-195644713 Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa53fd3479a24e56a740525e76245361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fa53fd3479a24e56a740525e76245361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fa53fd3479a24e56a740525e76245361", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa53fd3479a24e56a740525e76245361"}]}] Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestSecurityGroupsBasicOps-195644713 Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: fa53fd3479a24e56a740525e76245361 Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-195644713 Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestSecurityGroupsBasicOps-195644713-project Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6ef520f8dced4624b10319dff4fb924a Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestSecurityGroupsBasicOps-195644713-project Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance dede0882-4384-4b70-966d-fe81c61be70c could not be found. Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'dede0882-4384-4b70-966d-fe81c61be70c'} Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dede0882-4384-4b70-966d-fe81c61be70c could not be found. Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dede0882-4384-4b70-966d-fe81c61be70c could not be found. Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:49:32.228774 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:49:32.235470 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:49:32.235470 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:49:32.235470 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:49:32.235470 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:49:32.235470 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:49:32.235470 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dede0882-4384-4b70-966d-fe81c61be70c could not be found. Jul 26 14:49:32.235470 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:49:32.235470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae3112f2-e59c-4751-972f-a0a085b9c8b1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Returning 404 to user: Instance dede0882-4384-4b70-966d-fe81c61be70c could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:49:32.235470 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ae3112f2-e59c-4751-972f-a0a085b9c8b1 tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c" status: 404 len: 111 microversion: 2.1 time: 0.034155 Jul 26 14:49:32.235470 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2949/5774] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:32 2022] GET /compute/v2.1/servers/dede0882-4384-4b70-966d-fe81c61be70c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:49:36.414752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c2f70548-11df-4b96-bcea-8144aa4de60a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] Calling method '.version_select at 0x7f8786cde670>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:36.457406 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c2f70548-11df-4b96-bcea-8144aa4de60a tempest-TestSecurityGroupsBasicOps-195644713 tempest-TestSecurityGroupsBasicOps-195644713-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-219361403" status: 202 len: 0 microversion: 2.1 time: 0.049120 Jul 26 14:49:36.458419 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2826/5775] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:49:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-219361403 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:49:54.593011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1579572722", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "35e7d3e4-306a-4dc6-b55e-a2785acd8bde", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e976b6cc-dfb4-45b5-af81-629f1adeef76"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:54.604807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:54.606531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:54.667426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] validate_networks() for [('e976b6cc-dfb4-45b5-af81-629f1adeef76', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:49:55.153780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:49:55.154925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:49:55.155582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:49:55.156486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:49:55.157212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:49:55.174749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:55.175797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:55.176965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:55.178363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:55.206084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:49:55.213493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for user ac9553617f2440a68e33b82650206cae and project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:49:55.299327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:49:55.301608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='35e7d3e4-306a-4dc6-b55e-a2785acd8bde',volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:49:55.600206 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9bb42dab-2c22-42b7-acbf-6396111093f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.010776 Jul 26 14:49:55.603316 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2950/5776] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:49:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:49:55.613296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:55.617359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:55.623091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0481f0dd-d444-4451-92bd-0cebc4c71d87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:55.624357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0481f0dd-d444-4451-92bd-0cebc4c71d87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:55.712514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0481f0dd-d444-4451-92bd-0cebc4c71d87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:55.722921 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0481f0dd-d444-4451-92bd-0cebc4c71d87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1057 microversion: 2.1 time: 0.112399 Jul 26 14:49:55.724511 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2827/5777] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:55 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1057 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:56.745592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e6e5e5d7-773a-4757-b36f-9f0638ceae8f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:56.746206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e6e5e5d7-773a-4757-b36f-9f0638ceae8f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:56.753153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6e5e5d7-773a-4757-b36f-9f0638ceae8f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:56.753841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6e5e5d7-773a-4757-b36f-9f0638ceae8f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:56.754646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6e5e5d7-773a-4757-b36f-9f0638ceae8f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:56.755094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e6e5e5d7-773a-4757-b36f-9f0638ceae8f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:56.831264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e6e5e5d7-773a-4757-b36f-9f0638ceae8f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:56.842069 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e6e5e5d7-773a-4757-b36f-9f0638ceae8f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1155 microversion: 2.1 time: 0.101592 Jul 26 14:49:56.844955 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2951/5778] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:56 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1155 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:57.312328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c5aaf77e-5d1f-46fe-896d-ab3b93d926e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:57.312843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c5aaf77e-5d1f-46fe-896d-ab3b93d926e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:57.328691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5aaf77e-5d1f-46fe-896d-ab3b93d926e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:57.329278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5aaf77e-5d1f-46fe-896d-ab3b93d926e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:57.330201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5aaf77e-5d1f-46fe-896d-ab3b93d926e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:57.330650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c5aaf77e-5d1f-46fe-896d-ab3b93d926e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:57.387558 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c5aaf77e-5d1f-46fe-896d-ab3b93d926e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576/ips" status: 200 len: 147 microversion: 2.1 time: 0.082745 Jul 26 14:49:57.388559 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2828/5779] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:49:57 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576/ips => generated 147 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:57.401937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0856fa7-aaaf-42d8-8cdd-86de35c840c2 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94f04608-37b8-4700-a3ea-4fb02485732c"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:57.405931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d0856fa7-aaaf-42d8-8cdd-86de35c840c2 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:57.420104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0856fa7-aaaf-42d8-8cdd-86de35c840c2 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:57.420669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0856fa7-aaaf-42d8-8cdd-86de35c840c2 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:57.421689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0856fa7-aaaf-42d8-8cdd-86de35c840c2 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:57.422339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d0856fa7-aaaf-42d8-8cdd-86de35c840c2 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:57.538683 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d0856fa7-aaaf-42d8-8cdd-86de35c840c2 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Invalid volume: volume 94f04608-37b8-4700-a3ea-4fb02485732c is already attached to instances: 4cab1cb2-39b4-475e-aa98-74de17b0ec99 Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0856fa7-aaaf-42d8-8cdd-86de35c840c2 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576/os-volume_attachments HTTP/1.1 Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 74 Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: {"volumeAttachment": {"volumeId": "94f04608-37b8-4700-a3ea-4fb02485732c"}} Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: exception: Invalid volume: volume 94f04608-37b8-4700-a3ea-4fb02485732c is already attached to instances: 4cab1cb2-39b4-475e-aa98-74de17b0ec99 Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'server_id': 'f3b5a306-b891-483d-a413-266c1c94e576', 'body': {'volumeAttachment': {'volumeId': '94f04608-37b8-4700-a3ea-4fb02485732c'}}} Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 94f04608-37b8-4700-a3ea-4fb02485732c is already attached to instances: 4cab1cb2-39b4-475e-aa98-74de17b0ec99 Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:49:57.542013 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 94f04608-37b8-4700-a3ea-4fb02485732c is already attached to instances: 4cab1cb2-39b4-475e-aa98-74de17b0ec99 Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 94f04608-37b8-4700-a3ea-4fb02485732c is already attached to instances: 4cab1cb2-39b4-475e-aa98-74de17b0ec99 Jul 26 14:49:57.546771 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:49:57.550098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0856fa7-aaaf-42d8-8cdd-86de35c840c2 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 400 to user: Invalid volume: volume 94f04608-37b8-4700-a3ea-4fb02485732c is already attached to instances: 4cab1cb2-39b4-475e-aa98-74de17b0ec99 {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:49:57.550098 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d0856fa7-aaaf-42d8-8cdd-86de35c840c2 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153105 Jul 26 14:49:57.551860 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2952/5780] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:49:57 2022] POST /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576/os-volume_attachments => generated 174 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:49:57.573959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-81b9ef2f-71c1-4d0d-b77c-6a581473a1dd tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:57.574471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-81b9ef2f-71c1-4d0d-b77c-6a581473a1dd tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:57.593236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81b9ef2f-71c1-4d0d-b77c-6a581473a1dd tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:57.593716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81b9ef2f-71c1-4d0d-b77c-6a581473a1dd tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:57.594535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81b9ef2f-71c1-4d0d-b77c-6a581473a1dd tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:57.594969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-81b9ef2f-71c1-4d0d-b77c-6a581473a1dd tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:57.636457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-81b9ef2f-71c1-4d0d-b77c-6a581473a1dd tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:49:57.802124 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-81b9ef2f-71c1-4d0d-b77c-6a581473a1dd tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 204 len: 0 microversion: 2.1 time: 0.234984 Jul 26 14:49:57.803479 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2829/5781] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:49:57 2022] DELETE /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:49:57.813440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f9bcafae-e0be-4891-ae79-5dc004e7c0da tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:57.814079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f9bcafae-e0be-4891-ae79-5dc004e7c0da tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:57.835554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9bcafae-e0be-4891-ae79-5dc004e7c0da tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:57.836580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9bcafae-e0be-4891-ae79-5dc004e7c0da tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:57.837606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9bcafae-e0be-4891-ae79-5dc004e7c0da tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:57.838237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f9bcafae-e0be-4891-ae79-5dc004e7c0da tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:57.867764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-94cb1ca5-a21c-468d-8369-d667902bbbe0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:57.868538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-94cb1ca5-a21c-468d-8369-d667902bbbe0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:57.885709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94cb1ca5-a21c-468d-8369-d667902bbbe0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:57.889090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94cb1ca5-a21c-468d-8369-d667902bbbe0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:57.890402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94cb1ca5-a21c-468d-8369-d667902bbbe0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:57.893163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94cb1ca5-a21c-468d-8369-d667902bbbe0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:58.174478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f9bcafae-e0be-4891-ae79-5dc004e7c0da tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:58.188564 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f9bcafae-e0be-4891-ae79-5dc004e7c0da tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1678 microversion: 2.1 time: 0.380439 Jul 26 14:49:58.194210 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2953/5782] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:57 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1678 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:58.343796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-94cb1ca5-a21c-468d-8369-d667902bbbe0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:58.356664 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-94cb1ca5-a21c-468d-8369-d667902bbbe0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1215 microversion: 2.1 time: 0.497454 Jul 26 14:49:58.360317 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2830/5783] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:57 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1215 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:49:59.217239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f1b032fd-cb0f-427d-8ff4-d57614129587 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:59.219222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f1b032fd-cb0f-427d-8ff4-d57614129587 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:59.234167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1b032fd-cb0f-427d-8ff4-d57614129587 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:59.238947 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1b032fd-cb0f-427d-8ff4-d57614129587 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:59.242816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1b032fd-cb0f-427d-8ff4-d57614129587 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:59.245104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1b032fd-cb0f-427d-8ff4-d57614129587 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:59.566037 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-08edc032-85be-4f65-bffe-b9aae511e1d6 req-aa8df2da-28cb-4087-991b-f5edcd5e46e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b59970-6681-4940-9d64-41b45bb7caa8", "tag": "eff7c898-f793-4a04-a927-f33eca7f97fd"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:49:59.582047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-08edc032-85be-4f65-bffe-b9aae511e1d6 req-aa8df2da-28cb-4087-991b-f5edcd5e46e8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:59.582942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-08edc032-85be-4f65-bffe-b9aae511e1d6 req-aa8df2da-28cb-4087-991b-f5edcd5e46e8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:59.602541 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-08edc032-85be-4f65-bffe-b9aae511e1d6 req-aa8df2da-28cb-4087-991b-f5edcd5e46e8 service nova] Creating event network-changed:eff7c898-f793-4a04-a927-f33eca7f97fd for instance 58b59970-6681-4940-9d64-41b45bb7caa8 on n-h1-833090-9 Jul 26 14:49:59.609733 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-08edc032-85be-4f65-bffe-b9aae511e1d6 req-aa8df2da-28cb-4087-991b-f5edcd5e46e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490863 Jul 26 14:49:59.612950 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2954/5784] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:59.621124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3bf17f6b-01c3-4787-aa97-eb54686bab22 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:59.624168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3bf17f6b-01c3-4787-aa97-eb54686bab22 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:49:59.633739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3bf17f6b-01c3-4787-aa97-eb54686bab22 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:59.634580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3bf17f6b-01c3-4787-aa97-eb54686bab22 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:59.635591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3bf17f6b-01c3-4787-aa97-eb54686bab22 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:59.636247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3bf17f6b-01c3-4787-aa97-eb54686bab22 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:59.773742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f1b032fd-cb0f-427d-8ff4-d57614129587 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:49:59.792329 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f1b032fd-cb0f-427d-8ff4-d57614129587 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1678 microversion: 2.1 time: 0.579085 Jul 26 14:49:59.794538 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2831/5785] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:59 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1678 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:00.111275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3bf17f6b-01c3-4787-aa97-eb54686bab22 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:00.141659 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3bf17f6b-01c3-4787-aa97-eb54686bab22 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1215 microversion: 2.1 time: 0.526814 Jul 26 14:50:00.143810 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2955/5786] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:49:59 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1215 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:00.819202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cb4269d3-9ef3-43bd-a583-309651b1a304 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:00.820927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cb4269d3-9ef3-43bd-a583-309651b1a304 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:00.828899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4269d3-9ef3-43bd-a583-309651b1a304 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:00.830340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4269d3-9ef3-43bd-a583-309651b1a304 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:00.831071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4269d3-9ef3-43bd-a583-309651b1a304 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:00.831803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4269d3-9ef3-43bd-a583-309651b1a304 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:01.167394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f2fc0820-11bb-4ba6-b207-871e8bf32b85 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:01.168538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f2fc0820-11bb-4ba6-b207-871e8bf32b85 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:01.176263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2fc0820-11bb-4ba6-b207-871e8bf32b85 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:01.178975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2fc0820-11bb-4ba6-b207-871e8bf32b85 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:01.180001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2fc0820-11bb-4ba6-b207-871e8bf32b85 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:01.180448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f2fc0820-11bb-4ba6-b207-871e8bf32b85 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:01.386770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb4269d3-9ef3-43bd-a583-309651b1a304 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:01.397482 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cb4269d3-9ef3-43bd-a583-309651b1a304 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1678 microversion: 2.1 time: 0.582037 Jul 26 14:50:01.398738 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2832/5787] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:00 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1678 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:01.639421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f2fc0820-11bb-4ba6-b207-871e8bf32b85 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:01.659484 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f2fc0820-11bb-4ba6-b207-871e8bf32b85 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1215 microversion: 2.1 time: 0.496212 Jul 26 14:50:01.675199 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2956/5788] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:01 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1215 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:02.260306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2beb4a40-94eb-4c5a-94eb-5a4a852c3f4d req-01a05f85-6d2b-4996-9052-9c5405d76b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3b5a306-b891-483d-a413-266c1c94e576", "name": "network-vif-deleted", "tag": "070c9d12-a53f-4f2c-ab48-a3d69723f172"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:02.282426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2beb4a40-94eb-4c5a-94eb-5a4a852c3f4d req-01a05f85-6d2b-4996-9052-9c5405d76b2c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:02.283270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2beb4a40-94eb-4c5a-94eb-5a4a852c3f4d req-01a05f85-6d2b-4996-9052-9c5405d76b2c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:02.306594 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2beb4a40-94eb-4c5a-94eb-5a4a852c3f4d req-01a05f85-6d2b-4996-9052-9c5405d76b2c service nova] Creating event network-vif-deleted:070c9d12-a53f-4f2c-ab48-a3d69723f172 for instance f3b5a306-b891-483d-a413-266c1c94e576 on n-h2-833090-9 Jul 26 14:50:02.320818 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2beb4a40-94eb-4c5a-94eb-5a4a852c3f4d req-01a05f85-6d2b-4996-9052-9c5405d76b2c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061839 Jul 26 14:50:02.322289 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2833/5789] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:02.421277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:02.421918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:02.451302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:02.451756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:02.452603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:02.453340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:02.540088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:02.540993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:02.541996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lazy-loading 'fault' on Instance uuid f3b5a306-b891-483d-a413-266c1c94e576 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:50:02.640355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:02.670228 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-33b1df47-8382-4658-a3df-ea7bec734793 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 200 len: 1331 microversion: 2.1 time: 0.255049 Jul 26 14:50:02.671332 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2957/5790] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:02 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 1331 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:02.705655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0eb5a864-9da9-4f45-a2fb-6f232c124fb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:02.706724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0eb5a864-9da9-4f45-a2fb-6f232c124fb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:02.714334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0eb5a864-9da9-4f45-a2fb-6f232c124fb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:02.715166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0eb5a864-9da9-4f45-a2fb-6f232c124fb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:02.716325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0eb5a864-9da9-4f45-a2fb-6f232c124fb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:02.717016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0eb5a864-9da9-4f45-a2fb-6f232c124fb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:03.027108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0eb5a864-9da9-4f45-a2fb-6f232c124fb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:03.060665 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0eb5a864-9da9-4f45-a2fb-6f232c124fb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1215 microversion: 2.1 time: 0.366207 Jul 26 14:50:03.061552 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2834/5791] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:02 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1215 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:03.697433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9a70b20-19e9-4fe8-bc00-d18f62ad37e4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:03.698765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a9a70b20-19e9-4fe8-bc00-d18f62ad37e4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:03.711747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9a70b20-19e9-4fe8-bc00-d18f62ad37e4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:03.711857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9a70b20-19e9-4fe8-bc00-d18f62ad37e4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:03.716391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9a70b20-19e9-4fe8-bc00-d18f62ad37e4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:03.718501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9a70b20-19e9-4fe8-bc00-d18f62ad37e4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:03.742924 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a9a70b20-19e9-4fe8-bc00-d18f62ad37e4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9a70b20-19e9-4fe8-bc00-d18f62ad37e4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 HTTP/1.1 Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'f3b5a306-b891-483d-a413-266c1c94e576'} Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:50:03.744893 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:50:03.749959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:50:03.749959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:50:03.749959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:50:03.749959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:50:03.749959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:50:03.749959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:50:03.749959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:50:03.752179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9a70b20-19e9-4fe8-bc00-d18f62ad37e4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:50:03.757981 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a9a70b20-19e9-4fe8-bc00-d18f62ad37e4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 404 len: 111 microversion: 2.1 time: 0.067693 Jul 26 14:50:03.758980 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2958/5792] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:03 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:50:03.772443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6da7eed2-56e0-4d25-a931-cc745fbf4626 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '.version_select at 0x7f8787610700>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:03.807834 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6da7eed2-56e0-4d25-a931-cc745fbf4626 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-872493025" status: 202 len: 0 microversion: 2.1 time: 0.043854 Jul 26 14:50:03.808999 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2835/5793] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Jul 26 14:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-872493025 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:50:04.106071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-064a90e4-4908-4d5e-9d05-1cec7ab143cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:04.107083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-064a90e4-4908-4d5e-9d05-1cec7ab143cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:04.116324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-064a90e4-4908-4d5e-9d05-1cec7ab143cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:04.117068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-064a90e4-4908-4d5e-9d05-1cec7ab143cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:04.118033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-064a90e4-4908-4d5e-9d05-1cec7ab143cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:04.118827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-064a90e4-4908-4d5e-9d05-1cec7ab143cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:04.342447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-064a90e4-4908-4d5e-9d05-1cec7ab143cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:04.355159 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-064a90e4-4908-4d5e-9d05-1cec7ab143cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1203 microversion: 2.1 time: 0.254115 Jul 26 14:50:04.355821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2959/5794] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:04 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1203 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:04.743473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-00e45bac-201e-4bb2-9875-1e4c02e38d71 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:04.744144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-00e45bac-201e-4bb2-9875-1e4c02e38d71 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:04.751524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00e45bac-201e-4bb2-9875-1e4c02e38d71 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:04.752751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00e45bac-201e-4bb2-9875-1e4c02e38d71 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:04.753627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00e45bac-201e-4bb2-9875-1e4c02e38d71 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:04.754138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00e45bac-201e-4bb2-9875-1e4c02e38d71 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:04.857784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-00e45bac-201e-4bb2-9875-1e4c02e38d71 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lazy-loading 'services' on Instance uuid 4cab1cb2-39b4-475e-aa98-74de17b0ec99 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:50:04.936343 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-00e45bac-201e-4bb2-9875-1e4c02e38d71 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments/94f04608-37b8-4700-a3ea-4fb02485732c" status: 202 len: 0 microversion: 2.1 time: 0.196386 Jul 26 14:50:04.941387 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2836/5795] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:50:04 2022] DELETE /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments/94f04608-37b8-4700-a3ea-4fb02485732c => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:50:04.947434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7742ed67-d842-4b47-9ffb-873c38b49796 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:04.950480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7742ed67-d842-4b47-9ffb-873c38b49796 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:04.959222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7742ed67-d842-4b47-9ffb-873c38b49796 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:04.959701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7742ed67-d842-4b47-9ffb-873c38b49796 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:04.960553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7742ed67-d842-4b47-9ffb-873c38b49796 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:04.961457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7742ed67-d842-4b47-9ffb-873c38b49796 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:04.995778 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7742ed67-d842-4b47-9ffb-873c38b49796 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052726 Jul 26 14:50:04.996803 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2960/5796] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:50:04 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:05.380070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-95ce1088-e6cf-4d9d-84c7-64992e11a804 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:05.380833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-95ce1088-e6cf-4d9d-84c7-64992e11a804 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:05.388079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95ce1088-e6cf-4d9d-84c7-64992e11a804 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:05.388549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95ce1088-e6cf-4d9d-84c7-64992e11a804 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:05.389346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95ce1088-e6cf-4d9d-84c7-64992e11a804 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:05.389792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95ce1088-e6cf-4d9d-84c7-64992e11a804 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:05.540846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-95ce1088-e6cf-4d9d-84c7-64992e11a804 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:05.552218 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-95ce1088-e6cf-4d9d-84c7-64992e11a804 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1203 microversion: 2.1 time: 0.178172 Jul 26 14:50:05.552895 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2837/5797] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:05 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:06.009573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-39e0a30c-3a54-4020-97a2-87467668e63f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:06.013250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-39e0a30c-3a54-4020-97a2-87467668e63f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:06.015448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:06.016702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:06.024787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39e0a30c-3a54-4020-97a2-87467668e63f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:06.025318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39e0a30c-3a54-4020-97a2-87467668e63f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:06.026216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39e0a30c-3a54-4020-97a2-87467668e63f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:06.026759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39e0a30c-3a54-4020-97a2-87467668e63f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:06.060731 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-39e0a30c-3a54-4020-97a2-87467668e63f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055381 Jul 26 14:50:06.061671 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2961/5798] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:50:06 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:06.574301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c503a0dc-0ee3-4c8d-a03a-bfc69a3f341e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:06.574940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c503a0dc-0ee3-4c8d-a03a-bfc69a3f341e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:06.577041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:06.584837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c503a0dc-0ee3-4c8d-a03a-bfc69a3f341e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:06.585297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c503a0dc-0ee3-4c8d-a03a-bfc69a3f341e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:06.586172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c503a0dc-0ee3-4c8d-a03a-bfc69a3f341e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:06.586615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c503a0dc-0ee3-4c8d-a03a-bfc69a3f341e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:06.730828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c503a0dc-0ee3-4c8d-a03a-bfc69a3f341e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:06.739261 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c503a0dc-0ee3-4c8d-a03a-bfc69a3f341e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1203 microversion: 2.1 time: 0.169677 Jul 26 14:50:06.739858 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2838/5799] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:06 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:07.073970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db801556-390b-4832-9af9-24ed6df2e0c5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:07.076300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-db801556-390b-4832-9af9-24ed6df2e0c5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:07.085147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db801556-390b-4832-9af9-24ed6df2e0c5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:07.085608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db801556-390b-4832-9af9-24ed6df2e0c5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:07.086426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db801556-390b-4832-9af9-24ed6df2e0c5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:07.086868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db801556-390b-4832-9af9-24ed6df2e0c5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:07.148775 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db801556-390b-4832-9af9-24ed6df2e0c5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078752 Jul 26 14:50:07.149660 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2962/5800] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:50:07 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:07.761293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d361171-b78b-4286-a019-75ec24105200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:07.762041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d361171-b78b-4286-a019-75ec24105200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:07.770793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d361171-b78b-4286-a019-75ec24105200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:07.771884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d361171-b78b-4286-a019-75ec24105200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:07.772365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d361171-b78b-4286-a019-75ec24105200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:07.772909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d361171-b78b-4286-a019-75ec24105200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:07.914131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0d361171-b78b-4286-a019-75ec24105200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:07.922739 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d361171-b78b-4286-a019-75ec24105200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1203 microversion: 2.1 time: 0.165517 Jul 26 14:50:07.923332 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2839/5801] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:07 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:08.163531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-303ad158-2f97-45c3-8ebc-7a35101ef50f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:08.165958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-303ad158-2f97-45c3-8ebc-7a35101ef50f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:08.172699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-303ad158-2f97-45c3-8ebc-7a35101ef50f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:08.173154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-303ad158-2f97-45c3-8ebc-7a35101ef50f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:08.174886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-303ad158-2f97-45c3-8ebc-7a35101ef50f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:08.175331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-303ad158-2f97-45c3-8ebc-7a35101ef50f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:08.210746 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-303ad158-2f97-45c3-8ebc-7a35101ef50f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052810 Jul 26 14:50:08.216127 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2963/5802] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:50:08 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:08.944268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d2fe3a69-9a29-4be3-9556-27dde0d3658a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:08.944892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d2fe3a69-9a29-4be3-9556-27dde0d3658a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:08.952493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2fe3a69-9a29-4be3-9556-27dde0d3658a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:08.952951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2fe3a69-9a29-4be3-9556-27dde0d3658a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:08.953742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2fe3a69-9a29-4be3-9556-27dde0d3658a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:08.954188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2fe3a69-9a29-4be3-9556-27dde0d3658a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:09.105645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d2fe3a69-9a29-4be3-9556-27dde0d3658a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:09.115444 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d2fe3a69-9a29-4be3-9556-27dde0d3658a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1203 microversion: 2.1 time: 0.175083 Jul 26 14:50:09.116213 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2840/5803] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:08 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:09.224604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-148e1822-226b-46d8-9057-6181c4c7eb09 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:09.226940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-148e1822-226b-46d8-9057-6181c4c7eb09 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:09.234366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-148e1822-226b-46d8-9057-6181c4c7eb09 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:09.235055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-148e1822-226b-46d8-9057-6181c4c7eb09 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:09.237975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-148e1822-226b-46d8-9057-6181c4c7eb09 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:09.241472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-148e1822-226b-46d8-9057-6181c4c7eb09 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:09.280440 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-148e1822-226b-46d8-9057-6181c4c7eb09 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061382 Jul 26 14:50:09.286252 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2964/5804] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:50:09 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:10.137584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-423f777c-13fc-4ad9-88f5-1312a05aefcb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:10.138212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-423f777c-13fc-4ad9-88f5-1312a05aefcb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:10.146526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-423f777c-13fc-4ad9-88f5-1312a05aefcb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:10.147069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-423f777c-13fc-4ad9-88f5-1312a05aefcb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:10.147880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-423f777c-13fc-4ad9-88f5-1312a05aefcb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:10.148451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-423f777c-13fc-4ad9-88f5-1312a05aefcb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:10.294568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-423f777c-13fc-4ad9-88f5-1312a05aefcb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:10.295480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0500a7be-484d-4cc0-b30d-b6c73730e3a4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:10.299029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0500a7be-484d-4cc0-b30d-b6c73730e3a4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:10.305814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0500a7be-484d-4cc0-b30d-b6c73730e3a4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:10.306682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0500a7be-484d-4cc0-b30d-b6c73730e3a4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:10.306952 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-423f777c-13fc-4ad9-88f5-1312a05aefcb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1203 microversion: 2.1 time: 0.173229 Jul 26 14:50:10.307898 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2841/5805] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:10 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1203 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:10.308218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0500a7be-484d-4cc0-b30d-b6c73730e3a4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:10.308760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0500a7be-484d-4cc0-b30d-b6c73730e3a4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:10.342276 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0500a7be-484d-4cc0-b30d-b6c73730e3a4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052119 Jul 26 14:50:10.342970 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2965/5806] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:50:10 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 14:50:10.411852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5f76a80a-7c07-49ef-a498-ba6510f73690 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:10.412381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5f76a80a-7c07-49ef-a498-ba6510f73690 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:10.418952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f76a80a-7c07-49ef-a498-ba6510f73690 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:10.419413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f76a80a-7c07-49ef-a498-ba6510f73690 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:10.420226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f76a80a-7c07-49ef-a498-ba6510f73690 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:10.420674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5f76a80a-7c07-49ef-a498-ba6510f73690 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:10.461334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5f76a80a-7c07-49ef-a498-ba6510f73690 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:50:10.511172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:10.545533 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5f76a80a-7c07-49ef-a498-ba6510f73690 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 204 len: 0 microversion: 2.1 time: 0.137393 Jul 26 14:50:10.546035 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2842/5807] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:50:10 2022] DELETE /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:50:10.555083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3285d008-03ef-45a6-a032-7995ddee188d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:10.555709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3285d008-03ef-45a6-a032-7995ddee188d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:10.562423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3285d008-03ef-45a6-a032-7995ddee188d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:10.562887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3285d008-03ef-45a6-a032-7995ddee188d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:10.563678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3285d008-03ef-45a6-a032-7995ddee188d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:10.564747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3285d008-03ef-45a6-a032-7995ddee188d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:10.721737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3285d008-03ef-45a6-a032-7995ddee188d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:10.730604 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3285d008-03ef-45a6-a032-7995ddee188d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1680 microversion: 2.1 time: 0.179403 Jul 26 14:50:10.731127 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2966/5808] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:10 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:11.330425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-775a463f-5756-4ce2-92c9-12924faa2328 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:11.331521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-775a463f-5756-4ce2-92c9-12924faa2328 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:11.338244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-775a463f-5756-4ce2-92c9-12924faa2328 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:11.338769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-775a463f-5756-4ce2-92c9-12924faa2328 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:11.339558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-775a463f-5756-4ce2-92c9-12924faa2328 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:11.340024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-775a463f-5756-4ce2-92c9-12924faa2328 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:11.503877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-775a463f-5756-4ce2-92c9-12924faa2328 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:11.511938 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-775a463f-5756-4ce2-92c9-12924faa2328 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1203 microversion: 2.1 time: 0.186627 Jul 26 14:50:11.513782 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2843/5809] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:11 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1203 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:11.754375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-05e5f922-83be-40b8-962e-69363dd5a3a0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:11.755798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-05e5f922-83be-40b8-962e-69363dd5a3a0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:11.763815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05e5f922-83be-40b8-962e-69363dd5a3a0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:11.764608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05e5f922-83be-40b8-962e-69363dd5a3a0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:11.765634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05e5f922-83be-40b8-962e-69363dd5a3a0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:11.766307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05e5f922-83be-40b8-962e-69363dd5a3a0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:11.944297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-05e5f922-83be-40b8-962e-69363dd5a3a0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:11.956822 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-05e5f922-83be-40b8-962e-69363dd5a3a0 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1680 microversion: 2.1 time: 0.208041 Jul 26 14:50:11.957678 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2967/5810] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:11 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:12.538347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b27adc6a-5437-45ea-b400-f59813ed984e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:12.540358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b27adc6a-5437-45ea-b400-f59813ed984e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:12.552825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b27adc6a-5437-45ea-b400-f59813ed984e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:12.553556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b27adc6a-5437-45ea-b400-f59813ed984e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:12.554519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b27adc6a-5437-45ea-b400-f59813ed984e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:12.555341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b27adc6a-5437-45ea-b400-f59813ed984e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:12.809602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b27adc6a-5437-45ea-b400-f59813ed984e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:12.817473 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b27adc6a-5437-45ea-b400-f59813ed984e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1203 microversion: 2.1 time: 0.286899 Jul 26 14:50:12.818131 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2844/5811] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:12 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1203 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:12.981988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-26ca5974-762b-47dd-b04d-1a29c7683cb3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:12.983267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-26ca5974-762b-47dd-b04d-1a29c7683cb3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:12.990726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26ca5974-762b-47dd-b04d-1a29c7683cb3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:12.991214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26ca5974-762b-47dd-b04d-1a29c7683cb3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:12.992452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26ca5974-762b-47dd-b04d-1a29c7683cb3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:12.993100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26ca5974-762b-47dd-b04d-1a29c7683cb3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:12.998085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:13.067616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-26ca5974-762b-47dd-b04d-1a29c7683cb3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:13.077022 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-26ca5974-762b-47dd-b04d-1a29c7683cb3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 200 len: 1612 microversion: 2.1 time: 0.099953 Jul 26 14:50:13.077610 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2968/5812] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:12 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 1612 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:13.268181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-21dcc563-d8e3-4056-b641-b51054e69c2e req-6408e834-121a-480a-b0cf-9fc946bfa000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cab1cb2-39b4-475e-aa98-74de17b0ec99", "name": "network-vif-deleted", "tag": "945f81a4-2ce3-4197-a947-8b533bf0aa5c"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:13.295539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-21dcc563-d8e3-4056-b641-b51054e69c2e req-6408e834-121a-480a-b0cf-9fc946bfa000 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:13.296464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-21dcc563-d8e3-4056-b641-b51054e69c2e req-6408e834-121a-480a-b0cf-9fc946bfa000 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:13.334085 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-21dcc563-d8e3-4056-b641-b51054e69c2e req-6408e834-121a-480a-b0cf-9fc946bfa000 service nova] Creating event network-vif-deleted:945f81a4-2ce3-4197-a947-8b533bf0aa5c for instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 on n-h2-833090-9 Jul 26 14:50:13.339416 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-21dcc563-d8e3-4056-b641-b51054e69c2e req-6408e834-121a-480a-b0cf-9fc946bfa000 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076019 Jul 26 14:50:13.340439 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2845/5813] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:50:13.841224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c5b6d630-3c96-496a-9065-86a731f111f2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:13.841851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c5b6d630-3c96-496a-9065-86a731f111f2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:13.855401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5b6d630-3c96-496a-9065-86a731f111f2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:13.858029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5b6d630-3c96-496a-9065-86a731f111f2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:13.858933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5b6d630-3c96-496a-9065-86a731f111f2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:13.861874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5b6d630-3c96-496a-9065-86a731f111f2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:14.094515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-6da59f39-9a94-4319-933c-d56b9fa85fbf req-6098f5ce-65f4-4411-8ac1-321a3ee9554c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b59970-6681-4940-9d64-41b45bb7caa8", "name": "network-vif-plugged", "status": "completed", "tag": "eff7c898-f793-4a04-a927-f33eca7f97fd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:14.107981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6da59f39-9a94-4319-933c-d56b9fa85fbf req-6098f5ce-65f4-4411-8ac1-321a3ee9554c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:14.108516 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6da59f39-9a94-4319-933c-d56b9fa85fbf req-6098f5ce-65f4-4411-8ac1-321a3ee9554c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:14.122271 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-6da59f39-9a94-4319-933c-d56b9fa85fbf req-6098f5ce-65f4-4411-8ac1-321a3ee9554c service nova] Creating event network-vif-plugged:eff7c898-f793-4a04-a927-f33eca7f97fd for instance 58b59970-6681-4940-9d64-41b45bb7caa8 on n-h1-833090-9 Jul 26 14:50:14.128542 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-6da59f39-9a94-4319-933c-d56b9fa85fbf req-6098f5ce-65f4-4411-8ac1-321a3ee9554c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176147 Jul 26 14:50:14.130030 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2846/5814] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:14.136739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7031e61a-3493-4b60-b73c-31b6f27082d3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:14.148971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7031e61a-3493-4b60-b73c-31b6f27082d3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:14.157644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7031e61a-3493-4b60-b73c-31b6f27082d3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:14.159295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7031e61a-3493-4b60-b73c-31b6f27082d3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:14.160010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c5b6d630-3c96-496a-9065-86a731f111f2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:14.161592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7031e61a-3493-4b60-b73c-31b6f27082d3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:14.162240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7031e61a-3493-4b60-b73c-31b6f27082d3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:14.184206 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c5b6d630-3c96-496a-9065-86a731f111f2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1203 microversion: 2.1 time: 0.347567 Jul 26 14:50:14.185452 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2969/5815] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:13 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1203 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:14.200669 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-7031e61a-3493-4b60-b73c-31b6f27082d3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7031e61a-3493-4b60-b73c-31b6f27082d3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 HTTP/1.1 Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4cab1cb2-39b4-475e-aa98-74de17b0ec99'} Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:50:14.202958 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:50:14.208824 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:50:14.208824 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:50:14.208824 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:50:14.208824 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:50:14.208824 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:50:14.208824 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:50:14.208824 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:50:14.214932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7031e61a-3493-4b60-b73c-31b6f27082d3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:50:14.222613 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7031e61a-3493-4b60-b73c-31b6f27082d3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 404 len: 111 microversion: 2.1 time: 0.090898 Jul 26 14:50:14.223920 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2847/5816] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:14 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:50:14.232425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bbcda874-db51-42fb-84b4-85bd87ba8b64 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '.version_select at 0x7f8786a1bf70>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:14.269687 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bbcda874-db51-42fb-84b4-85bd87ba8b64 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-973313680" status: 202 len: 0 microversion: 2.1 time: 0.041112 Jul 26 14:50:14.271818 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2970/5817] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Jul 26 14:50:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-973313680 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:50:15.151887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-49e65f12-dcdf-4b2d-bbbc-01d6e42fe20e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: .version_select at 0x7f8786e365e0>, body: {"keypair": {"name": "tempest-keypair-1541306155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDutQ2jfVXi9KcSTVG/MzahOHf6yF+c3Qf9vUmBx0heEI4nMTQHbF82lj8jlcaQPzkCJX08r9qmVHixfGAS1kS3ER66N065ky8e4bf4A3FGF3SquU8V8hNA3W3LpmyY6Q=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:15.170758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-49e65f12-dcdf-4b2d-bbbc-01d6e42fe20e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:50:15.177124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-49e65f12-dcdf-4b2d-bbbc-01d6e42fe20e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for user df60439bde7a40938de3990499a342fc and project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:50:15.201590 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-49e65f12-dcdf-4b2d-bbbc-01d6e42fe20e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054719 Jul 26 14:50:15.202482 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2848/5818] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:50:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:15.213299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cadc412d-af96-4c82-be26-ff351e7655bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:15.214485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cadc412d-af96-4c82-be26-ff351e7655bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:15.224172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cadc412d-af96-4c82-be26-ff351e7655bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:15.224965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cadc412d-af96-4c82-be26-ff351e7655bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:15.225969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cadc412d-af96-4c82-be26-ff351e7655bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:15.227039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cadc412d-af96-4c82-be26-ff351e7655bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:15.489544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cadc412d-af96-4c82-be26-ff351e7655bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:15.498174 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cadc412d-af96-4c82-be26-ff351e7655bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1203 microversion: 2.1 time: 0.295625 Jul 26 14:50:15.498893 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2971/5819] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:15 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1203 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:16.527634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9b7c2822-7768-41f1-9b85-188099e302ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:16.528954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9b7c2822-7768-41f1-9b85-188099e302ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:16.540123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b7c2822-7768-41f1-9b85-188099e302ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:16.540956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b7c2822-7768-41f1-9b85-188099e302ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:16.542930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b7c2822-7768-41f1-9b85-188099e302ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:16.543558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9b7c2822-7768-41f1-9b85-188099e302ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:16.698389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9b7c2822-7768-41f1-9b85-188099e302ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:16.706865 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9b7c2822-7768-41f1-9b85-188099e302ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1389 microversion: 2.1 time: 0.189512 Jul 26 14:50:16.707444 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2849/5820] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:16 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1389 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:16.717650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-276092687", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bea5649-0c21-48c4-9c64-ad69cc72b39d"}], "security_groups": [{"name": "tempest-securitygroup--1757320960"}], "key_name": "tempest-keypair-1541306155", "user_data": "}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:16.727598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b253d6eb-532d-4b30-98f9-9771791cdaa4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:16.728411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b253d6eb-532d-4b30-98f9-9771791cdaa4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:16.735172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b253d6eb-532d-4b30-98f9-9771791cdaa4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:16.735743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b253d6eb-532d-4b30-98f9-9771791cdaa4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:16.737190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b253d6eb-532d-4b30-98f9-9771791cdaa4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:16.737700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b253d6eb-532d-4b30-98f9-9771791cdaa4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:16.881062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] validate_networks() for [('5bea5649-0c21-48c4-9c64-ad69cc72b39d', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:50:16.961850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b253d6eb-532d-4b30-98f9-9771791cdaa4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:16.971162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b253d6eb-532d-4b30-98f9-9771791cdaa4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1389 microversion: 2.1 time: 0.246546 Jul 26 14:50:16.971585 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2850/5821] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:16 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1389 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:16.993322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-59815665-a7fb-416e-b54d-718bb65a5248 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:16.994228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-59815665-a7fb-416e-b54d-718bb65a5248 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:17.000474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59815665-a7fb-416e-b54d-718bb65a5248 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:17.001157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59815665-a7fb-416e-b54d-718bb65a5248 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:17.002300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59815665-a7fb-416e-b54d-718bb65a5248 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:17.003081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59815665-a7fb-416e-b54d-718bb65a5248 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:17.184003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-59815665-a7fb-416e-b54d-718bb65a5248 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:17.193908 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-59815665-a7fb-416e-b54d-718bb65a5248 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1389 microversion: 2.1 time: 0.204360 Jul 26 14:50:17.203498 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2851/5822] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:16 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1389 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:17.215083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0df66051-e960-407b-aaeb-6ca8ff8f16c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:17.216496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0df66051-e960-407b-aaeb-6ca8ff8f16c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:17.227009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0df66051-e960-407b-aaeb-6ca8ff8f16c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:17.227618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0df66051-e960-407b-aaeb-6ca8ff8f16c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:17.228565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0df66051-e960-407b-aaeb-6ca8ff8f16c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:17.229341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0df66051-e960-407b-aaeb-6ca8ff8f16c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:17.270387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0df66051-e960-407b-aaeb-6ca8ff8f16c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:50:17.371567 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0df66051-e960-407b-aaeb-6ca8ff8f16c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 204 len: 0 microversion: 2.1 time: 0.158611 Jul 26 14:50:17.372305 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2852/5823] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:50:17 2022] DELETE /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:50:17.381880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c2baeb1-a102-4db3-ac65-9c7a83011027 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:17.382700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c2baeb1-a102-4db3-ac65-9c7a83011027 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:17.390267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c2baeb1-a102-4db3-ac65-9c7a83011027 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:17.391031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c2baeb1-a102-4db3-ac65-9c7a83011027 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:17.391835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c2baeb1-a102-4db3-ac65-9c7a83011027 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:17.392885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c2baeb1-a102-4db3-ac65-9c7a83011027 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:17.595001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:50:17.600376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:50:17.602813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:50:17.604131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:50:17.608370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:50:17.629732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c2baeb1-a102-4db3-ac65-9c7a83011027 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:17.640974 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2c2baeb1-a102-4db3-ac65-9c7a83011027 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1395 microversion: 2.1 time: 0.264013 Jul 26 14:50:17.641449 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2853/5824] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:17 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1395 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:17.646382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:17.647423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:17.648408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:17.648941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:17.669450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:50:17.675214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for user df60439bde7a40938de3990499a342fc and project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:50:17.687898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:50:17.691149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:50:17.741095 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d777db69-9d03-42ee-abbb-ec81399baa6f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.027618 Jul 26 14:50:17.743995 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2972/5825] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:50:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:50:17.753324 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-11cea93f-a019-44fe-84fd-e5e6b02c4db6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:17.753966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-11cea93f-a019-44fe-84fd-e5e6b02c4db6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:17.838981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-11cea93f-a019-44fe-84fd-e5e6b02c4db6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:17.846104 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-11cea93f-a019-44fe-84fd-e5e6b02c4db6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1241 microversion: 2.1 time: 0.097389 Jul 26 14:50:17.859806 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2854/5826] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:17 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:18.663606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-79f85de0-f753-4b58-98f6-3383fffe8272 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:18.664527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79f85de0-f753-4b58-98f6-3383fffe8272 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:18.674250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79f85de0-f753-4b58-98f6-3383fffe8272 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:18.674528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79f85de0-f753-4b58-98f6-3383fffe8272 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:18.675385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79f85de0-f753-4b58-98f6-3383fffe8272 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:18.675786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79f85de0-f753-4b58-98f6-3383fffe8272 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:18.867562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2755612f-6e32-44ed-9b24-9174027e77c3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:18.868841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2755612f-6e32-44ed-9b24-9174027e77c3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:18.879143 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2755612f-6e32-44ed-9b24-9174027e77c3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:18.879835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2755612f-6e32-44ed-9b24-9174027e77c3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:18.880810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2755612f-6e32-44ed-9b24-9174027e77c3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:18.881414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2755612f-6e32-44ed-9b24-9174027e77c3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:19.003882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2755612f-6e32-44ed-9b24-9174027e77c3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:19.016371 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2755612f-6e32-44ed-9b24-9174027e77c3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1311 microversion: 2.1 time: 0.153218 Jul 26 14:50:19.017098 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2855/5827] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:18 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1311 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:19.022972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-79f85de0-f753-4b58-98f6-3383fffe8272 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:19.042507 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-79f85de0-f753-4b58-98f6-3383fffe8272 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1395 microversion: 2.1 time: 0.382360 Jul 26 14:50:19.043929 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2973/5828] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:18 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1395 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:20.042175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-137f6040-94f6-4f58-87cb-34aa14d16e06 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:20.042888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-137f6040-94f6-4f58-87cb-34aa14d16e06 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:20.059220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-81f6d204-bae1-4b3c-9fbd-8284143df143 req-071dc0e2-36dd-4eda-8171-f1ce1ec11bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b59970-6681-4940-9d64-41b45bb7caa8", "name": "network-vif-deleted", "tag": "eff7c898-f793-4a04-a927-f33eca7f97fd"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:20.066167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-137f6040-94f6-4f58-87cb-34aa14d16e06 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:20.066938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-137f6040-94f6-4f58-87cb-34aa14d16e06 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:20.067783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-137f6040-94f6-4f58-87cb-34aa14d16e06 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:20.082883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-137f6040-94f6-4f58-87cb-34aa14d16e06 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:20.084698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-81f6d204-bae1-4b3c-9fbd-8284143df143 req-071dc0e2-36dd-4eda-8171-f1ce1ec11bed service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:20.086486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-81f6d204-bae1-4b3c-9fbd-8284143df143 req-071dc0e2-36dd-4eda-8171-f1ce1ec11bed service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:20.124033 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-81f6d204-bae1-4b3c-9fbd-8284143df143 req-071dc0e2-36dd-4eda-8171-f1ce1ec11bed service nova] Creating event network-vif-deleted:eff7c898-f793-4a04-a927-f33eca7f97fd for instance 58b59970-6681-4940-9d64-41b45bb7caa8 on n-h1-833090-9 Jul 26 14:50:20.133711 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-81f6d204-bae1-4b3c-9fbd-8284143df143 req-071dc0e2-36dd-4eda-8171-f1ce1ec11bed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078217 Jul 26 14:50:20.134386 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2974/5829] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:20.143163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ce74193c-d962-4efa-8f33-e04abb8a183d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:20.143890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ce74193c-d962-4efa-8f33-e04abb8a183d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:20.158570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce74193c-d962-4efa-8f33-e04abb8a183d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:20.159396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce74193c-d962-4efa-8f33-e04abb8a183d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:20.160465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce74193c-d962-4efa-8f33-e04abb8a183d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:20.161094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ce74193c-d962-4efa-8f33-e04abb8a183d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:20.191718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-137f6040-94f6-4f58-87cb-34aa14d16e06 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:20.206400 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-137f6040-94f6-4f58-87cb-34aa14d16e06 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1299 microversion: 2.1 time: 0.169093 Jul 26 14:50:20.208800 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2856/5830] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:20 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:20.281348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ce74193c-d962-4efa-8f33-e04abb8a183d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:20.295222 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ce74193c-d962-4efa-8f33-e04abb8a183d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1188 microversion: 2.1 time: 0.158601 Jul 26 14:50:20.296598 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2975/5831] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:20 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:21.234517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a68b13ca-77fb-43ee-84d1-39d256b105e3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:21.237125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a68b13ca-77fb-43ee-84d1-39d256b105e3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:21.257321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a68b13ca-77fb-43ee-84d1-39d256b105e3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:21.257861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a68b13ca-77fb-43ee-84d1-39d256b105e3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:21.258753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a68b13ca-77fb-43ee-84d1-39d256b105e3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:21.259441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a68b13ca-77fb-43ee-84d1-39d256b105e3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:21.320051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-061ac2ed-fc34-4dd0-9495-d8fb45c07fb8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:21.320964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-061ac2ed-fc34-4dd0-9495-d8fb45c07fb8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:21.338567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-061ac2ed-fc34-4dd0-9495-d8fb45c07fb8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:21.342317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-061ac2ed-fc34-4dd0-9495-d8fb45c07fb8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:21.345109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-061ac2ed-fc34-4dd0-9495-d8fb45c07fb8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:21.346210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-061ac2ed-fc34-4dd0-9495-d8fb45c07fb8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:21.559665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a68b13ca-77fb-43ee-84d1-39d256b105e3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:21.561244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-061ac2ed-fc34-4dd0-9495-d8fb45c07fb8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:21.569829 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-061ac2ed-fc34-4dd0-9495-d8fb45c07fb8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1188 microversion: 2.1 time: 0.255242 Jul 26 14:50:21.571040 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2976/5832] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:21 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1188 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:21.590861 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a68b13ca-77fb-43ee-84d1-39d256b105e3 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1367 microversion: 2.1 time: 0.359834 Jul 26 14:50:21.592339 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2857/5833] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:21 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:22.160384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-89fd27b8-0567-4c26-a905-391a0f53913a req-0dbc7c4b-f4dd-4198-bc49-bdc422721fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54a90dca-fd66-404f-af79-45a4ebeb0c74", "tag": "974a6210-cb7b-47e5-95b3-6a2523b05ac6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:22.171661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-89fd27b8-0567-4c26-a905-391a0f53913a req-0dbc7c4b-f4dd-4198-bc49-bdc422721fd7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:22.172656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-89fd27b8-0567-4c26-a905-391a0f53913a req-0dbc7c4b-f4dd-4198-bc49-bdc422721fd7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:22.185018 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-89fd27b8-0567-4c26-a905-391a0f53913a req-0dbc7c4b-f4dd-4198-bc49-bdc422721fd7 service nova] Creating event network-changed:974a6210-cb7b-47e5-95b3-6a2523b05ac6 for instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 on n-h2-833090-9 Jul 26 14:50:22.191650 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-89fd27b8-0567-4c26-a905-391a0f53913a req-0dbc7c4b-f4dd-4198-bc49-bdc422721fd7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036124 Jul 26 14:50:22.192930 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2977/5834] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:22.599292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0f7cde74-d802-4801-867c-bc1f03d2a520 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:22.600032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0f7cde74-d802-4801-867c-bc1f03d2a520 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:22.610023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f7cde74-d802-4801-867c-bc1f03d2a520 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:22.610492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f7cde74-d802-4801-867c-bc1f03d2a520 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:22.612266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f7cde74-d802-4801-867c-bc1f03d2a520 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:22.612968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f7cde74-d802-4801-867c-bc1f03d2a520 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:22.621992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7cf7270b-ea2d-475d-8a10-fafed91eb91e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:22.625180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7cf7270b-ea2d-475d-8a10-fafed91eb91e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:22.634690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cf7270b-ea2d-475d-8a10-fafed91eb91e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:22.635451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cf7270b-ea2d-475d-8a10-fafed91eb91e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:22.637804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cf7270b-ea2d-475d-8a10-fafed91eb91e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:22.638265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7cf7270b-ea2d-475d-8a10-fafed91eb91e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:22.693057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0f7cde74-d802-4801-867c-bc1f03d2a520 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:22.706089 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0f7cde74-d802-4801-867c-bc1f03d2a520 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1188 microversion: 2.1 time: 0.108677 Jul 26 14:50:22.708139 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2858/5835] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:22 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1188 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:22.817026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7cf7270b-ea2d-475d-8a10-fafed91eb91e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:22.826063 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7cf7270b-ea2d-475d-8a10-fafed91eb91e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1367 microversion: 2.1 time: 0.213928 Jul 26 14:50:22.827600 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2978/5836] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:22 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:23.728228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee9e406a-0aed-471f-bce5-c02e4aad1400 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:23.728929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ee9e406a-0aed-471f-bce5-c02e4aad1400 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:23.737439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:23.738562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee9e406a-0aed-471f-bce5-c02e4aad1400 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:23.739107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee9e406a-0aed-471f-bce5-c02e4aad1400 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:23.739884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee9e406a-0aed-471f-bce5-c02e4aad1400 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:23.740315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee9e406a-0aed-471f-bce5-c02e4aad1400 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:23.850031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e607c6b9-1658-4801-8ad7-a3a348417f7f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:23.851284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e607c6b9-1658-4801-8ad7-a3a348417f7f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:23.858504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e607c6b9-1658-4801-8ad7-a3a348417f7f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:23.859179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e607c6b9-1658-4801-8ad7-a3a348417f7f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:23.860451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e607c6b9-1658-4801-8ad7-a3a348417f7f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:23.861673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e607c6b9-1658-4801-8ad7-a3a348417f7f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:23.877476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ee9e406a-0aed-471f-bce5-c02e4aad1400 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:23.889942 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ee9e406a-0aed-471f-bce5-c02e4aad1400 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1188 microversion: 2.1 time: 0.166367 Jul 26 14:50:23.891117 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2859/5837] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:23 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1188 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:24.222685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e607c6b9-1658-4801-8ad7-a3a348417f7f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:24.236902 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e607c6b9-1658-4801-8ad7-a3a348417f7f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1367 microversion: 2.1 time: 0.385741 Jul 26 14:50:24.237814 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2979/5838] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:23 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:24.911564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:24.912420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:24.919711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:24.920266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:24.921136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:24.921730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:24.955078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:24.955553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:24.956078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lazy-loading 'fault' on Instance uuid 58b59970-6681-4940-9d64-41b45bb7caa8 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:50:25.012033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:25.020995 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-74fd963e-ac25-4f9c-8ab9-cfde9e83f8e0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 200 len: 1193 microversion: 2.1 time: 0.114024 Jul 26 14:50:25.021798 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2860/5839] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:24 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 1193 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:25.260054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f5888357-e98c-4837-9788-6f14f60d285b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:25.260677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f5888357-e98c-4837-9788-6f14f60d285b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:25.265131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:25.270040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5888357-e98c-4837-9788-6f14f60d285b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:25.270503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5888357-e98c-4837-9788-6f14f60d285b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:25.274236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5888357-e98c-4837-9788-6f14f60d285b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:25.275312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f5888357-e98c-4837-9788-6f14f60d285b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:25.451262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f5888357-e98c-4837-9788-6f14f60d285b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:25.461631 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f5888357-e98c-4837-9788-6f14f60d285b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1367 microversion: 2.1 time: 0.206606 Jul 26 14:50:25.462391 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2980/5840] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:25 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:26.043836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae8394a7-2c4a-4383-bdf3-75078158f06b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:26.044570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ae8394a7-2c4a-4383-bdf3-75078158f06b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 58b59970-6681-4940-9d64-41b45bb7caa8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:26.053452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae8394a7-2c4a-4383-bdf3-75078158f06b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:26.054360 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae8394a7-2c4a-4383-bdf3-75078158f06b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:26.055363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae8394a7-2c4a-4383-bdf3-75078158f06b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:26.056030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ae8394a7-2c4a-4383-bdf3-75078158f06b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:26.061021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:26.078373 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ae8394a7-2c4a-4383-bdf3-75078158f06b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 58b59970-6681-4940-9d64-41b45bb7caa8 could not be found. Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae8394a7-2c4a-4383-bdf3-75078158f06b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 HTTP/1.1 Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 58b59970-6681-4940-9d64-41b45bb7caa8 could not be found. Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '58b59970-6681-4940-9d64-41b45bb7caa8'} Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b59970-6681-4940-9d64-41b45bb7caa8 could not be found. Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b59970-6681-4940-9d64-41b45bb7caa8 could not be found. Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:50:26.080619 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:50:26.086633 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:50:26.086633 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:50:26.086633 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:50:26.086633 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:50:26.086633 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:50:26.086633 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b59970-6681-4940-9d64-41b45bb7caa8 could not be found. Jul 26 14:50:26.086633 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:50:26.088439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ae8394a7-2c4a-4383-bdf3-75078158f06b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 58b59970-6681-4940-9d64-41b45bb7caa8 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:50:26.089542 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ae8394a7-2c4a-4383-bdf3-75078158f06b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8" status: 404 len: 111 microversion: 2.1 time: 0.050428 Jul 26 14:50:26.090330 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2861/5841] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:26 2022] GET /compute/v2.1/servers/58b59970-6681-4940-9d64-41b45bb7caa8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:50:26.295586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-130d3fd4-3ca7-4a5f-b9c2-2012fc41a2ae req-f06a8b36-066e-46f1-ad3a-2bf517929cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a90dca-fd66-404f-af79-45a4ebeb0c74", "name": "network-vif-plugged", "status": "completed", "tag": "974a6210-cb7b-47e5-95b3-6a2523b05ac6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:26.314992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-130d3fd4-3ca7-4a5f-b9c2-2012fc41a2ae req-f06a8b36-066e-46f1-ad3a-2bf517929cb2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:26.316069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-130d3fd4-3ca7-4a5f-b9c2-2012fc41a2ae req-f06a8b36-066e-46f1-ad3a-2bf517929cb2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:26.336371 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-130d3fd4-3ca7-4a5f-b9c2-2012fc41a2ae req-f06a8b36-066e-46f1-ad3a-2bf517929cb2 service nova] Creating event network-vif-plugged:974a6210-cb7b-47e5-95b3-6a2523b05ac6 for instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 on n-h2-833090-9 Jul 26 14:50:26.342846 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-130d3fd4-3ca7-4a5f-b9c2-2012fc41a2ae req-f06a8b36-066e-46f1-ad3a-2bf517929cb2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052217 Jul 26 14:50:26.344437 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2981/5842] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:26.483396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-155a8263-8ee5-4bc4-bb34-85ae3984e94f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:26.484889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-155a8263-8ee5-4bc4-bb34-85ae3984e94f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:26.493354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-155a8263-8ee5-4bc4-bb34-85ae3984e94f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:26.494539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-155a8263-8ee5-4bc4-bb34-85ae3984e94f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:26.495703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-155a8263-8ee5-4bc4-bb34-85ae3984e94f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:26.496577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-155a8263-8ee5-4bc4-bb34-85ae3984e94f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:26.736822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-155a8263-8ee5-4bc4-bb34-85ae3984e94f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:26.751671 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-155a8263-8ee5-4bc4-bb34-85ae3984e94f tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1367 microversion: 2.1 time: 0.272594 Jul 26 14:50:26.752307 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2862/5843] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:26 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:27.775938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:27.777451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:27.787116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c2e35a2c-f44f-462a-984f-7deea41a22cc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:27.789030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c2e35a2c-f44f-462a-984f-7deea41a22cc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:27.813384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2e35a2c-f44f-462a-984f-7deea41a22cc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:27.817424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2e35a2c-f44f-462a-984f-7deea41a22cc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:27.818656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2e35a2c-f44f-462a-984f-7deea41a22cc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:27.821207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2e35a2c-f44f-462a-984f-7deea41a22cc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:28.144242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c2e35a2c-f44f-462a-984f-7deea41a22cc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:28.157362 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c2e35a2c-f44f-462a-984f-7deea41a22cc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1367 microversion: 2.1 time: 0.383612 Jul 26 14:50:28.158880 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2982/5844] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:27 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:29.181482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02bf0e10-e826-417d-a048-f73e3dbc14ae tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:29.182070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-02bf0e10-e826-417d-a048-f73e3dbc14ae tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:29.192804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:29.196240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02bf0e10-e826-417d-a048-f73e3dbc14ae tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:29.197477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02bf0e10-e826-417d-a048-f73e3dbc14ae tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:29.198907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02bf0e10-e826-417d-a048-f73e3dbc14ae tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:29.199524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02bf0e10-e826-417d-a048-f73e3dbc14ae tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:29.397350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-02bf0e10-e826-417d-a048-f73e3dbc14ae tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:29.412660 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-02bf0e10-e826-417d-a048-f73e3dbc14ae tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1555 microversion: 2.1 time: 0.234830 Jul 26 14:50:29.413142 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2863/5845] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:29 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:29.435401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ff7a2143-64bb-4b23-96a9-a931e29cefdc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:29.436322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ff7a2143-64bb-4b23-96a9-a931e29cefdc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:29.451510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff7a2143-64bb-4b23-96a9-a931e29cefdc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:29.452041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff7a2143-64bb-4b23-96a9-a931e29cefdc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:29.453475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff7a2143-64bb-4b23-96a9-a931e29cefdc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:29.453929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ff7a2143-64bb-4b23-96a9-a931e29cefdc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:29.550157 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ff7a2143-64bb-4b23-96a9-a931e29cefdc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119559 Jul 26 14:50:29.550759 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2983/5846] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:50:29 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:30.966577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-519ef042-835b-4413-83bd-275080b26be9 req-9d981fdd-df4e-46dd-88ae-6a7ef2f77131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54a90dca-fd66-404f-af79-45a4ebeb0c74", "tag": "974a6210-cb7b-47e5-95b3-6a2523b05ac6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:30.979242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-519ef042-835b-4413-83bd-275080b26be9 req-9d981fdd-df4e-46dd-88ae-6a7ef2f77131 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:30.980157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-519ef042-835b-4413-83bd-275080b26be9 req-9d981fdd-df4e-46dd-88ae-6a7ef2f77131 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:30.995596 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-519ef042-835b-4413-83bd-275080b26be9 req-9d981fdd-df4e-46dd-88ae-6a7ef2f77131 service nova] Creating event network-changed:974a6210-cb7b-47e5-95b3-6a2523b05ac6 for instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 on n-h2-833090-9 Jul 26 14:50:31.002531 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-519ef042-835b-4413-83bd-275080b26be9 req-9d981fdd-df4e-46dd-88ae-6a7ef2f77131 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040119 Jul 26 14:50:31.006925 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2864/5847] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:33.841644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-499402074", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1d717048-288d-40e3-8337-38cbd7578a92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e976b6cc-dfb4-45b5-af81-629f1adeef76"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:33.909876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] validate_networks() for [('e976b6cc-dfb4-45b5-af81-629f1adeef76', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:50:34.629898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:50:34.630402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:50:34.631073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:50:34.631557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:50:34.632390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:50:34.641621 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:34.642721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:34.643865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:34.644387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:34.662212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:50:34.668234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for user ac9553617f2440a68e33b82650206cae and project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:50:34.729470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:50:34.731589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1d717048-288d-40e3-8337-38cbd7578a92',volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:50:34.914291 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8488f26e-61e7-4581-8610-55fbfe725d13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079322 Jul 26 14:50:34.915123 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2984/5848] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:50:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:50:34.928412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bd6b7113-c442-465e-864a-3c149beac5a1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:34.929912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bd6b7113-c442-465e-864a-3c149beac5a1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:35.023675 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bd6b7113-c442-465e-864a-3c149beac5a1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:35.034836 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bd6b7113-c442-465e-864a-3c149beac5a1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1056 microversion: 2.1 time: 0.111953 Jul 26 14:50:35.050694 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2865/5849] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:34 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1056 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:36.060415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-67e3eb97-fecc-4488-9311-17aa84c5bdab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:36.060962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-67e3eb97-fecc-4488-9311-17aa84c5bdab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:36.068744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67e3eb97-fecc-4488-9311-17aa84c5bdab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:36.069379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67e3eb97-fecc-4488-9311-17aa84c5bdab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:36.070178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67e3eb97-fecc-4488-9311-17aa84c5bdab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:36.070702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-67e3eb97-fecc-4488-9311-17aa84c5bdab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:36.169968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-67e3eb97-fecc-4488-9311-17aa84c5bdab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:36.179338 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-67e3eb97-fecc-4488-9311-17aa84c5bdab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1172 microversion: 2.1 time: 0.124166 Jul 26 14:50:36.180307 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2985/5850] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:36 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1172 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:37.202964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0999d470-d0ae-4174-8c00-3acc4f451d7e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:37.204257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0999d470-d0ae-4174-8c00-3acc4f451d7e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:37.213371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0999d470-d0ae-4174-8c00-3acc4f451d7e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:37.213840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0999d470-d0ae-4174-8c00-3acc4f451d7e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:37.214633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0999d470-d0ae-4174-8c00-3acc4f451d7e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:37.215077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0999d470-d0ae-4174-8c00-3acc4f451d7e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:37.516515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0999d470-d0ae-4174-8c00-3acc4f451d7e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:37.535395 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0999d470-d0ae-4174-8c00-3acc4f451d7e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1214 microversion: 2.1 time: 0.336472 Jul 26 14:50:37.541211 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2866/5851] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:37 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1214 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:38.058352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f6245340-f049-4796-946c-f4e2cdf9ac24 req-22f3c583-8ab2-4698-911c-4042d0aeff51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13e25b6b-06ea-4e22-9bac-8e7561a3bb3b", "tag": "8c628961-f320-43f3-8883-28b8c11ed7e4"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:38.083818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f6245340-f049-4796-946c-f4e2cdf9ac24 req-22f3c583-8ab2-4698-911c-4042d0aeff51 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:38.085828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f6245340-f049-4796-946c-f4e2cdf9ac24 req-22f3c583-8ab2-4698-911c-4042d0aeff51 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:38.165079 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f6245340-f049-4796-946c-f4e2cdf9ac24 req-22f3c583-8ab2-4698-911c-4042d0aeff51 service nova] Creating event network-changed:8c628961-f320-43f3-8883-28b8c11ed7e4 for instance 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b on n-h1-833090-9 Jul 26 14:50:38.178228 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f6245340-f049-4796-946c-f4e2cdf9ac24 req-22f3c583-8ab2-4698-911c-4042d0aeff51 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126913 Jul 26 14:50:38.179464 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2986/5852] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:38.565586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4f0c3f29-637d-4024-bfdf-791b11d12108 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:38.566226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4f0c3f29-637d-4024-bfdf-791b11d12108 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:38.573983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f0c3f29-637d-4024-bfdf-791b11d12108 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:38.574454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f0c3f29-637d-4024-bfdf-791b11d12108 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:38.575264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f0c3f29-637d-4024-bfdf-791b11d12108 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:38.575976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f0c3f29-637d-4024-bfdf-791b11d12108 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:38.821943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4f0c3f29-637d-4024-bfdf-791b11d12108 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:38.830636 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4f0c3f29-637d-4024-bfdf-791b11d12108 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1214 microversion: 2.1 time: 0.271474 Jul 26 14:50:38.831226 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2867/5853] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:38 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1214 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:39.853236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f8825cbf-8f81-4c24-8f4f-7da88f2edd0a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:39.853885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f8825cbf-8f81-4c24-8f4f-7da88f2edd0a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:39.861227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8825cbf-8f81-4c24-8f4f-7da88f2edd0a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:39.861840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8825cbf-8f81-4c24-8f4f-7da88f2edd0a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:39.862674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8825cbf-8f81-4c24-8f4f-7da88f2edd0a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:39.863129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8825cbf-8f81-4c24-8f4f-7da88f2edd0a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:40.002530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f8825cbf-8f81-4c24-8f4f-7da88f2edd0a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:40.010237 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f8825cbf-8f81-4c24-8f4f-7da88f2edd0a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1214 microversion: 2.1 time: 0.161389 Jul 26 14:50:40.010811 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2987/5854] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:39 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:41.031205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a6c4f735-5b17-43d3-ae4b-163547fe4557 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:41.031818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a6c4f735-5b17-43d3-ae4b-163547fe4557 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:41.039809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6c4f735-5b17-43d3-ae4b-163547fe4557 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:41.040311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6c4f735-5b17-43d3-ae4b-163547fe4557 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:41.041332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6c4f735-5b17-43d3-ae4b-163547fe4557 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:41.041779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6c4f735-5b17-43d3-ae4b-163547fe4557 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:41.188406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a6c4f735-5b17-43d3-ae4b-163547fe4557 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:41.196724 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a6c4f735-5b17-43d3-ae4b-163547fe4557 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1214 microversion: 2.1 time: 0.169735 Jul 26 14:50:41.197341 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2868/5855] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:41 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:42.218619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-20017acf-796f-4076-8d97-e98f3e2b9b87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:42.219170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-20017acf-796f-4076-8d97-e98f3e2b9b87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:42.227308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20017acf-796f-4076-8d97-e98f3e2b9b87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:42.227773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20017acf-796f-4076-8d97-e98f3e2b9b87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:42.228603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20017acf-796f-4076-8d97-e98f3e2b9b87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:42.229059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-20017acf-796f-4076-8d97-e98f3e2b9b87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:42.359587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-20017acf-796f-4076-8d97-e98f3e2b9b87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:42.367907 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-20017acf-796f-4076-8d97-e98f3e2b9b87 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1202 microversion: 2.1 time: 0.153278 Jul 26 14:50:42.368498 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2988/5856] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:42 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:43.389725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-be606696-28ca-4201-9bef-102ea33ce8a6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:43.390377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-be606696-28ca-4201-9bef-102ea33ce8a6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:43.397737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be606696-28ca-4201-9bef-102ea33ce8a6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:43.398228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be606696-28ca-4201-9bef-102ea33ce8a6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:43.399020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be606696-28ca-4201-9bef-102ea33ce8a6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:43.399467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be606696-28ca-4201-9bef-102ea33ce8a6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:43.545731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-be606696-28ca-4201-9bef-102ea33ce8a6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:43.554830 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-be606696-28ca-4201-9bef-102ea33ce8a6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1202 microversion: 2.1 time: 0.168961 Jul 26 14:50:43.555427 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2869/5857] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:43 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:44.576946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9d71cb74-25fc-4b04-865b-9fe35af023e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:44.577752 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9d71cb74-25fc-4b04-865b-9fe35af023e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:44.585609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d71cb74-25fc-4b04-865b-9fe35af023e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:44.586070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d71cb74-25fc-4b04-865b-9fe35af023e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:44.586860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d71cb74-25fc-4b04-865b-9fe35af023e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:44.587309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9d71cb74-25fc-4b04-865b-9fe35af023e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:44.590297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=93 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:44.652881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:44.678971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:44.728964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9d71cb74-25fc-4b04-865b-9fe35af023e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:44.736757 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9d71cb74-25fc-4b04-865b-9fe35af023e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1202 microversion: 2.1 time: 0.163754 Jul 26 14:50:44.737346 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2989/5858] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:44 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:45.758541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0fda8633-955b-487d-80af-a60ab6bcad19 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:45.759193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0fda8633-955b-487d-80af-a60ab6bcad19 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:45.762033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:45.768442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0fda8633-955b-487d-80af-a60ab6bcad19 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:45.768898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0fda8633-955b-487d-80af-a60ab6bcad19 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:45.769674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0fda8633-955b-487d-80af-a60ab6bcad19 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:45.770112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0fda8633-955b-487d-80af-a60ab6bcad19 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:45.912237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0fda8633-955b-487d-80af-a60ab6bcad19 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:45.920742 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0fda8633-955b-487d-80af-a60ab6bcad19 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1202 microversion: 2.1 time: 0.166074 Jul 26 14:50:45.921427 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2870/5859] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:45 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:46.943634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a634669b-b11a-44bb-a840-9ef52c8cc5fa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:46.944273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a634669b-b11a-44bb-a840-9ef52c8cc5fa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:46.951063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a634669b-b11a-44bb-a840-9ef52c8cc5fa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:46.951459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a634669b-b11a-44bb-a840-9ef52c8cc5fa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:46.952266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a634669b-b11a-44bb-a840-9ef52c8cc5fa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:46.952716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a634669b-b11a-44bb-a840-9ef52c8cc5fa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:47.084445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a634669b-b11a-44bb-a840-9ef52c8cc5fa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:47.093056 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a634669b-b11a-44bb-a840-9ef52c8cc5fa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1202 microversion: 2.1 time: 0.154299 Jul 26 14:50:47.093635 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2990/5860] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:46 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:48.115585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-29144430-c596-4418-a5e1-597bad07f3d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:48.116253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-29144430-c596-4418-a5e1-597bad07f3d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:48.123460 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29144430-c596-4418-a5e1-597bad07f3d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:48.123921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29144430-c596-4418-a5e1-597bad07f3d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:48.124735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29144430-c596-4418-a5e1-597bad07f3d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:48.125187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-29144430-c596-4418-a5e1-597bad07f3d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:48.261397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-29144430-c596-4418-a5e1-597bad07f3d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:48.269613 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-29144430-c596-4418-a5e1-597bad07f3d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1202 microversion: 2.1 time: 0.158312 Jul 26 14:50:48.270213 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2871/5861] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:48 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:49.291129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-857d3c29-4b8c-4e15-a511-419be22be182 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:49.291758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-857d3c29-4b8c-4e15-a511-419be22be182 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:49.299551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-857d3c29-4b8c-4e15-a511-419be22be182 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:49.300044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-857d3c29-4b8c-4e15-a511-419be22be182 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:49.300840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-857d3c29-4b8c-4e15-a511-419be22be182 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:49.301289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-857d3c29-4b8c-4e15-a511-419be22be182 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:49.442336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-857d3c29-4b8c-4e15-a511-419be22be182 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:49.450432 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-857d3c29-4b8c-4e15-a511-419be22be182 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1202 microversion: 2.1 time: 0.163440 Jul 26 14:50:49.451003 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2991/5862] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:49 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:50.473457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b9995a0c-78e9-4cf4-8787-b050640ef1a2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:50.474083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b9995a0c-78e9-4cf4-8787-b050640ef1a2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:50.480812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9995a0c-78e9-4cf4-8787-b050640ef1a2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:50.481273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9995a0c-78e9-4cf4-8787-b050640ef1a2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:50.482052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9995a0c-78e9-4cf4-8787-b050640ef1a2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:50.482500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b9995a0c-78e9-4cf4-8787-b050640ef1a2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:50.615618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b9995a0c-78e9-4cf4-8787-b050640ef1a2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:50.623220 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b9995a0c-78e9-4cf4-8787-b050640ef1a2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1202 microversion: 2.1 time: 0.154495 Jul 26 14:50:50.623784 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2872/5863] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:50 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:51.646031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f4b8426-6885-4eea-ae2d-7a9c8cd01c0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:51.646790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f4b8426-6885-4eea-ae2d-7a9c8cd01c0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:51.654743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f4b8426-6885-4eea-ae2d-7a9c8cd01c0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:51.655256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f4b8426-6885-4eea-ae2d-7a9c8cd01c0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:51.656172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f4b8426-6885-4eea-ae2d-7a9c8cd01c0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:51.656672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f4b8426-6885-4eea-ae2d-7a9c8cd01c0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:51.802956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f4b8426-6885-4eea-ae2d-7a9c8cd01c0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:51.809430 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f4b8426-6885-4eea-ae2d-7a9c8cd01c0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1202 microversion: 2.1 time: 0.168076 Jul 26 14:50:51.810027 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2992/5864] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:51 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:50:52.079849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-041240ed-0af8-44c9-a6a3-0587b79ac63f req-61e9b0e0-9f2e-4fb7-85ea-a99939b659df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e25b6b-06ea-4e22-9bac-8e7561a3bb3b", "name": "network-vif-plugged", "status": "completed", "tag": "8c628961-f320-43f3-8883-28b8c11ed7e4"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:52.091362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-041240ed-0af8-44c9-a6a3-0587b79ac63f req-61e9b0e0-9f2e-4fb7-85ea-a99939b659df service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:52.091988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-041240ed-0af8-44c9-a6a3-0587b79ac63f req-61e9b0e0-9f2e-4fb7-85ea-a99939b659df service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:52.104615 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-041240ed-0af8-44c9-a6a3-0587b79ac63f req-61e9b0e0-9f2e-4fb7-85ea-a99939b659df service nova] Creating event network-vif-plugged:8c628961-f320-43f3-8883-28b8c11ed7e4 for instance 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b on n-h1-833090-9 Jul 26 14:50:52.109892 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-041240ed-0af8-44c9-a6a3-0587b79ac63f req-61e9b0e0-9f2e-4fb7-85ea-a99939b659df service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034105 Jul 26 14:50:52.110650 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2873/5865] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:50:52.830830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ed986da-a2d4-4e7c-a185-a7b3be5448bb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:52.832082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4ed986da-a2d4-4e7c-a185-a7b3be5448bb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:52.839135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ed986da-a2d4-4e7c-a185-a7b3be5448bb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:52.839593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ed986da-a2d4-4e7c-a185-a7b3be5448bb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:52.840402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ed986da-a2d4-4e7c-a185-a7b3be5448bb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:52.840873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ed986da-a2d4-4e7c-a185-a7b3be5448bb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:52.978920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4ed986da-a2d4-4e7c-a185-a7b3be5448bb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:52.986471 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4ed986da-a2d4-4e7c-a185-a7b3be5448bb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1202 microversion: 2.1 time: 0.159741 Jul 26 14:50:52.987554 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2993/5866] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:52 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:54.010899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-218b4756-8862-4967-ade5-66e3bd8ffc17 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:54.011605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-218b4756-8862-4967-ade5-66e3bd8ffc17 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:54.013640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=33 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:54.019353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-218b4756-8862-4967-ade5-66e3bd8ffc17 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:54.019815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-218b4756-8862-4967-ade5-66e3bd8ffc17 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:54.020646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-218b4756-8862-4967-ade5-66e3bd8ffc17 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:54.021086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-218b4756-8862-4967-ade5-66e3bd8ffc17 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:54.163754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-218b4756-8862-4967-ade5-66e3bd8ffc17 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:54.172464 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-218b4756-8862-4967-ade5-66e3bd8ffc17 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1389 microversion: 2.1 time: 0.166572 Jul 26 14:50:54.173076 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2874/5867] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:54 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:54.195330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6dc7e413-5d59-47ca-9a53-b0c255ce7bdc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:54.195940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6dc7e413-5d59-47ca-9a53-b0c255ce7bdc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:54.203366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dc7e413-5d59-47ca-9a53-b0c255ce7bdc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:54.203834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dc7e413-5d59-47ca-9a53-b0c255ce7bdc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:54.204765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dc7e413-5d59-47ca-9a53-b0c255ce7bdc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:54.205216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6dc7e413-5d59-47ca-9a53-b0c255ce7bdc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:54.340159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6dc7e413-5d59-47ca-9a53-b0c255ce7bdc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:54.349766 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6dc7e413-5d59-47ca-9a53-b0c255ce7bdc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1389 microversion: 2.1 time: 0.158600 Jul 26 14:50:54.350381 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2994/5868] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:54 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:54.371611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3fff6c07-838f-4893-a0f0-8b6a918c23ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:54.372257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3fff6c07-838f-4893-a0f0-8b6a918c23ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:54.378911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fff6c07-838f-4893-a0f0-8b6a918c23ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:54.379371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fff6c07-838f-4893-a0f0-8b6a918c23ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:54.380263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fff6c07-838f-4893-a0f0-8b6a918c23ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:54.380715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fff6c07-838f-4893-a0f0-8b6a918c23ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:54.528172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3fff6c07-838f-4893-a0f0-8b6a918c23ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:54.537233 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3fff6c07-838f-4893-a0f0-8b6a918c23ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1389 microversion: 2.1 time: 0.169609 Jul 26 14:50:54.537744 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2875/5869] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:54 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:54.558911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f52f8915-f8d2-4484-9c5c-817769fbc3b9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:54.559414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f52f8915-f8d2-4484-9c5c-817769fbc3b9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:54.565854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f52f8915-f8d2-4484-9c5c-817769fbc3b9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:54.566313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f52f8915-f8d2-4484-9c5c-817769fbc3b9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:54.567131 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f52f8915-f8d2-4484-9c5c-817769fbc3b9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:54.567578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f52f8915-f8d2-4484-9c5c-817769fbc3b9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:54.592948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f52f8915-f8d2-4484-9c5c-817769fbc3b9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:50:54.671847 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f52f8915-f8d2-4484-9c5c-817769fbc3b9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 204 len: 0 microversion: 2.1 time: 0.116451 Jul 26 14:50:54.672972 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2995/5870] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:50:54 2022] DELETE /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:50:54.680921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3fb80966-ddc1-4d3f-a12a-4336b42afc99 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:54.681668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3fb80966-ddc1-4d3f-a12a-4336b42afc99 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:54.687768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fb80966-ddc1-4d3f-a12a-4336b42afc99 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:54.688256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fb80966-ddc1-4d3f-a12a-4336b42afc99 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:54.689742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fb80966-ddc1-4d3f-a12a-4336b42afc99 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:54.689742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fb80966-ddc1-4d3f-a12a-4336b42afc99 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:54.828106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3fb80966-ddc1-4d3f-a12a-4336b42afc99 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:54.838510 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3fb80966-ddc1-4d3f-a12a-4336b42afc99 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1395 microversion: 2.1 time: 0.161462 Jul 26 14:50:54.839083 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2876/5871] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:54 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:55.859403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9be45014-6fd5-413c-bd32-d4f7c2f5b644 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:55.860218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9be45014-6fd5-413c-bd32-d4f7c2f5b644 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:55.863833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:55.871172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be45014-6fd5-413c-bd32-d4f7c2f5b644 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:55.871632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be45014-6fd5-413c-bd32-d4f7c2f5b644 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:55.872448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be45014-6fd5-413c-bd32-d4f7c2f5b644 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:55.872905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9be45014-6fd5-413c-bd32-d4f7c2f5b644 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:56.016164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9be45014-6fd5-413c-bd32-d4f7c2f5b644 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:56.024064 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9be45014-6fd5-413c-bd32-d4f7c2f5b644 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1395 microversion: 2.1 time: 0.169028 Jul 26 14:50:56.024644 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2996/5872] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:55 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1395 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:56.703204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f830605b-99f5-4ea1-ad9e-aae25214da97 req-f4d98ceb-f9d8-435e-83f3-6fb7c9913b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13e25b6b-06ea-4e22-9bac-8e7561a3bb3b", "name": "network-vif-deleted", "tag": "8c628961-f320-43f3-8883-28b8c11ed7e4"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:50:56.716946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f830605b-99f5-4ea1-ad9e-aae25214da97 req-f4d98ceb-f9d8-435e-83f3-6fb7c9913b62 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:56.718010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f830605b-99f5-4ea1-ad9e-aae25214da97 req-f4d98ceb-f9d8-435e-83f3-6fb7c9913b62 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:56.720924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=77 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:50:56.736711 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f830605b-99f5-4ea1-ad9e-aae25214da97 req-f4d98ceb-f9d8-435e-83f3-6fb7c9913b62 service nova] Creating event network-vif-deleted:8c628961-f320-43f3-8883-28b8c11ed7e4 for instance 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b on n-h1-833090-9 Jul 26 14:50:56.743204 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f830605b-99f5-4ea1-ad9e-aae25214da97 req-f4d98ceb-f9d8-435e-83f3-6fb7c9913b62 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043621 Jul 26 14:50:56.744171 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2877/5873] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:50:57.045710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fc1aa6cf-dd56-40e7-8f74-5d96e5f4852e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:57.047074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fc1aa6cf-dd56-40e7-8f74-5d96e5f4852e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:57.054493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc1aa6cf-dd56-40e7-8f74-5d96e5f4852e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:57.054956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc1aa6cf-dd56-40e7-8f74-5d96e5f4852e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:57.055748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc1aa6cf-dd56-40e7-8f74-5d96e5f4852e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:57.056232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fc1aa6cf-dd56-40e7-8f74-5d96e5f4852e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:57.118942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fc1aa6cf-dd56-40e7-8f74-5d96e5f4852e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:57.127366 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fc1aa6cf-dd56-40e7-8f74-5d96e5f4852e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1187 microversion: 2.1 time: 0.086025 Jul 26 14:50:57.128661 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2997/5874] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:57 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:58.150777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7fbeaa49-9f9d-4c89-aeda-4475aaed2a3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:58.151526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7fbeaa49-9f9d-4c89-aeda-4475aaed2a3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:58.158178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fbeaa49-9f9d-4c89-aeda-4475aaed2a3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:58.158632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fbeaa49-9f9d-4c89-aeda-4475aaed2a3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:58.159931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fbeaa49-9f9d-4c89-aeda-4475aaed2a3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:58.160515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7fbeaa49-9f9d-4c89-aeda-4475aaed2a3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:58.228189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7fbeaa49-9f9d-4c89-aeda-4475aaed2a3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:58.236590 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7fbeaa49-9f9d-4c89-aeda-4475aaed2a3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1187 microversion: 2.1 time: 0.091134 Jul 26 14:50:58.237476 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2878/5875] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:58 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:50:59.258555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c99abfcd-2514-46ac-8fd5-c2dfd91cb3b6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:50:59.259250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c99abfcd-2514-46ac-8fd5-c2dfd91cb3b6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:50:59.266654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c99abfcd-2514-46ac-8fd5-c2dfd91cb3b6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:59.267115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c99abfcd-2514-46ac-8fd5-c2dfd91cb3b6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:59.267905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c99abfcd-2514-46ac-8fd5-c2dfd91cb3b6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:59.269051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c99abfcd-2514-46ac-8fd5-c2dfd91cb3b6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:59.341816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c99abfcd-2514-46ac-8fd5-c2dfd91cb3b6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:50:59.351348 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c99abfcd-2514-46ac-8fd5-c2dfd91cb3b6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1187 microversion: 2.1 time: 0.096738 Jul 26 14:50:59.352654 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2998/5876] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:50:59 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:00.375170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-167eb116-38d1-4017-b0af-6a4dd4fe643c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:00.375796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-167eb116-38d1-4017-b0af-6a4dd4fe643c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:00.382874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-167eb116-38d1-4017-b0af-6a4dd4fe643c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:00.383336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-167eb116-38d1-4017-b0af-6a4dd4fe643c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:00.384211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-167eb116-38d1-4017-b0af-6a4dd4fe643c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:00.384676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-167eb116-38d1-4017-b0af-6a4dd4fe643c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:00.454950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-167eb116-38d1-4017-b0af-6a4dd4fe643c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:00.464338 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-167eb116-38d1-4017-b0af-6a4dd4fe643c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 200 len: 1187 microversion: 2.1 time: 0.093270 Jul 26 14:51:00.464925 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2879/5877] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:00 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:01.489797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8ee9002c-cbbc-404e-8f08-724446529e83 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:01.490969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8ee9002c-cbbc-404e-8f08-724446529e83 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:01.499292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ee9002c-cbbc-404e-8f08-724446529e83 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:01.499753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ee9002c-cbbc-404e-8f08-724446529e83 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:01.500580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ee9002c-cbbc-404e-8f08-724446529e83 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:01.501026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ee9002c-cbbc-404e-8f08-724446529e83 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:01.515294 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-8ee9002c-cbbc-404e-8f08-724446529e83 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b could not be found. Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8ee9002c-cbbc-404e-8f08-724446529e83 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b HTTP/1.1 Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b could not be found. Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '13e25b6b-06ea-4e22-9bac-8e7561a3bb3b'} Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b could not be found. Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b could not be found. Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:01.517041 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:51:01.522794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:01.522794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:51:01.522794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:51:01.522794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:51:01.522794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:51:01.522794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b could not be found. Jul 26 14:51:01.522794 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:51:01.522794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8ee9002c-cbbc-404e-8f08-724446529e83 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 13e25b6b-06ea-4e22-9bac-8e7561a3bb3b could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:51:01.522794 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8ee9002c-cbbc-404e-8f08-724446529e83 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b" status: 404 len: 111 microversion: 2.1 time: 0.035499 Jul 26 14:51:01.522794 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 2999/5878] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:01 2022] GET /compute/v2.1/servers/13e25b6b-06ea-4e22-9bac-8e7561a3bb3b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:51:05.601181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c9bb5d2-91ed-4ed6-9bcf-225716d87a6c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:05.602496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5c9bb5d2-91ed-4ed6-9bcf-225716d87a6c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:05.610866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c9bb5d2-91ed-4ed6-9bcf-225716d87a6c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:05.611431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c9bb5d2-91ed-4ed6-9bcf-225716d87a6c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:05.613201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c9bb5d2-91ed-4ed6-9bcf-225716d87a6c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:05.614137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c9bb5d2-91ed-4ed6-9bcf-225716d87a6c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:05.643443 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5c9bb5d2-91ed-4ed6-9bcf-225716d87a6c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/ips" status: 200 len: 148 microversion: 2.1 time: 0.047859 Jul 26 14:51:05.645104 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2880/5879] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:51:05 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:07.017560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3823ed56-085b-44ba-adc5-c89fd89aaf59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "105bbbee-1d9b-417a-9371-1e63fa34ff54"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:07.021045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3823ed56-085b-44ba-adc5-c89fd89aaf59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:07.029708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3823ed56-085b-44ba-adc5-c89fd89aaf59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:07.030083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3823ed56-085b-44ba-adc5-c89fd89aaf59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:07.030938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3823ed56-085b-44ba-adc5-c89fd89aaf59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:07.031623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3823ed56-085b-44ba-adc5-c89fd89aaf59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:07.288827 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3823ed56-085b-44ba-adc5-c89fd89aaf59 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274874 Jul 26 14:51:07.295556 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3000/5880] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:51:07 2022] POST /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:18.042083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e901b251-b9ce-4084-8c8e-0b3f692d8f60 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "105bbbee-1d9b-417a-9371-1e63fa34ff54"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:18.044892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e901b251-b9ce-4084-8c8e-0b3f692d8f60 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:18.047812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=13 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:18.048506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=17 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:18.055482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e901b251-b9ce-4084-8c8e-0b3f692d8f60 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:18.056099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e901b251-b9ce-4084-8c8e-0b3f692d8f60 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:18.056899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e901b251-b9ce-4084-8c8e-0b3f692d8f60 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:18.057342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e901b251-b9ce-4084-8c8e-0b3f692d8f60 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:18.139764 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-e901b251-b9ce-4084-8c8e-0b3f692d8f60 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Invalid volume: volume 105bbbee-1d9b-417a-9371-1e63fa34ff54 is already attached to instances: 54a90dca-fd66-404f-af79-45a4ebeb0c74 Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e901b251-b9ce-4084-8c8e-0b3f692d8f60 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments HTTP/1.1 Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 74 Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: {"volumeAttachment": {"volumeId": "105bbbee-1d9b-417a-9371-1e63fa34ff54"}} Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid volume: volume 105bbbee-1d9b-417a-9371-1e63fa34ff54 is already attached to instances: 54a90dca-fd66-404f-af79-45a4ebeb0c74 Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': '54a90dca-fd66-404f-af79-45a4ebeb0c74', 'body': {'volumeAttachment': {'volumeId': '105bbbee-1d9b-417a-9371-1e63fa34ff54'}}} Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 105bbbee-1d9b-417a-9371-1e63fa34ff54 is already attached to instances: 54a90dca-fd66-404f-af79-45a4ebeb0c74 Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:51:18.141636 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 105bbbee-1d9b-417a-9371-1e63fa34ff54 is already attached to instances: 54a90dca-fd66-404f-af79-45a4ebeb0c74 Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 105bbbee-1d9b-417a-9371-1e63fa34ff54 is already attached to instances: 54a90dca-fd66-404f-af79-45a4ebeb0c74 Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e901b251-b9ce-4084-8c8e-0b3f692d8f60 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 400 to user: Invalid volume: volume 105bbbee-1d9b-417a-9371-1e63fa34ff54 is already attached to instances: 54a90dca-fd66-404f-af79-45a4ebeb0c74 {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e901b251-b9ce-4084-8c8e-0b3f692d8f60 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106668 Jul 26 14:51:18.148867 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2881/5881] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:51:18 2022] POST /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 14:51:18.218579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=9 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:18.219362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:18.224955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a7b27c79-ac73-47ea-9b13-2a09a44c6c86 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:18.225543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a7b27c79-ac73-47ea-9b13-2a09a44c6c86 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:18.234679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7b27c79-ac73-47ea-9b13-2a09a44c6c86 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:18.235182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7b27c79-ac73-47ea-9b13-2a09a44c6c86 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:18.236144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7b27c79-ac73-47ea-9b13-2a09a44c6c86 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:18.236589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7b27c79-ac73-47ea-9b13-2a09a44c6c86 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:18.322908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-a7b27c79-ac73-47ea-9b13-2a09a44c6c86 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lazy-loading 'services' on Instance uuid 54a90dca-fd66-404f-af79-45a4ebeb0c74 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:51:18.409854 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a7b27c79-ac73-47ea-9b13-2a09a44c6c86 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments/105bbbee-1d9b-417a-9371-1e63fa34ff54" status: 202 len: 0 microversion: 2.1 time: 0.192194 Jul 26 14:51:18.410760 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3001/5882] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:51:18 2022] DELETE /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments/105bbbee-1d9b-417a-9371-1e63fa34ff54 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:51:18.420628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6493ee72-b7e3-4b04-b942-ccc740fa5f8e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:18.425923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6493ee72-b7e3-4b04-b942-ccc740fa5f8e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:18.434505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6493ee72-b7e3-4b04-b942-ccc740fa5f8e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:18.435160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6493ee72-b7e3-4b04-b942-ccc740fa5f8e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:18.436099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6493ee72-b7e3-4b04-b942-ccc740fa5f8e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:18.436802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6493ee72-b7e3-4b04-b942-ccc740fa5f8e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:18.470509 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6493ee72-b7e3-4b04-b942-ccc740fa5f8e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054499 Jul 26 14:51:18.471088 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2882/5883] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:51:18 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:19.486499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-68288163-4d2b-4d6f-8321-929903f6839b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:19.490978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-68288163-4d2b-4d6f-8321-929903f6839b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:19.506624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68288163-4d2b-4d6f-8321-929903f6839b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:19.507107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68288163-4d2b-4d6f-8321-929903f6839b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:19.508287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68288163-4d2b-4d6f-8321-929903f6839b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:19.508531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68288163-4d2b-4d6f-8321-929903f6839b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:19.554650 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-68288163-4d2b-4d6f-8321-929903f6839b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072965 Jul 26 14:51:19.555559 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3002/5884] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:51:19 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:20.568134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-36bd265b-b034-4624-8acc-876a6a4b0022 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:20.571414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-36bd265b-b034-4624-8acc-876a6a4b0022 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:20.579233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36bd265b-b034-4624-8acc-876a6a4b0022 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:20.579706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36bd265b-b034-4624-8acc-876a6a4b0022 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:20.580658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36bd265b-b034-4624-8acc-876a6a4b0022 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:20.581453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-36bd265b-b034-4624-8acc-876a6a4b0022 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:20.617995 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-36bd265b-b034-4624-8acc-876a6a4b0022 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054849 Jul 26 14:51:20.618769 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2883/5885] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:51:20 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:21.630626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6493f709-3f0d-419c-a39e-5ad199683f20 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:21.632953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6493f709-3f0d-419c-a39e-5ad199683f20 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:21.640241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6493f709-3f0d-419c-a39e-5ad199683f20 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:21.640819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6493f709-3f0d-419c-a39e-5ad199683f20 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:21.641718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6493f709-3f0d-419c-a39e-5ad199683f20 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:21.642265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6493f709-3f0d-419c-a39e-5ad199683f20 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:21.675224 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6493f709-3f0d-419c-a39e-5ad199683f20 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048232 Jul 26 14:51:21.679840 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3003/5886] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:51:21 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:51:22.694548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0a3bded0-d2e5-42c9-834c-922370982694 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:22.704025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0a3bded0-d2e5-42c9-834c-922370982694 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:22.728697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a3bded0-d2e5-42c9-834c-922370982694 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:22.729485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a3bded0-d2e5-42c9-834c-922370982694 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:22.730479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a3bded0-d2e5-42c9-834c-922370982694 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:22.731099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a3bded0-d2e5-42c9-834c-922370982694 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:22.809444 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0a3bded0-d2e5-42c9-834c-922370982694 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125107 Jul 26 14:51:22.810359 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2884/5887] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:51:22 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:23.681137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1777013538", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2185ae09-ccb2-410d-a490-df82ac0eeab2", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e976b6cc-dfb4-45b5-af81-629f1adeef76"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:23.775039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] validate_networks() for [('e976b6cc-dfb4-45b5-af81-629f1adeef76', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:51:23.822122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ba1a616c-c964-425d-8785-5d990e6fddb1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:23.824362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ba1a616c-c964-425d-8785-5d990e6fddb1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:23.831861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba1a616c-c964-425d-8785-5d990e6fddb1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:23.832341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba1a616c-c964-425d-8785-5d990e6fddb1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:23.833124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba1a616c-c964-425d-8785-5d990e6fddb1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:23.833601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba1a616c-c964-425d-8785-5d990e6fddb1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:23.863360 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ba1a616c-c964-425d-8785-5d990e6fddb1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045210 Jul 26 14:51:23.863930 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2885/5888] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:51:23 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 14:51:23.928193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3c5621c6-59b3-4fae-bd60-6e8936b86102 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:23.928705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3c5621c6-59b3-4fae-bd60-6e8936b86102 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:23.934910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c5621c6-59b3-4fae-bd60-6e8936b86102 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:23.935299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c5621c6-59b3-4fae-bd60-6e8936b86102 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:23.936102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c5621c6-59b3-4fae-bd60-6e8936b86102 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:23.936565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c5621c6-59b3-4fae-bd60-6e8936b86102 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:23.962787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3c5621c6-59b3-4fae-bd60-6e8936b86102 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:51:24.048388 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3c5621c6-59b3-4fae-bd60-6e8936b86102 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 204 len: 0 microversion: 2.1 time: 0.124305 Jul 26 14:51:24.049878 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2886/5889] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:51:23 2022] DELETE /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:51:24.059135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3bf72297-858e-4dac-9767-c5b1798fd00e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:24.060054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3bf72297-858e-4dac-9767-c5b1798fd00e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:24.072005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bf72297-858e-4dac-9767-c5b1798fd00e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:24.072752 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bf72297-858e-4dac-9767-c5b1798fd00e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:24.073587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bf72297-858e-4dac-9767-c5b1798fd00e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:24.074175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3bf72297-858e-4dac-9767-c5b1798fd00e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:24.599019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3bf72297-858e-4dac-9767-c5b1798fd00e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:24.608001 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3bf72297-858e-4dac-9767-c5b1798fd00e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1680 microversion: 2.1 time: 0.553538 Jul 26 14:51:24.608604 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2887/5890] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:24 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1680 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:51:24.640361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:51:24.640795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:51:24.641279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:51:24.641736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:51:24.642191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:51:24.655876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:24.656349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:24.657155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:24.657603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:24.675867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:51:24.681261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for user ac9553617f2440a68e33b82650206cae and project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:51:24.695251 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:51:24.697306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2185ae09-ccb2-410d-a490-df82ac0eeab2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:51:24.773799 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a67f2fef-26be-4bc5-b5b8-425c1848ad08 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096585 Jul 26 14:51:24.774447 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3004/5891] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:51:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:51:24.787184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-41861911-e638-48f9-be34-4f39511e65f1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:24.788140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-41861911-e638-48f9-be34-4f39511e65f1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:24.849212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-41861911-e638-48f9-be34-4f39511e65f1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:24.856450 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-41861911-e638-48f9-be34-4f39511e65f1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1057 microversion: 2.1 time: 0.074133 Jul 26 14:51:24.857095 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2888/5892] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:24 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1057 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:51:25.633100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27394305-26d1-4681-b8e7-a4ff5b6d2715 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:25.633993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27394305-26d1-4681-b8e7-a4ff5b6d2715 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:25.644139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27394305-26d1-4681-b8e7-a4ff5b6d2715 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:25.644606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27394305-26d1-4681-b8e7-a4ff5b6d2715 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:25.645404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27394305-26d1-4681-b8e7-a4ff5b6d2715 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:25.645879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27394305-26d1-4681-b8e7-a4ff5b6d2715 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:25.861083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27394305-26d1-4681-b8e7-a4ff5b6d2715 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:25.870686 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27394305-26d1-4681-b8e7-a4ff5b6d2715 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1680 microversion: 2.1 time: 0.243518 Jul 26 14:51:25.871267 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3005/5893] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:25 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1680 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:25.877443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-21c83bd6-e9d8-4788-a25f-d5217f7a30bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:25.878213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-21c83bd6-e9d8-4788-a25f-d5217f7a30bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:25.886278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21c83bd6-e9d8-4788-a25f-d5217f7a30bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:25.887007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21c83bd6-e9d8-4788-a25f-d5217f7a30bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:25.887788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21c83bd6-e9d8-4788-a25f-d5217f7a30bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:25.888612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21c83bd6-e9d8-4788-a25f-d5217f7a30bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:25.979602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-21c83bd6-e9d8-4788-a25f-d5217f7a30bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:25.987848 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-21c83bd6-e9d8-4788-a25f-d5217f7a30bc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1109 microversion: 2.1 time: 0.114220 Jul 26 14:51:25.988456 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2889/5894] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:25 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1109 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:26.894001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d8f24e2f-56f8-47f9-8ba9-2ce6fd434636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:26.894834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d8f24e2f-56f8-47f9-8ba9-2ce6fd434636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:26.902457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8f24e2f-56f8-47f9-8ba9-2ce6fd434636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:26.902921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8f24e2f-56f8-47f9-8ba9-2ce6fd434636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:26.903843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8f24e2f-56f8-47f9-8ba9-2ce6fd434636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:26.905925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8f24e2f-56f8-47f9-8ba9-2ce6fd434636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:27.012313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f32cc5aa-52a6-4a18-ba83-72750e6cfe6d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:27.013332 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f32cc5aa-52a6-4a18-ba83-72750e6cfe6d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:27.021114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f32cc5aa-52a6-4a18-ba83-72750e6cfe6d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:27.022082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f32cc5aa-52a6-4a18-ba83-72750e6cfe6d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:27.024468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f32cc5aa-52a6-4a18-ba83-72750e6cfe6d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:27.025160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f32cc5aa-52a6-4a18-ba83-72750e6cfe6d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:27.035798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d8f24e2f-56f8-47f9-8ba9-2ce6fd434636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:27.052723 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d8f24e2f-56f8-47f9-8ba9-2ce6fd434636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 200 len: 1612 microversion: 2.1 time: 0.162480 Jul 26 14:51:27.054066 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3006/5895] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:26 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 1612 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:27.257628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f32cc5aa-52a6-4a18-ba83-72750e6cfe6d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:27.274490 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f32cc5aa-52a6-4a18-ba83-72750e6cfe6d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1127 microversion: 2.1 time: 0.268814 Jul 26 14:51:27.275685 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2890/5896] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:27 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1127 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:27.281697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-46f93607-a50f-40b1-ad05-642c5828f2d0 req-97091808-83b7-4f00-8af0-8da4a40a4fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a90dca-fd66-404f-af79-45a4ebeb0c74", "name": "network-vif-deleted", "tag": "974a6210-cb7b-47e5-95b3-6a2523b05ac6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:27.302257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-46f93607-a50f-40b1-ad05-642c5828f2d0 req-97091808-83b7-4f00-8af0-8da4a40a4fd0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:27.303073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-46f93607-a50f-40b1-ad05-642c5828f2d0 req-97091808-83b7-4f00-8af0-8da4a40a4fd0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:27.323806 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-46f93607-a50f-40b1-ad05-642c5828f2d0 req-97091808-83b7-4f00-8af0-8da4a40a4fd0 service nova] Creating event network-vif-deleted:974a6210-cb7b-47e5-95b3-6a2523b05ac6 for instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 on n-h2-833090-9 Jul 26 14:51:27.346916 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-46f93607-a50f-40b1-ad05-642c5828f2d0 req-97091808-83b7-4f00-8af0-8da4a40a4fd0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072165 Jul 26 14:51:27.351153 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3007/5897] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:28.079454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0533f18-43d3-414b-93f5-42b4f028a4d6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:28.089847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c0533f18-43d3-414b-93f5-42b4f028a4d6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:28.102695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0533f18-43d3-414b-93f5-42b4f028a4d6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:28.104291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0533f18-43d3-414b-93f5-42b4f028a4d6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:28.105450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0533f18-43d3-414b-93f5-42b4f028a4d6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:28.106179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0533f18-43d3-414b-93f5-42b4f028a4d6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:28.135804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c0533f18-43d3-414b-93f5-42b4f028a4d6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0533f18-43d3-414b-93f5-42b4f028a4d6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 HTTP/1.1 Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '54a90dca-fd66-404f-af79-45a4ebeb0c74'} Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:28.137540 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:28.141846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:28.141846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:51:28.141846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:51:28.141846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:51:28.141846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:51:28.141846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:51:28.141846 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:28.141846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0533f18-43d3-414b-93f5-42b4f028a4d6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:51:28.141846 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c0533f18-43d3-414b-93f5-42b4f028a4d6 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 404 len: 111 microversion: 2.1 time: 0.064089 Jul 26 14:51:28.141846 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2891/5898] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:28 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:51:28.151426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ded9faab-81c3-442d-b70e-9d2d03b09cf9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '.version_select at 0x7f8786d0b700>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:28.174169 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ded9faab-81c3-442d-b70e-9d2d03b09cf9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1541306155" status: 202 len: 0 microversion: 2.1 time: 0.029622 Jul 26 14:51:28.175845 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3008/5899] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Jul 26 14:51:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1541306155 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:51:28.309469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-afb37c98-0363-4cc0-b723-88b8b4dfd7a8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:28.310728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-afb37c98-0363-4cc0-b723-88b8b4dfd7a8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:28.321230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afb37c98-0363-4cc0-b723-88b8b4dfd7a8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:28.321685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afb37c98-0363-4cc0-b723-88b8b4dfd7a8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:28.322886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afb37c98-0363-4cc0-b723-88b8b4dfd7a8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:28.323497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-afb37c98-0363-4cc0-b723-88b8b4dfd7a8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:28.787801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-afb37c98-0363-4cc0-b723-88b8b4dfd7a8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:28.803191 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-afb37c98-0363-4cc0-b723-88b8b4dfd7a8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1169 microversion: 2.1 time: 0.497845 Jul 26 14:51:28.804069 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2892/5900] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:28 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1169 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:29.122050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5f5b8637-799d-4d8a-9366-4466c0e0445a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: .version_select at 0x7f8786ab9160>, body: {"keypair": {"name": "tempest-keypair-34349665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCwCPrrQgYYQo8n3+boV/RrotMmtPgLRSv5s/HfCCWuK+5Quhqkvhcqbp2jGbAXoXbMggRWNcaEV77UFkyeizRCnsS7FBIE+Agg1FMJ324oNgAcaWnZie+hyp1YRCKYIQ=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:29.145944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-5f5b8637-799d-4d8a-9366-4466c0e0445a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:51:29.153679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-5f5b8637-799d-4d8a-9366-4466c0e0445a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for user df60439bde7a40938de3990499a342fc and project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:51:29.180368 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5f5b8637-799d-4d8a-9366-4466c0e0445a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.062057 Jul 26 14:51:29.187336 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3009/5901] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:51:29 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:29.391854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-65eadf85-0368-4f0c-92b8-f3f3a7fe8962 req-e98cb221-aaf1-4535-88b7-0c6d0c5ee7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49126479-d113-4aae-afb4-3360d66b54d6", "tag": "489e95e9-5169-4392-92c9-ba40b2124f92"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:29.406753 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-65eadf85-0368-4f0c-92b8-f3f3a7fe8962 req-e98cb221-aaf1-4535-88b7-0c6d0c5ee7ff service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:29.407377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-65eadf85-0368-4f0c-92b8-f3f3a7fe8962 req-e98cb221-aaf1-4535-88b7-0c6d0c5ee7ff service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:29.421416 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-65eadf85-0368-4f0c-92b8-f3f3a7fe8962 req-e98cb221-aaf1-4535-88b7-0c6d0c5ee7ff service nova] Creating event network-changed:489e95e9-5169-4392-92c9-ba40b2124f92 for instance 49126479-d113-4aae-afb4-3360d66b54d6 on n-h1-833090-9 Jul 26 14:51:29.427760 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-65eadf85-0368-4f0c-92b8-f3f3a7fe8962 req-e98cb221-aaf1-4535-88b7-0c6d0c5ee7ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042192 Jul 26 14:51:29.428483 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2893/5902] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:51:29.826555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cc38c28a-1f97-439e-9c53-2a95872f50cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:29.827636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cc38c28a-1f97-439e-9c53-2a95872f50cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:29.840903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc38c28a-1f97-439e-9c53-2a95872f50cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:29.841740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc38c28a-1f97-439e-9c53-2a95872f50cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:29.842954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc38c28a-1f97-439e-9c53-2a95872f50cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:29.843811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc38c28a-1f97-439e-9c53-2a95872f50cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:30.106011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cc38c28a-1f97-439e-9c53-2a95872f50cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:30.117566 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cc38c28a-1f97-439e-9c53-2a95872f50cc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1169 microversion: 2.1 time: 0.295559 Jul 26 14:51:30.121913 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3010/5903] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:29 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1169 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:31.083643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1519061783", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bea5649-0c21-48c4-9c64-ad69cc72b39d"}], "security_groups": [{"name": "tempest-securitygroup--1321334481"}], "key_name": "tempest-keypair-34349665", "user_data": "}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:31.142858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e8332788-d40f-4ab5-885e-df78443ecd29 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:31.143759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e8332788-d40f-4ab5-885e-df78443ecd29 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:31.151285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8332788-d40f-4ab5-885e-df78443ecd29 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:31.151745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8332788-d40f-4ab5-885e-df78443ecd29 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:31.152813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8332788-d40f-4ab5-885e-df78443ecd29 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:31.153276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8332788-d40f-4ab5-885e-df78443ecd29 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:31.318246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] validate_networks() for [('5bea5649-0c21-48c4-9c64-ad69cc72b39d', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:51:31.590374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e8332788-d40f-4ab5-885e-df78443ecd29 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:31.604929 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e8332788-d40f-4ab5-885e-df78443ecd29 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1169 microversion: 2.1 time: 0.465604 Jul 26 14:51:31.606496 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3011/5904] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:31 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1169 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:51:32.255200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:51:32.255750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:51:32.256319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:51:32.256850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:51:32.257270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:51:32.266387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:32.266839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:32.267756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:32.268238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:32.288543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:51:32.296475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Getting quotas for user df60439bde7a40938de3990499a342fc and project 2eb67d4af2924c9f8e40b33e83d5901e. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:51:32.318556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:51:32.321013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:51:32.394814 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-60c7a34b-ae6a-42bf-b7a2-8eaf4856833c tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.317377 Jul 26 14:51:32.395731 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2894/5905] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:51:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:51:32.407580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-25903e98-c5d7-4b24-ac47-5b71b6878636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:32.408242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-25903e98-c5d7-4b24-ac47-5b71b6878636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:32.476523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25903e98-c5d7-4b24-ac47-5b71b6878636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:32.483943 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-25903e98-c5d7-4b24-ac47-5b71b6878636 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1240 microversion: 2.1 time: 0.080832 Jul 26 14:51:32.484559 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3012/5906] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:32 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:32.630524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-706e5223-dafd-4e85-8355-e7a6d89603c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:32.632095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-706e5223-dafd-4e85-8355-e7a6d89603c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:32.640758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-706e5223-dafd-4e85-8355-e7a6d89603c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:32.641227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-706e5223-dafd-4e85-8355-e7a6d89603c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:32.642020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-706e5223-dafd-4e85-8355-e7a6d89603c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:32.642531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-706e5223-dafd-4e85-8355-e7a6d89603c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:32.815934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-706e5223-dafd-4e85-8355-e7a6d89603c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:32.825708 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-706e5223-dafd-4e85-8355-e7a6d89603c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1169 microversion: 2.1 time: 0.200563 Jul 26 14:51:32.826300 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2895/5907] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:32 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1169 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:33.506891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-654b9d82-6a99-4ae9-b491-caa0684cb329 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:33.507531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-654b9d82-6a99-4ae9-b491-caa0684cb329 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:33.519490 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-654b9d82-6a99-4ae9-b491-caa0684cb329 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:33.520792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-654b9d82-6a99-4ae9-b491-caa0684cb329 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:33.522163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-654b9d82-6a99-4ae9-b491-caa0684cb329 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:33.523263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-654b9d82-6a99-4ae9-b491-caa0684cb329 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:33.602716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-654b9d82-6a99-4ae9-b491-caa0684cb329 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:33.615438 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-654b9d82-6a99-4ae9-b491-caa0684cb329 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1236 microversion: 2.1 time: 0.112051 Jul 26 14:51:33.616341 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3013/5908] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:33 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1236 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:33.855386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7e5ccd1a-43e2-4959-8444-931f90f7c23c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:33.856697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7e5ccd1a-43e2-4959-8444-931f90f7c23c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:33.864017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e5ccd1a-43e2-4959-8444-931f90f7c23c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:33.864714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e5ccd1a-43e2-4959-8444-931f90f7c23c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:33.865660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e5ccd1a-43e2-4959-8444-931f90f7c23c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:33.866255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7e5ccd1a-43e2-4959-8444-931f90f7c23c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:34.025684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7e5ccd1a-43e2-4959-8444-931f90f7c23c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:34.037470 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7e5ccd1a-43e2-4959-8444-931f90f7c23c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1169 microversion: 2.1 time: 0.188338 Jul 26 14:51:34.038061 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2896/5909] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:33 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1169 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:34.639201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c2625c60-4e5c-4bbb-9f8e-0e1149681bd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:34.641366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c2625c60-4e5c-4bbb-9f8e-0e1149681bd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:34.652221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2625c60-4e5c-4bbb-9f8e-0e1149681bd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:34.652764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2625c60-4e5c-4bbb-9f8e-0e1149681bd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:34.653689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2625c60-4e5c-4bbb-9f8e-0e1149681bd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:34.654326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c2625c60-4e5c-4bbb-9f8e-0e1149681bd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:34.676397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:34.750673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c2625c60-4e5c-4bbb-9f8e-0e1149681bd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:34.761827 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c2625c60-4e5c-4bbb-9f8e-0e1149681bd9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1298 microversion: 2.1 time: 0.127141 Jul 26 14:51:34.776126 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3014/5910] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:34 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:35.063084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a09e7f0f-d146-4dfe-a9e0-093a19593c68 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:35.063725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a09e7f0f-d146-4dfe-a9e0-093a19593c68 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:35.072666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a09e7f0f-d146-4dfe-a9e0-093a19593c68 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:35.073781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a09e7f0f-d146-4dfe-a9e0-093a19593c68 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:35.074361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a09e7f0f-d146-4dfe-a9e0-093a19593c68 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:35.074814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a09e7f0f-d146-4dfe-a9e0-093a19593c68 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:35.309365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a09e7f0f-d146-4dfe-a9e0-093a19593c68 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:35.319332 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a09e7f0f-d146-4dfe-a9e0-093a19593c68 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1169 microversion: 2.1 time: 0.262639 Jul 26 14:51:35.319911 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2897/5911] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:35 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1169 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:35.785986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1abbf762-d8e6-4781-b7f9-7e2260219e19 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:35.786617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1abbf762-d8e6-4781-b7f9-7e2260219e19 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:35.794495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1abbf762-d8e6-4781-b7f9-7e2260219e19 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:35.795085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1abbf762-d8e6-4781-b7f9-7e2260219e19 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:35.795921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1abbf762-d8e6-4781-b7f9-7e2260219e19 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:35.796497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1abbf762-d8e6-4781-b7f9-7e2260219e19 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:36.169974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1abbf762-d8e6-4781-b7f9-7e2260219e19 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:36.178440 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1abbf762-d8e6-4781-b7f9-7e2260219e19 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1366 microversion: 2.1 time: 0.397141 Jul 26 14:51:36.179023 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3015/5912] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:35 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:51:36.342449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b0295bc-a1f9-457b-bfda-87791082116b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:36.343002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b0295bc-a1f9-457b-bfda-87791082116b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:36.351563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0295bc-a1f9-457b-bfda-87791082116b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:36.352055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0295bc-a1f9-457b-bfda-87791082116b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:36.352849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0295bc-a1f9-457b-bfda-87791082116b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:36.353297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b0295bc-a1f9-457b-bfda-87791082116b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:36.568020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b0295bc-a1f9-457b-bfda-87791082116b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:36.572305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:36.578203 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b0295bc-a1f9-457b-bfda-87791082116b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1169 microversion: 2.1 time: 0.239833 Jul 26 14:51:36.579578 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2898/5913] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:36 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1169 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:36.647778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2c546429-c0b0-428b-8492-fb3f231f45d7 req-e6087a6a-d85e-47e7-b3d0-8ea510b82d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d358f20-c4bc-4da0-b6fd-d111b32ab9e2", "tag": "c31d0c23-5460-494a-869e-2d41bee0c9e6"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:36.669417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2c546429-c0b0-428b-8492-fb3f231f45d7 req-e6087a6a-d85e-47e7-b3d0-8ea510b82d0a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:36.669965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2c546429-c0b0-428b-8492-fb3f231f45d7 req-e6087a6a-d85e-47e7-b3d0-8ea510b82d0a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:36.684505 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2c546429-c0b0-428b-8492-fb3f231f45d7 req-e6087a6a-d85e-47e7-b3d0-8ea510b82d0a service nova] Creating event network-changed:c31d0c23-5460-494a-869e-2d41bee0c9e6 for instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 on n-h2-833090-9 Jul 26 14:51:36.689928 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2c546429-c0b0-428b-8492-fb3f231f45d7 req-e6087a6a-d85e-47e7-b3d0-8ea510b82d0a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046299 Jul 26 14:51:36.691773 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3016/5914] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:37.199600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-27d1a3eb-629b-4b5c-9ba9-5a78e92c2612 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:37.200302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-27d1a3eb-629b-4b5c-9ba9-5a78e92c2612 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:37.208958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27d1a3eb-629b-4b5c-9ba9-5a78e92c2612 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:37.209419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27d1a3eb-629b-4b5c-9ba9-5a78e92c2612 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:37.210205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27d1a3eb-629b-4b5c-9ba9-5a78e92c2612 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:37.210686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27d1a3eb-629b-4b5c-9ba9-5a78e92c2612 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:37.355438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-27d1a3eb-629b-4b5c-9ba9-5a78e92c2612 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:37.363874 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-27d1a3eb-629b-4b5c-9ba9-5a78e92c2612 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1366 microversion: 2.1 time: 0.169009 Jul 26 14:51:37.364841 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2899/5915] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:37 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:37.603034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b316f807-7b4d-4106-9622-ecced4c945e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:37.603751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b316f807-7b4d-4106-9622-ecced4c945e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:37.611183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b316f807-7b4d-4106-9622-ecced4c945e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:37.612292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b316f807-7b4d-4106-9622-ecced4c945e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:37.613103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b316f807-7b4d-4106-9622-ecced4c945e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:37.613545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b316f807-7b4d-4106-9622-ecced4c945e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:37.761975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b316f807-7b4d-4106-9622-ecced4c945e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:37.771063 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b316f807-7b4d-4106-9622-ecced4c945e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1169 microversion: 2.1 time: 0.173786 Jul 26 14:51:37.771640 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3017/5916] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:37 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1169 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:38.384665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-579ce5e7-2505-428a-b430-0aa95dc0c23b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:38.385287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-579ce5e7-2505-428a-b430-0aa95dc0c23b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:38.413362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-579ce5e7-2505-428a-b430-0aa95dc0c23b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:38.413815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-579ce5e7-2505-428a-b430-0aa95dc0c23b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:38.414855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-579ce5e7-2505-428a-b430-0aa95dc0c23b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:38.415469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-579ce5e7-2505-428a-b430-0aa95dc0c23b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:38.636264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-579ce5e7-2505-428a-b430-0aa95dc0c23b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:38.646930 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-579ce5e7-2505-428a-b430-0aa95dc0c23b tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1366 microversion: 2.1 time: 0.266444 Jul 26 14:51:38.648629 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2900/5917] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:38 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:38.794514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f8dc7b64-25af-444d-8080-b2df2dfed7da tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:38.795441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f8dc7b64-25af-444d-8080-b2df2dfed7da tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:38.803745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8dc7b64-25af-444d-8080-b2df2dfed7da tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:38.804256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8dc7b64-25af-444d-8080-b2df2dfed7da tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:38.805058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8dc7b64-25af-444d-8080-b2df2dfed7da tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:38.805509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8dc7b64-25af-444d-8080-b2df2dfed7da tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:38.963420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f8dc7b64-25af-444d-8080-b2df2dfed7da tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:38.972241 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f8dc7b64-25af-444d-8080-b2df2dfed7da tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1169 microversion: 2.1 time: 0.181396 Jul 26 14:51:38.972846 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3018/5918] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:38 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1169 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:39.669873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-07a33eea-8595-40e9-8ef6-0101e6c3466d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:39.670491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-07a33eea-8595-40e9-8ef6-0101e6c3466d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:39.679061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07a33eea-8595-40e9-8ef6-0101e6c3466d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:39.679517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07a33eea-8595-40e9-8ef6-0101e6c3466d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:39.680394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07a33eea-8595-40e9-8ef6-0101e6c3466d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:39.680787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07a33eea-8595-40e9-8ef6-0101e6c3466d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:39.819082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-07a33eea-8595-40e9-8ef6-0101e6c3466d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:39.826986 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-07a33eea-8595-40e9-8ef6-0101e6c3466d tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1366 microversion: 2.1 time: 0.161402 Jul 26 14:51:39.827558 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2901/5919] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:39 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:39.997764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a67546d5-8335-42bb-8b19-84525c654a5a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:39.998929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a67546d5-8335-42bb-8b19-84525c654a5a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:40.008127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a67546d5-8335-42bb-8b19-84525c654a5a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:40.008624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a67546d5-8335-42bb-8b19-84525c654a5a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:40.009410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a67546d5-8335-42bb-8b19-84525c654a5a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:40.009855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a67546d5-8335-42bb-8b19-84525c654a5a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:40.166576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a67546d5-8335-42bb-8b19-84525c654a5a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:40.180512 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a67546d5-8335-42bb-8b19-84525c654a5a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1169 microversion: 2.1 time: 0.190348 Jul 26 14:51:40.181205 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3019/5920] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:39 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1169 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:40.280355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-277f090a-c792-4ee4-83e7-e1cb7ce18ef6 req-d2ddc851-31ae-4263-8759-b949af1a6178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d358f20-c4bc-4da0-b6fd-d111b32ab9e2", "name": "network-vif-plugged", "status": "completed", "tag": "c31d0c23-5460-494a-869e-2d41bee0c9e6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:40.291941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-277f090a-c792-4ee4-83e7-e1cb7ce18ef6 req-d2ddc851-31ae-4263-8759-b949af1a6178 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:40.293329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-277f090a-c792-4ee4-83e7-e1cb7ce18ef6 req-d2ddc851-31ae-4263-8759-b949af1a6178 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:40.307768 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-277f090a-c792-4ee4-83e7-e1cb7ce18ef6 req-d2ddc851-31ae-4263-8759-b949af1a6178 service nova] Creating event network-vif-plugged:c31d0c23-5460-494a-869e-2d41bee0c9e6 for instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 on n-h2-833090-9 Jul 26 14:51:40.315831 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-277f090a-c792-4ee4-83e7-e1cb7ce18ef6 req-d2ddc851-31ae-4263-8759-b949af1a6178 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037124 Jul 26 14:51:40.315831 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2902/5921] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:51:40.849853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c44e64e9-6908-4d88-ab3f-e08b21b483e1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:40.850491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c44e64e9-6908-4d88-ab3f-e08b21b483e1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:40.856980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c44e64e9-6908-4d88-ab3f-e08b21b483e1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:40.857446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c44e64e9-6908-4d88-ab3f-e08b21b483e1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:40.858243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c44e64e9-6908-4d88-ab3f-e08b21b483e1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:40.858695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c44e64e9-6908-4d88-ab3f-e08b21b483e1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:41.022597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c44e64e9-6908-4d88-ab3f-e08b21b483e1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:41.030812 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c44e64e9-6908-4d88-ab3f-e08b21b483e1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1366 microversion: 2.1 time: 0.185828 Jul 26 14:51:41.031406 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3020/5922] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:40 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:41.203788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20594644-af5a-4ec7-81de-6119f1b1d7ca tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:41.204593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-20594644-af5a-4ec7-81de-6119f1b1d7ca tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:41.212295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20594644-af5a-4ec7-81de-6119f1b1d7ca tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:41.212747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20594644-af5a-4ec7-81de-6119f1b1d7ca tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:41.213528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20594644-af5a-4ec7-81de-6119f1b1d7ca tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:41.214266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20594644-af5a-4ec7-81de-6119f1b1d7ca tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:41.368139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-20594644-af5a-4ec7-81de-6119f1b1d7ca tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:41.375896 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-20594644-af5a-4ec7-81de-6119f1b1d7ca tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1215 microversion: 2.1 time: 0.177298 Jul 26 14:51:41.376493 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2903/5923] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:41 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1215 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:42.052485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7448e7f2-218e-4449-aa0b-2611e5b63f2a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:42.053099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7448e7f2-218e-4449-aa0b-2611e5b63f2a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:42.061044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7448e7f2-218e-4449-aa0b-2611e5b63f2a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:42.061505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7448e7f2-218e-4449-aa0b-2611e5b63f2a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:42.062272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7448e7f2-218e-4449-aa0b-2611e5b63f2a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:42.062712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7448e7f2-218e-4449-aa0b-2611e5b63f2a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:42.204788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7448e7f2-218e-4449-aa0b-2611e5b63f2a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:42.208927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:42.214154 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7448e7f2-218e-4449-aa0b-2611e5b63f2a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1554 microversion: 2.1 time: 0.166222 Jul 26 14:51:42.214721 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3021/5924] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:42 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:42.235530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-330b0a12-9b33-48df-b968-17d374f943e5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:42.236092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-330b0a12-9b33-48df-b968-17d374f943e5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:42.243224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-330b0a12-9b33-48df-b968-17d374f943e5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:42.243707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-330b0a12-9b33-48df-b968-17d374f943e5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:42.244943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-330b0a12-9b33-48df-b968-17d374f943e5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:42.245378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-330b0a12-9b33-48df-b968-17d374f943e5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:42.277345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:42.309103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:42.326321 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-330b0a12-9b33-48df-b968-17d374f943e5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094699 Jul 26 14:51:42.326956 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2904/5925] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 14:51:42 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:42.405075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7f36d700-27e2-4ed9-81c4-2ca5fda06e2a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:42.405733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7f36d700-27e2-4ed9-81c4-2ca5fda06e2a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:42.414556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f36d700-27e2-4ed9-81c4-2ca5fda06e2a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:42.415012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f36d700-27e2-4ed9-81c4-2ca5fda06e2a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:42.415798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f36d700-27e2-4ed9-81c4-2ca5fda06e2a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:42.416266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7f36d700-27e2-4ed9-81c4-2ca5fda06e2a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:42.483726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:42.663068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7f36d700-27e2-4ed9-81c4-2ca5fda06e2a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:42.671056 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7f36d700-27e2-4ed9-81c4-2ca5fda06e2a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1203 microversion: 2.1 time: 0.269910 Jul 26 14:51:42.671768 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3022/5926] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:42 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1203 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:43.366901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-493cfa47-6fc5-41b3-8093-810b5c5a6601 req-c31061be-38c0-43a3-a50d-e1925462585b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d358f20-c4bc-4da0-b6fd-d111b32ab9e2", "tag": "c31d0c23-5460-494a-869e-2d41bee0c9e6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:43.376929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-493cfa47-6fc5-41b3-8093-810b5c5a6601 req-c31061be-38c0-43a3-a50d-e1925462585b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:43.377976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-493cfa47-6fc5-41b3-8093-810b5c5a6601 req-c31061be-38c0-43a3-a50d-e1925462585b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:43.389725 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-493cfa47-6fc5-41b3-8093-810b5c5a6601 req-c31061be-38c0-43a3-a50d-e1925462585b service nova] Creating event network-changed:c31d0c23-5460-494a-869e-2d41bee0c9e6 for instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 on n-h2-833090-9 Jul 26 14:51:43.395823 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-493cfa47-6fc5-41b3-8093-810b5c5a6601 req-c31061be-38c0-43a3-a50d-e1925462585b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033804 Jul 26 14:51:43.396545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2905/5927] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:43.694948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-669ebe2e-bed4-40af-b6ae-ff4e4f49ada2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:43.695576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-669ebe2e-bed4-40af-b6ae-ff4e4f49ada2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:43.703377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-669ebe2e-bed4-40af-b6ae-ff4e4f49ada2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:43.704679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-669ebe2e-bed4-40af-b6ae-ff4e4f49ada2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:43.705282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-669ebe2e-bed4-40af-b6ae-ff4e4f49ada2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:43.706161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-669ebe2e-bed4-40af-b6ae-ff4e4f49ada2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:43.903426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-669ebe2e-bed4-40af-b6ae-ff4e4f49ada2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:43.913185 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-669ebe2e-bed4-40af-b6ae-ff4e4f49ada2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1203 microversion: 2.1 time: 0.223443 Jul 26 14:51:43.913780 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3023/5928] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:43 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1203 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:44.937644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4e91604b-3988-4c01-af00-7ce3bf950343 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:44.938355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4e91604b-3988-4c01-af00-7ce3bf950343 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:44.945673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e91604b-3988-4c01-af00-7ce3bf950343 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:44.946129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e91604b-3988-4c01-af00-7ce3bf950343 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:44.946900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e91604b-3988-4c01-af00-7ce3bf950343 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:44.947364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e91604b-3988-4c01-af00-7ce3bf950343 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:45.088781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4e91604b-3988-4c01-af00-7ce3bf950343 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:45.097774 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4e91604b-3988-4c01-af00-7ce3bf950343 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1203 microversion: 2.1 time: 0.165044 Jul 26 14:51:45.098383 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2906/5929] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:44 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:46.119034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7fe914e7-6fd1-4305-b152-05c728c20770 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:46.119709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7fe914e7-6fd1-4305-b152-05c728c20770 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:46.126570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fe914e7-6fd1-4305-b152-05c728c20770 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:46.127036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fe914e7-6fd1-4305-b152-05c728c20770 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:46.128136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fe914e7-6fd1-4305-b152-05c728c20770 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:46.128635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7fe914e7-6fd1-4305-b152-05c728c20770 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:46.260812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7fe914e7-6fd1-4305-b152-05c728c20770 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:46.269077 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7fe914e7-6fd1-4305-b152-05c728c20770 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1203 microversion: 2.1 time: 0.153569 Jul 26 14:51:46.269650 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3024/5930] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:46 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:47.290854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff43789f-ead4-4a45-a1b6-5b8915f9a825 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:47.291549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ff43789f-ead4-4a45-a1b6-5b8915f9a825 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:47.299086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff43789f-ead4-4a45-a1b6-5b8915f9a825 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:47.300164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff43789f-ead4-4a45-a1b6-5b8915f9a825 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:47.301110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff43789f-ead4-4a45-a1b6-5b8915f9a825 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:47.301558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff43789f-ead4-4a45-a1b6-5b8915f9a825 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:47.434686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ff43789f-ead4-4a45-a1b6-5b8915f9a825 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:47.442854 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff43789f-ead4-4a45-a1b6-5b8915f9a825 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1203 microversion: 2.1 time: 0.155916 Jul 26 14:51:47.443429 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2907/5931] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:47 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:48.465080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1f8d360e-0990-46d2-ae42-811962b2b609 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:48.465779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1f8d360e-0990-46d2-ae42-811962b2b609 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:48.468540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:48.474956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f8d360e-0990-46d2-ae42-811962b2b609 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:48.475429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f8d360e-0990-46d2-ae42-811962b2b609 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:48.476217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f8d360e-0990-46d2-ae42-811962b2b609 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:48.476666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f8d360e-0990-46d2-ae42-811962b2b609 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:48.614851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1f8d360e-0990-46d2-ae42-811962b2b609 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:48.622696 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1f8d360e-0990-46d2-ae42-811962b2b609 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1203 microversion: 2.1 time: 0.161598 Jul 26 14:51:48.623579 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3025/5932] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:48 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:49.650549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-47ecc4b9-191c-4554-bede-31d402568b67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:49.651091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-47ecc4b9-191c-4554-bede-31d402568b67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:49.653526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:49.659413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47ecc4b9-191c-4554-bede-31d402568b67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:49.659872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47ecc4b9-191c-4554-bede-31d402568b67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:49.660659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47ecc4b9-191c-4554-bede-31d402568b67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:49.661099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47ecc4b9-191c-4554-bede-31d402568b67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:49.800113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-47ecc4b9-191c-4554-bede-31d402568b67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:49.807719 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-47ecc4b9-191c-4554-bede-31d402568b67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1203 microversion: 2.1 time: 0.161445 Jul 26 14:51:49.808325 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2908/5933] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:49 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:50.335120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-791f8b52-17e7-44ec-b769-275c98f56596 req-9279e1a6-e2ed-4394-a60f-345046bedc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49126479-d113-4aae-afb4-3360d66b54d6", "name": "network-vif-plugged", "status": "completed", "tag": "489e95e9-5169-4392-92c9-ba40b2124f92"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:50.346096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-791f8b52-17e7-44ec-b769-275c98f56596 req-9279e1a6-e2ed-4394-a60f-345046bedc33 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:50.346807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-791f8b52-17e7-44ec-b769-275c98f56596 req-9279e1a6-e2ed-4394-a60f-345046bedc33 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:50.358191 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-791f8b52-17e7-44ec-b769-275c98f56596 req-9279e1a6-e2ed-4394-a60f-345046bedc33 service nova] Creating event network-vif-plugged:489e95e9-5169-4392-92c9-ba40b2124f92 for instance 49126479-d113-4aae-afb4-3360d66b54d6 on n-h1-833090-9 Jul 26 14:51:50.364381 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-791f8b52-17e7-44ec-b769-275c98f56596 req-9279e1a6-e2ed-4394-a60f-345046bedc33 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033960 Jul 26 14:51:50.365149 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3026/5934] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:51:50.829357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8cda209a-0efb-46ad-8aac-bf8e181011e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:50.829906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8cda209a-0efb-46ad-8aac-bf8e181011e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:50.836945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8cda209a-0efb-46ad-8aac-bf8e181011e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:50.837403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8cda209a-0efb-46ad-8aac-bf8e181011e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:50.838205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8cda209a-0efb-46ad-8aac-bf8e181011e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:50.838646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8cda209a-0efb-46ad-8aac-bf8e181011e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:50.969496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8cda209a-0efb-46ad-8aac-bf8e181011e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:50.977536 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8cda209a-0efb-46ad-8aac-bf8e181011e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1203 microversion: 2.1 time: 0.152149 Jul 26 14:51:50.978103 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2909/5935] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:50 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:52.000455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8f99f732-0692-4522-be84-4b36ffb591a7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:52.001161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8f99f732-0692-4522-be84-4b36ffb591a7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:52.008391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f99f732-0692-4522-be84-4b36ffb591a7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:52.008800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f99f732-0692-4522-be84-4b36ffb591a7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:52.009593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f99f732-0692-4522-be84-4b36ffb591a7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:52.010048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f99f732-0692-4522-be84-4b36ffb591a7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:52.149683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8f99f732-0692-4522-be84-4b36ffb591a7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:52.157680 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8f99f732-0692-4522-be84-4b36ffb591a7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1390 microversion: 2.1 time: 0.162626 Jul 26 14:51:52.158203 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3027/5936] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:51 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:52.178936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0e235e88-ff26-41b2-96f5-7b9ac70213f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:52.179545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0e235e88-ff26-41b2-96f5-7b9ac70213f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:52.186506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e235e88-ff26-41b2-96f5-7b9ac70213f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:52.186948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e235e88-ff26-41b2-96f5-7b9ac70213f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:52.187721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e235e88-ff26-41b2-96f5-7b9ac70213f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:52.188195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e235e88-ff26-41b2-96f5-7b9ac70213f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:52.323358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0e235e88-ff26-41b2-96f5-7b9ac70213f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:52.331876 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0e235e88-ff26-41b2-96f5-7b9ac70213f8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1390 microversion: 2.1 time: 0.156960 Jul 26 14:51:52.332485 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2910/5937] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:52 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:52.351867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4eaf1cc4-631d-470d-b53a-4d118a12e00a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:52.352437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4eaf1cc4-631d-470d-b53a-4d118a12e00a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:52.358609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4eaf1cc4-631d-470d-b53a-4d118a12e00a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:52.359160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4eaf1cc4-631d-470d-b53a-4d118a12e00a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:52.359992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4eaf1cc4-631d-470d-b53a-4d118a12e00a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:52.360438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4eaf1cc4-631d-470d-b53a-4d118a12e00a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:52.496818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4eaf1cc4-631d-470d-b53a-4d118a12e00a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:52.505189 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4eaf1cc4-631d-470d-b53a-4d118a12e00a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1390 microversion: 2.1 time: 0.157250 Jul 26 14:51:52.505767 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3028/5938] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:52 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:51:52.585684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb6f212c-9fe0-47d2-925a-f725b461d2eb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:52.585684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eb6f212c-9fe0-47d2-925a-f725b461d2eb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:52.592392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb6f212c-9fe0-47d2-925a-f725b461d2eb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:52.592843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb6f212c-9fe0-47d2-925a-f725b461d2eb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:52.593613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb6f212c-9fe0-47d2-925a-f725b461d2eb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:52.594048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb6f212c-9fe0-47d2-925a-f725b461d2eb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:52.620885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eb6f212c-9fe0-47d2-925a-f725b461d2eb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:51:52.702435 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eb6f212c-9fe0-47d2-925a-f725b461d2eb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 204 len: 0 microversion: 2.1 time: 0.120167 Jul 26 14:51:52.703454 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2911/5939] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:51:52 2022] DELETE /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:51:52.712702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0c30b3c-a6c5-42e7-be78-4a5338c58487 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:52.713422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0c30b3c-a6c5-42e7-be78-4a5338c58487 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:52.719468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0c30b3c-a6c5-42e7-be78-4a5338c58487 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:52.719931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0c30b3c-a6c5-42e7-be78-4a5338c58487 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:52.720740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0c30b3c-a6c5-42e7-be78-4a5338c58487 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:52.721366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0c30b3c-a6c5-42e7-be78-4a5338c58487 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:52.862184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0c30b3c-a6c5-42e7-be78-4a5338c58487 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:52.869880 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0c30b3c-a6c5-42e7-be78-4a5338c58487 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1396 microversion: 2.1 time: 0.161821 Jul 26 14:51:52.870466 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3029/5940] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:52 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1396 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:53.892108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7da314de-a80c-42e3-8fe9-debd45776ab7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:53.892852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7da314de-a80c-42e3-8fe9-debd45776ab7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:53.900945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7da314de-a80c-42e3-8fe9-debd45776ab7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:53.901397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7da314de-a80c-42e3-8fe9-debd45776ab7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:53.902170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7da314de-a80c-42e3-8fe9-debd45776ab7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:53.902609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7da314de-a80c-42e3-8fe9-debd45776ab7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:54.040598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7da314de-a80c-42e3-8fe9-debd45776ab7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:54.048410 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7da314de-a80c-42e3-8fe9-debd45776ab7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1396 microversion: 2.1 time: 0.160622 Jul 26 14:51:54.048979 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2912/5941] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:53 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:54.668129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-c077b4dc-9afb-457d-90b0-4d51d2ac07fe req-790a772c-07a3-4112-9fc2-7445cbd0171b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49126479-d113-4aae-afb4-3360d66b54d6", "name": "network-vif-deleted", "tag": "489e95e9-5169-4392-92c9-ba40b2124f92"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:54.680875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c077b4dc-9afb-457d-90b0-4d51d2ac07fe req-790a772c-07a3-4112-9fc2-7445cbd0171b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:54.681325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c077b4dc-9afb-457d-90b0-4d51d2ac07fe req-790a772c-07a3-4112-9fc2-7445cbd0171b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:54.700109 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-c077b4dc-9afb-457d-90b0-4d51d2ac07fe req-790a772c-07a3-4112-9fc2-7445cbd0171b service nova] Creating event network-vif-deleted:489e95e9-5169-4392-92c9-ba40b2124f92 for instance 49126479-d113-4aae-afb4-3360d66b54d6 on n-h1-833090-9 Jul 26 14:51:54.706944 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-c077b4dc-9afb-457d-90b0-4d51d2ac07fe req-790a772c-07a3-4112-9fc2-7445cbd0171b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042033 Jul 26 14:51:54.707922 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3030/5942] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:51:55.072072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4bcb394c-e26f-4f30-9988-21427a9349c5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:55.072632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4bcb394c-e26f-4f30-9988-21427a9349c5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:55.081419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bcb394c-e26f-4f30-9988-21427a9349c5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:55.081872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bcb394c-e26f-4f30-9988-21427a9349c5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:55.082653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bcb394c-e26f-4f30-9988-21427a9349c5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:55.083093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bcb394c-e26f-4f30-9988-21427a9349c5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:55.147078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4bcb394c-e26f-4f30-9988-21427a9349c5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:55.154934 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4bcb394c-e26f-4f30-9988-21427a9349c5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1188 microversion: 2.1 time: 0.086925 Jul 26 14:51:55.155497 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2913/5943] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:55 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:56.179622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a1d9ac52-3645-4926-a6c9-2cfd2f902ed4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:56.180352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a1d9ac52-3645-4926-a6c9-2cfd2f902ed4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:56.186855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1d9ac52-3645-4926-a6c9-2cfd2f902ed4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:56.187313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1d9ac52-3645-4926-a6c9-2cfd2f902ed4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:56.188129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1d9ac52-3645-4926-a6c9-2cfd2f902ed4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:56.188578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1d9ac52-3645-4926-a6c9-2cfd2f902ed4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:56.256882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a1d9ac52-3645-4926-a6c9-2cfd2f902ed4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:56.265084 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a1d9ac52-3645-4926-a6c9-2cfd2f902ed4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1188 microversion: 2.1 time: 0.091476 Jul 26 14:51:56.265649 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3031/5944] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:56 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:57.287267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2adb71b1-8074-4969-ad8e-cb12deb0043d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:57.287900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2adb71b1-8074-4969-ad8e-cb12deb0043d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:57.297592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2adb71b1-8074-4969-ad8e-cb12deb0043d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:57.298395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2adb71b1-8074-4969-ad8e-cb12deb0043d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:57.299987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2adb71b1-8074-4969-ad8e-cb12deb0043d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:57.300542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2adb71b1-8074-4969-ad8e-cb12deb0043d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:57.372831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2adb71b1-8074-4969-ad8e-cb12deb0043d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:57.382843 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2adb71b1-8074-4969-ad8e-cb12deb0043d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1188 microversion: 2.1 time: 0.099627 Jul 26 14:51:57.383509 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2914/5945] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:57 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1188 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:58.405420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0772f40-be87-44c3-89aa-2f021c56ad5b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:58.406058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a0772f40-be87-44c3-89aa-2f021c56ad5b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:58.414819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0772f40-be87-44c3-89aa-2f021c56ad5b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:58.415452 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0772f40-be87-44c3-89aa-2f021c56ad5b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:58.416275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0772f40-be87-44c3-89aa-2f021c56ad5b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:58.416729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0772f40-be87-44c3-89aa-2f021c56ad5b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:58.490463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0772f40-be87-44c3-89aa-2f021c56ad5b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:51:58.498891 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a0772f40-be87-44c3-89aa-2f021c56ad5b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 200 len: 1188 microversion: 2.1 time: 0.098078 Jul 26 14:51:58.499478 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3032/5946] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:58 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:51:59.520659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7ccd8dc-156f-473c-b5e5-061d9902f662 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:59.521356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c7ccd8dc-156f-473c-b5e5-061d9902f662 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:51:59.528394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7ccd8dc-156f-473c-b5e5-061d9902f662 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:59.528858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7ccd8dc-156f-473c-b5e5-061d9902f662 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:59.529641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7ccd8dc-156f-473c-b5e5-061d9902f662 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:51:59.530086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7ccd8dc-156f-473c-b5e5-061d9902f662 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:51:59.544322 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c7ccd8dc-156f-473c-b5e5-061d9902f662 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7ccd8dc-156f-473c-b5e5-061d9902f662 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 HTTP/1.1 Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '49126479-d113-4aae-afb4-3360d66b54d6'} Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:59.546286 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:59.552176 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:59.552176 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:51:59.552176 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:51:59.552176 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:51:59.552176 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:51:59.552176 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:51:59.552176 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:51:59.552176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7ccd8dc-156f-473c-b5e5-061d9902f662 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:51:59.552176 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c7ccd8dc-156f-473c-b5e5-061d9902f662 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 404 len: 111 microversion: 2.1 time: 0.031431 Jul 26 14:51:59.552176 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2915/5947] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:51:59 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:52:02.754162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0d0330e-c76c-4a04-a407-807fafa83c7d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:02.754855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a0d0330e-c76c-4a04-a407-807fafa83c7d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:02.761707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d0330e-c76c-4a04-a407-807fafa83c7d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:02.762173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d0330e-c76c-4a04-a407-807fafa83c7d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:02.762965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d0330e-c76c-4a04-a407-807fafa83c7d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:02.763420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0d0330e-c76c-4a04-a407-807fafa83c7d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:02.781129 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a0d0330e-c76c-4a04-a407-807fafa83c7d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0d0330e-c76c-4a04-a407-807fafa83c7d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 HTTP/1.1 Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '49126479-d113-4aae-afb4-3360d66b54d6'} Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:02.782850 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0d0330e-c76c-4a04-a407-807fafa83c7d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a0d0330e-c76c-4a04-a407-807fafa83c7d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 404 len: 111 microversion: 2.1 time: 0.035237 Jul 26 14:52:02.787793 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3033/5948] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:52:02 2022] DELETE /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:52:02.796940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c3ade839-9c46-43a1-b630-dcd18db2773a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:02.798012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c3ade839-9c46-43a1-b630-dcd18db2773a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 49126479-d113-4aae-afb4-3360d66b54d6] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:02.807824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3ade839-9c46-43a1-b630-dcd18db2773a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:02.808445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3ade839-9c46-43a1-b630-dcd18db2773a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:02.809248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3ade839-9c46-43a1-b630-dcd18db2773a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:02.809699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3ade839-9c46-43a1-b630-dcd18db2773a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:02.814302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:02.826499 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c3ade839-9c46-43a1-b630-dcd18db2773a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c3ade839-9c46-43a1-b630-dcd18db2773a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 HTTP/1.1 Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '49126479-d113-4aae-afb4-3360d66b54d6'} Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:02.828395 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:02.834774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:02.834774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:02.834774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:02.834774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:02.834774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:02.834774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. Jul 26 14:52:02.834774 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:02.834774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c3ade839-9c46-43a1-b630-dcd18db2773a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 49126479-d113-4aae-afb4-3360d66b54d6 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:02.834774 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c3ade839-9c46-43a1-b630-dcd18db2773a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6" status: 404 len: 111 microversion: 2.1 time: 0.039917 Jul 26 14:52:02.834774 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2916/5949] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:02 2022] GET /compute/v2.1/servers/49126479-d113-4aae-afb4-3360d66b54d6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:52:15.772936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f6eeb784-b2cd-4d4c-b8b2-68bc657e64c1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:15.774261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f6eeb784-b2cd-4d4c-b8b2-68bc657e64c1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:15.777704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=17 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:15.778428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=60 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:15.782971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6eeb784-b2cd-4d4c-b8b2-68bc657e64c1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:15.783665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6eeb784-b2cd-4d4c-b8b2-68bc657e64c1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:15.784278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6eeb784-b2cd-4d4c-b8b2-68bc657e64c1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:15.784764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6eeb784-b2cd-4d4c-b8b2-68bc657e64c1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:15.816056 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f6eeb784-b2cd-4d4c-b8b2-68bc657e64c1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/ips" status: 200 len: 147 microversion: 2.1 time: 0.047939 Jul 26 14:52:15.816642 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3034/5950] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Jul 26 14:52:15 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/ips => generated 147 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:17.350857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-25b2b671-5bfd-446f-91c1-78947bc660b5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fdccf97-65b3-4aec-aef4-3e377a2ad173"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:17.354017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-25b2b671-5bfd-446f-91c1-78947bc660b5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:17.358858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:17.365262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25b2b671-5bfd-446f-91c1-78947bc660b5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:17.365655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25b2b671-5bfd-446f-91c1-78947bc660b5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:17.366484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25b2b671-5bfd-446f-91c1-78947bc660b5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:17.366910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-25b2b671-5bfd-446f-91c1-78947bc660b5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:17.638354 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-25b2b671-5bfd-446f-91c1-78947bc660b5 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "POST /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295575 Jul 26 14:52:17.639201 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2917/5951] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 14:52:17 2022] POST /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:23.653228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-197738920", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8cbd5ad0-6579-402b-868a-91d01e9e9555", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e976b6cc-dfb4-45b5-af81-629f1adeef76"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:23.716606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] validate_networks() for [('e976b6cc-dfb4-45b5-af81-629f1adeef76', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:52:24.426236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:52:24.426681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:52:24.427171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:52:24.427591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:52:24.428057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:52:24.437773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:24.438231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:24.439042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:24.439491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:24.456772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:52:24.462437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for user ac9553617f2440a68e33b82650206cae and project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:52:24.521345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:52:24.523404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8cbd5ad0-6579-402b-868a-91d01e9e9555',volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:52:24.651436 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-19cf93bd-2ce6-4829-a6ad-c3256dc48c3e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002212 Jul 26 14:52:24.652310 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3035/5952] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:52:24.664839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-22de04c3-5162-4fe5-8ff0-afb301d981c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:24.665553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-22de04c3-5162-4fe5-8ff0-afb301d981c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:24.723037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-22de04c3-5162-4fe5-8ff0-afb301d981c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:24.730032 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-22de04c3-5162-4fe5-8ff0-afb301d981c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1070 microversion: 2.1 time: 0.069685 Jul 26 14:52:24.730607 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2918/5953] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:24 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1070 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:25.753248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c683f385-680a-4952-bc0a-a9e99fa3fd8b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:25.753962 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c683f385-680a-4952-bc0a-a9e99fa3fd8b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:25.763457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c683f385-680a-4952-bc0a-a9e99fa3fd8b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:25.763933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c683f385-680a-4952-bc0a-a9e99fa3fd8b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:25.764765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c683f385-680a-4952-bc0a-a9e99fa3fd8b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:25.765222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c683f385-680a-4952-bc0a-a9e99fa3fd8b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:25.839016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c683f385-680a-4952-bc0a-a9e99fa3fd8b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:25.848962 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c683f385-680a-4952-bc0a-a9e99fa3fd8b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1186 microversion: 2.1 time: 0.102035 Jul 26 14:52:25.849719 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3036/5954] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:25 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1186 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:26.876147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0dc9ff77-4a93-427d-84df-45448884f8ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:26.877161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0dc9ff77-4a93-427d-84df-45448884f8ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:26.886904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dc9ff77-4a93-427d-84df-45448884f8ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:26.888584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dc9ff77-4a93-427d-84df-45448884f8ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:26.890083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dc9ff77-4a93-427d-84df-45448884f8ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:26.890990 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dc9ff77-4a93-427d-84df-45448884f8ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:27.073934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4c628b08-8b68-47ca-9670-8c42aaf3d412 req-7d5a8edc-b973-4236-a9c6-0dbd67c8fb25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50c8b86f-8ee8-4f50-9468-e264a7211af8", "tag": "87c1f720-768e-492c-acda-c8d09d4f8353"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:27.091475 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4c628b08-8b68-47ca-9670-8c42aaf3d412 req-7d5a8edc-b973-4236-a9c6-0dbd67c8fb25 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:27.091938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4c628b08-8b68-47ca-9670-8c42aaf3d412 req-7d5a8edc-b973-4236-a9c6-0dbd67c8fb25 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:27.107096 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4c628b08-8b68-47ca-9670-8c42aaf3d412 req-7d5a8edc-b973-4236-a9c6-0dbd67c8fb25 service nova] Creating event network-changed:87c1f720-768e-492c-acda-c8d09d4f8353 for instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 on n-h1-833090-9 Jul 26 14:52:27.114811 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4c628b08-8b68-47ca-9670-8c42aaf3d412 req-7d5a8edc-b973-4236-a9c6-0dbd67c8fb25 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046403 Jul 26 14:52:27.116453 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3037/5955] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:27.222274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0dc9ff77-4a93-427d-84df-45448884f8ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:27.235041 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0dc9ff77-4a93-427d-84df-45448884f8ee tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1228 microversion: 2.1 time: 0.367394 Jul 26 14:52:27.248637 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2919/5956] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:26 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1228 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:28.260513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-05563421-49c5-41f9-8a1b-26aa9b1e7c27 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:28.261387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-05563421-49c5-41f9-8a1b-26aa9b1e7c27 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:28.269780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05563421-49c5-41f9-8a1b-26aa9b1e7c27 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.270395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05563421-49c5-41f9-8a1b-26aa9b1e7c27 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.271359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05563421-49c5-41f9-8a1b-26aa9b1e7c27 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.271908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-05563421-49c5-41f9-8a1b-26aa9b1e7c27 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.431324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-05563421-49c5-41f9-8a1b-26aa9b1e7c27 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:28.439190 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-05563421-49c5-41f9-8a1b-26aa9b1e7c27 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1228 microversion: 2.1 time: 0.183363 Jul 26 14:52:28.440116 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3038/5957] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:28 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1228 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:28.587737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-862a1ccc-34b7-4595-b479-dc3333df90e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:28.588297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-862a1ccc-34b7-4595-b479-dc3333df90e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:28.595313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-862a1ccc-34b7-4595-b479-dc3333df90e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.595855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-862a1ccc-34b7-4595-b479-dc3333df90e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.597229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-862a1ccc-34b7-4595-b479-dc3333df90e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.597663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-862a1ccc-34b7-4595-b479-dc3333df90e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.684418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-862a1ccc-34b7-4595-b479-dc3333df90e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lazy-loading 'services' on Instance uuid 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:52:28.760050 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-862a1ccc-34b7-4595-b479-dc3333df90e8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments/8fdccf97-65b3-4aec-aef4-3e377a2ad173" status: 202 len: 0 microversion: 2.1 time: 0.176178 Jul 26 14:52:28.760674 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2920/5958] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 14:52:28 2022] DELETE /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments/8fdccf97-65b3-4aec-aef4-3e377a2ad173 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:52:28.770700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1748e768-829f-4ea3-b1f1-dab6af051a91 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:28.772983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1748e768-829f-4ea3-b1f1-dab6af051a91 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:28.779445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1748e768-829f-4ea3-b1f1-dab6af051a91 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.779911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1748e768-829f-4ea3-b1f1-dab6af051a91 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.780724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1748e768-829f-4ea3-b1f1-dab6af051a91 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.781176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1748e768-829f-4ea3-b1f1-dab6af051a91 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.816911 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1748e768-829f-4ea3-b1f1-dab6af051a91 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051353 Jul 26 14:52:28.817493 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3039/5959] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:52:28 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:29.461718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dceb31e9-4f99-4776-9da4-12d9033cbf70 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:29.462429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dceb31e9-4f99-4776-9da4-12d9033cbf70 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:29.469023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dceb31e9-4f99-4776-9da4-12d9033cbf70 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.469473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dceb31e9-4f99-4776-9da4-12d9033cbf70 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.470247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dceb31e9-4f99-4776-9da4-12d9033cbf70 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.470689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dceb31e9-4f99-4776-9da4-12d9033cbf70 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.615599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dceb31e9-4f99-4776-9da4-12d9033cbf70 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:29.623567 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dceb31e9-4f99-4776-9da4-12d9033cbf70 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1228 microversion: 2.1 time: 0.166217 Jul 26 14:52:29.624173 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2921/5960] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:29 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1228 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:29.829872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1797e909-573e-4a2e-9a5b-686049d264d8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:29.832374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1797e909-573e-4a2e-9a5b-686049d264d8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:29.839393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1797e909-573e-4a2e-9a5b-686049d264d8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.839865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1797e909-573e-4a2e-9a5b-686049d264d8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.840700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1797e909-573e-4a2e-9a5b-686049d264d8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.841157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1797e909-573e-4a2e-9a5b-686049d264d8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.872339 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1797e909-573e-4a2e-9a5b-686049d264d8 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046497 Jul 26 14:52:29.872906 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3040/5961] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:52:29 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:30.647261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a52b54cc-0fea-441d-a285-bb691844a11a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:30.648175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a52b54cc-0fea-441d-a285-bb691844a11a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:30.655534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a52b54cc-0fea-441d-a285-bb691844a11a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:30.656396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a52b54cc-0fea-441d-a285-bb691844a11a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:30.657198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a52b54cc-0fea-441d-a285-bb691844a11a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:30.657659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a52b54cc-0fea-441d-a285-bb691844a11a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:30.805646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a52b54cc-0fea-441d-a285-bb691844a11a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:30.814013 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a52b54cc-0fea-441d-a285-bb691844a11a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1228 microversion: 2.1 time: 0.172477 Jul 26 14:52:30.814797 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2922/5962] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:30 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1228 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:30.884849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d28ce81d-3c3e-404e-83ef-421d38e60b11 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:30.887074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d28ce81d-3c3e-404e-83ef-421d38e60b11 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:30.894993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28ce81d-3c3e-404e-83ef-421d38e60b11 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:30.895465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28ce81d-3c3e-404e-83ef-421d38e60b11 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:30.896306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28ce81d-3c3e-404e-83ef-421d38e60b11 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:30.896759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d28ce81d-3c3e-404e-83ef-421d38e60b11 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:30.930014 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d28ce81d-3c3e-404e-83ef-421d38e60b11 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049620 Jul 26 14:52:30.930594 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3041/5963] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:52:30 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:31.835817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4f2718e9-b9db-49be-b167-8a49407353e3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:31.836414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4f2718e9-b9db-49be-b167-8a49407353e3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:31.843382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f2718e9-b9db-49be-b167-8a49407353e3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.843839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f2718e9-b9db-49be-b167-8a49407353e3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.844689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f2718e9-b9db-49be-b167-8a49407353e3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.845134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4f2718e9-b9db-49be-b167-8a49407353e3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.942288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8a668a34-7fd2-4d1d-bd9e-24d99b268614 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:31.944927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8a668a34-7fd2-4d1d-bd9e-24d99b268614 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:31.951450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8a668a34-7fd2-4d1d-bd9e-24d99b268614 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.951910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8a668a34-7fd2-4d1d-bd9e-24d99b268614 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.952932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8a668a34-7fd2-4d1d-bd9e-24d99b268614 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.953381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8a668a34-7fd2-4d1d-bd9e-24d99b268614 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.988780 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8a668a34-7fd2-4d1d-bd9e-24d99b268614 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050457 Jul 26 14:52:31.988972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4f2718e9-b9db-49be-b167-8a49407353e3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:31.989526 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3042/5964] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:52:31 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:31.996894 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4f2718e9-b9db-49be-b167-8a49407353e3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1216 microversion: 2.1 time: 0.165401 Jul 26 14:52:31.997470 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2923/5965] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:31 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:33.002194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d95e2665-1bbb-4804-b2a3-d47a19500301 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:33.005048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d95e2665-1bbb-4804-b2a3-d47a19500301 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:33.011813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d95e2665-1bbb-4804-b2a3-d47a19500301 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:33.012327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d95e2665-1bbb-4804-b2a3-d47a19500301 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.013095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d95e2665-1bbb-4804-b2a3-d47a19500301 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:33.013775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d95e2665-1bbb-4804-b2a3-d47a19500301 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.021292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0db5ae28-5320-4b68-a5d7-96dde45a8d4e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:33.022000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0db5ae28-5320-4b68-a5d7-96dde45a8d4e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:33.029002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db5ae28-5320-4b68-a5d7-96dde45a8d4e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:33.029472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db5ae28-5320-4b68-a5d7-96dde45a8d4e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.030272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db5ae28-5320-4b68-a5d7-96dde45a8d4e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:33.030713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db5ae28-5320-4b68-a5d7-96dde45a8d4e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.058534 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d95e2665-1bbb-4804-b2a3-d47a19500301 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058141 Jul 26 14:52:33.058942 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3043/5966] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:52:32 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:33.175586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0db5ae28-5320-4b68-a5d7-96dde45a8d4e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:33.184199 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0db5ae28-5320-4b68-a5d7-96dde45a8d4e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1216 microversion: 2.1 time: 0.167327 Jul 26 14:52:33.184846 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2924/5967] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:33 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:34.070278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36e06031-260a-481a-8aef-f89fe09840c4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:34.072576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-36e06031-260a-481a-8aef-f89fe09840c4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:34.079753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e06031-260a-481a-8aef-f89fe09840c4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.080778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e06031-260a-481a-8aef-f89fe09840c4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.081976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e06031-260a-481a-8aef-f89fe09840c4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.082609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e06031-260a-481a-8aef-f89fe09840c4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.114623 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-36e06031-260a-481a-8aef-f89fe09840c4 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048341 Jul 26 14:52:34.115396 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3044/5968] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:52:34 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:34.204964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1578241c-639d-489c-8b4f-956ff33efa7f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:34.206454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1578241c-639d-489c-8b4f-956ff33efa7f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:34.213672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1578241c-639d-489c-8b4f-956ff33efa7f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.214128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1578241c-639d-489c-8b4f-956ff33efa7f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.214909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1578241c-639d-489c-8b4f-956ff33efa7f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.215351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1578241c-639d-489c-8b4f-956ff33efa7f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.355501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1578241c-639d-489c-8b4f-956ff33efa7f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:34.363507 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1578241c-639d-489c-8b4f-956ff33efa7f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1216 microversion: 2.1 time: 0.162435 Jul 26 14:52:34.364126 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2925/5969] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:34 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:35.127272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4a3cbec5-3c60-4c66-8ba9-ab4b6b1079af tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:35.129750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4a3cbec5-3c60-4c66-8ba9-ab4b6b1079af tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:35.131770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:35.132466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:35.139550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a3cbec5-3c60-4c66-8ba9-ab4b6b1079af tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.140038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a3cbec5-3c60-4c66-8ba9-ab4b6b1079af tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.140823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a3cbec5-3c60-4c66-8ba9-ab4b6b1079af tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.141268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4a3cbec5-3c60-4c66-8ba9-ab4b6b1079af tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.171119 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4a3cbec5-3c60-4c66-8ba9-ab4b6b1079af tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047901 Jul 26 14:52:35.171672 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3045/5970] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 14:52:35 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:52:35.237467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea177afb-3192-4d4e-a023-b0302d433bfe tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:35.238055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ea177afb-3192-4d4e-a023-b0302d433bfe tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:35.240123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:35.246904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea177afb-3192-4d4e-a023-b0302d433bfe tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.247364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea177afb-3192-4d4e-a023-b0302d433bfe tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.248196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea177afb-3192-4d4e-a023-b0302d433bfe tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.248639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea177afb-3192-4d4e-a023-b0302d433bfe tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.279314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ea177afb-3192-4d4e-a023-b0302d433bfe tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:52:35.364018 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ea177afb-3192-4d4e-a023-b0302d433bfe tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 204 len: 0 microversion: 2.1 time: 0.131145 Jul 26 14:52:35.364927 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2926/5971] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:52:35 2022] DELETE /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:52:35.373516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-191801ac-75af-4e1a-a06d-f38334a3ae42 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:35.374152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-191801ac-75af-4e1a-a06d-f38334a3ae42 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:35.381701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-191801ac-75af-4e1a-a06d-f38334a3ae42 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.382155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-191801ac-75af-4e1a-a06d-f38334a3ae42 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.382973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-191801ac-75af-4e1a-a06d-f38334a3ae42 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.383414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-191801ac-75af-4e1a-a06d-f38334a3ae42 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.385663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f80e3c74-7482-40e1-812f-595583cc8d52 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:35.386387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f80e3c74-7482-40e1-812f-595583cc8d52 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:35.392777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f80e3c74-7482-40e1-812f-595583cc8d52 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.393288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f80e3c74-7482-40e1-812f-595583cc8d52 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.394294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f80e3c74-7482-40e1-812f-595583cc8d52 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.394764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f80e3c74-7482-40e1-812f-595583cc8d52 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.637128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f80e3c74-7482-40e1-812f-595583cc8d52 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:35.644681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-191801ac-75af-4e1a-a06d-f38334a3ae42 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:35.645965 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f80e3c74-7482-40e1-812f-595583cc8d52 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1216 microversion: 2.1 time: 0.264484 Jul 26 14:52:35.646460 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2927/5972] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:35 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1216 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:35.653972 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-191801ac-75af-4e1a-a06d-f38334a3ae42 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1678 microversion: 2.1 time: 0.284482 Jul 26 14:52:35.654562 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3046/5973] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:35 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1678 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:36.671349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d4e469e6-0ff5-41d8-bde6-feef7baf28c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:36.672194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d4e469e6-0ff5-41d8-bde6-feef7baf28c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:36.680346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4e469e6-0ff5-41d8-bde6-feef7baf28c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.680805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4e469e6-0ff5-41d8-bde6-feef7baf28c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.681624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4e469e6-0ff5-41d8-bde6-feef7baf28c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.682122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4e469e6-0ff5-41d8-bde6-feef7baf28c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.683182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a1e37828-f1cc-4a57-8d2f-159cf17807e9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:36.684423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a1e37828-f1cc-4a57-8d2f-159cf17807e9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:36.693655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1e37828-f1cc-4a57-8d2f-159cf17807e9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.694540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1e37828-f1cc-4a57-8d2f-159cf17807e9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.696050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1e37828-f1cc-4a57-8d2f-159cf17807e9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.696931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a1e37828-f1cc-4a57-8d2f-159cf17807e9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:37.045789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d4e469e6-0ff5-41d8-bde6-feef7baf28c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:37.053934 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d4e469e6-0ff5-41d8-bde6-feef7baf28c2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1216 microversion: 2.1 time: 0.387809 Jul 26 14:52:37.054716 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2928/5974] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:36 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1216 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:37.054859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a1e37828-f1cc-4a57-8d2f-159cf17807e9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:37.062718 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a1e37828-f1cc-4a57-8d2f-159cf17807e9 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1678 microversion: 2.1 time: 0.385998 Jul 26 14:52:37.063911 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3047/5975] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:36 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1678 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:37.997352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-34ea53fe-5efb-4d14-9455-955b4a41cd0c req-e1e39745-0832-495d-8385-f28fe1b15efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d358f20-c4bc-4da0-b6fd-d111b32ab9e2", "name": "network-vif-deleted", "tag": "c31d0c23-5460-494a-869e-2d41bee0c9e6"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:38.010670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-34ea53fe-5efb-4d14-9455-955b4a41cd0c req-e1e39745-0832-495d-8385-f28fe1b15efa service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.011128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-34ea53fe-5efb-4d14-9455-955b4a41cd0c req-e1e39745-0832-495d-8385-f28fe1b15efa service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.025048 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-34ea53fe-5efb-4d14-9455-955b4a41cd0c req-e1e39745-0832-495d-8385-f28fe1b15efa service nova] Creating event network-vif-deleted:c31d0c23-5460-494a-869e-2d41bee0c9e6 for instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 on n-h2-833090-9 Jul 26 14:52:38.030861 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-34ea53fe-5efb-4d14-9455-955b4a41cd0c req-e1e39745-0832-495d-8385-f28fe1b15efa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037462 Jul 26 14:52:38.031558 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2929/5976] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:38.081617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6fbd1d59-e038-4e38-9fe2-8a89c5d6479b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:38.081617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6fbd1d59-e038-4e38-9fe2-8a89c5d6479b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:38.088273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:38.089017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:38.089740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fbd1d59-e038-4e38-9fe2-8a89c5d6479b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.090450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fbd1d59-e038-4e38-9fe2-8a89c5d6479b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.091564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fbd1d59-e038-4e38-9fe2-8a89c5d6479b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.092869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fbd1d59-e038-4e38-9fe2-8a89c5d6479b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.096241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.096692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.097867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.098479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.139775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.140582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.141236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lazy-loading 'fault' on Instance uuid 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:52:38.227744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df60439bde7a40938de3990499a342fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb67d4af2924c9f8e40b33e83d5901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:38.241717 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6df41e04-fb4a-4833-a3ea-010292cc0046 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 200 len: 1330 microversion: 2.1 time: 0.158527 Jul 26 14:52:38.242320 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2930/5977] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:38 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 1330 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:38.321680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6fbd1d59-e038-4e38-9fe2-8a89c5d6479b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:38.331107 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6fbd1d59-e038-4e38-9fe2-8a89c5d6479b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1216 microversion: 2.1 time: 0.258767 Jul 26 14:52:38.331847 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3048/5978] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:38 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1216 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:39.263099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f485b96b-e6b3-4d37-9999-ba3650604881 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:39.263721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f485b96b-e6b3-4d37-9999-ba3650604881 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:39.272220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f485b96b-e6b3-4d37-9999-ba3650604881 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:39.272782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f485b96b-e6b3-4d37-9999-ba3650604881 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:39.273940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f485b96b-e6b3-4d37-9999-ba3650604881 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:39.274395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f485b96b-e6b3-4d37-9999-ba3650604881 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:39.278913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:39.290640 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-f485b96b-e6b3-4d37-9999-ba3650604881 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f485b96b-e6b3-4d37-9999-ba3650604881 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 HTTP/1.1 Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4d358f20-c4bc-4da0-b6fd-d111b32ab9e2'} Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:39.292330 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:39.297928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:39.297928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:39.297928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:39.297928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:39.297928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:39.297928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:39.297928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:39.297928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f485b96b-e6b3-4d37-9999-ba3650604881 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:39.297928 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f485b96b-e6b3-4d37-9999-ba3650604881 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 404 len: 111 microversion: 2.1 time: 0.034827 Jul 26 14:52:39.297928 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2931/5979] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:39 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:52:39.304666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-368fbe64-af88-4798-b340-a38a41966f75 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '.version_select at 0x7f8794acb550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:39.324844 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-368fbe64-af88-4798-b340-a38a41966f75 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-34349665" status: 202 len: 0 microversion: 2.1 time: 0.024058 Jul 26 14:52:39.325358 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3049/5980] 10.222.0.70 () {58 vars in 1215 bytes} [Tue Jul 26 14:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-34349665 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:52:39.353455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8b5fdd69-df94-45f2-9794-946b2a875781 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:39.354085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8b5fdd69-df94-45f2-9794-946b2a875781 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:39.360744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b5fdd69-df94-45f2-9794-946b2a875781 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:39.361207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b5fdd69-df94-45f2-9794-946b2a875781 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:39.362530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b5fdd69-df94-45f2-9794-946b2a875781 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:39.362977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8b5fdd69-df94-45f2-9794-946b2a875781 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:39.540841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8b5fdd69-df94-45f2-9794-946b2a875781 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:39.563576 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8b5fdd69-df94-45f2-9794-946b2a875781 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1216 microversion: 2.1 time: 0.214512 Jul 26 14:52:39.564222 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2932/5981] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:39 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1216 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:40.588953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74172854-add5-40aa-8adc-e496b6cd147d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:40.590909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-74172854-add5-40aa-8adc-e496b6cd147d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:40.598450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74172854-add5-40aa-8adc-e496b6cd147d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.598912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74172854-add5-40aa-8adc-e496b6cd147d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.599697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74172854-add5-40aa-8adc-e496b6cd147d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.600168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74172854-add5-40aa-8adc-e496b6cd147d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.607072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2959fed1-3599-4080-9181-60dd6979c4f6 req-d95bf24c-6354-46c1-8121-7feacc20e49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c8b86f-8ee8-4f50-9468-e264a7211af8", "name": "network-vif-plugged", "status": "completed", "tag": "87c1f720-768e-492c-acda-c8d09d4f8353"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:40.619336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2959fed1-3599-4080-9181-60dd6979c4f6 req-d95bf24c-6354-46c1-8121-7feacc20e49a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.619856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2959fed1-3599-4080-9181-60dd6979c4f6 req-d95bf24c-6354-46c1-8121-7feacc20e49a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.635567 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2959fed1-3599-4080-9181-60dd6979c4f6 req-d95bf24c-6354-46c1-8121-7feacc20e49a service nova] Creating event network-vif-plugged:87c1f720-768e-492c-acda-c8d09d4f8353 for instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 on n-h1-833090-9 Jul 26 14:52:40.642296 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2959fed1-3599-4080-9181-60dd6979c4f6 req-d95bf24c-6354-46c1-8121-7feacc20e49a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038788 Jul 26 14:52:40.645099 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2933/5982] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:40.816499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-74172854-add5-40aa-8adc-e496b6cd147d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:40.824601 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-74172854-add5-40aa-8adc-e496b6cd147d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1216 microversion: 2.1 time: 0.240447 Jul 26 14:52:40.825297 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3050/5983] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:40 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1216 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:41.848478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7aefdd83-b622-4cfc-9103-837b3b60ed2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:41.849308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7aefdd83-b622-4cfc-9103-837b3b60ed2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:41.858194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7aefdd83-b622-4cfc-9103-837b3b60ed2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:41.858687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7aefdd83-b622-4cfc-9103-837b3b60ed2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:41.859783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7aefdd83-b622-4cfc-9103-837b3b60ed2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:41.860517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7aefdd83-b622-4cfc-9103-837b3b60ed2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:42.007364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7aefdd83-b622-4cfc-9103-837b3b60ed2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:42.015466 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7aefdd83-b622-4cfc-9103-837b3b60ed2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1216 microversion: 2.1 time: 0.172846 Jul 26 14:52:42.016063 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2934/5984] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:41 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:43.037291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6298c7c3-b573-45d5-95e3-7775dd6b7694 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:43.037836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6298c7c3-b573-45d5-95e3-7775dd6b7694 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:43.044880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6298c7c3-b573-45d5-95e3-7775dd6b7694 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.045335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6298c7c3-b573-45d5-95e3-7775dd6b7694 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.046377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6298c7c3-b573-45d5-95e3-7775dd6b7694 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.046817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6298c7c3-b573-45d5-95e3-7775dd6b7694 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.180727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6298c7c3-b573-45d5-95e3-7775dd6b7694 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:43.188656 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6298c7c3-b573-45d5-95e3-7775dd6b7694 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1403 microversion: 2.1 time: 0.155502 Jul 26 14:52:43.189268 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3051/5985] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:43 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:43.210347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6ef5f359-8de5-43f4-b57c-118a5cf88a97 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:43.210965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6ef5f359-8de5-43f4-b57c-118a5cf88a97 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:43.217992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ef5f359-8de5-43f4-b57c-118a5cf88a97 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.218439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ef5f359-8de5-43f4-b57c-118a5cf88a97 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.219221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ef5f359-8de5-43f4-b57c-118a5cf88a97 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.219641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6ef5f359-8de5-43f4-b57c-118a5cf88a97 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.291004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76b4931f-f2bb-4d19-9c70-8c0baf32791a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:43.292443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-76b4931f-f2bb-4d19-9c70-8c0baf32791a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:43.301188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76b4931f-f2bb-4d19-9c70-8c0baf32791a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.301658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76b4931f-f2bb-4d19-9c70-8c0baf32791a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.302654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76b4931f-f2bb-4d19-9c70-8c0baf32791a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.303102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76b4931f-f2bb-4d19-9c70-8c0baf32791a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.321101 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-76b4931f-f2bb-4d19-9c70-8c0baf32791a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76b4931f-f2bb-4d19-9c70-8c0baf32791a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 HTTP/1.1 Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4d358f20-c4bc-4da0-b6fd-d111b32ab9e2'} Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:43.322827 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76b4931f-f2bb-4d19-9c70-8c0baf32791a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76b4931f-f2bb-4d19-9c70-8c0baf32791a tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 404 len: 111 microversion: 2.1 time: 0.037609 Jul 26 14:52:43.330601 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3052/5986] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:52:43 2022] DELETE /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:52:43.332934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aebd5861-d908-4ef9-9539-e72804c15015 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:43.333632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aebd5861-d908-4ef9-9539-e72804c15015 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:43.339699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aebd5861-d908-4ef9-9539-e72804c15015 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.340207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aebd5861-d908-4ef9-9539-e72804c15015 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.340986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aebd5861-d908-4ef9-9539-e72804c15015 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.341430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aebd5861-d908-4ef9-9539-e72804c15015 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.356507 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-aebd5861-d908-4ef9-9539-e72804c15015 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aebd5861-d908-4ef9-9539-e72804c15015 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 HTTP/1.1 Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4d358f20-c4bc-4da0-b6fd-d111b32ab9e2'} Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:43.358083 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:43.363936 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:43.363936 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:43.363936 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:43.363936 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:43.363936 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:43.363936 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. Jul 26 14:52:43.363936 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:43.363936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aebd5861-d908-4ef9-9539-e72804c15015 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance 4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:43.363936 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aebd5861-d908-4ef9-9539-e72804c15015 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2" status: 404 len: 111 microversion: 2.1 time: 0.030463 Jul 26 14:52:43.363936 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3053/5987] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:43 2022] GET /compute/v2.1/servers/4d358f20-c4bc-4da0-b6fd-d111b32ab9e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:52:43.368252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6ef5f359-8de5-43f4-b57c-118a5cf88a97 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:43.376719 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6ef5f359-8de5-43f4-b57c-118a5cf88a97 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1403 microversion: 2.1 time: 0.170716 Jul 26 14:52:43.381816 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2935/5988] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:43 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1403 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:43.398082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c55b4dd1-1cbd-44cf-b4da-6cad1e8d854b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1618748348"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:43.406369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c55b4dd1-1cbd-44cf-b4da-6cad1e8d854b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:43.413736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c55b4dd1-1cbd-44cf-b4da-6cad1e8d854b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.414200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c55b4dd1-1cbd-44cf-b4da-6cad1e8d854b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.414988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c55b4dd1-1cbd-44cf-b4da-6cad1e8d854b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.415437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c55b4dd1-1cbd-44cf-b4da-6cad1e8d854b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.440920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=100 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:43.528150 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.compute.api [None req-c55b4dd1-1cbd-44cf-b4da-6cad1e8d854b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Attempting to quiesce instance before volume snapshot. Jul 26 14:52:43.587388 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.compute.api [None req-c55b4dd1-1cbd-44cf-b4da-6cad1e8d854b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 26 14:52:43.676059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c55b4dd1-1cbd-44cf-b4da-6cad1e8d854b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Creating snapshot from volume 8cbd5ad0-6579-402b-868a-91d01e9e9555. {{(pid=119479) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 26 14:52:44.743291 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c55b4dd1-1cbd-44cf-b4da-6cad1e8d854b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "POST /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8/action" status: 202 len: 0 microversion: 2.1 time: 1.349334 Jul 26 14:52:44.744990 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3054/5989] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 14:52:43 2022] POST /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8/action => generated 0 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 26 14:52:45.932659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-613587932", "imageRef": "f10fa197-0475-44c0-a14b-705c92234648", "flavorRef": "452", "networks": [{"uuid": "e976b6cc-dfb4-45b5-af81-629f1adeef76"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:45.991890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] validate_networks() for [('e976b6cc-dfb4-45b5-af81-629f1adeef76', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:52:46.385800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:52:46.386576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:52:46.387146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:52:46.387664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:52:46.388174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:52:46.400240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.400763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.401621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.402066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.421223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:52:46.427861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for user ac9553617f2440a68e33b82650206cae and project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:52:46.442496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:52:46.445201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='271f01ea-e15a-4151-8dcb-e6383141486a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:52:46.524053 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-87f51bfe-056a-411b-837f-48e6363278c9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595116 Jul 26 14:52:46.524887 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2936/5990] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:52:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:52:46.538957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7118ca70-dfd3-412e-a1de-9f287fb15a48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:46.540433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7118ca70-dfd3-412e-a1de-9f287fb15a48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:46.543205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:46.602348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7118ca70-dfd3-412e-a1de-9f287fb15a48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:46.610043 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7118ca70-dfd3-412e-a1de-9f287fb15a48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1229 microversion: 2.1 time: 0.077650 Jul 26 14:52:46.610635 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3055/5991] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:46 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1229 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:46.701466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fd548cf9-f41f-4ffc-af1b-af687c4642d1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:46.702097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fd548cf9-f41f-4ffc-af1b-af687c4642d1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:46.709457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd548cf9-f41f-4ffc-af1b-af687c4642d1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.710229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd548cf9-f41f-4ffc-af1b-af687c4642d1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.713067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd548cf9-f41f-4ffc-af1b-af687c4642d1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.713571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd548cf9-f41f-4ffc-af1b-af687c4642d1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.728548 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-fd548cf9-f41f-4ffc-af1b-af687c4642d1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fd548cf9-f41f-4ffc-af1b-af687c4642d1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 HTTP/1.1 Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '54a90dca-fd66-404f-af79-45a4ebeb0c74'} Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:46.730358 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:52:46.735150 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.736647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fd548cf9-f41f-4ffc-af1b-af687c4642d1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:46.737835 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fd548cf9-f41f-4ffc-af1b-af687c4642d1 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 404 len: 111 microversion: 2.1 time: 0.040648 Jul 26 14:52:46.738841 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2937/5992] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:52:46 2022] DELETE /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:52:46.747844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9254bb7b-3219-4ac5-9734-fc36919be413 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:46.748624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9254bb7b-3219-4ac5-9734-fc36919be413 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 54a90dca-fd66-404f-af79-45a4ebeb0c74] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:46.755130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9254bb7b-3219-4ac5-9734-fc36919be413 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.755603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9254bb7b-3219-4ac5-9734-fc36919be413 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.756430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9254bb7b-3219-4ac5-9734-fc36919be413 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.756881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9254bb7b-3219-4ac5-9734-fc36919be413 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.773487 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-9254bb7b-3219-4ac5-9734-fc36919be413 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9254bb7b-3219-4ac5-9734-fc36919be413 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 HTTP/1.1 Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '54a90dca-fd66-404f-af79-45a4ebeb0c74'} Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:46.776156 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.780725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.780725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:46.780725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:46.780725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:46.780725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:46.780725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. Jul 26 14:52:46.780725 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.780725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9254bb7b-3219-4ac5-9734-fc36919be413 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance 54a90dca-fd66-404f-af79-45a4ebeb0c74 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:46.780725 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9254bb7b-3219-4ac5-9734-fc36919be413 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74" status: 404 len: 111 microversion: 2.1 time: 0.034443 Jul 26 14:52:46.780725 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3056/5993] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:46 2022] GET /compute/v2.1/servers/54a90dca-fd66-404f-af79-45a4ebeb0c74 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:52:46.787181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c8025949-97b6-4fac-98a0-94c16c93972e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:46.787687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c8025949-97b6-4fac-98a0-94c16c93972e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:46.794016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8025949-97b6-4fac-98a0-94c16c93972e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.794470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8025949-97b6-4fac-98a0-94c16c93972e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.795242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8025949-97b6-4fac-98a0-94c16c93972e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.795678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8025949-97b6-4fac-98a0-94c16c93972e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.811775 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c8025949-97b6-4fac-98a0-94c16c93972e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c8025949-97b6-4fac-98a0-94c16c93972e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 HTTP/1.1 Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'f3b5a306-b891-483d-a413-266c1c94e576'} Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:46.813161 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c8025949-97b6-4fac-98a0-94c16c93972e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c8025949-97b6-4fac-98a0-94c16c93972e tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 404 len: 111 microversion: 2.1 time: 0.031982 Jul 26 14:52:46.818565 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2938/5994] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:52:46 2022] DELETE /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:52:46.823905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d4ef3ac5-ad01-4b8a-b5ff-edd6b844e023 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:46.824564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d4ef3ac5-ad01-4b8a-b5ff-edd6b844e023 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: f3b5a306-b891-483d-a413-266c1c94e576] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:46.831465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4ef3ac5-ad01-4b8a-b5ff-edd6b844e023 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.831930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4ef3ac5-ad01-4b8a-b5ff-edd6b844e023 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.832930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4ef3ac5-ad01-4b8a-b5ff-edd6b844e023 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.833391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4ef3ac5-ad01-4b8a-b5ff-edd6b844e023 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.864011 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d4ef3ac5-ad01-4b8a-b5ff-edd6b844e023 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d4ef3ac5-ad01-4b8a-b5ff-edd6b844e023 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 HTTP/1.1 Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'f3b5a306-b891-483d-a413-266c1c94e576'} Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:46.865575 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.870822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:46.870822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:46.870822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:46.870822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:46.870822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:46.870822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. Jul 26 14:52:46.870822 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:46.870822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d4ef3ac5-ad01-4b8a-b5ff-edd6b844e023 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance f3b5a306-b891-483d-a413-266c1c94e576 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:46.870822 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d4ef3ac5-ad01-4b8a-b5ff-edd6b844e023 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576" status: 404 len: 111 microversion: 2.1 time: 0.046928 Jul 26 14:52:46.870822 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3057/5995] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:46 2022] GET /compute/v2.1/servers/f3b5a306-b891-483d-a413-266c1c94e576 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:52:47.640401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7a32cd5-5e21-4b2b-bdea-178aa1128b95 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:47.644246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f7a32cd5-5e21-4b2b-bdea-178aa1128b95 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:47.656286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:47.669424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7a32cd5-5e21-4b2b-bdea-178aa1128b95 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:47.671212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7a32cd5-5e21-4b2b-bdea-178aa1128b95 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:47.672313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7a32cd5-5e21-4b2b-bdea-178aa1128b95 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:47.672771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7a32cd5-5e21-4b2b-bdea-178aa1128b95 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:48.040981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f7a32cd5-5e21-4b2b-bdea-178aa1128b95 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:48.052610 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7a32cd5-5e21-4b2b-bdea-178aa1128b95 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1299 microversion: 2.1 time: 0.423385 Jul 26 14:52:48.067695 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2939/5996] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:47 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1299 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:49.075224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a9f8e8e-8304-41dc-9b87-58240b56edf9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:49.076508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9a9f8e8e-8304-41dc-9b87-58240b56edf9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:49.085308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a9f8e8e-8304-41dc-9b87-58240b56edf9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:49.086088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a9f8e8e-8304-41dc-9b87-58240b56edf9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:49.087525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a9f8e8e-8304-41dc-9b87-58240b56edf9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:49.088879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a9f8e8e-8304-41dc-9b87-58240b56edf9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:49.367266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9a9f8e8e-8304-41dc-9b87-58240b56edf9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:49.380635 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9a9f8e8e-8304-41dc-9b87-58240b56edf9 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.309646 Jul 26 14:52:49.382034 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3058/5997] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:49 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:49.726781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3c1e3516-0141-49bf-95fc-0eeb9c008f55 req-b4c58507-5adc-4d0e-bf58-cfc2d287bfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4346c2e0-eefb-493b-9468-2c71a16e6530", "tag": "13e51208-a3d9-403b-b6a9-b8f7ace6a6ea"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:49.761311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3c1e3516-0141-49bf-95fc-0eeb9c008f55 req-b4c58507-5adc-4d0e-bf58-cfc2d287bfa4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:49.762126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3c1e3516-0141-49bf-95fc-0eeb9c008f55 req-b4c58507-5adc-4d0e-bf58-cfc2d287bfa4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:49.778782 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3c1e3516-0141-49bf-95fc-0eeb9c008f55 req-b4c58507-5adc-4d0e-bf58-cfc2d287bfa4 service nova] Creating event network-changed:13e51208-a3d9-403b-b6a9-b8f7ace6a6ea for instance 4346c2e0-eefb-493b-9468-2c71a16e6530 on n-h2-833090-9 Jul 26 14:52:49.786383 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3c1e3516-0141-49bf-95fc-0eeb9c008f55 req-b4c58507-5adc-4d0e-bf58-cfc2d287bfa4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063806 Jul 26 14:52:49.787779 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2940/5998] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:50.228845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fd6fde1a-4065-4733-9aae-c90da5577efc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:50.230014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fd6fde1a-4065-4733-9aae-c90da5577efc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:50.239858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd6fde1a-4065-4733-9aae-c90da5577efc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.240652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd6fde1a-4065-4733-9aae-c90da5577efc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.241646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd6fde1a-4065-4733-9aae-c90da5577efc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.242276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd6fde1a-4065-4733-9aae-c90da5577efc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.259854 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-fd6fde1a-4065-4733-9aae-c90da5577efc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fd6fde1a-4065-4733-9aae-c90da5577efc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 HTTP/1.1 Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4cab1cb2-39b4-475e-aa98-74de17b0ec99'} Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:50.261912 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:52:50.266131 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:52:50.267900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fd6fde1a-4065-4733-9aae-c90da5577efc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:50.269310 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fd6fde1a-4065-4733-9aae-c90da5577efc tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 404 len: 111 microversion: 2.1 time: 0.045342 Jul 26 14:52:50.278399 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3059/5999] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:52:50 2022] DELETE /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:52:50.413118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-293385a5-ee68-42ce-9da3-4c81c7118092 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:50.413834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-293385a5-ee68-42ce-9da3-4c81c7118092 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:50.435115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-293385a5-ee68-42ce-9da3-4c81c7118092 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.435596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-293385a5-ee68-42ce-9da3-4c81c7118092 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.436463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-293385a5-ee68-42ce-9da3-4c81c7118092 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.436923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-293385a5-ee68-42ce-9da3-4c81c7118092 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.507163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-920d0e85-b1f3-42cd-8214-70ad7daef367 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:50.508538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-920d0e85-b1f3-42cd-8214-70ad7daef367 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] [instance: 4cab1cb2-39b4-475e-aa98-74de17b0ec99] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:50.517059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-920d0e85-b1f3-42cd-8214-70ad7daef367 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.518218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-920d0e85-b1f3-42cd-8214-70ad7daef367 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.519677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-920d0e85-b1f3-42cd-8214-70ad7daef367 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.520410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-920d0e85-b1f3-42cd-8214-70ad7daef367 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.540255 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-920d0e85-b1f3-42cd-8214-70ad7daef367 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] HTTP exception thrown: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-920d0e85-b1f3-42cd-8214-70ad7daef367 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Request method failure captured: Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 HTTP/1.1 Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_6V9CiDQ4fSk8ZFOxse8VONYFEOEj79o1EJjMICUg2901iuz-LJTBF7OUTjvsd9-4ztMcFnjiDlYFrflIb4NI7V_adZOA656iCd6iejfyabWclfHCvXeHzwLnjpKNI4qwlE7uwaeiK3H87qNoedK_JbM2f9j4pp8atKaLv-e9zQGyc Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2eb67d4af2924c9f8e40b33e83d5901e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2eb67d4af2924c9f8e40b33e83d5901e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2eb67d4af2924c9f8e40b33e83d5901e"}]}] Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2eb67d4af2924c9f8e40b33e83d5901e Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-739566217 Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: df60439bde7a40938de3990499a342fc Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-AttachVolumeNegativeTest-739566217-project Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4cab1cb2-39b4-475e-aa98-74de17b0ec99'} Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:52:50.542343 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:50.547337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:52:50.547337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:52:50.547337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:52:50.547337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:52:50.547337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:52:50.547337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. Jul 26 14:52:50.547337 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:52:50.550264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-920d0e85-b1f3-42cd-8214-70ad7daef367 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] Returning 404 to user: Instance 4cab1cb2-39b4-475e-aa98-74de17b0ec99 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:52:50.551422 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-920d0e85-b1f3-42cd-8214-70ad7daef367 tempest-AttachVolumeNegativeTest-739566217 tempest-AttachVolumeNegativeTest-739566217-project] 10.222.0.70 "GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99" status: 404 len: 111 microversion: 2.1 time: 0.276711 Jul 26 14:52:50.556273 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2941/6000] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:50 2022] GET /compute/v2.1/servers/4cab1cb2-39b4-475e-aa98-74de17b0ec99 => generated 111 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:52:50.773318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-293385a5-ee68-42ce-9da3-4c81c7118092 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:50.782664 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-293385a5-ee68-42ce-9da3-4c81c7118092 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.383346 Jul 26 14:52:50.798777 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3060/6001] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:50 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:51.807639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a65a93f2-d28f-4d2a-a366-8bdf59725c10 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:51.808293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a65a93f2-d28f-4d2a-a366-8bdf59725c10 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:51.819737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a65a93f2-d28f-4d2a-a366-8bdf59725c10 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:51.820382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a65a93f2-d28f-4d2a-a366-8bdf59725c10 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:51.821340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a65a93f2-d28f-4d2a-a366-8bdf59725c10 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:51.822097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a65a93f2-d28f-4d2a-a366-8bdf59725c10 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:52.036413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a65a93f2-d28f-4d2a-a366-8bdf59725c10 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:52.051322 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a65a93f2-d28f-4d2a-a366-8bdf59725c10 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.249059 Jul 26 14:52:52.056192 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2942/6002] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:51 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:53.078544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f926dfa0-9d23-4b26-bd0f-0c8a5f7291c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:53.079777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f926dfa0-9d23-4b26-bd0f-0c8a5f7291c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:53.088072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f926dfa0-9d23-4b26-bd0f-0c8a5f7291c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.088588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f926dfa0-9d23-4b26-bd0f-0c8a5f7291c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.089385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f926dfa0-9d23-4b26-bd0f-0c8a5f7291c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.089857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f926dfa0-9d23-4b26-bd0f-0c8a5f7291c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.322275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f926dfa0-9d23-4b26-bd0f-0c8a5f7291c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:53.335782 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f926dfa0-9d23-4b26-bd0f-0c8a5f7291c3 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.261885 Jul 26 14:52:53.352473 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3061/6003] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:53 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:54.374042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f9a19d6a-8239-4c23-b275-90284caa0892 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:54.375086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f9a19d6a-8239-4c23-b275-90284caa0892 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:54.405053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9a19d6a-8239-4c23-b275-90284caa0892 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:54.407832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9a19d6a-8239-4c23-b275-90284caa0892 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:54.414508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9a19d6a-8239-4c23-b275-90284caa0892 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:54.415294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9a19d6a-8239-4c23-b275-90284caa0892 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:54.683835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f9a19d6a-8239-4c23-b275-90284caa0892 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:54.702296 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f9a19d6a-8239-4c23-b275-90284caa0892 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.333484 Jul 26 14:52:54.721307 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2943/6004] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:54 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:55.728260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8803682f-3d80-444e-a5b2-b47cbd734d4d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:55.730103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8803682f-3d80-444e-a5b2-b47cbd734d4d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:55.738182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8803682f-3d80-444e-a5b2-b47cbd734d4d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:55.739025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8803682f-3d80-444e-a5b2-b47cbd734d4d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:55.740206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8803682f-3d80-444e-a5b2-b47cbd734d4d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:55.740884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8803682f-3d80-444e-a5b2-b47cbd734d4d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:55.896506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8803682f-3d80-444e-a5b2-b47cbd734d4d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:55.905796 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8803682f-3d80-444e-a5b2-b47cbd734d4d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.181747 Jul 26 14:52:55.906504 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3062/6005] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:55 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:56.931234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c1d5dc0f-54f3-4e8a-8039-ef5ece9a1d06 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:56.932251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c1d5dc0f-54f3-4e8a-8039-ef5ece9a1d06 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:56.936368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:56.937280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:56.944249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1d5dc0f-54f3-4e8a-8039-ef5ece9a1d06 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:56.944930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1d5dc0f-54f3-4e8a-8039-ef5ece9a1d06 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:56.945959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1d5dc0f-54f3-4e8a-8039-ef5ece9a1d06 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:56.946640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1d5dc0f-54f3-4e8a-8039-ef5ece9a1d06 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:57.100772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c1d5dc0f-54f3-4e8a-8039-ef5ece9a1d06 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:57.109673 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c1d5dc0f-54f3-4e8a-8039-ef5ece9a1d06 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.182424 Jul 26 14:52:57.121245 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2944/6006] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:56 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:58.128295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:58.134747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-11941122-e74f-4293-b1e0-e42ab3c8067e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:58.135381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-11941122-e74f-4293-b1e0-e42ab3c8067e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:58.142134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11941122-e74f-4293-b1e0-e42ab3c8067e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:58.142973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11941122-e74f-4293-b1e0-e42ab3c8067e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:58.144555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11941122-e74f-4293-b1e0-e42ab3c8067e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:58.145050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-11941122-e74f-4293-b1e0-e42ab3c8067e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:58.286785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-11941122-e74f-4293-b1e0-e42ab3c8067e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:58.294741 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-11941122-e74f-4293-b1e0-e42ab3c8067e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.167593 Jul 26 14:52:58.295318 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3063/6007] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:58 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:59.317619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f7a1bd74-c74f-4055-a9b4-5d058d113fed tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:59.318308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f7a1bd74-c74f-4055-a9b4-5d058d113fed tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:59.325973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7a1bd74-c74f-4055-a9b4-5d058d113fed tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:59.326547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7a1bd74-c74f-4055-a9b4-5d058d113fed tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:59.327338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7a1bd74-c74f-4055-a9b4-5d058d113fed tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:59.327812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f7a1bd74-c74f-4055-a9b4-5d058d113fed tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:59.475263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f7a1bd74-c74f-4055-a9b4-5d058d113fed tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:59.483185 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f7a1bd74-c74f-4055-a9b4-5d058d113fed tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.170511 Jul 26 14:52:59.483762 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2945/6008] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:59 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:00.508431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bb406b55-f3d5-4e0f-b7bf-40a174998a67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:00.509409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bb406b55-f3d5-4e0f-b7bf-40a174998a67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:00.518419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb406b55-f3d5-4e0f-b7bf-40a174998a67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:00.519069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb406b55-f3d5-4e0f-b7bf-40a174998a67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:00.520074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb406b55-f3d5-4e0f-b7bf-40a174998a67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:00.521199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb406b55-f3d5-4e0f-b7bf-40a174998a67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:00.680519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bb406b55-f3d5-4e0f-b7bf-40a174998a67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:00.697866 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bb406b55-f3d5-4e0f-b7bf-40a174998a67 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.195750 Jul 26 14:53:00.698472 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3064/6009] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:00 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:01.720057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-647b50d8-3812-4390-8805-6847695d7f2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:01.721062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-647b50d8-3812-4390-8805-6847695d7f2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:01.729365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-647b50d8-3812-4390-8805-6847695d7f2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:01.730120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-647b50d8-3812-4390-8805-6847695d7f2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:01.731308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-647b50d8-3812-4390-8805-6847695d7f2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:01.731882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-647b50d8-3812-4390-8805-6847695d7f2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:01.893936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-647b50d8-3812-4390-8805-6847695d7f2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:01.902787 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-647b50d8-3812-4390-8805-6847695d7f2c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.186618 Jul 26 14:53:01.916559 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2946/6010] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:01 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:02.927839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56636b87-71e1-4a92-89f9-8ef559f763a5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:02.928504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56636b87-71e1-4a92-89f9-8ef559f763a5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:02.936253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56636b87-71e1-4a92-89f9-8ef559f763a5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:02.936741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56636b87-71e1-4a92-89f9-8ef559f763a5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:02.937630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56636b87-71e1-4a92-89f9-8ef559f763a5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:02.938822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56636b87-71e1-4a92-89f9-8ef559f763a5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:03.212003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56636b87-71e1-4a92-89f9-8ef559f763a5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:03.221773 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56636b87-71e1-4a92-89f9-8ef559f763a5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.298826 Jul 26 14:53:03.235802 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3065/6011] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:02 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:04.243333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-96cad271-6733-4c7a-aba8-fa3cce720b2d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:04.244107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-96cad271-6733-4c7a-aba8-fa3cce720b2d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:04.251543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96cad271-6733-4c7a-aba8-fa3cce720b2d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:04.252898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96cad271-6733-4c7a-aba8-fa3cce720b2d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:04.253693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96cad271-6733-4c7a-aba8-fa3cce720b2d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:04.254430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-96cad271-6733-4c7a-aba8-fa3cce720b2d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:04.440711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-96cad271-6733-4c7a-aba8-fa3cce720b2d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:04.448627 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-96cad271-6733-4c7a-aba8-fa3cce720b2d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.209535 Jul 26 14:53:04.459618 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2947/6012] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:04 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:05.473395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aad3724d-604f-4491-a922-aa5f4fa2349d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:05.476476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aad3724d-604f-4491-a922-aa5f4fa2349d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:05.484571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aad3724d-604f-4491-a922-aa5f4fa2349d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:05.485423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aad3724d-604f-4491-a922-aa5f4fa2349d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:05.487331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aad3724d-604f-4491-a922-aa5f4fa2349d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:05.488007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aad3724d-604f-4491-a922-aa5f4fa2349d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:05.666721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aad3724d-604f-4491-a922-aa5f4fa2349d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:05.676585 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aad3724d-604f-4491-a922-aa5f4fa2349d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1341 microversion: 2.1 time: 0.207063 Jul 26 14:53:05.677468 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3066/6013] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:05 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1341 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:06.699273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cb4d9d5d-9c62-4b66-9b00-82428feafad7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:06.699919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cb4d9d5d-9c62-4b66-9b00-82428feafad7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:06.708120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4d9d5d-9c62-4b66-9b00-82428feafad7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:06.708579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4d9d5d-9c62-4b66-9b00-82428feafad7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:06.709364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4d9d5d-9c62-4b66-9b00-82428feafad7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:06.709810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb4d9d5d-9c62-4b66-9b00-82428feafad7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:06.856222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb4d9d5d-9c62-4b66-9b00-82428feafad7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:06.865086 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cb4d9d5d-9c62-4b66-9b00-82428feafad7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1375 microversion: 2.1 time: 0.169839 Jul 26 14:53:06.865669 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2948/6014] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:06 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:07.887420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70c046cc-2573-4ee5-8245-7926959ccb63 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:07.888481 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70c046cc-2573-4ee5-8245-7926959ccb63 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:07.896793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70c046cc-2573-4ee5-8245-7926959ccb63 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:07.897871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70c046cc-2573-4ee5-8245-7926959ccb63 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:07.898843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70c046cc-2573-4ee5-8245-7926959ccb63 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:07.899332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70c046cc-2573-4ee5-8245-7926959ccb63 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:08.052482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70c046cc-2573-4ee5-8245-7926959ccb63 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:08.060733 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70c046cc-2573-4ee5-8245-7926959ccb63 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1375 microversion: 2.1 time: 0.177266 Jul 26 14:53:08.061329 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3067/6015] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:07 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:09.084272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a6576eb6-3c7d-4383-94e0-f7fd88b2f61e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:09.084896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a6576eb6-3c7d-4383-94e0-f7fd88b2f61e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:09.091750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6576eb6-3c7d-4383-94e0-f7fd88b2f61e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:09.092557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6576eb6-3c7d-4383-94e0-f7fd88b2f61e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:09.093503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6576eb6-3c7d-4383-94e0-f7fd88b2f61e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:09.093952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a6576eb6-3c7d-4383-94e0-f7fd88b2f61e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:09.233334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a6576eb6-3c7d-4383-94e0-f7fd88b2f61e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:09.244018 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a6576eb6-3c7d-4383-94e0-f7fd88b2f61e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1375 microversion: 2.1 time: 0.163480 Jul 26 14:53:09.244650 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2949/6016] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:09 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:10.266617 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca22e1b8-e6d5-45ef-89d6-6055532df3a4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:10.267272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ca22e1b8-e6d5-45ef-89d6-6055532df3a4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:10.275012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca22e1b8-e6d5-45ef-89d6-6055532df3a4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:10.275765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca22e1b8-e6d5-45ef-89d6-6055532df3a4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:10.276596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca22e1b8-e6d5-45ef-89d6-6055532df3a4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:10.277267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca22e1b8-e6d5-45ef-89d6-6055532df3a4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:10.430744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ca22e1b8-e6d5-45ef-89d6-6055532df3a4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:10.439116 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca22e1b8-e6d5-45ef-89d6-6055532df3a4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1375 microversion: 2.1 time: 0.176336 Jul 26 14:53:10.439729 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3068/6017] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:10 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:11.460621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-106ba7cf-fc75-4fb7-b042-51e2fc0d16c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:11.461430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-106ba7cf-fc75-4fb7-b042-51e2fc0d16c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:11.468442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-106ba7cf-fc75-4fb7-b042-51e2fc0d16c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:11.468882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-106ba7cf-fc75-4fb7-b042-51e2fc0d16c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:11.469657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-106ba7cf-fc75-4fb7-b042-51e2fc0d16c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:11.470097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-106ba7cf-fc75-4fb7-b042-51e2fc0d16c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:11.476064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=85 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:11.626626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-106ba7cf-fc75-4fb7-b042-51e2fc0d16c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:11.640883 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-106ba7cf-fc75-4fb7-b042-51e2fc0d16c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1375 microversion: 2.1 time: 0.184146 Jul 26 14:53:11.652586 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2950/6018] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:11 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1375 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:12.665077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fe2d3275-1634-4fb5-a05d-56a04a1785aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:12.665720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fe2d3275-1634-4fb5-a05d-56a04a1785aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:12.673138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe2d3275-1634-4fb5-a05d-56a04a1785aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:12.673612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe2d3275-1634-4fb5-a05d-56a04a1785aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:12.675209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe2d3275-1634-4fb5-a05d-56a04a1785aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:12.675595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe2d3275-1634-4fb5-a05d-56a04a1785aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:12.833868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fe2d3275-1634-4fb5-a05d-56a04a1785aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:12.843267 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fe2d3275-1634-4fb5-a05d-56a04a1785aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1375 microversion: 2.1 time: 0.182243 Jul 26 14:53:12.843862 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3069/6019] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:12 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1375 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:13.864563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e07ad1cd-af40-4cb9-86c3-a249689994e7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:13.865413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e07ad1cd-af40-4cb9-86c3-a249689994e7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:13.872655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e07ad1cd-af40-4cb9-86c3-a249689994e7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:13.873113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e07ad1cd-af40-4cb9-86c3-a249689994e7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:13.873891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e07ad1cd-af40-4cb9-86c3-a249689994e7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:13.874328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e07ad1cd-af40-4cb9-86c3-a249689994e7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:14.028174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e07ad1cd-af40-4cb9-86c3-a249689994e7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:14.037291 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e07ad1cd-af40-4cb9-86c3-a249689994e7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1375 microversion: 2.1 time: 0.176831 Jul 26 14:53:14.037873 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2951/6020] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:13 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:15.061728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e60d15e7-b775-4d20-84d4-98127792e90d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:15.062395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e60d15e7-b775-4d20-84d4-98127792e90d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:15.071256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e60d15e7-b775-4d20-84d4-98127792e90d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:15.071734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e60d15e7-b775-4d20-84d4-98127792e90d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:15.072926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e60d15e7-b775-4d20-84d4-98127792e90d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:15.073444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e60d15e7-b775-4d20-84d4-98127792e90d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:15.092888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:15.248641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e60d15e7-b775-4d20-84d4-98127792e90d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:15.263993 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e60d15e7-b775-4d20-84d4-98127792e90d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1375 microversion: 2.1 time: 0.206260 Jul 26 14:53:15.265229 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3070/6021] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:15 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1375 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:16.285712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6c2e61fd-e1a2-4df3-9190-223993677504 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:16.286433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6c2e61fd-e1a2-4df3-9190-223993677504 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:16.294187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c2e61fd-e1a2-4df3-9190-223993677504 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:16.294649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c2e61fd-e1a2-4df3-9190-223993677504 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:16.295572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c2e61fd-e1a2-4df3-9190-223993677504 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:16.296039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6c2e61fd-e1a2-4df3-9190-223993677504 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:16.444828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6c2e61fd-e1a2-4df3-9190-223993677504 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:16.452570 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6c2e61fd-e1a2-4df3-9190-223993677504 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1375 microversion: 2.1 time: 0.170929 Jul 26 14:53:16.453153 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2952/6022] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:16 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:16.660568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d35a6319-0e7c-47cf-97b6-5b0d38112255 req-2bd3f8e0-858c-470d-ad86-a291ec09333e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4346c2e0-eefb-493b-9468-2c71a16e6530", "name": "network-vif-plugged", "status": "completed", "tag": "13e51208-a3d9-403b-b6a9-b8f7ace6a6ea"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:53:16.666898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=34 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:16.673573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d35a6319-0e7c-47cf-97b6-5b0d38112255 req-2bd3f8e0-858c-470d-ad86-a291ec09333e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:16.674041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d35a6319-0e7c-47cf-97b6-5b0d38112255 req-2bd3f8e0-858c-470d-ad86-a291ec09333e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:16.687728 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d35a6319-0e7c-47cf-97b6-5b0d38112255 req-2bd3f8e0-858c-470d-ad86-a291ec09333e service nova] Creating event network-vif-plugged:13e51208-a3d9-403b-b6a9-b8f7ace6a6ea for instance 4346c2e0-eefb-493b-9468-2c71a16e6530 on n-h2-833090-9 Jul 26 14:53:16.694330 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d35a6319-0e7c-47cf-97b6-5b0d38112255 req-2bd3f8e0-858c-470d-ad86-a291ec09333e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038629 Jul 26 14:53:16.695316 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3071/6023] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:53:17.474834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4dc25c4f-4f1e-41de-8339-5fc20fa4b078 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:17.475521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4dc25c4f-4f1e-41de-8339-5fc20fa4b078 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:17.485017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dc25c4f-4f1e-41de-8339-5fc20fa4b078 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:17.485405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dc25c4f-4f1e-41de-8339-5fc20fa4b078 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:17.486613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dc25c4f-4f1e-41de-8339-5fc20fa4b078 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:17.487227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4dc25c4f-4f1e-41de-8339-5fc20fa4b078 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:17.662906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4dc25c4f-4f1e-41de-8339-5fc20fa4b078 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:17.675748 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4dc25c4f-4f1e-41de-8339-5fc20fa4b078 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1375 microversion: 2.1 time: 0.205561 Jul 26 14:53:17.676712 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2953/6024] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:17 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1375 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:18.700145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-82873cdc-69df-4d95-a7e9-a2aa3a8fdccb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:18.700804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-82873cdc-69df-4d95-a7e9-a2aa3a8fdccb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:18.708609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82873cdc-69df-4d95-a7e9-a2aa3a8fdccb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:18.709085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82873cdc-69df-4d95-a7e9-a2aa3a8fdccb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:18.710016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82873cdc-69df-4d95-a7e9-a2aa3a8fdccb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:18.710579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82873cdc-69df-4d95-a7e9-a2aa3a8fdccb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:19.092442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-82873cdc-69df-4d95-a7e9-a2aa3a8fdccb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:19.101351 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-82873cdc-69df-4d95-a7e9-a2aa3a8fdccb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1562 microversion: 2.1 time: 0.406825 Jul 26 14:53:19.102051 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3072/6025] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:18 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1562 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:19.123304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-37a59263-7e27-4f8a-94a5-4945bc598bbf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:19.124153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-37a59263-7e27-4f8a-94a5-4945bc598bbf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:19.127327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=30 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:19.133171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37a59263-7e27-4f8a-94a5-4945bc598bbf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:19.133716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37a59263-7e27-4f8a-94a5-4945bc598bbf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:19.134492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37a59263-7e27-4f8a-94a5-4945bc598bbf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:19.134932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37a59263-7e27-4f8a-94a5-4945bc598bbf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:19.281404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-37a59263-7e27-4f8a-94a5-4945bc598bbf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:19.289958 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-37a59263-7e27-4f8a-94a5-4945bc598bbf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1562 microversion: 2.1 time: 0.170812 Jul 26 14:53:19.290613 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2954/6026] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:19 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:19.372658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b4ca36f6-4c0b-4c01-8d72-c3c761da1857 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:19.373190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b4ca36f6-4c0b-4c01-8d72-c3c761da1857 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:19.379587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4ca36f6-4c0b-4c01-8d72-c3c761da1857 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:19.380176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4ca36f6-4c0b-4c01-8d72-c3c761da1857 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:19.381124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4ca36f6-4c0b-4c01-8d72-c3c761da1857 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:19.381860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b4ca36f6-4c0b-4c01-8d72-c3c761da1857 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:19.409349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b4ca36f6-4c0b-4c01-8d72-c3c761da1857 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:53:19.497842 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b4ca36f6-4c0b-4c01-8d72-c3c761da1857 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 204 len: 0 microversion: 2.1 time: 0.128752 Jul 26 14:53:19.498731 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3073/6027] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:53:19 2022] DELETE /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:53:19.511585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-912f8761-24ac-4e1b-815c-805ccf2d778a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:19.512646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-912f8761-24ac-4e1b-815c-805ccf2d778a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:19.519699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-912f8761-24ac-4e1b-815c-805ccf2d778a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:19.520553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-912f8761-24ac-4e1b-815c-805ccf2d778a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:19.521238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-912f8761-24ac-4e1b-815c-805ccf2d778a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:19.522559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-912f8761-24ac-4e1b-815c-805ccf2d778a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:19.675920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-912f8761-24ac-4e1b-815c-805ccf2d778a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:19.683917 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-912f8761-24ac-4e1b-815c-805ccf2d778a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1568 microversion: 2.1 time: 0.179738 Jul 26 14:53:19.684537 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2955/6028] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:19 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:20.709765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d7ab5315-7b75-439e-8f46-c38dc27ca720 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:20.710513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d7ab5315-7b75-439e-8f46-c38dc27ca720 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:20.718216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7ab5315-7b75-439e-8f46-c38dc27ca720 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:20.718748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7ab5315-7b75-439e-8f46-c38dc27ca720 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:20.719562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7ab5315-7b75-439e-8f46-c38dc27ca720 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:20.720063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7ab5315-7b75-439e-8f46-c38dc27ca720 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:20.904207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d7ab5315-7b75-439e-8f46-c38dc27ca720 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:20.912455 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d7ab5315-7b75-439e-8f46-c38dc27ca720 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1568 microversion: 2.1 time: 0.209294 Jul 26 14:53:20.913102 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3074/6029] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:20 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:21.705877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-37cd01d4-1671-453e-ab40-e50aa20a6269 req-c4dcf506-533d-4c63-b128-f045c2aaa7dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4346c2e0-eefb-493b-9468-2c71a16e6530", "name": "network-vif-deleted", "tag": "13e51208-a3d9-403b-b6a9-b8f7ace6a6ea"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:53:21.718861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-37cd01d4-1671-453e-ab40-e50aa20a6269 req-c4dcf506-533d-4c63-b128-f045c2aaa7dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:21.719498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-37cd01d4-1671-453e-ab40-e50aa20a6269 req-c4dcf506-533d-4c63-b128-f045c2aaa7dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:21.733962 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-37cd01d4-1671-453e-ab40-e50aa20a6269 req-c4dcf506-533d-4c63-b128-f045c2aaa7dd service nova] Creating event network-vif-deleted:13e51208-a3d9-403b-b6a9-b8f7ace6a6ea for instance 4346c2e0-eefb-493b-9468-2c71a16e6530 on n-h2-833090-9 Jul 26 14:53:21.745471 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-37cd01d4-1671-453e-ab40-e50aa20a6269 req-c4dcf506-533d-4c63-b128-f045c2aaa7dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044086 Jul 26 14:53:21.749813 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2956/6030] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:53:21.934852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ef2d67e9-0a75-4446-a2f9-bb70c63a9f39 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:21.935560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef2d67e9-0a75-4446-a2f9-bb70c63a9f39 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:21.944514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef2d67e9-0a75-4446-a2f9-bb70c63a9f39 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:21.945796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef2d67e9-0a75-4446-a2f9-bb70c63a9f39 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:21.947562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef2d67e9-0a75-4446-a2f9-bb70c63a9f39 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:21.948070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef2d67e9-0a75-4446-a2f9-bb70c63a9f39 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:22.036345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ef2d67e9-0a75-4446-a2f9-bb70c63a9f39 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:22.046134 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ef2d67e9-0a75-4446-a2f9-bb70c63a9f39 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1360 microversion: 2.1 time: 0.115228 Jul 26 14:53:22.047487 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3075/6031] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:21 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1360 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:23.072261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f1e7b396-d529-4714-907e-286e8e33c075 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:23.073355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f1e7b396-d529-4714-907e-286e8e33c075 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:23.080585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1e7b396-d529-4714-907e-286e8e33c075 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:23.081543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1e7b396-d529-4714-907e-286e8e33c075 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:23.082573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1e7b396-d529-4714-907e-286e8e33c075 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:23.083122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1e7b396-d529-4714-907e-286e8e33c075 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:23.177382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f1e7b396-d529-4714-907e-286e8e33c075 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:23.188332 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f1e7b396-d529-4714-907e-286e8e33c075 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1360 microversion: 2.1 time: 0.121962 Jul 26 14:53:23.203681 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2957/6032] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:23 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1360 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:24.213203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-726348a3-78f3-4023-88f7-616ea43b6a05 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:24.214441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-726348a3-78f3-4023-88f7-616ea43b6a05 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:24.224238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-726348a3-78f3-4023-88f7-616ea43b6a05 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:24.225006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-726348a3-78f3-4023-88f7-616ea43b6a05 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:24.226282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-726348a3-78f3-4023-88f7-616ea43b6a05 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:24.227053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-726348a3-78f3-4023-88f7-616ea43b6a05 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:24.301733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-726348a3-78f3-4023-88f7-616ea43b6a05 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:24.312882 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-726348a3-78f3-4023-88f7-616ea43b6a05 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1360 microversion: 2.1 time: 0.104731 Jul 26 14:53:24.313505 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3076/6033] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:24 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1360 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:25.335556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f52f7190-a8ff-47b1-80e1-256b29045545 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:25.336220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f52f7190-a8ff-47b1-80e1-256b29045545 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:25.343280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f52f7190-a8ff-47b1-80e1-256b29045545 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:25.343936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f52f7190-a8ff-47b1-80e1-256b29045545 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:25.344597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f52f7190-a8ff-47b1-80e1-256b29045545 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:25.345052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f52f7190-a8ff-47b1-80e1-256b29045545 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:25.414977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f52f7190-a8ff-47b1-80e1-256b29045545 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:25.433103 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f52f7190-a8ff-47b1-80e1-256b29045545 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1360 microversion: 2.1 time: 0.101381 Jul 26 14:53:25.433774 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2958/6034] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:25 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1360 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:26.456223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2e572a5d-b9f9-4a07-b8c7-fa1b71456050 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:26.456858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2e572a5d-b9f9-4a07-b8c7-fa1b71456050 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:26.465354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e572a5d-b9f9-4a07-b8c7-fa1b71456050 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:26.465900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e572a5d-b9f9-4a07-b8c7-fa1b71456050 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:26.467097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e572a5d-b9f9-4a07-b8c7-fa1b71456050 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:26.467559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e572a5d-b9f9-4a07-b8c7-fa1b71456050 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:26.552605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2e572a5d-b9f9-4a07-b8c7-fa1b71456050 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:26.569810 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2e572a5d-b9f9-4a07-b8c7-fa1b71456050 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 200 len: 1360 microversion: 2.1 time: 0.118901 Jul 26 14:53:26.570688 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3077/6035] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:26 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 1360 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:27.597292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff663b2f-62e2-49ef-98b6-cb0adc1bee3d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:27.598532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ff663b2f-62e2-49ef-98b6-cb0adc1bee3d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:27.605836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff663b2f-62e2-49ef-98b6-cb0adc1bee3d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:27.606709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff663b2f-62e2-49ef-98b6-cb0adc1bee3d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:27.607565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff663b2f-62e2-49ef-98b6-cb0adc1bee3d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:27.608037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff663b2f-62e2-49ef-98b6-cb0adc1bee3d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:27.626436 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ff663b2f-62e2-49ef-98b6-cb0adc1bee3d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff663b2f-62e2-49ef-98b6-cb0adc1bee3d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 HTTP/1.1 Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4346c2e0-eefb-493b-9468-2c71a16e6530'} Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:27.629180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:27.633911 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:27.633911 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:27.633911 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:27.633911 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:53:27.633911 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:53:27.633911 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:27.633911 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:27.636483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff663b2f-62e2-49ef-98b6-cb0adc1bee3d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:53:27.638149 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff663b2f-62e2-49ef-98b6-cb0adc1bee3d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 404 len: 111 microversion: 2.1 time: 0.045246 Jul 26 14:53:27.639366 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2959/6036] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:27 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:53:31.359553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b19589cc-fa08-482f-ab9d-ad0fa2a7b7c4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692-project-admin] Calling method '.version_select at 0x7f8786a3d280>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:31.360557 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:53:31.360557 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 14:53:31.362714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b19589cc-fa08-482f-ab9d-ad0fa2a7b7c4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:31.363198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b19589cc-fa08-482f-ab9d-ad0fa2a7b7c4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:31.381404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b19589cc-fa08-482f-ab9d-ad0fa2a7b7c4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:31.381945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b19589cc-fa08-482f-ab9d-ad0fa2a7b7c4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:31.392944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b19589cc-fa08-482f-ab9d-ad0fa2a7b7c4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:31.393664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b19589cc-fa08-482f-ab9d-ad0fa2a7b7c4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:31.401876 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b19589cc-fa08-482f-ab9d-ad0fa2a7b7c4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1103798692-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.193461 Jul 26 14:53:31.409360 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3078/6037] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 14:53:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:53:31.964828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1f318263-a193-44cf-8338-ea70fedecfe6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:31.965403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f318263-a193-44cf-8338-ea70fedecfe6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:31.974592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f318263-a193-44cf-8338-ea70fedecfe6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:31.974852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f318263-a193-44cf-8338-ea70fedecfe6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:31.975643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f318263-a193-44cf-8338-ea70fedecfe6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:31.976171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f318263-a193-44cf-8338-ea70fedecfe6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:32.012538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f318263-a193-44cf-8338-ea70fedecfe6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:53:32.096716 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1f318263-a193-44cf-8338-ea70fedecfe6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 204 len: 0 microversion: 2.1 time: 0.135874 Jul 26 14:53:32.097463 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2960/6038] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:53:31 2022] DELETE /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:53:32.106477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36df571b-ee51-49f6-ad75-2ccc04fa22bf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:32.107124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-36df571b-ee51-49f6-ad75-2ccc04fa22bf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:32.114240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36df571b-ee51-49f6-ad75-2ccc04fa22bf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:32.114804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36df571b-ee51-49f6-ad75-2ccc04fa22bf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:32.115521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36df571b-ee51-49f6-ad75-2ccc04fa22bf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:32.116023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36df571b-ee51-49f6-ad75-2ccc04fa22bf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:32.339898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-36df571b-ee51-49f6-ad75-2ccc04fa22bf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:32.348984 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-36df571b-ee51-49f6-ad75-2ccc04fa22bf tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1409 microversion: 2.1 time: 0.246725 Jul 26 14:53:32.349573 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3079/6039] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:32 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1409 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:33.371837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-301ff91f-8a85-4352-bb9d-04d744d766aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:33.372782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-301ff91f-8a85-4352-bb9d-04d744d766aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:33.382987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-301ff91f-8a85-4352-bb9d-04d744d766aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:33.383597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-301ff91f-8a85-4352-bb9d-04d744d766aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:33.385250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-301ff91f-8a85-4352-bb9d-04d744d766aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:33.385796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-301ff91f-8a85-4352-bb9d-04d744d766aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:33.592120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-301ff91f-8a85-4352-bb9d-04d744d766aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:33.600277 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-301ff91f-8a85-4352-bb9d-04d744d766aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1409 microversion: 2.1 time: 0.232749 Jul 26 14:53:33.601152 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2961/6040] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:33 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1409 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:34.557722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-26fdcff7-80d5-4b02-8d65-ef2131c7130c req-1f0397b2-3a87-4d5b-a059-63f071a77af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50c8b86f-8ee8-4f50-9468-e264a7211af8", "name": "network-vif-deleted", "tag": "87c1f720-768e-492c-acda-c8d09d4f8353"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:53:34.578542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-26fdcff7-80d5-4b02-8d65-ef2131c7130c req-1f0397b2-3a87-4d5b-a059-63f071a77af2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:34.579725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-26fdcff7-80d5-4b02-8d65-ef2131c7130c req-1f0397b2-3a87-4d5b-a059-63f071a77af2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:34.596282 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-26fdcff7-80d5-4b02-8d65-ef2131c7130c req-1f0397b2-3a87-4d5b-a059-63f071a77af2 service nova] Creating event network-vif-deleted:87c1f720-768e-492c-acda-c8d09d4f8353 for instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 on n-h1-833090-9 Jul 26 14:53:34.604057 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-26fdcff7-80d5-4b02-8d65-ef2131c7130c req-1f0397b2-3a87-4d5b-a059-63f071a77af2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049263 Jul 26 14:53:34.605019 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3080/6041] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:53:34.622883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-47d22698-b902-4c26-9cef-f762ad686019 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:34.623594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-47d22698-b902-4c26-9cef-f762ad686019 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:34.632525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47d22698-b902-4c26-9cef-f762ad686019 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:34.633325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47d22698-b902-4c26-9cef-f762ad686019 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:34.634364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47d22698-b902-4c26-9cef-f762ad686019 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:34.634882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47d22698-b902-4c26-9cef-f762ad686019 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:34.730988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-47d22698-b902-4c26-9cef-f762ad686019 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:34.741166 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-47d22698-b902-4c26-9cef-f762ad686019 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1201 microversion: 2.1 time: 0.122131 Jul 26 14:53:34.742062 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2962/6042] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:34 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1201 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:35.778262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1aec76d-9538-4a66-a06c-56f5ed03bc59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:35.779731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f1aec76d-9538-4a66-a06c-56f5ed03bc59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:35.794369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1aec76d-9538-4a66-a06c-56f5ed03bc59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:35.794941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1aec76d-9538-4a66-a06c-56f5ed03bc59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:35.795820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1aec76d-9538-4a66-a06c-56f5ed03bc59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:35.796335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1aec76d-9538-4a66-a06c-56f5ed03bc59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:35.894045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1aec76d-9538-4a66-a06c-56f5ed03bc59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:35.904131 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f1aec76d-9538-4a66-a06c-56f5ed03bc59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1201 microversion: 2.1 time: 0.130605 Jul 26 14:53:35.905833 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3081/6043] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:35 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1201 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:36.926373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f9e28f86-d335-44f3-a5d6-8cac210f2edc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:36.927529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f9e28f86-d335-44f3-a5d6-8cac210f2edc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:36.937137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9e28f86-d335-44f3-a5d6-8cac210f2edc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:36.937721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9e28f86-d335-44f3-a5d6-8cac210f2edc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:36.938871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9e28f86-d335-44f3-a5d6-8cac210f2edc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:36.939851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f9e28f86-d335-44f3-a5d6-8cac210f2edc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:37.016597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f9e28f86-d335-44f3-a5d6-8cac210f2edc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:37.028438 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f9e28f86-d335-44f3-a5d6-8cac210f2edc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1201 microversion: 2.1 time: 0.106810 Jul 26 14:53:37.030831 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2963/6044] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:36 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1201 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:38.053479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c281b8b2-1899-4f09-aa91-ce51d5c95096 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:38.054253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c281b8b2-1899-4f09-aa91-ce51d5c95096 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:38.061943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c281b8b2-1899-4f09-aa91-ce51d5c95096 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:38.062529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c281b8b2-1899-4f09-aa91-ce51d5c95096 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:38.063499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c281b8b2-1899-4f09-aa91-ce51d5c95096 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:38.064095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c281b8b2-1899-4f09-aa91-ce51d5c95096 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:38.137966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c281b8b2-1899-4f09-aa91-ce51d5c95096 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:38.147533 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c281b8b2-1899-4f09-aa91-ce51d5c95096 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1201 microversion: 2.1 time: 0.098947 Jul 26 14:53:38.148367 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3082/6045] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:38 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:39.169594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:39.170232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:39.179115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:39.179859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:39.180673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:39.181111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:39.215817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:39.216311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:39.216883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lazy-loading 'fault' on Instance uuid 50c8b86f-8ee8-4f50-9468-e264a7211af8 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:53:39.262247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:39.272956 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ac107481-c610-4abe-bd84-bebb3a064360 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 200 len: 1206 microversion: 2.1 time: 0.107438 Jul 26 14:53:39.276123 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2964/6046] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:39 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 1206 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:40.294299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cafc194-06ce-48ae-afac-c11cc099b8d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:40.295267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5cafc194-06ce-48ae-afac-c11cc099b8d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:40.304044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cafc194-06ce-48ae-afac-c11cc099b8d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:40.304644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cafc194-06ce-48ae-afac-c11cc099b8d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:40.306399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cafc194-06ce-48ae-afac-c11cc099b8d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:40.307021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cafc194-06ce-48ae-afac-c11cc099b8d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:40.323423 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-5cafc194-06ce-48ae-afac-c11cc099b8d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cafc194-06ce-48ae-afac-c11cc099b8d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 HTTP/1.1 Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '50c8b86f-8ee8-4f50-9468-e264a7211af8'} Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:40.325497 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:40.332234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:40.332234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:40.332234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:40.332234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:53:40.332234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:53:40.332234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:40.332234 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:40.332234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cafc194-06ce-48ae-afac-c11cc099b8d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:53:40.332234 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5cafc194-06ce-48ae-afac-c11cc099b8d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 404 len: 111 microversion: 2.1 time: 0.036701 Jul 26 14:53:40.332234 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3083/6047] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:40 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:53:42.480873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-67d7204e-dec8-4bfd-a89c-ea0e15cf87fe tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:42.481401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-67d7204e-dec8-4bfd-a89c-ea0e15cf87fe tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:42.488874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67d7204e-dec8-4bfd-a89c-ea0e15cf87fe tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:42.489330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67d7204e-dec8-4bfd-a89c-ea0e15cf87fe tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:42.490111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67d7204e-dec8-4bfd-a89c-ea0e15cf87fe tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:42.490549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67d7204e-dec8-4bfd-a89c-ea0e15cf87fe tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:42.505224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:42.507242 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-67d7204e-dec8-4bfd-a89c-ea0e15cf87fe tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-67d7204e-dec8-4bfd-a89c-ea0e15cf87fe tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 HTTP/1.1 Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4346c2e0-eefb-493b-9468-2c71a16e6530'} Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:53:42.510937 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-67d7204e-dec8-4bfd-a89c-ea0e15cf87fe tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-67d7204e-dec8-4bfd-a89c-ea0e15cf87fe tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 404 len: 111 microversion: 2.1 time: 0.035585 Jul 26 14:53:42.518365 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2965/6048] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:53:42 2022] DELETE /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:53:42.522369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f8d2ddd2-f771-4bf8-ab5a-30bf918df956 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:42.523565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f8d2ddd2-f771-4bf8-ab5a-30bf918df956 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4346c2e0-eefb-493b-9468-2c71a16e6530] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:42.531101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8d2ddd2-f771-4bf8-ab5a-30bf918df956 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:42.531573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8d2ddd2-f771-4bf8-ab5a-30bf918df956 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:42.532406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8d2ddd2-f771-4bf8-ab5a-30bf918df956 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:42.534009 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f8d2ddd2-f771-4bf8-ab5a-30bf918df956 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:42.549788 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-f8d2ddd2-f771-4bf8-ab5a-30bf918df956 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f8d2ddd2-f771-4bf8-ab5a-30bf918df956 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 HTTP/1.1 Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4346c2e0-eefb-493b-9468-2c71a16e6530'} Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:42.552448 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:42.557713 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:42.557713 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:42.557713 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:42.557713 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:53:42.557713 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:53:42.557713 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. Jul 26 14:53:42.557713 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:42.568944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f8d2ddd2-f771-4bf8-ab5a-30bf918df956 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 4346c2e0-eefb-493b-9468-2c71a16e6530 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:53:42.569975 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f8d2ddd2-f771-4bf8-ab5a-30bf918df956 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530" status: 404 len: 111 microversion: 2.1 time: 0.052441 Jul 26 14:53:42.570785 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3084/6049] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:42 2022] GET /compute/v2.1/servers/4346c2e0-eefb-493b-9468-2c71a16e6530 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:53:43.182542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c78d507-3ad5-4c2f-ac87-f820eba464f7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:43.183048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0c78d507-3ad5-4c2f-ac87-f820eba464f7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:43.192260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c78d507-3ad5-4c2f-ac87-f820eba464f7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:43.192777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c78d507-3ad5-4c2f-ac87-f820eba464f7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:43.193576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c78d507-3ad5-4c2f-ac87-f820eba464f7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:43.194024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c78d507-3ad5-4c2f-ac87-f820eba464f7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:43.213936 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-0c78d507-3ad5-4c2f-ac87-f820eba464f7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c78d507-3ad5-4c2f-ac87-f820eba464f7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 HTTP/1.1 Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '50c8b86f-8ee8-4f50-9468-e264a7211af8'} Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:53:43.215523 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c78d507-3ad5-4c2f-ac87-f820eba464f7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c78d507-3ad5-4c2f-ac87-f820eba464f7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 404 len: 111 microversion: 2.1 time: 0.039042 Jul 26 14:53:43.224482 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2966/6050] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:53:43 2022] DELETE /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:53:43.233094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-200a3326-00a9-455b-9395-a9530b086ec5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:43.233754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-200a3326-00a9-455b-9395-a9530b086ec5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 50c8b86f-8ee8-4f50-9468-e264a7211af8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:43.242110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-200a3326-00a9-455b-9395-a9530b086ec5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:43.242603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-200a3326-00a9-455b-9395-a9530b086ec5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:43.243421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-200a3326-00a9-455b-9395-a9530b086ec5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:43.244140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-200a3326-00a9-455b-9395-a9530b086ec5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:43.259224 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-200a3326-00a9-455b-9395-a9530b086ec5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-200a3326-00a9-455b-9395-a9530b086ec5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 HTTP/1.1 Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '50c8b86f-8ee8-4f50-9468-e264a7211af8'} Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:43.260902 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:43.266072 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:43.266072 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:43.266072 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:43.266072 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:53:43.266072 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:53:43.266072 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. Jul 26 14:53:43.266072 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 14:53:43.266072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-200a3326-00a9-455b-9395-a9530b086ec5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 50c8b86f-8ee8-4f50-9468-e264a7211af8 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:53:43.266072 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-200a3326-00a9-455b-9395-a9530b086ec5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8" status: 404 len: 111 microversion: 2.1 time: 0.034569 Jul 26 14:53:43.266770 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3085/6051] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:43 2022] GET /compute/v2.1/servers/50c8b86f-8ee8-4f50-9468-e264a7211af8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:53:43.340413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d7e6352f-6a64-4c84-a9ed-424fdd06e10c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Action: 'create', calling method: .version_select at 0x7f8787e82d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-679082839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI50eTB8GVbmpMdiJbz44vCWQY0QEFBc8D6ac6H7xn3Ev9gRcVm//D8PRy1ddn/9uR3oeKNVDDEgRPSj2y/vYW1rmjstIYHIGg7JqB66U6z7kq5ZTD3Wx8hgsVRpklguQ=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:53:43.356779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-d7e6352f-6a64-4c84-a9ed-424fdd06e10c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for project f953d00da52543fda852b2d118613fa8. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:53:43.364928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-d7e6352f-6a64-4c84-a9ed-424fdd06e10c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for user ac9553617f2440a68e33b82650206cae and project f953d00da52543fda852b2d118613fa8. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:53:43.391128 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d7e6352f-6a64-4c84-a9ed-424fdd06e10c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.054714 Jul 26 14:53:43.391927 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2967/6052] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:53:43 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:54:03.900787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1919962711", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-679082839", "security_groups": [{"name": "tempest-secgroup-smoke-1340528023"}], "block_device_mapping_v2": [{"uuid": "bd4e1022-d030-4af5-8de0-29bf21155daf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e976b6cc-dfb4-45b5-af81-629f1adeef76"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:03.913031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:03.913424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:04.347051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] validate_networks() for [('e976b6cc-dfb4-45b5-af81-629f1adeef76', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:54:05.402498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:54:05.403135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:54:05.403436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:54:05.403863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:54:05.404329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:54:05.415489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:05.415974 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:05.416802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:05.417254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:05.438342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:54:05.445108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for user ac9553617f2440a68e33b82650206cae and project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:54:05.507227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:54:05.509376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd4e1022-d030-4af5-8de0-29bf21155daf',volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:54:05.670795 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ffb83b4b-48c7-4eeb-be60-ef409f8be10f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.773978 Jul 26 14:54:05.672019 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3086/6053] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:54:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:54:05.684407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0d1f1c2-7843-4818-aa7d-c11a8fd1e24d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:05.685041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c0d1f1c2-7843-4818-aa7d-c11a8fd1e24d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:05.689079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:05.700126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:05.701338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:05.898233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c0d1f1c2-7843-4818-aa7d-c11a8fd1e24d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:05.905723 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c0d1f1c2-7843-4818-aa7d-c11a8fd1e24d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1094 microversion: 2.1 time: 0.225606 Jul 26 14:54:05.906317 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2968/6054] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:05 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1094 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:06.935159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dab6603f-c698-4637-9a87-afd83a08cb48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:06.936743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dab6603f-c698-4637-9a87-afd83a08cb48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:06.947482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dab6603f-c698-4637-9a87-afd83a08cb48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:06.948274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dab6603f-c698-4637-9a87-afd83a08cb48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:06.950719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dab6603f-c698-4637-9a87-afd83a08cb48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:06.951723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dab6603f-c698-4637-9a87-afd83a08cb48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:07.093269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dab6603f-c698-4637-9a87-afd83a08cb48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:07.111243 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dab6603f-c698-4637-9a87-afd83a08cb48 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1210 microversion: 2.1 time: 0.188316 Jul 26 14:54:07.112861 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3087/6055] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:06 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1210 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:08.134852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-874f2f20-12e1-4c7d-824b-efd279dec8c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:08.136926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-874f2f20-12e1-4c7d-824b-efd279dec8c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:08.145522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-874f2f20-12e1-4c7d-824b-efd279dec8c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:08.146437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-874f2f20-12e1-4c7d-824b-efd279dec8c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:08.147434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-874f2f20-12e1-4c7d-824b-efd279dec8c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:08.148081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-874f2f20-12e1-4c7d-824b-efd279dec8c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:08.395596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-874f2f20-12e1-4c7d-824b-efd279dec8c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:08.419659 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-874f2f20-12e1-4c7d-824b-efd279dec8c4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1278 microversion: 2.1 time: 0.289439 Jul 26 14:54:08.424682 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2969/6056] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:08 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1278 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:08.677921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1139e96a-6b7e-4dc9-ba00-07227e4b1778 req-664341e1-7ed2-4005-bb04-1210bc22a8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9a1be8-b8e7-4be1-897f-02e3a877deb8", "tag": "3228ed03-8144-4209-94d9-f13637551d33"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:08.696805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1139e96a-6b7e-4dc9-ba00-07227e4b1778 req-664341e1-7ed2-4005-bb04-1210bc22a8b9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:08.697437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1139e96a-6b7e-4dc9-ba00-07227e4b1778 req-664341e1-7ed2-4005-bb04-1210bc22a8b9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:08.710720 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1139e96a-6b7e-4dc9-ba00-07227e4b1778 req-664341e1-7ed2-4005-bb04-1210bc22a8b9 service nova] Creating event network-changed:3228ed03-8144-4209-94d9-f13637551d33 for instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 on n-h2-833090-9 Jul 26 14:54:08.717916 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1139e96a-6b7e-4dc9-ba00-07227e4b1778 req-664341e1-7ed2-4005-bb04-1210bc22a8b9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045659 Jul 26 14:54:08.720143 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3088/6057] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:54:09.450479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-809420ad-b061-4b45-adfe-cd6d2795ab5e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:09.451795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-809420ad-b061-4b45-adfe-cd6d2795ab5e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:09.467782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-809420ad-b061-4b45-adfe-cd6d2795ab5e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:09.468583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-809420ad-b061-4b45-adfe-cd6d2795ab5e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:09.469574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-809420ad-b061-4b45-adfe-cd6d2795ab5e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:09.470186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-809420ad-b061-4b45-adfe-cd6d2795ab5e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:09.737389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-809420ad-b061-4b45-adfe-cd6d2795ab5e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:09.748988 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-809420ad-b061-4b45-adfe-cd6d2795ab5e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1278 microversion: 2.1 time: 0.303583 Jul 26 14:54:09.750237 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2970/6058] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:09 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1278 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:10.779759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d891b163-b043-43bd-b91b-2ded6ad7f243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:10.781253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d891b163-b043-43bd-b91b-2ded6ad7f243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:10.793754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d891b163-b043-43bd-b91b-2ded6ad7f243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:10.794231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d891b163-b043-43bd-b91b-2ded6ad7f243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:10.795078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d891b163-b043-43bd-b91b-2ded6ad7f243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:10.795540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d891b163-b043-43bd-b91b-2ded6ad7f243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:10.987411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d891b163-b043-43bd-b91b-2ded6ad7f243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:11.003681 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d891b163-b043-43bd-b91b-2ded6ad7f243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1278 microversion: 2.1 time: 0.228086 Jul 26 14:54:11.004343 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3089/6059] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:10 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1278 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:12.028700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bd3ceaa9-cc46-4e1a-a57f-9f09ee6d4606 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:12.030978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bd3ceaa9-cc46-4e1a-a57f-9f09ee6d4606 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:12.045153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd3ceaa9-cc46-4e1a-a57f-9f09ee6d4606 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:12.046102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd3ceaa9-cc46-4e1a-a57f-9f09ee6d4606 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:12.047810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd3ceaa9-cc46-4e1a-a57f-9f09ee6d4606 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:12.050682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd3ceaa9-cc46-4e1a-a57f-9f09ee6d4606 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:12.262026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bd3ceaa9-cc46-4e1a-a57f-9f09ee6d4606 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:12.272575 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bd3ceaa9-cc46-4e1a-a57f-9f09ee6d4606 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1278 microversion: 2.1 time: 0.251030 Jul 26 14:54:12.285834 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2971/6060] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:12 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1278 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:13.296257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-faf2f7cd-4880-41ae-8f66-13c0acc596dd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:13.297636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-faf2f7cd-4880-41ae-8f66-13c0acc596dd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:13.306563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faf2f7cd-4880-41ae-8f66-13c0acc596dd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:13.307189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faf2f7cd-4880-41ae-8f66-13c0acc596dd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:13.308039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faf2f7cd-4880-41ae-8f66-13c0acc596dd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:13.308879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faf2f7cd-4880-41ae-8f66-13c0acc596dd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:13.780063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-faf2f7cd-4880-41ae-8f66-13c0acc596dd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:13.795854 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-faf2f7cd-4880-41ae-8f66-13c0acc596dd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1266 microversion: 2.1 time: 0.503551 Jul 26 14:54:13.796689 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3090/6061] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:13 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1266 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:14.820315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b04b5869-87c6-4160-a3c3-1a7b1df090c8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:14.820940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b04b5869-87c6-4160-a3c3-1a7b1df090c8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:14.827012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b04b5869-87c6-4160-a3c3-1a7b1df090c8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:14.827568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b04b5869-87c6-4160-a3c3-1a7b1df090c8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:14.828382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b04b5869-87c6-4160-a3c3-1a7b1df090c8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:14.828831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b04b5869-87c6-4160-a3c3-1a7b1df090c8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:14.973820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b04b5869-87c6-4160-a3c3-1a7b1df090c8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:14.981394 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b04b5869-87c6-4160-a3c3-1a7b1df090c8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1266 microversion: 2.1 time: 0.166302 Jul 26 14:54:14.981963 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2972/6062] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:14 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:16.007487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ab9de9cd-3031-41e2-a874-a1cfd0bbdb1c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:16.009359 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ab9de9cd-3031-41e2-a874-a1cfd0bbdb1c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:16.016869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:16.018601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:16.021295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab9de9cd-3031-41e2-a874-a1cfd0bbdb1c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:16.022072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab9de9cd-3031-41e2-a874-a1cfd0bbdb1c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:16.023745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab9de9cd-3031-41e2-a874-a1cfd0bbdb1c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:16.024357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab9de9cd-3031-41e2-a874-a1cfd0bbdb1c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:16.210868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ab9de9cd-3031-41e2-a874-a1cfd0bbdb1c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:16.219551 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ab9de9cd-3031-41e2-a874-a1cfd0bbdb1c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1266 microversion: 2.1 time: 0.218539 Jul 26 14:54:16.232484 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3091/6063] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:15 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:17.242291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-455e405f-8fb6-4ae4-97e4-cd1805580530 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:17.242704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-455e405f-8fb6-4ae4-97e4-cd1805580530 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:17.245451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:17.251083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-455e405f-8fb6-4ae4-97e4-cd1805580530 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:17.252249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-455e405f-8fb6-4ae4-97e4-cd1805580530 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:17.253528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-455e405f-8fb6-4ae4-97e4-cd1805580530 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:17.253934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-455e405f-8fb6-4ae4-97e4-cd1805580530 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:17.404087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-455e405f-8fb6-4ae4-97e4-cd1805580530 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:17.413261 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-455e405f-8fb6-4ae4-97e4-cd1805580530 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1266 microversion: 2.1 time: 0.175644 Jul 26 14:54:17.413984 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2973/6064] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:17 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:18.437711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dc340e6d-f3c0-4d8a-8d3a-344f6555a96a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:18.438386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dc340e6d-f3c0-4d8a-8d3a-344f6555a96a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:18.447733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dc340e6d-f3c0-4d8a-8d3a-344f6555a96a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:18.448321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dc340e6d-f3c0-4d8a-8d3a-344f6555a96a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:18.449133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dc340e6d-f3c0-4d8a-8d3a-344f6555a96a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:18.449589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dc340e6d-f3c0-4d8a-8d3a-344f6555a96a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:18.642980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dc340e6d-f3c0-4d8a-8d3a-344f6555a96a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:18.653026 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dc340e6d-f3c0-4d8a-8d3a-344f6555a96a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1266 microversion: 2.1 time: 0.219231 Jul 26 14:54:18.653821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3092/6065] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:18 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:19.674767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1159de78-2087-4f33-948d-8dd9868ec200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:19.675542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1159de78-2087-4f33-948d-8dd9868ec200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:19.682609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1159de78-2087-4f33-948d-8dd9868ec200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:19.683065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1159de78-2087-4f33-948d-8dd9868ec200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:19.683854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1159de78-2087-4f33-948d-8dd9868ec200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:19.684326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1159de78-2087-4f33-948d-8dd9868ec200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:19.847287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1159de78-2087-4f33-948d-8dd9868ec200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:19.856514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1159de78-2087-4f33-948d-8dd9868ec200 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1266 microversion: 2.1 time: 0.186595 Jul 26 14:54:19.869289 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2974/6066] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:19 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:20.881230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-35ebbcf2-5a0c-4567-95d5-1411b7ace4d5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:20.881697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-35ebbcf2-5a0c-4567-95d5-1411b7ace4d5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:20.888920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35ebbcf2-5a0c-4567-95d5-1411b7ace4d5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:20.889402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35ebbcf2-5a0c-4567-95d5-1411b7ace4d5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:20.890213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35ebbcf2-5a0c-4567-95d5-1411b7ace4d5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:20.890679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35ebbcf2-5a0c-4567-95d5-1411b7ace4d5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:21.046032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35ebbcf2-5a0c-4567-95d5-1411b7ace4d5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:21.054853 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-35ebbcf2-5a0c-4567-95d5-1411b7ace4d5 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1266 microversion: 2.1 time: 0.178553 Jul 26 14:54:21.055448 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3093/6067] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:20 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:22.076097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d2875896-d1ad-412f-84b9-190de465483e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:22.076866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d2875896-d1ad-412f-84b9-190de465483e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:22.085655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2875896-d1ad-412f-84b9-190de465483e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:22.086498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2875896-d1ad-412f-84b9-190de465483e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:22.087499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2875896-d1ad-412f-84b9-190de465483e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:22.087969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d2875896-d1ad-412f-84b9-190de465483e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:22.238552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d2875896-d1ad-412f-84b9-190de465483e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:22.247580 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d2875896-d1ad-412f-84b9-190de465483e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1266 microversion: 2.1 time: 0.175314 Jul 26 14:54:22.248570 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2975/6068] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:22 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:22.978646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6690fde5-da94-47e8-911b-3e32564ce564 req-2099dcde-961a-4a55-b9c1-7b5dfe3413e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9a1be8-b8e7-4be1-897f-02e3a877deb8", "name": "network-vif-plugged", "status": "completed", "tag": "3228ed03-8144-4209-94d9-f13637551d33"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:22.993756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6690fde5-da94-47e8-911b-3e32564ce564 req-2099dcde-961a-4a55-b9c1-7b5dfe3413e4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:22.994745 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6690fde5-da94-47e8-911b-3e32564ce564 req-2099dcde-961a-4a55-b9c1-7b5dfe3413e4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:23.007995 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6690fde5-da94-47e8-911b-3e32564ce564 req-2099dcde-961a-4a55-b9c1-7b5dfe3413e4 service nova] Creating event network-vif-plugged:3228ed03-8144-4209-94d9-f13637551d33 for instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 on n-h2-833090-9 Jul 26 14:54:23.013307 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6690fde5-da94-47e8-911b-3e32564ce564 req-2099dcde-961a-4a55-b9c1-7b5dfe3413e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038891 Jul 26 14:54:23.013941 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3094/6069] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:54:23.274709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a7361cd8-f0a2-42ee-9c94-37cb24f41ea7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:23.275498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a7361cd8-f0a2-42ee-9c94-37cb24f41ea7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:23.282268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7361cd8-f0a2-42ee-9c94-37cb24f41ea7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:23.283240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7361cd8-f0a2-42ee-9c94-37cb24f41ea7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:23.284114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7361cd8-f0a2-42ee-9c94-37cb24f41ea7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:23.284559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7361cd8-f0a2-42ee-9c94-37cb24f41ea7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:23.426307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a7361cd8-f0a2-42ee-9c94-37cb24f41ea7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:23.434694 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a7361cd8-f0a2-42ee-9c94-37cb24f41ea7 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1266 microversion: 2.1 time: 0.163817 Jul 26 14:54:23.435709 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2976/6070] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:23 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:24.465920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e30088d8-bb90-45db-b083-a79db4292758 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:24.466779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e30088d8-bb90-45db-b083-a79db4292758 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:24.473575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e30088d8-bb90-45db-b083-a79db4292758 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:24.473987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e30088d8-bb90-45db-b083-a79db4292758 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:24.474777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e30088d8-bb90-45db-b083-a79db4292758 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:24.475243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e30088d8-bb90-45db-b083-a79db4292758 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:24.619261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e30088d8-bb90-45db-b083-a79db4292758 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:24.627151 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e30088d8-bb90-45db-b083-a79db4292758 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1453 microversion: 2.1 time: 0.166343 Jul 26 14:54:24.627728 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3095/6071] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:24 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:24.648310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-08243456-c864-4436-966b-c73555428ac0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:24.648941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-08243456-c864-4436-966b-c73555428ac0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:24.655634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08243456-c864-4436-966b-c73555428ac0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:24.656198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08243456-c864-4436-966b-c73555428ac0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:24.656976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08243456-c864-4436-966b-c73555428ac0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:24.657469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08243456-c864-4436-966b-c73555428ac0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:24.803827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-08243456-c864-4436-966b-c73555428ac0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:24.812071 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-08243456-c864-4436-966b-c73555428ac0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1453 microversion: 2.1 time: 0.167814 Jul 26 14:54:24.812666 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2977/6072] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:24 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:26.518661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-290e9b52-a7ae-4b97-936e-7bc51d530848 req-61af9a22-16ef-4ff5-a973-c4237104db1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9a1be8-b8e7-4be1-897f-02e3a877deb8", "tag": "3228ed03-8144-4209-94d9-f13637551d33"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:26.530168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-290e9b52-a7ae-4b97-936e-7bc51d530848 req-61af9a22-16ef-4ff5-a973-c4237104db1c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:26.530646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-290e9b52-a7ae-4b97-936e-7bc51d530848 req-61af9a22-16ef-4ff5-a973-c4237104db1c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:26.543721 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-290e9b52-a7ae-4b97-936e-7bc51d530848 req-61af9a22-16ef-4ff5-a973-c4237104db1c service nova] Creating event network-changed:3228ed03-8144-4209-94d9-f13637551d33 for instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 on n-h2-833090-9 Jul 26 14:54:26.549655 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-290e9b52-a7ae-4b97-936e-7bc51d530848 req-61af9a22-16ef-4ff5-a973-c4237104db1c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034925 Jul 26 14:54:26.551071 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3096/6073] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:53.763213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=22 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:53.764003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=54 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:53.979544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-14fd4cd2-9386-41e3-a412-e1babd070f75 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Action: 'create', calling method: .version_select at 0x7f8787ceb280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-865037253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhStnkdecm4QAbAcFHxsuZL7OE+kqmrKXepNTGODV8K3jKugYfXEWGmglcmjIIC1ixPjdHsefgL6gTf2kuxqMDC9cd4vElTgAf6wrBlJVMqXhWimfmGOWT+LB+Jbh0Bnw=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:53.996222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-14fd4cd2-9386-41e3-a412-e1babd070f75 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Getting quotas for project c4984fbf96584477bf56d06023a62fbd. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:55:54.002276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-14fd4cd2-9386-41e3-a412-e1babd070f75 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Getting quotas for user b831fc644736499695ac2d88bc51efd6 and project c4984fbf96584477bf56d06023a62fbd. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:55:54.030160 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-14fd4cd2-9386-41e3-a412-e1babd070f75 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.272842 Jul 26 14:55:54.031045 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2978/6074] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 14:55:53 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:55.048370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:55.049664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=50 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:55.058599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-508075008", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-865037253", "security_groups": [{"name": "tempest-secgroup-smoke-140820370"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "5a1b7f9b-226a-4b6c-bb84-b9797c131fc7"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:55.169911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] validate_networks() for [('5a1b7f9b-226a-4b6c-bb84-b9797c131fc7', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:55:55.684595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Getting quotas for project c4984fbf96584477bf56d06023a62fbd. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:55:55.690682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Getting quotas for user b831fc644736499695ac2d88bc51efd6 and project c4984fbf96584477bf56d06023a62fbd. Resources: dict_keys(['metadata_items']) {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:55:55.703532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:55:55.703991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:55:55.704495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:55:55.705089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:55:55.705322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:55:55.713601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:55.714068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:55.714883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:55.715339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:55.732571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Getting quotas for project c4984fbf96584477bf56d06023a62fbd. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:55:55.738717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Getting quotas for user b831fc644736499695ac2d88bc51efd6 and project c4984fbf96584477bf56d06023a62fbd. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:55:55.751161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:55:55.753667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:55:55.806888 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e4957200-e1c3-49c7-8492-1f60e1bc7c05 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.761551 Jul 26 14:55:55.807855 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3097/6075] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:55:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:55:55.820935 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d6039f5b-a1f5-4d38-8d2f-1898429def40 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:55.821553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d6039f5b-a1f5-4d38-8d2f-1898429def40 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:55.898643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d6039f5b-a1f5-4d38-8d2f-1898429def40 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:55.905886 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d6039f5b-a1f5-4d38-8d2f-1898429def40 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1301 microversion: 2.1 time: 0.090391 Jul 26 14:55:55.910912 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2979/6076] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:55 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:56.930257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-14380646-a121-484b-bf52-26746418f5b7 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:56.931201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-14380646-a121-484b-bf52-26746418f5b7 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:56.940403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14380646-a121-484b-bf52-26746418f5b7 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:56.941288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14380646-a121-484b-bf52-26746418f5b7 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:56.942929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14380646-a121-484b-bf52-26746418f5b7 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:56.943558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-14380646-a121-484b-bf52-26746418f5b7 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:57.039424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-14380646-a121-484b-bf52-26746418f5b7 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:57.048765 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-14380646-a121-484b-bf52-26746418f5b7 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1371 microversion: 2.1 time: 0.125328 Jul 26 14:55:57.049939 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3098/6077] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:56 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:58.073628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5483d6df-45c4-4e6b-83ca-6ecd83579b8a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:58.075025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5483d6df-45c4-4e6b-83ca-6ecd83579b8a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:58.083075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5483d6df-45c4-4e6b-83ca-6ecd83579b8a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:58.083678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5483d6df-45c4-4e6b-83ca-6ecd83579b8a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:58.084525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5483d6df-45c4-4e6b-83ca-6ecd83579b8a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:58.084974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5483d6df-45c4-4e6b-83ca-6ecd83579b8a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:58.293985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5483d6df-45c4-4e6b-83ca-6ecd83579b8a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:58.303346 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5483d6df-45c4-4e6b-83ca-6ecd83579b8a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1426 microversion: 2.1 time: 0.233861 Jul 26 14:55:58.303918 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2980/6078] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:58 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1426 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:55:58.682110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-129451b0-7c20-4435-93f3-ba097a614eca req-226cf44b-bd20-4611-8a2b-05580f95ea5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b5a234-bd58-4c38-b119-0095a494d1e3", "tag": "02217c29-41df-4dea-832c-98ced87a4b89"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:58.693346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-129451b0-7c20-4435-93f3-ba097a614eca req-226cf44b-bd20-4611-8a2b-05580f95ea5b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:58.693822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-129451b0-7c20-4435-93f3-ba097a614eca req-226cf44b-bd20-4611-8a2b-05580f95ea5b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:58.706878 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-129451b0-7c20-4435-93f3-ba097a614eca req-226cf44b-bd20-4611-8a2b-05580f95ea5b service nova] Creating event network-changed:02217c29-41df-4dea-832c-98ced87a4b89 for instance 09b5a234-bd58-4c38-b119-0095a494d1e3 on n-h1-833090-9 Jul 26 14:55:58.717285 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-129451b0-7c20-4435-93f3-ba097a614eca req-226cf44b-bd20-4611-8a2b-05580f95ea5b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145149 Jul 26 14:55:58.719093 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3099/6079] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:59.324670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cc6ce3d3-6fa8-41e6-8034-7e2e2ecb500f tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:59.325301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cc6ce3d3-6fa8-41e6-8034-7e2e2ecb500f tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:59.332812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cc6ce3d3-6fa8-41e6-8034-7e2e2ecb500f tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:59.333201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cc6ce3d3-6fa8-41e6-8034-7e2e2ecb500f tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:59.334076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cc6ce3d3-6fa8-41e6-8034-7e2e2ecb500f tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:59.334513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cc6ce3d3-6fa8-41e6-8034-7e2e2ecb500f tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:59.471513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cc6ce3d3-6fa8-41e6-8034-7e2e2ecb500f tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:59.479304 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cc6ce3d3-6fa8-41e6-8034-7e2e2ecb500f tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1426 microversion: 2.1 time: 0.158746 Jul 26 14:55:59.479878 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2981/6080] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:59 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1426 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:00.501634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b3008a78-810e-4aaf-ba20-4bd8a44a3e95 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:00.502286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b3008a78-810e-4aaf-ba20-4bd8a44a3e95 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:00.509517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3008a78-810e-4aaf-ba20-4bd8a44a3e95 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:00.509981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3008a78-810e-4aaf-ba20-4bd8a44a3e95 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:00.510769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3008a78-810e-4aaf-ba20-4bd8a44a3e95 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:00.511224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b3008a78-810e-4aaf-ba20-4bd8a44a3e95 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:00.648472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b3008a78-810e-4aaf-ba20-4bd8a44a3e95 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:00.656192 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b3008a78-810e-4aaf-ba20-4bd8a44a3e95 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1426 microversion: 2.1 time: 0.159045 Jul 26 14:56:00.656760 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3100/6081] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:00 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1426 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:01.678298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-79a09c6c-d3cd-47a4-9461-6d91fa67065b tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:01.678995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-79a09c6c-d3cd-47a4-9461-6d91fa67065b tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:01.685960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79a09c6c-d3cd-47a4-9461-6d91fa67065b tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:01.686421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79a09c6c-d3cd-47a4-9461-6d91fa67065b tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:01.687210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79a09c6c-d3cd-47a4-9461-6d91fa67065b tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:01.687653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-79a09c6c-d3cd-47a4-9461-6d91fa67065b tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:01.838870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-79a09c6c-d3cd-47a4-9461-6d91fa67065b tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:01.847246 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-79a09c6c-d3cd-47a4-9461-6d91fa67065b tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1426 microversion: 2.1 time: 0.173897 Jul 26 14:56:01.848050 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2982/6082] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:01 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1426 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:02.868337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a68384f2-bc99-42e9-94bf-fadf545e319d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:02.868979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a68384f2-bc99-42e9-94bf-fadf545e319d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:02.875575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a68384f2-bc99-42e9-94bf-fadf545e319d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:02.876144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a68384f2-bc99-42e9-94bf-fadf545e319d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:02.877056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a68384f2-bc99-42e9-94bf-fadf545e319d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:02.877529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a68384f2-bc99-42e9-94bf-fadf545e319d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:03.025266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a68384f2-bc99-42e9-94bf-fadf545e319d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:03.033411 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a68384f2-bc99-42e9-94bf-fadf545e319d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1426 microversion: 2.1 time: 0.169326 Jul 26 14:56:03.034020 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3101/6083] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:02 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1426 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:03.735767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-5bfe675f-99d2-4d9b-adba-b47e4f5bfed0 req-f55e3b7c-994a-4e7b-b446-6d09b3ac58dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b5a234-bd58-4c38-b119-0095a494d1e3", "name": "network-vif-plugged", "status": "completed", "tag": "02217c29-41df-4dea-832c-98ced87a4b89"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:03.747027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5bfe675f-99d2-4d9b-adba-b47e4f5bfed0 req-f55e3b7c-994a-4e7b-b446-6d09b3ac58dc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:03.747682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5bfe675f-99d2-4d9b-adba-b47e4f5bfed0 req-f55e3b7c-994a-4e7b-b446-6d09b3ac58dc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:03.760780 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-5bfe675f-99d2-4d9b-adba-b47e4f5bfed0 req-f55e3b7c-994a-4e7b-b446-6d09b3ac58dc service nova] Creating event network-vif-plugged:02217c29-41df-4dea-832c-98ced87a4b89 for instance 09b5a234-bd58-4c38-b119-0095a494d1e3 on n-h1-833090-9 Jul 26 14:56:03.766306 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-5bfe675f-99d2-4d9b-adba-b47e4f5bfed0 req-f55e3b7c-994a-4e7b-b446-6d09b3ac58dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112977 Jul 26 14:56:03.768004 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2983/6084] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:04.057039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-66c53de0-5a69-481c-8b8b-a65f3d45fdc4 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:04.057632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-66c53de0-5a69-481c-8b8b-a65f3d45fdc4 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:04.065116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66c53de0-5a69-481c-8b8b-a65f3d45fdc4 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:04.065587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66c53de0-5a69-481c-8b8b-a65f3d45fdc4 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:04.066383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66c53de0-5a69-481c-8b8b-a65f3d45fdc4 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:04.066836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66c53de0-5a69-481c-8b8b-a65f3d45fdc4 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:04.206402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-66c53de0-5a69-481c-8b8b-a65f3d45fdc4 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:04.216275 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-66c53de0-5a69-481c-8b8b-a65f3d45fdc4 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1426 microversion: 2.1 time: 0.163371 Jul 26 14:56:04.216852 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3102/6085] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:04 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1426 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:05.238833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f0f69a16-e199-4635-bacb-0d0d4a16a409 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:05.239606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f0f69a16-e199-4635-bacb-0d0d4a16a409 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:05.246015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0f69a16-e199-4635-bacb-0d0d4a16a409 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:05.246469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0f69a16-e199-4635-bacb-0d0d4a16a409 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:05.247237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0f69a16-e199-4635-bacb-0d0d4a16a409 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:05.247677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0f69a16-e199-4635-bacb-0d0d4a16a409 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:05.385309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f0f69a16-e199-4635-bacb-0d0d4a16a409 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:05.393425 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f0f69a16-e199-4635-bacb-0d0d4a16a409 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1606 microversion: 2.1 time: 0.159769 Jul 26 14:56:05.394001 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2984/6086] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:05 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1606 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:05.414181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43fb8d5c-bd13-481e-a6b0-06f4ad81b01d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:05.414815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-43fb8d5c-bd13-481e-a6b0-06f4ad81b01d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:05.421719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43fb8d5c-bd13-481e-a6b0-06f4ad81b01d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:05.422188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43fb8d5c-bd13-481e-a6b0-06f4ad81b01d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:05.423653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43fb8d5c-bd13-481e-a6b0-06f4ad81b01d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:05.424302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43fb8d5c-bd13-481e-a6b0-06f4ad81b01d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:05.561709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43fb8d5c-bd13-481e-a6b0-06f4ad81b01d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:05.569776 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43fb8d5c-bd13-481e-a6b0-06f4ad81b01d tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1606 microversion: 2.1 time: 0.159480 Jul 26 14:56:05.570347 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3103/6087] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:05 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1606 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:05.589819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-03fd0b25-bb08-4032-a68f-e84f68391d46 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:05.590444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-03fd0b25-bb08-4032-a68f-e84f68391d46 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:05.597193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03fd0b25-bb08-4032-a68f-e84f68391d46 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:05.597653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03fd0b25-bb08-4032-a68f-e84f68391d46 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:05.598427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03fd0b25-bb08-4032-a68f-e84f68391d46 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:05.598872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03fd0b25-bb08-4032-a68f-e84f68391d46 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:05.734698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-03fd0b25-bb08-4032-a68f-e84f68391d46 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:05.742872 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-03fd0b25-bb08-4032-a68f-e84f68391d46 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1606 microversion: 2.1 time: 0.156922 Jul 26 14:56:05.743437 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2985/6088] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:05 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1606 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:07.734268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-634071d5-165f-444d-b29b-ec4e32333a42 req-e78b275e-6af8-4547-9ba7-b90f4b9a66dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b5a234-bd58-4c38-b119-0095a494d1e3", "tag": "02217c29-41df-4dea-832c-98ced87a4b89"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:07.740307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:07.741174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=10 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:07.749941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-634071d5-165f-444d-b29b-ec4e32333a42 req-e78b275e-6af8-4547-9ba7-b90f4b9a66dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:07.750709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-634071d5-165f-444d-b29b-ec4e32333a42 req-e78b275e-6af8-4547-9ba7-b90f4b9a66dd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:07.766976 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-634071d5-165f-444d-b29b-ec4e32333a42 req-e78b275e-6af8-4547-9ba7-b90f4b9a66dd service nova] Creating event network-changed:02217c29-41df-4dea-832c-98ced87a4b89 for instance 09b5a234-bd58-4c38-b119-0095a494d1e3 on n-h1-833090-9 Jul 26 14:56:07.774416 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-634071d5-165f-444d-b29b-ec4e32333a42 req-e78b275e-6af8-4547-9ba7-b90f4b9a66dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044215 Jul 26 14:56:07.775046 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3104/6089] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:23.900286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:23.901199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:23.901849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=32 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:24.002711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f64c904d-0b59-423b-9f9b-b7082db682b8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:24.003217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f64c904d-0b59-423b-9f9b-b7082db682b8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:24.009635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f64c904d-0b59-423b-9f9b-b7082db682b8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:24.010093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f64c904d-0b59-423b-9f9b-b7082db682b8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:24.010884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f64c904d-0b59-423b-9f9b-b7082db682b8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:24.011325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f64c904d-0b59-423b-9f9b-b7082db682b8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:24.040015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f64c904d-0b59-423b-9f9b-b7082db682b8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:56:24.123425 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f64c904d-0b59-423b-9f9b-b7082db682b8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 204 len: 0 microversion: 2.1 time: 0.227953 Jul 26 14:56:24.124060 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2986/6090] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 14:56:23 2022] DELETE /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:56:24.131125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:24.132152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=36 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:24.137495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-77e6310e-a04c-44bd-8b5b-7ea8bfb1120a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:24.138227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-77e6310e-a04c-44bd-8b5b-7ea8bfb1120a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:24.146827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77e6310e-a04c-44bd-8b5b-7ea8bfb1120a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:24.148061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77e6310e-a04c-44bd-8b5b-7ea8bfb1120a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:24.148239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77e6310e-a04c-44bd-8b5b-7ea8bfb1120a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:24.148593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77e6310e-a04c-44bd-8b5b-7ea8bfb1120a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:24.290472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-77e6310e-a04c-44bd-8b5b-7ea8bfb1120a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:24.298364 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-77e6310e-a04c-44bd-8b5b-7ea8bfb1120a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1577 microversion: 2.1 time: 0.169443 Jul 26 14:56:24.299817 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3105/6091] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:24 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:25.322066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1b79764a-f59b-4c00-beb6-065edbae228a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:25.322781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1b79764a-f59b-4c00-beb6-065edbae228a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:25.331792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b79764a-f59b-4c00-beb6-065edbae228a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:25.332293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b79764a-f59b-4c00-beb6-065edbae228a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:25.333089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b79764a-f59b-4c00-beb6-065edbae228a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:25.333652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b79764a-f59b-4c00-beb6-065edbae228a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:25.489610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1b79764a-f59b-4c00-beb6-065edbae228a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:25.497591 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1b79764a-f59b-4c00-beb6-065edbae228a tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1577 microversion: 2.1 time: 0.179898 Jul 26 14:56:25.498325 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2987/6092] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:25 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:26.523286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-cdd51204-66d9-45c9-817c-4020988cf957 req-6a24281e-1b07-4a28-aee7-424e0afd9592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9a1be8-b8e7-4be1-897f-02e3a877deb8", "name": "network-vif-deleted", "tag": "3228ed03-8144-4209-94d9-f13637551d33"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:26.528197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b6482544-0bb3-41ed-a0a3-4dd2d61c0041 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:26.528880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b6482544-0bb3-41ed-a0a3-4dd2d61c0041 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:26.541365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6482544-0bb3-41ed-a0a3-4dd2d61c0041 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:26.548305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6482544-0bb3-41ed-a0a3-4dd2d61c0041 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:26.549605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6482544-0bb3-41ed-a0a3-4dd2d61c0041 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:26.550680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6482544-0bb3-41ed-a0a3-4dd2d61c0041 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:26.553970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cdd51204-66d9-45c9-817c-4020988cf957 req-6a24281e-1b07-4a28-aee7-424e0afd9592 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:26.554440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cdd51204-66d9-45c9-817c-4020988cf957 req-6a24281e-1b07-4a28-aee7-424e0afd9592 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:26.571524 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-cdd51204-66d9-45c9-817c-4020988cf957 req-6a24281e-1b07-4a28-aee7-424e0afd9592 service nova] Creating event network-vif-deleted:3228ed03-8144-4209-94d9-f13637551d33 for instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 on n-h2-833090-9 Jul 26 14:56:26.578614 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-cdd51204-66d9-45c9-817c-4020988cf957 req-6a24281e-1b07-4a28-aee7-424e0afd9592 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058653 Jul 26 14:56:26.579824 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2988/6093] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:26.646566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b6482544-0bb3-41ed-a0a3-4dd2d61c0041 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:26.657677 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b6482544-0bb3-41ed-a0a3-4dd2d61c0041 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1225 microversion: 2.1 time: 0.140573 Jul 26 14:56:26.671975 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3106/6094] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:26 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1225 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:27.681737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0391cfd3-d39b-4c0d-b934-d1be3c01e4e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:27.682380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0391cfd3-d39b-4c0d-b934-d1be3c01e4e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:27.689641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0391cfd3-d39b-4c0d-b934-d1be3c01e4e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:27.690098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0391cfd3-d39b-4c0d-b934-d1be3c01e4e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:27.691026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0391cfd3-d39b-4c0d-b934-d1be3c01e4e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:27.691472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0391cfd3-d39b-4c0d-b934-d1be3c01e4e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:27.762253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0391cfd3-d39b-4c0d-b934-d1be3c01e4e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:27.770207 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0391cfd3-d39b-4c0d-b934-d1be3c01e4e8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1225 microversion: 2.1 time: 0.093025 Jul 26 14:56:27.770820 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2989/6095] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:27 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:28.804286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b17a9cc2-d35c-4112-8cd4-d78f81e0e870 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:28.804922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b17a9cc2-d35c-4112-8cd4-d78f81e0e870 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:28.812469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b17a9cc2-d35c-4112-8cd4-d78f81e0e870 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:28.812944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b17a9cc2-d35c-4112-8cd4-d78f81e0e870 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:28.813733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b17a9cc2-d35c-4112-8cd4-d78f81e0e870 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:28.814493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b17a9cc2-d35c-4112-8cd4-d78f81e0e870 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:28.882566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b17a9cc2-d35c-4112-8cd4-d78f81e0e870 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:28.890530 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b17a9cc2-d35c-4112-8cd4-d78f81e0e870 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1225 microversion: 2.1 time: 0.090717 Jul 26 14:56:28.891115 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3107/6096] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:28 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:29.912600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-00f29c97-49d3-47f0-bcbf-0b5e33c90da4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:29.913194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-00f29c97-49d3-47f0-bcbf-0b5e33c90da4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:29.920238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00f29c97-49d3-47f0-bcbf-0b5e33c90da4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:29.920685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00f29c97-49d3-47f0-bcbf-0b5e33c90da4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:29.921442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00f29c97-49d3-47f0-bcbf-0b5e33c90da4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:29.921880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00f29c97-49d3-47f0-bcbf-0b5e33c90da4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:29.987263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-00f29c97-49d3-47f0-bcbf-0b5e33c90da4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:29.995158 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-00f29c97-49d3-47f0-bcbf-0b5e33c90da4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1225 microversion: 2.1 time: 0.086560 Jul 26 14:56:29.995720 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2990/6097] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:29 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:31.016325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:31.017023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:31.024322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:31.024797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:31.025582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:31.026038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:31.060719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:31.061194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:31.061663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lazy-loading 'fault' on Instance uuid bb9a1be8-b8e7-4be1-897f-02e3a877deb8 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:56:31.104947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:31.113471 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a585a3bc-3acd-47bf-a90b-38808ff73333 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 200 len: 1230 microversion: 2.1 time: 0.100991 Jul 26 14:56:31.114052 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3108/6098] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:31 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:32.134511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea548224-2599-4c88-accf-70e233a58314 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:32.135137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ea548224-2599-4c88-accf-70e233a58314 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:32.142071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea548224-2599-4c88-accf-70e233a58314 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:32.143218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea548224-2599-4c88-accf-70e233a58314 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:32.144190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea548224-2599-4c88-accf-70e233a58314 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:32.144640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea548224-2599-4c88-accf-70e233a58314 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:32.158887 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ea548224-2599-4c88-accf-70e233a58314 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea548224-2599-4c88-accf-70e233a58314 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 HTTP/1.1 Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'bb9a1be8-b8e7-4be1-897f-02e3a877deb8'} Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:56:32.160704 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:56:32.166402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:56:32.166402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:56:32.166402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:56:32.166402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:56:32.166402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:56:32.166402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 14:56:32.166402 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 14:56:32.166402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea548224-2599-4c88-accf-70e233a58314 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:56:32.166402 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ea548224-2599-4c88-accf-70e233a58314 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 404 len: 111 microversion: 2.1 time: 0.031667 Jul 26 14:56:32.166402 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2991/6099] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:32 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:56:32.212153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1071210667", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-679082839", "security_groups": [{"name": "tempest-secgroup-smoke-1340528023"}], "block_device_mapping_v2": [{"uuid": "bd4e1022-d030-4af5-8de0-29bf21155daf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e976b6cc-dfb4-45b5-af81-629f1adeef76"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:32.330677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] validate_networks() for [('e976b6cc-dfb4-45b5-af81-629f1adeef76', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:56:32.704740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:56:32.705708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:56:32.706306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:56:32.706744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:56:32.707183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:56:32.716347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:32.716822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:32.717655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:32.718118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:32.735069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:56:32.740439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for user ac9553617f2440a68e33b82650206cae and project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:56:32.801436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:56:32.803835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd4e1022-d030-4af5-8de0-29bf21155daf',volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:56:32.934081 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ef58b9dd-0a98-4321-b7bf-da9baa0b931c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.725699 Jul 26 14:56:32.934081 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3109/6100] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:56:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 14:56:32.944891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e1f98594-79fb-4fd3-a036-717bb8a65d79 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:32.945546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e1f98594-79fb-4fd3-a036-717bb8a65d79 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:33.002457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e1f98594-79fb-4fd3-a036-717bb8a65d79 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:33.009497 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e1f98594-79fb-4fd3-a036-717bb8a65d79 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1094 microversion: 2.1 time: 0.068536 Jul 26 14:56:33.010195 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2992/6101] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:32 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:34.035167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-482c2a8d-296a-4768-a537-370a6e56d2ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:34.035906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-482c2a8d-296a-4768-a537-370a6e56d2ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:34.091902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-482c2a8d-296a-4768-a537-370a6e56d2ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:34.098851 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-482c2a8d-296a-4768-a537-370a6e56d2ec tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1094 microversion: 2.1 time: 0.068039 Jul 26 14:56:34.099429 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3110/6102] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:34 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:35.120370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee56fe05-21e0-4d4e-a566-752737f23a51 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:35.121006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ee56fe05-21e0-4d4e-a566-752737f23a51 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:35.176951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ee56fe05-21e0-4d4e-a566-752737f23a51 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:35.184845 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ee56fe05-21e0-4d4e-a566-752737f23a51 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1094 microversion: 2.1 time: 0.068399 Jul 26 14:56:35.185414 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2993/6103] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:35 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:36.206006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-573c5891-b159-4a68-8129-7ec46430b2a0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:36.206667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-573c5891-b159-4a68-8129-7ec46430b2a0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:36.214307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573c5891-b159-4a68-8129-7ec46430b2a0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:36.214785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573c5891-b159-4a68-8129-7ec46430b2a0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:36.215579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573c5891-b159-4a68-8129-7ec46430b2a0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:36.216076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-573c5891-b159-4a68-8129-7ec46430b2a0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:36.279783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-573c5891-b159-4a68-8129-7ec46430b2a0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:36.288927 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-573c5891-b159-4a68-8129-7ec46430b2a0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1144 microversion: 2.1 time: 0.087433 Jul 26 14:56:36.289510 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3111/6104] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:36 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:37.311272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad6d2467-9624-435a-a80e-88c44fa98b16 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:37.311907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ad6d2467-9624-435a-a80e-88c44fa98b16 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:37.319226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad6d2467-9624-435a-a80e-88c44fa98b16 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:37.319600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad6d2467-9624-435a-a80e-88c44fa98b16 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:37.320562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad6d2467-9624-435a-a80e-88c44fa98b16 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:37.321007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad6d2467-9624-435a-a80e-88c44fa98b16 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:37.395462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ad6d2467-9624-435a-a80e-88c44fa98b16 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:37.407305 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad6d2467-9624-435a-a80e-88c44fa98b16 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1210 microversion: 2.1 time: 0.100287 Jul 26 14:56:37.408954 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2994/6105] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:37 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:38.433888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a3f19e9f-3888-4df5-af6a-cfcbc6c1696c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:38.434761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a3f19e9f-3888-4df5-af6a-cfcbc6c1696c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:38.442487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3f19e9f-3888-4df5-af6a-cfcbc6c1696c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:38.443092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3f19e9f-3888-4df5-af6a-cfcbc6c1696c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:38.444030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3f19e9f-3888-4df5-af6a-cfcbc6c1696c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:38.444714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a3f19e9f-3888-4df5-af6a-cfcbc6c1696c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:38.943777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a3f19e9f-3888-4df5-af6a-cfcbc6c1696c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:38.952032 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a3f19e9f-3888-4df5-af6a-cfcbc6c1696c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1278 microversion: 2.1 time: 0.522250 Jul 26 14:56:38.952603 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3112/6106] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:38 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1278 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:39.142365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-98c3fa05-9bb9-4dce-a923-c96698a5c4b0 req-cf3ec723-b318-4157-8643-043b903a9206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36736136-fe6f-43ce-b9c8-d08b0c89dde9", "tag": "aeaa591a-5a9b-4fd3-8931-a2e9dfec566a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:39.156424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-98c3fa05-9bb9-4dce-a923-c96698a5c4b0 req-cf3ec723-b318-4157-8643-043b903a9206 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:39.156865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-98c3fa05-9bb9-4dce-a923-c96698a5c4b0 req-cf3ec723-b318-4157-8643-043b903a9206 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:39.174126 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-98c3fa05-9bb9-4dce-a923-c96698a5c4b0 req-cf3ec723-b318-4157-8643-043b903a9206 service nova] Creating event network-changed:aeaa591a-5a9b-4fd3-8931-a2e9dfec566a for instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 on n-h2-833090-9 Jul 26 14:56:39.180912 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-98c3fa05-9bb9-4dce-a923-c96698a5c4b0 req-cf3ec723-b318-4157-8643-043b903a9206 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043001 Jul 26 14:56:39.183968 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2995/6107] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:39.975049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-34d6675a-5581-490f-b3ad-63be5c6534f6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:39.975884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-34d6675a-5581-490f-b3ad-63be5c6534f6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:39.983961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34d6675a-5581-490f-b3ad-63be5c6534f6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:39.984565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34d6675a-5581-490f-b3ad-63be5c6534f6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:39.985484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34d6675a-5581-490f-b3ad-63be5c6534f6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:39.986038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34d6675a-5581-490f-b3ad-63be5c6534f6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:40.219601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-34d6675a-5581-490f-b3ad-63be5c6534f6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:40.227556 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-34d6675a-5581-490f-b3ad-63be5c6534f6 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1278 microversion: 2.1 time: 0.257538 Jul 26 14:56:40.228168 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3113/6108] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:39 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:41.249216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-59877afc-ae84-4fc4-8134-575c37749b31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:41.250057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-59877afc-ae84-4fc4-8134-575c37749b31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:41.257523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59877afc-ae84-4fc4-8134-575c37749b31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:41.258279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59877afc-ae84-4fc4-8134-575c37749b31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:41.259066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59877afc-ae84-4fc4-8134-575c37749b31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:41.259506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59877afc-ae84-4fc4-8134-575c37749b31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:41.403097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-59877afc-ae84-4fc4-8134-575c37749b31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:41.412423 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-59877afc-ae84-4fc4-8134-575c37749b31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1278 microversion: 2.1 time: 0.167374 Jul 26 14:56:41.413024 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2996/6109] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:41 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:42.433820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3bfa4c82-a50c-4ab6-a82f-3cf527c2de0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:42.434468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3bfa4c82-a50c-4ab6-a82f-3cf527c2de0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:42.442316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3bfa4c82-a50c-4ab6-a82f-3cf527c2de0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:42.442797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3bfa4c82-a50c-4ab6-a82f-3cf527c2de0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:42.443604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3bfa4c82-a50c-4ab6-a82f-3cf527c2de0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:42.444176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3bfa4c82-a50c-4ab6-a82f-3cf527c2de0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:42.597336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3bfa4c82-a50c-4ab6-a82f-3cf527c2de0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:42.605102 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3bfa4c82-a50c-4ab6-a82f-3cf527c2de0e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1278 microversion: 2.1 time: 0.175925 Jul 26 14:56:42.605703 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3114/6110] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:42 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:43.626715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8bee7a5c-f81c-4330-8968-b5413717ab57 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:43.627799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8bee7a5c-f81c-4330-8968-b5413717ab57 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:43.634865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bee7a5c-f81c-4330-8968-b5413717ab57 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:43.635319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bee7a5c-f81c-4330-8968-b5413717ab57 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:43.636123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bee7a5c-f81c-4330-8968-b5413717ab57 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:43.636564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bee7a5c-f81c-4330-8968-b5413717ab57 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:43.779230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8bee7a5c-f81c-4330-8968-b5413717ab57 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:43.787608 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8bee7a5c-f81c-4330-8968-b5413717ab57 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1266 microversion: 2.1 time: 0.164742 Jul 26 14:56:43.788227 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2997/6111] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:43 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:44.464276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6b9ab544-8b71-4d94-928b-626ec3da0c25 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:44.464862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6b9ab544-8b71-4d94-928b-626ec3da0c25 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:44.469716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:44.471868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:44.474496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b9ab544-8b71-4d94-928b-626ec3da0c25 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:44.474969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b9ab544-8b71-4d94-928b-626ec3da0c25 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:44.475772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b9ab544-8b71-4d94-928b-626ec3da0c25 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:44.476257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6b9ab544-8b71-4d94-928b-626ec3da0c25 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:44.502619 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6b9ab544-8b71-4d94-928b-626ec3da0c25 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.041833 Jul 26 14:56:44.503113 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3115/6112] 10.222.0.70 () {58 vars in 1293 bytes} [Tue Jul 26 14:56:44 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:44.809043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d3d0513-7946-4528-94b4-3d0d7b6f821d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:44.809677 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6d3d0513-7946-4528-94b4-3d0d7b6f821d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:44.817260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d3d0513-7946-4528-94b4-3d0d7b6f821d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:44.817711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d3d0513-7946-4528-94b4-3d0d7b6f821d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:44.818489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d3d0513-7946-4528-94b4-3d0d7b6f821d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:44.818928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d3d0513-7946-4528-94b4-3d0d7b6f821d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:44.967101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d3d0513-7946-4528-94b4-3d0d7b6f821d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:44.975489 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6d3d0513-7946-4528-94b4-3d0d7b6f821d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1266 microversion: 2.1 time: 0.170467 Jul 26 14:56:44.976112 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2998/6113] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:44 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:45.995816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-55e334a0-09ed-4484-a35e-d588e70e1e8d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:45.996394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-55e334a0-09ed-4484-a35e-d588e70e1e8d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:46.003512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-55e334a0-09ed-4484-a35e-d588e70e1e8d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:46.004014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-55e334a0-09ed-4484-a35e-d588e70e1e8d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:46.004817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-55e334a0-09ed-4484-a35e-d588e70e1e8d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:46.005402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-55e334a0-09ed-4484-a35e-d588e70e1e8d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:46.137860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-55e334a0-09ed-4484-a35e-d588e70e1e8d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:46.146397 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-55e334a0-09ed-4484-a35e-d588e70e1e8d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1266 microversion: 2.1 time: 0.154656 Jul 26 14:56:46.146970 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3116/6114] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:45 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:47.168349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9a1e049a-0edd-44d4-9e29-7df9c74c2af8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:47.168964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9a1e049a-0edd-44d4-9e29-7df9c74c2af8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:47.170992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:47.178837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a1e049a-0edd-44d4-9e29-7df9c74c2af8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:47.179284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a1e049a-0edd-44d4-9e29-7df9c74c2af8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:47.180080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a1e049a-0edd-44d4-9e29-7df9c74c2af8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:47.180517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9a1e049a-0edd-44d4-9e29-7df9c74c2af8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:47.313243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9a1e049a-0edd-44d4-9e29-7df9c74c2af8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:47.321611 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9a1e049a-0edd-44d4-9e29-7df9c74c2af8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1266 microversion: 2.1 time: 0.157976 Jul 26 14:56:47.322189 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 2999/6115] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:47 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:48.342959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed578ae5-1610-4d90-8d53-dffa3c5fbe93 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:48.343599 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ed578ae5-1610-4d90-8d53-dffa3c5fbe93 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:48.351470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed578ae5-1610-4d90-8d53-dffa3c5fbe93 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:48.351942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed578ae5-1610-4d90-8d53-dffa3c5fbe93 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:48.352782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed578ae5-1610-4d90-8d53-dffa3c5fbe93 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:48.353239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed578ae5-1610-4d90-8d53-dffa3c5fbe93 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:48.497160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ed578ae5-1610-4d90-8d53-dffa3c5fbe93 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:48.505853 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed578ae5-1610-4d90-8d53-dffa3c5fbe93 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1266 microversion: 2.1 time: 0.166927 Jul 26 14:56:48.506440 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3117/6116] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:48 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:49.528247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c82cf60-5d2e-4c8c-ab29-e98dabdb0d00 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:49.528861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c82cf60-5d2e-4c8c-ab29-e98dabdb0d00 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:49.536361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c82cf60-5d2e-4c8c-ab29-e98dabdb0d00 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:49.536813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c82cf60-5d2e-4c8c-ab29-e98dabdb0d00 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:49.537578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c82cf60-5d2e-4c8c-ab29-e98dabdb0d00 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:49.538013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9c82cf60-5d2e-4c8c-ab29-e98dabdb0d00 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:49.669988 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c82cf60-5d2e-4c8c-ab29-e98dabdb0d00 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:49.678142 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c82cf60-5d2e-4c8c-ab29-e98dabdb0d00 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1266 microversion: 2.1 time: 0.153738 Jul 26 14:56:49.678709 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3000/6117] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:49 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:50.699026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b205420c-1522-4206-a442-c0c49bddf394 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:50.699585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b205420c-1522-4206-a442-c0c49bddf394 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:50.707761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b205420c-1522-4206-a442-c0c49bddf394 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:50.708265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b205420c-1522-4206-a442-c0c49bddf394 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:50.709140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b205420c-1522-4206-a442-c0c49bddf394 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:50.709597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b205420c-1522-4206-a442-c0c49bddf394 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:50.853228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b205420c-1522-4206-a442-c0c49bddf394 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:50.860720 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b205420c-1522-4206-a442-c0c49bddf394 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1266 microversion: 2.1 time: 0.165778 Jul 26 14:56:50.861285 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3118/6118] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:50 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:51.882142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b528ed5f-9d9e-4f43-9070-da3347b24215 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:51.882771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b528ed5f-9d9e-4f43-9070-da3347b24215 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:51.890385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b528ed5f-9d9e-4f43-9070-da3347b24215 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:51.890833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b528ed5f-9d9e-4f43-9070-da3347b24215 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:51.891607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b528ed5f-9d9e-4f43-9070-da3347b24215 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:51.892898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b528ed5f-9d9e-4f43-9070-da3347b24215 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:52.033740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b528ed5f-9d9e-4f43-9070-da3347b24215 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:52.041998 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b528ed5f-9d9e-4f43-9070-da3347b24215 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1266 microversion: 2.1 time: 0.163829 Jul 26 14:56:52.042583 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3001/6119] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:51 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:53.065423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-75b1465a-f8e4-48dc-a159-b796963f64e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:53.066049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-75b1465a-f8e4-48dc-a159-b796963f64e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:53.073034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75b1465a-f8e4-48dc-a159-b796963f64e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:53.073507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75b1465a-f8e4-48dc-a159-b796963f64e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:53.074287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75b1465a-f8e4-48dc-a159-b796963f64e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:53.074742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-75b1465a-f8e4-48dc-a159-b796963f64e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:53.208919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-75b1465a-f8e4-48dc-a159-b796963f64e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:53.216615 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-75b1465a-f8e4-48dc-a159-b796963f64e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1266 microversion: 2.1 time: 0.155825 Jul 26 14:56:53.217194 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3119/6120] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:53 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:53.933786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3c368947-2c0a-4f1b-b718-04d6d3a1f79c req-95d69787-c7a4-4232-9c25-849e8f2ed787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36736136-fe6f-43ce-b9c8-d08b0c89dde9", "name": "network-vif-plugged", "status": "completed", "tag": "aeaa591a-5a9b-4fd3-8931-a2e9dfec566a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:53.940345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:53.948192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3c368947-2c0a-4f1b-b718-04d6d3a1f79c req-95d69787-c7a4-4232-9c25-849e8f2ed787 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:53.948657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3c368947-2c0a-4f1b-b718-04d6d3a1f79c req-95d69787-c7a4-4232-9c25-849e8f2ed787 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:53.953109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:53.963587 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3c368947-2c0a-4f1b-b718-04d6d3a1f79c req-95d69787-c7a4-4232-9c25-849e8f2ed787 service nova] Creating event network-vif-plugged:aeaa591a-5a9b-4fd3-8931-a2e9dfec566a for instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 on n-h2-833090-9 Jul 26 14:56:53.968947 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3c368947-2c0a-4f1b-b718-04d6d3a1f79c req-95d69787-c7a4-4232-9c25-849e8f2ed787 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038912 Jul 26 14:56:53.969982 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3002/6121] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:54.239618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70ed0cd6-f91d-43b4-914e-8be9ba03ca21 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:54.240415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70ed0cd6-f91d-43b4-914e-8be9ba03ca21 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:54.243089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:54.248533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70ed0cd6-f91d-43b4-914e-8be9ba03ca21 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:54.249006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70ed0cd6-f91d-43b4-914e-8be9ba03ca21 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:54.249822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70ed0cd6-f91d-43b4-914e-8be9ba03ca21 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:54.250276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70ed0cd6-f91d-43b4-914e-8be9ba03ca21 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:54.254316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=81 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:54.393705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70ed0cd6-f91d-43b4-914e-8be9ba03ca21 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:54.401772 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70ed0cd6-f91d-43b4-914e-8be9ba03ca21 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1266 microversion: 2.1 time: 0.167157 Jul 26 14:56:54.402368 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3120/6122] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:54 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:55.424437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-14e86d3a-58a7-4dd8-bcd1-944085839bb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:55.425273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-14e86d3a-58a7-4dd8-bcd1-944085839bb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:55.434203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14e86d3a-58a7-4dd8-bcd1-944085839bb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:55.434665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14e86d3a-58a7-4dd8-bcd1-944085839bb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:55.435458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14e86d3a-58a7-4dd8-bcd1-944085839bb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:55.435927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14e86d3a-58a7-4dd8-bcd1-944085839bb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:55.573985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-14e86d3a-58a7-4dd8-bcd1-944085839bb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:55.582334 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-14e86d3a-58a7-4dd8-bcd1-944085839bb0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1452 microversion: 2.1 time: 0.163327 Jul 26 14:56:55.582907 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3003/6123] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:55 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:55.602585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0be3ec52-51d5-4801-9ae5-4e4699142c9d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:55.603230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0be3ec52-51d5-4801-9ae5-4e4699142c9d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:55.610582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0be3ec52-51d5-4801-9ae5-4e4699142c9d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:55.611062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0be3ec52-51d5-4801-9ae5-4e4699142c9d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:55.612660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0be3ec52-51d5-4801-9ae5-4e4699142c9d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:55.613126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0be3ec52-51d5-4801-9ae5-4e4699142c9d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:55.748682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0be3ec52-51d5-4801-9ae5-4e4699142c9d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:55.756457 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0be3ec52-51d5-4801-9ae5-4e4699142c9d tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1452 microversion: 2.1 time: 0.157839 Jul 26 14:56:55.757052 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3121/6124] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:55 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:57.739716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f2750d30-7da2-4b78-8806-d8f927c07848 req-803448a5-9ffe-49a4-84c5-2320ef974452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36736136-fe6f-43ce-b9c8-d08b0c89dde9", "tag": "aeaa591a-5a9b-4fd3-8931-a2e9dfec566a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:57.750200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f2750d30-7da2-4b78-8806-d8f927c07848 req-803448a5-9ffe-49a4-84c5-2320ef974452 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:57.750655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f2750d30-7da2-4b78-8806-d8f927c07848 req-803448a5-9ffe-49a4-84c5-2320ef974452 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:57.765678 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f2750d30-7da2-4b78-8806-d8f927c07848 req-803448a5-9ffe-49a4-84c5-2320ef974452 service nova] Creating event network-changed:aeaa591a-5a9b-4fd3-8931-a2e9dfec566a for instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 on n-h2-833090-9 Jul 26 14:56:57.770976 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f2750d30-7da2-4b78-8806-d8f927c07848 req-803448a5-9ffe-49a4-84c5-2320ef974452 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035623 Jul 26 14:56:57.771923 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3004/6125] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:58.269028 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 14:57:58.269686 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 14:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 14:57:58.690598 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 14:57:58.691261 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 14:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 14:58:37.568463 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 14:58:37.569418 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 14:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 14:58:37.738632 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fcb0ade0-98d2-4d3c-ae6b-59cf589e6dcc] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 14:58:37.739807 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30cc4c1d-189c-4030-802b-dd5549a8f3b2] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 14:58:37.740438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:37.741311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=11 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:37.745384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-145206514", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-679082839", "security_groups": [{"name": "tempest-secgroup-smoke-1340528023"}], "block_device_mapping_v2": [{"uuid": "f69c569f-d9e3-4a2d-b802-3c2b9e0449bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e976b6cc-dfb4-45b5-af81-629f1adeef76"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:37.863918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] validate_networks() for [('e976b6cc-dfb4-45b5-af81-629f1adeef76', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:58:38.273038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:58:38.273486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:58:38.273989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:58:38.274415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:58:38.274855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:58:38.283868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:38.284378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:38.286127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:38.286614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:38.304386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:58:38.309751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Getting quotas for user ac9553617f2440a68e33b82650206cae and project f953d00da52543fda852b2d118613fa8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:58:38.369021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:58:38.371068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f69c569f-d9e3-4a2d-b802-3c2b9e0449bc',volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:58:38.502688 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8769e27a-5dae-4679-8ee0-661d22cde49b tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765918 Jul 26 14:58:38.503603 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3122/6126] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 14:58:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:58:38.512632 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [54fe80fa-5d54-4bb9-a76b-59290c50e610] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 14:58:38.513560 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7f3ab2a-6e11-4e90-a515-8ef793525f8a] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 14:58:38.514444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=5 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:38.515193 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=9 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:38.520648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84255836-ddff-4a32-b4fe-d82dce4a3243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:38.521417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-84255836-ddff-4a32-b4fe-d82dce4a3243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:38.579180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-84255836-ddff-4a32-b4fe-d82dce4a3243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:38.585987 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-84255836-ddff-4a32-b4fe-d82dce4a3243 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1093 microversion: 2.1 time: 0.075272 Jul 26 14:58:38.586545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3005/6127] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:38 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:58:39.607871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fda291cb-0f16-4e65-9c26-3b18b1a3bb13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:39.608691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fda291cb-0f16-4e65-9c26-3b18b1a3bb13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:39.621867 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] [30cc4c1d-189c-4030-802b-dd5549a8f3b2] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 48566. Jul 26 14:58:39.632804 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] [fcb0ade0-98d2-4d3c-ae6b-59cf589e6dcc] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 48564. Jul 26 14:58:39.637464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fda291cb-0f16-4e65-9c26-3b18b1a3bb13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:39.637937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fda291cb-0f16-4e65-9c26-3b18b1a3bb13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:39.638818 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fda291cb-0f16-4e65-9c26-3b18b1a3bb13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:39.639279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fda291cb-0f16-4e65-9c26-3b18b1a3bb13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:39.723291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fda291cb-0f16-4e65-9c26-3b18b1a3bb13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:39.732939 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fda291cb-0f16-4e65-9c26-3b18b1a3bb13 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1209 microversion: 2.1 time: 0.128917 Jul 26 14:58:39.740066 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3123/6128] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:39 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:40.754910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca382bfe-ea96-4366-8c08-09c387ad974e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:40.755698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ca382bfe-ea96-4366-8c08-09c387ad974e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:40.763781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca382bfe-ea96-4366-8c08-09c387ad974e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:40.764257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca382bfe-ea96-4366-8c08-09c387ad974e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:40.765296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca382bfe-ea96-4366-8c08-09c387ad974e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:40.765945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca382bfe-ea96-4366-8c08-09c387ad974e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:40.806385 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7f3ab2a-6e11-4e90-a515-8ef793525f8a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 48572. Jul 26 14:58:40.807568 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] [54fe80fa-5d54-4bb9-a76b-59290c50e610] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 48570. Jul 26 14:58:40.997470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ca382bfe-ea96-4366-8c08-09c387ad974e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:41.010507 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ca382bfe-ea96-4366-8c08-09c387ad974e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1277 microversion: 2.1 time: 0.258849 Jul 26 14:58:41.024947 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3006/6129] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:40 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1277 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:41.137076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-0143b53b-4d5b-4737-ab81-8b1dd369d367 req-17d04fc0-a3e0-4326-bb2d-0afef1646e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7bcd8b-b1f8-4952-8542-be8652a0fa42", "tag": "ec137d34-e230-4bdc-88c3-41e6744f2b09"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:41.153710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0143b53b-4d5b-4737-ab81-8b1dd369d367 req-17d04fc0-a3e0-4326-bb2d-0afef1646e6c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:41.155403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0143b53b-4d5b-4737-ab81-8b1dd369d367 req-17d04fc0-a3e0-4326-bb2d-0afef1646e6c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:41.170222 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-0143b53b-4d5b-4737-ab81-8b1dd369d367 req-17d04fc0-a3e0-4326-bb2d-0afef1646e6c service nova] Creating event network-changed:ec137d34-e230-4bdc-88c3-41e6744f2b09 for instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 on n-h2-833090-9 Jul 26 14:58:41.179201 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-0143b53b-4d5b-4737-ab81-8b1dd369d367 req-17d04fc0-a3e0-4326-bb2d-0afef1646e6c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045772 Jul 26 14:58:41.180372 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3124/6130] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:58:42.031576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-76197900-a53c-4dce-bffa-40ebea745984 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:42.032424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76197900-a53c-4dce-bffa-40ebea745984 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:42.040964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76197900-a53c-4dce-bffa-40ebea745984 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:42.042029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76197900-a53c-4dce-bffa-40ebea745984 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:42.043089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76197900-a53c-4dce-bffa-40ebea745984 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:42.043644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76197900-a53c-4dce-bffa-40ebea745984 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:42.286471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-76197900-a53c-4dce-bffa-40ebea745984 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:42.294474 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-76197900-a53c-4dce-bffa-40ebea745984 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1277 microversion: 2.1 time: 0.266927 Jul 26 14:58:42.295038 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3007/6131] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:42 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:43.318204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d63dc0d1-64b6-4273-9b4d-844563cf0d53 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:43.318868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d63dc0d1-64b6-4273-9b4d-844563cf0d53 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:43.325400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d63dc0d1-64b6-4273-9b4d-844563cf0d53 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:43.325884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d63dc0d1-64b6-4273-9b4d-844563cf0d53 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:43.326690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d63dc0d1-64b6-4273-9b4d-844563cf0d53 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:43.327157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d63dc0d1-64b6-4273-9b4d-844563cf0d53 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:43.732469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d63dc0d1-64b6-4273-9b4d-844563cf0d53 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:43.742407 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d63dc0d1-64b6-4273-9b4d-844563cf0d53 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1277 microversion: 2.1 time: 0.429559 Jul 26 14:58:43.743004 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3125/6132] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:43 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1277 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:44.767623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-771a1a5b-6c42-4df0-a9c3-6cab8f31f8b2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:44.768424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-771a1a5b-6c42-4df0-a9c3-6cab8f31f8b2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:44.779124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-771a1a5b-6c42-4df0-a9c3-6cab8f31f8b2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:44.779672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-771a1a5b-6c42-4df0-a9c3-6cab8f31f8b2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:44.780769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-771a1a5b-6c42-4df0-a9c3-6cab8f31f8b2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:44.781292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-771a1a5b-6c42-4df0-a9c3-6cab8f31f8b2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:44.949035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-771a1a5b-6c42-4df0-a9c3-6cab8f31f8b2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:44.957039 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-771a1a5b-6c42-4df0-a9c3-6cab8f31f8b2 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1277 microversion: 2.1 time: 0.197025 Jul 26 14:58:44.957559 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3008/6133] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:44 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:45.978472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-238f7276-82e0-4167-a253-88a9ed627aae tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:45.979116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-238f7276-82e0-4167-a253-88a9ed627aae tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:45.990994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-238f7276-82e0-4167-a253-88a9ed627aae tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:45.991472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-238f7276-82e0-4167-a253-88a9ed627aae tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:45.992493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-238f7276-82e0-4167-a253-88a9ed627aae tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:45.992955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-238f7276-82e0-4167-a253-88a9ed627aae tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:46.161449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-238f7276-82e0-4167-a253-88a9ed627aae tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:46.169618 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-238f7276-82e0-4167-a253-88a9ed627aae tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1265 microversion: 2.1 time: 0.195411 Jul 26 14:58:46.170196 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3126/6134] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:45 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:47.190640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-26222ce8-ddf2-4ae0-a27d-951efad24e6e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:47.191407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-26222ce8-ddf2-4ae0-a27d-951efad24e6e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:47.199249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26222ce8-ddf2-4ae0-a27d-951efad24e6e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:47.199695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26222ce8-ddf2-4ae0-a27d-951efad24e6e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:47.200495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26222ce8-ddf2-4ae0-a27d-951efad24e6e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:47.200936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26222ce8-ddf2-4ae0-a27d-951efad24e6e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:47.336893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-26222ce8-ddf2-4ae0-a27d-951efad24e6e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:47.344459 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-26222ce8-ddf2-4ae0-a27d-951efad24e6e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1265 microversion: 2.1 time: 0.157712 Jul 26 14:58:47.345022 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3009/6135] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:47 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:48.365844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8db3abb8-96c4-4574-b057-78faa2c2ab46 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:48.366542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8db3abb8-96c4-4574-b057-78faa2c2ab46 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:48.369303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:48.369979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:48.375835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8db3abb8-96c4-4574-b057-78faa2c2ab46 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:48.376329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8db3abb8-96c4-4574-b057-78faa2c2ab46 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:48.377124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8db3abb8-96c4-4574-b057-78faa2c2ab46 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:48.377578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8db3abb8-96c4-4574-b057-78faa2c2ab46 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:48.513036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8db3abb8-96c4-4574-b057-78faa2c2ab46 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:48.521260 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8db3abb8-96c4-4574-b057-78faa2c2ab46 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1265 microversion: 2.1 time: 0.159457 Jul 26 14:58:48.521831 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3127/6136] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:48 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:49.542565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad4605eb-f3f0-43dd-9482-676e8dffece8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:49.543302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ad4605eb-f3f0-43dd-9482-676e8dffece8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:49.546124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:49.552001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad4605eb-f3f0-43dd-9482-676e8dffece8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:49.552466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad4605eb-f3f0-43dd-9482-676e8dffece8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:49.553338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad4605eb-f3f0-43dd-9482-676e8dffece8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:49.553783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad4605eb-f3f0-43dd-9482-676e8dffece8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:49.697175 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ad4605eb-f3f0-43dd-9482-676e8dffece8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:49.705399 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad4605eb-f3f0-43dd-9482-676e8dffece8 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1265 microversion: 2.1 time: 0.167021 Jul 26 14:58:49.705980 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3010/6137] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:49 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:50.729896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21dc81d0-e735-4943-aa85-3f01c3c24dfc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:50.730519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-21dc81d0-e735-4943-aa85-3f01c3c24dfc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:50.738915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21dc81d0-e735-4943-aa85-3f01c3c24dfc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:50.739393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21dc81d0-e735-4943-aa85-3f01c3c24dfc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:50.740241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21dc81d0-e735-4943-aa85-3f01c3c24dfc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:50.740698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21dc81d0-e735-4943-aa85-3f01c3c24dfc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:50.900437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-21dc81d0-e735-4943-aa85-3f01c3c24dfc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:50.911855 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-21dc81d0-e735-4943-aa85-3f01c3c24dfc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1265 microversion: 2.1 time: 0.185890 Jul 26 14:58:50.912602 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3128/6138] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:50 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:51.933664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-16acc532-d7e9-4cd6-a41a-f78e684b3c66 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:51.934288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-16acc532-d7e9-4cd6-a41a-f78e684b3c66 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:51.942009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16acc532-d7e9-4cd6-a41a-f78e684b3c66 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:51.942596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16acc532-d7e9-4cd6-a41a-f78e684b3c66 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:51.943380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16acc532-d7e9-4cd6-a41a-f78e684b3c66 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:51.943825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16acc532-d7e9-4cd6-a41a-f78e684b3c66 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:52.078335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-16acc532-d7e9-4cd6-a41a-f78e684b3c66 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:52.087388 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-16acc532-d7e9-4cd6-a41a-f78e684b3c66 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1265 microversion: 2.1 time: 0.157881 Jul 26 14:58:52.087905 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3011/6139] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:51 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:53.108606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3325d1df-6508-46ae-a6af-d521928c7a43 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:53.109181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3325d1df-6508-46ae-a6af-d521928c7a43 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:53.116646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3325d1df-6508-46ae-a6af-d521928c7a43 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:53.117112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3325d1df-6508-46ae-a6af-d521928c7a43 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:53.117907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3325d1df-6508-46ae-a6af-d521928c7a43 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:53.118368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3325d1df-6508-46ae-a6af-d521928c7a43 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:53.257363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3325d1df-6508-46ae-a6af-d521928c7a43 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:53.265044 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3325d1df-6508-46ae-a6af-d521928c7a43 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1265 microversion: 2.1 time: 0.160539 Jul 26 14:58:53.265623 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3129/6140] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:53 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:54.287067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1ae5d1d1-f362-4127-b110-8fac55664ba4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:54.287929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1ae5d1d1-f362-4127-b110-8fac55664ba4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:54.294886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ae5d1d1-f362-4127-b110-8fac55664ba4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:54.295347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ae5d1d1-f362-4127-b110-8fac55664ba4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:54.296159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ae5d1d1-f362-4127-b110-8fac55664ba4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:54.296603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1ae5d1d1-f362-4127-b110-8fac55664ba4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:54.322547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-5710e316-52f0-4f5e-bb26-e8d672c6208c req-2b96943f-b719-4c10-bcb5-a33cc36dd37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7bcd8b-b1f8-4952-8542-be8652a0fa42", "name": "network-vif-plugged", "status": "completed", "tag": "ec137d34-e230-4bdc-88c3-41e6744f2b09"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:54.334231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5710e316-52f0-4f5e-bb26-e8d672c6208c req-2b96943f-b719-4c10-bcb5-a33cc36dd37d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:54.334810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-5710e316-52f0-4f5e-bb26-e8d672c6208c req-2b96943f-b719-4c10-bcb5-a33cc36dd37d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:54.347046 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-5710e316-52f0-4f5e-bb26-e8d672c6208c req-2b96943f-b719-4c10-bcb5-a33cc36dd37d service nova] Creating event network-vif-plugged:ec137d34-e230-4bdc-88c3-41e6744f2b09 for instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 on n-h2-833090-9 Jul 26 14:58:54.354369 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-5710e316-52f0-4f5e-bb26-e8d672c6208c req-2b96943f-b719-4c10-bcb5-a33cc36dd37d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035815 Jul 26 14:58:54.355139 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3130/6141] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:58:54.485755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1ae5d1d1-f362-4127-b110-8fac55664ba4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:54.494796 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1ae5d1d1-f362-4127-b110-8fac55664ba4 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1265 microversion: 2.1 time: 0.212589 Jul 26 14:58:54.495382 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3012/6142] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:54 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:55.518494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d87e822d-2366-4c1a-90d7-c38b39d8ee2f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:55.519219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d87e822d-2366-4c1a-90d7-c38b39d8ee2f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:55.527519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87e822d-2366-4c1a-90d7-c38b39d8ee2f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:55.528320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87e822d-2366-4c1a-90d7-c38b39d8ee2f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:55.529123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87e822d-2366-4c1a-90d7-c38b39d8ee2f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:55.530147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d87e822d-2366-4c1a-90d7-c38b39d8ee2f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:55.678687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d87e822d-2366-4c1a-90d7-c38b39d8ee2f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:55.686671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d87e822d-2366-4c1a-90d7-c38b39d8ee2f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1265 microversion: 2.1 time: 0.173286 Jul 26 14:58:55.687245 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3131/6143] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:55 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:56.707695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f238c357-dab6-4c63-a30e-1a3f71af72e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:56.708374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f238c357-dab6-4c63-a30e-1a3f71af72e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:56.715553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f238c357-dab6-4c63-a30e-1a3f71af72e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:56.716043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f238c357-dab6-4c63-a30e-1a3f71af72e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:56.716905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f238c357-dab6-4c63-a30e-1a3f71af72e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:56.717355 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f238c357-dab6-4c63-a30e-1a3f71af72e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:56.852765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f238c357-dab6-4c63-a30e-1a3f71af72e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:56.860424 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f238c357-dab6-4c63-a30e-1a3f71af72e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1451 microversion: 2.1 time: 0.156542 Jul 26 14:58:56.860986 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3013/6144] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:56 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:56.883679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8bbc2da5-f617-411c-bf8d-e6db930ddd09 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:56.884349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8bbc2da5-f617-411c-bf8d-e6db930ddd09 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:56.891375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8bbc2da5-f617-411c-bf8d-e6db930ddd09 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:56.891851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8bbc2da5-f617-411c-bf8d-e6db930ddd09 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:56.892673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8bbc2da5-f617-411c-bf8d-e6db930ddd09 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:56.893135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8bbc2da5-f617-411c-bf8d-e6db930ddd09 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:57.035505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8bbc2da5-f617-411c-bf8d-e6db930ddd09 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:57.043778 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8bbc2da5-f617-411c-bf8d-e6db930ddd09 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1451 microversion: 2.1 time: 0.164046 Jul 26 14:58:57.044509 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3132/6145] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:56 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:58.681384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b90bfca1-3fb9-4598-8ddf-a19e7008c464 req-793ef9f5-3f59-42e5-bb86-0b31ee2e1cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7bcd8b-b1f8-4952-8542-be8652a0fa42", "tag": "ec137d34-e230-4bdc-88c3-41e6744f2b09"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:58.692072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b90bfca1-3fb9-4598-8ddf-a19e7008c464 req-793ef9f5-3f59-42e5-bb86-0b31ee2e1cdc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:58.692624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b90bfca1-3fb9-4598-8ddf-a19e7008c464 req-793ef9f5-3f59-42e5-bb86-0b31ee2e1cdc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:58.703859 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b90bfca1-3fb9-4598-8ddf-a19e7008c464 req-793ef9f5-3f59-42e5-bb86-0b31ee2e1cdc service nova] Creating event network-changed:ec137d34-e230-4bdc-88c3-41e6744f2b09 for instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 on n-h2-833090-9 Jul 26 14:58:58.709357 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b90bfca1-3fb9-4598-8ddf-a19e7008c464 req-793ef9f5-3f59-42e5-bb86-0b31ee2e1cdc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032630 Jul 26 14:58:58.710435 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3014/6146] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 14:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:38.343277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:38.344190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=54 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:38.348226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=22 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:38.349043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=50 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:38.349506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7dcb74c8-5e15-40c2-b70d-f74fd66adf31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:38.350435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7dcb74c8-5e15-40c2-b70d-f74fd66adf31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:38.354313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-594b0fab-66c8-46eb-9480-89c24988a077 req-096c8d18-993e-4e23-982e-7652d69f7042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7bcd8b-b1f8-4952-8542-be8652a0fa42", "tag": "ec137d34-e230-4bdc-88c3-41e6744f2b09"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:38.358631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7dcb74c8-5e15-40c2-b70d-f74fd66adf31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:38.359214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7dcb74c8-5e15-40c2-b70d-f74fd66adf31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:38.360054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7dcb74c8-5e15-40c2-b70d-f74fd66adf31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:38.360512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7dcb74c8-5e15-40c2-b70d-f74fd66adf31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:38.365070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-594b0fab-66c8-46eb-9480-89c24988a077 req-096c8d18-993e-4e23-982e-7652d69f7042 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:38.365837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-594b0fab-66c8-46eb-9480-89c24988a077 req-096c8d18-993e-4e23-982e-7652d69f7042 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:38.378009 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-594b0fab-66c8-46eb-9480-89c24988a077 req-096c8d18-993e-4e23-982e-7652d69f7042 service nova] Creating event network-changed:ec137d34-e230-4bdc-88c3-41e6744f2b09 for instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 on n-h2-833090-9 Jul 26 15:00:38.383911 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-594b0fab-66c8-46eb-9480-89c24988a077 req-096c8d18-993e-4e23-982e-7652d69f7042 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037960 Jul 26 15:00:38.384831 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3015/6147] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:38.388222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7dcb74c8-5e15-40c2-b70d-f74fd66adf31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:00:38.485696 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7dcb74c8-5e15-40c2-b70d-f74fd66adf31 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 204 len: 0 microversion: 2.1 time: 0.145229 Jul 26 15:00:38.486300 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3133/6148] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:00:38 2022] DELETE /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:00:38.495709 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d66d7fef-7a38-4bb1-a1da-4f59c43e7ade tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:38.496452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d66d7fef-7a38-4bb1-a1da-4f59c43e7ade tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:38.504358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d66d7fef-7a38-4bb1-a1da-4f59c43e7ade tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:38.505121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d66d7fef-7a38-4bb1-a1da-4f59c43e7ade tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:38.506124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d66d7fef-7a38-4bb1-a1da-4f59c43e7ade tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:38.506747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d66d7fef-7a38-4bb1-a1da-4f59c43e7ade tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:38.743245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d66d7fef-7a38-4bb1-a1da-4f59c43e7ade tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:38.755147 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d66d7fef-7a38-4bb1-a1da-4f59c43e7ade tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1575 microversion: 2.1 time: 0.263617 Jul 26 15:00:38.755852 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3016/6149] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:38 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1575 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:39.783198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76ecd034-a3b0-4905-9ece-939d8738214e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:39.784051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-76ecd034-a3b0-4905-9ece-939d8738214e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:39.790473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76ecd034-a3b0-4905-9ece-939d8738214e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:39.790942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76ecd034-a3b0-4905-9ece-939d8738214e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:39.791760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76ecd034-a3b0-4905-9ece-939d8738214e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:39.792223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76ecd034-a3b0-4905-9ece-939d8738214e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:40.007507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-76ecd034-a3b0-4905-9ece-939d8738214e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:40.016379 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76ecd034-a3b0-4905-9ece-939d8738214e tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1575 microversion: 2.1 time: 0.240899 Jul 26 15:00:40.017007 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3134/6150] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:39 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1575 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:40.632860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-735fe54f-0461-48d3-8815-72dd71b5efe0 req-bf317d35-050b-4ebf-9160-c16bfcbcee9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7bcd8b-b1f8-4952-8542-be8652a0fa42", "name": "network-vif-deleted", "tag": "ec137d34-e230-4bdc-88c3-41e6744f2b09"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:40.644564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-735fe54f-0461-48d3-8815-72dd71b5efe0 req-bf317d35-050b-4ebf-9160-c16bfcbcee9c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:40.645008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-735fe54f-0461-48d3-8815-72dd71b5efe0 req-bf317d35-050b-4ebf-9160-c16bfcbcee9c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:40.657123 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-735fe54f-0461-48d3-8815-72dd71b5efe0 req-bf317d35-050b-4ebf-9160-c16bfcbcee9c service nova] Creating event network-vif-deleted:ec137d34-e230-4bdc-88c3-41e6744f2b09 for instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 on n-h2-833090-9 Jul 26 15:00:40.662639 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-735fe54f-0461-48d3-8815-72dd71b5efe0 req-bf317d35-050b-4ebf-9160-c16bfcbcee9c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033501 Jul 26 15:00:40.663324 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3017/6151] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:41.038193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-239b23fd-2616-4208-a815-a18f76fbfc88 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:41.038843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-239b23fd-2616-4208-a815-a18f76fbfc88 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:41.046909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-239b23fd-2616-4208-a815-a18f76fbfc88 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:41.047389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-239b23fd-2616-4208-a815-a18f76fbfc88 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:41.048499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-239b23fd-2616-4208-a815-a18f76fbfc88 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:41.048963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-239b23fd-2616-4208-a815-a18f76fbfc88 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:41.115613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-239b23fd-2616-4208-a815-a18f76fbfc88 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:41.123408 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-239b23fd-2616-4208-a815-a18f76fbfc88 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1224 microversion: 2.1 time: 0.089317 Jul 26 15:00:41.124593 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3135/6152] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:41 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:42.147778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-08c42872-6a9b-4cc4-9527-b76bc31e6ddc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:42.148508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-08c42872-6a9b-4cc4-9527-b76bc31e6ddc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:42.155528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08c42872-6a9b-4cc4-9527-b76bc31e6ddc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:42.156058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08c42872-6a9b-4cc4-9527-b76bc31e6ddc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:42.156919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08c42872-6a9b-4cc4-9527-b76bc31e6ddc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:42.157528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-08c42872-6a9b-4cc4-9527-b76bc31e6ddc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:42.232488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-08c42872-6a9b-4cc4-9527-b76bc31e6ddc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:42.240981 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-08c42872-6a9b-4cc4-9527-b76bc31e6ddc tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1224 microversion: 2.1 time: 0.098394 Jul 26 15:00:42.241672 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3018/6153] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:42 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:43.262846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c155ed00-0761-45b8-ad01-a000d742d827 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:43.263607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c155ed00-0761-45b8-ad01-a000d742d827 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:43.270847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c155ed00-0761-45b8-ad01-a000d742d827 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:43.271304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c155ed00-0761-45b8-ad01-a000d742d827 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:43.272143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c155ed00-0761-45b8-ad01-a000d742d827 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:43.272608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c155ed00-0761-45b8-ad01-a000d742d827 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:43.338534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c155ed00-0761-45b8-ad01-a000d742d827 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:43.347210 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c155ed00-0761-45b8-ad01-a000d742d827 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1224 microversion: 2.1 time: 0.088276 Jul 26 15:00:43.347805 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3136/6154] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:43 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:44.369309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-07c2d87b-f1af-41f4-a563-d76126fdc70c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:44.369936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-07c2d87b-f1af-41f4-a563-d76126fdc70c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:44.377755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07c2d87b-f1af-41f4-a563-d76126fdc70c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:44.378211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07c2d87b-f1af-41f4-a563-d76126fdc70c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:44.378985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07c2d87b-f1af-41f4-a563-d76126fdc70c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:44.379432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-07c2d87b-f1af-41f4-a563-d76126fdc70c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:44.452085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-07c2d87b-f1af-41f4-a563-d76126fdc70c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:44.460100 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-07c2d87b-f1af-41f4-a563-d76126fdc70c tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 200 len: 1224 microversion: 2.1 time: 0.095096 Jul 26 15:00:44.460780 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3019/6155] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:44 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:45.481081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-78cc02b5-fd50-47ba-9c27-285c8b2b1d59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:45.481727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-78cc02b5-fd50-47ba-9c27-285c8b2b1d59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 4d7bcd8b-b1f8-4952-8542-be8652a0fa42] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:45.489112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78cc02b5-fd50-47ba-9c27-285c8b2b1d59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:45.489586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78cc02b5-fd50-47ba-9c27-285c8b2b1d59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:45.490383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78cc02b5-fd50-47ba-9c27-285c8b2b1d59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:45.490842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-78cc02b5-fd50-47ba-9c27-285c8b2b1d59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:45.505444 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-78cc02b5-fd50-47ba-9c27-285c8b2b1d59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 could not be found. Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-78cc02b5-fd50-47ba-9c27-285c8b2b1d59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 HTTP/1.1 Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 could not be found. Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4d7bcd8b-b1f8-4952-8542-be8652a0fa42'} Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 could not be found. Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 could not be found. Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:45.507166 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:45.512194 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:45.512194 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:45.512194 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:45.512194 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:00:45.512194 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:00:45.512194 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 could not be found. Jul 26 15:00:45.512194 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:45.512194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-78cc02b5-fd50-47ba-9c27-285c8b2b1d59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 4d7bcd8b-b1f8-4952-8542-be8652a0fa42 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:00:45.512194 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-78cc02b5-fd50-47ba-9c27-285c8b2b1d59 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42" status: 404 len: 111 microversion: 2.1 time: 0.031576 Jul 26 15:00:45.512194 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3137/6156] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:45 2022] GET /compute/v2.1/servers/4d7bcd8b-b1f8-4952-8542-be8652a0fa42 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:00:48.113419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7c41790e-bf43-4beb-aafa-9f69a976863e tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:48.114099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c41790e-bf43-4beb-aafa-9f69a976863e tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:48.125304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c41790e-bf43-4beb-aafa-9f69a976863e tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:48.125552 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c41790e-bf43-4beb-aafa-9f69a976863e tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:48.126451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c41790e-bf43-4beb-aafa-9f69a976863e tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:48.126985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7c41790e-bf43-4beb-aafa-9f69a976863e tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:48.156705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7c41790e-bf43-4beb-aafa-9f69a976863e tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:00:48.244557 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7c41790e-bf43-4beb-aafa-9f69a976863e tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "DELETE /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 204 len: 0 microversion: 2.1 time: 0.134541 Jul 26 15:00:48.245212 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3020/6157] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:00:48 2022] DELETE /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:00:48.254723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e40a30b2-4f11-4792-837d-a57c0bbb8b99 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:48.256017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e40a30b2-4f11-4792-837d-a57c0bbb8b99 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:48.263345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e40a30b2-4f11-4792-837d-a57c0bbb8b99 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:48.263826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e40a30b2-4f11-4792-837d-a57c0bbb8b99 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:48.264727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e40a30b2-4f11-4792-837d-a57c0bbb8b99 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:48.265303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e40a30b2-4f11-4792-837d-a57c0bbb8b99 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:48.407738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e40a30b2-4f11-4792-837d-a57c0bbb8b99 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:48.417835 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e40a30b2-4f11-4792-837d-a57c0bbb8b99 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1731 microversion: 2.1 time: 0.167105 Jul 26 15:00:48.418447 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3138/6158] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:48 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:00:49.441910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4adec848-8be6-4378-8d14-c961c644ff87 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:49.442479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4adec848-8be6-4378-8d14-c961c644ff87 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:49.451569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4adec848-8be6-4378-8d14-c961c644ff87 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:49.453736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4adec848-8be6-4378-8d14-c961c644ff87 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:49.455012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4adec848-8be6-4378-8d14-c961c644ff87 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:49.455629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4adec848-8be6-4378-8d14-c961c644ff87 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:49.672006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4adec848-8be6-4378-8d14-c961c644ff87 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:49.681141 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4adec848-8be6-4378-8d14-c961c644ff87 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1731 microversion: 2.1 time: 0.243482 Jul 26 15:00:49.694920 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3021/6159] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:49 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1731 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:50.476781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-80cbf34f-728b-48c6-a539-8dab2090f51e req-9df07520-88a0-4e5d-a28e-6058b55f251e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b5a234-bd58-4c38-b119-0095a494d1e3", "name": "network-vif-deleted", "tag": "02217c29-41df-4dea-832c-98ced87a4b89"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:50.501041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-80cbf34f-728b-48c6-a539-8dab2090f51e req-9df07520-88a0-4e5d-a28e-6058b55f251e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:50.504596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-80cbf34f-728b-48c6-a539-8dab2090f51e req-9df07520-88a0-4e5d-a28e-6058b55f251e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:50.518285 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-80cbf34f-728b-48c6-a539-8dab2090f51e req-9df07520-88a0-4e5d-a28e-6058b55f251e service nova] Creating event network-vif-deleted:02217c29-41df-4dea-832c-98ced87a4b89 for instance 09b5a234-bd58-4c38-b119-0095a494d1e3 on n-h1-833090-9 Jul 26 15:00:50.528813 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-80cbf34f-728b-48c6-a539-8dab2090f51e req-9df07520-88a0-4e5d-a28e-6058b55f251e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055394 Jul 26 15:00:50.530411 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3139/6160] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:50.702655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:50.704064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:50.711290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:50.712038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:50.712773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:50.713213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:50.748238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:50.748739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:50.749499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lazy-loading 'fault' on Instance uuid 09b5a234-bd58-4c38-b119-0095a494d1e3 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:00:50.795357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b831fc644736499695ac2d88bc51efd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4984fbf96584477bf56d06023a62fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:50.810117 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4e5edd60-0a7f-4a5a-8a66-90a1e89b3ae3 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 200 len: 1387 microversion: 2.1 time: 0.111386 Jul 26 15:00:50.816008 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3022/6161] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:50 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 1387 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:51.835255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-38480c39-bf42-4fa1-a50a-fec6f368e5af tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:51.836014 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-38480c39-bf42-4fa1-a50a-fec6f368e5af tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:51.843393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38480c39-bf42-4fa1-a50a-fec6f368e5af tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:51.844089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38480c39-bf42-4fa1-a50a-fec6f368e5af tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:51.845181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38480c39-bf42-4fa1-a50a-fec6f368e5af tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:51.845655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38480c39-bf42-4fa1-a50a-fec6f368e5af tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:51.864202 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-38480c39-bf42-4fa1-a50a-fec6f368e5af tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] HTTP exception thrown: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-38480c39-bf42-4fa1-a50a-fec6f368e5af tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Request method failure captured: Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 HTTP/1.1 Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4ABzTfHKbqMz8EeWegpMaIjUdiZFxmc9UoqUH1zhtUCyAeqjuf8nr1klb1zHksdsqIy5zoHBys42eddrjaxrfFUTaqoZXwMKSVJzX1fP-h_2GoE9BK6mJtFeKKeiLoLG5wEa9UCVZXpr4yOKWPq4oJyxNYe0xt7N16kS2PTqp2d7nQ8 Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c4984fbf96584477bf56d06023a62fbd Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestServerBasicOps-1377881501 Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4984fbf96584477bf56d06023a62fbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4984fbf96584477bf56d06023a62fbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4984fbf96584477bf56d06023a62fbd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4984fbf96584477bf56d06023a62fbd"}]}] Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestServerBasicOps-1377881501 Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c4984fbf96584477bf56d06023a62fbd Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestServerBasicOps-1377881501 Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestServerBasicOps-1377881501-project Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b831fc644736499695ac2d88bc51efd6 Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestServerBasicOps-1377881501-project Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '09b5a234-bd58-4c38-b119-0095a494d1e3'} Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:51.865743 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:51.871438 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:51.871438 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:51.871438 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:51.871438 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:00:51.871438 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:00:51.871438 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:51.871438 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:51.871438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-38480c39-bf42-4fa1-a50a-fec6f368e5af tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Returning 404 to user: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:00:51.871438 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-38480c39-bf42-4fa1-a50a-fec6f368e5af tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 404 len: 111 microversion: 2.1 time: 0.038144 Jul 26 15:00:51.871438 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3140/6162] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:51 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:00:52.087611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3c87a550-deaf-4c27-8e41-ab35b75bbd01 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:52.088312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3c87a550-deaf-4c27-8e41-ab35b75bbd01 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:52.096134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c87a550-deaf-4c27-8e41-ab35b75bbd01 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:52.096881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c87a550-deaf-4c27-8e41-ab35b75bbd01 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:52.098383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c87a550-deaf-4c27-8e41-ab35b75bbd01 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:52.099002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c87a550-deaf-4c27-8e41-ab35b75bbd01 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:52.129544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3c87a550-deaf-4c27-8e41-ab35b75bbd01 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:00:52.228514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3c87a550-deaf-4c27-8e41-ab35b75bbd01 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 204 len: 0 microversion: 2.1 time: 0.144153 Jul 26 15:00:52.233598 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3023/6163] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:00:52 2022] DELETE /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:00:52.238840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fd44d0c9-e134-4cac-a3cd-af82efa3b3aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:52.239513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fd44d0c9-e134-4cac-a3cd-af82efa3b3aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:52.246047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd44d0c9-e134-4cac-a3cd-af82efa3b3aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:52.246590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd44d0c9-e134-4cac-a3cd-af82efa3b3aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:52.247351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd44d0c9-e134-4cac-a3cd-af82efa3b3aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:52.247878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd44d0c9-e134-4cac-a3cd-af82efa3b3aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:52.409094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64676b84-0649-4b6e-93fd-dc6ad228493a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:52.410275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-64676b84-0649-4b6e-93fd-dc6ad228493a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:52.415092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fd44d0c9-e134-4cac-a3cd-af82efa3b3aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:52.416341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64676b84-0649-4b6e-93fd-dc6ad228493a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:52.416801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64676b84-0649-4b6e-93fd-dc6ad228493a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:52.417641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64676b84-0649-4b6e-93fd-dc6ad228493a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:52.418034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64676b84-0649-4b6e-93fd-dc6ad228493a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:52.424625 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fd44d0c9-e134-4cac-a3cd-af82efa3b3aa tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1576 microversion: 2.1 time: 0.189735 Jul 26 15:00:52.425892 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3141/6164] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:52 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:52.441176 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-64676b84-0649-4b6e-93fd-dc6ad228493a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] HTTP exception thrown: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64676b84-0649-4b6e-93fd-dc6ad228493a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Request method failure captured: Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 HTTP/1.1 Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4ABzTfHKbqMz8EeWegpMaIjUdiZFxmc9UoqUH1zhtUCyAeqjuf8nr1klb1zHksdsqIy5zoHBys42eddrjaxrfFUTaqoZXwMKSVJzX1fP-h_2GoE9BK6mJtFeKKeiLoLG5wEa9UCVZXpr4yOKWPq4oJyxNYe0xt7N16kS2PTqp2d7nQ8 Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: c4984fbf96584477bf56d06023a62fbd Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestServerBasicOps-1377881501 Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4984fbf96584477bf56d06023a62fbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4984fbf96584477bf56d06023a62fbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4984fbf96584477bf56d06023a62fbd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4984fbf96584477bf56d06023a62fbd"}]}] Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestServerBasicOps-1377881501 Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: c4984fbf96584477bf56d06023a62fbd Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestServerBasicOps-1377881501 Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestServerBasicOps-1377881501-project Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b831fc644736499695ac2d88bc51efd6 Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestServerBasicOps-1377881501-project Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '09b5a234-bd58-4c38-b119-0095a494d1e3'} Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:00:52.443426 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64676b84-0649-4b6e-93fd-dc6ad228493a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Returning 404 to user: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64676b84-0649-4b6e-93fd-dc6ad228493a tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "DELETE /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 404 len: 111 microversion: 2.1 time: 0.039766 Jul 26 15:00:52.449307 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3024/6165] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:00:52 2022] DELETE /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:00:52.453615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d2b7edb5-b526-42c1-9691-217a93369e30 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:52.454268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d2b7edb5-b526-42c1-9691-217a93369e30 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] [instance: 09b5a234-bd58-4c38-b119-0095a494d1e3] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:52.460782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2b7edb5-b526-42c1-9691-217a93369e30 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:52.461259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2b7edb5-b526-42c1-9691-217a93369e30 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:52.462073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2b7edb5-b526-42c1-9691-217a93369e30 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:52.462614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d2b7edb5-b526-42c1-9691-217a93369e30 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:52.480237 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d2b7edb5-b526-42c1-9691-217a93369e30 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] HTTP exception thrown: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d2b7edb5-b526-42c1-9691-217a93369e30 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Request method failure captured: Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 HTTP/1.1 Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4ABzTfHKbqMz8EeWegpMaIjUdiZFxmc9UoqUH1zhtUCyAeqjuf8nr1klb1zHksdsqIy5zoHBys42eddrjaxrfFUTaqoZXwMKSVJzX1fP-h_2GoE9BK6mJtFeKKeiLoLG5wEa9UCVZXpr4yOKWPq4oJyxNYe0xt7N16kS2PTqp2d7nQ8 Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c4984fbf96584477bf56d06023a62fbd Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestServerBasicOps-1377881501 Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4984fbf96584477bf56d06023a62fbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c4984fbf96584477bf56d06023a62fbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c4984fbf96584477bf56d06023a62fbd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c4984fbf96584477bf56d06023a62fbd"}]}] Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestServerBasicOps-1377881501 Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c4984fbf96584477bf56d06023a62fbd Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestServerBasicOps-1377881501 Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestServerBasicOps-1377881501-project Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b831fc644736499695ac2d88bc51efd6 Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestServerBasicOps-1377881501-project Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '09b5a234-bd58-4c38-b119-0095a494d1e3'} Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:52.481830 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:52.489020 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:52.489020 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:52.489020 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:52.489020 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:00:52.489020 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:00:52.489020 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. Jul 26 15:00:52.489020 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:00:52.489020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d2b7edb5-b526-42c1-9691-217a93369e30 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Returning 404 to user: Instance 09b5a234-bd58-4c38-b119-0095a494d1e3 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:00:52.489020 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d2b7edb5-b526-42c1-9691-217a93369e30 tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3" status: 404 len: 111 microversion: 2.1 time: 0.034108 Jul 26 15:00:52.489020 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3142/6166] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:52 2022] GET /compute/v2.1/servers/09b5a234-bd58-4c38-b119-0095a494d1e3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:00:52.546766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d1ab0614-85f0-4a49-b228-42dfc159930c req-c4819355-b3f4-4227-a5e3-03f34bb908fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36736136-fe6f-43ce-b9c8-d08b0c89dde9", "tag": "aeaa591a-5a9b-4fd3-8931-a2e9dfec566a"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:52.558375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d1ab0614-85f0-4a49-b228-42dfc159930c req-c4819355-b3f4-4227-a5e3-03f34bb908fd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:52.560177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d1ab0614-85f0-4a49-b228-42dfc159930c req-c4819355-b3f4-4227-a5e3-03f34bb908fd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:52.572641 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d1ab0614-85f0-4a49-b228-42dfc159930c req-c4819355-b3f4-4227-a5e3-03f34bb908fd service nova] Creating event network-changed:aeaa591a-5a9b-4fd3-8931-a2e9dfec566a for instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 on n-h2-833090-9 Jul 26 15:00:52.579178 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d1ab0614-85f0-4a49-b228-42dfc159930c req-c4819355-b3f4-4227-a5e3-03f34bb908fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036531 Jul 26 15:00:52.579796 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3025/6167] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:52.690483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed4c6f3e-7186-4b65-878e-5694494e0daf tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] Calling method '.version_select at 0x7f87993d6310>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:52.727489 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed4c6f3e-7186-4b65-878e-5694494e0daf tempest-TestServerBasicOps-1377881501 tempest-TestServerBasicOps-1377881501-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-865037253" status: 202 len: 0 microversion: 2.1 time: 0.055056 Jul 26 15:00:52.728328 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3143/6168] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 15:00:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-865037253 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:00:53.454928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-819251da-1748-4e62-a410-250b5a4f13d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:53.455732 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-819251da-1748-4e62-a410-250b5a4f13d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:53.462582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-819251da-1748-4e62-a410-250b5a4f13d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:53.463079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-819251da-1748-4e62-a410-250b5a4f13d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:53.463830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-819251da-1748-4e62-a410-250b5a4f13d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:53.464313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-819251da-1748-4e62-a410-250b5a4f13d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:53.698821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-819251da-1748-4e62-a410-250b5a4f13d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:53.708423 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-819251da-1748-4e62-a410-250b5a4f13d1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1576 microversion: 2.1 time: 0.262501 Jul 26 15:00:53.708423 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3026/6169] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:53 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:54.600262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2c7c2fb1-f1fd-41cc-83de-f98e9287c5c4 req-7357e6e1-a8a1-4df3-baf8-069b3fb0cae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36736136-fe6f-43ce-b9c8-d08b0c89dde9", "name": "network-vif-deleted", "tag": "aeaa591a-5a9b-4fd3-8931-a2e9dfec566a"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:54.614329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2c7c2fb1-f1fd-41cc-83de-f98e9287c5c4 req-7357e6e1-a8a1-4df3-baf8-069b3fb0cae6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:54.614894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2c7c2fb1-f1fd-41cc-83de-f98e9287c5c4 req-7357e6e1-a8a1-4df3-baf8-069b3fb0cae6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:54.630572 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2c7c2fb1-f1fd-41cc-83de-f98e9287c5c4 req-7357e6e1-a8a1-4df3-baf8-069b3fb0cae6 service nova] Creating event network-vif-deleted:aeaa591a-5a9b-4fd3-8931-a2e9dfec566a for instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 on n-h2-833090-9 Jul 26 15:00:54.635852 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2c7c2fb1-f1fd-41cc-83de-f98e9287c5c4 req-7357e6e1-a8a1-4df3-baf8-069b3fb0cae6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042140 Jul 26 15:00:54.636752 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3144/6170] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:00:54.730268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef4e2053-6393-42c9-a9f8-5e780ea93ccd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:54.732277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ef4e2053-6393-42c9-a9f8-5e780ea93ccd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:54.742416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef4e2053-6393-42c9-a9f8-5e780ea93ccd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:54.743550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef4e2053-6393-42c9-a9f8-5e780ea93ccd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:54.744622 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef4e2053-6393-42c9-a9f8-5e780ea93ccd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:54.745302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef4e2053-6393-42c9-a9f8-5e780ea93ccd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:54.816280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ef4e2053-6393-42c9-a9f8-5e780ea93ccd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:54.825912 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ef4e2053-6393-42c9-a9f8-5e780ea93ccd tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1225 microversion: 2.1 time: 0.099437 Jul 26 15:00:54.827519 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3027/6171] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:54 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:55.852570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e61cff09-1d7d-4fe1-b6e2-f7c25152e2e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:55.854215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e61cff09-1d7d-4fe1-b6e2-f7c25152e2e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:55.863119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e61cff09-1d7d-4fe1-b6e2-f7c25152e2e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:55.863865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e61cff09-1d7d-4fe1-b6e2-f7c25152e2e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:55.865139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e61cff09-1d7d-4fe1-b6e2-f7c25152e2e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:55.865606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e61cff09-1d7d-4fe1-b6e2-f7c25152e2e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:56.112857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e61cff09-1d7d-4fe1-b6e2-f7c25152e2e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:56.122653 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e61cff09-1d7d-4fe1-b6e2-f7c25152e2e1 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1225 microversion: 2.1 time: 0.274959 Jul 26 15:00:56.126830 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3145/6172] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:55 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1225 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:57.149945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9bb80d3f-d05f-4adc-bc6b-b20f2c6207fb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:57.150541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9bb80d3f-d05f-4adc-bc6b-b20f2c6207fb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:57.158499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9bb80d3f-d05f-4adc-bc6b-b20f2c6207fb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:57.158956 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9bb80d3f-d05f-4adc-bc6b-b20f2c6207fb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:57.160344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9bb80d3f-d05f-4adc-bc6b-b20f2c6207fb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:57.160785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9bb80d3f-d05f-4adc-bc6b-b20f2c6207fb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:57.284118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9bb80d3f-d05f-4adc-bc6b-b20f2c6207fb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:57.292989 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9bb80d3f-d05f-4adc-bc6b-b20f2c6207fb tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1225 microversion: 2.1 time: 0.147800 Jul 26 15:00:57.293765 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3028/6173] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:57 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1225 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:58.314953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cd8b7d77-b833-481a-9fee-4ee7048bf3d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:58.316397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cd8b7d77-b833-481a-9fee-4ee7048bf3d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:58.323232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd8b7d77-b833-481a-9fee-4ee7048bf3d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:58.324072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd8b7d77-b833-481a-9fee-4ee7048bf3d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:58.325130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd8b7d77-b833-481a-9fee-4ee7048bf3d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:58.325754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd8b7d77-b833-481a-9fee-4ee7048bf3d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:58.435740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cd8b7d77-b833-481a-9fee-4ee7048bf3d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:58.450434 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cd8b7d77-b833-481a-9fee-4ee7048bf3d0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1225 microversion: 2.1 time: 0.140290 Jul 26 15:00:58.451543 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3146/6174] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:58 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1225 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:59.473834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:59.474701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:59.485605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:59.488439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:59.491277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:59.511376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:59.570574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:59.571038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:59.571561 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lazy-loading 'fault' on Instance uuid 36736136-fe6f-43ce-b9c8-d08b0c89dde9 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:00:59.636298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9553617f2440a68e33b82650206cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f953d00da52543fda852b2d118613fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:59.646565 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7654d12b-4384-41a4-9ba0-d7bf51c03704 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 200 len: 1184 microversion: 2.1 time: 0.177696 Jul 26 15:00:59.647153 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3029/6175] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:59 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 1184 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:00.669584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21f979e2-2fc8-4d20-9dbc-ed1d1c26b0ab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:00.670260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-21f979e2-2fc8-4d20-9dbc-ed1d1c26b0ab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: 36736136-fe6f-43ce-b9c8-d08b0c89dde9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:00.677941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21f979e2-2fc8-4d20-9dbc-ed1d1c26b0ab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:00.678416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21f979e2-2fc8-4d20-9dbc-ed1d1c26b0ab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:00.679216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21f979e2-2fc8-4d20-9dbc-ed1d1c26b0ab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:00.679681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21f979e2-2fc8-4d20-9dbc-ed1d1c26b0ab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:00.694478 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-21f979e2-2fc8-4d20-9dbc-ed1d1c26b0ab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 could not be found. Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21f979e2-2fc8-4d20-9dbc-ed1d1c26b0ab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 HTTP/1.1 Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 could not be found. Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '36736136-fe6f-43ce-b9c8-d08b0c89dde9'} Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 could not be found. Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 could not be found. Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:00.696209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:00.702623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:00.702623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:00.702623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:00.702623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:01:00.702623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:01:00.702623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 could not be found. Jul 26 15:01:00.702623 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:00.702623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21f979e2-2fc8-4d20-9dbc-ed1d1c26b0ab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance 36736136-fe6f-43ce-b9c8-d08b0c89dde9 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:01:00.702623 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-21f979e2-2fc8-4d20-9dbc-ed1d1c26b0ab tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9" status: 404 len: 111 microversion: 2.1 time: 0.034139 Jul 26 15:01:00.702623 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3147/6176] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:00 2022] GET /compute/v2.1/servers/36736136-fe6f-43ce-b9c8-d08b0c89dde9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:01:01.285965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f36177fa-db78-415b-b049-e7e8dfc5863f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:01.286467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f36177fa-db78-415b-b049-e7e8dfc5863f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:01.293293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f36177fa-db78-415b-b049-e7e8dfc5863f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:01.293747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f36177fa-db78-415b-b049-e7e8dfc5863f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:01.294518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f36177fa-db78-415b-b049-e7e8dfc5863f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:01.294994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f36177fa-db78-415b-b049-e7e8dfc5863f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:01.300654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:01.313950 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-f36177fa-db78-415b-b049-e7e8dfc5863f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f36177fa-db78-415b-b049-e7e8dfc5863f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 HTTP/1.1 Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'bb9a1be8-b8e7-4be1-897f-02e3a877deb8'} Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:01:01.315721 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f36177fa-db78-415b-b049-e7e8dfc5863f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f36177fa-db78-415b-b049-e7e8dfc5863f tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 404 len: 111 microversion: 2.1 time: 0.035253 Jul 26 15:01:01.321180 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3030/6177] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:01:01 2022] DELETE /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:01:01.326342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50d76d29-502f-4aab-ade3-545edba87933 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:01.327577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-50d76d29-502f-4aab-ade3-545edba87933 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [instance: bb9a1be8-b8e7-4be1-897f-02e3a877deb8] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:01.334982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50d76d29-502f-4aab-ade3-545edba87933 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:01.335468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50d76d29-502f-4aab-ade3-545edba87933 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:01.336374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50d76d29-502f-4aab-ade3-545edba87933 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:01.336842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-50d76d29-502f-4aab-ade3-545edba87933 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:01.354573 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-50d76d29-502f-4aab-ade3-545edba87933 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] HTTP exception thrown: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50d76d29-502f-4aab-ade3-545edba87933 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Request method failure captured: Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 HTTP/1.1 Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi3_8JBzH7zE3VImwhDH0BmLNzSG7S6QMJeZem0LIi4GCY5sSd1pFpt8zl0KMY6tCPl-jjolsfdN9H9D8KF2nybalFuYn89Rg2j6xLnhdKT57myeXgnxp_VEBdT01-60FTcbABUtHpkAarkpXENvMdLRUmG-jMOOZD7uY4GF1duJKlQwQ Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f953d00da52543fda852b2d118613fa8 Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f953d00da52543fda852b2d118613fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f953d00da52543fda852b2d118613fa8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f953d00da52543fda852b2d118613fa8"}]}] Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f953d00da52543fda852b2d118613fa8 Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestVolumeBootPattern-1197026172 Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestVolumeBootPattern-1197026172-project Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: ac9553617f2440a68e33b82650206cae Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestVolumeBootPattern-1197026172-project Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'bb9a1be8-b8e7-4be1-897f-02e3a877deb8'} Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:01.356136 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:01.360952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:01.360952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:01.360952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:01.360952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:01:01.360952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:01:01.360952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. Jul 26 15:01:01.360952 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:01.360952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50d76d29-502f-4aab-ade3-545edba87933 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Returning 404 to user: Instance bb9a1be8-b8e7-4be1-897f-02e3a877deb8 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:01:01.360952 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-50d76d29-502f-4aab-ade3-545edba87933 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8" status: 404 len: 111 microversion: 2.1 time: 0.035320 Jul 26 15:01:01.360952 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3148/6178] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:01 2022] GET /compute/v2.1/servers/bb9a1be8-b8e7-4be1-897f-02e3a877deb8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:01:04.799171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-711b5cbc-1094-492c-a53a-d0e236e56da0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] Calling method '.version_select at 0x7f8799469f70>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:04.805634 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [None req-711b5cbc-1094-492c-a53a-d0e236e56da0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [d2f55996-37e8-4142-99a1-3c8f4d298bbc] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 15:01:05.816768 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [None req-711b5cbc-1094-492c-a53a-d0e236e56da0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] [d2f55996-37e8-4142-99a1-3c8f4d298bbc] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 48832. Jul 26 15:01:05.836116 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-711b5cbc-1094-492c-a53a-d0e236e56da0 tempest-TestVolumeBootPattern-1197026172 tempest-TestVolumeBootPattern-1197026172-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-679082839" status: 202 len: 0 microversion: 2.1 time: 1.040881 Jul 26 15:01:05.836697 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3031/6179] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Jul 26 15:01:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-679082839 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:01:18.698968 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:01:18.699665 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:01:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:01:24.960887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:24.961726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:25.100963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-899884556", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:25.359931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] validate_networks() for None {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:01:25.637986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:01:25.638440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:01:25.638945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:01:25.639898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:01:25.640372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:01:25.649443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:25.649920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:25.650808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:25.651279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:25.668986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Getting quotas for project 9343fe77e9f946e7a09ba5709dfb0dfa. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:01:25.674503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Getting quotas for user fbd46ef0c1cf416bbc0f627ba291f134 and project 9343fe77e9f946e7a09ba5709dfb0dfa. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:01:25.687857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:01:25.690260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:01:25.734295 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6a3af9b9-1ea0-4b8b-92ea-2dd621c12dc9 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779278 Jul 26 15:01:25.735158 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3149/6180] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:01:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:01:25.745154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:25.750023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2b1c1bf5-978e-4724-8086-ee652229ef36 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:25.750654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2b1c1bf5-978e-4724-8086-ee652229ef36 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:25.937613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2b1c1bf5-978e-4724-8086-ee652229ef36 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:25.947784 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2b1c1bf5-978e-4724-8086-ee652229ef36 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1221 microversion: 2.1 time: 0.204462 Jul 26 15:01:25.948381 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3032/6181] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:25 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1221 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:26.970997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b265f616-b9ed-4bf4-ab39-c21ee43a3301 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:26.971641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b265f616-b9ed-4bf4-ab39-c21ee43a3301 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:27.028064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b265f616-b9ed-4bf4-ab39-c21ee43a3301 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:27.035266 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b265f616-b9ed-4bf4-ab39-c21ee43a3301 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1221 microversion: 2.1 time: 0.069698 Jul 26 15:01:27.035835 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3150/6182] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:26 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1221 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:28.057153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7f3a5b60-d53e-4f6b-a76a-76fbf55451bc tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:28.057781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7f3a5b60-d53e-4f6b-a76a-76fbf55451bc tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:28.065240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f3a5b60-d53e-4f6b-a76a-76fbf55451bc tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:28.065698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f3a5b60-d53e-4f6b-a76a-76fbf55451bc tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:28.066480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f3a5b60-d53e-4f6b-a76a-76fbf55451bc tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:28.066970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f3a5b60-d53e-4f6b-a76a-76fbf55451bc tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:28.131741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7f3a5b60-d53e-4f6b-a76a-76fbf55451bc tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:28.139322 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7f3a5b60-d53e-4f6b-a76a-76fbf55451bc tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1225 microversion: 2.1 time: 0.085999 Jul 26 15:01:28.140062 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3033/6183] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:28 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:01:29.159995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3b04a3ab-fe36-4474-b668-dea41afbb703 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:29.160442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3b04a3ab-fe36-4474-b668-dea41afbb703 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:29.167012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b04a3ab-fe36-4474-b668-dea41afbb703 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:29.167500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b04a3ab-fe36-4474-b668-dea41afbb703 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:29.168345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b04a3ab-fe36-4474-b668-dea41afbb703 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:29.168817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b04a3ab-fe36-4474-b668-dea41afbb703 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:29.239618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3b04a3ab-fe36-4474-b668-dea41afbb703 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:29.247398 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3b04a3ab-fe36-4474-b668-dea41afbb703 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1279 microversion: 2.1 time: 0.092107 Jul 26 15:01:29.247908 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3151/6184] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:29 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:30.269419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8bb84f32-63c2-48b6-9955-ecf28df8bab3 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:30.270183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8bb84f32-63c2-48b6-9955-ecf28df8bab3 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:30.277934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bb84f32-63c2-48b6-9955-ecf28df8bab3 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:30.278407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bb84f32-63c2-48b6-9955-ecf28df8bab3 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:30.279483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bb84f32-63c2-48b6-9955-ecf28df8bab3 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:30.280617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bb84f32-63c2-48b6-9955-ecf28df8bab3 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:30.463550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6e25ea28-223c-4dd2-ba50-8fe6c886ccd0 req-1004f694-b075-416a-accd-17d0b399b852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f80914-e7f3-4193-95e8-4ab52d65e7eb", "tag": "35ba91fa-57f6-4c87-9a8f-b3f3d54cd66f"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:30.481325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6e25ea28-223c-4dd2-ba50-8fe6c886ccd0 req-1004f694-b075-416a-accd-17d0b399b852 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:30.481791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6e25ea28-223c-4dd2-ba50-8fe6c886ccd0 req-1004f694-b075-416a-accd-17d0b399b852 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:30.499348 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6e25ea28-223c-4dd2-ba50-8fe6c886ccd0 req-1004f694-b075-416a-accd-17d0b399b852 service nova] Creating event network-changed:35ba91fa-57f6-4c87-9a8f-b3f3d54cd66f for instance d8f80914-e7f3-4193-95e8-4ab52d65e7eb on n-h2-833090-9 Jul 26 15:01:30.504944 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6e25ea28-223c-4dd2-ba50-8fe6c886ccd0 req-1004f694-b075-416a-accd-17d0b399b852 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122436 Jul 26 15:01:30.506218 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3152/6185] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:30.576205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8bb84f32-63c2-48b6-9955-ecf28df8bab3 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:30.584007 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8bb84f32-63c2-48b6-9955-ecf28df8bab3 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1321 microversion: 2.1 time: 0.318761 Jul 26 15:01:30.584593 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3034/6186] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:30 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:31.606983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-308eed3a-ca3f-4ec4-a915-82586bea6942 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:31.607719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-308eed3a-ca3f-4ec4-a915-82586bea6942 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:31.614572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-308eed3a-ca3f-4ec4-a915-82586bea6942 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:31.615049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-308eed3a-ca3f-4ec4-a915-82586bea6942 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:31.615863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-308eed3a-ca3f-4ec4-a915-82586bea6942 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:31.616368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-308eed3a-ca3f-4ec4-a915-82586bea6942 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:31.757726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-308eed3a-ca3f-4ec4-a915-82586bea6942 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:31.767418 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-308eed3a-ca3f-4ec4-a915-82586bea6942 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1321 microversion: 2.1 time: 0.165540 Jul 26 15:01:31.768028 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3153/6187] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:31 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:32.788649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4cc6e570-16cc-44b1-8035-19d323f4037b tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:32.789274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4cc6e570-16cc-44b1-8035-19d323f4037b tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:32.796728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4cc6e570-16cc-44b1-8035-19d323f4037b tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:32.797184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4cc6e570-16cc-44b1-8035-19d323f4037b tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:32.797955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4cc6e570-16cc-44b1-8035-19d323f4037b tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:32.798395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4cc6e570-16cc-44b1-8035-19d323f4037b tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:32.932370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4cc6e570-16cc-44b1-8035-19d323f4037b tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:32.942370 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4cc6e570-16cc-44b1-8035-19d323f4037b tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1321 microversion: 2.1 time: 0.157545 Jul 26 15:01:32.944322 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3035/6188] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:32 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:33.962812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-adf6915c-0fee-4113-9ed4-ecc049922ba2 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:33.963437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-adf6915c-0fee-4113-9ed4-ecc049922ba2 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:33.971132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf6915c-0fee-4113-9ed4-ecc049922ba2 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:33.971601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf6915c-0fee-4113-9ed4-ecc049922ba2 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:33.972410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf6915c-0fee-4113-9ed4-ecc049922ba2 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:33.972868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-adf6915c-0fee-4113-9ed4-ecc049922ba2 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:34.101863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-adf6915c-0fee-4113-9ed4-ecc049922ba2 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:34.110725 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-adf6915c-0fee-4113-9ed4-ecc049922ba2 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1321 microversion: 2.1 time: 0.151813 Jul 26 15:01:34.111300 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3154/6189] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:33 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:35.131814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1dfecc56-2c54-4105-b047-293868ad5689 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:35.132617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1dfecc56-2c54-4105-b047-293868ad5689 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:35.143037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dfecc56-2c54-4105-b047-293868ad5689 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:35.143547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dfecc56-2c54-4105-b047-293868ad5689 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:35.144994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dfecc56-2c54-4105-b047-293868ad5689 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:35.145202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1dfecc56-2c54-4105-b047-293868ad5689 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:35.215206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-efe9fa75-4806-490e-b3f8-0b8e29f7d9f6 req-0639bbbe-5b5f-4031-af76-f9a60b718897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f80914-e7f3-4193-95e8-4ab52d65e7eb", "name": "network-vif-plugged", "status": "completed", "tag": "35ba91fa-57f6-4c87-9a8f-b3f3d54cd66f"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:35.225232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-efe9fa75-4806-490e-b3f8-0b8e29f7d9f6 req-0639bbbe-5b5f-4031-af76-f9a60b718897 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:35.226296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-efe9fa75-4806-490e-b3f8-0b8e29f7d9f6 req-0639bbbe-5b5f-4031-af76-f9a60b718897 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:35.238313 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-efe9fa75-4806-490e-b3f8-0b8e29f7d9f6 req-0639bbbe-5b5f-4031-af76-f9a60b718897 service nova] Creating event network-vif-plugged:35ba91fa-57f6-4c87-9a8f-b3f3d54cd66f for instance d8f80914-e7f3-4193-95e8-4ab52d65e7eb on n-h2-833090-9 Jul 26 15:01:35.243516 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-efe9fa75-4806-490e-b3f8-0b8e29f7d9f6 req-0639bbbe-5b5f-4031-af76-f9a60b718897 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089359 Jul 26 15:01:35.244249 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3155/6190] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:35.293660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1dfecc56-2c54-4105-b047-293868ad5689 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:35.301942 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1dfecc56-2c54-4105-b047-293868ad5689 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1321 microversion: 2.1 time: 0.174950 Jul 26 15:01:35.302519 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3036/6191] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:35 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:01:36.320358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:36.325350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-544d20a5-dcf2-4580-bf05-52bf31c2dd4d tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:36.326125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-544d20a5-dcf2-4580-bf05-52bf31c2dd4d tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:36.333031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-544d20a5-dcf2-4580-bf05-52bf31c2dd4d tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:36.333674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-544d20a5-dcf2-4580-bf05-52bf31c2dd4d tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:36.334738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-544d20a5-dcf2-4580-bf05-52bf31c2dd4d tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:36.335530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-544d20a5-dcf2-4580-bf05-52bf31c2dd4d tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:36.494634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-544d20a5-dcf2-4580-bf05-52bf31c2dd4d tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:36.503651 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-544d20a5-dcf2-4580-bf05-52bf31c2dd4d tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1321 microversion: 2.1 time: 0.184386 Jul 26 15:01:36.504498 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3156/6192] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:36 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:37.525627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-00c69544-3e66-4135-a9a3-70cb1920b1e7 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:37.526247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-00c69544-3e66-4135-a9a3-70cb1920b1e7 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:37.528181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:37.534860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00c69544-3e66-4135-a9a3-70cb1920b1e7 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:37.535319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00c69544-3e66-4135-a9a3-70cb1920b1e7 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:37.536140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00c69544-3e66-4135-a9a3-70cb1920b1e7 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:37.536576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-00c69544-3e66-4135-a9a3-70cb1920b1e7 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:37.673128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-00c69544-3e66-4135-a9a3-70cb1920b1e7 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:37.680866 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-00c69544-3e66-4135-a9a3-70cb1920b1e7 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1471 microversion: 2.1 time: 0.159124 Jul 26 15:01:37.681382 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3037/6193] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:37 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:37.705163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:37.758927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a1a3da9d-040a-4f64-a345-1bfb1a696c01 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Calling method '.version_select at 0x7f87993d6310>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:37.823984 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a1a3da9d-040a-4f64-a345-1bfb1a696c01 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/c9f76df7cdc54234a5b0648035b5b58e" status: 200 len: 371 microversion: 2.1 time: 0.123740 Jul 26 15:01:37.824579 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3157/6194] 10.222.0.70 () {58 vars in 1242 bytes} [Tue Jul 26 15:01:37 2022] GET /compute/v2.1/os-quota-sets/c9f76df7cdc54234a5b0648035b5b58e => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:37.836049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d87c73e6-530d-4d90-bbb2-4249ff97f577 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-218806766", "id": 1549654344, "os-flavor-access:is_public": "True"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:37.838970 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:01:37.838970 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 15:01:37.854003 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d87c73e6-530d-4d90-bbb2-4249ff97f577 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.021698 Jul 26 15:01:37.854586 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3038/6195] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:01:37 2022] POST /compute/v2.1/flavors => generated 437 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:37.867468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1549654344"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:37.869847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:37.877959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:37.878432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:37.879270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:37.879721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.019812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b1aadec1ce7c476ca171e86db16ecf13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f76df7cdc54234a5b0648035b5b58e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:38.026842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-218806766 {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 15:01:38.033876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:38.034351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.035176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:38.035640 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.056663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Getting quotas for project 9343fe77e9f946e7a09ba5709dfb0dfa. Resources: {'ram', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:01:38.062398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Getting quotas for user fbd46ef0c1cf416bbc0f627ba291f134 and project 9343fe77e9f946e7a09ba5709dfb0dfa. Resources: {'ram', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:01:38.074691 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.compute.api [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] ram quota exceeded for c9f76df7cdc54234a5b0648035b5b58e, tried to resize instance. Jul 26 15:01:38.075256 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Request method failure captured: Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb/action HTTP/1.1 Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 39 Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AHE-zsPCOCfK7bFRoprnVO9XrTfj_HHAb4DK0BYaGxB6y6zcnND0zhapaz1I5pWSjySI3IaC-DvznYaHl9j-f135iRcoCXIwwUoCcvvcSPFqwdLftxERloB933nDDcbc8sqLSmGYdctWOnZ5yIoP6G1gr9U4IMqdsj4mRA4ZRDm9oc Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: c9f76df7cdc54234a5b0648035b5b58e Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-541781668 Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader,admin Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader,admin Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c9f76df7cdc54234a5b0648035b5b58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c9f76df7cdc54234a5b0648035b5b58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c9f76df7cdc54234a5b0648035b5b58e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c9f76df7cdc54234a5b0648035b5b58e"}]}] Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersAdminNegativeTestJSON-541781668 Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: c9f76df7cdc54234a5b0648035b5b58e Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-541781668 Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersAdminNegativeTestJSON-541781668-project-admin Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b1aadec1ce7c476ca171e86db16ecf13 Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersAdminNegativeTestJSON-541781668-project-admin Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: {"resize": {"flavorRef": "1549654344"}} Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd8f80914-e7f3-4193-95e8-4ab52d65e7eb', 'body': {'resize': {'flavorRef': '1549654344'}}} Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:01:38.077647 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f6ed1ab2-764b-48a0-a3b7-f13fe307708d tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb/action" status: 403 len: 118 microversion: 2.1 time: 0.215580 Jul 26 15:01:38.084254 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3158/6196] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:01:37 2022] POST /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb/action => generated 118 bytes in 217 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:01:38.088347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6e75f1fe-e4ea-4ff2-a398-99fb0c567df3 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:38.089094 n-d-833090-9 devstack@n-api.service[119478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:01:38.089094 n-d-833090-9 devstack@n-api.service[119478]: warnings.warn(msg) Jul 26 15:01:38.106122 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6e75f1fe-e4ea-4ff2-a398-99fb0c567df3 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1549654344" status: 202 len: 0 microversion: 2.1 time: 0.021717 Jul 26 15:01:38.106685 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3039/6197] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 15:01:38 2022] DELETE /compute/v2.1/flavors/1549654344 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:01:38.115226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d84e3146-8c77-43e0-a5b6-4e8e54356126 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:38.135851 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d84e3146-8c77-43e0-a5b6-4e8e54356126 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024155 Jul 26 15:01:38.136457 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3159/6198] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 15:01:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:38.157290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b75b46c0-3837-482d-b642-3fe9c218e037 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Calling method '.version_select at 0x7f8786ccbdc0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:38.230036 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b75b46c0-3837-482d-b642-3fe9c218e037 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/c9f76df7cdc54234a5b0648035b5b58e" status: 200 len: 371 microversion: 2.1 time: 0.077530 Jul 26 15:01:38.230610 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3040/6199] 10.222.0.70 () {58 vars in 1242 bytes} [Tue Jul 26 15:01:38 2022] GET /compute/v2.1/os-quota-sets/c9f76df7cdc54234a5b0648035b5b58e => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:38.242306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8a3e0d73-574f-40e7-9c6d-20261eeaaab4 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-120067392", "id": 1779092792, "os-flavor-access:is_public": "True"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:38.245387 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:01:38.245387 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 15:01:38.260425 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8a3e0d73-574f-40e7-9c6d-20261eeaaab4 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021773 Jul 26 15:01:38.261011 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3160/6200] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:01:38 2022] POST /compute/v2.1/flavors => generated 436 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:38.273261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1779092792"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:38.275639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:38.282502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:38.282962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.283741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:38.284238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.423419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b1aadec1ce7c476ca171e86db16ecf13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f76df7cdc54234a5b0648035b5b58e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:38.431125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-120067392 {{(pid=119478) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 15:01:38.438249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:38.438687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.439479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:38.439912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.460470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Getting quotas for project 9343fe77e9f946e7a09ba5709dfb0dfa. Resources: {'ram', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:01:38.465434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Getting quotas for user fbd46ef0c1cf416bbc0f627ba291f134 and project 9343fe77e9f946e7a09ba5709dfb0dfa. Resources: {'ram', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:01:38.477896 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.compute.api [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] cores quota exceeded for c9f76df7cdc54234a5b0648035b5b58e, tried to resize instance. Jul 26 15:01:38.478431 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Request method failure captured: Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb/action HTTP/1.1 Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 39 Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AHE-zsPCOCfK7bFRoprnVO9XrTfj_HHAb4DK0BYaGxB6y6zcnND0zhapaz1I5pWSjySI3IaC-DvznYaHl9j-f135iRcoCXIwwUoCcvvcSPFqwdLftxERloB933nDDcbc8sqLSmGYdctWOnZ5yIoP6G1gr9U4IMqdsj4mRA4ZRDm9oc Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: c9f76df7cdc54234a5b0648035b5b58e Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-541781668 Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader,admin Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader,admin Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c9f76df7cdc54234a5b0648035b5b58e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c9f76df7cdc54234a5b0648035b5b58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c9f76df7cdc54234a5b0648035b5b58e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c9f76df7cdc54234a5b0648035b5b58e"}]}] Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersAdminNegativeTestJSON-541781668 Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: c9f76df7cdc54234a5b0648035b5b58e Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-541781668 Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersAdminNegativeTestJSON-541781668-project-admin Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b1aadec1ce7c476ca171e86db16ecf13 Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersAdminNegativeTestJSON-541781668-project-admin Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: {"resize": {"flavorRef": "1779092792"}} Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd8f80914-e7f3-4193-95e8-4ab52d65e7eb', 'body': {'resize': {'flavorRef': '1779092792'}}} Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:01:38.480437 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ee83cac5-d86c-4212-bf35-332159da9169 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb/action" status: 403 len: 113 microversion: 2.1 time: 0.212533 Jul 26 15:01:38.486184 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3041/6201] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:01:38 2022] POST /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb/action => generated 113 bytes in 217 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:01:38.495231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d655bbc0-7def-4cd4-967f-41b2c71f6bdd tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:38.496034 n-d-833090-9 devstack@n-api.service[119479]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 15:01:38.496034 n-d-833090-9 devstack@n-api.service[119479]: warnings.warn(msg) Jul 26 15:01:38.512919 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d655bbc0-7def-4cd4-967f-41b2c71f6bdd tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1779092792" status: 202 len: 0 microversion: 2.1 time: 0.021479 Jul 26 15:01:38.513480 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3161/6202] 10.222.0.70 () {58 vars in 1161 bytes} [Tue Jul 26 15:01:38 2022] DELETE /compute/v2.1/flavors/1779092792 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:01:38.522307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d2687a68-d211-4778-a4ec-34cd4d5b6162 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:38.542595 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d2687a68-d211-4778-a4ec-34cd4d5b6162 tempest-ServersAdminNegativeTestJSON-541781668 tempest-ServersAdminNegativeTestJSON-541781668-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024199 Jul 26 15:01:38.543216 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3042/6203] 10.222.0.70 () {58 vars in 1146 bytes} [Tue Jul 26 15:01:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:38.564108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6c2e496b-ea2d-41d9-9d7a-48289a028941 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:38.564628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6c2e496b-ea2d-41d9-9d7a-48289a028941 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:38.570756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c2e496b-ea2d-41d9-9d7a-48289a028941 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:38.571229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c2e496b-ea2d-41d9-9d7a-48289a028941 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.572045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c2e496b-ea2d-41d9-9d7a-48289a028941 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:38.572509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c2e496b-ea2d-41d9-9d7a-48289a028941 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.598858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6c2e496b-ea2d-41d9-9d7a-48289a028941 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:01:38.679829 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6c2e496b-ea2d-41d9-9d7a-48289a028941 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 204 len: 0 microversion: 2.1 time: 0.120368 Jul 26 15:01:38.680796 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3162/6204] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:01:38 2022] DELETE /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:01:38.689440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7a32fac3-dd64-4150-9fca-f9b0607eef63 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:38.690057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7a32fac3-dd64-4150-9fca-f9b0607eef63 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:38.697317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a32fac3-dd64-4150-9fca-f9b0607eef63 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:38.697759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a32fac3-dd64-4150-9fca-f9b0607eef63 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.698543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a32fac3-dd64-4150-9fca-f9b0607eef63 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:38.698983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a32fac3-dd64-4150-9fca-f9b0607eef63 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.842965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7a32fac3-dd64-4150-9fca-f9b0607eef63 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:38.850795 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7a32fac3-dd64-4150-9fca-f9b0607eef63 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1477 microversion: 2.1 time: 0.165518 Jul 26 15:01:38.851386 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3043/6205] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:38 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:39.877689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4c2d0476-7554-4d46-aabd-927e7aabc485 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:39.878451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4c2d0476-7554-4d46-aabd-927e7aabc485 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:39.885260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c2d0476-7554-4d46-aabd-927e7aabc485 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:39.885733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c2d0476-7554-4d46-aabd-927e7aabc485 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:39.886541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c2d0476-7554-4d46-aabd-927e7aabc485 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:39.886992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4c2d0476-7554-4d46-aabd-927e7aabc485 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:40.322478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4c2d0476-7554-4d46-aabd-927e7aabc485 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd46ef0c1cf416bbc0f627ba291f134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9343fe77e9f946e7a09ba5709dfb0dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:40.331184 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4c2d0476-7554-4d46-aabd-927e7aabc485 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 200 len: 1477 microversion: 2.1 time: 0.458826 Jul 26 15:01:40.332522 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3163/6206] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:39 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 1477 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:40.761483 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c4c76ffa-f501-4417-b9d6-f940b7308609 req-7d2141ce-f3c4-43c2-b2b1-ea8c01e64bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f80914-e7f3-4193-95e8-4ab52d65e7eb", "name": "network-vif-deleted", "tag": "35ba91fa-57f6-4c87-9a8f-b3f3d54cd66f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:40.775133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c4c76ffa-f501-4417-b9d6-f940b7308609 req-7d2141ce-f3c4-43c2-b2b1-ea8c01e64bad service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:40.775593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c4c76ffa-f501-4417-b9d6-f940b7308609 req-7d2141ce-f3c4-43c2-b2b1-ea8c01e64bad service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:40.788320 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c4c76ffa-f501-4417-b9d6-f940b7308609 req-7d2141ce-f3c4-43c2-b2b1-ea8c01e64bad service nova] Creating event network-vif-deleted:35ba91fa-57f6-4c87-9a8f-b3f3d54cd66f for instance d8f80914-e7f3-4193-95e8-4ab52d65e7eb on n-h2-833090-9 Jul 26 15:01:40.794003 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c4c76ffa-f501-4417-b9d6-f940b7308609 req-7d2141ce-f3c4-43c2-b2b1-ea8c01e64bad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036202 Jul 26 15:01:40.794628 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3044/6207] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:41.356757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a51b6f08-df81-49ca-b4c2-df1e4cfe5599 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:41.359380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a51b6f08-df81-49ca-b4c2-df1e4cfe5599 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] [instance: d8f80914-e7f3-4193-95e8-4ab52d65e7eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:41.372778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a51b6f08-df81-49ca-b4c2-df1e4cfe5599 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:41.373529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a51b6f08-df81-49ca-b4c2-df1e4cfe5599 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:41.375687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a51b6f08-df81-49ca-b4c2-df1e4cfe5599 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:41.376408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a51b6f08-df81-49ca-b4c2-df1e4cfe5599 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:41.392485 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-a51b6f08-df81-49ca-b4c2-df1e4cfe5599 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] HTTP exception thrown: Instance d8f80914-e7f3-4193-95e8-4ab52d65e7eb could not be found. Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a51b6f08-df81-49ca-b4c2-df1e4cfe5599 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Request method failure captured: Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb HTTP/1.1 Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AHEP1LwvHtyY_NgKESai5x33rjvdtvqJhztLGDLIiUxVznoOj1lKz6jz4xYyiJjwx0y17D0slIahp9tiVVOvoVpRuX6sBj2ZtxaMVSIH1EmktSo1uWEySQTDCR1QSO8WT_wGYzF3Nv0ymBdIiHlFfWjWsZJR8ncf-J90AQqGmRTxT0 Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 9343fe77e9f946e7a09ba5709dfb0dfa Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1057201164 Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9343fe77e9f946e7a09ba5709dfb0dfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9343fe77e9f946e7a09ba5709dfb0dfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9343fe77e9f946e7a09ba5709dfb0dfa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9343fe77e9f946e7a09ba5709dfb0dfa"}]}] Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1057201164 Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 9343fe77e9f946e7a09ba5709dfb0dfa Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1057201164 Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersAdminNegativeTestJSON-1057201164-project Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: fbd46ef0c1cf416bbc0f627ba291f134 Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1057201164-project Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d8f80914-e7f3-4193-95e8-4ab52d65e7eb could not be found. Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd8f80914-e7f3-4193-95e8-4ab52d65e7eb'} Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f80914-e7f3-4193-95e8-4ab52d65e7eb could not be found. Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f80914-e7f3-4193-95e8-4ab52d65e7eb could not be found. Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:41.394175 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f80914-e7f3-4193-95e8-4ab52d65e7eb could not be found. Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a51b6f08-df81-49ca-b4c2-df1e4cfe5599 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] Returning 404 to user: Instance d8f80914-e7f3-4193-95e8-4ab52d65e7eb could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a51b6f08-df81-49ca-b4c2-df1e4cfe5599 tempest-ServersAdminNegativeTestJSON-1057201164 tempest-ServersAdminNegativeTestJSON-1057201164-project] 10.222.0.70 "GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb" status: 404 len: 111 microversion: 2.1 time: 0.046027 Jul 26 15:01:41.399859 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3164/6208] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:41 2022] GET /compute/v2.1/servers/d8f80914-e7f3-4193-95e8-4ab52d65e7eb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:01:47.916535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1496655627", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "c6ac25d5-2728-4685-8782-7049992f3582"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:47.970127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] validate_networks() for [('c6ac25d5-2728-4685-8782-7049992f3582', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:01:48.222673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:48.450390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:48.502872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:01:48.503397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:01:48.503976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:01:48.504713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:01:48.505092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:01:48.516240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:48.516765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:48.517634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:48.518140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:48.537319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Getting quotas for project 4432968359bd4a0c86c3a202695d8ff0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:01:48.543652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Getting quotas for user 0d9d69e165c844b780dc22ed005342cc and project 4432968359bd4a0c86c3a202695d8ff0. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:01:48.557239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:01:48.559607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:01:48.607589 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e61d58ec-3d9a-4385-9545-99d03d9ed74c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807260 Jul 26 15:01:48.614210 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3045/6209] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:01:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:01:48.619450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ea3ca64-0eb4-4f0c-8603-40219dbb15a9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:48.620134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5ea3ca64-0eb4-4f0c-8603-40219dbb15a9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:48.629417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:48.630272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:48.699103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5ea3ca64-0eb4-4f0c-8603-40219dbb15a9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:48.706987 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ea3ca64-0eb4-4f0c-8603-40219dbb15a9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1215 microversion: 2.1 time: 0.091039 Jul 26 15:01:48.707753 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3165/6210] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:48 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:49.728407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e2ea845d-b0ad-4476-b567-30c945db6deb tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:49.729024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e2ea845d-b0ad-4476-b567-30c945db6deb tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:49.752527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2ea845d-b0ad-4476-b567-30c945db6deb tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:49.753254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2ea845d-b0ad-4476-b567-30c945db6deb tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:49.754405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2ea845d-b0ad-4476-b567-30c945db6deb tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:49.755027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e2ea845d-b0ad-4476-b567-30c945db6deb tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:49.836852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e2ea845d-b0ad-4476-b567-30c945db6deb tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:49.846936 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e2ea845d-b0ad-4476-b567-30c945db6deb tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1275 microversion: 2.1 time: 0.123430 Jul 26 15:01:49.848203 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3046/6211] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:49 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1275 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:50.870898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-30a123fb-6ed5-481c-81e0-1ff3ab3b27db tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:50.871542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-30a123fb-6ed5-481c-81e0-1ff3ab3b27db tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:50.881102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30a123fb-6ed5-481c-81e0-1ff3ab3b27db tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:50.881890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30a123fb-6ed5-481c-81e0-1ff3ab3b27db tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:50.882722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30a123fb-6ed5-481c-81e0-1ff3ab3b27db tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:50.883194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-30a123fb-6ed5-481c-81e0-1ff3ab3b27db tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:51.122996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-30a123fb-6ed5-481c-81e0-1ff3ab3b27db tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:51.136728 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-30a123fb-6ed5-481c-81e0-1ff3ab3b27db tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1315 microversion: 2.1 time: 0.269986 Jul 26 15:01:51.142714 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3166/6212] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:50 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:51.316177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d589bf15-d22d-4891-a150-dbd833ba8a63 req-7ce1d6bb-82f9-4cee-bd0d-9e9230b79f10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1bff9a-b4d8-4cd4-85e9-489f9a399fa4", "tag": "2163856b-c2a5-4d95-9eef-87bf37c25012"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:51.333200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d589bf15-d22d-4891-a150-dbd833ba8a63 req-7ce1d6bb-82f9-4cee-bd0d-9e9230b79f10 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:51.333789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d589bf15-d22d-4891-a150-dbd833ba8a63 req-7ce1d6bb-82f9-4cee-bd0d-9e9230b79f10 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:51.348518 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d589bf15-d22d-4891-a150-dbd833ba8a63 req-7ce1d6bb-82f9-4cee-bd0d-9e9230b79f10 service nova] Creating event network-changed:2163856b-c2a5-4d95-9eef-87bf37c25012 for instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 on n-h2-833090-9 Jul 26 15:01:51.355195 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d589bf15-d22d-4891-a150-dbd833ba8a63 req-7ce1d6bb-82f9-4cee-bd0d-9e9230b79f10 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047983 Jul 26 15:01:51.355823 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3047/6213] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:52.165815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b1dc565d-cb55-423d-ae5b-4739ad3cec3f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:52.166561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b1dc565d-cb55-423d-ae5b-4739ad3cec3f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:52.174177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1dc565d-cb55-423d-ae5b-4739ad3cec3f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:52.174666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1dc565d-cb55-423d-ae5b-4739ad3cec3f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:52.175523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1dc565d-cb55-423d-ae5b-4739ad3cec3f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:52.176398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1dc565d-cb55-423d-ae5b-4739ad3cec3f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:52.320483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1dc565d-cb55-423d-ae5b-4739ad3cec3f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:52.329219 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b1dc565d-cb55-423d-ae5b-4739ad3cec3f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1315 microversion: 2.1 time: 0.167331 Jul 26 15:01:52.329826 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3167/6214] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:52 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:53.352611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-72a929fd-72cd-48d7-9858-21e86859495c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:53.353346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-72a929fd-72cd-48d7-9858-21e86859495c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:53.360319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-72a929fd-72cd-48d7-9858-21e86859495c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:53.360772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-72a929fd-72cd-48d7-9858-21e86859495c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:53.361541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-72a929fd-72cd-48d7-9858-21e86859495c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:53.361983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-72a929fd-72cd-48d7-9858-21e86859495c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:53.521973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-72a929fd-72cd-48d7-9858-21e86859495c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:53.530876 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-72a929fd-72cd-48d7-9858-21e86859495c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1315 microversion: 2.1 time: 0.183019 Jul 26 15:01:53.531477 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3048/6215] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:53 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:54.552999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-09ee335e-0065-40d8-94c7-9ce29fcfd49d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:54.553642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-09ee335e-0065-40d8-94c7-9ce29fcfd49d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:54.560670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09ee335e-0065-40d8-94c7-9ce29fcfd49d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:54.561174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09ee335e-0065-40d8-94c7-9ce29fcfd49d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:54.562428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09ee335e-0065-40d8-94c7-9ce29fcfd49d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:54.562890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-09ee335e-0065-40d8-94c7-9ce29fcfd49d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:54.710768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-09ee335e-0065-40d8-94c7-9ce29fcfd49d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:54.719970 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-09ee335e-0065-40d8-94c7-9ce29fcfd49d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1315 microversion: 2.1 time: 0.170441 Jul 26 15:01:54.720932 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3168/6216] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:54 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:55.746179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9570794c-0e2f-4dd1-b8d4-c949ca1fd70c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:55.746816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9570794c-0e2f-4dd1-b8d4-c949ca1fd70c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:55.754699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9570794c-0e2f-4dd1-b8d4-c949ca1fd70c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:55.755150 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9570794c-0e2f-4dd1-b8d4-c949ca1fd70c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:55.756055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9570794c-0e2f-4dd1-b8d4-c949ca1fd70c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:55.756496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9570794c-0e2f-4dd1-b8d4-c949ca1fd70c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:55.759393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=68 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:55.899873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9570794c-0e2f-4dd1-b8d4-c949ca1fd70c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:55.907713 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9570794c-0e2f-4dd1-b8d4-c949ca1fd70c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1315 microversion: 2.1 time: 0.165639 Jul 26 15:01:55.908354 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3049/6217] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:55 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:56.928470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ce9f896-f92d-447d-8ff8-c50412aceaf5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:56.929107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1ce9f896-f92d-447d-8ff8-c50412aceaf5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:56.931819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:56.939860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ce9f896-f92d-447d-8ff8-c50412aceaf5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:56.940365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ce9f896-f92d-447d-8ff8-c50412aceaf5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:56.941164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ce9f896-f92d-447d-8ff8-c50412aceaf5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:56.941676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ce9f896-f92d-447d-8ff8-c50412aceaf5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:56.946180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:57.091346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ce9f896-f92d-447d-8ff8-c50412aceaf5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:57.099483 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ce9f896-f92d-447d-8ff8-c50412aceaf5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1315 microversion: 2.1 time: 0.174865 Jul 26 15:01:57.100007 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3169/6218] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:56 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:57.174088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b0281aa3-4c17-4392-a0ae-72af05e3f0e4 req-1395d7f5-6be2-4b09-abfb-44ba96d88f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1bff9a-b4d8-4cd4-85e9-489f9a399fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2163856b-c2a5-4d95-9eef-87bf37c25012"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:57.180177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:57.187502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b0281aa3-4c17-4392-a0ae-72af05e3f0e4 req-1395d7f5-6be2-4b09-abfb-44ba96d88f97 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:57.187995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b0281aa3-4c17-4392-a0ae-72af05e3f0e4 req-1395d7f5-6be2-4b09-abfb-44ba96d88f97 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:57.209674 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b0281aa3-4c17-4392-a0ae-72af05e3f0e4 req-1395d7f5-6be2-4b09-abfb-44ba96d88f97 service nova] Creating event network-vif-plugged:2163856b-c2a5-4d95-9eef-87bf37c25012 for instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 on n-h2-833090-9 Jul 26 15:01:57.213358 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b0281aa3-4c17-4392-a0ae-72af05e3f0e4 req-1395d7f5-6be2-4b09-abfb-44ba96d88f97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050479 Jul 26 15:01:57.215786 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3050/6219] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:58.122987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58ed9f36-bbdb-4e01-ac13-b0ad1d64d65a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:58.124413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-58ed9f36-bbdb-4e01-ac13-b0ad1d64d65a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:58.133556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58ed9f36-bbdb-4e01-ac13-b0ad1d64d65a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:58.134117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58ed9f36-bbdb-4e01-ac13-b0ad1d64d65a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:58.135448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58ed9f36-bbdb-4e01-ac13-b0ad1d64d65a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:58.136207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58ed9f36-bbdb-4e01-ac13-b0ad1d64d65a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:58.308953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-58ed9f36-bbdb-4e01-ac13-b0ad1d64d65a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:58.318711 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-58ed9f36-bbdb-4e01-ac13-b0ad1d64d65a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1315 microversion: 2.1 time: 0.200307 Jul 26 15:01:58.319438 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3170/6220] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:58 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:59.339316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:59.340021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:59.344814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aed9463c-ba31-43ff-a249-e571d4083077 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:59.345531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aed9463c-ba31-43ff-a249-e571d4083077 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:59.352875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aed9463c-ba31-43ff-a249-e571d4083077 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:59.353339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aed9463c-ba31-43ff-a249-e571d4083077 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:59.354120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aed9463c-ba31-43ff-a249-e571d4083077 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:59.354561 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aed9463c-ba31-43ff-a249-e571d4083077 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:59.498285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aed9463c-ba31-43ff-a249-e571d4083077 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:59.506816 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aed9463c-ba31-43ff-a249-e571d4083077 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1502 microversion: 2.1 time: 0.169463 Jul 26 15:01:59.507401 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3051/6221] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:59 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:01:59.528808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:59.531816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:59.533776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:59.539941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:59.540438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:59.541235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:59.541693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:59.572834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:59.580491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Old instance type m1.heat2, new instance type m1.heat {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 15:01:59.586870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:01:59.587313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:01:59.587807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:01:59.588267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:01:59.588706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:01:59.656376 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9248cf74-02fd-4ddc-87d9-88d0e576b1ac tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "POST /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4/action" status: 202 len: 0 microversion: 2.1 time: 0.130328 Jul 26 15:01:59.657174 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3171/6222] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:01:59 2022] POST /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:01:59.665765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12e1081f-025d-4d76-808a-07860517f349 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:59.666467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-12e1081f-025d-4d76-808a-07860517f349 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:59.674097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12e1081f-025d-4d76-808a-07860517f349 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:59.674829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12e1081f-025d-4d76-808a-07860517f349 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:59.675634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12e1081f-025d-4d76-808a-07860517f349 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:59.676114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12e1081f-025d-4d76-808a-07860517f349 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:59.831669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-12e1081f-025d-4d76-808a-07860517f349 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:59.840730 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-12e1081f-025d-4d76-808a-07860517f349 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1511 microversion: 2.1 time: 0.179038 Jul 26 15:01:59.841322 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3052/6223] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:59 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:02:00.864331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5467c2ab-c71d-4733-b37b-69269deca906 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:00.865019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5467c2ab-c71d-4733-b37b-69269deca906 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:00.872556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5467c2ab-c71d-4733-b37b-69269deca906 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:00.873024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5467c2ab-c71d-4733-b37b-69269deca906 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:00.875002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5467c2ab-c71d-4733-b37b-69269deca906 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:00.875401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5467c2ab-c71d-4733-b37b-69269deca906 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:01.018998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5467c2ab-c71d-4733-b37b-69269deca906 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:01.029156 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5467c2ab-c71d-4733-b37b-69269deca906 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1511 microversion: 2.1 time: 0.168323 Jul 26 15:02:01.030876 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3172/6224] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:00 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:02.061596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-447e81f7-e089-469a-8b61-0a631d049f17 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:02.062567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-447e81f7-e089-469a-8b61-0a631d049f17 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:02.069934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-447e81f7-e089-469a-8b61-0a631d049f17 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:02.070414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-447e81f7-e089-469a-8b61-0a631d049f17 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:02.071192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-447e81f7-e089-469a-8b61-0a631d049f17 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:02.071631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-447e81f7-e089-469a-8b61-0a631d049f17 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:02.203475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-447e81f7-e089-469a-8b61-0a631d049f17 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:02.211285 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-447e81f7-e089-469a-8b61-0a631d049f17 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.157298 Jul 26 15:02:02.211799 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3053/6225] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:02 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:03.234271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00e4cab9-3e65-4508-98f9-737623b40df3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:03.234917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00e4cab9-3e65-4508-98f9-737623b40df3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:03.242020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e4cab9-3e65-4508-98f9-737623b40df3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:03.242498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e4cab9-3e65-4508-98f9-737623b40df3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:03.243290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e4cab9-3e65-4508-98f9-737623b40df3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:03.243770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e4cab9-3e65-4508-98f9-737623b40df3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:03.382670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-00e4cab9-3e65-4508-98f9-737623b40df3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:03.390703 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-00e4cab9-3e65-4508-98f9-737623b40df3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.161107 Jul 26 15:02:03.391405 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3173/6226] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:03 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:04.411497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4b73c9e9-3f98-4eba-b5cc-c13f24bb3d7a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:04.412250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4b73c9e9-3f98-4eba-b5cc-c13f24bb3d7a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:04.419351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b73c9e9-3f98-4eba-b5cc-c13f24bb3d7a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:04.419800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b73c9e9-3f98-4eba-b5cc-c13f24bb3d7a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:04.420691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b73c9e9-3f98-4eba-b5cc-c13f24bb3d7a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:04.421133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b73c9e9-3f98-4eba-b5cc-c13f24bb3d7a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:04.556835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4b73c9e9-3f98-4eba-b5cc-c13f24bb3d7a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:04.564922 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4b73c9e9-3f98-4eba-b5cc-c13f24bb3d7a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.157487 Jul 26 15:02:04.565506 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3054/6227] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:04 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:05.586643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32efcc24-5789-4b65-8dfa-5248ff58644a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:05.587274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32efcc24-5789-4b65-8dfa-5248ff58644a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:05.595110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32efcc24-5789-4b65-8dfa-5248ff58644a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:05.595575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32efcc24-5789-4b65-8dfa-5248ff58644a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:05.596387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32efcc24-5789-4b65-8dfa-5248ff58644a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:05.596837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32efcc24-5789-4b65-8dfa-5248ff58644a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:05.741104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32efcc24-5789-4b65-8dfa-5248ff58644a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:05.750006 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-32efcc24-5789-4b65-8dfa-5248ff58644a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.167205 Jul 26 15:02:05.750600 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3174/6228] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:05 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:06.774256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b2ea6148-d68f-49a0-927d-3c344c4f0ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:06.774837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b2ea6148-d68f-49a0-927d-3c344c4f0ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:06.785321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2ea6148-d68f-49a0-927d-3c344c4f0ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:06.785775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2ea6148-d68f-49a0-927d-3c344c4f0ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:06.786557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2ea6148-d68f-49a0-927d-3c344c4f0ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:06.786999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2ea6148-d68f-49a0-927d-3c344c4f0ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:06.928274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b2ea6148-d68f-49a0-927d-3c344c4f0ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:06.938074 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b2ea6148-d68f-49a0-927d-3c344c4f0ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.167834 Jul 26 15:02:06.938665 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3055/6229] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:06 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:07.960895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f6d56d23-39f6-4131-b478-6a644dc23a4b tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:07.961649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f6d56d23-39f6-4131-b478-6a644dc23a4b tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:07.972765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6d56d23-39f6-4131-b478-6a644dc23a4b tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.973309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6d56d23-39f6-4131-b478-6a644dc23a4b tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.974034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6d56d23-39f6-4131-b478-6a644dc23a4b tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.974487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6d56d23-39f6-4131-b478-6a644dc23a4b tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:08.119437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f6d56d23-39f6-4131-b478-6a644dc23a4b tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:08.127428 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f6d56d23-39f6-4131-b478-6a644dc23a4b tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.170595 Jul 26 15:02:08.128048 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3175/6230] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:07 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:09.156735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-43a2abcd-ddb2-4960-94fe-8d90f3782156 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:09.157376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-43a2abcd-ddb2-4960-94fe-8d90f3782156 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:09.165080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a2abcd-ddb2-4960-94fe-8d90f3782156 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:09.165526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a2abcd-ddb2-4960-94fe-8d90f3782156 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:09.166299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a2abcd-ddb2-4960-94fe-8d90f3782156 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:09.166757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a2abcd-ddb2-4960-94fe-8d90f3782156 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:09.305025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43a2abcd-ddb2-4960-94fe-8d90f3782156 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:09.313810 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-43a2abcd-ddb2-4960-94fe-8d90f3782156 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.160943 Jul 26 15:02:09.314386 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3056/6231] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:09 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:10.336341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1dc31fc7-3be3-4cad-bd44-11a861dba51d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:10.336977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1dc31fc7-3be3-4cad-bd44-11a861dba51d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:10.344164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dc31fc7-3be3-4cad-bd44-11a861dba51d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:10.344638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dc31fc7-3be3-4cad-bd44-11a861dba51d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:10.345424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dc31fc7-3be3-4cad-bd44-11a861dba51d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:10.345878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dc31fc7-3be3-4cad-bd44-11a861dba51d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:10.480352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1dc31fc7-3be3-4cad-bd44-11a861dba51d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:10.488404 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1dc31fc7-3be3-4cad-bd44-11a861dba51d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.156310 Jul 26 15:02:10.489094 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3176/6232] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:10 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:11.510002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6dd304b-9b93-42b9-a00b-a8ab458fe76c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:11.510610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6dd304b-9b93-42b9-a00b-a8ab458fe76c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:11.517241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6dd304b-9b93-42b9-a00b-a8ab458fe76c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:11.517688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6dd304b-9b93-42b9-a00b-a8ab458fe76c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:11.518462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6dd304b-9b93-42b9-a00b-a8ab458fe76c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:11.518903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6dd304b-9b93-42b9-a00b-a8ab458fe76c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:11.653424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c6dd304b-9b93-42b9-a00b-a8ab458fe76c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:11.661683 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6dd304b-9b93-42b9-a00b-a8ab458fe76c tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.155492 Jul 26 15:02:11.662290 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3057/6233] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:11 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:12.683344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb87d1fd-f174-4228-88cd-c0363c888884 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:12.683998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cb87d1fd-f174-4228-88cd-c0363c888884 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:12.694322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb87d1fd-f174-4228-88cd-c0363c888884 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:12.694804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb87d1fd-f174-4228-88cd-c0363c888884 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:12.695722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb87d1fd-f174-4228-88cd-c0363c888884 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:12.696172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb87d1fd-f174-4228-88cd-c0363c888884 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:12.845973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cb87d1fd-f174-4228-88cd-c0363c888884 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:12.855595 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cb87d1fd-f174-4228-88cd-c0363c888884 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.176265 Jul 26 15:02:12.856206 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3177/6234] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:12 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:13.887449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-268cb2cd-3d60-478a-a740-3ef7f4a376e9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:13.889004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-268cb2cd-3d60-478a-a740-3ef7f4a376e9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:13.896323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-268cb2cd-3d60-478a-a740-3ef7f4a376e9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:13.896840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-268cb2cd-3d60-478a-a740-3ef7f4a376e9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:13.897624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-268cb2cd-3d60-478a-a740-3ef7f4a376e9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:13.898066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-268cb2cd-3d60-478a-a740-3ef7f4a376e9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:14.032930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-268cb2cd-3d60-478a-a740-3ef7f4a376e9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:14.040646 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-268cb2cd-3d60-478a-a740-3ef7f4a376e9 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.157095 Jul 26 15:02:14.041217 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3058/6235] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:13 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:15.063369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-07edc4cb-2f5e-4bb0-9b25-ee1b6e6cb87a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:15.064013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-07edc4cb-2f5e-4bb0-9b25-ee1b6e6cb87a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:15.071479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07edc4cb-2f5e-4bb0-9b25-ee1b6e6cb87a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:15.071978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07edc4cb-2f5e-4bb0-9b25-ee1b6e6cb87a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:15.072791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07edc4cb-2f5e-4bb0-9b25-ee1b6e6cb87a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:15.073255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07edc4cb-2f5e-4bb0-9b25-ee1b6e6cb87a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:15.209245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-07edc4cb-2f5e-4bb0-9b25-ee1b6e6cb87a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:15.217368 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-07edc4cb-2f5e-4bb0-9b25-ee1b6e6cb87a tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.158692 Jul 26 15:02:15.218015 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3178/6236] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:15 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:16.238160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-825bd6ad-5754-4cde-b3a5-f0f43b248083 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:16.238729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-825bd6ad-5754-4cde-b3a5-f0f43b248083 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:16.245864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-825bd6ad-5754-4cde-b3a5-f0f43b248083 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:16.246323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-825bd6ad-5754-4cde-b3a5-f0f43b248083 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:16.247746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-825bd6ad-5754-4cde-b3a5-f0f43b248083 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:16.248362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-825bd6ad-5754-4cde-b3a5-f0f43b248083 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:16.383466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-825bd6ad-5754-4cde-b3a5-f0f43b248083 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:16.392125 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-825bd6ad-5754-4cde-b3a5-f0f43b248083 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.157938 Jul 26 15:02:16.392698 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3059/6237] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:16 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:17.414246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c16b70c5-a1b1-4f6f-9ea1-57d904b0d928 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:17.414915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c16b70c5-a1b1-4f6f-9ea1-57d904b0d928 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:17.422586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c16b70c5-a1b1-4f6f-9ea1-57d904b0d928 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:17.423080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c16b70c5-a1b1-4f6f-9ea1-57d904b0d928 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:17.424202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c16b70c5-a1b1-4f6f-9ea1-57d904b0d928 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:17.424715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c16b70c5-a1b1-4f6f-9ea1-57d904b0d928 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:17.565283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c16b70c5-a1b1-4f6f-9ea1-57d904b0d928 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:17.572933 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c16b70c5-a1b1-4f6f-9ea1-57d904b0d928 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.163020 Jul 26 15:02:17.573494 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3179/6238] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:17 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:18.594226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3c25c307-e183-4216-b550-5701f49accc1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:18.594822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3c25c307-e183-4216-b550-5701f49accc1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:18.601890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c25c307-e183-4216-b550-5701f49accc1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:18.602344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c25c307-e183-4216-b550-5701f49accc1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:18.603107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c25c307-e183-4216-b550-5701f49accc1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:18.603542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3c25c307-e183-4216-b550-5701f49accc1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:18.740712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3c25c307-e183-4216-b550-5701f49accc1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:18.751848 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3c25c307-e183-4216-b550-5701f49accc1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.161602 Jul 26 15:02:18.752369 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3060/6239] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:18 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:19.773930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1fc3fd4f-2b2d-4fa3-979a-787b3a7dffcf tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:19.774572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1fc3fd4f-2b2d-4fa3-979a-787b3a7dffcf tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:19.782937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fc3fd4f-2b2d-4fa3-979a-787b3a7dffcf tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:19.783418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fc3fd4f-2b2d-4fa3-979a-787b3a7dffcf tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:19.784602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fc3fd4f-2b2d-4fa3-979a-787b3a7dffcf tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:19.785286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1fc3fd4f-2b2d-4fa3-979a-787b3a7dffcf tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:19.931781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1fc3fd4f-2b2d-4fa3-979a-787b3a7dffcf tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:19.941280 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1fc3fd4f-2b2d-4fa3-979a-787b3a7dffcf tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.170968 Jul 26 15:02:19.941545 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3180/6240] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:19 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:20.962446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cf13b1ee-972b-420a-b674-d60bc06fe580 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:20.963076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cf13b1ee-972b-420a-b674-d60bc06fe580 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:20.970799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf13b1ee-972b-420a-b674-d60bc06fe580 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:20.971266 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf13b1ee-972b-420a-b674-d60bc06fe580 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:20.972154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf13b1ee-972b-420a-b674-d60bc06fe580 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:20.972761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf13b1ee-972b-420a-b674-d60bc06fe580 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:21.126864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cf13b1ee-972b-420a-b674-d60bc06fe580 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:21.135604 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cf13b1ee-972b-420a-b674-d60bc06fe580 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.177178 Jul 26 15:02:21.136566 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3061/6241] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:20 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:22.163792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-40759907-d40c-46ad-b138-01e82c3c8d32 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:22.165538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-40759907-d40c-46ad-b138-01e82c3c8d32 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:22.177577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40759907-d40c-46ad-b138-01e82c3c8d32 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:22.178051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40759907-d40c-46ad-b138-01e82c3c8d32 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:22.178863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40759907-d40c-46ad-b138-01e82c3c8d32 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:22.179329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-40759907-d40c-46ad-b138-01e82c3c8d32 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:22.353126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-40759907-d40c-46ad-b138-01e82c3c8d32 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:22.361850 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-40759907-d40c-46ad-b138-01e82c3c8d32 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.204717 Jul 26 15:02:22.362371 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3181/6242] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:22 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:23.397413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2fe6fdfd-e8a1-48c5-91ef-624370666ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:23.398112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2fe6fdfd-e8a1-48c5-91ef-624370666ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:23.408401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2fe6fdfd-e8a1-48c5-91ef-624370666ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:23.408869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2fe6fdfd-e8a1-48c5-91ef-624370666ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:23.409782 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2fe6fdfd-e8a1-48c5-91ef-624370666ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:23.410241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2fe6fdfd-e8a1-48c5-91ef-624370666ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:23.566966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2fe6fdfd-e8a1-48c5-91ef-624370666ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:23.575909 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2fe6fdfd-e8a1-48c5-91ef-624370666ee5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.182644 Jul 26 15:02:23.576518 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3062/6243] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:23 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:02:24.602548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3df8cd71-eee7-4fa7-a07b-6c4f39a63119 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:24.603636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3df8cd71-eee7-4fa7-a07b-6c4f39a63119 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:24.611869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3df8cd71-eee7-4fa7-a07b-6c4f39a63119 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:24.612386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3df8cd71-eee7-4fa7-a07b-6c4f39a63119 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:24.613212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3df8cd71-eee7-4fa7-a07b-6c4f39a63119 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:24.613676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3df8cd71-eee7-4fa7-a07b-6c4f39a63119 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:24.794649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3df8cd71-eee7-4fa7-a07b-6c4f39a63119 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:24.803345 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3df8cd71-eee7-4fa7-a07b-6c4f39a63119 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.207747 Jul 26 15:02:24.804034 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3182/6244] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:24 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:25.831520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2a89ab55-3fe6-4929-bbf2-d934725cb6e5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:25.832476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2a89ab55-3fe6-4929-bbf2-d934725cb6e5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:25.842004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a89ab55-3fe6-4929-bbf2-d934725cb6e5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:25.842463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a89ab55-3fe6-4929-bbf2-d934725cb6e5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:25.843263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a89ab55-3fe6-4929-bbf2-d934725cb6e5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:25.843702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a89ab55-3fe6-4929-bbf2-d934725cb6e5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:25.846773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=80 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:26.010676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2a89ab55-3fe6-4929-bbf2-d934725cb6e5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:26.021625 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2a89ab55-3fe6-4929-bbf2-d934725cb6e5 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.196903 Jul 26 15:02:26.022506 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3063/6245] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:25 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:02:27.047735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-894fc5a2-ad1c-4371-924c-34b644fc1190 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:27.049036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-894fc5a2-ad1c-4371-924c-34b644fc1190 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:27.053850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=32 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:27.063662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-894fc5a2-ad1c-4371-924c-34b644fc1190 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:27.064528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-894fc5a2-ad1c-4371-924c-34b644fc1190 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:27.065918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-894fc5a2-ad1c-4371-924c-34b644fc1190 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:27.067775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-894fc5a2-ad1c-4371-924c-34b644fc1190 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:27.076149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:27.269094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-894fc5a2-ad1c-4371-924c-34b644fc1190 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:27.282208 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-894fc5a2-ad1c-4371-924c-34b644fc1190 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.242171 Jul 26 15:02:27.283172 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3183/6246] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:27 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:28.320535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-640e6484-d311-4211-932f-fb690ec9e82e tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:28.321649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-640e6484-d311-4211-932f-fb690ec9e82e tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:28.327083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=28 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:28.337966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-640e6484-d311-4211-932f-fb690ec9e82e tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:28.338836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-640e6484-d311-4211-932f-fb690ec9e82e tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:28.340495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-640e6484-d311-4211-932f-fb690ec9e82e tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:28.341319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-640e6484-d311-4211-932f-fb690ec9e82e tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:28.559910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-640e6484-d311-4211-932f-fb690ec9e82e tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:28.569033 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-640e6484-d311-4211-932f-fb690ec9e82e tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1516 microversion: 2.1 time: 0.256328 Jul 26 15:02:28.569642 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3064/6247] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:28 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:29.594572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fecc7d2e-7ce3-4bd9-aad3-5e31ff753ae3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:29.596027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fecc7d2e-7ce3-4bd9-aad3-5e31ff753ae3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:29.604895 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fecc7d2e-7ce3-4bd9-aad3-5e31ff753ae3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:29.606274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fecc7d2e-7ce3-4bd9-aad3-5e31ff753ae3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:29.607549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fecc7d2e-7ce3-4bd9-aad3-5e31ff753ae3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:29.608188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fecc7d2e-7ce3-4bd9-aad3-5e31ff753ae3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:29.867016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fecc7d2e-7ce3-4bd9-aad3-5e31ff753ae3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:29.882807 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fecc7d2e-7ce3-4bd9-aad3-5e31ff753ae3 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1515 microversion: 2.1 time: 0.293714 Jul 26 15:02:29.883906 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3184/6248] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:29 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1515 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:30.559530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c052afdd-7d46-4674-ad04-0e354e5016d7 req-11788df9-ac8b-4127-b223-3a66c3c8668a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1bff9a-b4d8-4cd4-85e9-489f9a399fa4", "name": "network-vif-unplugged", "status": "completed", "tag": "2163856b-c2a5-4d95-9eef-87bf37c25012"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:30.571028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c052afdd-7d46-4674-ad04-0e354e5016d7 req-11788df9-ac8b-4127-b223-3a66c3c8668a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:30.571485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c052afdd-7d46-4674-ad04-0e354e5016d7 req-11788df9-ac8b-4127-b223-3a66c3c8668a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:30.585368 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c052afdd-7d46-4674-ad04-0e354e5016d7 req-11788df9-ac8b-4127-b223-3a66c3c8668a service nova] Creating event network-vif-unplugged:2163856b-c2a5-4d95-9eef-87bf37c25012 for instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 on n-h1-833090-9 Jul 26 15:02:30.596170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-c052afdd-7d46-4674-ad04-0e354e5016d7 req-11788df9-ac8b-4127-b223-3a66c3c8668a service nova] Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:02:30.618338 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c052afdd-7d46-4674-ad04-0e354e5016d7 req-11788df9-ac8b-4127-b223-3a66c3c8668a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062346 Jul 26 15:02:30.619686 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3065/6249] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:02:30.923376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3a6c8079-ec55-401a-aaaa-792aabf23d1f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:30.925839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3a6c8079-ec55-401a-aaaa-792aabf23d1f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:30.936362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a6c8079-ec55-401a-aaaa-792aabf23d1f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:30.937127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a6c8079-ec55-401a-aaaa-792aabf23d1f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:30.938158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a6c8079-ec55-401a-aaaa-792aabf23d1f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:30.938908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a6c8079-ec55-401a-aaaa-792aabf23d1f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:31.280395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3a6c8079-ec55-401a-aaaa-792aabf23d1f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:31.295728 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3a6c8079-ec55-401a-aaaa-792aabf23d1f tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1515 microversion: 2.1 time: 0.378872 Jul 26 15:02:31.296939 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3185/6250] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:30 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:32.334583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d488b91c-f1ea-4546-9487-ed0c3e490a64 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:32.335424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d488b91c-f1ea-4546-9487-ed0c3e490a64 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:32.348995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d488b91c-f1ea-4546-9487-ed0c3e490a64 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:32.349590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d488b91c-f1ea-4546-9487-ed0c3e490a64 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:32.350943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d488b91c-f1ea-4546-9487-ed0c3e490a64 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:32.351705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d488b91c-f1ea-4546-9487-ed0c3e490a64 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:32.581744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d488b91c-f1ea-4546-9487-ed0c3e490a64 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:32.595731 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d488b91c-f1ea-4546-9487-ed0c3e490a64 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1513 microversion: 2.1 time: 0.268007 Jul 26 15:02:32.596469 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3066/6251] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:32 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:32.642978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-3c73b3ad-9790-4ae6-b48a-70b4f9168e5c req-5541b614-6f59-4ed4-a008-4f7337e947c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1bff9a-b4d8-4cd4-85e9-489f9a399fa4", "tag": "2163856b-c2a5-4d95-9eef-87bf37c25012"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:32.654068 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3c73b3ad-9790-4ae6-b48a-70b4f9168e5c req-5541b614-6f59-4ed4-a008-4f7337e947c4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:32.654624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3c73b3ad-9790-4ae6-b48a-70b4f9168e5c req-5541b614-6f59-4ed4-a008-4f7337e947c4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:32.670918 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-3c73b3ad-9790-4ae6-b48a-70b4f9168e5c req-5541b614-6f59-4ed4-a008-4f7337e947c4 service nova] Creating event network-changed:2163856b-c2a5-4d95-9eef-87bf37c25012 for instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 on n-h1-833090-9 Jul 26 15:02:32.677825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-3c73b3ad-9790-4ae6-b48a-70b4f9168e5c req-5541b614-6f59-4ed4-a008-4f7337e947c4 service nova] Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:02:32.691606 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-3c73b3ad-9790-4ae6-b48a-70b4f9168e5c req-5541b614-6f59-4ed4-a008-4f7337e947c4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053106 Jul 26 15:02:32.692687 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3186/6252] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:33.631657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-432a5608-f058-4daf-b18d-bdbfef3ba3bd tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:33.632847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-432a5608-f058-4daf-b18d-bdbfef3ba3bd tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:33.646021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-432a5608-f058-4daf-b18d-bdbfef3ba3bd tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:33.647242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-432a5608-f058-4daf-b18d-bdbfef3ba3bd tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:33.648532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-432a5608-f058-4daf-b18d-bdbfef3ba3bd tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:33.649335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-432a5608-f058-4daf-b18d-bdbfef3ba3bd tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:33.990210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-432a5608-f058-4daf-b18d-bdbfef3ba3bd tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:34.003184 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-432a5608-f058-4daf-b18d-bdbfef3ba3bd tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1510 microversion: 2.1 time: 0.378523 Jul 26 15:02:34.004583 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3067/6253] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:33 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1510 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:34.043110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-035026e2-3962-4b5b-8e10-6a0f883a3755 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:34.043912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-035026e2-3962-4b5b-8e10-6a0f883a3755 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:34.054015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-035026e2-3962-4b5b-8e10-6a0f883a3755 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:34.054834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-035026e2-3962-4b5b-8e10-6a0f883a3755 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:34.056282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-035026e2-3962-4b5b-8e10-6a0f883a3755 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:34.057121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-035026e2-3962-4b5b-8e10-6a0f883a3755 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:34.098635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-035026e2-3962-4b5b-8e10-6a0f883a3755 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:02:34.188749 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.compute.api [None req-035026e2-3962-4b5b-8e10-6a0f883a3755 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Found an unconfirmed migration during delete, id: 16, status: finished Jul 26 15:02:36.059152 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-035026e2-3962-4b5b-8e10-6a0f883a3755 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "DELETE /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 204 len: 0 microversion: 2.1 time: 2.022990 Jul 26 15:02:36.061784 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3187/6254] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:02:34 2022] DELETE /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 0 bytes in 2029 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:02:36.072001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bb4c67af-244e-423b-83c9-d4583e67ac5d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:36.072758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bb4c67af-244e-423b-83c9-d4583e67ac5d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:36.080923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb4c67af-244e-423b-83c9-d4583e67ac5d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:36.081383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb4c67af-244e-423b-83c9-d4583e67ac5d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:36.082479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb4c67af-244e-423b-83c9-d4583e67ac5d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:36.082950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bb4c67af-244e-423b-83c9-d4583e67ac5d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:36.249400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bb4c67af-244e-423b-83c9-d4583e67ac5d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:36.258154 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bb4c67af-244e-423b-83c9-d4583e67ac5d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1502 microversion: 2.1 time: 0.190466 Jul 26 15:02:36.258767 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3068/6255] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:36 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:02:37.281840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f804c28e-9b34-498b-b26e-8ea3c2332e55 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:37.282564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f804c28e-9b34-498b-b26e-8ea3c2332e55 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:37.290038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f804c28e-9b34-498b-b26e-8ea3c2332e55 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:37.290518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f804c28e-9b34-498b-b26e-8ea3c2332e55 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:37.291679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f804c28e-9b34-498b-b26e-8ea3c2332e55 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:37.292598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f804c28e-9b34-498b-b26e-8ea3c2332e55 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:37.369206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7856e8a3-f5dd-4b4a-bfb7-b68979c77488 req-9c27aacd-c8db-4a61-a16f-2ba69c9bde1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1bff9a-b4d8-4cd4-85e9-489f9a399fa4", "name": "network-vif-plugged", "status": "completed", "tag": "2163856b-c2a5-4d95-9eef-87bf37c25012"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:37.383182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7856e8a3-f5dd-4b4a-bfb7-b68979c77488 req-9c27aacd-c8db-4a61-a16f-2ba69c9bde1d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:37.383628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7856e8a3-f5dd-4b4a-bfb7-b68979c77488 req-9c27aacd-c8db-4a61-a16f-2ba69c9bde1d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:37.396999 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7856e8a3-f5dd-4b4a-bfb7-b68979c77488 req-9c27aacd-c8db-4a61-a16f-2ba69c9bde1d service nova] Creating event network-vif-plugged:2163856b-c2a5-4d95-9eef-87bf37c25012 for instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 on n-h1-833090-9 Jul 26 15:02:37.402610 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7856e8a3-f5dd-4b4a-bfb7-b68979c77488 req-9c27aacd-c8db-4a61-a16f-2ba69c9bde1d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037145 Jul 26 15:02:37.403806 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3069/6256] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:37.522614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f804c28e-9b34-498b-b26e-8ea3c2332e55 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9d69e165c844b780dc22ed005342cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4432968359bd4a0c86c3a202695d8ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:37.532030 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f804c28e-9b34-498b-b26e-8ea3c2332e55 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 200 len: 1502 microversion: 2.1 time: 0.254485 Jul 26 15:02:37.532653 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3188/6257] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:37 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:38.012300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2f083e60-5e89-4291-9571-127bad3ea825 req-288512a8-8e87-407e-a117-7013278a9419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1bff9a-b4d8-4cd4-85e9-489f9a399fa4", "name": "network-vif-deleted", "tag": "2163856b-c2a5-4d95-9eef-87bf37c25012"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:38.023066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2f083e60-5e89-4291-9571-127bad3ea825 req-288512a8-8e87-407e-a117-7013278a9419 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:38.023514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2f083e60-5e89-4291-9571-127bad3ea825 req-288512a8-8e87-407e-a117-7013278a9419 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:38.042551 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2f083e60-5e89-4291-9571-127bad3ea825 req-288512a8-8e87-407e-a117-7013278a9419 service nova] Creating event network-vif-deleted:2163856b-c2a5-4d95-9eef-87bf37c25012 for instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 on n-h1-833090-9 Jul 26 15:02:38.049340 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2f083e60-5e89-4291-9571-127bad3ea825 req-288512a8-8e87-407e-a117-7013278a9419 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041330 Jul 26 15:02:38.050132 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3070/6258] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:02:38.553936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e072350a-4c70-4808-831d-bd28a31714b0 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:38.554560 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e072350a-4c70-4808-831d-bd28a31714b0 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:38.562657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e072350a-4c70-4808-831d-bd28a31714b0 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:38.563136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e072350a-4c70-4808-831d-bd28a31714b0 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:38.563970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e072350a-4c70-4808-831d-bd28a31714b0 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:38.564434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e072350a-4c70-4808-831d-bd28a31714b0 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:38.582434 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e072350a-4c70-4808-831d-bd28a31714b0 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] HTTP exception thrown: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e072350a-4c70-4808-831d-bd28a31714b0 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Request method failure captured: Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 HTTP/1.1 Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AHbNyzp7EIFlCYZAS_FRL2lKl2FtjiGNWROysj_WHmj0EBSEexxLOBBhuODLe49yHT5n5m9voXBNIOgxvvHRelLts8hGaVqmUGHyn_XmGNFlvSeZ_T-KIJyMNwPx8xnQSB7d58l3jiFciKhRWCpXyUAskfnLMMd-s86MdNKHXjUCdg Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4432968359bd4a0c86c3a202695d8ff0 Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-2040443327 Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4432968359bd4a0c86c3a202695d8ff0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4432968359bd4a0c86c3a202695d8ff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4432968359bd4a0c86c3a202695d8ff0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4432968359bd4a0c86c3a202695d8ff0"}]}] Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-2040443327 Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4432968359bd4a0c86c3a202695d8ff0 Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-2040443327 Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-2040443327-project Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 0d9d69e165c844b780dc22ed005342cc Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-2040443327-project Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'db1bff9a-b4d8-4cd4-85e9-489f9a399fa4'} Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:38.584236 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.589989 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:38.589989 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:38.589989 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:38.589989 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:38.589989 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:38.589989 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.589989 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.589989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e072350a-4c70-4808-831d-bd28a31714b0 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Returning 404 to user: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:38.589989 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e072350a-4c70-4808-831d-bd28a31714b0 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 404 len: 111 microversion: 2.1 time: 0.036044 Jul 26 15:02:38.589989 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3189/6259] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:38 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:02:38.605144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-58c29578-9dd8-4d33-81cd-e7516f52fcd1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:38.605934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-58c29578-9dd8-4d33-81cd-e7516f52fcd1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:38.613978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58c29578-9dd8-4d33-81cd-e7516f52fcd1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:38.613978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58c29578-9dd8-4d33-81cd-e7516f52fcd1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:38.616253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58c29578-9dd8-4d33-81cd-e7516f52fcd1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:38.616253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58c29578-9dd8-4d33-81cd-e7516f52fcd1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:38.630464 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-58c29578-9dd8-4d33-81cd-e7516f52fcd1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] HTTP exception thrown: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-58c29578-9dd8-4d33-81cd-e7516f52fcd1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Request method failure captured: Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 HTTP/1.1 Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AHbNyzp7EIFlCYZAS_FRL2lKl2FtjiGNWROysj_WHmj0EBSEexxLOBBhuODLe49yHT5n5m9voXBNIOgxvvHRelLts8hGaVqmUGHyn_XmGNFlvSeZ_T-KIJyMNwPx8xnQSB7d58l3jiFciKhRWCpXyUAskfnLMMd-s86MdNKHXjUCdg Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 4432968359bd4a0c86c3a202695d8ff0 Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-DeleteServersTestJSON-2040443327 Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4432968359bd4a0c86c3a202695d8ff0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4432968359bd4a0c86c3a202695d8ff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4432968359bd4a0c86c3a202695d8ff0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4432968359bd4a0c86c3a202695d8ff0"}]}] Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-DeleteServersTestJSON-2040443327 Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 4432968359bd4a0c86c3a202695d8ff0 Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-DeleteServersTestJSON-2040443327 Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-DeleteServersTestJSON-2040443327-project Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 0d9d69e165c844b780dc22ed005342cc Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-DeleteServersTestJSON-2040443327-project Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'db1bff9a-b4d8-4cd4-85e9-489f9a399fa4'} Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:02:38.632221 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-58c29578-9dd8-4d33-81cd-e7516f52fcd1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Returning 404 to user: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-58c29578-9dd8-4d33-81cd-e7516f52fcd1 tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "DELETE /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 404 len: 111 microversion: 2.1 time: 0.035142 Jul 26 15:02:38.637745 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3071/6260] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:02:38 2022] DELETE /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:02:38.643738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e57b2ece-ef9c-4add-b47e-83b4fedb053d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:38.644491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e57b2ece-ef9c-4add-b47e-83b4fedb053d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] [instance: db1bff9a-b4d8-4cd4-85e9-489f9a399fa4] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:38.651122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e57b2ece-ef9c-4add-b47e-83b4fedb053d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:38.651736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e57b2ece-ef9c-4add-b47e-83b4fedb053d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:38.652706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e57b2ece-ef9c-4add-b47e-83b4fedb053d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:38.653168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e57b2ece-ef9c-4add-b47e-83b4fedb053d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:38.674714 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-e57b2ece-ef9c-4add-b47e-83b4fedb053d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] HTTP exception thrown: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e57b2ece-ef9c-4add-b47e-83b4fedb053d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Request method failure captured: Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 HTTP/1.1 Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AHbNyzp7EIFlCYZAS_FRL2lKl2FtjiGNWROysj_WHmj0EBSEexxLOBBhuODLe49yHT5n5m9voXBNIOgxvvHRelLts8hGaVqmUGHyn_XmGNFlvSeZ_T-KIJyMNwPx8xnQSB7d58l3jiFciKhRWCpXyUAskfnLMMd-s86MdNKHXjUCdg Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 4432968359bd4a0c86c3a202695d8ff0 Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-DeleteServersTestJSON-2040443327 Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4432968359bd4a0c86c3a202695d8ff0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4432968359bd4a0c86c3a202695d8ff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4432968359bd4a0c86c3a202695d8ff0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4432968359bd4a0c86c3a202695d8ff0"}]}] Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-DeleteServersTestJSON-2040443327 Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 4432968359bd4a0c86c3a202695d8ff0 Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-DeleteServersTestJSON-2040443327 Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-DeleteServersTestJSON-2040443327-project Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 0d9d69e165c844b780dc22ed005342cc Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-DeleteServersTestJSON-2040443327-project Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'db1bff9a-b4d8-4cd4-85e9-489f9a399fa4'} Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:38.676855 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.683675 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:38.683675 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:38.683675 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:38.683675 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:38.683675 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:38.683675 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. Jul 26 15:02:38.683675 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:02:38.683675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e57b2ece-ef9c-4add-b47e-83b4fedb053d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] Returning 404 to user: Instance db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:38.683675 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e57b2ece-ef9c-4add-b47e-83b4fedb053d tempest-DeleteServersTestJSON-2040443327 tempest-DeleteServersTestJSON-2040443327-project] 10.222.0.70 "GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4" status: 404 len: 111 microversion: 2.1 time: 0.038691 Jul 26 15:02:38.683675 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3190/6261] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:38 2022] GET /compute/v2.1/servers/db1bff9a-b4d8-4cd4-85e9-489f9a399fa4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:02:47.657205 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-199169075", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "4baa4ead-48cc-429b-80fd-f74742ba765e"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:47.712290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] validate_networks() for [('4baa4ead-48cc-429b-80fd-f74742ba765e', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:02:48.443194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:02:48.443619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:02:48.444145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:02:48.444559 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:02:48.444977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:02:48.458283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:48.458738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:48.459543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:48.460022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:48.481613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Getting quotas for project f55629d889ba4cd9955417467280c90f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:02:48.487094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Getting quotas for user c6ebda8ca0ad4cb58fabd6ce53c97882 and project f55629d889ba4cd9955417467280c90f. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:02:48.500481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:02:48.502953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:02:48.552283 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8fd98f03-63ab-401f-94bc-e109c62ce661 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026900 Jul 26 15:02:48.553062 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3072/6262] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:02:48.564677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b311ab3e-2922-414e-bfb8-2eacb908ff41 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:48.565238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b311ab3e-2922-414e-bfb8-2eacb908ff41 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:48.624231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b311ab3e-2922-414e-bfb8-2eacb908ff41 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:48.637223 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b311ab3e-2922-414e-bfb8-2eacb908ff41 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1217 microversion: 2.1 time: 0.076535 Jul 26 15:02:48.637824 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3191/6263] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:48 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:49.662874 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3ac18926-8907-41a6-9f92-a74701e87682 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:49.664576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3ac18926-8907-41a6-9f92-a74701e87682 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:49.675558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ac18926-8907-41a6-9f92-a74701e87682 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:49.676366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ac18926-8907-41a6-9f92-a74701e87682 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:49.677440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ac18926-8907-41a6-9f92-a74701e87682 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:49.677851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3ac18926-8907-41a6-9f92-a74701e87682 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:49.756153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3ac18926-8907-41a6-9f92-a74701e87682 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:49.767795 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3ac18926-8907-41a6-9f92-a74701e87682 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1275 microversion: 2.1 time: 0.109490 Jul 26 15:02:49.779832 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3073/6264] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:49 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:50.792880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-24f534c0-e910-4f99-a924-41c3bd796753 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:50.793612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-24f534c0-e910-4f99-a924-41c3bd796753 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:50.799699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:50.802673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24f534c0-e910-4f99-a924-41c3bd796753 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:50.803371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24f534c0-e910-4f99-a924-41c3bd796753 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:50.804676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24f534c0-e910-4f99-a924-41c3bd796753 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:50.806245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24f534c0-e910-4f99-a924-41c3bd796753 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:51.097723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-24f534c0-e910-4f99-a924-41c3bd796753 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:51.110684 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-24f534c0-e910-4f99-a924-41c3bd796753 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1317 microversion: 2.1 time: 0.318313 Jul 26 15:02:51.112544 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3192/6265] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:50 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:51.255006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-8a8ff48c-793c-4a8c-b59a-82329f342aeb req-e41eef42-02a7-4179-bca6-1ba369d7b74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18be207e-05c6-40f8-ac84-cc404b0d1e15", "tag": "34cc1f9c-7960-4395-a6c2-069d7021022d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:51.275682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-8a8ff48c-793c-4a8c-b59a-82329f342aeb req-e41eef42-02a7-4179-bca6-1ba369d7b74f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:51.276350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-8a8ff48c-793c-4a8c-b59a-82329f342aeb req-e41eef42-02a7-4179-bca6-1ba369d7b74f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:51.291777 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-8a8ff48c-793c-4a8c-b59a-82329f342aeb req-e41eef42-02a7-4179-bca6-1ba369d7b74f service nova] Creating event network-changed:34cc1f9c-7960-4395-a6c2-069d7021022d for instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 on n-h2-833090-9 Jul 26 15:02:51.297948 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-8a8ff48c-793c-4a8c-b59a-82329f342aeb req-e41eef42-02a7-4179-bca6-1ba369d7b74f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056382 Jul 26 15:02:51.299090 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3074/6266] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:52.133191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba076d75-7602-4e70-832d-39e49546748b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:52.133941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba076d75-7602-4e70-832d-39e49546748b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:52.144073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba076d75-7602-4e70-832d-39e49546748b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:52.144638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba076d75-7602-4e70-832d-39e49546748b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:52.145450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba076d75-7602-4e70-832d-39e49546748b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:52.146080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba076d75-7602-4e70-832d-39e49546748b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:52.295007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba076d75-7602-4e70-832d-39e49546748b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:52.302810 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba076d75-7602-4e70-832d-39e49546748b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1317 microversion: 2.1 time: 0.173920 Jul 26 15:02:52.303422 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3193/6267] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:52 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:53.326214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8c5642b0-69c1-46ad-b82e-f975be9ecd53 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:53.326923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8c5642b0-69c1-46ad-b82e-f975be9ecd53 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:53.334263 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c5642b0-69c1-46ad-b82e-f975be9ecd53 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:53.334774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c5642b0-69c1-46ad-b82e-f975be9ecd53 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:53.335650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c5642b0-69c1-46ad-b82e-f975be9ecd53 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:53.336121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c5642b0-69c1-46ad-b82e-f975be9ecd53 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:53.475747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8c5642b0-69c1-46ad-b82e-f975be9ecd53 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:53.486309 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8c5642b0-69c1-46ad-b82e-f975be9ecd53 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1317 microversion: 2.1 time: 0.165523 Jul 26 15:02:53.486933 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3075/6268] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:53 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:54.507744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-221a7b7c-c57f-478e-92fc-319eb2b4d3e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:54.508428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-221a7b7c-c57f-478e-92fc-319eb2b4d3e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:54.515377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-221a7b7c-c57f-478e-92fc-319eb2b4d3e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:54.515846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-221a7b7c-c57f-478e-92fc-319eb2b4d3e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:54.516660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-221a7b7c-c57f-478e-92fc-319eb2b4d3e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:54.517109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-221a7b7c-c57f-478e-92fc-319eb2b4d3e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:54.656354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-221a7b7c-c57f-478e-92fc-319eb2b4d3e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:54.663914 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-221a7b7c-c57f-478e-92fc-319eb2b4d3e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1317 microversion: 2.1 time: 0.160098 Jul 26 15:02:54.664504 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3194/6269] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:54 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:55.523577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-afffd6ce-ce71-41ec-be95-af2ea031330d req-4877ef01-1122-4dd4-8950-2df27d301214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18be207e-05c6-40f8-ac84-cc404b0d1e15", "name": "network-vif-plugged", "status": "completed", "tag": "34cc1f9c-7960-4395-a6c2-069d7021022d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:55.534891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-afffd6ce-ce71-41ec-be95-af2ea031330d req-4877ef01-1122-4dd4-8950-2df27d301214 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:55.535347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-afffd6ce-ce71-41ec-be95-af2ea031330d req-4877ef01-1122-4dd4-8950-2df27d301214 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:55.549440 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-afffd6ce-ce71-41ec-be95-af2ea031330d req-4877ef01-1122-4dd4-8950-2df27d301214 service nova] Creating event network-vif-plugged:34cc1f9c-7960-4395-a6c2-069d7021022d for instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 on n-h2-833090-9 Jul 26 15:02:55.556756 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-afffd6ce-ce71-41ec-be95-af2ea031330d req-4877ef01-1122-4dd4-8950-2df27d301214 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036257 Jul 26 15:02:55.557399 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3076/6270] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:55.686246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cea8226c-8a5c-4956-9dc1-2bc13501c495 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:55.686894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cea8226c-8a5c-4956-9dc1-2bc13501c495 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:55.693970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cea8226c-8a5c-4956-9dc1-2bc13501c495 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:55.694447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cea8226c-8a5c-4956-9dc1-2bc13501c495 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:55.695246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cea8226c-8a5c-4956-9dc1-2bc13501c495 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:55.695713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cea8226c-8a5c-4956-9dc1-2bc13501c495 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:55.835905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cea8226c-8a5c-4956-9dc1-2bc13501c495 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:55.845435 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cea8226c-8a5c-4956-9dc1-2bc13501c495 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1317 microversion: 2.1 time: 0.163418 Jul 26 15:02:55.846039 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3195/6271] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:55 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:56.870006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b46680d5-7a08-4619-bc61-767a3bd322ac tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:56.870840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b46680d5-7a08-4619-bc61-767a3bd322ac tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:56.877649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b46680d5-7a08-4619-bc61-767a3bd322ac tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:56.878096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b46680d5-7a08-4619-bc61-767a3bd322ac tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:56.878868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b46680d5-7a08-4619-bc61-767a3bd322ac tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:56.879306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b46680d5-7a08-4619-bc61-767a3bd322ac tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:56.883289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=58 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:57.015979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b46680d5-7a08-4619-bc61-767a3bd322ac tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:57.023547 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b46680d5-7a08-4619-bc61-767a3bd322ac tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1506 microversion: 2.1 time: 0.160550 Jul 26 15:02:57.024147 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3077/6272] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:56 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:57.048768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63e479ba-cf6e-4fb5-8225-9b83be21a73d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:57.049405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63e479ba-cf6e-4fb5-8225-9b83be21a73d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:57.056628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63e479ba-cf6e-4fb5-8225-9b83be21a73d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.057098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63e479ba-cf6e-4fb5-8225-9b83be21a73d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.057897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63e479ba-cf6e-4fb5-8225-9b83be21a73d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.058358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63e479ba-cf6e-4fb5-8225-9b83be21a73d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.194315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63e479ba-cf6e-4fb5-8225-9b83be21a73d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:57.202734 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63e479ba-cf6e-4fb5-8225-9b83be21a73d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1506 microversion: 2.1 time: 0.158088 Jul 26 15:02:57.203320 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3196/6273] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:57 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:57.223499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-01a8b24e-22cc-4fa4-bc9c-1154d189ce3e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:57.225938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-01a8b24e-22cc-4fa4-bc9c-1154d189ce3e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:57.232307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01a8b24e-22cc-4fa4-bc9c-1154d189ce3e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.232766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01a8b24e-22cc-4fa4-bc9c-1154d189ce3e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.233555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01a8b24e-22cc-4fa4-bc9c-1154d189ce3e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.234001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01a8b24e-22cc-4fa4-bc9c-1154d189ce3e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.299880 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-01a8b24e-22cc-4fa4-bc9c-1154d189ce3e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "PUT /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1078 microversion: 2.1 time: 0.080256 Jul 26 15:02:57.300576 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3078/6274] 10.222.0.70 () {60 vars in 1256 bytes} [Tue Jul 26 15:02:57 2022] PUT /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1078 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:57.318540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2e8dc4e8-5f70-41a9-8362-e0541ac9669a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:57.319277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2e8dc4e8-5f70-41a9-8362-e0541ac9669a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:57.324782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:57.331025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e8dc4e8-5f70-41a9-8362-e0541ac9669a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.331503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e8dc4e8-5f70-41a9-8362-e0541ac9669a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.332400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e8dc4e8-5f70-41a9-8362-e0541ac9669a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.332866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2e8dc4e8-5f70-41a9-8362-e0541ac9669a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.471407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2e8dc4e8-5f70-41a9-8362-e0541ac9669a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:57.480484 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2e8dc4e8-5f70-41a9-8362-e0541ac9669a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1504 microversion: 2.1 time: 0.165775 Jul 26 15:02:57.481132 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3197/6275] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:57 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:57.500925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a9748069-8b0c-48c3-918f-763292ae23b6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:57.501542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a9748069-8b0c-48c3-918f-763292ae23b6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:57.508074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9748069-8b0c-48c3-918f-763292ae23b6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.508529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9748069-8b0c-48c3-918f-763292ae23b6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.509661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9748069-8b0c-48c3-918f-763292ae23b6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.510108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9748069-8b0c-48c3-918f-763292ae23b6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.642239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a9748069-8b0c-48c3-918f-763292ae23b6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:57.650849 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a9748069-8b0c-48c3-918f-763292ae23b6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1504 microversion: 2.1 time: 0.153765 Jul 26 15:02:57.651435 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3079/6276] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:57 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:57.671458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:57.673853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:57.679875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.680374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.681756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.682274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.711464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:57.718536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Old instance type m1.heat2, new instance type m1.heat {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 15:02:57.725404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:02:57.725774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:02:57.726322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:02:57.726754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:02:57.727187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:02:57.791932 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-96b24e2e-ecb9-47af-8e58-2fa27f93b054 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "POST /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15/action" status: 202 len: 0 microversion: 2.1 time: 0.124279 Jul 26 15:02:57.792584 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3198/6277] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:02:57 2022] POST /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:02:57.800824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2e90b080-50cc-488a-965e-4c80133f2cde tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:57.801476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2e90b080-50cc-488a-965e-4c80133f2cde tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:57.808037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e90b080-50cc-488a-965e-4c80133f2cde tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.808828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e90b080-50cc-488a-965e-4c80133f2cde tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.809604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e90b080-50cc-488a-965e-4c80133f2cde tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.810045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2e90b080-50cc-488a-965e-4c80133f2cde tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.947790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2e90b080-50cc-488a-965e-4c80133f2cde tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:57.956244 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2e90b080-50cc-488a-965e-4c80133f2cde tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1515 microversion: 2.1 time: 0.159322 Jul 26 15:02:57.956818 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3080/6278] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:57 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:58.279716 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:02:58.280522 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:02:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:02:58.976808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:58.982208 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90c6e9cd-d6de-4ba0-8eb8-7c302ef2a26b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:58.983154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-90c6e9cd-d6de-4ba0-8eb8-7c302ef2a26b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:58.991117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90c6e9cd-d6de-4ba0-8eb8-7c302ef2a26b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:58.991670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90c6e9cd-d6de-4ba0-8eb8-7c302ef2a26b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:58.992819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90c6e9cd-d6de-4ba0-8eb8-7c302ef2a26b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:58.993914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90c6e9cd-d6de-4ba0-8eb8-7c302ef2a26b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:59.148409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-90c6e9cd-d6de-4ba0-8eb8-7c302ef2a26b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:59.156838 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90c6e9cd-d6de-4ba0-8eb8-7c302ef2a26b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1515 microversion: 2.1 time: 0.182074 Jul 26 15:02:59.157435 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3199/6279] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:58 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:00.177757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3cb73a69-49cf-458e-8b61-f34a3c1a45bc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:00.178382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3cb73a69-49cf-458e-8b61-f34a3c1a45bc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:00.180341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:00.181227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:00.182734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:00.189093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3cb73a69-49cf-458e-8b61-f34a3c1a45bc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:00.189544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3cb73a69-49cf-458e-8b61-f34a3c1a45bc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:00.190424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3cb73a69-49cf-458e-8b61-f34a3c1a45bc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:00.190864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3cb73a69-49cf-458e-8b61-f34a3c1a45bc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:00.331825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3cb73a69-49cf-458e-8b61-f34a3c1a45bc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:00.340698 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3cb73a69-49cf-458e-8b61-f34a3c1a45bc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.166672 Jul 26 15:03:00.341388 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3081/6280] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:00 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:01.363262 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ccdf8c2c-e193-4109-bc93-bc4df1952f2d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:01.363812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ccdf8c2c-e193-4109-bc93-bc4df1952f2d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:01.372078 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccdf8c2c-e193-4109-bc93-bc4df1952f2d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:01.372595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccdf8c2c-e193-4109-bc93-bc4df1952f2d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:01.373400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccdf8c2c-e193-4109-bc93-bc4df1952f2d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:01.373862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccdf8c2c-e193-4109-bc93-bc4df1952f2d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:01.510023 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ccdf8c2c-e193-4109-bc93-bc4df1952f2d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:01.517727 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ccdf8c2c-e193-4109-bc93-bc4df1952f2d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.158475 Jul 26 15:03:01.518306 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3200/6281] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:01 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:02.538789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d9f7b69f-53e3-4d7b-b8ed-ae73af964235 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:02.539442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d9f7b69f-53e3-4d7b-b8ed-ae73af964235 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:02.548625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9f7b69f-53e3-4d7b-b8ed-ae73af964235 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:02.549081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9f7b69f-53e3-4d7b-b8ed-ae73af964235 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:02.549890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9f7b69f-53e3-4d7b-b8ed-ae73af964235 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:02.550329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d9f7b69f-53e3-4d7b-b8ed-ae73af964235 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:02.690403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d9f7b69f-53e3-4d7b-b8ed-ae73af964235 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:02.698387 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d9f7b69f-53e3-4d7b-b8ed-ae73af964235 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.163553 Jul 26 15:03:02.698949 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3082/6282] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:02 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:03.719040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d2dd56d-7196-413b-b7cc-96eba12771b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:03.719665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4d2dd56d-7196-413b-b7cc-96eba12771b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:03.726603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d2dd56d-7196-413b-b7cc-96eba12771b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:03.727741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d2dd56d-7196-413b-b7cc-96eba12771b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:03.728479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d2dd56d-7196-413b-b7cc-96eba12771b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:03.728972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d2dd56d-7196-413b-b7cc-96eba12771b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:03.865217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4d2dd56d-7196-413b-b7cc-96eba12771b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:03.873780 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d2dd56d-7196-413b-b7cc-96eba12771b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.158619 Jul 26 15:03:03.874361 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3201/6283] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:03 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:04.894759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f41bd8df-f141-420d-89e9-c703f8115c73 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:04.895376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f41bd8df-f141-420d-89e9-c703f8115c73 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:04.903590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f41bd8df-f141-420d-89e9-c703f8115c73 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:04.904096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f41bd8df-f141-420d-89e9-c703f8115c73 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:04.904894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f41bd8df-f141-420d-89e9-c703f8115c73 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:04.905340 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f41bd8df-f141-420d-89e9-c703f8115c73 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:05.070070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f41bd8df-f141-420d-89e9-c703f8115c73 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:05.078629 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f41bd8df-f141-420d-89e9-c703f8115c73 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.187697 Jul 26 15:03:05.079213 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3083/6284] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:04 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:06.100444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e25d07ac-8270-484d-920a-21e7db930438 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:06.101118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e25d07ac-8270-484d-920a-21e7db930438 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:06.109130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e25d07ac-8270-484d-920a-21e7db930438 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:06.109608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e25d07ac-8270-484d-920a-21e7db930438 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:06.110423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e25d07ac-8270-484d-920a-21e7db930438 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:06.110886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e25d07ac-8270-484d-920a-21e7db930438 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:06.253883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e25d07ac-8270-484d-920a-21e7db930438 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:06.261822 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e25d07ac-8270-484d-920a-21e7db930438 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.165285 Jul 26 15:03:06.262410 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3202/6285] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:06 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:07.285546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1674fe6e-727b-49cb-8d00-9157fc9b1b8b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:07.286164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1674fe6e-727b-49cb-8d00-9157fc9b1b8b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:07.293768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1674fe6e-727b-49cb-8d00-9157fc9b1b8b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:07.294219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1674fe6e-727b-49cb-8d00-9157fc9b1b8b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:07.295084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1674fe6e-727b-49cb-8d00-9157fc9b1b8b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:07.295522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1674fe6e-727b-49cb-8d00-9157fc9b1b8b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:07.427740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1674fe6e-727b-49cb-8d00-9157fc9b1b8b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:07.436498 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1674fe6e-727b-49cb-8d00-9157fc9b1b8b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.154892 Jul 26 15:03:07.437100 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3084/6286] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:07 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:08.457240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c3dfe4cf-0ea5-43d9-85de-89f3bdb79536 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:08.457979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c3dfe4cf-0ea5-43d9-85de-89f3bdb79536 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:08.465351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3dfe4cf-0ea5-43d9-85de-89f3bdb79536 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:08.465821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3dfe4cf-0ea5-43d9-85de-89f3bdb79536 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:08.466611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3dfe4cf-0ea5-43d9-85de-89f3bdb79536 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:08.467067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3dfe4cf-0ea5-43d9-85de-89f3bdb79536 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:08.607127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c3dfe4cf-0ea5-43d9-85de-89f3bdb79536 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:08.614961 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c3dfe4cf-0ea5-43d9-85de-89f3bdb79536 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.161668 Jul 26 15:03:08.615551 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3203/6287] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:08 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:09.637511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6caa1e74-2284-4fff-b1dd-c44e3069c0d5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:09.638156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6caa1e74-2284-4fff-b1dd-c44e3069c0d5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:09.645214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6caa1e74-2284-4fff-b1dd-c44e3069c0d5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:09.645670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6caa1e74-2284-4fff-b1dd-c44e3069c0d5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:09.646444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6caa1e74-2284-4fff-b1dd-c44e3069c0d5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:09.647003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6caa1e74-2284-4fff-b1dd-c44e3069c0d5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:09.789763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6caa1e74-2284-4fff-b1dd-c44e3069c0d5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:09.801178 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6caa1e74-2284-4fff-b1dd-c44e3069c0d5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.168348 Jul 26 15:03:09.801769 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3085/6288] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:09 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:10.824878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-93d4ca4b-fff0-4b1d-a14a-cff585e26cbd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:10.825431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-93d4ca4b-fff0-4b1d-a14a-cff585e26cbd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:10.831804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93d4ca4b-fff0-4b1d-a14a-cff585e26cbd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:10.832299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93d4ca4b-fff0-4b1d-a14a-cff585e26cbd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:10.833082 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93d4ca4b-fff0-4b1d-a14a-cff585e26cbd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:10.833551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-93d4ca4b-fff0-4b1d-a14a-cff585e26cbd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:10.975598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-93d4ca4b-fff0-4b1d-a14a-cff585e26cbd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:10.983681 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-93d4ca4b-fff0-4b1d-a14a-cff585e26cbd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.164004 Jul 26 15:03:10.984284 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3204/6289] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:10 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:12.005835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea97136c-9d56-4862-b5fc-ae00dcd505b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:12.006469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ea97136c-9d56-4862-b5fc-ae00dcd505b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:12.013746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea97136c-9d56-4862-b5fc-ae00dcd505b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:12.014210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea97136c-9d56-4862-b5fc-ae00dcd505b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:12.015001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea97136c-9d56-4862-b5fc-ae00dcd505b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:12.015451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea97136c-9d56-4862-b5fc-ae00dcd505b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:12.154061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ea97136c-9d56-4862-b5fc-ae00dcd505b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:12.161803 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ea97136c-9d56-4862-b5fc-ae00dcd505b3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.160218 Jul 26 15:03:12.162394 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3086/6290] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:12 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:13.183856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-006a8342-259f-43c1-ae5c-e4bd24a75c7f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:13.184547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-006a8342-259f-43c1-ae5c-e4bd24a75c7f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:13.192196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-006a8342-259f-43c1-ae5c-e4bd24a75c7f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:13.192665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-006a8342-259f-43c1-ae5c-e4bd24a75c7f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:13.193466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-006a8342-259f-43c1-ae5c-e4bd24a75c7f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:13.193929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-006a8342-259f-43c1-ae5c-e4bd24a75c7f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:13.336767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-006a8342-259f-43c1-ae5c-e4bd24a75c7f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:13.344906 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-006a8342-259f-43c1-ae5c-e4bd24a75c7f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.165646 Jul 26 15:03:13.345498 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3205/6291] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:13 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:14.367808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d70ad102-99d2-4ca3-b84f-da102cc90578 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:14.368471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d70ad102-99d2-4ca3-b84f-da102cc90578 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:14.377647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d70ad102-99d2-4ca3-b84f-da102cc90578 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:14.378325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d70ad102-99d2-4ca3-b84f-da102cc90578 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:14.379548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d70ad102-99d2-4ca3-b84f-da102cc90578 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:14.380320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d70ad102-99d2-4ca3-b84f-da102cc90578 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:14.568459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d70ad102-99d2-4ca3-b84f-da102cc90578 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:14.579261 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d70ad102-99d2-4ca3-b84f-da102cc90578 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.216007 Jul 26 15:03:14.579851 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3087/6292] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:14 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:15.602362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-514b66c1-1fd1-44c5-a9a2-0df6e64f29a9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:15.603114 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-514b66c1-1fd1-44c5-a9a2-0df6e64f29a9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:15.613160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-514b66c1-1fd1-44c5-a9a2-0df6e64f29a9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:15.613768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-514b66c1-1fd1-44c5-a9a2-0df6e64f29a9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:15.614669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-514b66c1-1fd1-44c5-a9a2-0df6e64f29a9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:15.615210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-514b66c1-1fd1-44c5-a9a2-0df6e64f29a9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:15.761321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-514b66c1-1fd1-44c5-a9a2-0df6e64f29a9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:15.773550 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-514b66c1-1fd1-44c5-a9a2-0df6e64f29a9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.175189 Jul 26 15:03:15.774187 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3206/6293] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:15 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:16.796867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-912d644a-8728-49c5-8d2d-eff531dcdc92 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:16.797398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-912d644a-8728-49c5-8d2d-eff531dcdc92 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:16.804488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-912d644a-8728-49c5-8d2d-eff531dcdc92 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:16.804946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-912d644a-8728-49c5-8d2d-eff531dcdc92 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:16.806615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-912d644a-8728-49c5-8d2d-eff531dcdc92 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:16.807081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-912d644a-8728-49c5-8d2d-eff531dcdc92 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:16.957086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-912d644a-8728-49c5-8d2d-eff531dcdc92 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:16.965496 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-912d644a-8728-49c5-8d2d-eff531dcdc92 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.172630 Jul 26 15:03:16.966066 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3088/6294] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:16 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:17.987848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-07f018e5-b10d-4f41-be02-26deaaa9abaf tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:17.988433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-07f018e5-b10d-4f41-be02-26deaaa9abaf tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:17.996259 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07f018e5-b10d-4f41-be02-26deaaa9abaf tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:17.996739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07f018e5-b10d-4f41-be02-26deaaa9abaf tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:17.997563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07f018e5-b10d-4f41-be02-26deaaa9abaf tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:17.998031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07f018e5-b10d-4f41-be02-26deaaa9abaf tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:18.002715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:18.145232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-07f018e5-b10d-4f41-be02-26deaaa9abaf tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:18.158012 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-07f018e5-b10d-4f41-be02-26deaaa9abaf tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.174254 Jul 26 15:03:18.158603 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3207/6295] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:17 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:19.181419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-14f7cbcc-4260-42b0-9cf4-d338ef9dc781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:19.182529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-14f7cbcc-4260-42b0-9cf4-d338ef9dc781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:19.190356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f7cbcc-4260-42b0-9cf4-d338ef9dc781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.190806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f7cbcc-4260-42b0-9cf4-d338ef9dc781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.191591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f7cbcc-4260-42b0-9cf4-d338ef9dc781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.192061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f7cbcc-4260-42b0-9cf4-d338ef9dc781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.332831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-14f7cbcc-4260-42b0-9cf4-d338ef9dc781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:19.341858 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-14f7cbcc-4260-42b0-9cf4-d338ef9dc781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.165134 Jul 26 15:03:19.342553 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3089/6296] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:19 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:20.366957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba515f63-3d65-4aba-bf5b-0b4ae8840bc4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:20.367487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba515f63-3d65-4aba-bf5b-0b4ae8840bc4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:20.374742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba515f63-3d65-4aba-bf5b-0b4ae8840bc4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:20.375151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba515f63-3d65-4aba-bf5b-0b4ae8840bc4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:20.375942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba515f63-3d65-4aba-bf5b-0b4ae8840bc4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:20.376421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba515f63-3d65-4aba-bf5b-0b4ae8840bc4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:20.517427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba515f63-3d65-4aba-bf5b-0b4ae8840bc4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:20.526275 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba515f63-3d65-4aba-bf5b-0b4ae8840bc4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.163198 Jul 26 15:03:20.526855 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3208/6297] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:20 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:21.548191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1289c934-6602-4a17-8957-1d1b12cfb5a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:21.548814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1289c934-6602-4a17-8957-1d1b12cfb5a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:21.556765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1289c934-6602-4a17-8957-1d1b12cfb5a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.557480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1289c934-6602-4a17-8957-1d1b12cfb5a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.558277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1289c934-6602-4a17-8957-1d1b12cfb5a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.558720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1289c934-6602-4a17-8957-1d1b12cfb5a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.705209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1289c934-6602-4a17-8957-1d1b12cfb5a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:21.712966 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1289c934-6602-4a17-8957-1d1b12cfb5a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.168775 Jul 26 15:03:21.713550 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3090/6298] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:21 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:22.734066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4eef250d-d0f5-4650-bd4e-6d851498bef1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:22.734614 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4eef250d-d0f5-4650-bd4e-6d851498bef1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:22.743938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4eef250d-d0f5-4650-bd4e-6d851498bef1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:22.744809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4eef250d-d0f5-4650-bd4e-6d851498bef1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:22.745730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4eef250d-d0f5-4650-bd4e-6d851498bef1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:22.746185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4eef250d-d0f5-4650-bd4e-6d851498bef1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:22.903307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4eef250d-d0f5-4650-bd4e-6d851498bef1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:22.913118 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4eef250d-d0f5-4650-bd4e-6d851498bef1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.182968 Jul 26 15:03:22.914154 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3209/6299] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:22 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:23.937895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-80a360f7-7802-4a87-b3ff-7df13c65c781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:23.938511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-80a360f7-7802-4a87-b3ff-7df13c65c781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:23.947373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80a360f7-7802-4a87-b3ff-7df13c65c781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:23.947843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80a360f7-7802-4a87-b3ff-7df13c65c781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:23.948680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80a360f7-7802-4a87-b3ff-7df13c65c781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:23.949127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80a360f7-7802-4a87-b3ff-7df13c65c781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:24.089315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80a360f7-7802-4a87-b3ff-7df13c65c781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:24.097700 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-80a360f7-7802-4a87-b3ff-7df13c65c781 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.163682 Jul 26 15:03:24.098298 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3091/6300] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:23 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:25.122331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b6c8f92b-84a0-41d8-9987-e6557f3f2cc9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:25.123152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b6c8f92b-84a0-41d8-9987-e6557f3f2cc9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:25.130460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6c8f92b-84a0-41d8-9987-e6557f3f2cc9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:25.130966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6c8f92b-84a0-41d8-9987-e6557f3f2cc9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:25.131791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6c8f92b-84a0-41d8-9987-e6557f3f2cc9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:25.132290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6c8f92b-84a0-41d8-9987-e6557f3f2cc9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:25.273673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b6c8f92b-84a0-41d8-9987-e6557f3f2cc9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:25.281596 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b6c8f92b-84a0-41d8-9987-e6557f3f2cc9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.164064 Jul 26 15:03:25.282211 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3210/6301] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:25 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:26.305768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e895d4c4-6eed-45cb-b04b-52900c979ccc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:26.306389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e895d4c4-6eed-45cb-b04b-52900c979ccc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:26.314931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e895d4c4-6eed-45cb-b04b-52900c979ccc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:26.315399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e895d4c4-6eed-45cb-b04b-52900c979ccc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:26.316366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e895d4c4-6eed-45cb-b04b-52900c979ccc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:26.316815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e895d4c4-6eed-45cb-b04b-52900c979ccc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:26.509862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e895d4c4-6eed-45cb-b04b-52900c979ccc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:26.518462 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e895d4c4-6eed-45cb-b04b-52900c979ccc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1520 microversion: 2.1 time: 0.216731 Jul 26 15:03:26.519055 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3092/6302] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:26 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:27.136067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2cf24705-f18d-4247-b157-1852bd6f73b2 req-12d9489e-f588-4b9b-9a3c-a6ec25e08301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18be207e-05c6-40f8-ac84-cc404b0d1e15", "name": "network-vif-unplugged", "status": "completed", "tag": "34cc1f9c-7960-4395-a6c2-069d7021022d"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:27.147809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2cf24705-f18d-4247-b157-1852bd6f73b2 req-12d9489e-f588-4b9b-9a3c-a6ec25e08301 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:27.148130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2cf24705-f18d-4247-b157-1852bd6f73b2 req-12d9489e-f588-4b9b-9a3c-a6ec25e08301 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:27.161629 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2cf24705-f18d-4247-b157-1852bd6f73b2 req-12d9489e-f588-4b9b-9a3c-a6ec25e08301 service nova] Creating event network-vif-unplugged:34cc1f9c-7960-4395-a6c2-069d7021022d for instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 on n-h1-833090-9 Jul 26 15:03:27.167896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-2cf24705-f18d-4247-b157-1852bd6f73b2 req-12d9489e-f588-4b9b-9a3c-a6ec25e08301 service nova] Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:03:27.180906 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2cf24705-f18d-4247-b157-1852bd6f73b2 req-12d9489e-f588-4b9b-9a3c-a6ec25e08301 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048692 Jul 26 15:03:27.181785 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3211/6303] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:27.541228 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef0376c4-6745-413c-b975-8c462600f898 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:27.542037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ef0376c4-6745-413c-b975-8c462600f898 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:27.550350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0376c4-6745-413c-b975-8c462600f898 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:27.550815 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0376c4-6745-413c-b975-8c462600f898 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:27.551630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0376c4-6745-413c-b975-8c462600f898 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:27.552296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0376c4-6745-413c-b975-8c462600f898 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:27.571440 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:28.067509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ef0376c4-6745-413c-b975-8c462600f898 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:28.076006 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ef0376c4-6745-413c-b975-8c462600f898 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1519 microversion: 2.1 time: 0.539697 Jul 26 15:03:28.076603 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3093/6304] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:27 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1519 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:29.099978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bcd8f6ea-b5ab-4e88-8ee9-ab67f9025c61 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:29.100742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bcd8f6ea-b5ab-4e88-8ee9-ab67f9025c61 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:29.103376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=34 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:29.109189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bcd8f6ea-b5ab-4e88-8ee9-ab67f9025c61 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:29.109663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bcd8f6ea-b5ab-4e88-8ee9-ab67f9025c61 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:29.110458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bcd8f6ea-b5ab-4e88-8ee9-ab67f9025c61 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:29.110916 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bcd8f6ea-b5ab-4e88-8ee9-ab67f9025c61 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:29.202245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-638c95b8-8ce9-4b59-a1eb-7dc714989b16 req-cb9136c0-39ee-4e51-aa40-4db83ac41426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18be207e-05c6-40f8-ac84-cc404b0d1e15", "tag": "34cc1f9c-7960-4395-a6c2-069d7021022d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:29.214353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-638c95b8-8ce9-4b59-a1eb-7dc714989b16 req-cb9136c0-39ee-4e51-aa40-4db83ac41426 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:29.214841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-638c95b8-8ce9-4b59-a1eb-7dc714989b16 req-cb9136c0-39ee-4e51-aa40-4db83ac41426 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:29.228284 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-638c95b8-8ce9-4b59-a1eb-7dc714989b16 req-cb9136c0-39ee-4e51-aa40-4db83ac41426 service nova] Creating event network-changed:34cc1f9c-7960-4395-a6c2-069d7021022d for instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 on n-h1-833090-9 Jul 26 15:03:29.234333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-638c95b8-8ce9-4b59-a1eb-7dc714989b16 req-cb9136c0-39ee-4e51-aa40-4db83ac41426 service nova] Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:03:29.246850 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-638c95b8-8ce9-4b59-a1eb-7dc714989b16 req-cb9136c0-39ee-4e51-aa40-4db83ac41426 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049508 Jul 26 15:03:29.247739 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3094/6305] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:29.272330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bcd8f6ea-b5ab-4e88-8ee9-ab67f9025c61 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:29.281958 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bcd8f6ea-b5ab-4e88-8ee9-ab67f9025c61 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1517 microversion: 2.1 time: 0.187284 Jul 26 15:03:29.282572 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3212/6306] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:29 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:30.304876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0103a262-fd2c-444d-8242-e2c7c52b7e68 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:30.305609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0103a262-fd2c-444d-8242-e2c7c52b7e68 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:30.308643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=28 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:30.315503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0103a262-fd2c-444d-8242-e2c7c52b7e68 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:30.315973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0103a262-fd2c-444d-8242-e2c7c52b7e68 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:30.316776 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0103a262-fd2c-444d-8242-e2c7c52b7e68 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:30.317219 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0103a262-fd2c-444d-8242-e2c7c52b7e68 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:30.461231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0103a262-fd2c-444d-8242-e2c7c52b7e68 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:30.468915 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0103a262-fd2c-444d-8242-e2c7c52b7e68 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1514 microversion: 2.1 time: 0.168308 Jul 26 15:03:30.469502 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3095/6307] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:30 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:30.490509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e138f286-7100-49cd-b3a0-cc42859ec76e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:30.491036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e138f286-7100-49cd-b3a0-cc42859ec76e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:30.498880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e138f286-7100-49cd-b3a0-cc42859ec76e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:30.499360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e138f286-7100-49cd-b3a0-cc42859ec76e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:30.500205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e138f286-7100-49cd-b3a0-cc42859ec76e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:30.500670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e138f286-7100-49cd-b3a0-cc42859ec76e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:30.566067 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e138f286-7100-49cd-b3a0-cc42859ec76e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "POST /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15/action" status: 204 len: 0 microversion: 2.1 time: 0.079334 Jul 26 15:03:30.566740 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3213/6308] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:03:30 2022] POST /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:03:30.575464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3506e071-7f15-43f2-8ba9-cc8307f825f2 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:30.576128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3506e071-7f15-43f2-8ba9-cc8307f825f2 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:30.582431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3506e071-7f15-43f2-8ba9-cc8307f825f2 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:30.582880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3506e071-7f15-43f2-8ba9-cc8307f825f2 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:30.583659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3506e071-7f15-43f2-8ba9-cc8307f825f2 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:30.584206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3506e071-7f15-43f2-8ba9-cc8307f825f2 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:30.819123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3506e071-7f15-43f2-8ba9-cc8307f825f2 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:30.829414 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3506e071-7f15-43f2-8ba9-cc8307f825f2 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1514 microversion: 2.1 time: 0.258117 Jul 26 15:03:30.830022 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3096/6309] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:30 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:31.863977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a9c26337-4797-4f17-b161-160a1ee2fbf5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:31.865123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a9c26337-4797-4f17-b161-160a1ee2fbf5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:31.877543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9c26337-4797-4f17-b161-160a1ee2fbf5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:31.878322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9c26337-4797-4f17-b161-160a1ee2fbf5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:31.879578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9c26337-4797-4f17-b161-160a1ee2fbf5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:31.880374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a9c26337-4797-4f17-b161-160a1ee2fbf5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:32.094956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a9c26337-4797-4f17-b161-160a1ee2fbf5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:32.104132 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a9c26337-4797-4f17-b161-160a1ee2fbf5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1506 microversion: 2.1 time: 0.249009 Jul 26 15:03:32.104762 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3214/6310] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:31 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:32.127864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7cfbc3c6-f64b-4c86-9904-758ca1ec5fd1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:32.128711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7cfbc3c6-f64b-4c86-9904-758ca1ec5fd1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:32.138386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cfbc3c6-f64b-4c86-9904-758ca1ec5fd1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:32.138844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cfbc3c6-f64b-4c86-9904-758ca1ec5fd1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:32.139914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cfbc3c6-f64b-4c86-9904-758ca1ec5fd1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:32.140390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7cfbc3c6-f64b-4c86-9904-758ca1ec5fd1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:32.284307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7cfbc3c6-f64b-4c86-9904-758ca1ec5fd1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:32.292953 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7cfbc3c6-f64b-4c86-9904-758ca1ec5fd1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1506 microversion: 2.1 time: 0.169062 Jul 26 15:03:32.293686 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3097/6311] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:32 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:32.317480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1008f3a4-ac7b-4c9a-9df1-9586edf099f9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Action: 'create', calling method: .version_select at 0x7f87992c2f70>, body: {"keypair": {"name": "tempest-keypair-739368058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPwPYnkWXAzuIx14shefXhtROgj0zzoWLAMneD4Ga62SvsGADGKX/4gKQ2NFiRPtk3XpDmlCRmHYxBCOl/XPOVzoxK2FMjOKZ34vR4wzhQz8as78+mTRFExI8WDdkFVWA=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:32.333243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-1008f3a4-ac7b-4c9a-9df1-9586edf099f9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Getting quotas for project f55629d889ba4cd9955417467280c90f. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:03:32.339418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-1008f3a4-ac7b-4c9a-9df1-9586edf099f9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Getting quotas for user c6ebda8ca0ad4cb58fabd6ce53c97882 and project f55629d889ba4cd9955417467280c90f. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:03:32.370412 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1008f3a4-ac7b-4c9a-9df1-9586edf099f9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056887 Jul 26 15:03:32.371063 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3215/6312] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:03:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:03:33.603597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b664c234-4335-417a-a420-83364b9c4537 req-199db7e8-3891-4d25-94bf-06013576fa65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18be207e-05c6-40f8-ac84-cc404b0d1e15", "name": "network-vif-plugged", "status": "completed", "tag": "34cc1f9c-7960-4395-a6c2-069d7021022d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:33.619617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b664c234-4335-417a-a420-83364b9c4537 req-199db7e8-3891-4d25-94bf-06013576fa65 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:33.620220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b664c234-4335-417a-a420-83364b9c4537 req-199db7e8-3891-4d25-94bf-06013576fa65 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:33.633747 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b664c234-4335-417a-a420-83364b9c4537 req-199db7e8-3891-4d25-94bf-06013576fa65 service nova] Creating event network-vif-plugged:34cc1f9c-7960-4395-a6c2-069d7021022d for instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 on n-h1-833090-9 Jul 26 15:03:33.639836 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b664c234-4335-417a-a420-83364b9c4537 req-199db7e8-3891-4d25-94bf-06013576fa65 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043241 Jul 26 15:03:33.640905 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3098/6313] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:03:33.670545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-01b5b0b7-4b4a-4dd2-adbe-233a1fa5dd9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:33.671199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-01b5b0b7-4b4a-4dd2-adbe-233a1fa5dd9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:33.678856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01b5b0b7-4b4a-4dd2-adbe-233a1fa5dd9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:33.679925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01b5b0b7-4b4a-4dd2-adbe-233a1fa5dd9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:33.680957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01b5b0b7-4b4a-4dd2-adbe-233a1fa5dd9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:33.681429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-01b5b0b7-4b4a-4dd2-adbe-233a1fa5dd9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:33.824283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-01b5b0b7-4b4a-4dd2-adbe-233a1fa5dd9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:33.832249 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-01b5b0b7-4b4a-4dd2-adbe-233a1fa5dd9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 200 len: 1506 microversion: 2.1 time: 0.166695 Jul 26 15:03:33.832828 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3216/6314] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:33 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:33.854378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a362144f-5b61-454c-9220-2d36f4e0c677 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:33.854964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a362144f-5b61-454c-9220-2d36f4e0c677 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:33.862927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a362144f-5b61-454c-9220-2d36f4e0c677 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:33.863380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a362144f-5b61-454c-9220-2d36f4e0c677 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:33.864196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a362144f-5b61-454c-9220-2d36f4e0c677 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:33.864635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a362144f-5b61-454c-9220-2d36f4e0c677 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:33.892619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a362144f-5b61-454c-9220-2d36f4e0c677 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:03:33.970131 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a362144f-5b61-454c-9220-2d36f4e0c677 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "DELETE /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 204 len: 0 microversion: 2.1 time: 0.120527 Jul 26 15:03:33.970821 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3099/6315] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:03:33 2022] DELETE /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:03:34.029311 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-232958054", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "4baa4ead-48cc-429b-80fd-f74742ba765e"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:34.084058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] validate_networks() for [('4baa4ead-48cc-429b-80fd-f74742ba765e', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:03:34.564318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:03:34.564762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:03:34.565288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:03:34.565743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:03:34.566177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:03:34.576421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:34.576816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:34.577655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:34.578106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:34.598797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Getting quotas for project f55629d889ba4cd9955417467280c90f. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:03:34.605455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Getting quotas for user c6ebda8ca0ad4cb58fabd6ce53c97882 and project f55629d889ba4cd9955417467280c90f. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:03:34.619771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:03:34.622119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:03:34.669942 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8b823f0b-f14b-41c8-b333-8fa83c49f9ba tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644705 Jul 26 15:03:34.670784 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3217/6316] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:03:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 15:03:34.682387 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-11a599dd-3582-4d81-a25c-82e524989711 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:34.683409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-11a599dd-3582-4d81-a25c-82e524989711 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:34.738835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-11a599dd-3582-4d81-a25c-82e524989711 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:34.747828 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-11a599dd-3582-4d81-a25c-82e524989711 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1217 microversion: 2.1 time: 0.070233 Jul 26 15:03:34.748437 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3100/6317] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:34 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:35.777888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-598f9888-0ed0-4610-8b76-8f1efdacc232 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:35.779079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-598f9888-0ed0-4610-8b76-8f1efdacc232 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:35.787484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-598f9888-0ed0-4610-8b76-8f1efdacc232 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:35.788296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-598f9888-0ed0-4610-8b76-8f1efdacc232 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:35.790283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-598f9888-0ed0-4610-8b76-8f1efdacc232 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:35.791022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-598f9888-0ed0-4610-8b76-8f1efdacc232 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:35.877217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-83b1c53b-30c2-48f1-abd9-83214c76be7c req-848cd2b6-de84-4b8f-801b-47cfa6632b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18be207e-05c6-40f8-ac84-cc404b0d1e15", "name": "network-vif-deleted", "tag": "34cc1f9c-7960-4395-a6c2-069d7021022d"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:35.912275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-83b1c53b-30c2-48f1-abd9-83214c76be7c req-848cd2b6-de84-4b8f-801b-47cfa6632b61 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:35.928256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-83b1c53b-30c2-48f1-abd9-83214c76be7c req-848cd2b6-de84-4b8f-801b-47cfa6632b61 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:35.931653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-598f9888-0ed0-4610-8b76-8f1efdacc232 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:35.949076 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-598f9888-0ed0-4610-8b76-8f1efdacc232 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1277 microversion: 2.1 time: 0.183645 Jul 26 15:03:35.952710 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3218/6318] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:35 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:35.977277 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-83b1c53b-30c2-48f1-abd9-83214c76be7c req-848cd2b6-de84-4b8f-801b-47cfa6632b61 service nova] Creating event network-vif-deleted:34cc1f9c-7960-4395-a6c2-069d7021022d for instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 on n-h1-833090-9 Jul 26 15:03:35.986189 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-83b1c53b-30c2-48f1-abd9-83214c76be7c req-848cd2b6-de84-4b8f-801b-47cfa6632b61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118582 Jul 26 15:03:35.994844 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3101/6319] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:36.975388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-38a78a22-56ac-45ec-81bd-82d8a8c4560e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:36.976494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-38a78a22-56ac-45ec-81bd-82d8a8c4560e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:36.984581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38a78a22-56ac-45ec-81bd-82d8a8c4560e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:36.985306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38a78a22-56ac-45ec-81bd-82d8a8c4560e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:36.986089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38a78a22-56ac-45ec-81bd-82d8a8c4560e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:36.986539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-38a78a22-56ac-45ec-81bd-82d8a8c4560e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:37.142511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-38a78a22-56ac-45ec-81bd-82d8a8c4560e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:37.151168 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-38a78a22-56ac-45ec-81bd-82d8a8c4560e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1317 microversion: 2.1 time: 0.180023 Jul 26 15:03:37.151781 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3219/6320] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:36 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:37.509659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-bf292106-51fd-4119-af82-1d9d8613ffc0 req-6a18950d-66fd-4be7-ae63-ff8a26c752f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60f8bd9-d460-4a80-ba26-61e5cd138382", "tag": "e9077eb0-43bb-48cb-81ef-4b3f3b7594c1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:37.520459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bf292106-51fd-4119-af82-1d9d8613ffc0 req-6a18950d-66fd-4be7-ae63-ff8a26c752f5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:37.520914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bf292106-51fd-4119-af82-1d9d8613ffc0 req-6a18950d-66fd-4be7-ae63-ff8a26c752f5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:37.536593 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-bf292106-51fd-4119-af82-1d9d8613ffc0 req-6a18950d-66fd-4be7-ae63-ff8a26c752f5 service nova] Creating event network-changed:e9077eb0-43bb-48cb-81ef-4b3f3b7594c1 for instance e60f8bd9-d460-4a80-ba26-61e5cd138382 on n-h1-833090-9 Jul 26 15:03:37.542154 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-bf292106-51fd-4119-af82-1d9d8613ffc0 req-6a18950d-66fd-4be7-ae63-ff8a26c752f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097134 Jul 26 15:03:37.543023 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3102/6321] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:38.174277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-43b632bf-9b35-4bf1-acb7-e86f51ae6383 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:38.174905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-43b632bf-9b35-4bf1-acb7-e86f51ae6383 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:38.183053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43b632bf-9b35-4bf1-acb7-e86f51ae6383 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:38.183519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43b632bf-9b35-4bf1-acb7-e86f51ae6383 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:38.184504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43b632bf-9b35-4bf1-acb7-e86f51ae6383 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:38.184960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-43b632bf-9b35-4bf1-acb7-e86f51ae6383 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:38.323100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-43b632bf-9b35-4bf1-acb7-e86f51ae6383 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:38.331027 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-43b632bf-9b35-4bf1-acb7-e86f51ae6383 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1317 microversion: 2.1 time: 0.160707 Jul 26 15:03:38.331595 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3220/6322] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:38 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:39.354492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c7e59bd0-34f2-40e1-8779-d5007030db97 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:39.355117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c7e59bd0-34f2-40e1-8779-d5007030db97 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:39.361679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7e59bd0-34f2-40e1-8779-d5007030db97 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:39.362129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7e59bd0-34f2-40e1-8779-d5007030db97 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:39.362905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7e59bd0-34f2-40e1-8779-d5007030db97 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:39.363339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c7e59bd0-34f2-40e1-8779-d5007030db97 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:39.502058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c7e59bd0-34f2-40e1-8779-d5007030db97 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:39.510282 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c7e59bd0-34f2-40e1-8779-d5007030db97 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1317 microversion: 2.1 time: 0.161605 Jul 26 15:03:39.510858 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3103/6323] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:39 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:40.532426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-faa99cc4-c723-4a0b-8fe6-e7a78016463a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:40.533067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-faa99cc4-c723-4a0b-8fe6-e7a78016463a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:40.540316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faa99cc4-c723-4a0b-8fe6-e7a78016463a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:40.540795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faa99cc4-c723-4a0b-8fe6-e7a78016463a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:40.541595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faa99cc4-c723-4a0b-8fe6-e7a78016463a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:40.542215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-faa99cc4-c723-4a0b-8fe6-e7a78016463a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:40.672356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-faa99cc4-c723-4a0b-8fe6-e7a78016463a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:40.680029 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-faa99cc4-c723-4a0b-8fe6-e7a78016463a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1317 microversion: 2.1 time: 0.151832 Jul 26 15:03:40.680550 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3221/6324] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:40 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:41.701511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-559c951c-3c71-48a8-8b4b-3bf25b2a28e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:41.702036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-559c951c-3c71-48a8-8b4b-3bf25b2a28e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:41.710208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-559c951c-3c71-48a8-8b4b-3bf25b2a28e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:41.710754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-559c951c-3c71-48a8-8b4b-3bf25b2a28e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:41.711545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-559c951c-3c71-48a8-8b4b-3bf25b2a28e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:41.712012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-559c951c-3c71-48a8-8b4b-3bf25b2a28e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:41.851868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-559c951c-3c71-48a8-8b4b-3bf25b2a28e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:41.860537 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-559c951c-3c71-48a8-8b4b-3bf25b2a28e6 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1317 microversion: 2.1 time: 0.163189 Jul 26 15:03:41.861516 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3104/6325] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:41 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:42.887804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8838b81c-882c-484e-8c93-1baede84e3a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:42.889632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8838b81c-882c-484e-8c93-1baede84e3a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:42.895671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8838b81c-882c-484e-8c93-1baede84e3a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:42.896176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8838b81c-882c-484e-8c93-1baede84e3a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:42.896970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8838b81c-882c-484e-8c93-1baede84e3a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:42.897956 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8838b81c-882c-484e-8c93-1baede84e3a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:43.029501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8838b81c-882c-484e-8c93-1baede84e3a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:43.037088 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8838b81c-882c-484e-8c93-1baede84e3a1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1317 microversion: 2.1 time: 0.153743 Jul 26 15:03:43.037652 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3222/6326] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:42 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:43.629430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e9c66ac8-6ec5-4b64-a1c0-50511a64aa09 req-57fff0d6-09d5-43bb-9b60-22cfd99dc14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60f8bd9-d460-4a80-ba26-61e5cd138382", "name": "network-vif-plugged", "status": "completed", "tag": "e9077eb0-43bb-48cb-81ef-4b3f3b7594c1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:43.640849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e9c66ac8-6ec5-4b64-a1c0-50511a64aa09 req-57fff0d6-09d5-43bb-9b60-22cfd99dc14f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:43.641309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e9c66ac8-6ec5-4b64-a1c0-50511a64aa09 req-57fff0d6-09d5-43bb-9b60-22cfd99dc14f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:43.655508 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e9c66ac8-6ec5-4b64-a1c0-50511a64aa09 req-57fff0d6-09d5-43bb-9b60-22cfd99dc14f service nova] Creating event network-vif-plugged:e9077eb0-43bb-48cb-81ef-4b3f3b7594c1 for instance e60f8bd9-d460-4a80-ba26-61e5cd138382 on n-h1-833090-9 Jul 26 15:03:43.660680 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e9c66ac8-6ec5-4b64-a1c0-50511a64aa09 req-57fff0d6-09d5-43bb-9b60-22cfd99dc14f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034977 Jul 26 15:03:43.662024 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3105/6327] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:44.059936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c0aa84af-62c0-4e4c-9b9e-93b1865a250b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:44.060651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0aa84af-62c0-4e4c-9b9e-93b1865a250b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:44.068199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0aa84af-62c0-4e4c-9b9e-93b1865a250b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:44.068668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0aa84af-62c0-4e4c-9b9e-93b1865a250b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:44.069462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0aa84af-62c0-4e4c-9b9e-93b1865a250b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:44.069921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0aa84af-62c0-4e4c-9b9e-93b1865a250b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:44.208178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c0aa84af-62c0-4e4c-9b9e-93b1865a250b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:44.216690 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c0aa84af-62c0-4e4c-9b9e-93b1865a250b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1317 microversion: 2.1 time: 0.160872 Jul 26 15:03:44.217289 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3223/6328] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:44 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:45.236917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:45.242084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c3133352-40d5-45e2-a680-51b9b21c096d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:45.242841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c3133352-40d5-45e2-a680-51b9b21c096d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:45.249696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3133352-40d5-45e2-a680-51b9b21c096d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:45.250156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3133352-40d5-45e2-a680-51b9b21c096d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:45.250949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3133352-40d5-45e2-a680-51b9b21c096d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:45.251395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c3133352-40d5-45e2-a680-51b9b21c096d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:45.407186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c3133352-40d5-45e2-a680-51b9b21c096d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:45.419199 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c3133352-40d5-45e2-a680-51b9b21c096d tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1506 microversion: 2.1 time: 0.183988 Jul 26 15:03:45.432236 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3106/6329] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:45 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:45.442557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-767e9400-cf5e-4798-b6c0-58342db7a2b1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:45.443338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-767e9400-cf5e-4798-b6c0-58342db7a2b1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:45.445524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:45.446580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=10 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:45.455440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-767e9400-cf5e-4798-b6c0-58342db7a2b1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:45.455878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-767e9400-cf5e-4798-b6c0-58342db7a2b1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:45.456708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-767e9400-cf5e-4798-b6c0-58342db7a2b1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:45.457855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-767e9400-cf5e-4798-b6c0-58342db7a2b1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:45.612569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-767e9400-cf5e-4798-b6c0-58342db7a2b1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:45.614853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:45.624193 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-767e9400-cf5e-4798-b6c0-58342db7a2b1 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1506 microversion: 2.1 time: 0.185201 Jul 26 15:03:45.624473 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3224/6330] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:45 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:45.645010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:45.648104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:45.654606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:45.655058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:45.655841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:45.656319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:45.688196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:45.697003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Old instance type m1.heat2, new instance type m1.heat {{(pid=119478) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 15:03:45.703712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:03:45.704163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:03:45.704646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:03:45.705056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:03:45.705470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:03:45.776172 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce039797-799f-4dd9-9902-65349e536242 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "POST /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382/action" status: 202 len: 0 microversion: 2.1 time: 0.135214 Jul 26 15:03:45.777124 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3107/6331] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:03:45 2022] POST /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:03:45.785257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5e7014ee-be3d-4e30-9859-30b5689ce858 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:45.785894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5e7014ee-be3d-4e30-9859-30b5689ce858 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:45.793335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e7014ee-be3d-4e30-9859-30b5689ce858 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:45.793817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e7014ee-be3d-4e30-9859-30b5689ce858 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:45.794746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e7014ee-be3d-4e30-9859-30b5689ce858 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:45.795209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5e7014ee-be3d-4e30-9859-30b5689ce858 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:45.945927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5e7014ee-be3d-4e30-9859-30b5689ce858 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:45.952986 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5e7014ee-be3d-4e30-9859-30b5689ce858 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1513 microversion: 2.1 time: 0.171596 Jul 26 15:03:45.953773 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3225/6332] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:45 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:46.977863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1bbf31c9-396e-45f1-b75f-ddcca9fdd0b8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:46.978451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1bbf31c9-396e-45f1-b75f-ddcca9fdd0b8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:46.985019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bbf31c9-396e-45f1-b75f-ddcca9fdd0b8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:46.985761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bbf31c9-396e-45f1-b75f-ddcca9fdd0b8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:46.986602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bbf31c9-396e-45f1-b75f-ddcca9fdd0b8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:46.987056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bbf31c9-396e-45f1-b75f-ddcca9fdd0b8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:47.130728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1bbf31c9-396e-45f1-b75f-ddcca9fdd0b8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:47.138745 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1bbf31c9-396e-45f1-b75f-ddcca9fdd0b8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1513 microversion: 2.1 time: 0.167766 Jul 26 15:03:47.139329 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3108/6333] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:46 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:48.160800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-34a6e3d0-c1ea-4e21-b4eb-15c601080dd5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:48.161439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-34a6e3d0-c1ea-4e21-b4eb-15c601080dd5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:48.170854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34a6e3d0-c1ea-4e21-b4eb-15c601080dd5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:48.171334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34a6e3d0-c1ea-4e21-b4eb-15c601080dd5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:48.172465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34a6e3d0-c1ea-4e21-b4eb-15c601080dd5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:48.173026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-34a6e3d0-c1ea-4e21-b4eb-15c601080dd5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:48.307845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-34a6e3d0-c1ea-4e21-b4eb-15c601080dd5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:48.315510 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-34a6e3d0-c1ea-4e21-b4eb-15c601080dd5 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.158681 Jul 26 15:03:48.316105 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3226/6334] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:48 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:49.337123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e3bb2beb-90eb-487a-bf47-f64b9f44ac44 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:49.337731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e3bb2beb-90eb-487a-bf47-f64b9f44ac44 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:49.344850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3bb2beb-90eb-487a-bf47-f64b9f44ac44 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:49.345304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3bb2beb-90eb-487a-bf47-f64b9f44ac44 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:49.346070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3bb2beb-90eb-487a-bf47-f64b9f44ac44 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:49.346511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e3bb2beb-90eb-487a-bf47-f64b9f44ac44 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:49.483856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e3bb2beb-90eb-487a-bf47-f64b9f44ac44 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:49.491806 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e3bb2beb-90eb-487a-bf47-f64b9f44ac44 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.158729 Jul 26 15:03:49.492792 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3109/6335] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:49 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:50.513990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9f9c93e2-012f-406b-920b-37bdae1d5270 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:50.514622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9f9c93e2-012f-406b-920b-37bdae1d5270 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:50.521602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f9c93e2-012f-406b-920b-37bdae1d5270 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:50.522077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f9c93e2-012f-406b-920b-37bdae1d5270 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:50.522861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f9c93e2-012f-406b-920b-37bdae1d5270 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:50.523355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f9c93e2-012f-406b-920b-37bdae1d5270 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:50.661496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9f9c93e2-012f-406b-920b-37bdae1d5270 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:50.670564 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9f9c93e2-012f-406b-920b-37bdae1d5270 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.160535 Jul 26 15:03:50.671142 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3227/6336] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:50 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:51.692140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-218c5764-78a9-47b4-8535-cfda97809afc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:51.692765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-218c5764-78a9-47b4-8535-cfda97809afc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:51.700166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-218c5764-78a9-47b4-8535-cfda97809afc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:51.700626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-218c5764-78a9-47b4-8535-cfda97809afc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:51.701404 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-218c5764-78a9-47b4-8535-cfda97809afc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:51.701846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-218c5764-78a9-47b4-8535-cfda97809afc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:51.837877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-218c5764-78a9-47b4-8535-cfda97809afc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:51.841011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:51.855416 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-218c5764-78a9-47b4-8535-cfda97809afc tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.166541 Jul 26 15:03:51.855625 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3110/6337] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:51 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:52.877907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fd25ec3c-26ac-4f9c-83c3-1d59c7c22177 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:52.878632 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fd25ec3c-26ac-4f9c-83c3-1d59c7c22177 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:52.887679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd25ec3c-26ac-4f9c-83c3-1d59c7c22177 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:52.888210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd25ec3c-26ac-4f9c-83c3-1d59c7c22177 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:52.889025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd25ec3c-26ac-4f9c-83c3-1d59c7c22177 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:52.889489 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd25ec3c-26ac-4f9c-83c3-1d59c7c22177 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:53.025115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fd25ec3c-26ac-4f9c-83c3-1d59c7c22177 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:53.032841 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fd25ec3c-26ac-4f9c-83c3-1d59c7c22177 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.159356 Jul 26 15:03:53.033406 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3228/6338] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:52 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:54.053444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bd4ccb79-2372-46bb-bc26-d7674219a2c4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:54.054063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bd4ccb79-2372-46bb-bc26-d7674219a2c4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:54.062588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd4ccb79-2372-46bb-bc26-d7674219a2c4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:54.063036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd4ccb79-2372-46bb-bc26-d7674219a2c4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:54.063800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd4ccb79-2372-46bb-bc26-d7674219a2c4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:54.064260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bd4ccb79-2372-46bb-bc26-d7674219a2c4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:54.201826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bd4ccb79-2372-46bb-bc26-d7674219a2c4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:54.209467 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bd4ccb79-2372-46bb-bc26-d7674219a2c4 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.159883 Jul 26 15:03:54.210033 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3111/6339] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:54 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:55.233343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-256de0e1-7b8c-49b8-a88c-2b29a404d6e8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:55.234070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-256de0e1-7b8c-49b8-a88c-2b29a404d6e8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:55.240428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-256de0e1-7b8c-49b8-a88c-2b29a404d6e8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:55.240903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-256de0e1-7b8c-49b8-a88c-2b29a404d6e8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:55.241698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-256de0e1-7b8c-49b8-a88c-2b29a404d6e8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:55.242157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-256de0e1-7b8c-49b8-a88c-2b29a404d6e8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:55.374648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-256de0e1-7b8c-49b8-a88c-2b29a404d6e8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:55.382279 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-256de0e1-7b8c-49b8-a88c-2b29a404d6e8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.154065 Jul 26 15:03:55.382852 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3229/6340] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:55 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:56.403662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eaad0d50-a902-4f00-baec-273f1f0ebb6f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:56.404333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eaad0d50-a902-4f00-baec-273f1f0ebb6f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:56.411371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaad0d50-a902-4f00-baec-273f1f0ebb6f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:56.411818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaad0d50-a902-4f00-baec-273f1f0ebb6f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:56.412627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaad0d50-a902-4f00-baec-273f1f0ebb6f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:56.413065 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eaad0d50-a902-4f00-baec-273f1f0ebb6f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:56.550777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-eaad0d50-a902-4f00-baec-273f1f0ebb6f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:56.559381 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eaad0d50-a902-4f00-baec-273f1f0ebb6f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.160589 Jul 26 15:03:56.559972 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3112/6341] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:56 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:57.581811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-35be8dd0-ae0b-4e1f-abb4-12bea3531c82 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:57.582368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-35be8dd0-ae0b-4e1f-abb4-12bea3531c82 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:57.590708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35be8dd0-ae0b-4e1f-abb4-12bea3531c82 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:57.591179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35be8dd0-ae0b-4e1f-abb4-12bea3531c82 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:57.592064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35be8dd0-ae0b-4e1f-abb4-12bea3531c82 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:57.592527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35be8dd0-ae0b-4e1f-abb4-12bea3531c82 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:57.725044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35be8dd0-ae0b-4e1f-abb4-12bea3531c82 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:57.733515 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-35be8dd0-ae0b-4e1f-abb4-12bea3531c82 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.155603 Jul 26 15:03:57.733983 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3230/6342] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:57 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:58.755894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b78acd1d-b201-45e2-8ddf-c49406b5bb9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:58.756855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b78acd1d-b201-45e2-8ddf-c49406b5bb9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:58.764001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b78acd1d-b201-45e2-8ddf-c49406b5bb9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:58.764458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b78acd1d-b201-45e2-8ddf-c49406b5bb9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:58.765239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b78acd1d-b201-45e2-8ddf-c49406b5bb9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:58.765686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b78acd1d-b201-45e2-8ddf-c49406b5bb9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:58.900994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b78acd1d-b201-45e2-8ddf-c49406b5bb9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:58.908724 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b78acd1d-b201-45e2-8ddf-c49406b5bb9f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.157071 Jul 26 15:03:58.909322 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3113/6343] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:58 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:59.931595 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e798fa45-8104-403d-b1b0-2289619184b0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:59.932462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e798fa45-8104-403d-b1b0-2289619184b0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:59.935216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:59.940563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e798fa45-8104-403d-b1b0-2289619184b0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:59.941042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e798fa45-8104-403d-b1b0-2289619184b0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:59.941843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e798fa45-8104-403d-b1b0-2289619184b0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:59.942305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e798fa45-8104-403d-b1b0-2289619184b0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:00.084575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e798fa45-8104-403d-b1b0-2289619184b0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:00.093018 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e798fa45-8104-403d-b1b0-2289619184b0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.166185 Jul 26 15:04:00.093593 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3231/6344] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:59 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:01.114757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cf6ee3b9-86a6-4f44-b2cd-41b39d3c289f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:01.115391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cf6ee3b9-86a6-4f44-b2cd-41b39d3c289f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:01.118153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:01.123685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf6ee3b9-86a6-4f44-b2cd-41b39d3c289f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:01.124178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf6ee3b9-86a6-4f44-b2cd-41b39d3c289f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:01.124972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf6ee3b9-86a6-4f44-b2cd-41b39d3c289f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:01.125417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cf6ee3b9-86a6-4f44-b2cd-41b39d3c289f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:01.260245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cf6ee3b9-86a6-4f44-b2cd-41b39d3c289f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:01.268843 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cf6ee3b9-86a6-4f44-b2cd-41b39d3c289f tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.157982 Jul 26 15:04:01.269639 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3114/6345] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:01 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:02.290740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ccbbd927-2302-4366-afea-442bdca39790 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:02.291998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ccbbd927-2302-4366-afea-442bdca39790 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:02.299298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccbbd927-2302-4366-afea-442bdca39790 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:02.299772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccbbd927-2302-4366-afea-442bdca39790 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:02.300601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccbbd927-2302-4366-afea-442bdca39790 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:02.301061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccbbd927-2302-4366-afea-442bdca39790 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:02.437947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ccbbd927-2302-4366-afea-442bdca39790 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:02.445622 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ccbbd927-2302-4366-afea-442bdca39790 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.158908 Jul 26 15:04:02.446202 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3232/6346] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:02 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:03.467755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6cb9ff6e-5d0f-4be4-aa98-c5ff3d8d6140 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:03.468397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6cb9ff6e-5d0f-4be4-aa98-c5ff3d8d6140 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:03.475234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6cb9ff6e-5d0f-4be4-aa98-c5ff3d8d6140 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:03.475686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6cb9ff6e-5d0f-4be4-aa98-c5ff3d8d6140 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:03.476609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6cb9ff6e-5d0f-4be4-aa98-c5ff3d8d6140 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:03.477043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6cb9ff6e-5d0f-4be4-aa98-c5ff3d8d6140 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:03.611218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6cb9ff6e-5d0f-4be4-aa98-c5ff3d8d6140 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:03.618688 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6cb9ff6e-5d0f-4be4-aa98-c5ff3d8d6140 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.154923 Jul 26 15:04:03.619378 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3115/6347] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:03 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:04.640476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9fd75263-dfae-4e91-a19f-73c1a9bee553 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:04.641148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9fd75263-dfae-4e91-a19f-73c1a9bee553 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:04.648175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fd75263-dfae-4e91-a19f-73c1a9bee553 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:04.648688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fd75263-dfae-4e91-a19f-73c1a9bee553 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:04.649476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fd75263-dfae-4e91-a19f-73c1a9bee553 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:04.649936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9fd75263-dfae-4e91-a19f-73c1a9bee553 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:04.790299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9fd75263-dfae-4e91-a19f-73c1a9bee553 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:04.798102 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9fd75263-dfae-4e91-a19f-73c1a9bee553 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.161601 Jul 26 15:04:04.798683 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3233/6348] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:04 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:05.821397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4df81ac3-3782-4b0e-992a-c0fac42acea0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:05.822515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4df81ac3-3782-4b0e-992a-c0fac42acea0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:05.829725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4df81ac3-3782-4b0e-992a-c0fac42acea0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:05.830181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4df81ac3-3782-4b0e-992a-c0fac42acea0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:05.830951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4df81ac3-3782-4b0e-992a-c0fac42acea0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:05.831390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4df81ac3-3782-4b0e-992a-c0fac42acea0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:05.964352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4df81ac3-3782-4b0e-992a-c0fac42acea0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:05.972181 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4df81ac3-3782-4b0e-992a-c0fac42acea0 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.155352 Jul 26 15:04:05.972754 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3116/6349] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:05 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:06.995565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2b154dbb-c14f-4542-a358-4917c7434871 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:06.996250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2b154dbb-c14f-4542-a358-4917c7434871 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:07.004193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b154dbb-c14f-4542-a358-4917c7434871 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:07.004812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b154dbb-c14f-4542-a358-4917c7434871 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:07.005609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b154dbb-c14f-4542-a358-4917c7434871 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:07.006062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b154dbb-c14f-4542-a358-4917c7434871 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:07.146907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2b154dbb-c14f-4542-a358-4917c7434871 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:07.155002 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2b154dbb-c14f-4542-a358-4917c7434871 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.163930 Jul 26 15:04:07.155582 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3234/6350] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:06 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:08.176106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-361b7ae2-16b3-4706-a024-6b99d347f41c tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:08.176787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-361b7ae2-16b3-4706-a024-6b99d347f41c tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:08.184855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-361b7ae2-16b3-4706-a024-6b99d347f41c tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:08.185317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-361b7ae2-16b3-4706-a024-6b99d347f41c tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:08.186095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-361b7ae2-16b3-4706-a024-6b99d347f41c tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:08.186544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-361b7ae2-16b3-4706-a024-6b99d347f41c tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:08.315904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-361b7ae2-16b3-4706-a024-6b99d347f41c tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:08.323481 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-361b7ae2-16b3-4706-a024-6b99d347f41c tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.151373 Jul 26 15:04:08.324068 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3117/6351] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:08 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:09.344055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b2678b44-d509-4d49-998f-7634ece4ff4e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:09.344691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b2678b44-d509-4d49-998f-7634ece4ff4e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:09.351748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b2678b44-d509-4d49-998f-7634ece4ff4e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:09.352339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b2678b44-d509-4d49-998f-7634ece4ff4e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:09.353271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b2678b44-d509-4d49-998f-7634ece4ff4e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:09.353731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b2678b44-d509-4d49-998f-7634ece4ff4e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:09.483382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b2678b44-d509-4d49-998f-7634ece4ff4e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:09.490906 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b2678b44-d509-4d49-998f-7634ece4ff4e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.150822 Jul 26 15:04:09.491479 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3235/6352] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:09 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:10.514281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d4d5ce94-6edd-4224-825c-4f9a59edb84b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:10.514905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d4d5ce94-6edd-4224-825c-4f9a59edb84b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:10.521835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4d5ce94-6edd-4224-825c-4f9a59edb84b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:10.522296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4d5ce94-6edd-4224-825c-4f9a59edb84b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:10.523072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4d5ce94-6edd-4224-825c-4f9a59edb84b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:10.523519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d4d5ce94-6edd-4224-825c-4f9a59edb84b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:10.662126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d4d5ce94-6edd-4224-825c-4f9a59edb84b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:10.670257 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d4d5ce94-6edd-4224-825c-4f9a59edb84b tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.160088 Jul 26 15:04:10.670883 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3118/6353] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:10 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:11.692236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1afe4563-d598-4452-80cf-ba0155e2c778 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:11.692807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1afe4563-d598-4452-80cf-ba0155e2c778 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:11.700017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1afe4563-d598-4452-80cf-ba0155e2c778 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:11.700495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1afe4563-d598-4452-80cf-ba0155e2c778 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:11.701291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1afe4563-d598-4452-80cf-ba0155e2c778 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:11.701758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1afe4563-d598-4452-80cf-ba0155e2c778 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:11.832170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1afe4563-d598-4452-80cf-ba0155e2c778 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:11.841062 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1afe4563-d598-4452-80cf-ba0155e2c778 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.153057 Jul 26 15:04:11.841647 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3236/6354] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:11 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:12.862647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-282f755f-f882-4a80-a701-8aaf07f58f42 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:12.863196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-282f755f-f882-4a80-a701-8aaf07f58f42 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:12.869680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-282f755f-f882-4a80-a701-8aaf07f58f42 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:12.870136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-282f755f-f882-4a80-a701-8aaf07f58f42 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:12.870902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-282f755f-f882-4a80-a701-8aaf07f58f42 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:12.871376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-282f755f-f882-4a80-a701-8aaf07f58f42 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:13.012894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-282f755f-f882-4a80-a701-8aaf07f58f42 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:13.021288 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-282f755f-f882-4a80-a701-8aaf07f58f42 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.162595 Jul 26 15:04:13.021874 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3119/6355] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:12 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:14.047977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-be9ca47e-9bc5-4d65-828f-c00e1d1e9b7a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:14.048696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-be9ca47e-9bc5-4d65-828f-c00e1d1e9b7a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:14.055150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be9ca47e-9bc5-4d65-828f-c00e1d1e9b7a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:14.055693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be9ca47e-9bc5-4d65-828f-c00e1d1e9b7a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:14.057111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be9ca47e-9bc5-4d65-828f-c00e1d1e9b7a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:14.057568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be9ca47e-9bc5-4d65-828f-c00e1d1e9b7a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:14.197409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-be9ca47e-9bc5-4d65-828f-c00e1d1e9b7a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:14.205046 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-be9ca47e-9bc5-4d65-828f-c00e1d1e9b7a tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1518 microversion: 2.1 time: 0.166182 Jul 26 15:04:14.205616 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3237/6356] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:14 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:15.226912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5a9a94ab-eeae-4694-b571-7bdf688f0bcb tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:15.228281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5a9a94ab-eeae-4694-b571-7bdf688f0bcb tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:15.235586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a9a94ab-eeae-4694-b571-7bdf688f0bcb tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:15.236073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a9a94ab-eeae-4694-b571-7bdf688f0bcb tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:15.236853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a9a94ab-eeae-4694-b571-7bdf688f0bcb tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:15.237295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a9a94ab-eeae-4694-b571-7bdf688f0bcb tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:15.517794 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5a9a94ab-eeae-4694-b571-7bdf688f0bcb tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:15.526634 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5a9a94ab-eeae-4694-b571-7bdf688f0bcb tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1517 microversion: 2.1 time: 0.303518 Jul 26 15:04:15.527231 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3120/6357] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:15 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1517 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:15.529265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-17efc8d3-b41c-4b67-a299-f7b77f4f8036 req-96590bfe-5a4b-4f74-a599-3dc24801c625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60f8bd9-d460-4a80-ba26-61e5cd138382", "name": "network-vif-unplugged", "status": "completed", "tag": "e9077eb0-43bb-48cb-81ef-4b3f3b7594c1"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:15.539458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-17efc8d3-b41c-4b67-a299-f7b77f4f8036 req-96590bfe-5a4b-4f74-a599-3dc24801c625 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:15.540533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-17efc8d3-b41c-4b67-a299-f7b77f4f8036 req-96590bfe-5a4b-4f74-a599-3dc24801c625 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:15.553947 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-17efc8d3-b41c-4b67-a299-f7b77f4f8036 req-96590bfe-5a4b-4f74-a599-3dc24801c625 service nova] Creating event network-vif-unplugged:e9077eb0-43bb-48cb-81ef-4b3f3b7594c1 for instance e60f8bd9-d460-4a80-ba26-61e5cd138382 on n-h2-833090-9 Jul 26 15:04:15.560983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-17efc8d3-b41c-4b67-a299-f7b77f4f8036 req-96590bfe-5a4b-4f74-a599-3dc24801c625 service nova] Instance e60f8bd9-d460-4a80-ba26-61e5cd138382 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:04:15.573321 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-17efc8d3-b41c-4b67-a299-f7b77f4f8036 req-96590bfe-5a4b-4f74-a599-3dc24801c625 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049656 Jul 26 15:04:15.573964 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3238/6358] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:04:16.553155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1bfae5f3-b8ff-4cf7-b617-fd3c9ee4df6e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:16.553779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1bfae5f3-b8ff-4cf7-b617-fd3c9ee4df6e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:16.562040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bfae5f3-b8ff-4cf7-b617-fd3c9ee4df6e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:16.562497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bfae5f3-b8ff-4cf7-b617-fd3c9ee4df6e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:16.563288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bfae5f3-b8ff-4cf7-b617-fd3c9ee4df6e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:16.563733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bfae5f3-b8ff-4cf7-b617-fd3c9ee4df6e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:16.707367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1bfae5f3-b8ff-4cf7-b617-fd3c9ee4df6e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:16.715311 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1bfae5f3-b8ff-4cf7-b617-fd3c9ee4df6e tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1515 microversion: 2.1 time: 0.166063 Jul 26 15:04:16.715902 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3121/6359] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:16 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:17.599776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-33c71e26-2a71-478a-8364-0a110015e8c4 req-b4c57b65-7e34-47ba-9945-aa90a777b51a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60f8bd9-d460-4a80-ba26-61e5cd138382", "tag": "e9077eb0-43bb-48cb-81ef-4b3f3b7594c1"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:17.610365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-33c71e26-2a71-478a-8364-0a110015e8c4 req-b4c57b65-7e34-47ba-9945-aa90a777b51a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:17.610842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-33c71e26-2a71-478a-8364-0a110015e8c4 req-b4c57b65-7e34-47ba-9945-aa90a777b51a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:17.613600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=84 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:17.627613 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-33c71e26-2a71-478a-8364-0a110015e8c4 req-b4c57b65-7e34-47ba-9945-aa90a777b51a service nova] Creating event network-changed:e9077eb0-43bb-48cb-81ef-4b3f3b7594c1 for instance e60f8bd9-d460-4a80-ba26-61e5cd138382 on n-h2-833090-9 Jul 26 15:04:17.633312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-33c71e26-2a71-478a-8364-0a110015e8c4 req-b4c57b65-7e34-47ba-9945-aa90a777b51a service nova] Instance e60f8bd9-d460-4a80-ba26-61e5cd138382 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:04:17.645458 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-33c71e26-2a71-478a-8364-0a110015e8c4 req-b4c57b65-7e34-47ba-9945-aa90a777b51a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050583 Jul 26 15:04:17.646133 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3239/6360] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:04:17.743412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-029dd9a4-df76-4119-8748-4caf8c0a33e3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:17.747292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-029dd9a4-df76-4119-8748-4caf8c0a33e3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:17.768718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-029dd9a4-df76-4119-8748-4caf8c0a33e3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:17.769538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-029dd9a4-df76-4119-8748-4caf8c0a33e3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:17.772801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-029dd9a4-df76-4119-8748-4caf8c0a33e3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:17.776449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-029dd9a4-df76-4119-8748-4caf8c0a33e3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:18.053525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-029dd9a4-df76-4119-8748-4caf8c0a33e3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:18.067355 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-029dd9a4-df76-4119-8748-4caf8c0a33e3 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1515 microversion: 2.1 time: 0.333215 Jul 26 15:04:18.073865 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3122/6361] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:17 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1515 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:19.091563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e3b5a525-e1da-4403-808a-82f062a64853 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:19.092386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e3b5a525-e1da-4403-808a-82f062a64853 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:19.098740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3b5a525-e1da-4403-808a-82f062a64853 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:19.099211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3b5a525-e1da-4403-808a-82f062a64853 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:19.100027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3b5a525-e1da-4403-808a-82f062a64853 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:19.100520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e3b5a525-e1da-4403-808a-82f062a64853 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:19.237182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e3b5a525-e1da-4403-808a-82f062a64853 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:19.244971 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e3b5a525-e1da-4403-808a-82f062a64853 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1512 microversion: 2.1 time: 0.159636 Jul 26 15:04:19.245555 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3240/6362] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:19 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:19.266765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a24bc60a-6197-4524-a407-8f296321c478 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:19.267302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a24bc60a-6197-4524-a407-8f296321c478 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:19.274899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a24bc60a-6197-4524-a407-8f296321c478 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:19.275345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a24bc60a-6197-4524-a407-8f296321c478 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:19.276135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a24bc60a-6197-4524-a407-8f296321c478 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:19.276569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a24bc60a-6197-4524-a407-8f296321c478 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:19.337873 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a24bc60a-6197-4524-a407-8f296321c478 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "POST /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382/action" status: 204 len: 0 microversion: 2.1 time: 0.073989 Jul 26 15:04:19.338400 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3123/6363] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:04:19 2022] POST /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:04:19.346947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae73a656-efbb-4acd-9715-f09b2e16da06 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:19.347517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ae73a656-efbb-4acd-9715-f09b2e16da06 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:19.354018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae73a656-efbb-4acd-9715-f09b2e16da06 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:19.354525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae73a656-efbb-4acd-9715-f09b2e16da06 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:19.355333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae73a656-efbb-4acd-9715-f09b2e16da06 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:19.355791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae73a656-efbb-4acd-9715-f09b2e16da06 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:19.502722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ae73a656-efbb-4acd-9715-f09b2e16da06 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:19.511269 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ae73a656-efbb-4acd-9715-f09b2e16da06 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1512 microversion: 2.1 time: 0.168378 Jul 26 15:04:19.511998 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3241/6364] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:19 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:19.886410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-88c91c20-1134-4775-aaa7-7f6e755cacf3 req-438f3b7b-93ea-4083-94de-317c03a6cd69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60f8bd9-d460-4a80-ba26-61e5cd138382", "name": "network-vif-plugged", "status": "completed", "tag": "e9077eb0-43bb-48cb-81ef-4b3f3b7594c1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:19.897636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-88c91c20-1134-4775-aaa7-7f6e755cacf3 req-438f3b7b-93ea-4083-94de-317c03a6cd69 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:19.898225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-88c91c20-1134-4775-aaa7-7f6e755cacf3 req-438f3b7b-93ea-4083-94de-317c03a6cd69 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:19.910605 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-88c91c20-1134-4775-aaa7-7f6e755cacf3 req-438f3b7b-93ea-4083-94de-317c03a6cd69 service nova] Creating event network-vif-plugged:e9077eb0-43bb-48cb-81ef-4b3f3b7594c1 for instance e60f8bd9-d460-4a80-ba26-61e5cd138382 on n-h2-833090-9 Jul 26 15:04:19.918422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-88c91c20-1134-4775-aaa7-7f6e755cacf3 req-438f3b7b-93ea-4083-94de-317c03a6cd69 service nova] Instance e60f8bd9-d460-4a80-ba26-61e5cd138382 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:04:19.931569 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-88c91c20-1134-4775-aaa7-7f6e755cacf3 req-438f3b7b-93ea-4083-94de-317c03a6cd69 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052258 Jul 26 15:04:19.932666 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3124/6365] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:04:20.532667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1ff9e799-15e7-4f4d-a778-fdee9adb7530 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:20.533328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1ff9e799-15e7-4f4d-a778-fdee9adb7530 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:20.540263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ff9e799-15e7-4f4d-a778-fdee9adb7530 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:20.540750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ff9e799-15e7-4f4d-a778-fdee9adb7530 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:20.541551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ff9e799-15e7-4f4d-a778-fdee9adb7530 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:20.542020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1ff9e799-15e7-4f4d-a778-fdee9adb7530 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:20.686845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1ff9e799-15e7-4f4d-a778-fdee9adb7530 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:20.694474 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1ff9e799-15e7-4f4d-a778-fdee9adb7530 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1504 microversion: 2.1 time: 0.165761 Jul 26 15:04:20.695223 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3242/6366] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:20 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:20.717330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ab4ea1a6-76fe-4bb0-9b7e-2ba7ecdd6f65 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:20.718047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ab4ea1a6-76fe-4bb0-9b7e-2ba7ecdd6f65 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:20.725078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab4ea1a6-76fe-4bb0-9b7e-2ba7ecdd6f65 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:20.725534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab4ea1a6-76fe-4bb0-9b7e-2ba7ecdd6f65 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:20.726420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab4ea1a6-76fe-4bb0-9b7e-2ba7ecdd6f65 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:20.726869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab4ea1a6-76fe-4bb0-9b7e-2ba7ecdd6f65 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:20.863038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ab4ea1a6-76fe-4bb0-9b7e-2ba7ecdd6f65 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:20.871435 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ab4ea1a6-76fe-4bb0-9b7e-2ba7ecdd6f65 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1504 microversion: 2.1 time: 0.158479 Jul 26 15:04:20.872050 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3125/6367] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:20 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:20.893690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dd2ffea2-fc98-4c9e-80ca-31156acefb47 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:20.894321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dd2ffea2-fc98-4c9e-80ca-31156acefb47 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:20.900480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd2ffea2-fc98-4c9e-80ca-31156acefb47 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:20.900949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd2ffea2-fc98-4c9e-80ca-31156acefb47 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:20.901729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd2ffea2-fc98-4c9e-80ca-31156acefb47 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:20.902182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd2ffea2-fc98-4c9e-80ca-31156acefb47 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:21.035676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dd2ffea2-fc98-4c9e-80ca-31156acefb47 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:21.044108 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dd2ffea2-fc98-4c9e-80ca-31156acefb47 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1504 microversion: 2.1 time: 0.154228 Jul 26 15:04:21.044696 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3243/6368] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:20 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:21.064721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ab8400aa-53f5-4cfc-b7fc-d32264f087f8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:21.065225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ab8400aa-53f5-4cfc-b7fc-d32264f087f8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:21.071819 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab8400aa-53f5-4cfc-b7fc-d32264f087f8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:21.072293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab8400aa-53f5-4cfc-b7fc-d32264f087f8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:21.073053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab8400aa-53f5-4cfc-b7fc-d32264f087f8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:21.073519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ab8400aa-53f5-4cfc-b7fc-d32264f087f8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:21.091357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:21.099410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ab8400aa-53f5-4cfc-b7fc-d32264f087f8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:04:21.177818 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ab8400aa-53f5-4cfc-b7fc-d32264f087f8 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 204 len: 0 microversion: 2.1 time: 0.116603 Jul 26 15:04:21.178631 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3126/6369] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:04:21 2022] DELETE /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:04:21.198826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3c66f1b2-e6d9-4ce6-b4b2-47579cda7abd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:21.199346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3c66f1b2-e6d9-4ce6-b4b2-47579cda7abd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:21.206344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c66f1b2-e6d9-4ce6-b4b2-47579cda7abd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:21.206814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c66f1b2-e6d9-4ce6-b4b2-47579cda7abd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:21.207616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c66f1b2-e6d9-4ce6-b4b2-47579cda7abd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:21.208106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3c66f1b2-e6d9-4ce6-b4b2-47579cda7abd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:21.235658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3c66f1b2-e6d9-4ce6-b4b2-47579cda7abd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:04:21.285312 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.compute.api [None req-3c66f1b2-e6d9-4ce6-b4b2-47579cda7abd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Instance is already in deleting state, ignoring this request Jul 26 15:04:21.286176 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3c66f1b2-e6d9-4ce6-b4b2-47579cda7abd tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 204 len: 0 microversion: 2.1 time: 0.092234 Jul 26 15:04:21.286756 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3244/6370] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:04:21 2022] DELETE /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:04:21.296450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-395cbe52-750d-43e8-9ae5-d9ed3b4a0930 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:21.297163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-395cbe52-750d-43e8-9ae5-d9ed3b4a0930 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:21.303557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-395cbe52-750d-43e8-9ae5-d9ed3b4a0930 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:21.304040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-395cbe52-750d-43e8-9ae5-d9ed3b4a0930 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:21.305742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-395cbe52-750d-43e8-9ae5-d9ed3b4a0930 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:21.306645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-395cbe52-750d-43e8-9ae5-d9ed3b4a0930 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:21.454316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-395cbe52-750d-43e8-9ae5-d9ed3b4a0930 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:21.463552 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-395cbe52-750d-43e8-9ae5-d9ed3b4a0930 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1510 microversion: 2.1 time: 0.171418 Jul 26 15:04:21.464156 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3127/6371] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:21 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:22.484594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ed82dcc-867b-46f5-af5b-c4998b99ef66 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:22.485232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4ed82dcc-867b-46f5-af5b-c4998b99ef66 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:22.492250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ed82dcc-867b-46f5-af5b-c4998b99ef66 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:22.493433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ed82dcc-867b-46f5-af5b-c4998b99ef66 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:22.494267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ed82dcc-867b-46f5-af5b-c4998b99ef66 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:22.494733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ed82dcc-867b-46f5-af5b-c4998b99ef66 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:22.714708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4ed82dcc-867b-46f5-af5b-c4998b99ef66 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6ebda8ca0ad4cb58fabd6ce53c97882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f55629d889ba4cd9955417467280c90f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:22.722289 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4ed82dcc-867b-46f5-af5b-c4998b99ef66 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 200 len: 1510 microversion: 2.1 time: 0.241723 Jul 26 15:04:22.722867 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3245/6372] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:22 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 1510 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:23.073669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e67fef46-0ff8-477f-bcca-5c8f06692b16 req-cc5858df-2831-4aff-b5fd-607aa823ebf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60f8bd9-d460-4a80-ba26-61e5cd138382", "name": "network-vif-deleted", "tag": "e9077eb0-43bb-48cb-81ef-4b3f3b7594c1"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:23.084621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e67fef46-0ff8-477f-bcca-5c8f06692b16 req-cc5858df-2831-4aff-b5fd-607aa823ebf7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:23.085066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e67fef46-0ff8-477f-bcca-5c8f06692b16 req-cc5858df-2831-4aff-b5fd-607aa823ebf7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:23.100247 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e67fef46-0ff8-477f-bcca-5c8f06692b16 req-cc5858df-2831-4aff-b5fd-607aa823ebf7 service nova] Creating event network-vif-deleted:e9077eb0-43bb-48cb-81ef-4b3f3b7594c1 for instance e60f8bd9-d460-4a80-ba26-61e5cd138382 on n-h2-833090-9 Jul 26 15:04:23.110393 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e67fef46-0ff8-477f-bcca-5c8f06692b16 req-cc5858df-2831-4aff-b5fd-607aa823ebf7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040609 Jul 26 15:04:23.111718 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3128/6373] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:23.744729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a687783-6924-4b93-91ab-e6d9a276c515 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:23.745503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0a687783-6924-4b93-91ab-e6d9a276c515 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: e60f8bd9-d460-4a80-ba26-61e5cd138382] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:23.752422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a687783-6924-4b93-91ab-e6d9a276c515 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:23.752890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a687783-6924-4b93-91ab-e6d9a276c515 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:23.753669 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a687783-6924-4b93-91ab-e6d9a276c515 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:23.754121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a687783-6924-4b93-91ab-e6d9a276c515 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:23.768813 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-0a687783-6924-4b93-91ab-e6d9a276c515 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] HTTP exception thrown: Instance e60f8bd9-d460-4a80-ba26-61e5cd138382 could not be found. Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a687783-6924-4b93-91ab-e6d9a276c515 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Request method failure captured: Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 HTTP/1.1 Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AIXden1R9m_I5zvFLwY8QHwEa7yAOVDfd4vz87aH1bq7l8CjeObtznefYdSF6RpH9fHTbD9YrbcY3gqi8De0Rjc8s3cyocEOE0gknfQ0Ie5oj0wyrrXcKOgksiNOroIRdHMYB-Bt3HhCbBpHwKsWvuDZh99FIJktH11HC8Xhsly0RU Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f55629d889ba4cd9955417467280c90f Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1794655125 Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f55629d889ba4cd9955417467280c90f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f55629d889ba4cd9955417467280c90f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f55629d889ba4cd9955417467280c90f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f55629d889ba4cd9955417467280c90f"}]}] Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerDiskConfigTestJSON-1794655125 Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f55629d889ba4cd9955417467280c90f Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1794655125 Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerDiskConfigTestJSON-1794655125-project Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c6ebda8ca0ad4cb58fabd6ce53c97882 Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerDiskConfigTestJSON-1794655125-project Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance e60f8bd9-d460-4a80-ba26-61e5cd138382 could not be found. Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e60f8bd9-d460-4a80-ba26-61e5cd138382'} Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60f8bd9-d460-4a80-ba26-61e5cd138382 could not be found. Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60f8bd9-d460-4a80-ba26-61e5cd138382 could not be found. Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:23.770488 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:04:23.775976 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:23.775976 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:04:23.775976 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:04:23.775976 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:04:23.775976 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:04:23.775976 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60f8bd9-d460-4a80-ba26-61e5cd138382 could not be found. Jul 26 15:04:23.775976 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:04:23.775976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a687783-6924-4b93-91ab-e6d9a276c515 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Returning 404 to user: Instance e60f8bd9-d460-4a80-ba26-61e5cd138382 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:04:23.775976 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0a687783-6924-4b93-91ab-e6d9a276c515 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382" status: 404 len: 111 microversion: 2.1 time: 0.031933 Jul 26 15:04:23.775976 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3246/6374] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:23 2022] GET /compute/v2.1/servers/e60f8bd9-d460-4a80-ba26-61e5cd138382 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:04:23.781941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-83a470ff-8152-4310-9344-91c61460b966 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '.version_select at 0x7f87943ffd30>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:23.802005 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-83a470ff-8152-4310-9344-91c61460b966 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-739368058" status: 202 len: 0 microversion: 2.1 time: 0.024243 Jul 26 15:04:23.802581 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3129/6375] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Jul 26 15:04:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-739368058 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:04:24.412278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d407478d-8c93-404d-9c6b-490e1a463f35 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:24.413948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d407478d-8c93-404d-9c6b-490e1a463f35 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:24.423090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d407478d-8c93-404d-9c6b-490e1a463f35 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:24.423570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d407478d-8c93-404d-9c6b-490e1a463f35 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:24.424407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d407478d-8c93-404d-9c6b-490e1a463f35 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:24.424867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d407478d-8c93-404d-9c6b-490e1a463f35 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:24.442521 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d407478d-8c93-404d-9c6b-490e1a463f35 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] HTTP exception thrown: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d407478d-8c93-404d-9c6b-490e1a463f35 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Request method failure captured: Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 HTTP/1.1 Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AIXden1R9m_I5zvFLwY8QHwEa7yAOVDfd4vz87aH1bq7l8CjeObtznefYdSF6RpH9fHTbD9YrbcY3gqi8De0Rjc8s3cyocEOE0gknfQ0Ie5oj0wyrrXcKOgksiNOroIRdHMYB-Bt3HhCbBpHwKsWvuDZh99FIJktH11HC8Xhsly0RU Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: f55629d889ba4cd9955417467280c90f Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1794655125 Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f55629d889ba4cd9955417467280c90f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f55629d889ba4cd9955417467280c90f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f55629d889ba4cd9955417467280c90f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f55629d889ba4cd9955417467280c90f"}]}] Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerDiskConfigTestJSON-1794655125 Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: f55629d889ba4cd9955417467280c90f Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1794655125 Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerDiskConfigTestJSON-1794655125-project Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: c6ebda8ca0ad4cb58fabd6ce53c97882 Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerDiskConfigTestJSON-1794655125-project Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '18be207e-05c6-40f8-ac84-cc404b0d1e15'} Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:04:24.444151 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d407478d-8c93-404d-9c6b-490e1a463f35 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Returning 404 to user: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d407478d-8c93-404d-9c6b-490e1a463f35 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "DELETE /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 404 len: 111 microversion: 2.1 time: 0.040334 Jul 26 15:04:24.448608 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3247/6376] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:04:24 2022] DELETE /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:04:24.456248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-52d7f01d-a189-4d94-9f2d-90c35bbc09b9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:24.456995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-52d7f01d-a189-4d94-9f2d-90c35bbc09b9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] [instance: 18be207e-05c6-40f8-ac84-cc404b0d1e15] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:24.464705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-52d7f01d-a189-4d94-9f2d-90c35bbc09b9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:24.465157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-52d7f01d-a189-4d94-9f2d-90c35bbc09b9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:24.466051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-52d7f01d-a189-4d94-9f2d-90c35bbc09b9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:24.466485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-52d7f01d-a189-4d94-9f2d-90c35bbc09b9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:24.480260 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-52d7f01d-a189-4d94-9f2d-90c35bbc09b9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] HTTP exception thrown: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-52d7f01d-a189-4d94-9f2d-90c35bbc09b9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Request method failure captured: Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 HTTP/1.1 Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AIXden1R9m_I5zvFLwY8QHwEa7yAOVDfd4vz87aH1bq7l8CjeObtznefYdSF6RpH9fHTbD9YrbcY3gqi8De0Rjc8s3cyocEOE0gknfQ0Ie5oj0wyrrXcKOgksiNOroIRdHMYB-Bt3HhCbBpHwKsWvuDZh99FIJktH11HC8Xhsly0RU Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: f55629d889ba4cd9955417467280c90f Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1794655125 Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f55629d889ba4cd9955417467280c90f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f55629d889ba4cd9955417467280c90f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f55629d889ba4cd9955417467280c90f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f55629d889ba4cd9955417467280c90f"}]}] Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerDiskConfigTestJSON-1794655125 Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: f55629d889ba4cd9955417467280c90f Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1794655125 Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerDiskConfigTestJSON-1794655125-project Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: c6ebda8ca0ad4cb58fabd6ce53c97882 Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerDiskConfigTestJSON-1794655125-project Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '18be207e-05c6-40f8-ac84-cc404b0d1e15'} Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:24.481902 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:04:24.485620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:24.485620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:04:24.485620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:04:24.485620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:04:24.485620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:04:24.485620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. Jul 26 15:04:24.485620 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:04:24.485620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-52d7f01d-a189-4d94-9f2d-90c35bbc09b9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] Returning 404 to user: Instance 18be207e-05c6-40f8-ac84-cc404b0d1e15 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:04:24.485620 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-52d7f01d-a189-4d94-9f2d-90c35bbc09b9 tempest-ServerDiskConfigTestJSON-1794655125 tempest-ServerDiskConfigTestJSON-1794655125-project] 10.222.0.70 "GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15" status: 404 len: 111 microversion: 2.1 time: 0.031866 Jul 26 15:04:24.485620 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3130/6377] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:24 2022] GET /compute/v2.1/servers/18be207e-05c6-40f8-ac84-cc404b0d1e15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:04:33.507411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0e66179a-991a-4fdb-9f92-e6e418af09ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'create', calling method: .version_select at 0x7f879942b670>, body: {"keypair": {"name": "tempest-keypair-41852955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqvYn9DykqAscFJm9vDeKHBvI5ICIga2Omfqa0UMGXwhMvzOr9p9lZSoS12+P6ME4rx9UHXu12WKp0Anjvp4N1BlvCXxWMWNJP2yAWWPR1f7nT/Pck3rDtqICpWYLh3Dw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:33.513248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=34 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:33.525590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-0e66179a-991a-4fdb-9f92-e6e418af09ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:04:33.530644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-0e66179a-991a-4fdb-9f92-e6e418af09ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for user b5b34650cfc14e69ace08e3a0be3ca06 and project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:04:33.556060 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0e66179a-991a-4fdb-9f92-e6e418af09ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.170803 Jul 26 15:04:33.556662 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3248/6378] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:04:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:34.877682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-5022345", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "66cb7b7e-a81f-4c0f-acf4-78a073c427bb"}], "security_groups": [{"name": "tempest-securitygroup--502582096"}], "key_name": "tempest-keypair-41852955", "user_data": "}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:34.887526 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:34.888632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:34.998751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] validate_networks() for [('66cb7b7e-a81f-4c0f-acf4-78a073c427bb', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:04:35.410869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:04:35.411485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:04:35.411997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:04:35.412564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:04:35.412982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:04:35.436024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:35.436620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:35.437489 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:35.437926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:35.463615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:04:35.470196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for user b5b34650cfc14e69ace08e3a0be3ca06 and project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:04:35.485302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:04:35.487632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:04:35.543638 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f41460b2-dff7-4add-8902-7c1d49961dc4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.671404 Jul 26 15:04:35.550329 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3131/6379] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:04:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:04:35.558319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7112aa5e-4b37-40b3-9c4c-2027787b492f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:35.559301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7112aa5e-4b37-40b3-9c4c-2027787b492f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:35.563381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:35.635776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7112aa5e-4b37-40b3-9c4c-2027787b492f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:35.645845 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7112aa5e-4b37-40b3-9c4c-2027787b492f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1234 microversion: 2.1 time: 0.094364 Jul 26 15:04:35.646975 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3249/6380] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:35 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1234 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:36.668632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7d5358d8-0c6e-4733-a430-9d5001543f9d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:36.669370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7d5358d8-0c6e-4733-a430-9d5001543f9d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:36.677851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d5358d8-0c6e-4733-a430-9d5001543f9d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:36.678412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d5358d8-0c6e-4733-a430-9d5001543f9d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:36.680468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d5358d8-0c6e-4733-a430-9d5001543f9d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:36.681100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7d5358d8-0c6e-4733-a430-9d5001543f9d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:36.754327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7d5358d8-0c6e-4733-a430-9d5001543f9d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:36.764274 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7d5358d8-0c6e-4733-a430-9d5001543f9d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1286 microversion: 2.1 time: 0.101139 Jul 26 15:04:36.764904 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3132/6381] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:36 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:37.785841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b4b1c91-724f-4f14-8c1d-084607c67ecc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:37.786495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7b4b1c91-724f-4f14-8c1d-084607c67ecc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:37.794840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b4b1c91-724f-4f14-8c1d-084607c67ecc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:37.795318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b4b1c91-724f-4f14-8c1d-084607c67ecc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:37.796168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b4b1c91-724f-4f14-8c1d-084607c67ecc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:37.796634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b4b1c91-724f-4f14-8c1d-084607c67ecc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:38.023327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b4b1c91-724f-4f14-8c1d-084607c67ecc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:38.031579 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b4b1c91-724f-4f14-8c1d-084607c67ecc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1359 microversion: 2.1 time: 0.249556 Jul 26 15:04:38.032284 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3250/6382] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:37 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:38.423351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-34df65c4-f27e-4424-9066-f6a8e026ebf3 req-8e0c4eea-a6ec-4ee3-beb5-ea0c371b8cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e52e3e20-e30f-4c35-bf18-07a160a8ce04", "tag": "7f4a4639-206c-48b9-97e5-686efc3ef902"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:38.446738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-34df65c4-f27e-4424-9066-f6a8e026ebf3 req-8e0c4eea-a6ec-4ee3-beb5-ea0c371b8cc6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:38.446738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-34df65c4-f27e-4424-9066-f6a8e026ebf3 req-8e0c4eea-a6ec-4ee3-beb5-ea0c371b8cc6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:38.464187 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-34df65c4-f27e-4424-9066-f6a8e026ebf3 req-8e0c4eea-a6ec-4ee3-beb5-ea0c371b8cc6 service nova] Creating event network-changed:7f4a4639-206c-48b9-97e5-686efc3ef902 for instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 on n-h2-833090-9 Jul 26 15:04:38.469350 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-34df65c4-f27e-4424-9066-f6a8e026ebf3 req-8e0c4eea-a6ec-4ee3-beb5-ea0c371b8cc6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054160 Jul 26 15:04:38.470141 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3133/6383] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:39.057003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-752266e3-af20-4ce5-9190-37b4a70a1918 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:39.058172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-752266e3-af20-4ce5-9190-37b4a70a1918 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:39.066841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-752266e3-af20-4ce5-9190-37b4a70a1918 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:39.067403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-752266e3-af20-4ce5-9190-37b4a70a1918 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:39.068375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-752266e3-af20-4ce5-9190-37b4a70a1918 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:39.068846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-752266e3-af20-4ce5-9190-37b4a70a1918 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:39.247660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-752266e3-af20-4ce5-9190-37b4a70a1918 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:39.258268 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-752266e3-af20-4ce5-9190-37b4a70a1918 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1359 microversion: 2.1 time: 0.207206 Jul 26 15:04:39.259032 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3251/6384] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:39 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:40.280685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-78c68212-d1d4-4fcc-a02d-690c611dacb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:40.281392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-78c68212-d1d4-4fcc-a02d-690c611dacb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:40.287839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78c68212-d1d4-4fcc-a02d-690c611dacb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:40.289058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78c68212-d1d4-4fcc-a02d-690c611dacb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:40.289917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78c68212-d1d4-4fcc-a02d-690c611dacb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:40.290425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78c68212-d1d4-4fcc-a02d-690c611dacb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:40.503644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-78c68212-d1d4-4fcc-a02d-690c611dacb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:40.511861 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-78c68212-d1d4-4fcc-a02d-690c611dacb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1359 microversion: 2.1 time: 0.236248 Jul 26 15:04:40.512514 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3134/6385] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:40 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:41.534322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5107bf6b-3040-4498-bdcc-3cb988579b5e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:41.534322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5107bf6b-3040-4498-bdcc-3cb988579b5e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:41.540847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5107bf6b-3040-4498-bdcc-3cb988579b5e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:41.541314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5107bf6b-3040-4498-bdcc-3cb988579b5e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:41.542103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5107bf6b-3040-4498-bdcc-3cb988579b5e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:41.542559 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5107bf6b-3040-4498-bdcc-3cb988579b5e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:41.680594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5107bf6b-3040-4498-bdcc-3cb988579b5e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:41.688129 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5107bf6b-3040-4498-bdcc-3cb988579b5e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1359 microversion: 2.1 time: 0.159216 Jul 26 15:04:41.688701 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3252/6386] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:41 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:42.708848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-baf3daf2-9654-4303-a7df-ecb41f5220f2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:42.709375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-baf3daf2-9654-4303-a7df-ecb41f5220f2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:42.716381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-baf3daf2-9654-4303-a7df-ecb41f5220f2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:42.716825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-baf3daf2-9654-4303-a7df-ecb41f5220f2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:42.717589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-baf3daf2-9654-4303-a7df-ecb41f5220f2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:42.718025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-baf3daf2-9654-4303-a7df-ecb41f5220f2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:42.848571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-baf3daf2-9654-4303-a7df-ecb41f5220f2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:42.856194 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-baf3daf2-9654-4303-a7df-ecb41f5220f2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1359 microversion: 2.1 time: 0.151362 Jul 26 15:04:42.856778 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3135/6387] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:42 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:43.877728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e5a65619-49e0-4c9b-9ec5-e09e43e9b1fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:43.878373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e5a65619-49e0-4c9b-9ec5-e09e43e9b1fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:43.886492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5a65619-49e0-4c9b-9ec5-e09e43e9b1fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:43.886963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5a65619-49e0-4c9b-9ec5-e09e43e9b1fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:43.887770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5a65619-49e0-4c9b-9ec5-e09e43e9b1fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:43.888249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5a65619-49e0-4c9b-9ec5-e09e43e9b1fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:43.963445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-cf56c841-1922-4024-9476-7afe25757c0b req-4a9517c0-a420-4bd0-a883-17f81718bf6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52e3e20-e30f-4c35-bf18-07a160a8ce04", "name": "network-vif-plugged", "status": "completed", "tag": "7f4a4639-206c-48b9-97e5-686efc3ef902"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:43.977091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cf56c841-1922-4024-9476-7afe25757c0b req-4a9517c0-a420-4bd0-a883-17f81718bf6d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:43.977616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-cf56c841-1922-4024-9476-7afe25757c0b req-4a9517c0-a420-4bd0-a883-17f81718bf6d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:43.989678 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-cf56c841-1922-4024-9476-7afe25757c0b req-4a9517c0-a420-4bd0-a883-17f81718bf6d service nova] Creating event network-vif-plugged:7f4a4639-206c-48b9-97e5-686efc3ef902 for instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 on n-h2-833090-9 Jul 26 15:04:43.995551 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-cf56c841-1922-4024-9476-7afe25757c0b req-4a9517c0-a420-4bd0-a883-17f81718bf6d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036757 Jul 26 15:04:43.996424 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3136/6388] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:04:44.040857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e5a65619-49e0-4c9b-9ec5-e09e43e9b1fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:44.048766 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e5a65619-49e0-4c9b-9ec5-e09e43e9b1fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1359 microversion: 2.1 time: 0.175697 Jul 26 15:04:44.049704 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3253/6389] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:43 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:45.072599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-40498ee6-7ddd-4c23-835b-5f6e90b6b298 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:45.073246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-40498ee6-7ddd-4c23-835b-5f6e90b6b298 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:45.079715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40498ee6-7ddd-4c23-835b-5f6e90b6b298 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:45.080281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40498ee6-7ddd-4c23-835b-5f6e90b6b298 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:45.081085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40498ee6-7ddd-4c23-835b-5f6e90b6b298 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:45.081555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40498ee6-7ddd-4c23-835b-5f6e90b6b298 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:45.244171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-40498ee6-7ddd-4c23-835b-5f6e90b6b298 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:45.252093 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-40498ee6-7ddd-4c23-835b-5f6e90b6b298 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1359 microversion: 2.1 time: 0.185244 Jul 26 15:04:45.252911 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3137/6390] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:45 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:46.275569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2179cdd4-69f3-484c-b9b1-b14b3194df99 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:46.276230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2179cdd4-69f3-484c-b9b1-b14b3194df99 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:46.279003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:46.284533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2179cdd4-69f3-484c-b9b1-b14b3194df99 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:46.285004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2179cdd4-69f3-484c-b9b1-b14b3194df99 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:46.285792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2179cdd4-69f3-484c-b9b1-b14b3194df99 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:46.286253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2179cdd4-69f3-484c-b9b1-b14b3194df99 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:46.433449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2179cdd4-69f3-484c-b9b1-b14b3194df99 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:46.441543 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2179cdd4-69f3-484c-b9b1-b14b3194df99 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1546 microversion: 2.1 time: 0.170632 Jul 26 15:04:46.442113 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3254/6391] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:46 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:46.463009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-438bbd94-08ca-4ae3-ae22-59c7f81fbce7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:46.463564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-438bbd94-08ca-4ae3-ae22-59c7f81fbce7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:46.465497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:46.466170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:46.473098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-438bbd94-08ca-4ae3-ae22-59c7f81fbce7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:46.473557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-438bbd94-08ca-4ae3-ae22-59c7f81fbce7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:46.474333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-438bbd94-08ca-4ae3-ae22-59c7f81fbce7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:46.474774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-438bbd94-08ca-4ae3-ae22-59c7f81fbce7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:46.557725 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-438bbd94-08ca-4ae3-ae22-59c7f81fbce7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099260 Jul 26 15:04:46.558321 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3138/6392] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 15:04:46 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:47.519309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-01df6e38-8271-42d2-ab4e-802a1f855118 req-614de9b9-f9e2-4834-9e3d-4511e8c5218e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e52e3e20-e30f-4c35-bf18-07a160a8ce04", "tag": "7f4a4639-206c-48b9-97e5-686efc3ef902"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:47.531129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-01df6e38-8271-42d2-ab4e-802a1f855118 req-614de9b9-f9e2-4834-9e3d-4511e8c5218e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:47.531592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-01df6e38-8271-42d2-ab4e-802a1f855118 req-614de9b9-f9e2-4834-9e3d-4511e8c5218e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:47.544655 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-01df6e38-8271-42d2-ab4e-802a1f855118 req-614de9b9-f9e2-4834-9e3d-4511e8c5218e service nova] Creating event network-changed:7f4a4639-206c-48b9-97e5-686efc3ef902 for instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 on n-h2-833090-9 Jul 26 15:04:47.550273 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-01df6e38-8271-42d2-ab4e-802a1f855118 req-614de9b9-f9e2-4834-9e3d-4511e8c5218e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034465 Jul 26 15:04:47.551034 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3255/6393] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:23.519092 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:23.519980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=34 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:23.525089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1bdbe4cc-0016-418b-a1fa-3dca9b45ceb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:23.526522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1bdbe4cc-0016-418b-a1fa-3dca9b45ceb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:23.536070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bdbe4cc-0016-418b-a1fa-3dca9b45ceb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.536608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bdbe4cc-0016-418b-a1fa-3dca9b45ceb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.538108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bdbe4cc-0016-418b-a1fa-3dca9b45ceb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.538792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1bdbe4cc-0016-418b-a1fa-3dca9b45ceb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.702399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1bdbe4cc-0016-418b-a1fa-3dca9b45ceb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:23.711162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1bdbe4cc-0016-418b-a1fa-3dca9b45ceb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1665 microversion: 2.1 time: 0.194208 Jul 26 15:05:23.711743 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3139/6394] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:23 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1665 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:23.735541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:23.736423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=32 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:23.741381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5da02d65-af13-4003-b505-db9eaf9d1ff5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:23.741907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5da02d65-af13-4003-b505-db9eaf9d1ff5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:23.749594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da02d65-af13-4003-b505-db9eaf9d1ff5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.749911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da02d65-af13-4003-b505-db9eaf9d1ff5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.750715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da02d65-af13-4003-b505-db9eaf9d1ff5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.751167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5da02d65-af13-4003-b505-db9eaf9d1ff5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.902718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5da02d65-af13-4003-b505-db9eaf9d1ff5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:23.911033 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5da02d65-af13-4003-b505-db9eaf9d1ff5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1665 microversion: 2.1 time: 0.178705 Jul 26 15:05:23.911866 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3256/6395] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:23 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1665 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:23.933168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7edb5e5d-8beb-47c2-a15a-5e73a0642243 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:23.933803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7edb5e5d-8beb-47c2-a15a-5e73a0642243 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:23.941258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7edb5e5d-8beb-47c2-a15a-5e73a0642243 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.941704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7edb5e5d-8beb-47c2-a15a-5e73a0642243 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.942490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7edb5e5d-8beb-47c2-a15a-5e73a0642243 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.942927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7edb5e5d-8beb-47c2-a15a-5e73a0642243 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.119532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7edb5e5d-8beb-47c2-a15a-5e73a0642243 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:24.127794 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7edb5e5d-8beb-47c2-a15a-5e73a0642243 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1665 microversion: 2.1 time: 0.198519 Jul 26 15:05:24.128515 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3140/6396] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:23 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1665 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:24.154731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:24.157758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:24.166645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:24.167124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.168171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:24.168924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.203534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:24.212243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Old instance type m1.heat2, new instance type m1.heat {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 15:05:24.219280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:05:24.219724 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:05:24.220275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:05:24.220705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:05:24.221132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:05:24.293420 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ddd430c2-3c4e-402b-82fd-a0fddb355218 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04/action" status: 202 len: 0 microversion: 2.1 time: 0.142480 Jul 26 15:05:24.294268 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3257/6397] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:05:24 2022] POST /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:05:24.304169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9e4a732e-0376-4ec9-bd21-0804df384886 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:24.304659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9e4a732e-0376-4ec9-bd21-0804df384886 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:24.311282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e4a732e-0376-4ec9-bd21-0804df384886 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:24.311843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e4a732e-0376-4ec9-bd21-0804df384886 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.312756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e4a732e-0376-4ec9-bd21-0804df384886 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:24.313290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e4a732e-0376-4ec9-bd21-0804df384886 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.495421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9e4a732e-0376-4ec9-bd21-0804df384886 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:24.503719 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9e4a732e-0376-4ec9-bd21-0804df384886 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1674 microversion: 2.1 time: 0.204855 Jul 26 15:05:24.504544 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3141/6398] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:24 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:25.540473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-77bc9eb5-79d5-4a92-a2ca-cc8b9ee3bf25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:25.541086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-77bc9eb5-79d5-4a92-a2ca-cc8b9ee3bf25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:25.548238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77bc9eb5-79d5-4a92-a2ca-cc8b9ee3bf25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.548879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77bc9eb5-79d5-4a92-a2ca-cc8b9ee3bf25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.549957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77bc9eb5-79d5-4a92-a2ca-cc8b9ee3bf25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.550630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-77bc9eb5-79d5-4a92-a2ca-cc8b9ee3bf25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.706605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-77bc9eb5-79d5-4a92-a2ca-cc8b9ee3bf25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:25.719117 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-77bc9eb5-79d5-4a92-a2ca-cc8b9ee3bf25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1674 microversion: 2.1 time: 0.184199 Jul 26 15:05:25.719755 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3258/6399] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:25 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:26.742081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-017901e2-2f95-4e84-addc-e07b13986ff7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:26.742705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-017901e2-2f95-4e84-addc-e07b13986ff7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:26.750047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-017901e2-2f95-4e84-addc-e07b13986ff7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:26.750500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-017901e2-2f95-4e84-addc-e07b13986ff7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.751287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-017901e2-2f95-4e84-addc-e07b13986ff7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:26.751728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-017901e2-2f95-4e84-addc-e07b13986ff7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.893989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-017901e2-2f95-4e84-addc-e07b13986ff7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:26.901996 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-017901e2-2f95-4e84-addc-e07b13986ff7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.164725 Jul 26 15:05:26.902594 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3142/6400] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:26 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:27.923424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-99b2c9b2-9e37-4f91-8f54-c9f1449722b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:27.924194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-99b2c9b2-9e37-4f91-8f54-c9f1449722b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:27.932483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99b2c9b2-9e37-4f91-8f54-c9f1449722b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:27.932972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99b2c9b2-9e37-4f91-8f54-c9f1449722b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:27.933900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99b2c9b2-9e37-4f91-8f54-c9f1449722b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:27.934378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-99b2c9b2-9e37-4f91-8f54-c9f1449722b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:28.095347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-99b2c9b2-9e37-4f91-8f54-c9f1449722b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:28.109064 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-99b2c9b2-9e37-4f91-8f54-c9f1449722b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.189514 Jul 26 15:05:28.109669 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3259/6401] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:27 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:29.131866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f1d5bd02-7b19-4848-9285-60fe828ad1d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:29.132693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f1d5bd02-7b19-4848-9285-60fe828ad1d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:29.139851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1d5bd02-7b19-4848-9285-60fe828ad1d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.140334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1d5bd02-7b19-4848-9285-60fe828ad1d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.141112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1d5bd02-7b19-4848-9285-60fe828ad1d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.141549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f1d5bd02-7b19-4848-9285-60fe828ad1d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.278359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f1d5bd02-7b19-4848-9285-60fe828ad1d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:29.286192 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f1d5bd02-7b19-4848-9285-60fe828ad1d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.158966 Jul 26 15:05:29.286782 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3143/6402] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:29 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:30.308407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-751bab95-a400-41f6-86e9-b32827777355 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:30.309043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-751bab95-a400-41f6-86e9-b32827777355 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:30.316042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-751bab95-a400-41f6-86e9-b32827777355 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:30.316476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-751bab95-a400-41f6-86e9-b32827777355 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:30.317271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-751bab95-a400-41f6-86e9-b32827777355 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:30.317727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-751bab95-a400-41f6-86e9-b32827777355 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:30.455224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-751bab95-a400-41f6-86e9-b32827777355 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:30.463904 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-751bab95-a400-41f6-86e9-b32827777355 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.159417 Jul 26 15:05:30.464690 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3260/6403] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:30 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:31.487338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4c5af30d-b0c4-429a-a399-6aa7c39e53cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:31.487997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4c5af30d-b0c4-429a-a399-6aa7c39e53cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:31.495684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c5af30d-b0c4-429a-a399-6aa7c39e53cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:31.496189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c5af30d-b0c4-429a-a399-6aa7c39e53cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:31.496977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c5af30d-b0c4-429a-a399-6aa7c39e53cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:31.498291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c5af30d-b0c4-429a-a399-6aa7c39e53cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:31.638603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4c5af30d-b0c4-429a-a399-6aa7c39e53cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:31.646313 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4c5af30d-b0c4-429a-a399-6aa7c39e53cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.162980 Jul 26 15:05:31.646912 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3144/6404] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:31 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:32.668553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c996a3f9-c266-4824-8020-c7c56b223c59 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:32.669184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c996a3f9-c266-4824-8020-c7c56b223c59 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:32.676715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c996a3f9-c266-4824-8020-c7c56b223c59 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:32.677182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c996a3f9-c266-4824-8020-c7c56b223c59 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:32.678334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c996a3f9-c266-4824-8020-c7c56b223c59 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:32.678558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c996a3f9-c266-4824-8020-c7c56b223c59 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:32.819727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c996a3f9-c266-4824-8020-c7c56b223c59 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:32.827532 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c996a3f9-c266-4824-8020-c7c56b223c59 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.162891 Jul 26 15:05:32.828142 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3261/6405] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:32 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:33.849064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3fd966f1-b5ae-4b44-a2b8-b0191fd17792 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:33.850367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3fd966f1-b5ae-4b44-a2b8-b0191fd17792 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:33.857531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fd966f1-b5ae-4b44-a2b8-b0191fd17792 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:33.857985 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fd966f1-b5ae-4b44-a2b8-b0191fd17792 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:33.858756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fd966f1-b5ae-4b44-a2b8-b0191fd17792 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:33.859190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fd966f1-b5ae-4b44-a2b8-b0191fd17792 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:34.001804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3fd966f1-b5ae-4b44-a2b8-b0191fd17792 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:34.009812 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3fd966f1-b5ae-4b44-a2b8-b0191fd17792 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.164741 Jul 26 15:05:34.010398 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3145/6406] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:33 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:35.031447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-edc88cfc-41ed-427f-b07e-2bcd6e4ef78a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:35.032204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-edc88cfc-41ed-427f-b07e-2bcd6e4ef78a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:35.040410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-edc88cfc-41ed-427f-b07e-2bcd6e4ef78a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:35.040878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-edc88cfc-41ed-427f-b07e-2bcd6e4ef78a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:35.041670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-edc88cfc-41ed-427f-b07e-2bcd6e4ef78a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:35.042122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-edc88cfc-41ed-427f-b07e-2bcd6e4ef78a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:35.186310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-edc88cfc-41ed-427f-b07e-2bcd6e4ef78a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:35.195577 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-edc88cfc-41ed-427f-b07e-2bcd6e4ef78a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.168125 Jul 26 15:05:35.196207 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3262/6407] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:35 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:36.223132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a1e493f5-993b-45ba-b127-581a9e4bb50a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:36.223850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a1e493f5-993b-45ba-b127-581a9e4bb50a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:36.230921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1e493f5-993b-45ba-b127-581a9e4bb50a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:36.231381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1e493f5-993b-45ba-b127-581a9e4bb50a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:36.232306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1e493f5-993b-45ba-b127-581a9e4bb50a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:36.232663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a1e493f5-993b-45ba-b127-581a9e4bb50a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:36.429284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a1e493f5-993b-45ba-b127-581a9e4bb50a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:36.437236 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a1e493f5-993b-45ba-b127-581a9e4bb50a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.218610 Jul 26 15:05:36.438468 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3146/6408] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:36 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:37.458973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9cee7ff6-79a8-4ab6-b7bd-fe36cb5dab03 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:37.460234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9cee7ff6-79a8-4ab6-b7bd-fe36cb5dab03 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:37.467695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cee7ff6-79a8-4ab6-b7bd-fe36cb5dab03 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:37.468192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cee7ff6-79a8-4ab6-b7bd-fe36cb5dab03 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:37.469097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cee7ff6-79a8-4ab6-b7bd-fe36cb5dab03 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:37.469556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9cee7ff6-79a8-4ab6-b7bd-fe36cb5dab03 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:37.624684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9cee7ff6-79a8-4ab6-b7bd-fe36cb5dab03 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:37.634222 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9cee7ff6-79a8-4ab6-b7bd-fe36cb5dab03 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.179147 Jul 26 15:05:37.634827 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3263/6409] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:37 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:38.659668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-419c37ba-8849-4b2d-ad93-e1413a3d2d72 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:38.660569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-419c37ba-8849-4b2d-ad93-e1413a3d2d72 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:38.670802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-419c37ba-8849-4b2d-ad93-e1413a3d2d72 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:38.671252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-419c37ba-8849-4b2d-ad93-e1413a3d2d72 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:38.672073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-419c37ba-8849-4b2d-ad93-e1413a3d2d72 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:38.672605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-419c37ba-8849-4b2d-ad93-e1413a3d2d72 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:38.822994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-419c37ba-8849-4b2d-ad93-e1413a3d2d72 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:38.830753 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-419c37ba-8849-4b2d-ad93-e1413a3d2d72 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.176540 Jul 26 15:05:38.831558 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3147/6410] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:38 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:39.853205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1b1b7de3-af9f-425c-9af6-cb9dc59380d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:39.854000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1b1b7de3-af9f-425c-9af6-cb9dc59380d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:39.860592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b1b7de3-af9f-425c-9af6-cb9dc59380d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:39.861069 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b1b7de3-af9f-425c-9af6-cb9dc59380d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:39.861880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b1b7de3-af9f-425c-9af6-cb9dc59380d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:39.862347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b1b7de3-af9f-425c-9af6-cb9dc59380d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:40.005681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1b1b7de3-af9f-425c-9af6-cb9dc59380d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:40.014724 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1b1b7de3-af9f-425c-9af6-cb9dc59380d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.165431 Jul 26 15:05:40.015317 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3264/6411] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:39 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:41.037436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cafc5edf-7ea4-44fc-9a09-39b50438774c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:41.038659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cafc5edf-7ea4-44fc-9a09-39b50438774c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:41.044966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafc5edf-7ea4-44fc-9a09-39b50438774c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:41.045373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafc5edf-7ea4-44fc-9a09-39b50438774c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:41.046171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafc5edf-7ea4-44fc-9a09-39b50438774c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:41.046611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafc5edf-7ea4-44fc-9a09-39b50438774c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:41.184400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cafc5edf-7ea4-44fc-9a09-39b50438774c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:41.192033 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cafc5edf-7ea4-44fc-9a09-39b50438774c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.159696 Jul 26 15:05:41.192940 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3148/6412] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:41 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:42.215445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fd8bf330-3636-409b-b220-a0ffa06d6f2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:42.216121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fd8bf330-3636-409b-b220-a0ffa06d6f2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:42.223542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd8bf330-3636-409b-b220-a0ffa06d6f2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:42.224039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd8bf330-3636-409b-b220-a0ffa06d6f2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:42.224868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd8bf330-3636-409b-b220-a0ffa06d6f2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:42.226038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd8bf330-3636-409b-b220-a0ffa06d6f2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:42.382966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fd8bf330-3636-409b-b220-a0ffa06d6f2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:42.392269 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fd8bf330-3636-409b-b220-a0ffa06d6f2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.180820 Jul 26 15:05:42.392864 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3265/6413] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:42 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:43.416808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b7a602b6-5213-4b1b-a5f9-2bdcfcfc43b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:43.418101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b7a602b6-5213-4b1b-a5f9-2bdcfcfc43b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:43.424451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7a602b6-5213-4b1b-a5f9-2bdcfcfc43b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:43.424917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7a602b6-5213-4b1b-a5f9-2bdcfcfc43b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:43.425711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7a602b6-5213-4b1b-a5f9-2bdcfcfc43b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:43.426426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7a602b6-5213-4b1b-a5f9-2bdcfcfc43b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:43.584213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b7a602b6-5213-4b1b-a5f9-2bdcfcfc43b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:43.592167 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b7a602b6-5213-4b1b-a5f9-2bdcfcfc43b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1679 microversion: 2.1 time: 0.181246 Jul 26 15:05:43.592761 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3149/6414] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:43 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:43.994854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b201185d-73b6-4565-b44f-01e6f31be1ad req-a318c4d4-ee6c-4d84-9755-c1cb90343276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52e3e20-e30f-4c35-bf18-07a160a8ce04", "name": "network-vif-unplugged", "status": "completed", "tag": "7f4a4639-206c-48b9-97e5-686efc3ef902"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:44.012672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b201185d-73b6-4565-b44f-01e6f31be1ad req-a318c4d4-ee6c-4d84-9755-c1cb90343276 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:44.013471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b201185d-73b6-4565-b44f-01e6f31be1ad req-a318c4d4-ee6c-4d84-9755-c1cb90343276 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:44.028429 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b201185d-73b6-4565-b44f-01e6f31be1ad req-a318c4d4-ee6c-4d84-9755-c1cb90343276 service nova] Creating event network-vif-unplugged:7f4a4639-206c-48b9-97e5-686efc3ef902 for instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 on n-h1-833090-9 Jul 26 15:05:44.034774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-b201185d-73b6-4565-b44f-01e6f31be1ad req-a318c4d4-ee6c-4d84-9755-c1cb90343276 service nova] Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:05:44.046111 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b201185d-73b6-4565-b44f-01e6f31be1ad req-a318c4d4-ee6c-4d84-9755-c1cb90343276 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055506 Jul 26 15:05:44.046966 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3266/6415] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:05:44.621383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aeaff1a6-5671-4244-904e-d6d720a0791d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:44.622116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aeaff1a6-5671-4244-904e-d6d720a0791d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:44.630240 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeaff1a6-5671-4244-904e-d6d720a0791d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:44.634237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeaff1a6-5671-4244-904e-d6d720a0791d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:44.635269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeaff1a6-5671-4244-904e-d6d720a0791d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:44.635899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeaff1a6-5671-4244-904e-d6d720a0791d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:44.802430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aeaff1a6-5671-4244-904e-d6d720a0791d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:44.810753 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aeaff1a6-5671-4244-904e-d6d720a0791d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1678 microversion: 2.1 time: 0.200364 Jul 26 15:05:44.811324 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3150/6416] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:44 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:45.836936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b0ba4da1-2362-4ee8-b17a-03f9b33a34ef tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:45.837793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b0ba4da1-2362-4ee8-b17a-03f9b33a34ef tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:45.845288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b0ba4da1-2362-4ee8-b17a-03f9b33a34ef tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.845767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b0ba4da1-2362-4ee8-b17a-03f9b33a34ef tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.846955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b0ba4da1-2362-4ee8-b17a-03f9b33a34ef tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.847432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b0ba4da1-2362-4ee8-b17a-03f9b33a34ef tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:46.009842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b0ba4da1-2362-4ee8-b17a-03f9b33a34ef tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:46.017767 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b0ba4da1-2362-4ee8-b17a-03f9b33a34ef tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1676 microversion: 2.1 time: 0.187412 Jul 26 15:05:46.018344 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3267/6417] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:45 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:46.065236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-45462ac3-bccc-47e7-826c-d264cc3cb269 req-c72cd722-64e9-4ff6-a42d-1d198a3de277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e52e3e20-e30f-4c35-bf18-07a160a8ce04", "tag": "7f4a4639-206c-48b9-97e5-686efc3ef902"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:46.076645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-45462ac3-bccc-47e7-826c-d264cc3cb269 req-c72cd722-64e9-4ff6-a42d-1d198a3de277 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:46.077099 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-45462ac3-bccc-47e7-826c-d264cc3cb269 req-c72cd722-64e9-4ff6-a42d-1d198a3de277 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:46.090202 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-45462ac3-bccc-47e7-826c-d264cc3cb269 req-c72cd722-64e9-4ff6-a42d-1d198a3de277 service nova] Creating event network-changed:7f4a4639-206c-48b9-97e5-686efc3ef902 for instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 on n-h1-833090-9 Jul 26 15:05:46.095754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-45462ac3-bccc-47e7-826c-d264cc3cb269 req-c72cd722-64e9-4ff6-a42d-1d198a3de277 service nova] Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:05:46.108576 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-45462ac3-bccc-47e7-826c-d264cc3cb269 req-c72cd722-64e9-4ff6-a42d-1d198a3de277 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047282 Jul 26 15:05:46.109240 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3151/6418] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:47.052324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-16ed1689-c10c-48b8-adc1-fcabd4f62df0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:47.053683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-16ed1689-c10c-48b8-adc1-fcabd4f62df0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:47.066105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16ed1689-c10c-48b8-adc1-fcabd4f62df0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:47.066921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16ed1689-c10c-48b8-adc1-fcabd4f62df0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:47.068212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16ed1689-c10c-48b8-adc1-fcabd4f62df0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:47.069618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16ed1689-c10c-48b8-adc1-fcabd4f62df0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:47.341928 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-16ed1689-c10c-48b8-adc1-fcabd4f62df0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:47.351199 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-16ed1689-c10c-48b8-adc1-fcabd4f62df0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1673 microversion: 2.1 time: 0.309459 Jul 26 15:05:47.351814 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3268/6419] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:47 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1673 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:47.373989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-acbd645d-e836-425b-94a1-c61e44d2162b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:47.374719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-acbd645d-e836-425b-94a1-c61e44d2162b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:47.381628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acbd645d-e836-425b-94a1-c61e44d2162b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:47.382198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acbd645d-e836-425b-94a1-c61e44d2162b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:47.383042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acbd645d-e836-425b-94a1-c61e44d2162b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:47.383548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acbd645d-e836-425b-94a1-c61e44d2162b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:47.452960 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-acbd645d-e836-425b-94a1-c61e44d2162b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04/action" status: 204 len: 0 microversion: 2.1 time: 0.083914 Jul 26 15:05:47.453816 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3152/6420] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:05:47 2022] POST /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:05:47.462662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2854a805-1086-4072-97f1-2fac89fe4d33 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:47.463299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2854a805-1086-4072-97f1-2fac89fe4d33 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:47.472875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2854a805-1086-4072-97f1-2fac89fe4d33 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:47.473722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2854a805-1086-4072-97f1-2fac89fe4d33 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:47.474696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2854a805-1086-4072-97f1-2fac89fe4d33 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:47.476851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2854a805-1086-4072-97f1-2fac89fe4d33 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:47.707183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2854a805-1086-4072-97f1-2fac89fe4d33 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:47.717087 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2854a805-1086-4072-97f1-2fac89fe4d33 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1673 microversion: 2.1 time: 0.258559 Jul 26 15:05:47.717705 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3269/6421] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:47 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:48.741504 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-374f511a-86e2-4da7-b71c-6231fba077d3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:48.742223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-374f511a-86e2-4da7-b71c-6231fba077d3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:48.749002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-374f511a-86e2-4da7-b71c-6231fba077d3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:48.749468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-374f511a-86e2-4da7-b71c-6231fba077d3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:48.750253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-374f511a-86e2-4da7-b71c-6231fba077d3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:48.750696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-374f511a-86e2-4da7-b71c-6231fba077d3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:48.926273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-374f511a-86e2-4da7-b71c-6231fba077d3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:48.936975 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-374f511a-86e2-4da7-b71c-6231fba077d3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1665 microversion: 2.1 time: 0.201730 Jul 26 15:05:48.944303 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3153/6422] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:48 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1665 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:48.961687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d8cb4aff-4fd5-4eb1-87d1-cdef4e414e79 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:48.962494 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d8cb4aff-4fd5-4eb1-87d1-cdef4e414e79 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:48.969760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8cb4aff-4fd5-4eb1-87d1-cdef4e414e79 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:48.970243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8cb4aff-4fd5-4eb1-87d1-cdef4e414e79 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:48.971051 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8cb4aff-4fd5-4eb1-87d1-cdef4e414e79 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:48.971687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8cb4aff-4fd5-4eb1-87d1-cdef4e414e79 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.117761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d8cb4aff-4fd5-4eb1-87d1-cdef4e414e79 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:49.125682 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d8cb4aff-4fd5-4eb1-87d1-cdef4e414e79 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1665 microversion: 2.1 time: 0.168735 Jul 26 15:05:49.126715 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3270/6423] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:48 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1665 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:49.148469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-02521e0f-241a-4026-9c38-6ead4d0f6945 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:49.149206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-02521e0f-241a-4026-9c38-6ead4d0f6945 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:49.155475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02521e0f-241a-4026-9c38-6ead4d0f6945 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.155911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02521e0f-241a-4026-9c38-6ead4d0f6945 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.156716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02521e0f-241a-4026-9c38-6ead4d0f6945 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.157153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-02521e0f-241a-4026-9c38-6ead4d0f6945 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.294410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-02521e0f-241a-4026-9c38-6ead4d0f6945 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:49.296769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:49.303909 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-02521e0f-241a-4026-9c38-6ead4d0f6945 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1665 microversion: 2.1 time: 0.160275 Jul 26 15:05:49.304531 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3154/6424] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:49 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:49.324351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-97b742f8-0b67-4605-b32a-d5cdcbae6ec9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:49.324870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-97b742f8-0b67-4605-b32a-d5cdcbae6ec9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:49.331431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b742f8-0b67-4605-b32a-d5cdcbae6ec9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.331909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b742f8-0b67-4605-b32a-d5cdcbae6ec9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.332748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b742f8-0b67-4605-b32a-d5cdcbae6ec9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.333209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-97b742f8-0b67-4605-b32a-d5cdcbae6ec9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.356337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:49.365357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-97b742f8-0b67-4605-b32a-d5cdcbae6ec9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:05:49.455172 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-97b742f8-0b67-4605-b32a-d5cdcbae6ec9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 204 len: 0 microversion: 2.1 time: 0.134337 Jul 26 15:05:49.455710 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3271/6425] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:05:49 2022] DELETE /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:05:49.465868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-043c80e9-710b-41eb-828e-e184cf0c3c09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:49.466494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-043c80e9-710b-41eb-828e-e184cf0c3c09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:49.474060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-043c80e9-710b-41eb-828e-e184cf0c3c09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.474522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-043c80e9-710b-41eb-828e-e184cf0c3c09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.475386 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-043c80e9-710b-41eb-828e-e184cf0c3c09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:49.475825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-043c80e9-710b-41eb-828e-e184cf0c3c09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:49.614936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-043c80e9-710b-41eb-828e-e184cf0c3c09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:49.623090 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-043c80e9-710b-41eb-828e-e184cf0c3c09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1671 microversion: 2.1 time: 0.161909 Jul 26 15:05:49.623677 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3155/6426] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:49 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:50.277487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-20572010-3e56-42a0-93c0-4772b0ac5487 req-fe16ac88-4f73-454b-9c60-80fcdeb4e76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52e3e20-e30f-4c35-bf18-07a160a8ce04", "name": "network-vif-plugged", "status": "completed", "tag": "7f4a4639-206c-48b9-97e5-686efc3ef902"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:50.290487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-20572010-3e56-42a0-93c0-4772b0ac5487 req-fe16ac88-4f73-454b-9c60-80fcdeb4e76f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.290971 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-20572010-3e56-42a0-93c0-4772b0ac5487 req-fe16ac88-4f73-454b-9c60-80fcdeb4e76f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:50.302763 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-20572010-3e56-42a0-93c0-4772b0ac5487 req-fe16ac88-4f73-454b-9c60-80fcdeb4e76f service nova] Creating event network-vif-plugged:7f4a4639-206c-48b9-97e5-686efc3ef902 for instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 on n-h1-833090-9 Jul 26 15:05:50.308663 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-20572010-3e56-42a0-93c0-4772b0ac5487 req-fe16ac88-4f73-454b-9c60-80fcdeb4e76f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035450 Jul 26 15:05:50.309324 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3272/6427] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:05:50.645666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-66b2b32f-43de-4495-9cb5-7d317ee1ea06 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:50.646293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-66b2b32f-43de-4495-9cb5-7d317ee1ea06 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:50.655549 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66b2b32f-43de-4495-9cb5-7d317ee1ea06 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.656031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66b2b32f-43de-4495-9cb5-7d317ee1ea06 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:50.656827 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66b2b32f-43de-4495-9cb5-7d317ee1ea06 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:50.657260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66b2b32f-43de-4495-9cb5-7d317ee1ea06 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:50.843768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-66b2b32f-43de-4495-9cb5-7d317ee1ea06 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:50.852749 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-66b2b32f-43de-4495-9cb5-7d317ee1ea06 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1671 microversion: 2.1 time: 0.210978 Jul 26 15:05:50.853449 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3156/6428] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:50 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:51.761000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1c208ad7-87f6-4fa2-a93b-8038f26695c0 req-fb30826a-5710-46fb-aaa7-b2e2e68ec430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52e3e20-e30f-4c35-bf18-07a160a8ce04", "name": "network-vif-deleted", "tag": "7f4a4639-206c-48b9-97e5-686efc3ef902"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:51.774558 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1c208ad7-87f6-4fa2-a93b-8038f26695c0 req-fb30826a-5710-46fb-aaa7-b2e2e68ec430 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:51.775235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1c208ad7-87f6-4fa2-a93b-8038f26695c0 req-fb30826a-5710-46fb-aaa7-b2e2e68ec430 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:51.790785 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1c208ad7-87f6-4fa2-a93b-8038f26695c0 req-fb30826a-5710-46fb-aaa7-b2e2e68ec430 service nova] Creating event network-vif-deleted:7f4a4639-206c-48b9-97e5-686efc3ef902 for instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 on n-h1-833090-9 Jul 26 15:05:51.796855 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1c208ad7-87f6-4fa2-a93b-8038f26695c0 req-fb30826a-5710-46fb-aaa7-b2e2e68ec430 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046972 Jul 26 15:05:51.798243 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3273/6429] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:05:51.891269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:51.893236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:51.905881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:51.906682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:51.907520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:51.907991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:51.955914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:51.956711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:51.957188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lazy-loading 'fault' on Instance uuid e52e3e20-e30f-4c35-bf18-07a160a8ce04 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:05:52.001130 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:52.010466 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8f1ad626-bf7e-434a-b78a-1caa62ed24e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 200 len: 1324 microversion: 2.1 time: 0.124739 Jul 26 15:05:52.011063 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3157/6430] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:51 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 1324 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:53.035073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c9471344-d114-4490-87dc-76a810832b2a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:53.036121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c9471344-d114-4490-87dc-76a810832b2a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:53.043583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9471344-d114-4490-87dc-76a810832b2a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.044309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9471344-d114-4490-87dc-76a810832b2a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.045202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9471344-d114-4490-87dc-76a810832b2a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.045715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9471344-d114-4490-87dc-76a810832b2a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.071474 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-c9471344-d114-4490-87dc-76a810832b2a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c9471344-d114-4490-87dc-76a810832b2a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 HTTP/1.1 Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e52e3e20-e30f-4c35-bf18-07a160a8ce04'} Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:53.073253 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:05:53.077656 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:53.077656 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:05:53.077656 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:05:53.077656 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:05:53.077656 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:05:53.077656 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:05:53.077656 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:05:53.077656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c9471344-d114-4490-87dc-76a810832b2a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:05:53.077656 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c9471344-d114-4490-87dc-76a810832b2a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 404 len: 111 microversion: 2.1 time: 0.046225 Jul 26 15:05:53.077656 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3274/6431] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:53 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:05:53.095936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-74f28b1d-0c6a-4390-b1be-bbf41627542d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:53.096844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-74f28b1d-0c6a-4390-b1be-bbf41627542d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:53.105357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74f28b1d-0c6a-4390-b1be-bbf41627542d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.105816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74f28b1d-0c6a-4390-b1be-bbf41627542d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.106659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74f28b1d-0c6a-4390-b1be-bbf41627542d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.107122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-74f28b1d-0c6a-4390-b1be-bbf41627542d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.124911 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-74f28b1d-0c6a-4390-b1be-bbf41627542d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-74f28b1d-0c6a-4390-b1be-bbf41627542d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 HTTP/1.1 Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e52e3e20-e30f-4c35-bf18-07a160a8ce04'} Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:05:53.126954 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:05:53.133837 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:05:53.133837 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:05:53.133837 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:05:53.133837 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:05:53.133837 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:05:53.133837 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:05:53.133837 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:05:53.133837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-74f28b1d-0c6a-4390-b1be-bbf41627542d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:05:53.133837 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-74f28b1d-0c6a-4390-b1be-bbf41627542d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 404 len: 111 microversion: 2.1 time: 0.037401 Jul 26 15:05:53.133837 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3158/6432] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:53 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:05:53.180175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1254656060", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "66cb7b7e-a81f-4c0f-acf4-78a073c427bb"}], "security_groups": [{"name": "tempest-securitygroup--502582096"}], "key_name": "tempest-keypair-41852955", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:53.297284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] validate_networks() for [('66cb7b7e-a81f-4c0f-acf4-78a073c427bb', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:05:53.710814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:05:53.711345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:05:53.711879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:05:53.712341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:05:53.712776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:05:53.722400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.722867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.723692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:53.724211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:53.744040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:05:53.749763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for user b5b34650cfc14e69ace08e3a0be3ca06 and project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:05:53.760991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:53.765610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:05:53.767939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:05:53.820322 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f7ca9b21-7fab-4964-84eb-1a28b69ebafc tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.644777 Jul 26 15:05:53.820991 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3275/6433] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:05:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:05:53.832663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b2ed503f-2cfe-4b4b-abd1-4d3b3ce8aa0f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:53.833371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b2ed503f-2cfe-4b4b-abd1-4d3b3ce8aa0f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:53.835482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=43 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:53.900365 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b2ed503f-2cfe-4b4b-abd1-4d3b3ce8aa0f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:53.908301 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b2ed503f-2cfe-4b4b-abd1-4d3b3ce8aa0f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1237 microversion: 2.1 time: 0.079778 Jul 26 15:05:53.909091 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3159/6434] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:53 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:54.932391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bb4eb5a6-16fc-4a61-91e8-fe1048559272 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:54.934297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bb4eb5a6-16fc-4a61-91e8-fe1048559272 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:54.947887 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb4eb5a6-16fc-4a61-91e8-fe1048559272 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:54.948523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb4eb5a6-16fc-4a61-91e8-fe1048559272 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:54.949368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb4eb5a6-16fc-4a61-91e8-fe1048559272 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:54.949839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bb4eb5a6-16fc-4a61-91e8-fe1048559272 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:55.035066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bb4eb5a6-16fc-4a61-91e8-fe1048559272 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:55.043523 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bb4eb5a6-16fc-4a61-91e8-fe1048559272 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1307 microversion: 2.1 time: 0.117452 Jul 26 15:05:55.044146 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3276/6435] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:54 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:56.072051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-77c06709-f2f1-4396-a08d-4ca5ad36d55b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:56.072738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-77c06709-f2f1-4396-a08d-4ca5ad36d55b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:56.086667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77c06709-f2f1-4396-a08d-4ca5ad36d55b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:56.087127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77c06709-f2f1-4396-a08d-4ca5ad36d55b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:56.088006 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77c06709-f2f1-4396-a08d-4ca5ad36d55b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:56.088500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77c06709-f2f1-4396-a08d-4ca5ad36d55b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:56.369095 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-77c06709-f2f1-4396-a08d-4ca5ad36d55b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:56.378746 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-77c06709-f2f1-4396-a08d-4ca5ad36d55b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1362 microversion: 2.1 time: 0.312020 Jul 26 15:05:56.379669 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3160/6436] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:56 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:56.618105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d94a850b-f601-45f7-9d4a-9d3758832ad0 req-b0cd46f4-44be-483c-b44d-11e40592a5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3adba6e-8637-47c5-a781-b06993b81b76", "tag": "faa8864d-4a7d-44c6-9057-0c34a79e68ae"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:56.643059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d94a850b-f601-45f7-9d4a-9d3758832ad0 req-b0cd46f4-44be-483c-b44d-11e40592a5a6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:56.643526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d94a850b-f601-45f7-9d4a-9d3758832ad0 req-b0cd46f4-44be-483c-b44d-11e40592a5a6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:56.660543 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d94a850b-f601-45f7-9d4a-9d3758832ad0 req-b0cd46f4-44be-483c-b44d-11e40592a5a6 service nova] Creating event network-changed:faa8864d-4a7d-44c6-9057-0c34a79e68ae for instance d3adba6e-8637-47c5-a781-b06993b81b76 on n-h2-833090-9 Jul 26 15:05:56.667426 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d94a850b-f601-45f7-9d4a-9d3758832ad0 req-b0cd46f4-44be-483c-b44d-11e40592a5a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059348 Jul 26 15:05:56.668827 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3277/6437] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:57.407250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-18e0e928-69c6-4d82-9133-c6e9af45e77f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:57.408870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-18e0e928-69c6-4d82-9133-c6e9af45e77f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:57.419909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18e0e928-69c6-4d82-9133-c6e9af45e77f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:57.420406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18e0e928-69c6-4d82-9133-c6e9af45e77f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:57.422145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18e0e928-69c6-4d82-9133-c6e9af45e77f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:57.422145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18e0e928-69c6-4d82-9133-c6e9af45e77f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:57.594083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-18e0e928-69c6-4d82-9133-c6e9af45e77f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:57.603923 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-18e0e928-69c6-4d82-9133-c6e9af45e77f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1362 microversion: 2.1 time: 0.203111 Jul 26 15:05:57.604565 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3161/6438] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:57 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:58.628227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3e0580a1-b9f4-444f-b5d5-64b5914ec8ff tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:58.629339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3e0580a1-b9f4-444f-b5d5-64b5914ec8ff tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:58.638285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e0580a1-b9f4-444f-b5d5-64b5914ec8ff tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.638755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e0580a1-b9f4-444f-b5d5-64b5914ec8ff tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.639575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e0580a1-b9f4-444f-b5d5-64b5914ec8ff tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:58.640066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3e0580a1-b9f4-444f-b5d5-64b5914ec8ff tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:58.796800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3e0580a1-b9f4-444f-b5d5-64b5914ec8ff tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:58.806071 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3e0580a1-b9f4-444f-b5d5-64b5914ec8ff tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1362 microversion: 2.1 time: 0.183368 Jul 26 15:05:58.806696 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3278/6439] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:58 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:59.829190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8e32ea8f-1ddb-4f98-8f88-5702f64b745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:59.829771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8e32ea8f-1ddb-4f98-8f88-5702f64b745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:59.840177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e32ea8f-1ddb-4f98-8f88-5702f64b745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:59.840630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e32ea8f-1ddb-4f98-8f88-5702f64b745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:59.841424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e32ea8f-1ddb-4f98-8f88-5702f64b745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:59.841860 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8e32ea8f-1ddb-4f98-8f88-5702f64b745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:59.991734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8e32ea8f-1ddb-4f98-8f88-5702f64b745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:59.999712 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8e32ea8f-1ddb-4f98-8f88-5702f64b745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1362 microversion: 2.1 time: 0.174475 Jul 26 15:06:00.000422 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3162/6440] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:59 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:00.354674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b50f5943-ae2e-4595-a931-c644f2fe733f req-d79b6886-5065-4bcc-a53a-cf581dd2375e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3adba6e-8637-47c5-a781-b06993b81b76", "name": "network-vif-plugged", "status": "completed", "tag": "faa8864d-4a7d-44c6-9057-0c34a79e68ae"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:00.370346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b50f5943-ae2e-4595-a931-c644f2fe733f req-d79b6886-5065-4bcc-a53a-cf581dd2375e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:00.370851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b50f5943-ae2e-4595-a931-c644f2fe733f req-d79b6886-5065-4bcc-a53a-cf581dd2375e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:00.384927 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b50f5943-ae2e-4595-a931-c644f2fe733f req-d79b6886-5065-4bcc-a53a-cf581dd2375e service nova] Creating event network-vif-plugged:faa8864d-4a7d-44c6-9057-0c34a79e68ae for instance d3adba6e-8637-47c5-a781-b06993b81b76 on n-h2-833090-9 Jul 26 15:06:00.390132 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b50f5943-ae2e-4595-a931-c644f2fe733f req-d79b6886-5065-4bcc-a53a-cf581dd2375e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041835 Jul 26 15:06:00.390786 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3279/6441] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:06:01.028983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3415582b-6e76-43f1-b0b4-a3de38467107 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:01.029792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3415582b-6e76-43f1-b0b4-a3de38467107 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:01.039035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3415582b-6e76-43f1-b0b4-a3de38467107 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:01.039500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3415582b-6e76-43f1-b0b4-a3de38467107 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:01.040353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3415582b-6e76-43f1-b0b4-a3de38467107 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:01.040806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3415582b-6e76-43f1-b0b4-a3de38467107 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:01.201169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3415582b-6e76-43f1-b0b4-a3de38467107 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:01.210935 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3415582b-6e76-43f1-b0b4-a3de38467107 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1362 microversion: 2.1 time: 0.185700 Jul 26 15:06:01.212032 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3163/6442] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:01 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:02.242387 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0077fe32-3719-4011-a55a-d340823801be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:02.243696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0077fe32-3719-4011-a55a-d340823801be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:02.255054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0077fe32-3719-4011-a55a-d340823801be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:02.255919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0077fe32-3719-4011-a55a-d340823801be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:02.257417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0077fe32-3719-4011-a55a-d340823801be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:02.258225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0077fe32-3719-4011-a55a-d340823801be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:02.457619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0077fe32-3719-4011-a55a-d340823801be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:02.468521 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0077fe32-3719-4011-a55a-d340823801be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1549 microversion: 2.1 time: 0.235297 Jul 26 15:06:02.469332 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3280/6443] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:02 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1549 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:02.501962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8a13ca54-81cf-4f3e-be9b-be6da2caecbf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:02.502822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8a13ca54-81cf-4f3e-be9b-be6da2caecbf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:02.514870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a13ca54-81cf-4f3e-be9b-be6da2caecbf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:02.515652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a13ca54-81cf-4f3e-be9b-be6da2caecbf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:02.517017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a13ca54-81cf-4f3e-be9b-be6da2caecbf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:02.517799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a13ca54-81cf-4f3e-be9b-be6da2caecbf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:02.627124 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8a13ca54-81cf-4f3e-be9b-be6da2caecbf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131846 Jul 26 15:06:02.627852 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3164/6444] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 15:06:02 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:06:04.306089 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e66d0053-5307-4340-a16d-4601ff506488 req-8ae8dd55-09f2-40f0-8dd0-3932e2caa8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3adba6e-8637-47c5-a781-b06993b81b76", "tag": "faa8864d-4a7d-44c6-9057-0c34a79e68ae"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:04.316782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:04.317977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:04.329808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e66d0053-5307-4340-a16d-4601ff506488 req-8ae8dd55-09f2-40f0-8dd0-3932e2caa8a5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:04.330627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e66d0053-5307-4340-a16d-4601ff506488 req-8ae8dd55-09f2-40f0-8dd0-3932e2caa8a5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:04.353570 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e66d0053-5307-4340-a16d-4601ff506488 req-8ae8dd55-09f2-40f0-8dd0-3932e2caa8a5 service nova] Creating event network-changed:faa8864d-4a7d-44c6-9057-0c34a79e68ae for instance d3adba6e-8637-47c5-a781-b06993b81b76 on n-h2-833090-9 Jul 26 15:06:04.362919 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e66d0053-5307-4340-a16d-4601ff506488 req-8ae8dd55-09f2-40f0-8dd0-3932e2caa8a5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064918 Jul 26 15:06:04.363931 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3281/6445] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:06:48.341395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:48.342446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=13 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:48.343373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=51 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:48.351184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7411c5c2-7d8c-49c2-971f-0e25dddc4f89 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:48.363485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7411c5c2-7d8c-49c2-971f-0e25dddc4f89 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:48.364141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7411c5c2-7d8c-49c2-971f-0e25dddc4f89 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:48.401643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7411c5c2-7d8c-49c2-971f-0e25dddc4f89 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Going to try to stop instance {{(pid=119478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 15:06:48.467256 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7411c5c2-7d8c-49c2-971f-0e25dddc4f89 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76/action" status: 202 len: 0 microversion: 2.1 time: 0.127783 Jul 26 15:06:48.468663 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3165/6446] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:06:48 2022] POST /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:06:48.479790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:48.481675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:48.490219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-382a2566-defe-4b11-9c6b-7ee8c6256e32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.491759 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-382a2566-defe-4b11-9c6b-7ee8c6256e32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:48.505995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-382a2566-defe-4b11-9c6b-7ee8c6256e32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:48.506479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-382a2566-defe-4b11-9c6b-7ee8c6256e32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:48.507322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-382a2566-defe-4b11-9c6b-7ee8c6256e32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:48.508579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-382a2566-defe-4b11-9c6b-7ee8c6256e32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:48.806620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-382a2566-defe-4b11-9c6b-7ee8c6256e32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:48.820818 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-382a2566-defe-4b11-9c6b-7ee8c6256e32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.344744 Jul 26 15:06:48.821796 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3282/6447] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:48 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:49.855657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b554af8e-2800-46f8-a0a6-90efde4d7ad3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:49.856801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b554af8e-2800-46f8-a0a6-90efde4d7ad3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:49.869091 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b554af8e-2800-46f8-a0a6-90efde4d7ad3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.869868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b554af8e-2800-46f8-a0a6-90efde4d7ad3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:49.871235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b554af8e-2800-46f8-a0a6-90efde4d7ad3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.872385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b554af8e-2800-46f8-a0a6-90efde4d7ad3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.167662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b554af8e-2800-46f8-a0a6-90efde4d7ad3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:50.179015 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b554af8e-2800-46f8-a0a6-90efde4d7ad3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.332460 Jul 26 15:06:50.179626 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3166/6448] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:49 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:51.209667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c476d465-a3e9-4872-8316-200bb1d77a96 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:51.210893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c476d465-a3e9-4872-8316-200bb1d77a96 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:51.224404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c476d465-a3e9-4872-8316-200bb1d77a96 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:51.225167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c476d465-a3e9-4872-8316-200bb1d77a96 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:51.226053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c476d465-a3e9-4872-8316-200bb1d77a96 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:51.226566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c476d465-a3e9-4872-8316-200bb1d77a96 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:51.425369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c476d465-a3e9-4872-8316-200bb1d77a96 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:51.440699 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c476d465-a3e9-4872-8316-200bb1d77a96 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.238458 Jul 26 15:06:51.441955 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3283/6449] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:51 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:52.473550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f4feb7a0-2afd-4dd6-999b-5cb5466641c0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:52.474346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f4feb7a0-2afd-4dd6-999b-5cb5466641c0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:52.484541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4feb7a0-2afd-4dd6-999b-5cb5466641c0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:52.485499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4feb7a0-2afd-4dd6-999b-5cb5466641c0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:52.487269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4feb7a0-2afd-4dd6-999b-5cb5466641c0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:52.487778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f4feb7a0-2afd-4dd6-999b-5cb5466641c0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:52.687620 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f4feb7a0-2afd-4dd6-999b-5cb5466641c0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:52.696505 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f4feb7a0-2afd-4dd6-999b-5cb5466641c0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.229058 Jul 26 15:06:52.697230 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3167/6450] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:52 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:53.723714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c93694f4-5d3e-4ed6-941c-4f2bd65bc19b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:53.724635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c93694f4-5d3e-4ed6-941c-4f2bd65bc19b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:53.732188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c93694f4-5d3e-4ed6-941c-4f2bd65bc19b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.732672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c93694f4-5d3e-4ed6-941c-4f2bd65bc19b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.733518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c93694f4-5d3e-4ed6-941c-4f2bd65bc19b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.733986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c93694f4-5d3e-4ed6-941c-4f2bd65bc19b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.891245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c93694f4-5d3e-4ed6-941c-4f2bd65bc19b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:53.899600 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c93694f4-5d3e-4ed6-941c-4f2bd65bc19b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.182008 Jul 26 15:06:53.900247 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3284/6451] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:53 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:54.921818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-37f56086-1316-4afd-968d-11736d8605b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:54.922437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-37f56086-1316-4afd-968d-11736d8605b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:54.930984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37f56086-1316-4afd-968d-11736d8605b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:54.931443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37f56086-1316-4afd-968d-11736d8605b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:54.932291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37f56086-1316-4afd-968d-11736d8605b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:54.932729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-37f56086-1316-4afd-968d-11736d8605b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:55.090806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-37f56086-1316-4afd-968d-11736d8605b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:55.099611 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-37f56086-1316-4afd-968d-11736d8605b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.181679 Jul 26 15:06:55.100231 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3168/6452] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:54 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:06:56.122126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a463464-bf17-46aa-95a2-01c3ac9205f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:56.123364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a463464-bf17-46aa-95a2-01c3ac9205f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:56.135535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a463464-bf17-46aa-95a2-01c3ac9205f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.136042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a463464-bf17-46aa-95a2-01c3ac9205f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.136861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a463464-bf17-46aa-95a2-01c3ac9205f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.137397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a463464-bf17-46aa-95a2-01c3ac9205f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.313993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a463464-bf17-46aa-95a2-01c3ac9205f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:56.322595 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a463464-bf17-46aa-95a2-01c3ac9205f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.204423 Jul 26 15:06:56.323246 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3285/6453] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:56 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:57.349316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e9809c00-63b4-41b9-a4eb-094a9d727ab4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:57.350038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e9809c00-63b4-41b9-a4eb-094a9d727ab4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:57.358108 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9809c00-63b4-41b9-a4eb-094a9d727ab4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:57.358565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9809c00-63b4-41b9-a4eb-094a9d727ab4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:57.359359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9809c00-63b4-41b9-a4eb-094a9d727ab4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:57.359804 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9809c00-63b4-41b9-a4eb-094a9d727ab4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:57.552914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e9809c00-63b4-41b9-a4eb-094a9d727ab4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:57.563495 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e9809c00-63b4-41b9-a4eb-094a9d727ab4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.221188 Jul 26 15:06:57.564590 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3169/6454] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:57 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:58.599706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5cb66d48-d3d5-421e-b1f9-343635081562 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:58.600384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5cb66d48-d3d5-421e-b1f9-343635081562 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:58.607984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cb66d48-d3d5-421e-b1f9-343635081562 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:58.608443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cb66d48-d3d5-421e-b1f9-343635081562 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:58.609245 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cb66d48-d3d5-421e-b1f9-343635081562 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:58.609705 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5cb66d48-d3d5-421e-b1f9-343635081562 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:58.805166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5cb66d48-d3d5-421e-b1f9-343635081562 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:58.817631 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5cb66d48-d3d5-421e-b1f9-343635081562 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.222649 Jul 26 15:06:58.818462 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3286/6455] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:58 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:59.846160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-65f76c93-0346-4f3f-8f12-bac4f9809ded tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:59.846812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-65f76c93-0346-4f3f-8f12-bac4f9809ded tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:59.854129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65f76c93-0346-4f3f-8f12-bac4f9809ded tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:59.854582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65f76c93-0346-4f3f-8f12-bac4f9809ded tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:59.855358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65f76c93-0346-4f3f-8f12-bac4f9809ded tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:59.855792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65f76c93-0346-4f3f-8f12-bac4f9809ded tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:00.001962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-65f76c93-0346-4f3f-8f12-bac4f9809ded tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:00.009920 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-65f76c93-0346-4f3f-8f12-bac4f9809ded tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1655 microversion: 2.1 time: 0.168377 Jul 26 15:07:00.010515 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3170/6456] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:59 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:00.032334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:00.036363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:00.045255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:00.045884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:00.046814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:00.047399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:00.083710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:00.090834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Old instance type m1.heat2, new instance type m1.heat {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 15:07:00.098800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:07:00.099144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:07:00.099638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:07:00.100108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:07:00.100544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:07:00.185131 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27b5a035-6929-4f39-bce8-963a0faa619e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76/action" status: 202 len: 0 microversion: 2.1 time: 0.156859 Jul 26 15:07:00.185941 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3287/6457] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:07:00 2022] POST /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:07:00.196995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1d778ae5-31f4-4e68-8d6d-bde9524dbbf4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:00.199044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1d778ae5-31f4-4e68-8d6d-bde9524dbbf4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:00.206814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d778ae5-31f4-4e68-8d6d-bde9524dbbf4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:00.207535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d778ae5-31f4-4e68-8d6d-bde9524dbbf4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:00.209022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d778ae5-31f4-4e68-8d6d-bde9524dbbf4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:00.209767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d778ae5-31f4-4e68-8d6d-bde9524dbbf4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:00.396233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d778ae5-31f4-4e68-8d6d-bde9524dbbf4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:00.407069 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1d778ae5-31f4-4e68-8d6d-bde9524dbbf4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.214643 Jul 26 15:07:00.408905 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3171/6458] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:00 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:01.432919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d5de324d-99ac-4bb1-bf95-b3ee1e37c559 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:01.433564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d5de324d-99ac-4bb1-bf95-b3ee1e37c559 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:01.445951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5de324d-99ac-4bb1-bf95-b3ee1e37c559 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:01.447064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5de324d-99ac-4bb1-bf95-b3ee1e37c559 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:01.447908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5de324d-99ac-4bb1-bf95-b3ee1e37c559 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:01.448401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d5de324d-99ac-4bb1-bf95-b3ee1e37c559 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:01.609264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d5de324d-99ac-4bb1-bf95-b3ee1e37c559 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:01.621138 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d5de324d-99ac-4bb1-bf95-b3ee1e37c559 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1678 microversion: 2.1 time: 0.193415 Jul 26 15:07:01.622149 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3288/6459] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:01 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:02.652932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1778a674-bcfd-48ea-971b-9930b4ca7e74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:02.654057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1778a674-bcfd-48ea-971b-9930b4ca7e74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:02.665162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1778a674-bcfd-48ea-971b-9930b4ca7e74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.665162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1778a674-bcfd-48ea-971b-9930b4ca7e74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.666505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1778a674-bcfd-48ea-971b-9930b4ca7e74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.667204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1778a674-bcfd-48ea-971b-9930b4ca7e74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.869203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1778a674-bcfd-48ea-971b-9930b4ca7e74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:02.879041 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1778a674-bcfd-48ea-971b-9930b4ca7e74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1683 microversion: 2.1 time: 0.232468 Jul 26 15:07:02.879644 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3172/6460] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:02 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1683 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:03.909098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-023399c8-c6da-4133-90c4-4467fe45c0c3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:03.910012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-023399c8-c6da-4133-90c4-4467fe45c0c3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:03.921267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-023399c8-c6da-4133-90c4-4467fe45c0c3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.922027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-023399c8-c6da-4133-90c4-4467fe45c0c3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:03.923941 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-023399c8-c6da-4133-90c4-4467fe45c0c3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.924800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-023399c8-c6da-4133-90c4-4467fe45c0c3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:04.123197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-023399c8-c6da-4133-90c4-4467fe45c0c3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:04.135808 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-023399c8-c6da-4133-90c4-4467fe45c0c3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1683 microversion: 2.1 time: 0.233722 Jul 26 15:07:04.136916 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3289/6461] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:03 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1683 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:05.160407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5604df4f-e6fb-4712-8201-a72bf06945ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:05.161018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5604df4f-e6fb-4712-8201-a72bf06945ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:05.169202 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5604df4f-e6fb-4712-8201-a72bf06945ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:05.169662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5604df4f-e6fb-4712-8201-a72bf06945ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:05.170461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5604df4f-e6fb-4712-8201-a72bf06945ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:05.170893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5604df4f-e6fb-4712-8201-a72bf06945ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:05.352923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5604df4f-e6fb-4712-8201-a72bf06945ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:05.364419 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5604df4f-e6fb-4712-8201-a72bf06945ba tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1682 microversion: 2.1 time: 0.207844 Jul 26 15:07:05.365215 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3173/6462] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:05 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:05.612564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-11cd51f9-afd7-4265-b2e1-f5d793dd8115 req-54c67684-4b16-4c60-ac12-cd45f8345f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3adba6e-8637-47c5-a781-b06993b81b76", "name": "network-vif-unplugged", "status": "completed", "tag": "faa8864d-4a7d-44c6-9057-0c34a79e68ae"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:05.630333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-11cd51f9-afd7-4265-b2e1-f5d793dd8115 req-54c67684-4b16-4c60-ac12-cd45f8345f26 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:05.630890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-11cd51f9-afd7-4265-b2e1-f5d793dd8115 req-54c67684-4b16-4c60-ac12-cd45f8345f26 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:05.653917 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-11cd51f9-afd7-4265-b2e1-f5d793dd8115 req-54c67684-4b16-4c60-ac12-cd45f8345f26 service nova] Creating event network-vif-unplugged:faa8864d-4a7d-44c6-9057-0c34a79e68ae for instance d3adba6e-8637-47c5-a781-b06993b81b76 on n-h1-833090-9 Jul 26 15:07:05.660404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-11cd51f9-afd7-4265-b2e1-f5d793dd8115 req-54c67684-4b16-4c60-ac12-cd45f8345f26 service nova] Instance d3adba6e-8637-47c5-a781-b06993b81b76 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:07:05.672849 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-11cd51f9-afd7-4265-b2e1-f5d793dd8115 req-54c67684-4b16-4c60-ac12-cd45f8345f26 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065680 Jul 26 15:07:05.674153 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3290/6463] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:06.389237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d79a655a-de2c-4baa-8df7-cae95c15ba32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:06.389998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d79a655a-de2c-4baa-8df7-cae95c15ba32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:06.399323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d79a655a-de2c-4baa-8df7-cae95c15ba32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:06.399919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d79a655a-de2c-4baa-8df7-cae95c15ba32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:06.401199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d79a655a-de2c-4baa-8df7-cae95c15ba32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:06.401784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d79a655a-de2c-4baa-8df7-cae95c15ba32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:06.602593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d79a655a-de2c-4baa-8df7-cae95c15ba32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:06.611995 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d79a655a-de2c-4baa-8df7-cae95c15ba32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1682 microversion: 2.1 time: 0.227772 Jul 26 15:07:06.612580 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3174/6464] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:06 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:07.639039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f5b8a32-ba97-4d85-a9b5-7744c19f9115 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:07.639859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f5b8a32-ba97-4d85-a9b5-7744c19f9115 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:07.647484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f5b8a32-ba97-4d85-a9b5-7744c19f9115 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.647977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f5b8a32-ba97-4d85-a9b5-7744c19f9115 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.648793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f5b8a32-ba97-4d85-a9b5-7744c19f9115 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.649255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f5b8a32-ba97-4d85-a9b5-7744c19f9115 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.698060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3d035ad3-938b-4210-b5c8-4ce6585e379e req-03b6da16-b548-4bd0-a61f-85373282ace5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3adba6e-8637-47c5-a781-b06993b81b76", "tag": "faa8864d-4a7d-44c6-9057-0c34a79e68ae"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:07.712857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3d035ad3-938b-4210-b5c8-4ce6585e379e req-03b6da16-b548-4bd0-a61f-85373282ace5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.713304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3d035ad3-938b-4210-b5c8-4ce6585e379e req-03b6da16-b548-4bd0-a61f-85373282ace5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.726666 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3d035ad3-938b-4210-b5c8-4ce6585e379e req-03b6da16-b548-4bd0-a61f-85373282ace5 service nova] Creating event network-changed:faa8864d-4a7d-44c6-9057-0c34a79e68ae for instance d3adba6e-8637-47c5-a781-b06993b81b76 on n-h1-833090-9 Jul 26 15:07:07.733178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-3d035ad3-938b-4210-b5c8-4ce6585e379e req-03b6da16-b548-4bd0-a61f-85373282ace5 service nova] Instance d3adba6e-8637-47c5-a781-b06993b81b76 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:07:07.748113 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3d035ad3-938b-4210-b5c8-4ce6585e379e req-03b6da16-b548-4bd0-a61f-85373282ace5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056923 Jul 26 15:07:07.749247 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3175/6465] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:07:07.885002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3f5b8a32-ba97-4d85-a9b5-7744c19f9115 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:07.906604 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f5b8a32-ba97-4d85-a9b5-7744c19f9115 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1680 microversion: 2.1 time: 0.271951 Jul 26 15:07:07.919983 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3291/6466] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:07 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1680 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:08.949751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cafe4a65-b4b9-435f-97b7-cbb4b3fc0a42 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:08.950354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cafe4a65-b4b9-435f-97b7-cbb4b3fc0a42 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:08.958273 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafe4a65-b4b9-435f-97b7-cbb4b3fc0a42 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:08.958811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafe4a65-b4b9-435f-97b7-cbb4b3fc0a42 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:08.959612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafe4a65-b4b9-435f-97b7-cbb4b3fc0a42 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:08.960085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cafe4a65-b4b9-435f-97b7-cbb4b3fc0a42 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:09.149389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cafe4a65-b4b9-435f-97b7-cbb4b3fc0a42 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:09.158894 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cafe4a65-b4b9-435f-97b7-cbb4b3fc0a42 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1676 microversion: 2.1 time: 0.219040 Jul 26 15:07:09.159647 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3176/6467] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:08 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:09.184656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e7c84efc-42b4-4b7a-bf2c-77ac075e12c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:09.185503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e7c84efc-42b4-4b7a-bf2c-77ac075e12c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:09.192648 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7c84efc-42b4-4b7a-bf2c-77ac075e12c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:09.193118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7c84efc-42b4-4b7a-bf2c-77ac075e12c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:09.193921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7c84efc-42b4-4b7a-bf2c-77ac075e12c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:09.194376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7c84efc-42b4-4b7a-bf2c-77ac075e12c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:09.272443 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e7c84efc-42b4-4b7a-bf2c-77ac075e12c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76/action" status: 204 len: 0 microversion: 2.1 time: 0.093173 Jul 26 15:07:09.273122 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3292/6468] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:07:09 2022] POST /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76/action => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:07:09.284640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3f922797-6e6f-4329-ab48-b1acb4e966b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:09.285719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3f922797-6e6f-4329-ab48-b1acb4e966b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:09.293500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f922797-6e6f-4329-ab48-b1acb4e966b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:09.294344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f922797-6e6f-4329-ab48-b1acb4e966b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:09.296221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f922797-6e6f-4329-ab48-b1acb4e966b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:09.296661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f922797-6e6f-4329-ab48-b1acb4e966b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:09.566934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3f922797-6e6f-4329-ab48-b1acb4e966b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:09.576333 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3f922797-6e6f-4329-ab48-b1acb4e966b7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1676 microversion: 2.1 time: 0.297706 Jul 26 15:07:09.576937 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3177/6469] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:09 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1676 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:10.602717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-219e80c8-6f3e-4e98-93b3-40dcfdcf3c74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:10.603500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-219e80c8-6f3e-4e98-93b3-40dcfdcf3c74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:10.611697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-219e80c8-6f3e-4e98-93b3-40dcfdcf3c74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:10.612322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-219e80c8-6f3e-4e98-93b3-40dcfdcf3c74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:10.613145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-219e80c8-6f3e-4e98-93b3-40dcfdcf3c74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:10.613609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-219e80c8-6f3e-4e98-93b3-40dcfdcf3c74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:10.832685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-219e80c8-6f3e-4e98-93b3-40dcfdcf3c74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:10.849770 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-219e80c8-6f3e-4e98-93b3-40dcfdcf3c74 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1676 microversion: 2.1 time: 0.252274 Jul 26 15:07:10.851718 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3293/6470] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:10 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:11.874275 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-59d8d469-c830-432a-bbd1-94b5744a2b71 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:11.874910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-59d8d469-c830-432a-bbd1-94b5744a2b71 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:11.881714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59d8d469-c830-432a-bbd1-94b5744a2b71 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:11.882165 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59d8d469-c830-432a-bbd1-94b5744a2b71 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:11.882943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59d8d469-c830-432a-bbd1-94b5744a2b71 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:11.883380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-59d8d469-c830-432a-bbd1-94b5744a2b71 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.052750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-59d8d469-c830-432a-bbd1-94b5744a2b71 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:12.066237 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-59d8d469-c830-432a-bbd1-94b5744a2b71 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1655 microversion: 2.1 time: 0.195810 Jul 26 15:07:12.067281 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3178/6471] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:11 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1655 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:12.095764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-be2312dc-7015-482c-bd55-2d7e04252414 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:12.097091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-be2312dc-7015-482c-bd55-2d7e04252414 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:12.111221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be2312dc-7015-482c-bd55-2d7e04252414 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.111922 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be2312dc-7015-482c-bd55-2d7e04252414 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.113322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be2312dc-7015-482c-bd55-2d7e04252414 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.114092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-be2312dc-7015-482c-bd55-2d7e04252414 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.588750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-be2312dc-7015-482c-bd55-2d7e04252414 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:12.600930 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-be2312dc-7015-482c-bd55-2d7e04252414 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1655 microversion: 2.1 time: 0.512465 Jul 26 15:07:12.601815 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3294/6472] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:12 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1655 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:12.631359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-97103238-4244-4b43-940d-5c17d84a4314 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:12.640556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97103238-4244-4b43-940d-5c17d84a4314 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.641144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97103238-4244-4b43-940d-5c17d84a4314 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.684171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-97103238-4244-4b43-940d-5c17d84a4314 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Going to try to start instance {{(pid=119478) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 15:07:12.728975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:12.743771 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-97103238-4244-4b43-940d-5c17d84a4314 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76/action" status: 202 len: 0 microversion: 2.1 time: 0.119193 Jul 26 15:07:12.748115 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3179/6473] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:07:12 2022] POST /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:07:12.758575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2fed2250-3a21-4fbe-be29-5692f1205ea3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:12.760295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2fed2250-3a21-4fbe-be29-5692f1205ea3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:12.774628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2fed2250-3a21-4fbe-be29-5692f1205ea3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.774628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2fed2250-3a21-4fbe-be29-5692f1205ea3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.774628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2fed2250-3a21-4fbe-be29-5692f1205ea3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.775049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2fed2250-3a21-4fbe-be29-5692f1205ea3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.874526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-77c1c7b5-20a8-4e78-9bce-8bc99c50d063 req-d9bc3f07-dd7c-44a9-8f5a-2d085651680c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3adba6e-8637-47c5-a781-b06993b81b76", "name": "network-vif-plugged", "status": "completed", "tag": "faa8864d-4a7d-44c6-9057-0c34a79e68ae"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:12.887362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-77c1c7b5-20a8-4e78-9bce-8bc99c50d063 req-d9bc3f07-dd7c-44a9-8f5a-2d085651680c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.888611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-77c1c7b5-20a8-4e78-9bce-8bc99c50d063 req-d9bc3f07-dd7c-44a9-8f5a-2d085651680c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.908453 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-77c1c7b5-20a8-4e78-9bce-8bc99c50d063 req-d9bc3f07-dd7c-44a9-8f5a-2d085651680c service nova] Creating event network-vif-plugged:faa8864d-4a7d-44c6-9057-0c34a79e68ae for instance d3adba6e-8637-47c5-a781-b06993b81b76 on n-h1-833090-9 Jul 26 15:07:12.914165 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-77c1c7b5-20a8-4e78-9bce-8bc99c50d063 req-d9bc3f07-dd7c-44a9-8f5a-2d085651680c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172738 Jul 26 15:07:12.914951 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3295/6474] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:07:12.965829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2fed2250-3a21-4fbe-be29-5692f1205ea3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:12.980786 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2fed2250-3a21-4fbe-be29-5692f1205ea3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1664 microversion: 2.1 time: 0.229417 Jul 26 15:07:12.982455 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3180/6475] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:12 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1664 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:14.007561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fd36a901-4907-4309-9ac8-21362b25f186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:14.008758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fd36a901-4907-4309-9ac8-21362b25f186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:14.017270 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd36a901-4907-4309-9ac8-21362b25f186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:14.018220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd36a901-4907-4309-9ac8-21362b25f186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:14.019308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd36a901-4907-4309-9ac8-21362b25f186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:14.019892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fd36a901-4907-4309-9ac8-21362b25f186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:14.237439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fd36a901-4907-4309-9ac8-21362b25f186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:14.245695 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fd36a901-4907-4309-9ac8-21362b25f186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1664 microversion: 2.1 time: 0.245811 Jul 26 15:07:14.246291 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3296/6476] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:13 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1664 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:15.267788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-acab523b-a8c6-432e-b07b-641116092f1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:15.268810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-acab523b-a8c6-432e-b07b-641116092f1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:15.279251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acab523b-a8c6-432e-b07b-641116092f1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.279857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acab523b-a8c6-432e-b07b-641116092f1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.280944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acab523b-a8c6-432e-b07b-641116092f1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.281652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acab523b-a8c6-432e-b07b-641116092f1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.440142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-acab523b-a8c6-432e-b07b-641116092f1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:15.452412 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-acab523b-a8c6-432e-b07b-641116092f1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1668 microversion: 2.1 time: 0.188621 Jul 26 15:07:15.453152 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3181/6477] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:15 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1668 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:15.475405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ab7796d-8694-45af-a986-d94fe1bda672 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:15.476095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5ab7796d-8694-45af-a986-d94fe1bda672 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:15.486549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ab7796d-8694-45af-a986-d94fe1bda672 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.487026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ab7796d-8694-45af-a986-d94fe1bda672 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.487842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ab7796d-8694-45af-a986-d94fe1bda672 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.488343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ab7796d-8694-45af-a986-d94fe1bda672 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.491413 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:15.520890 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5ab7796d-8694-45af-a986-d94fe1bda672 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:07:15.618651 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ab7796d-8694-45af-a986-d94fe1bda672 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 204 len: 0 microversion: 2.1 time: 0.146841 Jul 26 15:07:15.619745 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3297/6478] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:07:15 2022] DELETE /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:07:15.630258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1aa916c8-ad71-4fab-9c81-810e356304f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:15.631076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1aa916c8-ad71-4fab-9c81-810e356304f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:15.639052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1aa916c8-ad71-4fab-9c81-810e356304f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.639708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1aa916c8-ad71-4fab-9c81-810e356304f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.640673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1aa916c8-ad71-4fab-9c81-810e356304f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:15.641873 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1aa916c8-ad71-4fab-9c81-810e356304f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.793277 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1aa916c8-ad71-4fab-9c81-810e356304f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:15.803464 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1aa916c8-ad71-4fab-9c81-810e356304f3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1674 microversion: 2.1 time: 0.178433 Jul 26 15:07:15.804086 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3182/6479] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:15 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:16.831926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e7037b3d-6a9e-4fe5-97d3-4a0dd71fb582 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:16.833101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e7037b3d-6a9e-4fe5-97d3-4a0dd71fb582 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:16.846358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7037b3d-6a9e-4fe5-97d3-4a0dd71fb582 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:16.846855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7037b3d-6a9e-4fe5-97d3-4a0dd71fb582 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:16.847700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7037b3d-6a9e-4fe5-97d3-4a0dd71fb582 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:16.848231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e7037b3d-6a9e-4fe5-97d3-4a0dd71fb582 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:17.073618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e7037b3d-6a9e-4fe5-97d3-4a0dd71fb582 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:17.092984 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e7037b3d-6a9e-4fe5-97d3-4a0dd71fb582 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1674 microversion: 2.1 time: 0.268890 Jul 26 15:07:17.094090 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3298/6480] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:16 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1674 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:18.004484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-59e5963c-88c7-4122-9e53-bb964d908efb req-fb5f620d-ee93-49b1-a627-2bee59556f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3adba6e-8637-47c5-a781-b06993b81b76", "name": "network-vif-deleted", "tag": "faa8864d-4a7d-44c6-9057-0c34a79e68ae"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:18.021448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-59e5963c-88c7-4122-9e53-bb964d908efb req-fb5f620d-ee93-49b1-a627-2bee59556f79 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:18.022069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-59e5963c-88c7-4122-9e53-bb964d908efb req-fb5f620d-ee93-49b1-a627-2bee59556f79 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.044116 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-59e5963c-88c7-4122-9e53-bb964d908efb req-fb5f620d-ee93-49b1-a627-2bee59556f79 service nova] Creating event network-vif-deleted:faa8864d-4a7d-44c6-9057-0c34a79e68ae for instance d3adba6e-8637-47c5-a781-b06993b81b76 on n-h1-833090-9 Jul 26 15:07:18.053554 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-59e5963c-88c7-4122-9e53-bb964d908efb req-fb5f620d-ee93-49b1-a627-2bee59556f79 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052860 Jul 26 15:07:18.054832 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3183/6481] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:07:18.124828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:18.127157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:18.142414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:18.144749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.147100 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:18.148256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.201169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:18.201551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.202027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lazy-loading 'fault' on Instance uuid d3adba6e-8637-47c5-a781-b06993b81b76 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:07:18.254624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:18.265418 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-738a3576-8ed4-4926-ad8c-2555cfdb210d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 200 len: 1327 microversion: 2.1 time: 0.149087 Jul 26 15:07:18.266392 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3299/6482] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:18 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 1327 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:19.291899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0e2385b-f153-4e4d-8ba5-2482a789f626 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:19.292632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c0e2385b-f153-4e4d-8ba5-2482a789f626 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:19.294802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=39 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:19.300963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0e2385b-f153-4e4d-8ba5-2482a789f626 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.301411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0e2385b-f153-4e4d-8ba5-2482a789f626 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.302189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0e2385b-f153-4e4d-8ba5-2482a789f626 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.302626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0e2385b-f153-4e4d-8ba5-2482a789f626 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.326560 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c0e2385b-f153-4e4d-8ba5-2482a789f626 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0e2385b-f153-4e4d-8ba5-2482a789f626 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 HTTP/1.1 Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd3adba6e-8637-47c5-a781-b06993b81b76'} Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:07:19.328293 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:07:19.336682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:19.336682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:07:19.336682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:07:19.336682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:07:19.336682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:07:19.336682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:07:19.336682 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:07:19.336682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0e2385b-f153-4e4d-8ba5-2482a789f626 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:07:19.336682 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c0e2385b-f153-4e4d-8ba5-2482a789f626 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 404 len: 111 microversion: 2.1 time: 0.044784 Jul 26 15:07:19.336682 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3184/6483] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:19 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:07:19.347713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b6fc30fb-f191-4aac-9757-259b3cf80cb1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:19.348584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b6fc30fb-f191-4aac-9757-259b3cf80cb1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:19.351597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:19.357716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6fc30fb-f191-4aac-9757-259b3cf80cb1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.358192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6fc30fb-f191-4aac-9757-259b3cf80cb1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.359056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6fc30fb-f191-4aac-9757-259b3cf80cb1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.359521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b6fc30fb-f191-4aac-9757-259b3cf80cb1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.375159 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-b6fc30fb-f191-4aac-9757-259b3cf80cb1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b6fc30fb-f191-4aac-9757-259b3cf80cb1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 HTTP/1.1 Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd3adba6e-8637-47c5-a781-b06993b81b76'} Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:07:19.377742 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:07:19.382204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:07:19.382204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:07:19.382204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:07:19.382204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:07:19.382204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:07:19.382204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:07:19.382204 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:07:19.382204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b6fc30fb-f191-4aac-9757-259b3cf80cb1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:07:19.382204 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b6fc30fb-f191-4aac-9757-259b3cf80cb1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 404 len: 111 microversion: 2.1 time: 0.037044 Jul 26 15:07:19.382204 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3300/6484] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:19 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:07:19.435278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1469011820", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "66cb7b7e-a81f-4c0f-acf4-78a073c427bb"}], "security_groups": [{"name": "tempest-securitygroup--502582096"}], "key_name": "tempest-keypair-41852955", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:19.599695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] validate_networks() for [('66cb7b7e-a81f-4c0f-acf4-78a073c427bb', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:07:20.177197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:07:20.178038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:07:20.178464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:07:20.178880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:07:20.179300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:07:20.193312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.193765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.194568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.195242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.216196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:07:20.225203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for user b5b34650cfc14e69ace08e3a0be3ca06 and project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:07:20.241215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:07:20.243558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:07:20.310172 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-14f6240d-c062-4761-af47-be9e1d3ee932 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.878760 Jul 26 15:07:20.311176 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3185/6485] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:07:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:07:20.323771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-50ea7e7e-1613-473a-8dbd-757d6cf1d963 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:20.324837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-50ea7e7e-1613-473a-8dbd-757d6cf1d963 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:20.416742 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-50ea7e7e-1613-473a-8dbd-757d6cf1d963 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:20.426906 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-50ea7e7e-1613-473a-8dbd-757d6cf1d963 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1237 microversion: 2.1 time: 0.107259 Jul 26 15:07:20.427517 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3301/6486] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:20 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:21.456920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-85ed2e7f-187d-4c87-90c5-9415552a1f92 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:21.457936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-85ed2e7f-187d-4c87-90c5-9415552a1f92 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:21.466249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85ed2e7f-187d-4c87-90c5-9415552a1f92 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:21.466710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85ed2e7f-187d-4c87-90c5-9415552a1f92 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:21.468411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85ed2e7f-187d-4c87-90c5-9415552a1f92 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:21.469104 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85ed2e7f-187d-4c87-90c5-9415552a1f92 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:21.609341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-85ed2e7f-187d-4c87-90c5-9415552a1f92 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:21.621993 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-85ed2e7f-187d-4c87-90c5-9415552a1f92 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1289 microversion: 2.1 time: 0.170030 Jul 26 15:07:21.622897 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3186/6487] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:21 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1289 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:22.650807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d6f39926-1d64-4894-8bd1-66380e9e972f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:22.652086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d6f39926-1d64-4894-8bd1-66380e9e972f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:22.663817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f39926-1d64-4894-8bd1-66380e9e972f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:22.664468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f39926-1d64-4894-8bd1-66380e9e972f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:22.665367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f39926-1d64-4894-8bd1-66380e9e972f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:22.665924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6f39926-1d64-4894-8bd1-66380e9e972f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:22.937540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d6f39926-1d64-4894-8bd1-66380e9e972f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:22.946704 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d6f39926-1d64-4894-8bd1-66380e9e972f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1362 microversion: 2.1 time: 0.302713 Jul 26 15:07:22.947260 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3302/6488] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:22 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:23.463388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-61542eba-bc02-429b-bfaf-30ed4ddf9123 req-d4955a9d-4a1b-4685-b9f9-d935302bb7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2aa6652-70b2-41c1-8347-8afe4098dee1", "tag": "38dff6d9-5fb3-43cd-9514-ebacb57cdc0b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:23.478829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-61542eba-bc02-429b-bfaf-30ed4ddf9123 req-d4955a9d-4a1b-4685-b9f9-d935302bb7f7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.479751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-61542eba-bc02-429b-bfaf-30ed4ddf9123 req-d4955a9d-4a1b-4685-b9f9-d935302bb7f7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:23.504198 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-61542eba-bc02-429b-bfaf-30ed4ddf9123 req-d4955a9d-4a1b-4685-b9f9-d935302bb7f7 service nova] Creating event network-changed:38dff6d9-5fb3-43cd-9514-ebacb57cdc0b for instance e2aa6652-70b2-41c1-8347-8afe4098dee1 on n-h2-833090-9 Jul 26 15:07:23.513125 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-61542eba-bc02-429b-bfaf-30ed4ddf9123 req-d4955a9d-4a1b-4685-b9f9-d935302bb7f7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163271 Jul 26 15:07:23.513949 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3187/6489] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:07:23.970816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4ec2bdc6-df93-405c-862b-a977cd9cca62 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:23.971655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4ec2bdc6-df93-405c-862b-a977cd9cca62 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:23.980211 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ec2bdc6-df93-405c-862b-a977cd9cca62 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.980899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ec2bdc6-df93-405c-862b-a977cd9cca62 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:23.981991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ec2bdc6-df93-405c-862b-a977cd9cca62 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.982404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4ec2bdc6-df93-405c-862b-a977cd9cca62 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:24.140181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4ec2bdc6-df93-405c-862b-a977cd9cca62 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:24.151207 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4ec2bdc6-df93-405c-862b-a977cd9cca62 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1362 microversion: 2.1 time: 0.185269 Jul 26 15:07:24.159400 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3303/6490] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:23 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:25.174921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-18138fdd-8b62-4c41-a671-22a77e49d4d2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:25.175688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-18138fdd-8b62-4c41-a671-22a77e49d4d2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:25.183561 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18138fdd-8b62-4c41-a671-22a77e49d4d2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:25.184049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18138fdd-8b62-4c41-a671-22a77e49d4d2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:25.184909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18138fdd-8b62-4c41-a671-22a77e49d4d2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:25.185368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18138fdd-8b62-4c41-a671-22a77e49d4d2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:25.468490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-18138fdd-8b62-4c41-a671-22a77e49d4d2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:25.482991 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-18138fdd-8b62-4c41-a671-22a77e49d4d2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1362 microversion: 2.1 time: 0.312654 Jul 26 15:07:25.484071 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3188/6491] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:25 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:26.511183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-de99c4fd-4d39-4afa-af58-61a1526a101f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:26.511983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-de99c4fd-4d39-4afa-af58-61a1526a101f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:26.520829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de99c4fd-4d39-4afa-af58-61a1526a101f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:26.521298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de99c4fd-4d39-4afa-af58-61a1526a101f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:26.522249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de99c4fd-4d39-4afa-af58-61a1526a101f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:26.522706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de99c4fd-4d39-4afa-af58-61a1526a101f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:26.679312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-de99c4fd-4d39-4afa-af58-61a1526a101f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:26.687229 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-de99c4fd-4d39-4afa-af58-61a1526a101f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1362 microversion: 2.1 time: 0.180294 Jul 26 15:07:26.688481 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3304/6492] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:26 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:27.711799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ef59f7b-8bdc-40e6-a9c9-b3bca25a44fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:27.712861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4ef59f7b-8bdc-40e6-a9c9-b3bca25a44fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:27.722033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ef59f7b-8bdc-40e6-a9c9-b3bca25a44fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:27.722578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ef59f7b-8bdc-40e6-a9c9-b3bca25a44fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:27.723410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ef59f7b-8bdc-40e6-a9c9-b3bca25a44fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:27.723981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ef59f7b-8bdc-40e6-a9c9-b3bca25a44fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:27.888417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4ef59f7b-8bdc-40e6-a9c9-b3bca25a44fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:27.898944 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ef59f7b-8bdc-40e6-a9c9-b3bca25a44fd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1362 microversion: 2.1 time: 0.191404 Jul 26 15:07:27.899594 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3189/6493] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:27 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:28.927290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-76a7c183-7f7f-4324-9bf4-a483e35912ea tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:28.929360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-76a7c183-7f7f-4324-9bf4-a483e35912ea tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:28.943438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76a7c183-7f7f-4324-9bf4-a483e35912ea tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:28.944200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76a7c183-7f7f-4324-9bf4-a483e35912ea tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:28.946136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76a7c183-7f7f-4324-9bf4-a483e35912ea tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:28.946513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-76a7c183-7f7f-4324-9bf4-a483e35912ea tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:29.136565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-76a7c183-7f7f-4324-9bf4-a483e35912ea tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:29.147122 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-76a7c183-7f7f-4324-9bf4-a483e35912ea tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1362 microversion: 2.1 time: 0.228432 Jul 26 15:07:29.147995 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3305/6494] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:28 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:30.172933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12f0804a-1fee-4a48-b519-442720211b01 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:30.173939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-12f0804a-1fee-4a48-b519-442720211b01 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:30.182700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12f0804a-1fee-4a48-b519-442720211b01 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:30.183188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12f0804a-1fee-4a48-b519-442720211b01 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:30.184090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12f0804a-1fee-4a48-b519-442720211b01 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:30.184608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12f0804a-1fee-4a48-b519-442720211b01 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:30.205513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:30.232318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:30.366737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-12f0804a-1fee-4a48-b519-442720211b01 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:30.375745 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-12f0804a-1fee-4a48-b519-442720211b01 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1362 microversion: 2.1 time: 0.208444 Jul 26 15:07:30.376397 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3190/6495] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:30 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:30.716775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f3b34148-6b55-4184-b379-49c418fcaf0c req-f8ddbac9-517c-4b6d-9e86-3c3108f2fc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aa6652-70b2-41c1-8347-8afe4098dee1", "name": "network-vif-plugged", "status": "completed", "tag": "38dff6d9-5fb3-43cd-9514-ebacb57cdc0b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:30.726139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:30.736204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f3b34148-6b55-4184-b379-49c418fcaf0c req-f8ddbac9-517c-4b6d-9e86-3c3108f2fc0c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:30.736869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f3b34148-6b55-4184-b379-49c418fcaf0c req-f8ddbac9-517c-4b6d-9e86-3c3108f2fc0c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:30.759123 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f3b34148-6b55-4184-b379-49c418fcaf0c req-f8ddbac9-517c-4b6d-9e86-3c3108f2fc0c service nova] Creating event network-vif-plugged:38dff6d9-5fb3-43cd-9514-ebacb57cdc0b for instance e2aa6652-70b2-41c1-8347-8afe4098dee1 on n-h2-833090-9 Jul 26 15:07:30.769429 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f3b34148-6b55-4184-b379-49c418fcaf0c req-f8ddbac9-517c-4b6d-9e86-3c3108f2fc0c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059238 Jul 26 15:07:30.770059 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3306/6496] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:31.400139 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6f1b2715-2012-402e-ad20-8c36113327be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:31.400894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6f1b2715-2012-402e-ad20-8c36113327be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:31.412397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f1b2715-2012-402e-ad20-8c36113327be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:31.412821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f1b2715-2012-402e-ad20-8c36113327be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:31.413647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f1b2715-2012-402e-ad20-8c36113327be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:31.414105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f1b2715-2012-402e-ad20-8c36113327be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:31.614005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6f1b2715-2012-402e-ad20-8c36113327be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:31.629047 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6f1b2715-2012-402e-ad20-8c36113327be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1362 microversion: 2.1 time: 0.233853 Jul 26 15:07:31.630096 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3191/6497] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:31 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:07:32.663792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6f63a64e-6c2d-437f-ac3e-6954769f2ebe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:32.664882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6f63a64e-6c2d-437f-ac3e-6954769f2ebe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:32.672417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f63a64e-6c2d-437f-ac3e-6954769f2ebe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:32.673215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f63a64e-6c2d-437f-ac3e-6954769f2ebe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:32.674024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f63a64e-6c2d-437f-ac3e-6954769f2ebe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:32.674493 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6f63a64e-6c2d-437f-ac3e-6954769f2ebe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:32.865697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6f63a64e-6c2d-437f-ac3e-6954769f2ebe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:32.879122 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6f63a64e-6c2d-437f-ac3e-6954769f2ebe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1549 microversion: 2.1 time: 0.220802 Jul 26 15:07:32.879667 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3307/6498] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:07:32 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1549 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:07:32.904481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3b64ffbb-a72d-4fc5-a94f-222514d6439a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:32.905394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3b64ffbb-a72d-4fc5-a94f-222514d6439a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:32.918496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b64ffbb-a72d-4fc5-a94f-222514d6439a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:32.918954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b64ffbb-a72d-4fc5-a94f-222514d6439a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:32.919755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b64ffbb-a72d-4fc5-a94f-222514d6439a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:32.920245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b64ffbb-a72d-4fc5-a94f-222514d6439a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:33.027824 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3b64ffbb-a72d-4fc5-a94f-222514d6439a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127406 Jul 26 15:07:33.028461 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3192/6499] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 15:07:32 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:34.717598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-84913153-4754-4194-b9a9-6c8dd590e9f0 req-85148436-d77d-4c7a-bf85-d64640f93041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2aa6652-70b2-41c1-8347-8afe4098dee1", "tag": "38dff6d9-5fb3-43cd-9514-ebacb57cdc0b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:34.735646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-84913153-4754-4194-b9a9-6c8dd590e9f0 req-85148436-d77d-4c7a-bf85-d64640f93041 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:34.736286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-84913153-4754-4194-b9a9-6c8dd590e9f0 req-85148436-d77d-4c7a-bf85-d64640f93041 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:34.752434 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-84913153-4754-4194-b9a9-6c8dd590e9f0 req-85148436-d77d-4c7a-bf85-d64640f93041 service nova] Creating event network-changed:38dff6d9-5fb3-43cd-9514-ebacb57cdc0b for instance e2aa6652-70b2-41c1-8347-8afe4098dee1 on n-h2-833090-9 Jul 26 15:07:34.760537 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-84913153-4754-4194-b9a9-6c8dd590e9f0 req-85148436-d77d-4c7a-bf85-d64640f93041 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047138 Jul 26 15:07:34.761559 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3308/6500] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:19.532649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:19.533582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=60 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:19.538379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:19.542212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:19.553803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:19.554316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:19.555342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:19.555834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:19.592347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:19.603008 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Old instance type m1.heat2, new instance type m1.heat {{(pid=119478) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 15:08:19.616156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:08:19.616721 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:08:19.617575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:08:19.618314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:08:19.618777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:08:19.734627 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-46b58fe8-1fd4-4fd1-8707-98a01a807482 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1/action" status: 202 len: 0 microversion: 2.1 time: 0.204080 Jul 26 15:08:19.736469 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3193/6501] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:08:19 2022] POST /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:08:19.749892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=19 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:19.750645 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:19.758852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0317d578-3892-4399-ad52-29cc29a75255 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:19.760212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0317d578-3892-4399-ad52-29cc29a75255 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:19.771810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0317d578-3892-4399-ad52-29cc29a75255 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:19.772316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0317d578-3892-4399-ad52-29cc29a75255 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:19.773143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0317d578-3892-4399-ad52-29cc29a75255 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:19.773612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0317d578-3892-4399-ad52-29cc29a75255 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:20.049288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0317d578-3892-4399-ad52-29cc29a75255 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:20.062440 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0317d578-3892-4399-ad52-29cc29a75255 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1677 microversion: 2.1 time: 0.317577 Jul 26 15:08:20.063828 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3309/6502] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:19 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1677 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:21.091629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5fddd229-9d21-42fb-aabb-33df91d72e8d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:21.092707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5fddd229-9d21-42fb-aabb-33df91d72e8d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:21.108803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fddd229-9d21-42fb-aabb-33df91d72e8d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:21.109609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fddd229-9d21-42fb-aabb-33df91d72e8d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:21.111056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fddd229-9d21-42fb-aabb-33df91d72e8d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:21.111837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5fddd229-9d21-42fb-aabb-33df91d72e8d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:21.316958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5fddd229-9d21-42fb-aabb-33df91d72e8d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:21.329170 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5fddd229-9d21-42fb-aabb-33df91d72e8d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1677 microversion: 2.1 time: 0.246075 Jul 26 15:08:21.329716 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3194/6503] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:21 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:22.353175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-265e0c7f-9cbf-4ce6-9381-5587b37d520e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:22.353861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-265e0c7f-9cbf-4ce6-9381-5587b37d520e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:22.363221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-265e0c7f-9cbf-4ce6-9381-5587b37d520e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:22.363918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-265e0c7f-9cbf-4ce6-9381-5587b37d520e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:22.365070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-265e0c7f-9cbf-4ce6-9381-5587b37d520e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:22.365719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-265e0c7f-9cbf-4ce6-9381-5587b37d520e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:22.582920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-265e0c7f-9cbf-4ce6-9381-5587b37d520e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:22.592392 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-265e0c7f-9cbf-4ce6-9381-5587b37d520e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1677 microversion: 2.1 time: 0.243035 Jul 26 15:08:22.592989 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3310/6504] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:22 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:23.617525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-323e6db5-6a20-4536-95b5-fede980e7acd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:23.618132 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-323e6db5-6a20-4536-95b5-fede980e7acd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:23.629136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-323e6db5-6a20-4536-95b5-fede980e7acd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:23.629737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-323e6db5-6a20-4536-95b5-fede980e7acd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:23.630770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-323e6db5-6a20-4536-95b5-fede980e7acd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:23.631259 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-323e6db5-6a20-4536-95b5-fede980e7acd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:23.813379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-323e6db5-6a20-4536-95b5-fede980e7acd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:23.821727 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-323e6db5-6a20-4536-95b5-fede980e7acd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.208038 Jul 26 15:08:23.822309 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3195/6505] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:23 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:24.862770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-144bebd3-ac11-4d56-99c0-51697988846b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:24.863761 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-144bebd3-ac11-4d56-99c0-51697988846b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:24.873566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-144bebd3-ac11-4d56-99c0-51697988846b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:24.874093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-144bebd3-ac11-4d56-99c0-51697988846b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:24.875471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-144bebd3-ac11-4d56-99c0-51697988846b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:24.876293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-144bebd3-ac11-4d56-99c0-51697988846b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:25.089414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-144bebd3-ac11-4d56-99c0-51697988846b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:25.102919 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-144bebd3-ac11-4d56-99c0-51697988846b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.247230 Jul 26 15:08:25.104018 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3311/6506] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:24 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:26.132447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7a9a30d1-60e2-4d69-a24b-85cb16232e39 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:26.133330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7a9a30d1-60e2-4d69-a24b-85cb16232e39 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:26.150236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a9a30d1-60e2-4d69-a24b-85cb16232e39 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:26.150750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a9a30d1-60e2-4d69-a24b-85cb16232e39 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:26.151584 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a9a30d1-60e2-4d69-a24b-85cb16232e39 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:26.152113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7a9a30d1-60e2-4d69-a24b-85cb16232e39 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:26.375395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7a9a30d1-60e2-4d69-a24b-85cb16232e39 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:26.385771 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7a9a30d1-60e2-4d69-a24b-85cb16232e39 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.257215 Jul 26 15:08:26.386354 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3196/6507] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:26 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:27.425173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63209de7-dbe3-4119-8d64-d320e6e9cd09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:27.425864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-63209de7-dbe3-4119-8d64-d320e6e9cd09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:27.434678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63209de7-dbe3-4119-8d64-d320e6e9cd09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:27.436099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63209de7-dbe3-4119-8d64-d320e6e9cd09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:27.436099 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63209de7-dbe3-4119-8d64-d320e6e9cd09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:27.436517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-63209de7-dbe3-4119-8d64-d320e6e9cd09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:27.646835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-63209de7-dbe3-4119-8d64-d320e6e9cd09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:27.659855 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63209de7-dbe3-4119-8d64-d320e6e9cd09 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.241604 Jul 26 15:08:27.660501 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3312/6508] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:27 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:28.684937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-45a5950d-09f6-4a18-8594-28c5f58a8186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:28.685862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-45a5950d-09f6-4a18-8594-28c5f58a8186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:28.693666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45a5950d-09f6-4a18-8594-28c5f58a8186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:28.694416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45a5950d-09f6-4a18-8594-28c5f58a8186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:28.695673 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45a5950d-09f6-4a18-8594-28c5f58a8186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:28.696298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-45a5950d-09f6-4a18-8594-28c5f58a8186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:28.879802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-45a5950d-09f6-4a18-8594-28c5f58a8186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:28.893664 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-45a5950d-09f6-4a18-8594-28c5f58a8186 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.213037 Jul 26 15:08:28.894605 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3197/6509] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:28 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:29.917689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-28701c58-55a8-46bf-ae65-5cd86ef3d137 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:29.919392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-28701c58-55a8-46bf-ae65-5cd86ef3d137 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:29.927512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28701c58-55a8-46bf-ae65-5cd86ef3d137 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:29.928011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28701c58-55a8-46bf-ae65-5cd86ef3d137 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:29.928822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28701c58-55a8-46bf-ae65-5cd86ef3d137 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:29.929279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28701c58-55a8-46bf-ae65-5cd86ef3d137 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:30.106626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-28701c58-55a8-46bf-ae65-5cd86ef3d137 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:30.115212 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-28701c58-55a8-46bf-ae65-5cd86ef3d137 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.201395 Jul 26 15:08:30.115706 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3313/6510] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:29 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:31.146246 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-549c6115-c70f-4f1f-88fd-3bad61a918dd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:31.147512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-549c6115-c70f-4f1f-88fd-3bad61a918dd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:31.158513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-549c6115-c70f-4f1f-88fd-3bad61a918dd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:31.158977 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-549c6115-c70f-4f1f-88fd-3bad61a918dd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:31.159779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-549c6115-c70f-4f1f-88fd-3bad61a918dd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:31.160294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-549c6115-c70f-4f1f-88fd-3bad61a918dd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:31.346574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-549c6115-c70f-4f1f-88fd-3bad61a918dd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:31.356697 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-549c6115-c70f-4f1f-88fd-3bad61a918dd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.217250 Jul 26 15:08:31.357319 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3198/6511] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:31 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:32.383075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1f66f993-7ad0-4451-a6c9-082d85d2e3df tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:32.384184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1f66f993-7ad0-4451-a6c9-082d85d2e3df tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:32.397557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f66f993-7ad0-4451-a6c9-082d85d2e3df tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:32.398380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f66f993-7ad0-4451-a6c9-082d85d2e3df tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:32.399783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f66f993-7ad0-4451-a6c9-082d85d2e3df tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:32.400572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f66f993-7ad0-4451-a6c9-082d85d2e3df tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:32.603751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1f66f993-7ad0-4451-a6c9-082d85d2e3df tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:32.613080 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1f66f993-7ad0-4451-a6c9-082d85d2e3df tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.235023 Jul 26 15:08:32.613671 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3314/6512] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:32 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:33.636153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-410177f7-78bd-484d-8da8-5067cf1a2ab3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:33.637608 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-410177f7-78bd-484d-8da8-5067cf1a2ab3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:33.645081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-410177f7-78bd-484d-8da8-5067cf1a2ab3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:33.645730 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-410177f7-78bd-484d-8da8-5067cf1a2ab3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:33.646597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-410177f7-78bd-484d-8da8-5067cf1a2ab3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:33.647140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-410177f7-78bd-484d-8da8-5067cf1a2ab3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:33.857330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-410177f7-78bd-484d-8da8-5067cf1a2ab3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:33.867705 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-410177f7-78bd-484d-8da8-5067cf1a2ab3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.235580 Jul 26 15:08:33.868757 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3199/6513] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:33 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:34.906477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bc9372fd-52bc-412c-91ce-1906cd5b0f4d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:34.907593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bc9372fd-52bc-412c-91ce-1906cd5b0f4d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:34.921105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc9372fd-52bc-412c-91ce-1906cd5b0f4d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:34.922165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc9372fd-52bc-412c-91ce-1906cd5b0f4d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:34.923426 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc9372fd-52bc-412c-91ce-1906cd5b0f4d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:34.924217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc9372fd-52bc-412c-91ce-1906cd5b0f4d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:35.126430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bc9372fd-52bc-412c-91ce-1906cd5b0f4d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:35.138169 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bc9372fd-52bc-412c-91ce-1906cd5b0f4d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.237487 Jul 26 15:08:35.138777 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3315/6514] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:34 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:36.175068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-51884a73-20c5-48a0-bd12-8acca4a2bd0b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:36.175823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-51884a73-20c5-48a0-bd12-8acca4a2bd0b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:36.187184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51884a73-20c5-48a0-bd12-8acca4a2bd0b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:36.187982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51884a73-20c5-48a0-bd12-8acca4a2bd0b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:36.189310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51884a73-20c5-48a0-bd12-8acca4a2bd0b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:36.190055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51884a73-20c5-48a0-bd12-8acca4a2bd0b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:36.385090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-51884a73-20c5-48a0-bd12-8acca4a2bd0b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:36.394263 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-51884a73-20c5-48a0-bd12-8acca4a2bd0b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.223425 Jul 26 15:08:36.394870 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3200/6515] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:36 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:37.421885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-349ef241-6388-4667-a88d-7722449c88c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:37.422750 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-349ef241-6388-4667-a88d-7722449c88c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:37.432739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-349ef241-6388-4667-a88d-7722449c88c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:37.433589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-349ef241-6388-4667-a88d-7722449c88c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:37.434409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-349ef241-6388-4667-a88d-7722449c88c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:37.434860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-349ef241-6388-4667-a88d-7722449c88c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:37.641775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-349ef241-6388-4667-a88d-7722449c88c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:37.650001 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-349ef241-6388-4667-a88d-7722449c88c8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.234272 Jul 26 15:08:37.651313 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3316/6516] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:37 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:38.673740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ed26c08b-5f93-4b42-87cf-7264ccd47e2f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:38.674599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ed26c08b-5f93-4b42-87cf-7264ccd47e2f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:38.684618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed26c08b-5f93-4b42-87cf-7264ccd47e2f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:38.685203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed26c08b-5f93-4b42-87cf-7264ccd47e2f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:38.686528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed26c08b-5f93-4b42-87cf-7264ccd47e2f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:38.687303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed26c08b-5f93-4b42-87cf-7264ccd47e2f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:38.851436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ed26c08b-5f93-4b42-87cf-7264ccd47e2f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:38.864932 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ed26c08b-5f93-4b42-87cf-7264ccd47e2f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.195407 Jul 26 15:08:38.865531 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3201/6517] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:38 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:39.899654 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ab5675f2-6cbb-4219-a410-16c7693c663b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:39.900802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ab5675f2-6cbb-4219-a410-16c7693c663b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:39.908472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab5675f2-6cbb-4219-a410-16c7693c663b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:39.908948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab5675f2-6cbb-4219-a410-16c7693c663b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:39.909785 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab5675f2-6cbb-4219-a410-16c7693c663b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:39.910234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ab5675f2-6cbb-4219-a410-16c7693c663b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:40.095346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ab5675f2-6cbb-4219-a410-16c7693c663b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:40.109439 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ab5675f2-6cbb-4219-a410-16c7693c663b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.215725 Jul 26 15:08:40.110388 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3317/6518] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:39 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:41.137339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7f6e11ab-63bf-4d47-8f01-a54462ef3e78 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:41.138239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7f6e11ab-63bf-4d47-8f01-a54462ef3e78 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:41.147149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f6e11ab-63bf-4d47-8f01-a54462ef3e78 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:41.147928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f6e11ab-63bf-4d47-8f01-a54462ef3e78 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:41.149370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f6e11ab-63bf-4d47-8f01-a54462ef3e78 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:41.150238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7f6e11ab-63bf-4d47-8f01-a54462ef3e78 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:41.369081 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7f6e11ab-63bf-4d47-8f01-a54462ef3e78 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:41.381963 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7f6e11ab-63bf-4d47-8f01-a54462ef3e78 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.250065 Jul 26 15:08:41.382805 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3202/6519] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:41 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:42.409024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9dd641ac-25cd-4f1b-baa7-aecd516562c7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:42.409673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9dd641ac-25cd-4f1b-baa7-aecd516562c7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:42.417458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9dd641ac-25cd-4f1b-baa7-aecd516562c7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:42.418805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9dd641ac-25cd-4f1b-baa7-aecd516562c7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:42.419846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9dd641ac-25cd-4f1b-baa7-aecd516562c7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:42.420345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9dd641ac-25cd-4f1b-baa7-aecd516562c7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:42.585968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9dd641ac-25cd-4f1b-baa7-aecd516562c7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:42.597478 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9dd641ac-25cd-4f1b-baa7-aecd516562c7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.193577 Jul 26 15:08:42.598210 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3318/6520] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:42 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:43.630313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b2ed65a6-c0b5-4799-8d3e-419910b41304 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:43.631451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b2ed65a6-c0b5-4799-8d3e-419910b41304 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:43.641054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2ed65a6-c0b5-4799-8d3e-419910b41304 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:43.641868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2ed65a6-c0b5-4799-8d3e-419910b41304 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:43.643313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2ed65a6-c0b5-4799-8d3e-419910b41304 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:43.644109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b2ed65a6-c0b5-4799-8d3e-419910b41304 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:43.839844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b2ed65a6-c0b5-4799-8d3e-419910b41304 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:43.854223 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b2ed65a6-c0b5-4799-8d3e-419910b41304 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.228518 Jul 26 15:08:43.856344 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3203/6521] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:43 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:44.894277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c8775455-732e-4ffc-bb5e-681c277b3cc0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:44.906915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c8775455-732e-4ffc-bb5e-681c277b3cc0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:44.928643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c8775455-732e-4ffc-bb5e-681c277b3cc0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:44.929977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c8775455-732e-4ffc-bb5e-681c277b3cc0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:44.931038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c8775455-732e-4ffc-bb5e-681c277b3cc0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:44.931633 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c8775455-732e-4ffc-bb5e-681c277b3cc0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:45.291288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c8775455-732e-4ffc-bb5e-681c277b3cc0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:45.303221 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c8775455-732e-4ffc-bb5e-681c277b3cc0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1682 microversion: 2.1 time: 0.415984 Jul 26 15:08:45.304482 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3319/6522] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:44 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1682 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:46.267185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4e26f75a-e740-4bfd-acb5-a0f529f5749a req-5275e88d-c1b5-4f35-865b-669e58594c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aa6652-70b2-41c1-8347-8afe4098dee1", "name": "network-vif-unplugged", "status": "completed", "tag": "38dff6d9-5fb3-43cd-9514-ebacb57cdc0b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:46.288524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4e26f75a-e740-4bfd-acb5-a0f529f5749a req-5275e88d-c1b5-4f35-865b-669e58594c34 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:46.289512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4e26f75a-e740-4bfd-acb5-a0f529f5749a req-5275e88d-c1b5-4f35-865b-669e58594c34 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:46.313283 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4e26f75a-e740-4bfd-acb5-a0f529f5749a req-5275e88d-c1b5-4f35-865b-669e58594c34 service nova] Creating event network-vif-unplugged:38dff6d9-5fb3-43cd-9514-ebacb57cdc0b for instance e2aa6652-70b2-41c1-8347-8afe4098dee1 on n-h1-833090-9 Jul 26 15:08:46.324917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-4e26f75a-e740-4bfd-acb5-a0f529f5749a req-5275e88d-c1b5-4f35-865b-669e58594c34 service nova] Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:08:46.328110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-17028620-dd46-44d3-9a7b-d4ee0220e8ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:46.329080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-17028620-dd46-44d3-9a7b-d4ee0220e8ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:46.341273 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4e26f75a-e740-4bfd-acb5-a0f529f5749a req-5275e88d-c1b5-4f35-865b-669e58594c34 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167855 Jul 26 15:08:46.344479 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3204/6523] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:46.347255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17028620-dd46-44d3-9a7b-d4ee0220e8ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:46.348130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17028620-dd46-44d3-9a7b-d4ee0220e8ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:46.349838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17028620-dd46-44d3-9a7b-d4ee0220e8ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:46.350624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17028620-dd46-44d3-9a7b-d4ee0220e8ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:46.591856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-17028620-dd46-44d3-9a7b-d4ee0220e8ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:46.606483 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-17028620-dd46-44d3-9a7b-d4ee0220e8ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1681 microversion: 2.1 time: 0.283325 Jul 26 15:08:46.607581 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3320/6524] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:46 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1681 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:47.645414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fc286cbf-6974-4637-8cd7-d1820237cb30 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:47.646049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fc286cbf-6974-4637-8cd7-d1820237cb30 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:47.660936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc286cbf-6974-4637-8cd7-d1820237cb30 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:47.661702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc286cbf-6974-4637-8cd7-d1820237cb30 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:47.662728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc286cbf-6974-4637-8cd7-d1820237cb30 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:47.663170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fc286cbf-6974-4637-8cd7-d1820237cb30 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:47.855832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fc286cbf-6974-4637-8cd7-d1820237cb30 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:47.864622 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fc286cbf-6974-4637-8cd7-d1820237cb30 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1679 microversion: 2.1 time: 0.226789 Jul 26 15:08:47.865218 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3205/6525] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:47 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:48.371656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7b8a13de-13bb-42c1-bec0-309c5c9098e4 req-7c0cebd8-7a7d-46d7-8b85-0b090430170a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2aa6652-70b2-41c1-8347-8afe4098dee1", "tag": "38dff6d9-5fb3-43cd-9514-ebacb57cdc0b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:48.387085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7b8a13de-13bb-42c1-bec0-309c5c9098e4 req-7c0cebd8-7a7d-46d7-8b85-0b090430170a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:48.387562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7b8a13de-13bb-42c1-bec0-309c5c9098e4 req-7c0cebd8-7a7d-46d7-8b85-0b090430170a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:48.400981 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7b8a13de-13bb-42c1-bec0-309c5c9098e4 req-7c0cebd8-7a7d-46d7-8b85-0b090430170a service nova] Creating event network-changed:38dff6d9-5fb3-43cd-9514-ebacb57cdc0b for instance e2aa6652-70b2-41c1-8347-8afe4098dee1 on n-h1-833090-9 Jul 26 15:08:48.408570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-7b8a13de-13bb-42c1-bec0-309c5c9098e4 req-7c0cebd8-7a7d-46d7-8b85-0b090430170a service nova] Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:08:48.422383 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7b8a13de-13bb-42c1-bec0-309c5c9098e4 req-7c0cebd8-7a7d-46d7-8b85-0b090430170a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053961 Jul 26 15:08:48.423478 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3321/6526] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:48.893304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0db34bf4-e7d8-4dd4-85f0-c3b03129a8b6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:48.894364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0db34bf4-e7d8-4dd4-85f0-c3b03129a8b6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:48.909618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db34bf4-e7d8-4dd4-85f0-c3b03129a8b6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:48.910265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db34bf4-e7d8-4dd4-85f0-c3b03129a8b6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:48.911598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db34bf4-e7d8-4dd4-85f0-c3b03129a8b6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:48.912079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0db34bf4-e7d8-4dd4-85f0-c3b03129a8b6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:49.251595 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0db34bf4-e7d8-4dd4-85f0-c3b03129a8b6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:49.274136 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0db34bf4-e7d8-4dd4-85f0-c3b03129a8b6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1679 microversion: 2.1 time: 0.388905 Jul 26 15:08:49.275376 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3206/6527] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:48 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1679 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:50.302811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cfffc5fc-d5d4-4e8b-9d55-3e85c8253e2d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:50.304121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cfffc5fc-d5d4-4e8b-9d55-3e85c8253e2d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:50.306383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=27 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:50.313008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfffc5fc-d5d4-4e8b-9d55-3e85c8253e2d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:50.313478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfffc5fc-d5d4-4e8b-9d55-3e85c8253e2d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:50.314292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfffc5fc-d5d4-4e8b-9d55-3e85c8253e2d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:50.314772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cfffc5fc-d5d4-4e8b-9d55-3e85c8253e2d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:50.317914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=77 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:50.509878 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cfffc5fc-d5d4-4e8b-9d55-3e85c8253e2d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:50.521010 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cfffc5fc-d5d4-4e8b-9d55-3e85c8253e2d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1676 microversion: 2.1 time: 0.224830 Jul 26 15:08:50.521961 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3322/6528] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:50 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:50.547922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:50.548755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:50.551378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=33 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:50.561849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:50.562450 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:50.563242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:50.563679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:50.566833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:50.612058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:50.612512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:50.613824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:50.614760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:50.641055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:08:50.646666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for user b5b34650cfc14e69ace08e3a0be3ca06 and project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:08:50.779391 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5e5005c6-5c51-4496-a62c-1cd6f53f5599 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1/action" status: 202 len: 0 microversion: 2.1 time: 0.235641 Jul 26 15:08:50.781124 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3207/6529] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:08:50 2022] POST /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:08:50.792727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1787c74a-85f4-47aa-a9b0-611c127a67de tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:50.793498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1787c74a-85f4-47aa-a9b0-611c127a67de tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:50.800458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1787c74a-85f4-47aa-a9b0-611c127a67de tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:50.801054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1787c74a-85f4-47aa-a9b0-611c127a67de tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:50.801959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1787c74a-85f4-47aa-a9b0-611c127a67de tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:50.802431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1787c74a-85f4-47aa-a9b0-611c127a67de tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:51.007307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1787c74a-85f4-47aa-a9b0-611c127a67de tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:51.021447 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1787c74a-85f4-47aa-a9b0-611c127a67de tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1675 microversion: 2.1 time: 0.233513 Jul 26 15:08:51.022394 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3323/6530] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:50 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:52.053810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2aa71bcd-0803-43b5-80f2-9df8addac254 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:52.054448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2aa71bcd-0803-43b5-80f2-9df8addac254 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:52.062041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2aa71bcd-0803-43b5-80f2-9df8addac254 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:52.062493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2aa71bcd-0803-43b5-80f2-9df8addac254 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:52.063310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2aa71bcd-0803-43b5-80f2-9df8addac254 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:52.063757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2aa71bcd-0803-43b5-80f2-9df8addac254 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:52.246757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2aa71bcd-0803-43b5-80f2-9df8addac254 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:52.259152 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2aa71bcd-0803-43b5-80f2-9df8addac254 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1675 microversion: 2.1 time: 0.210336 Jul 26 15:08:52.260225 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3208/6531] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:52 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1675 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:53.176744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-c6e32f1c-7fba-4c4b-b290-3c3078e064fb req-8e420daf-cd1c-4ee3-bcd6-2e0bef7ea62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aa6652-70b2-41c1-8347-8afe4098dee1", "name": "network-vif-plugged", "status": "completed", "tag": "38dff6d9-5fb3-43cd-9514-ebacb57cdc0b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:53.191153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c6e32f1c-7fba-4c4b-b290-3c3078e064fb req-8e420daf-cd1c-4ee3-bcd6-2e0bef7ea62a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:53.191153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-c6e32f1c-7fba-4c4b-b290-3c3078e064fb req-8e420daf-cd1c-4ee3-bcd6-2e0bef7ea62a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:53.205027 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-c6e32f1c-7fba-4c4b-b290-3c3078e064fb req-8e420daf-cd1c-4ee3-bcd6-2e0bef7ea62a service nova] Creating event network-vif-plugged:38dff6d9-5fb3-43cd-9514-ebacb57cdc0b for instance e2aa6652-70b2-41c1-8347-8afe4098dee1 on n-h1-833090-9 Jul 26 15:08:53.211612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-c6e32f1c-7fba-4c4b-b290-3c3078e064fb req-8e420daf-cd1c-4ee3-bcd6-2e0bef7ea62a service nova] Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:08:53.224941 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-c6e32f1c-7fba-4c4b-b290-3c3078e064fb req-8e420daf-cd1c-4ee3-bcd6-2e0bef7ea62a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053227 Jul 26 15:08:53.225381 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3324/6532] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:53.290062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-58a6cfa3-8848-4d3d-8cc6-82a055fb3996 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:53.290724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-58a6cfa3-8848-4d3d-8cc6-82a055fb3996 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:53.299841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58a6cfa3-8848-4d3d-8cc6-82a055fb3996 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:53.300338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58a6cfa3-8848-4d3d-8cc6-82a055fb3996 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:53.301126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58a6cfa3-8848-4d3d-8cc6-82a055fb3996 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:53.301573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-58a6cfa3-8848-4d3d-8cc6-82a055fb3996 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:53.503455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-58a6cfa3-8848-4d3d-8cc6-82a055fb3996 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:53.514363 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-58a6cfa3-8848-4d3d-8cc6-82a055fb3996 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1675 microversion: 2.1 time: 0.227741 Jul 26 15:08:53.514987 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3209/6533] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:53 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1675 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:54.330242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4113572d-1110-4769-9203-8b0e2a8db78d req-d7feb3fc-7964-49d5-9905-eb78b50ab7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aa6652-70b2-41c1-8347-8afe4098dee1", "name": "network-vif-unplugged", "status": "completed", "tag": "38dff6d9-5fb3-43cd-9514-ebacb57cdc0b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:54.345919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4113572d-1110-4769-9203-8b0e2a8db78d req-d7feb3fc-7964-49d5-9905-eb78b50ab7e7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:54.346691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4113572d-1110-4769-9203-8b0e2a8db78d req-d7feb3fc-7964-49d5-9905-eb78b50ab7e7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:54.365766 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4113572d-1110-4769-9203-8b0e2a8db78d req-d7feb3fc-7964-49d5-9905-eb78b50ab7e7 service nova] Creating event network-vif-unplugged:38dff6d9-5fb3-43cd-9514-ebacb57cdc0b for instance e2aa6652-70b2-41c1-8347-8afe4098dee1 on n-h2-833090-9 Jul 26 15:08:54.373341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-4113572d-1110-4769-9203-8b0e2a8db78d req-d7feb3fc-7964-49d5-9905-eb78b50ab7e7 service nova] Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:08:54.389608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4113572d-1110-4769-9203-8b0e2a8db78d req-d7feb3fc-7964-49d5-9905-eb78b50ab7e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068996 Jul 26 15:08:54.390677 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3325/6534] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:54.539435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d6f0a454-ecf3-4160-978d-ea7adaec9594 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:54.540817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d6f0a454-ecf3-4160-978d-ea7adaec9594 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:54.548933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6f0a454-ecf3-4160-978d-ea7adaec9594 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:54.549399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6f0a454-ecf3-4160-978d-ea7adaec9594 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:54.550208 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6f0a454-ecf3-4160-978d-ea7adaec9594 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:54.550669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d6f0a454-ecf3-4160-978d-ea7adaec9594 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:55.100217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d6f0a454-ecf3-4160-978d-ea7adaec9594 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:55.115007 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d6f0a454-ecf3-4160-978d-ea7adaec9594 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1675 microversion: 2.1 time: 0.580030 Jul 26 15:08:55.115924 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3210/6535] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:54 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1675 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:56.150765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eee99091-0c38-458d-94c5-94f942e33a17 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:56.152689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eee99091-0c38-458d-94c5-94f942e33a17 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:56.159699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eee99091-0c38-458d-94c5-94f942e33a17 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:56.160364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eee99091-0c38-458d-94c5-94f942e33a17 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:56.161305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eee99091-0c38-458d-94c5-94f942e33a17 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:56.161892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eee99091-0c38-458d-94c5-94f942e33a17 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:56.344919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eee99091-0c38-458d-94c5-94f942e33a17 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:56.355912 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eee99091-0c38-458d-94c5-94f942e33a17 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1675 microversion: 2.1 time: 0.212678 Jul 26 15:08:56.356586 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3326/6536] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:56 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1675 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:56.412410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-488d9542-e4ab-40b9-b93d-ce76f3e61146 req-bef19607-e62c-4ecc-912d-b40abec21b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2aa6652-70b2-41c1-8347-8afe4098dee1", "tag": "38dff6d9-5fb3-43cd-9514-ebacb57cdc0b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:56.427111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-488d9542-e4ab-40b9-b93d-ce76f3e61146 req-bef19607-e62c-4ecc-912d-b40abec21b04 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:56.427829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-488d9542-e4ab-40b9-b93d-ce76f3e61146 req-bef19607-e62c-4ecc-912d-b40abec21b04 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:56.451999 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-488d9542-e4ab-40b9-b93d-ce76f3e61146 req-bef19607-e62c-4ecc-912d-b40abec21b04 service nova] Creating event network-changed:38dff6d9-5fb3-43cd-9514-ebacb57cdc0b for instance e2aa6652-70b2-41c1-8347-8afe4098dee1 on n-h2-833090-9 Jul 26 15:08:56.459088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-488d9542-e4ab-40b9-b93d-ce76f3e61146 req-bef19607-e62c-4ecc-912d-b40abec21b04 service nova] Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:08:56.475171 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-488d9542-e4ab-40b9-b93d-ce76f3e61146 req-bef19607-e62c-4ecc-912d-b40abec21b04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066218 Jul 26 15:08:56.476220 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3211/6537] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:57.387028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-82ec37dd-6545-4445-805a-7d46d247e013 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:57.388107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-82ec37dd-6545-4445-805a-7d46d247e013 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:57.402808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82ec37dd-6545-4445-805a-7d46d247e013 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:57.402808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82ec37dd-6545-4445-805a-7d46d247e013 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:57.402808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82ec37dd-6545-4445-805a-7d46d247e013 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:57.402808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-82ec37dd-6545-4445-805a-7d46d247e013 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:57.756668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-82ec37dd-6545-4445-805a-7d46d247e013 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:57.770950 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-82ec37dd-6545-4445-805a-7d46d247e013 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1675 microversion: 2.1 time: 0.387925 Jul 26 15:08:57.772168 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3327/6538] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:57 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1675 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:58.817125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f871d393-a35f-4f86-9184-011aec8ba9ac tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:58.818428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f871d393-a35f-4f86-9184-011aec8ba9ac tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:58.829824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f871d393-a35f-4f86-9184-011aec8ba9ac tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:58.830281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f871d393-a35f-4f86-9184-011aec8ba9ac tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:58.831078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f871d393-a35f-4f86-9184-011aec8ba9ac tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:58.831626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f871d393-a35f-4f86-9184-011aec8ba9ac tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.018009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f871d393-a35f-4f86-9184-011aec8ba9ac tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:59.031192 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f871d393-a35f-4f86-9184-011aec8ba9ac tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1668 microversion: 2.1 time: 0.225024 Jul 26 15:08:59.032421 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3212/6539] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:58 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1668 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:59.068030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-446891a5-bff7-43d8-b009-fca48a89c2ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:59.069372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-446891a5-bff7-43d8-b009-fca48a89c2ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:59.083991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-446891a5-bff7-43d8-b009-fca48a89c2ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.084625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-446891a5-bff7-43d8-b009-fca48a89c2ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.085545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-446891a5-bff7-43d8-b009-fca48a89c2ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.086017 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-446891a5-bff7-43d8-b009-fca48a89c2ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.320954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-446891a5-bff7-43d8-b009-fca48a89c2ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:59.337034 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-446891a5-bff7-43d8-b009-fca48a89c2ae tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1668 microversion: 2.1 time: 0.275036 Jul 26 15:08:59.338202 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3328/6540] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:59 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1668 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:59.375480 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b13ceb2d-6e24-4957-91e0-a37a193168e8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:59.376212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b13ceb2d-6e24-4957-91e0-a37a193168e8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:59.384967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b13ceb2d-6e24-4957-91e0-a37a193168e8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.385914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b13ceb2d-6e24-4957-91e0-a37a193168e8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.386961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b13ceb2d-6e24-4957-91e0-a37a193168e8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.387455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b13ceb2d-6e24-4957-91e0-a37a193168e8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.624466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b13ceb2d-6e24-4957-91e0-a37a193168e8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:59.638035 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b13ceb2d-6e24-4957-91e0-a37a193168e8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1668 microversion: 2.1 time: 0.269630 Jul 26 15:08:59.638911 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3213/6541] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:59 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1668 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:59.666415 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af8a8676-3a95-4789-84be-d9433b890018 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:59.667399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af8a8676-3a95-4789-84be-d9433b890018 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:59.678241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8a8676-3a95-4789-84be-d9433b890018 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.678241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8a8676-3a95-4789-84be-d9433b890018 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.679232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8a8676-3a95-4789-84be-d9433b890018 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.679538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af8a8676-3a95-4789-84be-d9433b890018 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.712688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af8a8676-3a95-4789-84be-d9433b890018 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:08:59.846237 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af8a8676-3a95-4789-84be-d9433b890018 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 204 len: 0 microversion: 2.1 time: 0.184751 Jul 26 15:08:59.847295 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3329/6542] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:08:59 2022] DELETE /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:08:59.868594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-46048f32-1dd4-475e-b030-e6abe9366931 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:59.869254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-46048f32-1dd4-475e-b030-e6abe9366931 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:59.879624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46048f32-1dd4-475e-b030-e6abe9366931 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.880053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46048f32-1dd4-475e-b030-e6abe9366931 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:59.881279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46048f32-1dd4-475e-b030-e6abe9366931 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:59.882106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46048f32-1dd4-475e-b030-e6abe9366931 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:00.117524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-46048f32-1dd4-475e-b030-e6abe9366931 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:00.129336 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-46048f32-1dd4-475e-b030-e6abe9366931 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1674 microversion: 2.1 time: 0.264932 Jul 26 15:09:00.130312 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3214/6543] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:59 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1674 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:01.171440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-57b43596-5d62-45f3-95c7-e7985d5843bd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:01.172543 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-57b43596-5d62-45f3-95c7-e7985d5843bd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:01.183091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57b43596-5d62-45f3-95c7-e7985d5843bd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:01.183695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57b43596-5d62-45f3-95c7-e7985d5843bd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:01.184811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57b43596-5d62-45f3-95c7-e7985d5843bd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:01.185292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-57b43596-5d62-45f3-95c7-e7985d5843bd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:01.253297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ab6b6342-0055-4ae1-b966-83080e35f025 req-e169c8cd-5df5-4128-9174-bd63ccf55f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aa6652-70b2-41c1-8347-8afe4098dee1", "name": "network-vif-plugged", "status": "completed", "tag": "38dff6d9-5fb3-43cd-9514-ebacb57cdc0b"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:01.265190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:01.274172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ab6b6342-0055-4ae1-b966-83080e35f025 req-e169c8cd-5df5-4128-9174-bd63ccf55f37 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:01.274939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ab6b6342-0055-4ae1-b966-83080e35f025 req-e169c8cd-5df5-4128-9174-bd63ccf55f37 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:01.297032 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ab6b6342-0055-4ae1-b966-83080e35f025 req-e169c8cd-5df5-4128-9174-bd63ccf55f37 service nova] Creating event network-vif-plugged:38dff6d9-5fb3-43cd-9514-ebacb57cdc0b for instance e2aa6652-70b2-41c1-8347-8afe4098dee1 on n-h2-833090-9 Jul 26 15:09:01.305706 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ab6b6342-0055-4ae1-b966-83080e35f025 req-e169c8cd-5df5-4128-9174-bd63ccf55f37 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060734 Jul 26 15:09:01.307150 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3215/6544] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:01.429113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-57b43596-5d62-45f3-95c7-e7985d5843bd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:01.450171 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-57b43596-5d62-45f3-95c7-e7985d5843bd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1674 microversion: 2.1 time: 0.286306 Jul 26 15:09:01.450881 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3330/6545] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:01 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1674 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:02.475970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7031fa4a-a8d2-4220-aca4-9720a20925a0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:02.476772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7031fa4a-a8d2-4220-aca4-9720a20925a0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:02.484064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7031fa4a-a8d2-4220-aca4-9720a20925a0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:02.484535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7031fa4a-a8d2-4220-aca4-9720a20925a0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:02.485582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7031fa4a-a8d2-4220-aca4-9720a20925a0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:02.486346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7031fa4a-a8d2-4220-aca4-9720a20925a0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:02.626220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7031fa4a-a8d2-4220-aca4-9720a20925a0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:02.641512 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7031fa4a-a8d2-4220-aca4-9720a20925a0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 200 len: 1607 microversion: 2.1 time: 0.170660 Jul 26 15:09:02.643817 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3216/6546] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:02 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 1607 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:02.938732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-2cd9956e-df5f-4edc-8229-01f812414e2c req-ebbec604-32d1-4607-bbd7-04166efe3556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2aa6652-70b2-41c1-8347-8afe4098dee1", "name": "network-vif-deleted", "tag": "38dff6d9-5fb3-43cd-9514-ebacb57cdc0b"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:02.958803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2cd9956e-df5f-4edc-8229-01f812414e2c req-ebbec604-32d1-4607-bbd7-04166efe3556 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:02.959915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-2cd9956e-df5f-4edc-8229-01f812414e2c req-ebbec604-32d1-4607-bbd7-04166efe3556 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:02.978587 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-2cd9956e-df5f-4edc-8229-01f812414e2c req-ebbec604-32d1-4607-bbd7-04166efe3556 service nova] Creating event network-vif-deleted:38dff6d9-5fb3-43cd-9514-ebacb57cdc0b for instance e2aa6652-70b2-41c1-8347-8afe4098dee1 on n-h2-833090-9 Jul 26 15:09:02.988373 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-2cd9956e-df5f-4edc-8229-01f812414e2c req-ebbec604-32d1-4607-bbd7-04166efe3556 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055575 Jul 26 15:09:02.989135 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3331/6547] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:03.675173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-54bb1dc0-a58f-4eae-bca6-e2751cd3f179 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:03.676031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-54bb1dc0-a58f-4eae-bca6-e2751cd3f179 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:03.684847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54bb1dc0-a58f-4eae-bca6-e2751cd3f179 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.685301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54bb1dc0-a58f-4eae-bca6-e2751cd3f179 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.686256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54bb1dc0-a58f-4eae-bca6-e2751cd3f179 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.686702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54bb1dc0-a58f-4eae-bca6-e2751cd3f179 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.703505 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-54bb1dc0-a58f-4eae-bca6-e2751cd3f179 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-54bb1dc0-a58f-4eae-bca6-e2751cd3f179 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 HTTP/1.1 Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e2aa6652-70b2-41c1-8347-8afe4098dee1'} Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:03.705235 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:09:03.711245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:03.711245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:03.711245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:03.711245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:03.711245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:03.711245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:09:03.711245 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:09:03.711245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-54bb1dc0-a58f-4eae-bca6-e2751cd3f179 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:03.711245 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-54bb1dc0-a58f-4eae-bca6-e2751cd3f179 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 404 len: 111 microversion: 2.1 time: 0.036188 Jul 26 15:09:03.711245 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3217/6548] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:03 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:09:03.738544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b826c41e-16fc-40fe-8337-80dc9a34084e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:03.739782 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b826c41e-16fc-40fe-8337-80dc9a34084e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:03.751278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b826c41e-16fc-40fe-8337-80dc9a34084e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.751884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b826c41e-16fc-40fe-8337-80dc9a34084e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.752965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b826c41e-16fc-40fe-8337-80dc9a34084e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:03.753628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b826c41e-16fc-40fe-8337-80dc9a34084e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:03.779146 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-b826c41e-16fc-40fe-8337-80dc9a34084e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b826c41e-16fc-40fe-8337-80dc9a34084e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 HTTP/1.1 Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e2aa6652-70b2-41c1-8347-8afe4098dee1'} Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:03.782508 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:09:03.790209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:03.790209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:03.790209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:03.790209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:03.790209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:03.790209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:09:03.790209 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:09:03.790209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b826c41e-16fc-40fe-8337-80dc9a34084e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:03.790209 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b826c41e-16fc-40fe-8337-80dc9a34084e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 404 len: 111 microversion: 2.1 time: 0.054379 Jul 26 15:09:03.790209 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3332/6549] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:03 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:09:03.906654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-39137925", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "66cb7b7e-a81f-4c0f-acf4-78a073c427bb"}], "security_groups": [{"name": "tempest-securitygroup--502582096"}], "key_name": "tempest-keypair-41852955", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:04.037627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] validate_networks() for [('66cb7b7e-a81f-4c0f-acf4-78a073c427bb', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:09:04.524069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:09:04.524503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:09:04.525012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:09:04.525413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:09:04.526544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:09:04.536282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:04.536867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:04.537930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:04.538379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:04.558469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:09:04.564431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for user b5b34650cfc14e69ace08e3a0be3ca06 and project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:09:04.578696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:09:04.581034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:09:04.637186 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-35eb2604-8566-4188-a1c4-c733e7c6771a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.735312 Jul 26 15:09:04.638067 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3218/6550] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:09:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:09:04.649162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-226ac1a2-c709-40e5-b708-dde6260867d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:04.649853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-226ac1a2-c709-40e5-b708-dde6260867d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:04.716317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-226ac1a2-c709-40e5-b708-dde6260867d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:04.725573 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-226ac1a2-c709-40e5-b708-dde6260867d7 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1235 microversion: 2.1 time: 0.080443 Jul 26 15:09:04.726207 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3333/6551] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:04 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:05.754366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7bfb7c08-5f76-461d-8f26-782a2ca8e252 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:05.755221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7bfb7c08-5f76-461d-8f26-782a2ca8e252 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:05.763126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bfb7c08-5f76-461d-8f26-782a2ca8e252 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:05.763862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bfb7c08-5f76-461d-8f26-782a2ca8e252 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:05.764901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bfb7c08-5f76-461d-8f26-782a2ca8e252 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:05.765691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bfb7c08-5f76-461d-8f26-782a2ca8e252 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:05.868690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7bfb7c08-5f76-461d-8f26-782a2ca8e252 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:05.890608 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7bfb7c08-5f76-461d-8f26-782a2ca8e252 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1295 microversion: 2.1 time: 0.146097 Jul 26 15:09:05.892263 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3219/6552] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:05 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1295 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:06.914430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-936df72d-c02b-4cbc-a51b-0a52e7fbf264 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:06.915288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-936df72d-c02b-4cbc-a51b-0a52e7fbf264 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:06.923832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-936df72d-c02b-4cbc-a51b-0a52e7fbf264 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:06.924600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-936df72d-c02b-4cbc-a51b-0a52e7fbf264 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:06.925529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-936df72d-c02b-4cbc-a51b-0a52e7fbf264 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:06.926061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-936df72d-c02b-4cbc-a51b-0a52e7fbf264 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:07.071030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-936df72d-c02b-4cbc-a51b-0a52e7fbf264 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:07.080140 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-936df72d-c02b-4cbc-a51b-0a52e7fbf264 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1360 microversion: 2.1 time: 0.169684 Jul 26 15:09:07.080764 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3334/6553] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:06 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1360 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:07.446043 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-bf218272-e6a7-4a65-975a-ab3db3f18d27 req-dcfdf56c-2883-456b-b04f-c02af1e39cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf", "tag": "f37920c0-fddc-4d24-8bc6-10e1405e0bda"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:07.458295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bf218272-e6a7-4a65-975a-ab3db3f18d27 req-dcfdf56c-2883-456b-b04f-c02af1e39cb3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:07.459232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-bf218272-e6a7-4a65-975a-ab3db3f18d27 req-dcfdf56c-2883-456b-b04f-c02af1e39cb3 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:07.473527 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-bf218272-e6a7-4a65-975a-ab3db3f18d27 req-dcfdf56c-2883-456b-b04f-c02af1e39cb3 service nova] Creating event network-changed:f37920c0-fddc-4d24-8bc6-10e1405e0bda for instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf on n-h1-833090-9 Jul 26 15:09:07.479543 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-bf218272-e6a7-4a65-975a-ab3db3f18d27 req-dcfdf56c-2883-456b-b04f-c02af1e39cb3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037834 Jul 26 15:09:07.480513 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3220/6554] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:08.102593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c1922ca8-74ea-4397-b31a-2cd2d6ea745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:08.103239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c1922ca8-74ea-4397-b31a-2cd2d6ea745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:08.116086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c1922ca8-74ea-4397-b31a-2cd2d6ea745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:08.116608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c1922ca8-74ea-4397-b31a-2cd2d6ea745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:08.117432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c1922ca8-74ea-4397-b31a-2cd2d6ea745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:08.117899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c1922ca8-74ea-4397-b31a-2cd2d6ea745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:08.266882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c1922ca8-74ea-4397-b31a-2cd2d6ea745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:08.274872 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c1922ca8-74ea-4397-b31a-2cd2d6ea745f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1360 microversion: 2.1 time: 0.176177 Jul 26 15:09:08.275600 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3335/6555] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:08 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:09.300859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d39e48d6-757e-4c2b-980d-caebf7bf248c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:09.301577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d39e48d6-757e-4c2b-980d-caebf7bf248c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:09.309418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d39e48d6-757e-4c2b-980d-caebf7bf248c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:09.309875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d39e48d6-757e-4c2b-980d-caebf7bf248c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:09.310686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d39e48d6-757e-4c2b-980d-caebf7bf248c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:09.311136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d39e48d6-757e-4c2b-980d-caebf7bf248c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:09.482543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d39e48d6-757e-4c2b-980d-caebf7bf248c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:09.500759 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d39e48d6-757e-4c2b-980d-caebf7bf248c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1360 microversion: 2.1 time: 0.205490 Jul 26 15:09:09.501602 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3221/6556] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:09 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:10.525695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58d7ace0-f912-43c9-8c0a-111d9fdc23be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:10.526641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-58d7ace0-f912-43c9-8c0a-111d9fdc23be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:10.534581 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58d7ace0-f912-43c9-8c0a-111d9fdc23be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:10.535149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58d7ace0-f912-43c9-8c0a-111d9fdc23be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:10.536158 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58d7ace0-f912-43c9-8c0a-111d9fdc23be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:10.536637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58d7ace0-f912-43c9-8c0a-111d9fdc23be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:10.690854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-58d7ace0-f912-43c9-8c0a-111d9fdc23be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:10.700899 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-58d7ace0-f912-43c9-8c0a-111d9fdc23be tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1360 microversion: 2.1 time: 0.179763 Jul 26 15:09:10.701975 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3336/6557] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:10 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1360 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:11.728599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7270099f-b316-47bf-9ed1-cf2c6937ed60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:11.729445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7270099f-b316-47bf-9ed1-cf2c6937ed60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:11.736307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7270099f-b316-47bf-9ed1-cf2c6937ed60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:11.736763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7270099f-b316-47bf-9ed1-cf2c6937ed60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:11.737543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7270099f-b316-47bf-9ed1-cf2c6937ed60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:11.737982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7270099f-b316-47bf-9ed1-cf2c6937ed60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:11.887284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7270099f-b316-47bf-9ed1-cf2c6937ed60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:11.895822 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7270099f-b316-47bf-9ed1-cf2c6937ed60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1360 microversion: 2.1 time: 0.173627 Jul 26 15:09:11.896806 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3222/6558] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:11 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:09:12.919241 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e403edf7-f658-4c8d-9183-d27edb69873f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:12.919786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e403edf7-f658-4c8d-9183-d27edb69873f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:12.927223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e403edf7-f658-4c8d-9183-d27edb69873f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:12.927695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e403edf7-f658-4c8d-9183-d27edb69873f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:12.928549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e403edf7-f658-4c8d-9183-d27edb69873f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:12.929008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e403edf7-f658-4c8d-9183-d27edb69873f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:13.069348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e403edf7-f658-4c8d-9183-d27edb69873f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:13.077276 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e403edf7-f658-4c8d-9183-d27edb69873f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1360 microversion: 2.1 time: 0.163026 Jul 26 15:09:13.077853 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3337/6559] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:12 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:13.186599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-64718adc-b5d4-47db-8d86-1ca895264fab req-8a5144ea-315b-4da6-8e46-fa251f0a8d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf", "name": "network-vif-plugged", "status": "completed", "tag": "f37920c0-fddc-4d24-8bc6-10e1405e0bda"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:13.200172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-64718adc-b5d4-47db-8d86-1ca895264fab req-8a5144ea-315b-4da6-8e46-fa251f0a8d0d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:13.200630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-64718adc-b5d4-47db-8d86-1ca895264fab req-8a5144ea-315b-4da6-8e46-fa251f0a8d0d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:13.214112 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-64718adc-b5d4-47db-8d86-1ca895264fab req-8a5144ea-315b-4da6-8e46-fa251f0a8d0d service nova] Creating event network-vif-plugged:f37920c0-fddc-4d24-8bc6-10e1405e0bda for instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf on n-h1-833090-9 Jul 26 15:09:13.219851 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-64718adc-b5d4-47db-8d86-1ca895264fab req-8a5144ea-315b-4da6-8e46-fa251f0a8d0d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038233 Jul 26 15:09:13.220496 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3223/6560] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:14.100191 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00326467-2992-4729-932c-0e4037689893 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:14.100722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00326467-2992-4729-932c-0e4037689893 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:14.108715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00326467-2992-4729-932c-0e4037689893 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:14.109162 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00326467-2992-4729-932c-0e4037689893 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:14.109970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00326467-2992-4729-932c-0e4037689893 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:14.110427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00326467-2992-4729-932c-0e4037689893 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:14.256683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-00326467-2992-4729-932c-0e4037689893 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:14.265926 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-00326467-2992-4729-932c-0e4037689893 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1360 microversion: 2.1 time: 0.169577 Jul 26 15:09:14.267892 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3338/6561] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:14 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1360 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:15.287868 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:15.288799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:15.293796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5ddb5d8d-d67f-4a95-b85d-fd20a0ae1413 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:15.294508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5ddb5d8d-d67f-4a95-b85d-fd20a0ae1413 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:15.303736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ddb5d8d-d67f-4a95-b85d-fd20a0ae1413 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:15.304614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ddb5d8d-d67f-4a95-b85d-fd20a0ae1413 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:15.305539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ddb5d8d-d67f-4a95-b85d-fd20a0ae1413 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:15.306017 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5ddb5d8d-d67f-4a95-b85d-fd20a0ae1413 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:15.323394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:15.457679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5ddb5d8d-d67f-4a95-b85d-fd20a0ae1413 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:15.466630 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5ddb5d8d-d67f-4a95-b85d-fd20a0ae1413 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1548 microversion: 2.1 time: 0.180697 Jul 26 15:09:15.467220 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3224/6562] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:15 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1548 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:15.492957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5bd97f89-c122-424a-96f2-bf25edcec7d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:15.493504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5bd97f89-c122-424a-96f2-bf25edcec7d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:15.495744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:15.502164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bd97f89-c122-424a-96f2-bf25edcec7d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:15.502636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bd97f89-c122-424a-96f2-bf25edcec7d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:15.503433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bd97f89-c122-424a-96f2-bf25edcec7d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:15.503893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5bd97f89-c122-424a-96f2-bf25edcec7d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:15.592063 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5bd97f89-c122-424a-96f2-bf25edcec7d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102291 Jul 26 15:09:15.592894 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3339/6563] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 15:09:15 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:16.715335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ef9fae5e-028c-4005-b164-85d1558c4ab6 req-7a1a15ab-be64-4c0e-82b2-036c5baed151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf", "tag": "f37920c0-fddc-4d24-8bc6-10e1405e0bda"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:16.726720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ef9fae5e-028c-4005-b164-85d1558c4ab6 req-7a1a15ab-be64-4c0e-82b2-036c5baed151 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:16.727177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ef9fae5e-028c-4005-b164-85d1558c4ab6 req-7a1a15ab-be64-4c0e-82b2-036c5baed151 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:16.739986 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ef9fae5e-028c-4005-b164-85d1558c4ab6 req-7a1a15ab-be64-4c0e-82b2-036c5baed151 service nova] Creating event network-changed:f37920c0-fddc-4d24-8bc6-10e1405e0bda for instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf on n-h1-833090-9 Jul 26 15:09:16.746611 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ef9fae5e-028c-4005-b164-85d1558c4ab6 req-7a1a15ab-be64-4c0e-82b2-036c5baed151 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039273 Jul 26 15:09:16.747244 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3225/6564] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:38.296583 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:09:38.297226 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:09:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:09:38.327660 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:09:38.327882 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:09:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:09:38.441461 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:09:38.442019 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:09:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:09:53.521362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:53.522797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:53.528487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-16b9ea4a-d2fc-4d70-bf08-90b06bcb2b98 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:53.530873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-16b9ea4a-d2fc-4d70-bf08-90b06bcb2b98 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:53.540858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16b9ea4a-d2fc-4d70-bf08-90b06bcb2b98 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:53.541337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16b9ea4a-d2fc-4d70-bf08-90b06bcb2b98 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:53.542163 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16b9ea4a-d2fc-4d70-bf08-90b06bcb2b98 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:53.542611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16b9ea4a-d2fc-4d70-bf08-90b06bcb2b98 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:53.748215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-16b9ea4a-d2fc-4d70-bf08-90b06bcb2b98 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:09:53.759061 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-16b9ea4a-d2fc-4d70-bf08-90b06bcb2b98 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1667 microversion: 2.1 time: 0.241370 Jul 26 15:09:53.759659 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3340/6565] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:09:53 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1667 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:09:53.782231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1eaed211-d01d-490b-846b-05e040de469b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "425c998e-17ea-4483-95a9-9bfa0ea678b2"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:09:53.784685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1eaed211-d01d-490b-846b-05e040de469b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:09:53.787350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:53.788074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=5 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:09:53.796203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1eaed211-d01d-490b-846b-05e040de469b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:53.796664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1eaed211-d01d-490b-846b-05e040de469b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:53.797465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1eaed211-d01d-490b-846b-05e040de469b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:09:53.797907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1eaed211-d01d-490b-846b-05e040de469b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:09:54.114347 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1eaed211-d01d-490b-846b-05e040de469b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335835 Jul 26 15:09:54.115645 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3226/6566] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 15:09:53 2022] POST /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:06.142187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:06.144869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:06.147737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:06.148856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:06.156031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:06.156514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:06.157336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:06.157801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:06.190233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:06.200653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Old instance type m1.heat2, new instance type m1.heat {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 15:10:06.213094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:10:06.213806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:10:06.214626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:10:06.215329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:10:06.216064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:10:06.323621 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-25c2264f-455b-4a64-902d-74966e00b82a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/action" status: 202 len: 0 microversion: 2.1 time: 0.185605 Jul 26 15:10:06.324583 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3341/6567] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:10:06 2022] POST /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:10:06.335735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-51a8a74e-579e-4d2c-b747-322d71beaa82 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:06.337772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-51a8a74e-579e-4d2c-b747-322d71beaa82 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:06.341151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:06.342341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:06.349241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51a8a74e-579e-4d2c-b747-322d71beaa82 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:06.349764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51a8a74e-579e-4d2c-b747-322d71beaa82 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:06.351591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51a8a74e-579e-4d2c-b747-322d71beaa82 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:06.352546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51a8a74e-579e-4d2c-b747-322d71beaa82 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:06.556550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-51a8a74e-579e-4d2c-b747-322d71beaa82 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:06.566020 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-51a8a74e-579e-4d2c-b747-322d71beaa82 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1722 microversion: 2.1 time: 0.235264 Jul 26 15:10:06.566611 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3227/6568] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:06 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:07.592704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-262c974f-68f4-419c-8a73-adf8bf5ea966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:07.593424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-262c974f-68f4-419c-8a73-adf8bf5ea966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:07.603486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-262c974f-68f4-419c-8a73-adf8bf5ea966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:07.604059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-262c974f-68f4-419c-8a73-adf8bf5ea966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:07.604821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-262c974f-68f4-419c-8a73-adf8bf5ea966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:07.605288 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-262c974f-68f4-419c-8a73-adf8bf5ea966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:07.780744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-262c974f-68f4-419c-8a73-adf8bf5ea966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:07.792181 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-262c974f-68f4-419c-8a73-adf8bf5ea966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1722 microversion: 2.1 time: 0.206558 Jul 26 15:10:07.793096 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3342/6569] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:07 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:08.821761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e155452e-0377-4ed5-a6ba-16f21f0d993d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:08.822528 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e155452e-0377-4ed5-a6ba-16f21f0d993d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:08.829921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e155452e-0377-4ed5-a6ba-16f21f0d993d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:08.830378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e155452e-0377-4ed5-a6ba-16f21f0d993d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:08.831164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e155452e-0377-4ed5-a6ba-16f21f0d993d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:08.831602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e155452e-0377-4ed5-a6ba-16f21f0d993d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:09.001936 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e155452e-0377-4ed5-a6ba-16f21f0d993d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:09.012853 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e155452e-0377-4ed5-a6ba-16f21f0d993d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.198157 Jul 26 15:10:09.013490 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3228/6570] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:08 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:10.035322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a7ae31d-8a66-4513-af7d-a39967dc5410 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:10.036181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0a7ae31d-8a66-4513-af7d-a39967dc5410 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:10.044150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a7ae31d-8a66-4513-af7d-a39967dc5410 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:10.044873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a7ae31d-8a66-4513-af7d-a39967dc5410 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:10.045673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a7ae31d-8a66-4513-af7d-a39967dc5410 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:10.046132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a7ae31d-8a66-4513-af7d-a39967dc5410 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:10.205320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0a7ae31d-8a66-4513-af7d-a39967dc5410 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:10.220854 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0a7ae31d-8a66-4513-af7d-a39967dc5410 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.189028 Jul 26 15:10:10.221986 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3343/6571] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:10 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:11.244371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b7a0eb45-9717-4998-b8e5-c89d63c91753 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:11.245261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b7a0eb45-9717-4998-b8e5-c89d63c91753 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:11.252052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7a0eb45-9717-4998-b8e5-c89d63c91753 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:11.252691 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7a0eb45-9717-4998-b8e5-c89d63c91753 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:11.253596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7a0eb45-9717-4998-b8e5-c89d63c91753 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:11.254125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b7a0eb45-9717-4998-b8e5-c89d63c91753 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:11.423590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b7a0eb45-9717-4998-b8e5-c89d63c91753 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:11.438704 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b7a0eb45-9717-4998-b8e5-c89d63c91753 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.198715 Jul 26 15:10:11.439675 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3229/6572] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:11 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:12.465398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e0fda5ac-c7e3-42c7-b907-18a1a63c68eb tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:12.466057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e0fda5ac-c7e3-42c7-b907-18a1a63c68eb tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:12.478504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0fda5ac-c7e3-42c7-b907-18a1a63c68eb tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:12.478504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0fda5ac-c7e3-42c7-b907-18a1a63c68eb tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:12.478504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0fda5ac-c7e3-42c7-b907-18a1a63c68eb tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:12.479097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e0fda5ac-c7e3-42c7-b907-18a1a63c68eb tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:12.664715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e0fda5ac-c7e3-42c7-b907-18a1a63c68eb tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:12.679900 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e0fda5ac-c7e3-42c7-b907-18a1a63c68eb tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.220399 Jul 26 15:10:12.680668 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3344/6573] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:12 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:13.711214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-80de813e-e863-4216-b9a0-7539f6c69c75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:13.712384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-80de813e-e863-4216-b9a0-7539f6c69c75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:13.719265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80de813e-e863-4216-b9a0-7539f6c69c75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:13.719711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80de813e-e863-4216-b9a0-7539f6c69c75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:13.720543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80de813e-e863-4216-b9a0-7539f6c69c75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:13.720980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-80de813e-e863-4216-b9a0-7539f6c69c75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:13.894384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-80de813e-e863-4216-b9a0-7539f6c69c75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:13.904307 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-80de813e-e863-4216-b9a0-7539f6c69c75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.197440 Jul 26 15:10:13.905225 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3230/6574] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:13 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:14.936339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-74525680-93f3-4064-ac7c-75530f6f16b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:14.936980 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-74525680-93f3-4064-ac7c-75530f6f16b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:14.948991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74525680-93f3-4064-ac7c-75530f6f16b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:14.949795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74525680-93f3-4064-ac7c-75530f6f16b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:14.951031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74525680-93f3-4064-ac7c-75530f6f16b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:14.951827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-74525680-93f3-4064-ac7c-75530f6f16b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:15.108232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-74525680-93f3-4064-ac7c-75530f6f16b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:15.118493 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-74525680-93f3-4064-ac7c-75530f6f16b4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.186036 Jul 26 15:10:15.119178 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3345/6575] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:14 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:16.141923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2f78b662-ba63-452b-82a8-363391ebda2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:16.143048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2f78b662-ba63-452b-82a8-363391ebda2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:16.155459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f78b662-ba63-452b-82a8-363391ebda2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:16.156319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f78b662-ba63-452b-82a8-363391ebda2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:16.157725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f78b662-ba63-452b-82a8-363391ebda2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:16.158517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f78b662-ba63-452b-82a8-363391ebda2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:16.685820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2f78b662-ba63-452b-82a8-363391ebda2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:16.694798 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2f78b662-ba63-452b-82a8-363391ebda2c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.556855 Jul 26 15:10:16.695477 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3231/6576] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:16 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:17.719507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-56354ac8-a582-405f-a2d6-53a2db9a518f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:17.720402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-56354ac8-a582-405f-a2d6-53a2db9a518f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:17.729930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56354ac8-a582-405f-a2d6-53a2db9a518f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:17.730457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56354ac8-a582-405f-a2d6-53a2db9a518f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:17.731375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56354ac8-a582-405f-a2d6-53a2db9a518f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:17.732044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-56354ac8-a582-405f-a2d6-53a2db9a518f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:17.922970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-56354ac8-a582-405f-a2d6-53a2db9a518f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:17.943774 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-56354ac8-a582-405f-a2d6-53a2db9a518f tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.228942 Jul 26 15:10:17.945309 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3346/6577] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:17 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:18.978488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-43aa0044-b60c-4af9-8f6a-9731d01f5de6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:18.979305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-43aa0044-b60c-4af9-8f6a-9731d01f5de6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:18.987311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43aa0044-b60c-4af9-8f6a-9731d01f5de6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:18.987840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43aa0044-b60c-4af9-8f6a-9731d01f5de6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:18.988789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43aa0044-b60c-4af9-8f6a-9731d01f5de6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:18.989339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43aa0044-b60c-4af9-8f6a-9731d01f5de6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:19.158084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43aa0044-b60c-4af9-8f6a-9731d01f5de6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:19.170601 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-43aa0044-b60c-4af9-8f6a-9731d01f5de6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.198146 Jul 26 15:10:19.171199 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3232/6578] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:18 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:20.206740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f6cddaf1-6f74-4cef-a2ad-73720ddc1abd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:20.207982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f6cddaf1-6f74-4cef-a2ad-73720ddc1abd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:20.221472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6cddaf1-6f74-4cef-a2ad-73720ddc1abd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:20.221802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6cddaf1-6f74-4cef-a2ad-73720ddc1abd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:20.222639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6cddaf1-6f74-4cef-a2ad-73720ddc1abd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:20.223118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6cddaf1-6f74-4cef-a2ad-73720ddc1abd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:20.421244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f6cddaf1-6f74-4cef-a2ad-73720ddc1abd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:20.430760 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f6cddaf1-6f74-4cef-a2ad-73720ddc1abd tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.231693 Jul 26 15:10:20.431360 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3347/6579] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:20 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:21.453919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9784d86e-cb7e-4b7d-9b09-478c5d3ba991 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:21.454875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9784d86e-cb7e-4b7d-9b09-478c5d3ba991 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:21.466694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9784d86e-cb7e-4b7d-9b09-478c5d3ba991 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:21.467189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9784d86e-cb7e-4b7d-9b09-478c5d3ba991 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:21.468436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9784d86e-cb7e-4b7d-9b09-478c5d3ba991 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:21.469020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9784d86e-cb7e-4b7d-9b09-478c5d3ba991 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:21.680187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9784d86e-cb7e-4b7d-9b09-478c5d3ba991 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:21.688542 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9784d86e-cb7e-4b7d-9b09-478c5d3ba991 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.238606 Jul 26 15:10:21.689043 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3233/6580] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:21 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:22.722386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1967209f-a362-416e-a5c1-5cc4eae1952c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:22.723030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1967209f-a362-416e-a5c1-5cc4eae1952c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:22.732518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1967209f-a362-416e-a5c1-5cc4eae1952c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:22.733320 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1967209f-a362-416e-a5c1-5cc4eae1952c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:22.734680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1967209f-a362-416e-a5c1-5cc4eae1952c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:22.735465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1967209f-a362-416e-a5c1-5cc4eae1952c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:22.953631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1967209f-a362-416e-a5c1-5cc4eae1952c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:22.968320 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1967209f-a362-416e-a5c1-5cc4eae1952c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.249551 Jul 26 15:10:22.969256 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3348/6581] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:22 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:24.002778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d974db8-bf35-4329-86d6-72c87b46a6bf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:24.003681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4d974db8-bf35-4329-86d6-72c87b46a6bf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:24.013982 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d974db8-bf35-4329-86d6-72c87b46a6bf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:24.014678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d974db8-bf35-4329-86d6-72c87b46a6bf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:24.015771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d974db8-bf35-4329-86d6-72c87b46a6bf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:24.016264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d974db8-bf35-4329-86d6-72c87b46a6bf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:24.250411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4d974db8-bf35-4329-86d6-72c87b46a6bf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:24.273200 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4d974db8-bf35-4329-86d6-72c87b46a6bf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.274428 Jul 26 15:10:24.274310 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3234/6582] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:23 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:25.299277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2ee67079-8c9e-41d6-a0f2-22e515cbc1c5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:25.300236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2ee67079-8c9e-41d6-a0f2-22e515cbc1c5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:25.319805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ee67079-8c9e-41d6-a0f2-22e515cbc1c5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:25.320448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ee67079-8c9e-41d6-a0f2-22e515cbc1c5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:25.321339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ee67079-8c9e-41d6-a0f2-22e515cbc1c5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:25.321949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2ee67079-8c9e-41d6-a0f2-22e515cbc1c5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:25.502074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2ee67079-8c9e-41d6-a0f2-22e515cbc1c5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:25.512887 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2ee67079-8c9e-41d6-a0f2-22e515cbc1c5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.217610 Jul 26 15:10:25.513477 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3349/6583] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:25 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:26.540412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c65b0b3b-5248-425b-8503-106bd47397a1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:26.541399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c65b0b3b-5248-425b-8503-106bd47397a1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:26.550723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c65b0b3b-5248-425b-8503-106bd47397a1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:26.551522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c65b0b3b-5248-425b-8503-106bd47397a1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:26.552940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c65b0b3b-5248-425b-8503-106bd47397a1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:26.553735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c65b0b3b-5248-425b-8503-106bd47397a1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:26.734844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c65b0b3b-5248-425b-8503-106bd47397a1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:26.752539 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c65b0b3b-5248-425b-8503-106bd47397a1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.219915 Jul 26 15:10:26.753605 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3235/6584] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:26 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:27.790189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d6264171-1a38-49b9-81a3-eec5ea78a863 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:27.791356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d6264171-1a38-49b9-81a3-eec5ea78a863 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:27.800643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6264171-1a38-49b9-81a3-eec5ea78a863 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:27.800979 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6264171-1a38-49b9-81a3-eec5ea78a863 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:27.801944 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6264171-1a38-49b9-81a3-eec5ea78a863 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:27.802314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d6264171-1a38-49b9-81a3-eec5ea78a863 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:28.001659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d6264171-1a38-49b9-81a3-eec5ea78a863 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:28.017749 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d6264171-1a38-49b9-81a3-eec5ea78a863 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1727 microversion: 2.1 time: 0.233056 Jul 26 15:10:28.019065 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3350/6585] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:27 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1727 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:28.808638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f39c2eaf-39ef-4c2e-8d34-59b033b1f393 req-f84b666f-b84b-4293-85c5-ea4107009e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf", "name": "network-vif-unplugged", "status": "completed", "tag": "f37920c0-fddc-4d24-8bc6-10e1405e0bda"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:28.826097 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f39c2eaf-39ef-4c2e-8d34-59b033b1f393 req-f84b666f-b84b-4293-85c5-ea4107009e3e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:28.826668 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f39c2eaf-39ef-4c2e-8d34-59b033b1f393 req-f84b666f-b84b-4293-85c5-ea4107009e3e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:28.845483 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f39c2eaf-39ef-4c2e-8d34-59b033b1f393 req-f84b666f-b84b-4293-85c5-ea4107009e3e service nova] Creating event network-vif-unplugged:f37920c0-fddc-4d24-8bc6-10e1405e0bda for instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf on n-h2-833090-9 Jul 26 15:10:28.853080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-f39c2eaf-39ef-4c2e-8d34-59b033b1f393 req-f84b666f-b84b-4293-85c5-ea4107009e3e service nova] Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:10:28.864482 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f39c2eaf-39ef-4c2e-8d34-59b033b1f393 req-f84b666f-b84b-4293-85c5-ea4107009e3e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060223 Jul 26 15:10:28.865910 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3236/6586] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:29.047293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e8a0b06d-c856-4986-b2c1-4a6d820a0da3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:29.048496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e8a0b06d-c856-4986-b2c1-4a6d820a0da3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:29.061630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8a0b06d-c856-4986-b2c1-4a6d820a0da3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:29.062483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8a0b06d-c856-4986-b2c1-4a6d820a0da3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:29.064222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8a0b06d-c856-4986-b2c1-4a6d820a0da3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:29.065287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8a0b06d-c856-4986-b2c1-4a6d820a0da3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:29.352601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e8a0b06d-c856-4986-b2c1-4a6d820a0da3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:29.364312 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e8a0b06d-c856-4986-b2c1-4a6d820a0da3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1726 microversion: 2.1 time: 0.323524 Jul 26 15:10:29.364914 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3351/6587] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:29 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1726 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:30.398212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05ff4488-8cb6-400d-b1cf-0b25c3e5910a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:30.406930 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05ff4488-8cb6-400d-b1cf-0b25c3e5910a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:30.409837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05ff4488-8cb6-400d-b1cf-0b25c3e5910a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.410636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05ff4488-8cb6-400d-b1cf-0b25c3e5910a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.412119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05ff4488-8cb6-400d-b1cf-0b25c3e5910a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.413599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05ff4488-8cb6-400d-b1cf-0b25c3e5910a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.622117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05ff4488-8cb6-400d-b1cf-0b25c3e5910a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:30.635404 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05ff4488-8cb6-400d-b1cf-0b25c3e5910a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.244861 Jul 26 15:10:30.636029 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3237/6588] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:30 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:30.884958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-be52cfab-bf97-4629-9510-5b303e6b65fd req-b4f848d5-ac78-4039-80f0-d23c45449856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf", "tag": "f37920c0-fddc-4d24-8bc6-10e1405e0bda"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:30.904650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-be52cfab-bf97-4629-9510-5b303e6b65fd req-b4f848d5-ac78-4039-80f0-d23c45449856 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:30.905303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-be52cfab-bf97-4629-9510-5b303e6b65fd req-b4f848d5-ac78-4039-80f0-d23c45449856 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:30.924436 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-be52cfab-bf97-4629-9510-5b303e6b65fd req-b4f848d5-ac78-4039-80f0-d23c45449856 service nova] Creating event network-changed:f37920c0-fddc-4d24-8bc6-10e1405e0bda for instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf on n-h2-833090-9 Jul 26 15:10:30.935355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-be52cfab-bf97-4629-9510-5b303e6b65fd req-b4f848d5-ac78-4039-80f0-d23c45449856 service nova] Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:10:30.951224 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-be52cfab-bf97-4629-9510-5b303e6b65fd req-b4f848d5-ac78-4039-80f0-d23c45449856 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073594 Jul 26 15:10:30.952368 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3352/6589] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:31.661105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-18d2f359-b5c1-4c84-87a7-ba1d96168966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:31.662797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-18d2f359-b5c1-4c84-87a7-ba1d96168966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:31.672751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18d2f359-b5c1-4c84-87a7-ba1d96168966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:31.674016 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18d2f359-b5c1-4c84-87a7-ba1d96168966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:31.675735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18d2f359-b5c1-4c84-87a7-ba1d96168966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:31.676737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-18d2f359-b5c1-4c84-87a7-ba1d96168966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:31.922080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-18d2f359-b5c1-4c84-87a7-ba1d96168966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:31.936253 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-18d2f359-b5c1-4c84-87a7-ba1d96168966 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.279148 Jul 26 15:10:31.937338 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3238/6590] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:31 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:32.970027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f19ad9d5-b671-42a6-9eff-876a228d098b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:32.970811 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f19ad9d5-b671-42a6-9eff-876a228d098b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:32.978660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f19ad9d5-b671-42a6-9eff-876a228d098b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:32.979136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f19ad9d5-b671-42a6-9eff-876a228d098b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:32.979973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f19ad9d5-b671-42a6-9eff-876a228d098b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:32.980437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f19ad9d5-b671-42a6-9eff-876a228d098b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:33.173055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f19ad9d5-b671-42a6-9eff-876a228d098b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:33.182973 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f19ad9d5-b671-42a6-9eff-876a228d098b tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.218725 Jul 26 15:10:33.183570 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3353/6591] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:32 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:34.210182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b46c461c-71a8-45cc-ae1b-2602c3fd6eb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:34.211032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b46c461c-71a8-45cc-ae1b-2602c3fd6eb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:34.222288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b46c461c-71a8-45cc-ae1b-2602c3fd6eb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:34.223051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b46c461c-71a8-45cc-ae1b-2602c3fd6eb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:34.224406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b46c461c-71a8-45cc-ae1b-2602c3fd6eb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:34.225055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b46c461c-71a8-45cc-ae1b-2602c3fd6eb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:34.426938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b46c461c-71a8-45cc-ae1b-2602c3fd6eb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:34.438881 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b46c461c-71a8-45cc-ae1b-2602c3fd6eb2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.236428 Jul 26 15:10:34.452006 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3239/6592] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:34 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:35.477912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32baf670-ada6-41d0-8704-0adbacd08854 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:35.478772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32baf670-ada6-41d0-8704-0adbacd08854 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:35.491248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32baf670-ada6-41d0-8704-0adbacd08854 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:35.491770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32baf670-ada6-41d0-8704-0adbacd08854 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:35.492825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32baf670-ada6-41d0-8704-0adbacd08854 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:35.493378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32baf670-ada6-41d0-8704-0adbacd08854 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:35.681829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-32baf670-ada6-41d0-8704-0adbacd08854 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:35.692118 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-32baf670-ada6-41d0-8704-0adbacd08854 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.220542 Jul 26 15:10:35.708177 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3354/6593] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:35 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:36.721471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cce26b57-0bae-4c22-b1a1-c6f282e84b1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:36.722488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cce26b57-0bae-4c22-b1a1-c6f282e84b1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:36.726571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=27 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:36.735331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cce26b57-0bae-4c22-b1a1-c6f282e84b1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:36.735872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cce26b57-0bae-4c22-b1a1-c6f282e84b1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:36.736701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cce26b57-0bae-4c22-b1a1-c6f282e84b1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:36.737145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cce26b57-0bae-4c22-b1a1-c6f282e84b1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:36.740722 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=77 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:36.919785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cce26b57-0bae-4c22-b1a1-c6f282e84b1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:36.930416 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cce26b57-0bae-4c22-b1a1-c6f282e84b1d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.216548 Jul 26 15:10:36.931130 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3240/6594] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:36 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:37.953474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-711ac420-5152-4be7-8319-fb263ad95c0c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:37.954900 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-711ac420-5152-4be7-8319-fb263ad95c0c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:37.958360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=33 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:37.965851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-711ac420-5152-4be7-8319-fb263ad95c0c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:37.966373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-711ac420-5152-4be7-8319-fb263ad95c0c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:37.967230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-711ac420-5152-4be7-8319-fb263ad95c0c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:37.967728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-711ac420-5152-4be7-8319-fb263ad95c0c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:37.971308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:38.124456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-711ac420-5152-4be7-8319-fb263ad95c0c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:38.136198 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-711ac420-5152-4be7-8319-fb263ad95c0c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.186512 Jul 26 15:10:38.137167 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3355/6595] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:37 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:39.172801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3b8d2841-a038-4dec-b771-4f8164279524 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:39.173826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3b8d2841-a038-4dec-b771-4f8164279524 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:39.185959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b8d2841-a038-4dec-b771-4f8164279524 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:39.186692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b8d2841-a038-4dec-b771-4f8164279524 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:39.187880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b8d2841-a038-4dec-b771-4f8164279524 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:39.188456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3b8d2841-a038-4dec-b771-4f8164279524 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:39.343158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3b8d2841-a038-4dec-b771-4f8164279524 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:39.352506 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3b8d2841-a038-4dec-b771-4f8164279524 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.186885 Jul 26 15:10:39.353104 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3241/6596] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:39 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:40.383113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e8933fcd-3130-489e-be1f-1680e38ad516 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:40.383749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e8933fcd-3130-489e-be1f-1680e38ad516 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:40.391893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8933fcd-3130-489e-be1f-1680e38ad516 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:40.392396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8933fcd-3130-489e-be1f-1680e38ad516 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:40.393228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8933fcd-3130-489e-be1f-1680e38ad516 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:40.393667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e8933fcd-3130-489e-be1f-1680e38ad516 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:40.577067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e8933fcd-3130-489e-be1f-1680e38ad516 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:40.586923 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e8933fcd-3130-489e-be1f-1680e38ad516 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.207719 Jul 26 15:10:40.587519 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3356/6597] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:40 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:41.610372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-05dd3607-5eb4-44ac-8ae7-32da3dc12a68 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:41.611122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-05dd3607-5eb4-44ac-8ae7-32da3dc12a68 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:41.620236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05dd3607-5eb4-44ac-8ae7-32da3dc12a68 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:41.620702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05dd3607-5eb4-44ac-8ae7-32da3dc12a68 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:41.621586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05dd3607-5eb4-44ac-8ae7-32da3dc12a68 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:41.622038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-05dd3607-5eb4-44ac-8ae7-32da3dc12a68 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:41.815800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-05dd3607-5eb4-44ac-8ae7-32da3dc12a68 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:41.827007 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-05dd3607-5eb4-44ac-8ae7-32da3dc12a68 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.220470 Jul 26 15:10:41.827658 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3242/6598] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:41 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:42.852572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c00a4988-cc0b-4ab2-9b43-1a56662e7c44 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:42.853453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c00a4988-cc0b-4ab2-9b43-1a56662e7c44 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:42.865242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c00a4988-cc0b-4ab2-9b43-1a56662e7c44 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:42.865870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c00a4988-cc0b-4ab2-9b43-1a56662e7c44 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:42.866800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c00a4988-cc0b-4ab2-9b43-1a56662e7c44 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:42.867284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c00a4988-cc0b-4ab2-9b43-1a56662e7c44 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:43.097098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c00a4988-cc0b-4ab2-9b43-1a56662e7c44 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:43.120748 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c00a4988-cc0b-4ab2-9b43-1a56662e7c44 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1724 microversion: 2.1 time: 0.273400 Jul 26 15:10:43.122084 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3357/6599] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:42 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:44.165168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-863b0139-4675-4d9c-9786-fdd120785143 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:44.165784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-863b0139-4675-4d9c-9786-fdd120785143 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:44.173198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-863b0139-4675-4d9c-9786-fdd120785143 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.173653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-863b0139-4675-4d9c-9786-fdd120785143 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:44.174438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-863b0139-4675-4d9c-9786-fdd120785143 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.174883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-863b0139-4675-4d9c-9786-fdd120785143 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:44.363560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-863b0139-4675-4d9c-9786-fdd120785143 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:44.376618 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-863b0139-4675-4d9c-9786-fdd120785143 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1721 microversion: 2.1 time: 0.215371 Jul 26 15:10:44.377631 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3243/6600] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:44 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:44.403896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:44.405986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:44.415442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.415844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:44.416691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.417156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:44.472385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.472912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:44.473840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.475247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:44.503616 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:10:44.510340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Getting quotas for user b5b34650cfc14e69ace08e3a0be3ca06 and project 89dd1bdabe6a4fa4aa70fd31ee6f76aa. Resources: {'ram', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:10:44.693135 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f97a47b6-b62c-45b2-8a2d-2daa064b7b32 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "POST /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/action" status: 202 len: 0 microversion: 2.1 time: 0.294979 Jul 26 15:10:44.697435 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3358/6601] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:10:44 2022] POST /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:10:44.706069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c82fd26d-b4a3-4982-90bc-3c5a3a498c8e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:44.706929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c82fd26d-b4a3-4982-90bc-3c5a3a498c8e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:44.716173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c82fd26d-b4a3-4982-90bc-3c5a3a498c8e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.716857 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c82fd26d-b4a3-4982-90bc-3c5a3a498c8e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:44.717872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c82fd26d-b4a3-4982-90bc-3c5a3a498c8e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.718715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c82fd26d-b4a3-4982-90bc-3c5a3a498c8e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:45.074088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c82fd26d-b4a3-4982-90bc-3c5a3a498c8e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:45.087249 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c82fd26d-b4a3-4982-90bc-3c5a3a498c8e tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.386916 Jul 26 15:10:45.104659 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3244/6602] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:44 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:46.123007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5475df35-a03c-4840-abd8-a54b039486b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:46.124110 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5475df35-a03c-4840-abd8-a54b039486b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:46.137615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5475df35-a03c-4840-abd8-a54b039486b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:46.138257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5475df35-a03c-4840-abd8-a54b039486b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:46.139678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5475df35-a03c-4840-abd8-a54b039486b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:46.140515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5475df35-a03c-4840-abd8-a54b039486b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:46.360892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5475df35-a03c-4840-abd8-a54b039486b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:46.372127 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5475df35-a03c-4840-abd8-a54b039486b5 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.260663 Jul 26 15:10:46.372746 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3359/6603] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:46 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:47.408499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-91e0078d-0553-46af-adf6-89733926deda tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:47.409298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-91e0078d-0553-46af-adf6-89733926deda tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:47.418449 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91e0078d-0553-46af-adf6-89733926deda tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:47.419305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91e0078d-0553-46af-adf6-89733926deda tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:47.420251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91e0078d-0553-46af-adf6-89733926deda tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:47.420801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91e0078d-0553-46af-adf6-89733926deda tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:47.645912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-91e0078d-0553-46af-adf6-89733926deda tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:47.660429 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-91e0078d-0553-46af-adf6-89733926deda tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.256297 Jul 26 15:10:47.661907 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3245/6604] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:47 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:47.768699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-baabe79c-69da-4c48-b731-bc31f3e45810 req-bfb7bf0c-25a2-41b9-957e-b97b924c8b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf", "name": "network-vif-plugged", "status": "completed", "tag": "f37920c0-fddc-4d24-8bc6-10e1405e0bda"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:47.782038 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-baabe79c-69da-4c48-b731-bc31f3e45810 req-bfb7bf0c-25a2-41b9-957e-b97b924c8b88 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:47.782840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-baabe79c-69da-4c48-b731-bc31f3e45810 req-bfb7bf0c-25a2-41b9-957e-b97b924c8b88 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:47.801957 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-baabe79c-69da-4c48-b731-bc31f3e45810 req-bfb7bf0c-25a2-41b9-957e-b97b924c8b88 service nova] Creating event network-vif-plugged:f37920c0-fddc-4d24-8bc6-10e1405e0bda for instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf on n-h2-833090-9 Jul 26 15:10:47.813571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-baabe79c-69da-4c48-b731-bc31f3e45810 req-bfb7bf0c-25a2-41b9-957e-b97b924c8b88 service nova] Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:10:47.834764 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-baabe79c-69da-4c48-b731-bc31f3e45810 req-bfb7bf0c-25a2-41b9-957e-b97b924c8b88 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072547 Jul 26 15:10:47.835994 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3360/6605] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:48.694938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-168668d4-3023-4758-990c-a561b787389d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:48.695682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-168668d4-3023-4758-990c-a561b787389d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:48.703394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-168668d4-3023-4758-990c-a561b787389d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:48.704070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-168668d4-3023-4758-990c-a561b787389d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:48.704863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-168668d4-3023-4758-990c-a561b787389d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:48.705351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-168668d4-3023-4758-990c-a561b787389d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:48.870820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-168668d4-3023-4758-990c-a561b787389d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:48.881516 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-168668d4-3023-4758-990c-a561b787389d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.190534 Jul 26 15:10:48.882206 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3246/6606] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:48 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:49.906620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca4102f7-ca48-4180-ab3e-674bbacaba36 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:49.907407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ca4102f7-ca48-4180-ab3e-674bbacaba36 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:49.917707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca4102f7-ca48-4180-ab3e-674bbacaba36 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:49.918520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca4102f7-ca48-4180-ab3e-674bbacaba36 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:49.920084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca4102f7-ca48-4180-ab3e-674bbacaba36 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:49.920725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca4102f7-ca48-4180-ab3e-674bbacaba36 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:50.100662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ca4102f7-ca48-4180-ab3e-674bbacaba36 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:50.109844 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca4102f7-ca48-4180-ab3e-674bbacaba36 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.208814 Jul 26 15:10:50.110499 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3361/6607] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:49 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:51.137349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f354160d-a6ed-4c70-b6a7-ba444aa9a20a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:51.138385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f354160d-a6ed-4c70-b6a7-ba444aa9a20a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:51.149186 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f354160d-a6ed-4c70-b6a7-ba444aa9a20a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:51.149784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f354160d-a6ed-4c70-b6a7-ba444aa9a20a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:51.150759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f354160d-a6ed-4c70-b6a7-ba444aa9a20a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:51.151288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f354160d-a6ed-4c70-b6a7-ba444aa9a20a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:51.382699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f354160d-a6ed-4c70-b6a7-ba444aa9a20a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:51.396615 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f354160d-a6ed-4c70-b6a7-ba444aa9a20a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.264530 Jul 26 15:10:51.413612 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3247/6608] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:51 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:51.469203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-910fd536-1585-441d-80ae-989a187d20aa req-d69a5043-0a0e-4785-af25-3cce2eb60788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf", "name": "network-vif-unplugged", "status": "completed", "tag": "f37920c0-fddc-4d24-8bc6-10e1405e0bda"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:51.490511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-910fd536-1585-441d-80ae-989a187d20aa req-d69a5043-0a0e-4785-af25-3cce2eb60788 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:51.491049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-910fd536-1585-441d-80ae-989a187d20aa req-d69a5043-0a0e-4785-af25-3cce2eb60788 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:51.508008 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-910fd536-1585-441d-80ae-989a187d20aa req-d69a5043-0a0e-4785-af25-3cce2eb60788 service nova] Creating event network-vif-unplugged:f37920c0-fddc-4d24-8bc6-10e1405e0bda for instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf on n-h1-833090-9 Jul 26 15:10:51.515644 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-910fd536-1585-441d-80ae-989a187d20aa req-d69a5043-0a0e-4785-af25-3cce2eb60788 service nova] Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:10:51.539888 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-910fd536-1585-441d-80ae-989a187d20aa req-d69a5043-0a0e-4785-af25-3cce2eb60788 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074339 Jul 26 15:10:51.542242 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3362/6609] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:52.443547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d5945f2f-1f35-4294-a34f-005b72cc8758 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:52.444824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d5945f2f-1f35-4294-a34f-005b72cc8758 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:52.455101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5945f2f-1f35-4294-a34f-005b72cc8758 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:52.456539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5945f2f-1f35-4294-a34f-005b72cc8758 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:52.457727 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5945f2f-1f35-4294-a34f-005b72cc8758 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:52.459389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5945f2f-1f35-4294-a34f-005b72cc8758 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:52.663370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d5945f2f-1f35-4294-a34f-005b72cc8758 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:52.677972 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d5945f2f-1f35-4294-a34f-005b72cc8758 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.239993 Jul 26 15:10:52.678727 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3248/6610] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:52 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:53.563373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-479f3f2d-60e8-4f10-a99b-1aadee22ca4d req-8b7f460d-bcf8-440e-a62f-3039636a930a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf", "tag": "f37920c0-fddc-4d24-8bc6-10e1405e0bda"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:53.576333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-479f3f2d-60e8-4f10-a99b-1aadee22ca4d req-8b7f460d-bcf8-440e-a62f-3039636a930a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:53.576801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-479f3f2d-60e8-4f10-a99b-1aadee22ca4d req-8b7f460d-bcf8-440e-a62f-3039636a930a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:53.590610 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-479f3f2d-60e8-4f10-a99b-1aadee22ca4d req-8b7f460d-bcf8-440e-a62f-3039636a930a service nova] Creating event network-changed:f37920c0-fddc-4d24-8bc6-10e1405e0bda for instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf on n-h1-833090-9 Jul 26 15:10:53.597182 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-479f3f2d-60e8-4f10-a99b-1aadee22ca4d req-8b7f460d-bcf8-440e-a62f-3039636a930a service nova] Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:10:53.609895 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-479f3f2d-60e8-4f10-a99b-1aadee22ca4d req-8b7f460d-bcf8-440e-a62f-3039636a930a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052509 Jul 26 15:10:53.610925 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3363/6611] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:53.704242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-67acd43a-7e49-4ac9-a539-a2b384b4d8b2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:53.706627 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-67acd43a-7e49-4ac9-a539-a2b384b4d8b2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:53.721603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67acd43a-7e49-4ac9-a539-a2b384b4d8b2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:53.722508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67acd43a-7e49-4ac9-a539-a2b384b4d8b2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:53.725394 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67acd43a-7e49-4ac9-a539-a2b384b4d8b2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:53.727237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67acd43a-7e49-4ac9-a539-a2b384b4d8b2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:54.109785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-67acd43a-7e49-4ac9-a539-a2b384b4d8b2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:54.128157 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-67acd43a-7e49-4ac9-a539-a2b384b4d8b2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.428349 Jul 26 15:10:54.130677 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3249/6612] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:53 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:55.158593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a373f66-40a1-4c0f-8ae5-1541e578f12c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:55.160221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9a373f66-40a1-4c0f-8ae5-1541e578f12c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:55.167688 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:55.171578 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a373f66-40a1-4c0f-8ae5-1541e578f12c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:55.172165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a373f66-40a1-4c0f-8ae5-1541e578f12c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:55.173321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a373f66-40a1-4c0f-8ae5-1541e578f12c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:55.173793 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a373f66-40a1-4c0f-8ae5-1541e578f12c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:55.406905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9a373f66-40a1-4c0f-8ae5-1541e578f12c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:55.416918 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9a373f66-40a1-4c0f-8ae5-1541e578f12c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.263001 Jul 26 15:10:55.420054 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3364/6613] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:55 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:56.450145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cfb656c3-d2db-4b9e-b22c-5db844ea93fe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:56.450821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cfb656c3-d2db-4b9e-b22c-5db844ea93fe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:56.458793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfb656c3-d2db-4b9e-b22c-5db844ea93fe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:56.459247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfb656c3-d2db-4b9e-b22c-5db844ea93fe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:56.460056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfb656c3-d2db-4b9e-b22c-5db844ea93fe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:56.460497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cfb656c3-d2db-4b9e-b22c-5db844ea93fe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:56.634396 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cfb656c3-d2db-4b9e-b22c-5db844ea93fe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:56.648906 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cfb656c3-d2db-4b9e-b22c-5db844ea93fe tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.202419 Jul 26 15:10:56.650002 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3250/6614] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:56 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:57.674936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bda1d3d0-6f2e-411a-90ff-c8ffcdc5b9ce tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:57.675757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bda1d3d0-6f2e-411a-90ff-c8ffcdc5b9ce tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:57.687283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bda1d3d0-6f2e-411a-90ff-c8ffcdc5b9ce tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:57.688071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bda1d3d0-6f2e-411a-90ff-c8ffcdc5b9ce tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:57.689391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bda1d3d0-6f2e-411a-90ff-c8ffcdc5b9ce tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:57.690622 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bda1d3d0-6f2e-411a-90ff-c8ffcdc5b9ce tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:57.879338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bda1d3d0-6f2e-411a-90ff-c8ffcdc5b9ce tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:57.889233 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bda1d3d0-6f2e-411a-90ff-c8ffcdc5b9ce tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.220493 Jul 26 15:10:57.890025 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3365/6615] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:57 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:58.912454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b8002b85-d6f9-4c95-97c3-e5d87fb1c060 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:58.913399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b8002b85-d6f9-4c95-97c3-e5d87fb1c060 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:58.921262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8002b85-d6f9-4c95-97c3-e5d87fb1c060 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:58.921718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8002b85-d6f9-4c95-97c3-e5d87fb1c060 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:58.922510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8002b85-d6f9-4c95-97c3-e5d87fb1c060 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:58.922957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8002b85-d6f9-4c95-97c3-e5d87fb1c060 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:59.089832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b8002b85-d6f9-4c95-97c3-e5d87fb1c060 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:59.101591 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b8002b85-d6f9-4c95-97c3-e5d87fb1c060 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.193909 Jul 26 15:10:59.102219 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3251/6616] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:58 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:00.130189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-218607fa-b174-4249-a136-082b53bef023 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:00.132041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-218607fa-b174-4249-a136-082b53bef023 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:00.141917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-218607fa-b174-4249-a136-082b53bef023 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:00.142455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-218607fa-b174-4249-a136-082b53bef023 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:00.143260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-218607fa-b174-4249-a136-082b53bef023 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:00.143716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-218607fa-b174-4249-a136-082b53bef023 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:00.314181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-218607fa-b174-4249-a136-082b53bef023 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:00.327536 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-218607fa-b174-4249-a136-082b53bef023 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.206939 Jul 26 15:11:00.328184 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3366/6617] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:00 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:01.360972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ade6479f-e212-4471-8c0b-bef93ff8ad75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:01.361614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ade6479f-e212-4471-8c0b-bef93ff8ad75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:01.369420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ade6479f-e212-4471-8c0b-bef93ff8ad75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:01.369870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ade6479f-e212-4471-8c0b-bef93ff8ad75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:01.370652 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ade6479f-e212-4471-8c0b-bef93ff8ad75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:01.371090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ade6479f-e212-4471-8c0b-bef93ff8ad75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:01.526434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ade6479f-e212-4471-8c0b-bef93ff8ad75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:01.536969 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ade6479f-e212-4471-8c0b-bef93ff8ad75 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.179807 Jul 26 15:11:01.537667 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3252/6618] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:01 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:02.560362 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a987f0f-e647-4da3-beb4-7d3429821b25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:02.560955 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9a987f0f-e647-4da3-beb4-7d3429821b25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:02.574589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a987f0f-e647-4da3-beb4-7d3429821b25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:02.575228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a987f0f-e647-4da3-beb4-7d3429821b25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:02.576263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a987f0f-e647-4da3-beb4-7d3429821b25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:02.576885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a987f0f-e647-4da3-beb4-7d3429821b25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:02.732636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9a987f0f-e647-4da3-beb4-7d3429821b25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:02.744459 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9a987f0f-e647-4da3-beb4-7d3429821b25 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.187919 Jul 26 15:11:02.745227 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3367/6619] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:02 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:03.767247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3db4fca9-bf81-4b77-ba9a-54a98063687d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:03.767994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3db4fca9-bf81-4b77-ba9a-54a98063687d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:03.776172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3db4fca9-bf81-4b77-ba9a-54a98063687d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:03.776633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3db4fca9-bf81-4b77-ba9a-54a98063687d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:03.777419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3db4fca9-bf81-4b77-ba9a-54a98063687d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:03.777864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3db4fca9-bf81-4b77-ba9a-54a98063687d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:03.950724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3db4fca9-bf81-4b77-ba9a-54a98063687d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:03.965091 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3db4fca9-bf81-4b77-ba9a-54a98063687d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.201495 Jul 26 15:11:03.965993 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3253/6620] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:03 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:04.989380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5a048553-0137-4b5c-9b05-bb866e2e0822 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:04.990190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5a048553-0137-4b5c-9b05-bb866e2e0822 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:04.997682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5a048553-0137-4b5c-9b05-bb866e2e0822 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:04.998156 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5a048553-0137-4b5c-9b05-bb866e2e0822 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:04.998954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5a048553-0137-4b5c-9b05-bb866e2e0822 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:04.999419 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5a048553-0137-4b5c-9b05-bb866e2e0822 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:05.151524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5a048553-0137-4b5c-9b05-bb866e2e0822 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:05.161057 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5a048553-0137-4b5c-9b05-bb866e2e0822 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1720 microversion: 2.1 time: 0.174965 Jul 26 15:11:05.161642 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3368/6621] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:04 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:06.197210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-034d27b1-df76-4e4f-8f93-eb5a80b1c3d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:06.198062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-034d27b1-df76-4e4f-8f93-eb5a80b1c3d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:06.209644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-034d27b1-df76-4e4f-8f93-eb5a80b1c3d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:06.210174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-034d27b1-df76-4e4f-8f93-eb5a80b1c3d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:06.211393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-034d27b1-df76-4e4f-8f93-eb5a80b1c3d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:06.212192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-034d27b1-df76-4e4f-8f93-eb5a80b1c3d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:06.409291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-034d27b1-df76-4e4f-8f93-eb5a80b1c3d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:06.418102 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-034d27b1-df76-4e4f-8f93-eb5a80b1c3d8 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1713 microversion: 2.1 time: 0.227541 Jul 26 15:11:06.418684 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3254/6622] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:06 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1713 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:06.443831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dda5f143-b131-41d3-a39d-5b3d68cb21e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:06.444823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dda5f143-b131-41d3-a39d-5b3d68cb21e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:06.458139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dda5f143-b131-41d3-a39d-5b3d68cb21e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:06.458998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dda5f143-b131-41d3-a39d-5b3d68cb21e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:06.460568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dda5f143-b131-41d3-a39d-5b3d68cb21e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:06.461333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dda5f143-b131-41d3-a39d-5b3d68cb21e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:06.614332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dda5f143-b131-41d3-a39d-5b3d68cb21e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:06.616731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:06.624136 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dda5f143-b131-41d3-a39d-5b3d68cb21e2 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1713 microversion: 2.1 time: 0.186719 Jul 26 15:11:06.624884 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3369/6623] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:06 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1713 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:06.648654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3d6ddda8-cff1-45f1-ade0-f97746831b60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:06.649697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3d6ddda8-cff1-45f1-ade0-f97746831b60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:06.663514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d6ddda8-cff1-45f1-ade0-f97746831b60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:06.664088 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d6ddda8-cff1-45f1-ade0-f97746831b60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:06.664905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d6ddda8-cff1-45f1-ade0-f97746831b60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:06.665352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3d6ddda8-cff1-45f1-ade0-f97746831b60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:06.819680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3d6ddda8-cff1-45f1-ade0-f97746831b60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:06.828699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=94 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:06.840123 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3d6ddda8-cff1-45f1-ade0-f97746831b60 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1713 microversion: 2.1 time: 0.198079 Jul 26 15:11:06.841155 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3255/6624] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:06 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1713 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:06.863847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-28209e73-0d26-4cc5-89b1-fe2ad3d43cb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:06.864459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-28209e73-0d26-4cc5-89b1-fe2ad3d43cb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:06.871720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28209e73-0d26-4cc5-89b1-fe2ad3d43cb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:06.872216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28209e73-0d26-4cc5-89b1-fe2ad3d43cb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:06.873301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28209e73-0d26-4cc5-89b1-fe2ad3d43cb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:06.873753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-28209e73-0d26-4cc5-89b1-fe2ad3d43cb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:06.908771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-28209e73-0d26-4cc5-89b1-fe2ad3d43cb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:11:07.022779 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-28209e73-0d26-4cc5-89b1-fe2ad3d43cb9 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 204 len: 0 microversion: 2.1 time: 0.163110 Jul 26 15:11:07.023455 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3370/6625] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:06 2022] DELETE /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:07.037149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a202294b-ed86-4ae1-b52c-8e86b068eda3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:07.038373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a202294b-ed86-4ae1-b52c-8e86b068eda3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:07.041374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=32 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:07.051586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a202294b-ed86-4ae1-b52c-8e86b068eda3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:07.052603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a202294b-ed86-4ae1-b52c-8e86b068eda3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:07.054080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a202294b-ed86-4ae1-b52c-8e86b068eda3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:07.054878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a202294b-ed86-4ae1-b52c-8e86b068eda3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:07.216953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a202294b-ed86-4ae1-b52c-8e86b068eda3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:07.226224 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a202294b-ed86-4ae1-b52c-8e86b068eda3 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1719 microversion: 2.1 time: 0.197048 Jul 26 15:11:07.226814 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3256/6626] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:07 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:07.819277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-0b648fc3-a261-41ce-b188-7f525d059f50 req-ce210e86-0577-4a2a-a205-073134602358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf", "name": "network-vif-plugged", "status": "completed", "tag": "f37920c0-fddc-4d24-8bc6-10e1405e0bda"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:07.835310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0b648fc3-a261-41ce-b188-7f525d059f50 req-ce210e86-0577-4a2a-a205-073134602358 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:07.836032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0b648fc3-a261-41ce-b188-7f525d059f50 req-ce210e86-0577-4a2a-a205-073134602358 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:07.855109 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-0b648fc3-a261-41ce-b188-7f525d059f50 req-ce210e86-0577-4a2a-a205-073134602358 service nova] Creating event network-vif-plugged:f37920c0-fddc-4d24-8bc6-10e1405e0bda for instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf on n-h1-833090-9 Jul 26 15:11:07.865357 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-0b648fc3-a261-41ce-b188-7f525d059f50 req-ce210e86-0577-4a2a-a205-073134602358 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052114 Jul 26 15:11:07.866413 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3371/6627] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:11:08.248294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6727ca86-bdfd-4b91-b102-e90627dd74cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:08.249021 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6727ca86-bdfd-4b91-b102-e90627dd74cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:08.256881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6727ca86-bdfd-4b91-b102-e90627dd74cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:08.257333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6727ca86-bdfd-4b91-b102-e90627dd74cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:08.258141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6727ca86-bdfd-4b91-b102-e90627dd74cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:08.258574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6727ca86-bdfd-4b91-b102-e90627dd74cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:08.423996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6727ca86-bdfd-4b91-b102-e90627dd74cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:08.435939 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6727ca86-bdfd-4b91-b102-e90627dd74cf tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1719 microversion: 2.1 time: 0.191438 Jul 26 15:11:08.436570 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3257/6628] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:08 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:09.463970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-741f786b-5f31-4c69-836c-6119a0c4eb3d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:09.465988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-741f786b-5f31-4c69-836c-6119a0c4eb3d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:09.471028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:09.482767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-741f786b-5f31-4c69-836c-6119a0c4eb3d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:09.483580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-741f786b-5f31-4c69-836c-6119a0c4eb3d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:09.485050 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-741f786b-5f31-4c69-836c-6119a0c4eb3d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:09.485858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-741f786b-5f31-4c69-836c-6119a0c4eb3d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:09.586781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-741f786b-5f31-4c69-836c-6119a0c4eb3d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:09.604729 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-741f786b-5f31-4c69-836c-6119a0c4eb3d tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1652 microversion: 2.1 time: 0.149598 Jul 26 15:11:09.605276 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3372/6629] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:09 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1652 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:09.686796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-24be7afe-43c7-457a-97bd-4abe4d25b474 req-d864868e-f873-475a-a672-1ea103c9b5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf", "name": "network-vif-deleted", "tag": "f37920c0-fddc-4d24-8bc6-10e1405e0bda"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:09.698758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-24be7afe-43c7-457a-97bd-4abe4d25b474 req-d864868e-f873-475a-a672-1ea103c9b5c5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:09.699209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-24be7afe-43c7-457a-97bd-4abe4d25b474 req-d864868e-f873-475a-a672-1ea103c9b5c5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:09.712413 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-24be7afe-43c7-457a-97bd-4abe4d25b474 req-d864868e-f873-475a-a672-1ea103c9b5c5 service nova] Creating event network-vif-deleted:f37920c0-fddc-4d24-8bc6-10e1405e0bda for instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf on n-h1-833090-9 Jul 26 15:11:09.725930 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-24be7afe-43c7-457a-97bd-4abe4d25b474 req-d864868e-f873-475a-a672-1ea103c9b5c5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042958 Jul 26 15:11:09.727280 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3258/6630] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:10.627906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bd917a8a-a1e5-456c-bdaf-b6a3533251d1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:10.628655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bd917a8a-a1e5-456c-bdaf-b6a3533251d1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:10.636563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd917a8a-a1e5-456c-bdaf-b6a3533251d1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:10.637232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd917a8a-a1e5-456c-bdaf-b6a3533251d1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:10.638923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd917a8a-a1e5-456c-bdaf-b6a3533251d1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:10.639301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd917a8a-a1e5-456c-bdaf-b6a3533251d1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:10.730499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bd917a8a-a1e5-456c-bdaf-b6a3533251d1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:10.741685 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bd917a8a-a1e5-456c-bdaf-b6a3533251d1 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1366 microversion: 2.1 time: 0.118510 Jul 26 15:11:10.742280 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3373/6631] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:10 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:11.766200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-98e1c327-3f99-436e-a8d1-7634d9c7ba0a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:11.766934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-98e1c327-3f99-436e-a8d1-7634d9c7ba0a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:11.775048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-98e1c327-3f99-436e-a8d1-7634d9c7ba0a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:11.775501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-98e1c327-3f99-436e-a8d1-7634d9c7ba0a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:11.776321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-98e1c327-3f99-436e-a8d1-7634d9c7ba0a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:11.776763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-98e1c327-3f99-436e-a8d1-7634d9c7ba0a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:11.849653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-98e1c327-3f99-436e-a8d1-7634d9c7ba0a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:11.858006 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-98e1c327-3f99-436e-a8d1-7634d9c7ba0a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1366 microversion: 2.1 time: 0.097189 Jul 26 15:11:11.871979 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3259/6632] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:11 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:12.882326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-da113033-75b0-4a20-b2fd-e14e472363d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:12.883044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-da113033-75b0-4a20-b2fd-e14e472363d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:12.890318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da113033-75b0-4a20-b2fd-e14e472363d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:12.890992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da113033-75b0-4a20-b2fd-e14e472363d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:12.891801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da113033-75b0-4a20-b2fd-e14e472363d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:12.892295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-da113033-75b0-4a20-b2fd-e14e472363d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:12.981267 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-da113033-75b0-4a20-b2fd-e14e472363d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:12.990888 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-da113033-75b0-4a20-b2fd-e14e472363d6 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1366 microversion: 2.1 time: 0.113420 Jul 26 15:11:12.991475 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3374/6633] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:12 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:14.014319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-65ec6f10-cee4-47b0-9ffd-1783fd1d4021 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:14.014948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-65ec6f10-cee4-47b0-9ffd-1783fd1d4021 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:14.025060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65ec6f10-cee4-47b0-9ffd-1783fd1d4021 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:14.025524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65ec6f10-cee4-47b0-9ffd-1783fd1d4021 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:14.026351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65ec6f10-cee4-47b0-9ffd-1783fd1d4021 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:14.026798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65ec6f10-cee4-47b0-9ffd-1783fd1d4021 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:14.115137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-65ec6f10-cee4-47b0-9ffd-1783fd1d4021 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b34650cfc14e69ace08e3a0be3ca06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89dd1bdabe6a4fa4aa70fd31ee6f76aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:14.130008 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-65ec6f10-cee4-47b0-9ffd-1783fd1d4021 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 200 len: 1366 microversion: 2.1 time: 0.119722 Jul 26 15:11:14.131016 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3260/6634] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:14 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:15.164072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-287f37df-6d84-41f8-8671-35199eef4560 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:15.164733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-287f37df-6d84-41f8-8671-35199eef4560 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:15.173909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-287f37df-6d84-41f8-8671-35199eef4560 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:15.173909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-287f37df-6d84-41f8-8671-35199eef4560 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:15.173909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-287f37df-6d84-41f8-8671-35199eef4560 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:15.174441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-287f37df-6d84-41f8-8671-35199eef4560 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:15.198108 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-287f37df-6d84-41f8-8671-35199eef4560 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-287f37df-6d84-41f8-8671-35199eef4560 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf HTTP/1.1 Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf'} Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:15.201806 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:15.209911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:15.209911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:15.209911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:15.209911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:15.209911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:15.209911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:15.209911 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:15.209911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-287f37df-6d84-41f8-8671-35199eef4560 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:15.209911 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-287f37df-6d84-41f8-8671-35199eef4560 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 404 len: 111 microversion: 2.1 time: 0.045119 Jul 26 15:11:15.209911 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3375/6635] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:15 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:15.279153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a0b7fa9-3921-4cb3-b699-64a778274e00 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:15.281423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4a0b7fa9-3921-4cb3-b699-64a778274e00 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:15.288769 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a0b7fa9-3921-4cb3-b699-64a778274e00 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:15.289225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a0b7fa9-3921-4cb3-b699-64a778274e00 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:15.290010 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a0b7fa9-3921-4cb3-b699-64a778274e00 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:15.290445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a0b7fa9-3921-4cb3-b699-64a778274e00 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:15.304797 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-4a0b7fa9-3921-4cb3-b699-64a778274e00 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a0b7fa9-3921-4cb3-b699-64a778274e00 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/os-volume_attachments HTTP/1.1 Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': 'c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf'} Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:15.306525 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a0b7fa9-3921-4cb3-b699-64a778274e00 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4a0b7fa9-3921-4cb3-b699-64a778274e00 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032893 Jul 26 15:11:15.311736 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3261/6636] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:11:15 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:18.696570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f1d7790-627a-4e79-9476-dd1531d9f109 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:18.697184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4f1d7790-627a-4e79-9476-dd1531d9f109 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:18.705609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f1d7790-627a-4e79-9476-dd1531d9f109 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.706346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f1d7790-627a-4e79-9476-dd1531d9f109 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.707276 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f1d7790-627a-4e79-9476-dd1531d9f109 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.707913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f1d7790-627a-4e79-9476-dd1531d9f109 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.717367 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:11:18.718529 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:11:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:11:18.732012 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-4f1d7790-627a-4e79-9476-dd1531d9f109 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f1d7790-627a-4e79-9476-dd1531d9f109 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf HTTP/1.1 Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf'} Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:18.733620 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f1d7790-627a-4e79-9476-dd1531d9f109 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4f1d7790-627a-4e79-9476-dd1531d9f109 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 404 len: 111 microversion: 2.1 time: 0.042729 Jul 26 15:11:18.744046 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3376/6637] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:18 2022] DELETE /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:11:18.745023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dc498d18-0b8d-4dac-a2a5-6fd8df1f11e0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:18.745676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dc498d18-0b8d-4dac-a2a5-6fd8df1f11e0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:18.752821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc498d18-0b8d-4dac-a2a5-6fd8df1f11e0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.753330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc498d18-0b8d-4dac-a2a5-6fd8df1f11e0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.754586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc498d18-0b8d-4dac-a2a5-6fd8df1f11e0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.755020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dc498d18-0b8d-4dac-a2a5-6fd8df1f11e0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.775487 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-dc498d18-0b8d-4dac-a2a5-6fd8df1f11e0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dc498d18-0b8d-4dac-a2a5-6fd8df1f11e0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf HTTP/1.1 Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf'} Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.778107 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.783512 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.783512 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.783512 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.783512 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:18.783512 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:18.783512 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. Jul 26 15:11:18.783512 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.783512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dc498d18-0b8d-4dac-a2a5-6fd8df1f11e0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:18.783512 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dc498d18-0b8d-4dac-a2a5-6fd8df1f11e0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf" status: 404 len: 111 microversion: 2.1 time: 0.039078 Jul 26 15:11:18.783512 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3262/6638] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:18 2022] GET /compute/v2.1/servers/c6a7bb83-3a9d-4c0b-8a83-621ecd3bbeaf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:18.790341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d53fa2ce-67c6-4b28-a188-a1a93d72e684 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:18.790975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d53fa2ce-67c6-4b28-a188-a1a93d72e684 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:18.798080 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d53fa2ce-67c6-4b28-a188-a1a93d72e684 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.798649 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d53fa2ce-67c6-4b28-a188-a1a93d72e684 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.799530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d53fa2ce-67c6-4b28-a188-a1a93d72e684 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.800087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d53fa2ce-67c6-4b28-a188-a1a93d72e684 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.820972 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-d53fa2ce-67c6-4b28-a188-a1a93d72e684 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d53fa2ce-67c6-4b28-a188-a1a93d72e684 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 HTTP/1.1 Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e2aa6652-70b2-41c1-8347-8afe4098dee1'} Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:18.822935 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:11:18.827568 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.829177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d53fa2ce-67c6-4b28-a188-a1a93d72e684 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:18.830342 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d53fa2ce-67c6-4b28-a188-a1a93d72e684 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 404 len: 111 microversion: 2.1 time: 0.043959 Jul 26 15:11:18.830963 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3377/6639] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:18 2022] DELETE /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:18.842758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84b6f088-7c3a-4304-8c7c-dbd748f9e4a4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:18.843879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-84b6f088-7c3a-4304-8c7c-dbd748f9e4a4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e2aa6652-70b2-41c1-8347-8afe4098dee1] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:18.853409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84b6f088-7c3a-4304-8c7c-dbd748f9e4a4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.853871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84b6f088-7c3a-4304-8c7c-dbd748f9e4a4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.854682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84b6f088-7c3a-4304-8c7c-dbd748f9e4a4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.855131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-84b6f088-7c3a-4304-8c7c-dbd748f9e4a4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.871025 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-84b6f088-7c3a-4304-8c7c-dbd748f9e4a4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84b6f088-7c3a-4304-8c7c-dbd748f9e4a4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 HTTP/1.1 Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e2aa6652-70b2-41c1-8347-8afe4098dee1'} Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.872789 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.876678 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.876678 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.876678 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.876678 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:18.876678 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:18.876678 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. Jul 26 15:11:18.876678 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.876678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-84b6f088-7c3a-4304-8c7c-dbd748f9e4a4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance e2aa6652-70b2-41c1-8347-8afe4098dee1 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:18.876678 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-84b6f088-7c3a-4304-8c7c-dbd748f9e4a4 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1" status: 404 len: 111 microversion: 2.1 time: 0.037959 Jul 26 15:11:18.876678 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3263/6640] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:18 2022] GET /compute/v2.1/servers/e2aa6652-70b2-41c1-8347-8afe4098dee1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:18.885656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-119143b2-482e-4128-bac1-b7917b096136 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:18.886175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-119143b2-482e-4128-bac1-b7917b096136 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:18.892478 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-119143b2-482e-4128-bac1-b7917b096136 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.893075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-119143b2-482e-4128-bac1-b7917b096136 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.894003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-119143b2-482e-4128-bac1-b7917b096136 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.894608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-119143b2-482e-4128-bac1-b7917b096136 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.911243 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-119143b2-482e-4128-bac1-b7917b096136 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-119143b2-482e-4128-bac1-b7917b096136 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 HTTP/1.1 Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd3adba6e-8637-47c5-a781-b06993b81b76'} Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:18.913476 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-119143b2-482e-4128-bac1-b7917b096136 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-119143b2-482e-4128-bac1-b7917b096136 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 404 len: 111 microversion: 2.1 time: 0.034099 Jul 26 15:11:18.917341 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3378/6641] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:18 2022] DELETE /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:18.929641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-be7211ad-83b0-407d-bd2e-bfe05a0a313a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:18.930715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-be7211ad-83b0-407d-bd2e-bfe05a0a313a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: d3adba6e-8637-47c5-a781-b06993b81b76] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:18.940696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be7211ad-83b0-407d-bd2e-bfe05a0a313a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.942544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be7211ad-83b0-407d-bd2e-bfe05a0a313a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.942978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be7211ad-83b0-407d-bd2e-bfe05a0a313a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.943670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-be7211ad-83b0-407d-bd2e-bfe05a0a313a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.961809 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-be7211ad-83b0-407d-bd2e-bfe05a0a313a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-be7211ad-83b0-407d-bd2e-bfe05a0a313a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 HTTP/1.1 Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd3adba6e-8637-47c5-a781-b06993b81b76'} Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:18.963494 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.975690 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:18.975690 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:18.975690 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:18.975690 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:18.975690 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:18.975690 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. Jul 26 15:11:18.975690 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:18.975690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-be7211ad-83b0-407d-bd2e-bfe05a0a313a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance d3adba6e-8637-47c5-a781-b06993b81b76 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:18.975690 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-be7211ad-83b0-407d-bd2e-bfe05a0a313a tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76" status: 404 len: 111 microversion: 2.1 time: 0.043023 Jul 26 15:11:18.975690 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3264/6642] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:18 2022] GET /compute/v2.1/servers/d3adba6e-8637-47c5-a781-b06993b81b76 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:18.978279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0789b08f-cb2d-402e-a1ea-5f6032f9bbd0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:18.979062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0789b08f-cb2d-402e-a1ea-5f6032f9bbd0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:18.991775 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0789b08f-cb2d-402e-a1ea-5f6032f9bbd0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.992704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0789b08f-cb2d-402e-a1ea-5f6032f9bbd0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:18.993886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0789b08f-cb2d-402e-a1ea-5f6032f9bbd0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:18.995024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0789b08f-cb2d-402e-a1ea-5f6032f9bbd0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:19.014416 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-0789b08f-cb2d-402e-a1ea-5f6032f9bbd0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0789b08f-cb2d-402e-a1ea-5f6032f9bbd0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 HTTP/1.1 Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'e52e3e20-e30f-4c35-bf18-07a160a8ce04'} Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:19.016088 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0789b08f-cb2d-402e-a1ea-5f6032f9bbd0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0789b08f-cb2d-402e-a1ea-5f6032f9bbd0 tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 404 len: 111 microversion: 2.1 time: 0.046432 Jul 26 15:11:19.021817 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3379/6643] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:18 2022] DELETE /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:19.029725 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-30de9349-c571-4001-a87e-55cff3bf2f1c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:19.030367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-30de9349-c571-4001-a87e-55cff3bf2f1c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] [instance: e52e3e20-e30f-4c35-bf18-07a160a8ce04] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:19.038689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30de9349-c571-4001-a87e-55cff3bf2f1c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:19.039153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30de9349-c571-4001-a87e-55cff3bf2f1c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:19.039979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30de9349-c571-4001-a87e-55cff3bf2f1c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:19.040436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30de9349-c571-4001-a87e-55cff3bf2f1c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:19.061335 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-30de9349-c571-4001-a87e-55cff3bf2f1c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] HTTP exception thrown: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-30de9349-c571-4001-a87e-55cff3bf2f1c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Request method failure captured: Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 HTTP/1.1 Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AKBnaF7w0pyG2PukgtW3nlA6qxdcZglNbad3axAYs8aCkOYCCwCVsfmEIn1U0o357Zs4zxfGIYriXy5H6AtBynLY2TGgz4nCo9jbY-nntzVfPYSmhgIN-1ESG_ZL1j-IexZsvV7EFEGD148hdK_J88ioe6TczgbTRdYwiG4RcCUgTI Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89dd1bdabe6a4fa4aa70fd31ee6f76aa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89dd1bdabe6a4fa4aa70fd31ee6f76aa"}]}] Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 89dd1bdabe6a4fa4aa70fd31ee6f76aa Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServerActionsTestJSON-1220938762 Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: b5b34650cfc14e69ace08e3a0be3ca06 Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServerActionsTestJSON-1220938762-project Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'e52e3e20-e30f-4c35-bf18-07a160a8ce04'} Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:19.063928 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:19.071544 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:19.071544 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:19.071544 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:19.071544 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:19.071544 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:19.071544 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. Jul 26 15:11:19.071544 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:19.071544 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-30de9349-c571-4001-a87e-55cff3bf2f1c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Returning 404 to user: Instance e52e3e20-e30f-4c35-bf18-07a160a8ce04 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:19.071544 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-30de9349-c571-4001-a87e-55cff3bf2f1c tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04" status: 404 len: 111 microversion: 2.1 time: 0.041178 Jul 26 15:11:19.071544 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3265/6644] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:19 2022] GET /compute/v2.1/servers/e52e3e20-e30f-4c35-bf18-07a160a8ce04 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:19.075398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6bfb464b-933c-4611-8403-b74f36b18cdb tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] Calling method '.version_select at 0x7f87869b4dc0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:19.109891 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6bfb464b-933c-4611-8403-b74f36b18cdb tempest-ServerActionsTestJSON-1220938762 tempest-ServerActionsTestJSON-1220938762-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-41852955" status: 202 len: 0 microversion: 2.1 time: 0.038147 Jul 26 15:11:19.110597 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3380/6645] 10.222.0.70 () {58 vars in 1215 bytes} [Tue Jul 26 15:11:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-41852955 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:11:30.367659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=19 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:30.369226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=37 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:30.556435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1494427537", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "06f2e1f1-e5ca-40d4-aa9f-374334bcd1a5"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:30.620890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] validate_networks() for [('06f2e1f1-e5ca-40d4-aa9f-374334bcd1a5', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:11:31.092754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:11:31.093191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:11:31.093674 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:11:31.094093 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:11:31.095180 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:11:31.108342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:31.108849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:31.109607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:31.110447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:31.128583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Getting quotas for project 22cf4771de084198a68b2c63f1a6f456. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:11:31.135050 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Getting quotas for user 6fad52c4923341eea9c0f5f0d81d9b1f and project 22cf4771de084198a68b2c63f1a6f456. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:11:31.151255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:11:31.153582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:11:31.215886 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-822841ba-d0d7-4d63-b439-ddc1ca1e4251 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854480 Jul 26 15:11:31.216772 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3266/6646] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:11:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:11:31.231106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:31.231813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:31.236330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-df5c03b4-6950-483d-94ea-9b8639e5868e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:31.236992 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-df5c03b4-6950-483d-94ea-9b8639e5868e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:31.323172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-df5c03b4-6950-483d-94ea-9b8639e5868e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:31.330634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-df5c03b4-6950-483d-94ea-9b8639e5868e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1217 microversion: 2.1 time: 0.101293 Jul 26 15:11:31.331666 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3381/6647] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:31 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:32.352649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fa4b4774-5436-404e-86f3-cce2d1e9e331 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:32.354229 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fa4b4774-5436-404e-86f3-cce2d1e9e331 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:32.361134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa4b4774-5436-404e-86f3-cce2d1e9e331 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:32.364517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa4b4774-5436-404e-86f3-cce2d1e9e331 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:32.364517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa4b4774-5436-404e-86f3-cce2d1e9e331 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:32.364517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa4b4774-5436-404e-86f3-cce2d1e9e331 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:32.469198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fa4b4774-5436-404e-86f3-cce2d1e9e331 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:32.481362 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fa4b4774-5436-404e-86f3-cce2d1e9e331 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1269 microversion: 2.1 time: 0.133647 Jul 26 15:11:32.482386 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3267/6648] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:32 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1269 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:33.512003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2b7922eb-78a2-4775-a047-e042e600bf42 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:33.512826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2b7922eb-78a2-4775-a047-e042e600bf42 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:33.521947 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b7922eb-78a2-4775-a047-e042e600bf42 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:33.522701 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b7922eb-78a2-4775-a047-e042e600bf42 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:33.523690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b7922eb-78a2-4775-a047-e042e600bf42 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:33.524329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b7922eb-78a2-4775-a047-e042e600bf42 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:33.792260 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2b7922eb-78a2-4775-a047-e042e600bf42 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:33.801092 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2b7922eb-78a2-4775-a047-e042e600bf42 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1317 microversion: 2.1 time: 0.292982 Jul 26 15:11:33.812789 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3382/6649] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:33 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:34.523267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-1bf7eb38-2780-49ec-809c-6056bcb9b673 req-33e744a2-ce99-4934-935d-9e21eb4835a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dac4711-a28e-4800-aef4-e21a9243dc35", "tag": "2c65aca5-7583-4072-b90b-95ca898a55f7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:34.548908 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1bf7eb38-2780-49ec-809c-6056bcb9b673 req-33e744a2-ce99-4934-935d-9e21eb4835a8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:34.550505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-1bf7eb38-2780-49ec-809c-6056bcb9b673 req-33e744a2-ce99-4934-935d-9e21eb4835a8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:34.564928 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-1bf7eb38-2780-49ec-809c-6056bcb9b673 req-33e744a2-ce99-4934-935d-9e21eb4835a8 service nova] Creating event network-changed:2c65aca5-7583-4072-b90b-95ca898a55f7 for instance 4dac4711-a28e-4800-aef4-e21a9243dc35 on n-h2-833090-9 Jul 26 15:11:34.577829 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-1bf7eb38-2780-49ec-809c-6056bcb9b673 req-33e744a2-ce99-4934-935d-9e21eb4835a8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057348 Jul 26 15:11:34.579064 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3268/6650] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:34.839425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-64e1d3f0-3698-45c5-9e34-5872d48ced84 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:34.840239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-64e1d3f0-3698-45c5-9e34-5872d48ced84 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:34.856218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64e1d3f0-3698-45c5-9e34-5872d48ced84 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:34.857227 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64e1d3f0-3698-45c5-9e34-5872d48ced84 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:34.858437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64e1d3f0-3698-45c5-9e34-5872d48ced84 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:34.860655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-64e1d3f0-3698-45c5-9e34-5872d48ced84 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:35.177711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-64e1d3f0-3698-45c5-9e34-5872d48ced84 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:35.187935 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-64e1d3f0-3698-45c5-9e34-5872d48ced84 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1317 microversion: 2.1 time: 0.352689 Jul 26 15:11:35.202797 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3383/6651] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:34 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:36.211654 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1f5c3254-e3d6-4ef3-b329-3668b57600d1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:36.212521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f5c3254-e3d6-4ef3-b329-3668b57600d1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:36.220917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f5c3254-e3d6-4ef3-b329-3668b57600d1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:36.221373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f5c3254-e3d6-4ef3-b329-3668b57600d1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:36.222424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f5c3254-e3d6-4ef3-b329-3668b57600d1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:36.222695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f5c3254-e3d6-4ef3-b329-3668b57600d1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:36.465700 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1f5c3254-e3d6-4ef3-b329-3668b57600d1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:36.474612 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1f5c3254-e3d6-4ef3-b329-3668b57600d1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1317 microversion: 2.1 time: 0.267061 Jul 26 15:11:36.475007 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3269/6652] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:36 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:37.496847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aec8beba-cdd9-4746-9500-d51aea237be4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:37.497511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aec8beba-cdd9-4746-9500-d51aea237be4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:37.505188 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aec8beba-cdd9-4746-9500-d51aea237be4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:37.505666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aec8beba-cdd9-4746-9500-d51aea237be4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:37.506474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aec8beba-cdd9-4746-9500-d51aea237be4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:37.506943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aec8beba-cdd9-4746-9500-d51aea237be4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:37.658647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aec8beba-cdd9-4746-9500-d51aea237be4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:37.666535 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aec8beba-cdd9-4746-9500-d51aea237be4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1317 microversion: 2.1 time: 0.173650 Jul 26 15:11:37.667103 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3384/6653] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:37 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:38.689397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2c708687-96d4-4e8f-89c8-e38555cc88db tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:38.690237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2c708687-96d4-4e8f-89c8-e38555cc88db tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:38.699736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c708687-96d4-4e8f-89c8-e38555cc88db tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:38.700285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c708687-96d4-4e8f-89c8-e38555cc88db tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:38.701252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c708687-96d4-4e8f-89c8-e38555cc88db tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:38.701962 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2c708687-96d4-4e8f-89c8-e38555cc88db tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:38.870425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2c708687-96d4-4e8f-89c8-e38555cc88db tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:38.879865 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2c708687-96d4-4e8f-89c8-e38555cc88db tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1317 microversion: 2.1 time: 0.195279 Jul 26 15:11:38.880512 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3270/6654] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:38 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:39.906618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aa6a69be-767c-4d66-a50f-a0a2fc1386e7 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:39.907822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aa6a69be-767c-4d66-a50f-a0a2fc1386e7 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:39.921047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa6a69be-767c-4d66-a50f-a0a2fc1386e7 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:39.921884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa6a69be-767c-4d66-a50f-a0a2fc1386e7 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:39.923354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa6a69be-767c-4d66-a50f-a0a2fc1386e7 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:39.924330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa6a69be-767c-4d66-a50f-a0a2fc1386e7 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:40.099174 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-aa6a69be-767c-4d66-a50f-a0a2fc1386e7 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:40.106472 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ec247368-d5fe-4cfd-8da8-e451d079cc54 req-cfe231cb-6048-4fe8-a399-7120dd159ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dac4711-a28e-4800-aef4-e21a9243dc35", "name": "network-vif-plugged", "status": "completed", "tag": "2c65aca5-7583-4072-b90b-95ca898a55f7"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:40.111251 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aa6a69be-767c-4d66-a50f-a0a2fc1386e7 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1317 microversion: 2.1 time: 0.211679 Jul 26 15:11:40.114618 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3385/6655] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:39 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:40.123329 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ec247368-d5fe-4cfd-8da8-e451d079cc54 req-cfe231cb-6048-4fe8-a399-7120dd159ec0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:40.123865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ec247368-d5fe-4cfd-8da8-e451d079cc54 req-cfe231cb-6048-4fe8-a399-7120dd159ec0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:40.152152 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ec247368-d5fe-4cfd-8da8-e451d079cc54 req-cfe231cb-6048-4fe8-a399-7120dd159ec0 service nova] Creating event network-vif-plugged:2c65aca5-7583-4072-b90b-95ca898a55f7 for instance 4dac4711-a28e-4800-aef4-e21a9243dc35 on n-h2-833090-9 Jul 26 15:11:40.159594 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ec247368-d5fe-4cfd-8da8-e451d079cc54 req-cfe231cb-6048-4fe8-a399-7120dd159ec0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057141 Jul 26 15:11:40.160818 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3271/6656] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:11:41.140986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b82a479-4540-485c-a0e5-956488e7e4a9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:41.142138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7b82a479-4540-485c-a0e5-956488e7e4a9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:41.154239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b82a479-4540-485c-a0e5-956488e7e4a9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:41.155053 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b82a479-4540-485c-a0e5-956488e7e4a9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:41.156381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b82a479-4540-485c-a0e5-956488e7e4a9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:41.157062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b82a479-4540-485c-a0e5-956488e7e4a9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:41.328070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:41.357109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b82a479-4540-485c-a0e5-956488e7e4a9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:41.368684 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b82a479-4540-485c-a0e5-956488e7e4a9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1317 microversion: 2.1 time: 0.234890 Jul 26 15:11:41.369518 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3386/6657] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:41 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:42.390771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.392536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.400851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-93c0ccb1-9d0e-4348-9eb1-dffcd0f71d5b tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:42.401621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-93c0ccb1-9d0e-4348-9eb1-dffcd0f71d5b tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:42.413640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93c0ccb1-9d0e-4348-9eb1-dffcd0f71d5b tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:42.414158 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93c0ccb1-9d0e-4348-9eb1-dffcd0f71d5b tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:42.415474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93c0ccb1-9d0e-4348-9eb1-dffcd0f71d5b tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:42.416305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-93c0ccb1-9d0e-4348-9eb1-dffcd0f71d5b tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:42.586114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-93c0ccb1-9d0e-4348-9eb1-dffcd0f71d5b tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:42.594900 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-93c0ccb1-9d0e-4348-9eb1-dffcd0f71d5b tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1506 microversion: 2.1 time: 0.205066 Jul 26 15:11:42.595486 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3272/6658] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:42 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:42.694027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1448381616", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "06f2e1f1-e5ca-40d4-aa9f-374334bcd1a5"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:42.788135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] validate_networks() for [('06f2e1f1-e5ca-40d4-aa9f-374334bcd1a5', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:11:43.370555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:11:43.371194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:11:43.371802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:11:43.372455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:11:43.373031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:11:43.386970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:43.387444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:43.388607 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:43.389425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:43.417988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Getting quotas for project 22cf4771de084198a68b2c63f1a6f456. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:11:43.424348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Getting quotas for user 6fad52c4923341eea9c0f5f0d81d9b1f and project 22cf4771de084198a68b2c63f1a6f456. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:11:43.441296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:11:43.444303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:11:43.508892 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d4ac9916-af1e-4955-9005-58d845ece5c1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821855 Jul 26 15:11:43.509925 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3387/6659] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:11:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:11:43.528626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3e9b4c46-50a0-46aa-a881-a1c36420b1f4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:43.530567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3e9b4c46-50a0-46aa-a881-a1c36420b1f4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:43.632155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3e9b4c46-50a0-46aa-a881-a1c36420b1f4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:43.645356 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3e9b4c46-50a0-46aa-a881-a1c36420b1f4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1217 microversion: 2.1 time: 0.123789 Jul 26 15:11:43.646370 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3273/6660] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:43 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:44.682473 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-79e026a1-5124-412d-8e9c-4ec1882a1f4c tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:44.683462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79e026a1-5124-412d-8e9c-4ec1882a1f4c tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:44.697863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79e026a1-5124-412d-8e9c-4ec1882a1f4c tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:44.698600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79e026a1-5124-412d-8e9c-4ec1882a1f4c tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:44.701850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79e026a1-5124-412d-8e9c-4ec1882a1f4c tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:44.702657 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79e026a1-5124-412d-8e9c-4ec1882a1f4c tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:44.830738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-79e026a1-5124-412d-8e9c-4ec1882a1f4c tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:44.844349 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-79e026a1-5124-412d-8e9c-4ec1882a1f4c tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1277 microversion: 2.1 time: 0.171205 Jul 26 15:11:44.860016 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3388/6661] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:44 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:45.881114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-64814c4b-2d64-48f1-8ccf-aadd7942e931 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:45.883145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-64814c4b-2d64-48f1-8ccf-aadd7942e931 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:45.901687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64814c4b-2d64-48f1-8ccf-aadd7942e931 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.902436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64814c4b-2d64-48f1-8ccf-aadd7942e931 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:45.907236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64814c4b-2d64-48f1-8ccf-aadd7942e931 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.907236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-64814c4b-2d64-48f1-8ccf-aadd7942e931 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:46.181826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-64814c4b-2d64-48f1-8ccf-aadd7942e931 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:46.187780 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-64814c4b-2d64-48f1-8ccf-aadd7942e931 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1317 microversion: 2.1 time: 0.315242 Jul 26 15:11:46.188418 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3274/6662] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:45 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:46.913390 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a2c9aee9-c39d-463a-bfb9-6dbcf775df0d req-21dcf812-1f32-4f46-a96e-3cc41ae89e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04d5c8a5-a48c-4baf-ad08-f37bcb48daf7", "tag": "aac9ec0c-e9f4-4aa6-8e01-7354ba41dc2f"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:46.939231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a2c9aee9-c39d-463a-bfb9-6dbcf775df0d req-21dcf812-1f32-4f46-a96e-3cc41ae89e9b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:46.940566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a2c9aee9-c39d-463a-bfb9-6dbcf775df0d req-21dcf812-1f32-4f46-a96e-3cc41ae89e9b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:46.963872 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a2c9aee9-c39d-463a-bfb9-6dbcf775df0d req-21dcf812-1f32-4f46-a96e-3cc41ae89e9b service nova] Creating event network-changed:aac9ec0c-e9f4-4aa6-8e01-7354ba41dc2f for instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 on n-h1-833090-9 Jul 26 15:11:46.975015 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a2c9aee9-c39d-463a-bfb9-6dbcf775df0d req-21dcf812-1f32-4f46-a96e-3cc41ae89e9b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084167 Jul 26 15:11:46.976140 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3389/6663] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:47.223897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32a99ac0-7b1b-4ae8-ae6f-83864dcac2d8 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:47.224734 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-32a99ac0-7b1b-4ae8-ae6f-83864dcac2d8 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:47.236621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32a99ac0-7b1b-4ae8-ae6f-83864dcac2d8 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.237899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32a99ac0-7b1b-4ae8-ae6f-83864dcac2d8 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.238580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32a99ac0-7b1b-4ae8-ae6f-83864dcac2d8 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.239026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32a99ac0-7b1b-4ae8-ae6f-83864dcac2d8 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.412578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-32a99ac0-7b1b-4ae8-ae6f-83864dcac2d8 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:47.421987 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32a99ac0-7b1b-4ae8-ae6f-83864dcac2d8 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1317 microversion: 2.1 time: 0.204060 Jul 26 15:11:47.428075 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3275/6664] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:47 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:48.462652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d8f938f1-cead-45e7-add0-d582e3935d29 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:48.463772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d8f938f1-cead-45e7-add0-d582e3935d29 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:48.474315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8f938f1-cead-45e7-add0-d582e3935d29 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.474805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8f938f1-cead-45e7-add0-d582e3935d29 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:48.475638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8f938f1-cead-45e7-add0-d582e3935d29 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.476166 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d8f938f1-cead-45e7-add0-d582e3935d29 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:48.977146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d8f938f1-cead-45e7-add0-d582e3935d29 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:48.986389 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d8f938f1-cead-45e7-add0-d582e3935d29 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1317 microversion: 2.1 time: 0.528464 Jul 26 15:11:48.987409 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3390/6665] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:48 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:50.017253 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a4277056-0eb1-4d02-a75a-556e0dfafdfa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:50.018129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a4277056-0eb1-4d02-a75a-556e0dfafdfa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:50.025648 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4277056-0eb1-4d02-a75a-556e0dfafdfa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:50.026306 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4277056-0eb1-4d02-a75a-556e0dfafdfa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:50.027096 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4277056-0eb1-4d02-a75a-556e0dfafdfa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:50.027536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a4277056-0eb1-4d02-a75a-556e0dfafdfa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:50.254522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a4277056-0eb1-4d02-a75a-556e0dfafdfa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:50.268994 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a4277056-0eb1-4d02-a75a-556e0dfafdfa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1317 microversion: 2.1 time: 0.255123 Jul 26 15:11:50.270065 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3276/6666] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:50 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:51.302585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-864f4bb2-e7c3-45d9-9bf7-e6295aed0bdf tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:51.303436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-864f4bb2-e7c3-45d9-9bf7-e6295aed0bdf tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:51.311445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-864f4bb2-e7c3-45d9-9bf7-e6295aed0bdf tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:51.312006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-864f4bb2-e7c3-45d9-9bf7-e6295aed0bdf tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:51.313104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-864f4bb2-e7c3-45d9-9bf7-e6295aed0bdf tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:51.313569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-864f4bb2-e7c3-45d9-9bf7-e6295aed0bdf tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:51.483786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-864f4bb2-e7c3-45d9-9bf7-e6295aed0bdf tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:51.496439 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-864f4bb2-e7c3-45d9-9bf7-e6295aed0bdf tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1317 microversion: 2.1 time: 0.197674 Jul 26 15:11:51.497346 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3391/6667] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:51 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:52.044292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4a68c629-0218-4477-9a40-ae62f5612cc5 req-711baf59-fc6d-4125-910a-20a5765ed784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d5c8a5-a48c-4baf-ad08-f37bcb48daf7", "name": "network-vif-plugged", "status": "completed", "tag": "aac9ec0c-e9f4-4aa6-8e01-7354ba41dc2f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:52.057348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4a68c629-0218-4477-9a40-ae62f5612cc5 req-711baf59-fc6d-4125-910a-20a5765ed784 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:52.057964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4a68c629-0218-4477-9a40-ae62f5612cc5 req-711baf59-fc6d-4125-910a-20a5765ed784 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:52.073540 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4a68c629-0218-4477-9a40-ae62f5612cc5 req-711baf59-fc6d-4125-910a-20a5765ed784 service nova] Creating event network-vif-plugged:aac9ec0c-e9f4-4aa6-8e01-7354ba41dc2f for instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 on n-h1-833090-9 Jul 26 15:11:52.080563 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4a68c629-0218-4477-9a40-ae62f5612cc5 req-711baf59-fc6d-4125-910a-20a5765ed784 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039840 Jul 26 15:11:52.081421 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3277/6668] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:11:52.520983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c5e34bad-85c4-453a-978b-7d46734c5d7e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:52.520983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c5e34bad-85c4-453a-978b-7d46734c5d7e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:52.528324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5e34bad-85c4-453a-978b-7d46734c5d7e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:52.529405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5e34bad-85c4-453a-978b-7d46734c5d7e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:52.530247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5e34bad-85c4-453a-978b-7d46734c5d7e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:52.530713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c5e34bad-85c4-453a-978b-7d46734c5d7e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:52.724062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c5e34bad-85c4-453a-978b-7d46734c5d7e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:52.735287 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c5e34bad-85c4-453a-978b-7d46734c5d7e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1317 microversion: 2.1 time: 0.219509 Jul 26 15:11:52.744434 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3392/6669] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:52 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:53.760011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad80c856-4f37-4f75-b54f-41590dbe9a65 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:53.760735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ad80c856-4f37-4f75-b54f-41590dbe9a65 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:53.764289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.775657 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad80c856-4f37-4f75-b54f-41590dbe9a65 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:53.776479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad80c856-4f37-4f75-b54f-41590dbe9a65 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:53.777808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad80c856-4f37-4f75-b54f-41590dbe9a65 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:53.778567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad80c856-4f37-4f75-b54f-41590dbe9a65 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:53.951183 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ad80c856-4f37-4f75-b54f-41590dbe9a65 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:53.963752 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad80c856-4f37-4f75-b54f-41590dbe9a65 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1506 microversion: 2.1 time: 0.207610 Jul 26 15:11:53.964806 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3278/6670] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:53 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:53.993238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-632758cc-d6a0-4d85-a9a6-5badccce175a tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:53.994085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-632758cc-d6a0-4d85-a9a6-5badccce175a tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:53.996540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:53.997763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:54.006424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-632758cc-d6a0-4d85-a9a6-5badccce175a tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:54.007304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-632758cc-d6a0-4d85-a9a6-5badccce175a tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:54.008831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-632758cc-d6a0-4d85-a9a6-5badccce175a tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:54.009469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-632758cc-d6a0-4d85-a9a6-5badccce175a tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:54.050416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-632758cc-d6a0-4d85-a9a6-5badccce175a tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:11:54.169955 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-632758cc-d6a0-4d85-a9a6-5badccce175a tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "DELETE /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 204 len: 0 microversion: 2.1 time: 0.181905 Jul 26 15:11:54.171248 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3393/6671] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:53 2022] DELETE /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:54.185447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-06000fa6-abe1-485b-8b74-a14fd197b0b3 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:54.186587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-06000fa6-abe1-485b-8b74-a14fd197b0b3 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:54.195803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06000fa6-abe1-485b-8b74-a14fd197b0b3 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:54.196560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06000fa6-abe1-485b-8b74-a14fd197b0b3 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:54.197554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06000fa6-abe1-485b-8b74-a14fd197b0b3 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:54.198279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-06000fa6-abe1-485b-8b74-a14fd197b0b3 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:54.401643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-06000fa6-abe1-485b-8b74-a14fd197b0b3 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:54.412581 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-06000fa6-abe1-485b-8b74-a14fd197b0b3 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1512 microversion: 2.1 time: 0.234124 Jul 26 15:11:54.413349 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3279/6672] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:54 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:55.437479 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dea5a414-71c5-4a5d-a308-98793265f173 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:55.438978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dea5a414-71c5-4a5d-a308-98793265f173 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:55.447076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dea5a414-71c5-4a5d-a308-98793265f173 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:55.447593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dea5a414-71c5-4a5d-a308-98793265f173 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:55.448488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dea5a414-71c5-4a5d-a308-98793265f173 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:55.448989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dea5a414-71c5-4a5d-a308-98793265f173 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:55.621404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dea5a414-71c5-4a5d-a308-98793265f173 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:55.629858 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dea5a414-71c5-4a5d-a308-98793265f173 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1512 microversion: 2.1 time: 0.196959 Jul 26 15:11:55.630466 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3394/6673] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:55 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:56.199269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d39f778f-7a0e-4739-9125-a0fa379a9b1c req-129bba76-48a6-4bef-b5b8-b8d94c25671d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04d5c8a5-a48c-4baf-ad08-f37bcb48daf7", "name": "network-vif-deleted", "tag": "aac9ec0c-e9f4-4aa6-8e01-7354ba41dc2f"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:56.225840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d39f778f-7a0e-4739-9125-a0fa379a9b1c req-129bba76-48a6-4bef-b5b8-b8d94c25671d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:56.227283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d39f778f-7a0e-4739-9125-a0fa379a9b1c req-129bba76-48a6-4bef-b5b8-b8d94c25671d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:56.256087 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d39f778f-7a0e-4739-9125-a0fa379a9b1c req-129bba76-48a6-4bef-b5b8-b8d94c25671d service nova] Creating event network-vif-deleted:aac9ec0c-e9f4-4aa6-8e01-7354ba41dc2f for instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 on n-h1-833090-9 Jul 26 15:11:56.265777 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d39f778f-7a0e-4739-9125-a0fa379a9b1c req-129bba76-48a6-4bef-b5b8-b8d94c25671d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072492 Jul 26 15:11:56.267422 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3280/6674] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:56.663086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:56.665850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:56.681675 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:56.682356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:56.684309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:56.685433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:56.732095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:56.732749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:56.733556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lazy-loading 'fault' on Instance uuid 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:56.795520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:56.806518 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-31a12479-d6c2-4f83-ad3b-0582a3f7e6d0 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 200 len: 1307 microversion: 2.1 time: 0.150225 Jul 26 15:11:56.807130 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3395/6675] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:56 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:57.839061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-620d6eec-dd11-4d0c-9b99-24cc048b1f71 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:57.840071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-620d6eec-dd11-4d0c-9b99-24cc048b1f71 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:57.847877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-620d6eec-dd11-4d0c-9b99-24cc048b1f71 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:57.848363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-620d6eec-dd11-4d0c-9b99-24cc048b1f71 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:57.849164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-620d6eec-dd11-4d0c-9b99-24cc048b1f71 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:57.849600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-620d6eec-dd11-4d0c-9b99-24cc048b1f71 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:57.865719 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-620d6eec-dd11-4d0c-9b99-24cc048b1f71 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] HTTP exception thrown: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-620d6eec-dd11-4d0c-9b99-24cc048b1f71 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Request method failure captured: Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 HTTP/1.1 Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AQia9bme2IYdr1W8MBKmlBEfCY-oOU5N6Dy3-baJps_st4zM25KfvLYwt3IMhSHwBvP8DTlqX5VGb35Mu9u8ILTRPAtkOT9D-nwummAPUdbeDPogEFv4GnPaF7EYIEg8hCwiACIjH7CWjU9ROFF5dheJkrcYw0g_mNaODXpoY0TjFI Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_22cf4771de084198a68b2c63f1a6f456", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}] Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6fad52c4923341eea9c0f5f0d81d9b1f Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '04d5c8a5-a48c-4baf-ad08-f37bcb48daf7'} Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:57.867423 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:57.873904 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:57.873904 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:57.873904 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:57.873904 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:57.873904 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:57.873904 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:57.873904 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:57.873904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-620d6eec-dd11-4d0c-9b99-24cc048b1f71 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Returning 404 to user: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:57.873904 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-620d6eec-dd11-4d0c-9b99-24cc048b1f71 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 404 len: 111 microversion: 2.1 time: 0.039358 Jul 26 15:11:57.873904 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3281/6676] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:57 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:57.880303 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8f8889a7-d57e-42c5-a070-b509935992c4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:57.881884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8f8889a7-d57e-42c5-a070-b509935992c4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:57.889492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f8889a7-d57e-42c5-a070-b509935992c4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:57.890012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f8889a7-d57e-42c5-a070-b509935992c4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:57.890925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f8889a7-d57e-42c5-a070-b509935992c4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:57.891472 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f8889a7-d57e-42c5-a070-b509935992c4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.066321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8f8889a7-d57e-42c5-a070-b509935992c4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:58.074366 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8f8889a7-d57e-42c5-a070-b509935992c4 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1506 microversion: 2.1 time: 0.199588 Jul 26 15:11:58.074947 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3396/6677] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:57 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:58.097662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c0e5c30-11ea-4159-9a3d-232440e7b6d9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:58.099886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0c0e5c30-11ea-4159-9a3d-232440e7b6d9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: a82bd992-33b9-49d0-93b2-acc4fe074fd8] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:58.106572 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-0c0e5c30-11ea-4159-9a3d-232440e7b6d9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] HTTP exception thrown: Instance a82bd992-33b9-49d0-93b2-acc4fe074fd8 could not be found. Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c0e5c30-11ea-4159-9a3d-232440e7b6d9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Request method failure captured: Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/a82bd992-33b9-49d0-93b2-acc4fe074fd8/action HTTP/1.1 Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 32 Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AQia9bme2IYdr1W8MBKmlBEfCY-oOU5N6Dy3-baJps_st4zM25KfvLYwt3IMhSHwBvP8DTlqX5VGb35Mu9u8ILTRPAtkOT9D-nwummAPUdbeDPogEFv4GnPaF7EYIEg8hCwiACIjH7CWjU9ROFF5dheJkrcYw0g_mNaODXpoY0TjFI Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_22cf4771de084198a68b2c63f1a6f456", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}] Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6fad52c4923341eea9c0f5f0d81d9b1f Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: {"resize": {"flavorRef": "452"}} Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance a82bd992-33b9-49d0-93b2-acc4fe074fd8 could not be found. Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'a82bd992-33b9-49d0-93b2-acc4fe074fd8', 'body': {'resize': {'flavorRef': '452'}}} Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a82bd992-33b9-49d0-93b2-acc4fe074fd8 could not be found. Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:58.108509 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a82bd992-33b9-49d0-93b2-acc4fe074fd8 could not be found. Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a82bd992-33b9-49d0-93b2-acc4fe074fd8 could not be found. Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c0e5c30-11ea-4159-9a3d-232440e7b6d9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Returning 404 to user: Instance a82bd992-33b9-49d0-93b2-acc4fe074fd8 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c0e5c30-11ea-4159-9a3d-232440e7b6d9 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "POST /compute/v2.1/servers/a82bd992-33b9-49d0-93b2-acc4fe074fd8/action" status: 404 len: 111 microversion: 2.1 time: 0.018116 Jul 26 15:11:58.115354 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3282/6678] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:11:58 2022] POST /compute/v2.1/servers/a82bd992-33b9-49d0-93b2-acc4fe074fd8/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:58.123663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3a3962b1-ee25-494e-ac2b-bf5bdb8b5646 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:58.124666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3a3962b1-ee25-494e-ac2b-bf5bdb8b5646 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:58.132851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a3962b1-ee25-494e-ac2b-bf5bdb8b5646 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.133328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a3962b1-ee25-494e-ac2b-bf5bdb8b5646 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.134170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a3962b1-ee25-494e-ac2b-bf5bdb8b5646 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.134641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3a3962b1-ee25-494e-ac2b-bf5bdb8b5646 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.300312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3a3962b1-ee25-494e-ac2b-bf5bdb8b5646 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:58.306703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:58.318625 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3a3962b1-ee25-494e-ac2b-bf5bdb8b5646 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1506 microversion: 2.1 time: 0.201249 Jul 26 15:11:58.319733 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3397/6679] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:58 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:58.342764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-68f2c287-7f18-48b2-8baa-99fbb080d719 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:58.343408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-68f2c287-7f18-48b2-8baa-99fbb080d719 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:58.351007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68f2c287-7f18-48b2-8baa-99fbb080d719 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.351374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68f2c287-7f18-48b2-8baa-99fbb080d719 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.352191 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68f2c287-7f18-48b2-8baa-99fbb080d719 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.352633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-68f2c287-7f18-48b2-8baa-99fbb080d719 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.521836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-68f2c287-7f18-48b2-8baa-99fbb080d719 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:58.529983 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-68f2c287-7f18-48b2-8baa-99fbb080d719 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1506 microversion: 2.1 time: 0.191290 Jul 26 15:11:58.530560 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3283/6680] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:58 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:58.555767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2c0945ff-139f-4fa5-8cb2-f3961761379d"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:58.558842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:58.566879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.567350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.568233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.568690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.615527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:58.622856 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] HTTP exception thrown: Flavor 2c0945ff-139f-4fa5-8cb2-f3961761379d could not be found. Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Request method failure captured: Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: request: POST /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35/action HTTP/1.1 Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 65 Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AQia9bme2IYdr1W8MBKmlBEfCY-oOU5N6Dy3-baJps_st4zM25KfvLYwt3IMhSHwBvP8DTlqX5VGb35Mu9u8ILTRPAtkOT9D-nwummAPUdbeDPogEFv4GnPaF7EYIEg8hCwiACIjH7CWjU9ROFF5dheJkrcYw0g_mNaODXpoY0TjFI Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_22cf4771de084198a68b2c63f1a6f456", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}] Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6fad52c4923341eea9c0f5f0d81d9b1f Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: {"resize": {"flavorRef": "2c0945ff-139f-4fa5-8cb2-f3961761379d"}} Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: exception: Flavor 2c0945ff-139f-4fa5-8cb2-f3961761379d could not be found. Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4dac4711-a28e-4800-aef4-e21a9243dc35', 'body': {'resize': {'flavorRef': '2c0945ff-139f-4fa5-8cb2-f3961761379d'}}} Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 15:11:58.625186 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2c0945ff-139f-4fa5-8cb2-f3961761379d could not be found. Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2c0945ff-139f-4fa5-8cb2-f3961761379d could not be found. Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2c0945ff-139f-4fa5-8cb2-f3961761379d could not be found. Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Returning 400 to user: Flavor 2c0945ff-139f-4fa5-8cb2-f3961761379d could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af4c0d3b-1366-4d54-92a2-ccb8d0674102 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "POST /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35/action" status: 400 len: 107 microversion: 2.1 time: 0.074991 Jul 26 15:11:58.630077 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3398/6681] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:11:58 2022] POST /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35/action => generated 107 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:11:58.639346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ccebd151-a8c1-479c-a788-3f74bdadbb06 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:58.648682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ccebd151-a8c1-479c-a788-3f74bdadbb06 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:58.654612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ccebd151-a8c1-479c-a788-3f74bdadbb06 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.655066 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ccebd151-a8c1-479c-a788-3f74bdadbb06 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.655866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ccebd151-a8c1-479c-a788-3f74bdadbb06 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.656344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ccebd151-a8c1-479c-a788-3f74bdadbb06 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.827313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ccebd151-a8c1-479c-a788-3f74bdadbb06 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:58.839163 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ccebd151-a8c1-479c-a788-3f74bdadbb06 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1506 microversion: 2.1 time: 0.205198 Jul 26 15:11:58.840210 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3284/6682] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:58 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:58.870891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4235b854-c4b1-400a-b7d9-5b55e4e12781 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:58.871983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4235b854-c4b1-400a-b7d9-5b55e4e12781 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:58.881626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4235b854-c4b1-400a-b7d9-5b55e4e12781 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.882439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4235b854-c4b1-400a-b7d9-5b55e4e12781 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:58.883500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4235b854-c4b1-400a-b7d9-5b55e4e12781 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:58.884043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4235b854-c4b1-400a-b7d9-5b55e4e12781 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.050019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4235b854-c4b1-400a-b7d9-5b55e4e12781 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:59.059487 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4235b854-c4b1-400a-b7d9-5b55e4e12781 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1506 microversion: 2.1 time: 0.193995 Jul 26 15:11:59.060112 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3399/6683] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:58 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:59.086523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f62e3f88-efce-43fe-b516-be0372e7016e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f62e3f88-efce-43fe-b516-be0372e7016e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Request method failure captured: Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: request: POST /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35/action HTTP/1.1 Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 29 Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AQia9bme2IYdr1W8MBKmlBEfCY-oOU5N6Dy3-baJps_st4zM25KfvLYwt3IMhSHwBvP8DTlqX5VGb35Mu9u8ILTRPAtkOT9D-nwummAPUdbeDPogEFv4GnPaF7EYIEg8hCwiACIjH7CWjU9ROFF5dheJkrcYw0g_mNaODXpoY0TjFI Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_22cf4771de084198a68b2c63f1a6f456", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}] Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6fad52c4923341eea9c0f5f0d81d9b1f Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: {"resize": {"flavorRef": ""}} Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '4dac4711-a28e-4800-aef4-e21a9243dc35', 'body': {'resize': {'flavorRef': ''}}} Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise error Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi '' Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.090112 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f62e3f88-efce-43fe-b516-be0372e7016e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f62e3f88-efce-43fe-b516-be0372e7016e tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "POST /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35/action" status: 400 len: 113 microversion: 2.1 time: 0.012370 Jul 26 15:11:59.097926 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3285/6684] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:11:59 2022] POST /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35/action => generated 113 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 15:11:59.104427 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0b7e0ad-b0db-4925-9f89-220ce91ea996 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:59.105124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a0b7e0ad-b0db-4925-9f89-220ce91ea996 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:59.115365 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0b7e0ad-b0db-4925-9f89-220ce91ea996 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.116021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0b7e0ad-b0db-4925-9f89-220ce91ea996 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.117123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0b7e0ad-b0db-4925-9f89-220ce91ea996 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.117774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0b7e0ad-b0db-4925-9f89-220ce91ea996 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.294013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0b7e0ad-b0db-4925-9f89-220ce91ea996 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:59.302710 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a0b7e0ad-b0db-4925-9f89-220ce91ea996 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1506 microversion: 2.1 time: 0.202311 Jul 26 15:11:59.303703 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3400/6685] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:59 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:59.328968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-01b3d3f9-2435-4188-9c1e-394fd1c91672 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:59.329509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-01b3d3f9-2435-4188-9c1e-394fd1c91672 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:59.338055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b3d3f9-2435-4188-9c1e-394fd1c91672 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.338506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b3d3f9-2435-4188-9c1e-394fd1c91672 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.339289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b3d3f9-2435-4188-9c1e-394fd1c91672 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.339728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b3d3f9-2435-4188-9c1e-394fd1c91672 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.355567 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-01b3d3f9-2435-4188-9c1e-394fd1c91672 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] HTTP exception thrown: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-01b3d3f9-2435-4188-9c1e-394fd1c91672 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Request method failure captured: Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 HTTP/1.1 Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AQia9bme2IYdr1W8MBKmlBEfCY-oOU5N6Dy3-baJps_st4zM25KfvLYwt3IMhSHwBvP8DTlqX5VGb35Mu9u8ILTRPAtkOT9D-nwummAPUdbeDPogEFv4GnPaF7EYIEg8hCwiACIjH7CWjU9ROFF5dheJkrcYw0g_mNaODXpoY0TjFI Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_22cf4771de084198a68b2c63f1a6f456", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}] Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 6fad52c4923341eea9c0f5f0d81d9b1f Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '04d5c8a5-a48c-4baf-ad08-f37bcb48daf7'} Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:59.357366 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-01b3d3f9-2435-4188-9c1e-394fd1c91672 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Returning 404 to user: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-01b3d3f9-2435-4188-9c1e-394fd1c91672 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "DELETE /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 404 len: 111 microversion: 2.1 time: 0.035383 Jul 26 15:11:59.363885 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3286/6686] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:59 2022] DELETE /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:59.372957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f65b80cf-6c06-4e4e-a1e0-cadd2734eb85 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:59.373589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f65b80cf-6c06-4e4e-a1e0-cadd2734eb85 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:59.382154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f65b80cf-6c06-4e4e-a1e0-cadd2734eb85 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.382651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f65b80cf-6c06-4e4e-a1e0-cadd2734eb85 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.383443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f65b80cf-6c06-4e4e-a1e0-cadd2734eb85 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.383894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f65b80cf-6c06-4e4e-a1e0-cadd2734eb85 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.399256 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-f65b80cf-6c06-4e4e-a1e0-cadd2734eb85 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] HTTP exception thrown: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f65b80cf-6c06-4e4e-a1e0-cadd2734eb85 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Request method failure captured: Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 HTTP/1.1 Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AQia9bme2IYdr1W8MBKmlBEfCY-oOU5N6Dy3-baJps_st4zM25KfvLYwt3IMhSHwBvP8DTlqX5VGb35Mu9u8ILTRPAtkOT9D-nwummAPUdbeDPogEFv4GnPaF7EYIEg8hCwiACIjH7CWjU9ROFF5dheJkrcYw0g_mNaODXpoY0TjFI Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_22cf4771de084198a68b2c63f1a6f456", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}] Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6fad52c4923341eea9c0f5f0d81d9b1f Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '04d5c8a5-a48c-4baf-ad08-f37bcb48daf7'} Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:59.400881 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.409833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:59.409833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:59.409833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:59.409833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:59.409833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:59.409833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. Jul 26 15:11:59.409833 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:11:59.409833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f65b80cf-6c06-4e4e-a1e0-cadd2734eb85 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Returning 404 to user: Instance 04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:59.409833 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f65b80cf-6c06-4e4e-a1e0-cadd2734eb85 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7" status: 404 len: 111 microversion: 2.1 time: 0.034472 Jul 26 15:11:59.409833 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3401/6687] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:59 2022] GET /compute/v2.1/servers/04d5c8a5-a48c-4baf-ad08-f37bcb48daf7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:59.413731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4bf1719c-e713-43ab-b670-8e75fa973eaa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:59.414412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4bf1719c-e713-43ab-b670-8e75fa973eaa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:59.424597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bf1719c-e713-43ab-b670-8e75fa973eaa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.425055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bf1719c-e713-43ab-b670-8e75fa973eaa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.425847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bf1719c-e713-43ab-b670-8e75fa973eaa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.426289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4bf1719c-e713-43ab-b670-8e75fa973eaa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.457960 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4bf1719c-e713-43ab-b670-8e75fa973eaa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:11:59.559734 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4bf1719c-e713-43ab-b670-8e75fa973eaa tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 204 len: 0 microversion: 2.1 time: 0.150478 Jul 26 15:11:59.560609 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3287/6688] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:59 2022] DELETE /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:11:59.574005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3ac88e16-1e5f-42a7-badd-4ace63357741 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:59.575412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3ac88e16-1e5f-42a7-badd-4ace63357741 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:59.586588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ac88e16-1e5f-42a7-badd-4ace63357741 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.587374 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ac88e16-1e5f-42a7-badd-4ace63357741 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.588693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ac88e16-1e5f-42a7-badd-4ace63357741 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:59.589450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3ac88e16-1e5f-42a7-badd-4ace63357741 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:59.803767 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3ac88e16-1e5f-42a7-badd-4ace63357741 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:59.812529 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3ac88e16-1e5f-42a7-badd-4ace63357741 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1512 microversion: 2.1 time: 0.245903 Jul 26 15:11:59.813092 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3402/6689] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:59 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:00.839086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-21382be2-a3c8-46e4-94d9-6698088c73a1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:00.840254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-21382be2-a3c8-46e4-94d9-6698088c73a1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:00.843835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:00.851861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21382be2-a3c8-46e4-94d9-6698088c73a1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:00.852513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21382be2-a3c8-46e4-94d9-6698088c73a1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:00.853497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21382be2-a3c8-46e4-94d9-6698088c73a1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:00.854084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-21382be2-a3c8-46e4-94d9-6698088c73a1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:00.859047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:01.043439 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-21382be2-a3c8-46e4-94d9-6698088c73a1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:01.054364 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-21382be2-a3c8-46e4-94d9-6698088c73a1 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1512 microversion: 2.1 time: 0.220575 Jul 26 15:12:01.055242 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3288/6690] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:00 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:01.947189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ab7d58ec-7aac-4289-ac71-abe52f3b1b2c req-f96edcd2-fd47-44ba-9818-fcf3a1e4ab05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dac4711-a28e-4800-aef4-e21a9243dc35", "name": "network-vif-deleted", "tag": "2c65aca5-7583-4072-b90b-95ca898a55f7"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:01.953687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:01.962329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ab7d58ec-7aac-4289-ac71-abe52f3b1b2c req-f96edcd2-fd47-44ba-9818-fcf3a1e4ab05 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:01.962803 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ab7d58ec-7aac-4289-ac71-abe52f3b1b2c req-f96edcd2-fd47-44ba-9818-fcf3a1e4ab05 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:01.983664 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ab7d58ec-7aac-4289-ac71-abe52f3b1b2c req-f96edcd2-fd47-44ba-9818-fcf3a1e4ab05 service nova] Creating event network-vif-deleted:2c65aca5-7583-4072-b90b-95ca898a55f7 for instance 4dac4711-a28e-4800-aef4-e21a9243dc35 on n-h2-833090-9 Jul 26 15:12:01.990842 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ab7d58ec-7aac-4289-ac71-abe52f3b1b2c req-f96edcd2-fd47-44ba-9818-fcf3a1e4ab05 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047548 Jul 26 15:12:01.991691 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3403/6691] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:02.086578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:02.087385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:02.094952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:02.096296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:02.097911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:02.098910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:02.138372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:02.138718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:02.139470 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lazy-loading 'fault' on Instance uuid 4dac4711-a28e-4800-aef4-e21a9243dc35 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:12:02.191447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fad52c4923341eea9c0f5f0d81d9b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22cf4771de084198a68b2c63f1a6f456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:02.200097 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-19f32232-b4cc-4da9-8261-bbddb27abeeb tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 200 len: 1307 microversion: 2.1 time: 0.117863 Jul 26 15:12:02.200701 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3289/6692] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:02 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 1307 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:03.226164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32485977-e472-4f7c-b810-0384f3bd3f37 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:03.226892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-32485977-e472-4f7c-b810-0384f3bd3f37 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] [instance: 4dac4711-a28e-4800-aef4-e21a9243dc35] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:03.236049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32485977-e472-4f7c-b810-0384f3bd3f37 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:03.236536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32485977-e472-4f7c-b810-0384f3bd3f37 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:03.237350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32485977-e472-4f7c-b810-0384f3bd3f37 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:03.237817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-32485977-e472-4f7c-b810-0384f3bd3f37 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:03.259085 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-32485977-e472-4f7c-b810-0384f3bd3f37 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] HTTP exception thrown: Instance 4dac4711-a28e-4800-aef4-e21a9243dc35 could not be found. Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32485977-e472-4f7c-b810-0384f3bd3f37 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Request method failure captured: Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 HTTP/1.1 Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AQia9bme2IYdr1W8MBKmlBEfCY-oOU5N6Dy3-baJps_st4zM25KfvLYwt3IMhSHwBvP8DTlqX5VGb35Mu9u8ILTRPAtkOT9D-nwummAPUdbeDPogEFv4GnPaF7EYIEg8hCwiACIjH7CWjU9ROFF5dheJkrcYw0g_mNaODXpoY0TjFI Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/22cf4771de084198a68b2c63f1a6f456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_22cf4771de084198a68b2c63f1a6f456", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/22cf4771de084198a68b2c63f1a6f456"}]}] Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 22cf4771de084198a68b2c63f1a6f456 Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1683775264 Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 6fad52c4923341eea9c0f5f0d81d9b1f Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-ServersNegativeTestJSON-1683775264-project Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 4dac4711-a28e-4800-aef4-e21a9243dc35 could not be found. Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '4dac4711-a28e-4800-aef4-e21a9243dc35'} Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dac4711-a28e-4800-aef4-e21a9243dc35 could not be found. Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dac4711-a28e-4800-aef4-e21a9243dc35 could not be found. Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:03.261024 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:12:03.265687 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:03.265687 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:03.265687 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:03.265687 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:12:03.265687 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:12:03.265687 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dac4711-a28e-4800-aef4-e21a9243dc35 could not be found. Jul 26 15:12:03.265687 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:12:03.265687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-32485977-e472-4f7c-b810-0384f3bd3f37 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] Returning 404 to user: Instance 4dac4711-a28e-4800-aef4-e21a9243dc35 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:12:03.265687 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-32485977-e472-4f7c-b810-0384f3bd3f37 tempest-ServersNegativeTestJSON-1683775264 tempest-ServersNegativeTestJSON-1683775264-project] 10.222.0.70 "GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35" status: 404 len: 111 microversion: 2.1 time: 0.042948 Jul 26 15:12:03.265687 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3404/6693] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:03 2022] GET /compute/v2.1/servers/4dac4711-a28e-4800-aef4-e21a9243dc35 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:12:41.853366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=5 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:41.855370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=13 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:42.099174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12de6a4d-4284-4b37-b68f-fee8f44af816 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Action: 'create', calling method: .version_select at 0x7f8786ef6f70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-794950834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNKWurRQKC9HXtO8v/QNfqG/nYR2Iyl+DDETD/ZmZHSipEN0ZTlJHPvBG/3w1qh4Hoz2m+tfzjfgJrqYTC4cv2qvl5OKOJSMBxn3amsgLbMocjUnsfvom8amZcv6Zlkbw=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:42.119758 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-12de6a4d-4284-4b37-b68f-fee8f44af816 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:12:42.130902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-12de6a4d-4284-4b37-b68f-fee8f44af816 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for user fe343b4415e44afa80535d4e4ab42bae and project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:12:42.149904 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [None req-12de6a4d-4284-4b37-b68f-fee8f44af816 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [d2f55996-37e8-4142-99a1-3c8f4d298bbc] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 15:12:43.159740 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [None req-12de6a4d-4284-4b37-b68f-fee8f44af816 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [d2f55996-37e8-4142-99a1-3c8f4d298bbc] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 51162. Jul 26 15:12:43.182920 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-12de6a4d-4284-4b37-b68f-fee8f44af816 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 1.336617 Jul 26 15:12:43.183548 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3290/6694] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:12:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:43.248134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:43.250779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=28 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:43.255804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1183503308", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-794950834", "networks": [{"uuid": "03b7d6b5-0f53-4111-876f-139fe93c9d24"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:43.315034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] validate_networks() for [('03b7d6b5-0f53-4111-876f-139fe93c9d24', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:12:43.812298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:12:43.813631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:12:43.814385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:12:43.814826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:12:43.815269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:12:43.825562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:43.826066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:43.826908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:43.827379 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:43.850258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:12:43.856686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for user fe343b4415e44afa80535d4e4ab42bae and project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:12:43.876985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:12:43.879433 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:12:43.939124 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-84949731-86ce-436a-a18c-436ddd76ac85 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692404 Jul 26 15:12:43.940377 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3405/6695] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:12:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:12:43.951902 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b59d6ecd-8758-4e90-a3c3-fbbd98849126 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:43.952527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b59d6ecd-8758-4e90-a3c3-fbbd98849126 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:44.030244 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b59d6ecd-8758-4e90-a3c3-fbbd98849126 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:44.042767 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b59d6ecd-8758-4e90-a3c3-fbbd98849126 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1262 microversion: 2.1 time: 0.093468 Jul 26 15:12:44.044752 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3291/6696] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:43 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:45.070838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2cf3949b-2917-4b5d-a0a3-2809f2e7e70d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:45.072147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2cf3949b-2917-4b5d-a0a3-2809f2e7e70d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:45.084394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cf3949b-2917-4b5d-a0a3-2809f2e7e70d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:45.085592 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cf3949b-2917-4b5d-a0a3-2809f2e7e70d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:45.087063 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cf3949b-2917-4b5d-a0a3-2809f2e7e70d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:45.087722 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cf3949b-2917-4b5d-a0a3-2809f2e7e70d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:45.198286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2cf3949b-2917-4b5d-a0a3-2809f2e7e70d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:45.214667 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2cf3949b-2917-4b5d-a0a3-2809f2e7e70d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1314 microversion: 2.1 time: 0.151030 Jul 26 15:12:45.228139 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3406/6697] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:45 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:46.243195 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5a8de59a-3c64-4c0d-8ddb-658f28452a48 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:46.243859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5a8de59a-3c64-4c0d-8ddb-658f28452a48 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:46.264755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a8de59a-3c64-4c0d-8ddb-658f28452a48 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:46.265535 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a8de59a-3c64-4c0d-8ddb-658f28452a48 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:46.267083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a8de59a-3c64-4c0d-8ddb-658f28452a48 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:46.268142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a8de59a-3c64-4c0d-8ddb-658f28452a48 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:46.503770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5a8de59a-3c64-4c0d-8ddb-658f28452a48 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:46.514164 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5a8de59a-3c64-4c0d-8ddb-658f28452a48 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1362 microversion: 2.1 time: 0.274825 Jul 26 15:12:46.529029 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3292/6698] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:46 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:47.262358 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f206ff20-32b7-4a91-a8f5-dae0225f5ddb req-4ceb074f-e790-42a5-8b6e-47802e40557f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d", "tag": "c51cdd1e-587b-43e9-a7e3-00e5ca2b8dbb"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:47.289212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f206ff20-32b7-4a91-a8f5-dae0225f5ddb req-4ceb074f-e790-42a5-8b6e-47802e40557f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:47.290002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f206ff20-32b7-4a91-a8f5-dae0225f5ddb req-4ceb074f-e790-42a5-8b6e-47802e40557f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:47.319421 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f206ff20-32b7-4a91-a8f5-dae0225f5ddb req-4ceb074f-e790-42a5-8b6e-47802e40557f service nova] Creating event network-changed:c51cdd1e-587b-43e9-a7e3-00e5ca2b8dbb for instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d on n-h1-833090-9 Jul 26 15:12:47.332217 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f206ff20-32b7-4a91-a8f5-dae0225f5ddb req-4ceb074f-e790-42a5-8b6e-47802e40557f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072615 Jul 26 15:12:47.334040 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3407/6699] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:12:47.537805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6a598896-47db-4522-a1b1-4719707135c2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:47.538430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6a598896-47db-4522-a1b1-4719707135c2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:47.547425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a598896-47db-4522-a1b1-4719707135c2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:47.549519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a598896-47db-4522-a1b1-4719707135c2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:47.551341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a598896-47db-4522-a1b1-4719707135c2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:47.553701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6a598896-47db-4522-a1b1-4719707135c2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:47.724299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6a598896-47db-4522-a1b1-4719707135c2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:47.742933 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6a598896-47db-4522-a1b1-4719707135c2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1362 microversion: 2.1 time: 0.208745 Jul 26 15:12:47.743709 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3293/6700] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:47 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:48.770936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eed7847c-1894-48e0-a8bd-e2962082eb19 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:48.772291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eed7847c-1894-48e0-a8bd-e2962082eb19 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:48.783730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed7847c-1894-48e0-a8bd-e2962082eb19 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:48.784515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed7847c-1894-48e0-a8bd-e2962082eb19 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:48.785625 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed7847c-1894-48e0-a8bd-e2962082eb19 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:48.786346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed7847c-1894-48e0-a8bd-e2962082eb19 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:48.968754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eed7847c-1894-48e0-a8bd-e2962082eb19 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:48.981919 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eed7847c-1894-48e0-a8bd-e2962082eb19 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1362 microversion: 2.1 time: 0.219967 Jul 26 15:12:48.982519 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3408/6701] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:48 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:50.007156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-933f5385-34ac-4396-b4b4-607f5a9eaecf tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:50.007816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-933f5385-34ac-4396-b4b4-607f5a9eaecf tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:50.015061 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-933f5385-34ac-4396-b4b4-607f5a9eaecf tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:50.016285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-933f5385-34ac-4396-b4b4-607f5a9eaecf tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:50.017116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-933f5385-34ac-4396-b4b4-607f5a9eaecf tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:50.017592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-933f5385-34ac-4396-b4b4-607f5a9eaecf tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:50.190589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-933f5385-34ac-4396-b4b4-607f5a9eaecf tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:50.198886 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-933f5385-34ac-4396-b4b4-607f5a9eaecf tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1362 microversion: 2.1 time: 0.195621 Jul 26 15:12:50.200021 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3294/6702] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:50 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:51.223197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bc54b93e-84c9-4772-aa28-2b1b9e7e86f5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:51.224891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bc54b93e-84c9-4772-aa28-2b1b9e7e86f5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:51.235651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc54b93e-84c9-4772-aa28-2b1b9e7e86f5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:51.236153 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc54b93e-84c9-4772-aa28-2b1b9e7e86f5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:51.236953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc54b93e-84c9-4772-aa28-2b1b9e7e86f5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:51.237402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc54b93e-84c9-4772-aa28-2b1b9e7e86f5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:51.417168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bc54b93e-84c9-4772-aa28-2b1b9e7e86f5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:51.426089 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bc54b93e-84c9-4772-aa28-2b1b9e7e86f5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1362 microversion: 2.1 time: 0.208200 Jul 26 15:12:51.426682 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3409/6703] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:51 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:52.399644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-058d447a-abca-4cf3-87b5-8cc824890a21 req-5acbe713-eff9-4a68-80ea-208a4f79b4fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d", "name": "network-vif-plugged", "status": "completed", "tag": "c51cdd1e-587b-43e9-a7e3-00e5ca2b8dbb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:52.413142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-058d447a-abca-4cf3-87b5-8cc824890a21 req-5acbe713-eff9-4a68-80ea-208a4f79b4fb service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:52.413877 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-058d447a-abca-4cf3-87b5-8cc824890a21 req-5acbe713-eff9-4a68-80ea-208a4f79b4fb service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:52.430233 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-058d447a-abca-4cf3-87b5-8cc824890a21 req-5acbe713-eff9-4a68-80ea-208a4f79b4fb service nova] Creating event network-vif-plugged:c51cdd1e-587b-43e9-a7e3-00e5ca2b8dbb for instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d on n-h1-833090-9 Jul 26 15:12:52.436074 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-058d447a-abca-4cf3-87b5-8cc824890a21 req-5acbe713-eff9-4a68-80ea-208a4f79b4fb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125886 Jul 26 15:12:52.436741 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3295/6704] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:12:52.459540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b9956066-ea8e-4192-ac6c-7bd71b67868a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:52.460410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b9956066-ea8e-4192-ac6c-7bd71b67868a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:52.470949 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9956066-ea8e-4192-ac6c-7bd71b67868a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:52.471540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9956066-ea8e-4192-ac6c-7bd71b67868a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:52.472442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9956066-ea8e-4192-ac6c-7bd71b67868a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:52.472910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b9956066-ea8e-4192-ac6c-7bd71b67868a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:52.641870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b9956066-ea8e-4192-ac6c-7bd71b67868a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:52.653609 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b9956066-ea8e-4192-ac6c-7bd71b67868a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1362 microversion: 2.1 time: 0.199228 Jul 26 15:12:52.654502 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3410/6705] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:52 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:53.679547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-505eea24-ab85-453d-acbb-a747384b8759 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:53.680322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-505eea24-ab85-453d-acbb-a747384b8759 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:53.687112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-505eea24-ab85-453d-acbb-a747384b8759 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:53.687575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-505eea24-ab85-453d-acbb-a747384b8759 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:53.688392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-505eea24-ab85-453d-acbb-a747384b8759 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:53.689473 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-505eea24-ab85-453d-acbb-a747384b8759 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:53.869085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-505eea24-ab85-453d-acbb-a747384b8759 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:53.877549 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-505eea24-ab85-453d-acbb-a747384b8759 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1362 microversion: 2.1 time: 0.202618 Jul 26 15:12:53.877767 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3296/6706] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:53 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:54.898886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ad16045e-78b4-408b-9140-693386f6eacd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:54.899519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ad16045e-78b4-408b-9140-693386f6eacd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:54.902548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:54.903243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:54.909961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad16045e-78b4-408b-9140-693386f6eacd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:54.910436 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad16045e-78b4-408b-9140-693386f6eacd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:54.911248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad16045e-78b4-408b-9140-693386f6eacd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:54.911709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ad16045e-78b4-408b-9140-693386f6eacd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:55.080361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ad16045e-78b4-408b-9140-693386f6eacd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:55.089753 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ad16045e-78b4-408b-9140-693386f6eacd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1554 microversion: 2.1 time: 0.194421 Jul 26 15:12:55.090737 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3411/6707] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:54 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:55.120802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7bd754a4-5192-4b3c-956b-ec2bdcdf5297 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:55.121418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7bd754a4-5192-4b3c-956b-ec2bdcdf5297 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:55.123512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:55.131209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bd754a4-5192-4b3c-956b-ec2bdcdf5297 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:55.131760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bd754a4-5192-4b3c-956b-ec2bdcdf5297 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:55.132706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bd754a4-5192-4b3c-956b-ec2bdcdf5297 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:55.133152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7bd754a4-5192-4b3c-956b-ec2bdcdf5297 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:55.301296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7bd754a4-5192-4b3c-956b-ec2bdcdf5297 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:55.310587 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7bd754a4-5192-4b3c-956b-ec2bdcdf5297 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1554 microversion: 2.1 time: 0.193886 Jul 26 15:12:55.311488 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3297/6708] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:55 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:12:57.033717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a7d7365c-951b-4620-afbd-80a2e41dbffc tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4386283-6a7f-4474-a045-f55b10770175"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:57.036228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a7d7365c-951b-4620-afbd-80a2e41dbffc tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:57.044354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7d7365c-951b-4620-afbd-80a2e41dbffc tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:57.044832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7d7365c-951b-4620-afbd-80a2e41dbffc tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:57.045717 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7d7365c-951b-4620-afbd-80a2e41dbffc tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:57.046353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a7d7365c-951b-4620-afbd-80a2e41dbffc tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:57.363465 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a7d7365c-951b-4620-afbd-80a2e41dbffc tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "POST /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334576 Jul 26 15:12:57.364695 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3412/6709] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 15:12:57 2022] POST /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:09.300217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a029e8c4-88c2-4380-b5ae-374643f9c675 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:09.300820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a029e8c4-88c2-4380-b5ae-374643f9c675 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:09.304083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:09.304807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=32 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:09.311388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a029e8c4-88c2-4380-b5ae-374643f9c675 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:09.311844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a029e8c4-88c2-4380-b5ae-374643f9c675 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:09.312669 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a029e8c4-88c2-4380-b5ae-374643f9c675 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:09.313176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a029e8c4-88c2-4380-b5ae-374643f9c675 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:09.407279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-a029e8c4-88c2-4380-b5ae-374643f9c675 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lazy-loading 'services' on Instance uuid 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:13:09.505367 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a029e8c4-88c2-4380-b5ae-374643f9c675 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments/c4386283-6a7f-4474-a045-f55b10770175" status: 202 len: 0 microversion: 2.1 time: 0.215712 Jul 26 15:13:09.506013 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3298/6710] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 15:13:09 2022] DELETE /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments/c4386283-6a7f-4474-a045-f55b10770175 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:13:09.512972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:09.514465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:09.519988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-49f8b849-a0de-4128-b59c-00f7952a573c tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:09.522612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-49f8b849-a0de-4128-b59c-00f7952a573c tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:09.532086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49f8b849-a0de-4128-b59c-00f7952a573c tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:09.532086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49f8b849-a0de-4128-b59c-00f7952a573c tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:09.533229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49f8b849-a0de-4128-b59c-00f7952a573c tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:09.533807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-49f8b849-a0de-4128-b59c-00f7952a573c tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:09.572732 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-49f8b849-a0de-4128-b59c-00f7952a573c tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061633 Jul 26 15:13:09.573384 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3413/6711] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:09 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:10.586680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-086571e2-56c4-4c06-bb4a-91e02b29cac7 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:10.589301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-086571e2-56c4-4c06-bb4a-91e02b29cac7 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:10.597913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086571e2-56c4-4c06-bb4a-91e02b29cac7 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:10.598370 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086571e2-56c4-4c06-bb4a-91e02b29cac7 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:10.599155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086571e2-56c4-4c06-bb4a-91e02b29cac7 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:10.599591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-086571e2-56c4-4c06-bb4a-91e02b29cac7 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:10.631858 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-086571e2-56c4-4c06-bb4a-91e02b29cac7 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049368 Jul 26 15:13:10.632343 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3299/6712] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:10 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:11.645459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-73d7ec17-1be5-4b6f-9b1a-38942a89c990 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:11.647862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-73d7ec17-1be5-4b6f-9b1a-38942a89c990 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:11.655313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73d7ec17-1be5-4b6f-9b1a-38942a89c990 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:11.655866 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73d7ec17-1be5-4b6f-9b1a-38942a89c990 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:11.657030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73d7ec17-1be5-4b6f-9b1a-38942a89c990 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:11.657501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-73d7ec17-1be5-4b6f-9b1a-38942a89c990 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:11.692690 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-73d7ec17-1be5-4b6f-9b1a-38942a89c990 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051460 Jul 26 15:13:11.693201 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3414/6713] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:11 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:12.706271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-835ab6d9-ddbc-4334-b41d-3117bd3c762f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:12.708625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-835ab6d9-ddbc-4334-b41d-3117bd3c762f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:12.717493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-835ab6d9-ddbc-4334-b41d-3117bd3c762f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:12.717493 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-835ab6d9-ddbc-4334-b41d-3117bd3c762f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:12.718359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-835ab6d9-ddbc-4334-b41d-3117bd3c762f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:12.718806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-835ab6d9-ddbc-4334-b41d-3117bd3c762f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:12.765285 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-835ab6d9-ddbc-4334-b41d-3117bd3c762f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064016 Jul 26 15:13:12.765959 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3300/6714] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:12 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:13.778512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af0e0f8c-eb42-447c-8f55-646f37757192 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:13.780663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-af0e0f8c-eb42-447c-8f55-646f37757192 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:13.790539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af0e0f8c-eb42-447c-8f55-646f37757192 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:13.791040 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af0e0f8c-eb42-447c-8f55-646f37757192 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:13.796039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af0e0f8c-eb42-447c-8f55-646f37757192 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:13.796039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-af0e0f8c-eb42-447c-8f55-646f37757192 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:13.827500 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af0e0f8c-eb42-447c-8f55-646f37757192 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053163 Jul 26 15:13:13.828095 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3415/6715] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:13 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:14.840698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-16a19c1f-832a-4003-a165-8a92914288cb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:14.842886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-16a19c1f-832a-4003-a165-8a92914288cb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:14.850381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16a19c1f-832a-4003-a165-8a92914288cb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:14.850830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16a19c1f-832a-4003-a165-8a92914288cb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:14.851604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16a19c1f-832a-4003-a165-8a92914288cb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:14.852072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16a19c1f-832a-4003-a165-8a92914288cb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:14.885859 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-16a19c1f-832a-4003-a165-8a92914288cb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049144 Jul 26 15:13:14.886451 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3301/6716] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:14 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:13:14.897729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83907247-8ea0-4141-bbf5-167407a1dc27 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:14.898268 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-83907247-8ea0-4141-bbf5-167407a1dc27 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:14.905442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83907247-8ea0-4141-bbf5-167407a1dc27 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:14.905906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83907247-8ea0-4141-bbf5-167407a1dc27 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:14.907201 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83907247-8ea0-4141-bbf5-167407a1dc27 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:14.907661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83907247-8ea0-4141-bbf5-167407a1dc27 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:14.986792 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-83907247-8ea0-4141-bbf5-167407a1dc27 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] HTTP exception thrown: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d is not attached to volume c4386283-6a7f-4474-a045-f55b10770175 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83907247-8ea0-4141-bbf5-167407a1dc27 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Request method failure captured: Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments/c4386283-6a7f-4474-a045-f55b10770175 HTTP/1.1 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4ARi5FHTfNl_G-XX8ZgBMBrOnjYSRuvA0mAkdkubOX2Rcfw3p7n2vKsOrpr-J_-fHyAav32rqeMyZhlCnTuKJ_itJJKM2GqMfd3HVleZ1XLK7cIzDZJ_i2_wah9EJ4mLzaUyGM0ypRmn2tS4c5cO2vF0gRCom4V_DIqmSrCaVP8gXJ8 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_84f1ab925e244d8fbf573a2dd7f674c8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}] Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: fe343b4415e44afa80535d4e4ab42bae Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d is not attached to volume c4386283-6a7f-4474-a045-f55b10770175 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'server_id': '06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d', 'id': 'c4386283-6a7f-4474-a045-f55b10770175'} Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c4386283-6a7f-4474-a045-f55b10770175. Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d is not attached to volume c4386283-6a7f-4474-a045-f55b10770175 Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:14.992839 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:14.997005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:14.997005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:14.997005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d is not attached to volume c4386283-6a7f-4474-a045-f55b10770175 Jul 26 15:13:14.997005 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:14.997005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83907247-8ea0-4141-bbf5-167407a1dc27 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Returning 404 to user: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d is not attached to volume c4386283-6a7f-4474-a045-f55b10770175 {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:14.997005 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-83907247-8ea0-4141-bbf5-167407a1dc27 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments/c4386283-6a7f-4474-a045-f55b10770175" status: 404 len: 154 microversion: 2.1 time: 0.100683 Jul 26 15:13:14.997005 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3416/6717] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 15:13:14 2022] DELETE /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d/os-volume_attachments/c4386283-6a7f-4474-a045-f55b10770175 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:18.367410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d610850c-81b1-466e-bce3-57e40bb10efa tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:18.367927 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d610850c-81b1-466e-bce3-57e40bb10efa tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:18.375323 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d610850c-81b1-466e-bce3-57e40bb10efa tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:18.375778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d610850c-81b1-466e-bce3-57e40bb10efa tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:18.376786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d610850c-81b1-466e-bce3-57e40bb10efa tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:18.377226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d610850c-81b1-466e-bce3-57e40bb10efa tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:18.403822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d610850c-81b1-466e-bce3-57e40bb10efa tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:13:18.494654 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d610850c-81b1-466e-bce3-57e40bb10efa tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 204 len: 0 microversion: 2.1 time: 0.130653 Jul 26 15:13:18.495715 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3302/6718] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:13:18 2022] DELETE /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:13:18.506284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d450ec37-6564-4e78-8f39-2d4ccc74e3dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:18.506948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d450ec37-6564-4e78-8f39-2d4ccc74e3dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:18.514920 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d450ec37-6564-4e78-8f39-2d4ccc74e3dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:18.521281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d450ec37-6564-4e78-8f39-2d4ccc74e3dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:18.521281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d450ec37-6564-4e78-8f39-2d4ccc74e3dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:18.521281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d450ec37-6564-4e78-8f39-2d4ccc74e3dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:18.669037 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d450ec37-6564-4e78-8f39-2d4ccc74e3dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:18.677196 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d450ec37-6564-4e78-8f39-2d4ccc74e3dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1560 microversion: 2.1 time: 0.177179 Jul 26 15:13:18.677770 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3417/6719] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:18 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:19.700012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-90be7245-d171-41d7-a62c-5ecedaaf389b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:19.700613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-90be7245-d171-41d7-a62c-5ecedaaf389b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:19.708287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90be7245-d171-41d7-a62c-5ecedaaf389b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:19.708739 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90be7245-d171-41d7-a62c-5ecedaaf389b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:19.709681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90be7245-d171-41d7-a62c-5ecedaaf389b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:19.710121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-90be7245-d171-41d7-a62c-5ecedaaf389b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:19.849645 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-90be7245-d171-41d7-a62c-5ecedaaf389b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:19.857433 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-90be7245-d171-41d7-a62c-5ecedaaf389b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1560 microversion: 2.1 time: 0.161891 Jul 26 15:13:19.857999 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3303/6720] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:19 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:20.879146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ed120ee-90b3-4832-b9a3-0954518569ce tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:20.879802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ed120ee-90b3-4832-b9a3-0954518569ce tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:20.887424 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ed120ee-90b3-4832-b9a3-0954518569ce tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:20.887903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ed120ee-90b3-4832-b9a3-0954518569ce tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:20.888757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ed120ee-90b3-4832-b9a3-0954518569ce tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:20.889221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ed120ee-90b3-4832-b9a3-0954518569ce tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:21.035145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7ed120ee-90b3-4832-b9a3-0954518569ce tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:21.043200 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ed120ee-90b3-4832-b9a3-0954518569ce tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 200 len: 1560 microversion: 2.1 time: 0.168068 Jul 26 15:13:21.043832 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3418/6721] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:20 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:21.237495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-6822a2b7-c6da-4da6-a59d-1a55ea38d0aa req-60c49ea5-a7c7-4dfc-9097-85d91cfbb52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d", "name": "network-vif-deleted", "tag": "c51cdd1e-587b-43e9-a7e3-00e5ca2b8dbb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:21.251879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6822a2b7-c6da-4da6-a59d-1a55ea38d0aa req-60c49ea5-a7c7-4dfc-9097-85d91cfbb52b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:21.252380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-6822a2b7-c6da-4da6-a59d-1a55ea38d0aa req-60c49ea5-a7c7-4dfc-9097-85d91cfbb52b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:21.265230 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-6822a2b7-c6da-4da6-a59d-1a55ea38d0aa req-60c49ea5-a7c7-4dfc-9097-85d91cfbb52b service nova] Creating event network-vif-deleted:c51cdd1e-587b-43e9-a7e3-00e5ca2b8dbb for instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d on n-h1-833090-9 Jul 26 15:13:21.272238 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-6822a2b7-c6da-4da6-a59d-1a55ea38d0aa req-60c49ea5-a7c7-4dfc-9097-85d91cfbb52b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039134 Jul 26 15:13:21.273302 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3304/6722] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:22.065453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92e86974-c20f-4ebf-8d54-53f63cec3d30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:22.066090 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-92e86974-c20f-4ebf-8d54-53f63cec3d30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:22.073264 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92e86974-c20f-4ebf-8d54-53f63cec3d30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:22.073738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92e86974-c20f-4ebf-8d54-53f63cec3d30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:22.074639 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92e86974-c20f-4ebf-8d54-53f63cec3d30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:22.075013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92e86974-c20f-4ebf-8d54-53f63cec3d30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:22.088543 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-92e86974-c20f-4ebf-8d54-53f63cec3d30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] HTTP exception thrown: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d could not be found. Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92e86974-c20f-4ebf-8d54-53f63cec3d30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Request method failure captured: Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d HTTP/1.1 Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4ARi5FHTfNl_G-XX8ZgBMBrOnjYSRuvA0mAkdkubOX2Rcfw3p7n2vKsOrpr-J_-fHyAav32rqeMyZhlCnTuKJ_itJJKM2GqMfd3HVleZ1XLK7cIzDZJ_i2_wah9EJ4mLzaUyGM0ypRmn2tS4c5cO2vF0gRCom4V_DIqmSrCaVP8gXJ8 Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_84f1ab925e244d8fbf573a2dd7f674c8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}] Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: fe343b4415e44afa80535d4e4ab42bae Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d could not be found. Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d'} Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d could not be found. Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d could not be found. Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:22.090115 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:22.094199 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:22.094199 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:22.094199 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:22.094199 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:22.094199 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:22.094199 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d could not be found. Jul 26 15:13:22.094199 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:22.094199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92e86974-c20f-4ebf-8d54-53f63cec3d30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Returning 404 to user: Instance 06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:22.094199 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-92e86974-c20f-4ebf-8d54-53f63cec3d30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d" status: 404 len: 111 microversion: 2.1 time: 0.031038 Jul 26 15:13:22.094199 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3419/6723] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:22 2022] GET /compute/v2.1/servers/06c9c9f9-94e6-4c25-b4eb-9231d7ce3d6d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:22.101798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7b966d77-b1ec-461f-b6d0-00e6712e42ad tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '.version_select at 0x7f87879bf550>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:22.126009 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7b966d77-b1ec-461f-b6d0-00e6712e42ad tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-794950834" status: 202 len: 0 microversion: 2.1 time: 0.027556 Jul 26 15:13:22.126951 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3305/6724] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 15:13:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-794950834 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:13:22.146234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ecec074b-0182-47f2-a4c3-6cad85b17a30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Action: 'create', calling method: .version_select at 0x7f8786db2ee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1862791346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAz+C+n+I0LPOOwTscURKsinp4rHH1oewWqwD7I3F/nfDUDTyB/O1p6CwXQVcb6oWfrjlucmRaeruza7NFYY32l+fDn1beqW9o+oTSV9++Lmv7MdpyUvC1iaYoXZtf7hw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:22.162010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ecec074b-0182-47f2-a4c3-6cad85b17a30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:13:22.167238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ecec074b-0182-47f2-a4c3-6cad85b17a30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for user fe343b4415e44afa80535d4e4ab42bae and project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:13:22.193346 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ecec074b-0182-47f2-a4c3-6cad85b17a30 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050972 Jul 26 15:13:22.193943 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3420/6725] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:13:22 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:22.258303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-798181206", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1862791346", "networks": [{"uuid": "03b7d6b5-0f53-4111-876f-139fe93c9d24"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:22.323249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] validate_networks() for [('03b7d6b5-0f53-4111-876f-139fe93c9d24', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:13:22.859981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:13:22.860402 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:13:22.860872 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:13:22.861285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:13:22.861731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:13:22.871672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:22.872206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:22.873000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:22.873436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:22.895907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:13:22.901756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for user fe343b4415e44afa80535d4e4ab42bae and project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:13:22.916271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:13:22.919199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:13:22.973909 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-093adcca-60e7-4cc6-8560-af7bc8be43f2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720530 Jul 26 15:13:22.974561 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3306/6726] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:13:22.985860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6180563e-27d3-49af-bcd2-5ae216d45ea4 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:22.986618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6180563e-27d3-49af-bcd2-5ae216d45ea4 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:23.041769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6180563e-27d3-49af-bcd2-5ae216d45ea4 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:23.049284 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6180563e-27d3-49af-bcd2-5ae216d45ea4 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1262 microversion: 2.1 time: 0.067563 Jul 26 15:13:23.050165 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3421/6727] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:22 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:24.072650 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b5af997b-3f4b-4b55-86f2-3ff0cf08aad0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:24.073182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b5af997b-3f4b-4b55-86f2-3ff0cf08aad0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:24.080842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5af997b-3f4b-4b55-86f2-3ff0cf08aad0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:24.081298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5af997b-3f4b-4b55-86f2-3ff0cf08aad0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:24.082071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5af997b-3f4b-4b55-86f2-3ff0cf08aad0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:24.082687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5af997b-3f4b-4b55-86f2-3ff0cf08aad0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:24.172687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b5af997b-3f4b-4b55-86f2-3ff0cf08aad0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:24.188271 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b5af997b-3f4b-4b55-86f2-3ff0cf08aad0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1322 microversion: 2.1 time: 0.120312 Jul 26 15:13:24.190139 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3307/6728] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:24 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1322 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:25.212165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b1509544-31fc-4f91-ac72-1f614b82e0b3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:25.213015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b1509544-31fc-4f91-ac72-1f614b82e0b3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:25.220527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1509544-31fc-4f91-ac72-1f614b82e0b3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:25.221003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1509544-31fc-4f91-ac72-1f614b82e0b3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:25.221809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1509544-31fc-4f91-ac72-1f614b82e0b3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:25.222272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b1509544-31fc-4f91-ac72-1f614b82e0b3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:25.471117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b1509544-31fc-4f91-ac72-1f614b82e0b3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:25.479320 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b1509544-31fc-4f91-ac72-1f614b82e0b3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1362 microversion: 2.1 time: 0.271285 Jul 26 15:13:25.480105 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3422/6729] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:25 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:25.702750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-664c573d-dff1-4320-855e-1638b2e07d00 req-fb53ac21-b207-4f0e-b9f5-e4bcc443f334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93da2c3-aefe-4cd1-80db-a5996c3166ce", "tag": "83a67fdb-ca52-4830-8a2a-bf01657386cb"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:25.713680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-664c573d-dff1-4320-855e-1638b2e07d00 req-fb53ac21-b207-4f0e-b9f5-e4bcc443f334 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:25.714126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-664c573d-dff1-4320-855e-1638b2e07d00 req-fb53ac21-b207-4f0e-b9f5-e4bcc443f334 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:25.735428 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-664c573d-dff1-4320-855e-1638b2e07d00 req-fb53ac21-b207-4f0e-b9f5-e4bcc443f334 service nova] Creating event network-changed:83a67fdb-ca52-4830-8a2a-bf01657386cb for instance d93da2c3-aefe-4cd1-80db-a5996c3166ce on n-h2-833090-9 Jul 26 15:13:25.740976 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-664c573d-dff1-4320-855e-1638b2e07d00 req-fb53ac21-b207-4f0e-b9f5-e4bcc443f334 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116348 Jul 26 15:13:25.740976 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3308/6730] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:26.502282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-468de55e-3545-475f-8093-66b5ea294081 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:26.502917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-468de55e-3545-475f-8093-66b5ea294081 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:26.510154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-468de55e-3545-475f-8093-66b5ea294081 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:26.510629 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-468de55e-3545-475f-8093-66b5ea294081 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:26.511441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-468de55e-3545-475f-8093-66b5ea294081 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:26.511898 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-468de55e-3545-475f-8093-66b5ea294081 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:26.656072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-468de55e-3545-475f-8093-66b5ea294081 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:26.664888 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-468de55e-3545-475f-8093-66b5ea294081 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1362 microversion: 2.1 time: 0.167010 Jul 26 15:13:26.665554 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3423/6731] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:26 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:27.687350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4c13a5c3-9337-4861-9282-860bcfa5f57d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:27.688075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4c13a5c3-9337-4861-9282-860bcfa5f57d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:27.695363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c13a5c3-9337-4861-9282-860bcfa5f57d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:27.696098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c13a5c3-9337-4861-9282-860bcfa5f57d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:27.696884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c13a5c3-9337-4861-9282-860bcfa5f57d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:27.697322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4c13a5c3-9337-4861-9282-860bcfa5f57d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:27.832507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4c13a5c3-9337-4861-9282-860bcfa5f57d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:27.840823 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4c13a5c3-9337-4861-9282-860bcfa5f57d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1362 microversion: 2.1 time: 0.157668 Jul 26 15:13:27.842028 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3309/6732] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:27 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:28.865525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-29269638-5ae3-437e-890d-7c3f01545581 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:28.866294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-29269638-5ae3-437e-890d-7c3f01545581 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:28.873819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29269638-5ae3-437e-890d-7c3f01545581 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:28.874295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29269638-5ae3-437e-890d-7c3f01545581 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:28.876431 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29269638-5ae3-437e-890d-7c3f01545581 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:28.876739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-29269638-5ae3-437e-890d-7c3f01545581 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:29.034884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-29269638-5ae3-437e-890d-7c3f01545581 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:29.043184 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-29269638-5ae3-437e-890d-7c3f01545581 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1362 microversion: 2.1 time: 0.181328 Jul 26 15:13:29.043765 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3424/6733] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:28 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:30.066738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cb779cca-aaa6-444d-a657-b1671996b64f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:30.067428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cb779cca-aaa6-444d-a657-b1671996b64f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:30.074384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb779cca-aaa6-444d-a657-b1671996b64f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:30.074831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb779cca-aaa6-444d-a657-b1671996b64f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:30.075591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb779cca-aaa6-444d-a657-b1671996b64f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:30.076055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb779cca-aaa6-444d-a657-b1671996b64f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:30.224687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb779cca-aaa6-444d-a657-b1671996b64f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:30.233646 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cb779cca-aaa6-444d-a657-b1671996b64f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1362 microversion: 2.1 time: 0.171250 Jul 26 15:13:30.235112 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3310/6734] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:30 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:13:30.550554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-719086a9-c5cb-40a7-81ad-f6368a753d88 req-3c47eb58-d6c9-47c8-b9e6-da87591c81da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93da2c3-aefe-4cd1-80db-a5996c3166ce", "name": "network-vif-plugged", "status": "completed", "tag": "83a67fdb-ca52-4830-8a2a-bf01657386cb"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:30.562484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-719086a9-c5cb-40a7-81ad-f6368a753d88 req-3c47eb58-d6c9-47c8-b9e6-da87591c81da service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:30.562959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-719086a9-c5cb-40a7-81ad-f6368a753d88 req-3c47eb58-d6c9-47c8-b9e6-da87591c81da service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:30.578393 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-719086a9-c5cb-40a7-81ad-f6368a753d88 req-3c47eb58-d6c9-47c8-b9e6-da87591c81da service nova] Creating event network-vif-plugged:83a67fdb-ca52-4830-8a2a-bf01657386cb for instance d93da2c3-aefe-4cd1-80db-a5996c3166ce on n-h2-833090-9 Jul 26 15:13:30.583970 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-719086a9-c5cb-40a7-81ad-f6368a753d88 req-3c47eb58-d6c9-47c8-b9e6-da87591c81da service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037796 Jul 26 15:13:30.584815 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3425/6735] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:13:31.255913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5b98830d-7915-4626-87eb-ddd6b96e5c02 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:31.256550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b98830d-7915-4626-87eb-ddd6b96e5c02 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:31.263863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b98830d-7915-4626-87eb-ddd6b96e5c02 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:31.264347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b98830d-7915-4626-87eb-ddd6b96e5c02 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:31.265146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b98830d-7915-4626-87eb-ddd6b96e5c02 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:31.265585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b98830d-7915-4626-87eb-ddd6b96e5c02 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:31.411836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5b98830d-7915-4626-87eb-ddd6b96e5c02 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:31.420225 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5b98830d-7915-4626-87eb-ddd6b96e5c02 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1362 microversion: 2.1 time: 0.168462 Jul 26 15:13:31.420815 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3311/6736] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:31 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:32.443720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0e71b45a-bdab-4005-bb81-24cb436e2925 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:32.444469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0e71b45a-bdab-4005-bb81-24cb436e2925 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:32.451128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0e71b45a-bdab-4005-bb81-24cb436e2925 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:32.451593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0e71b45a-bdab-4005-bb81-24cb436e2925 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:32.452439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0e71b45a-bdab-4005-bb81-24cb436e2925 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:32.453327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0e71b45a-bdab-4005-bb81-24cb436e2925 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:32.592954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0e71b45a-bdab-4005-bb81-24cb436e2925 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:32.600611 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0e71b45a-bdab-4005-bb81-24cb436e2925 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1554 microversion: 2.1 time: 0.162235 Jul 26 15:13:32.601179 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3426/6737] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:32 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:32.625777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0180a309-a3d6-4f5b-8534-2c3fbb2c7c16 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:32.626566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0180a309-a3d6-4f5b-8534-2c3fbb2c7c16 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:32.634718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0180a309-a3d6-4f5b-8534-2c3fbb2c7c16 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:32.635321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0180a309-a3d6-4f5b-8534-2c3fbb2c7c16 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:32.635998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0180a309-a3d6-4f5b-8534-2c3fbb2c7c16 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:32.636491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0180a309-a3d6-4f5b-8534-2c3fbb2c7c16 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:32.884288 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:32.910800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:33.071047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0180a309-a3d6-4f5b-8534-2c3fbb2c7c16 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:33.080418 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0180a309-a3d6-4f5b-8534-2c3fbb2c7c16 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1554 microversion: 2.1 time: 0.460587 Jul 26 15:13:33.081016 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3312/6738] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:32 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1554 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:34.603501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-edbdabac-515a-499f-8abf-ecee0c3b8aba tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70083a30-22c4-403f-a4d5-80bf90732330"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:34.605946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-edbdabac-515a-499f-8abf-ecee0c3b8aba tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:34.607939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:34.615523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-edbdabac-515a-499f-8abf-ecee0c3b8aba tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:34.616012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-edbdabac-515a-499f-8abf-ecee0c3b8aba tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:34.616804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-edbdabac-515a-499f-8abf-ecee0c3b8aba tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:34.617253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-edbdabac-515a-499f-8abf-ecee0c3b8aba tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:34.867613 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-edbdabac-515a-499f-8abf-ecee0c3b8aba tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "POST /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268203 Jul 26 15:13:34.868253 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3427/6739] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 15:13:34 2022] POST /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:46.701505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5b02f3ee-2b66-4d69-9cd4-4c2104a9cede tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:46.702209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b02f3ee-2b66-4d69-9cd4-4c2104a9cede tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:46.704375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:46.705155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:46.710850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b02f3ee-2b66-4d69-9cd4-4c2104a9cede tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:46.711305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b02f3ee-2b66-4d69-9cd4-4c2104a9cede tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:46.712436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b02f3ee-2b66-4d69-9cd4-4c2104a9cede tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:46.713083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b02f3ee-2b66-4d69-9cd4-4c2104a9cede tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:46.803534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-5b02f3ee-2b66-4d69-9cd4-4c2104a9cede tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lazy-loading 'services' on Instance uuid d93da2c3-aefe-4cd1-80db-a5996c3166ce {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:13:46.881070 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5b02f3ee-2b66-4d69-9cd4-4c2104a9cede tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments/70083a30-22c4-403f-a4d5-80bf90732330" status: 202 len: 0 microversion: 2.1 time: 0.185388 Jul 26 15:13:46.881658 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3313/6740] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 15:13:46 2022] DELETE /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments/70083a30-22c4-403f-a4d5-80bf90732330 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:13:46.889849 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:46.890907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:13:46.895518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2905d574-6ba8-4704-9211-82b126775456 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:46.898556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2905d574-6ba8-4704-9211-82b126775456 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:46.906852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2905d574-6ba8-4704-9211-82b126775456 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:46.907399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2905d574-6ba8-4704-9211-82b126775456 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:46.908423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2905d574-6ba8-4704-9211-82b126775456 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:46.908885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2905d574-6ba8-4704-9211-82b126775456 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:46.949798 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2905d574-6ba8-4704-9211-82b126775456 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062793 Jul 26 15:13:46.950392 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3428/6741] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:46 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:47.963557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d9e0a8e-5783-4ad3-9d2f-fe3fe4ad0f07 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:47.966227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d9e0a8e-5783-4ad3-9d2f-fe3fe4ad0f07 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:47.972784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d9e0a8e-5783-4ad3-9d2f-fe3fe4ad0f07 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:47.973231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d9e0a8e-5783-4ad3-9d2f-fe3fe4ad0f07 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:47.974000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d9e0a8e-5783-4ad3-9d2f-fe3fe4ad0f07 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:47.974435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d9e0a8e-5783-4ad3-9d2f-fe3fe4ad0f07 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:48.005632 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d9e0a8e-5783-4ad3-9d2f-fe3fe4ad0f07 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047255 Jul 26 15:13:48.006562 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3314/6742] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:47 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:49.018681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d1c1ff36-5e13-410c-bdf0-e29ed939abb6 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:49.021027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d1c1ff36-5e13-410c-bdf0-e29ed939abb6 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:49.030006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1c1ff36-5e13-410c-bdf0-e29ed939abb6 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:49.030686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1c1ff36-5e13-410c-bdf0-e29ed939abb6 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:49.031751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1c1ff36-5e13-410c-bdf0-e29ed939abb6 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:49.032324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1c1ff36-5e13-410c-bdf0-e29ed939abb6 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:49.079516 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d1c1ff36-5e13-410c-bdf0-e29ed939abb6 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064778 Jul 26 15:13:49.081774 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3429/6743] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:49 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:50.093209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5e687b77-494a-405c-9430-9a4e92c24849 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:50.095476 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5e687b77-494a-405c-9430-9a4e92c24849 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:50.102318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e687b77-494a-405c-9430-9a4e92c24849 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:50.102778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e687b77-494a-405c-9430-9a4e92c24849 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:50.103569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e687b77-494a-405c-9430-9a4e92c24849 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:50.104044 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5e687b77-494a-405c-9430-9a4e92c24849 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:50.142077 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5e687b77-494a-405c-9430-9a4e92c24849 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053333 Jul 26 15:13:50.142671 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3315/6744] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:50 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:51.165732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3462d2d0-f5f5-4259-9540-c840adc683be tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:51.175279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3462d2d0-f5f5-4259-9540-c840adc683be tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:51.183215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3462d2d0-f5f5-4259-9540-c840adc683be tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:51.183883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3462d2d0-f5f5-4259-9540-c840adc683be tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:51.184800 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3462d2d0-f5f5-4259-9540-c840adc683be tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:51.185336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3462d2d0-f5f5-4259-9540-c840adc683be tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:51.221203 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3462d2d0-f5f5-4259-9540-c840adc683be tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068822 Jul 26 15:13:51.222312 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3430/6745] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:51 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:52.238859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55c802ce-d500-4cb9-8a64-58c11cc0baef tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:52.241609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-55c802ce-d500-4cb9-8a64-58c11cc0baef tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:52.249517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c802ce-d500-4cb9-8a64-58c11cc0baef tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:52.249966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c802ce-d500-4cb9-8a64-58c11cc0baef tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:52.250784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c802ce-d500-4cb9-8a64-58c11cc0baef tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:52.251383 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-55c802ce-d500-4cb9-8a64-58c11cc0baef tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:52.286736 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-55c802ce-d500-4cb9-8a64-58c11cc0baef tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055175 Jul 26 15:13:52.287348 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3316/6746] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:13:52 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 15:13:52.299988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cbd3065a-aac4-4049-b7cf-ca3f0cf6c2cd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:52.300672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cbd3065a-aac4-4049-b7cf-ca3f0cf6c2cd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:52.308098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cbd3065a-aac4-4049-b7cf-ca3f0cf6c2cd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:52.308784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cbd3065a-aac4-4049-b7cf-ca3f0cf6c2cd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:52.309619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cbd3065a-aac4-4049-b7cf-ca3f0cf6c2cd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:52.310015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cbd3065a-aac4-4049-b7cf-ca3f0cf6c2cd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:52.396478 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-cbd3065a-aac4-4049-b7cf-ca3f0cf6c2cd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] HTTP exception thrown: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce is not attached to volume 70083a30-22c4-403f-a4d5-80bf90732330 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cbd3065a-aac4-4049-b7cf-ca3f0cf6c2cd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Request method failure captured: Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments/70083a30-22c4-403f-a4d5-80bf90732330 HTTP/1.1 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4ARi5FHTfNl_G-XX8ZgBMBrOnjYSRuvA0mAkdkubOX2Rcfw3p7n2vKsOrpr-J_-fHyAav32rqeMyZhlCnTuKJ_itJJKM2GqMfd3HVleZ1XLK7cIzDZJ_i2_wah9EJ4mLzaUyGM0ypRmn2tS4c5cO2vF0gRCom4V_DIqmSrCaVP8gXJ8 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_84f1ab925e244d8fbf573a2dd7f674c8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}] Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: fe343b4415e44afa80535d4e4ab42bae Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce is not attached to volume 70083a30-22c4-403f-a4d5-80bf90732330 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'server_id': 'd93da2c3-aefe-4cd1-80db-a5996c3166ce', 'id': '70083a30-22c4-403f-a4d5-80bf90732330'} Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 70083a30-22c4-403f-a4d5-80bf90732330. Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce is not attached to volume 70083a30-22c4-403f-a4d5-80bf90732330 Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:52.398144 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:52.401795 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:52.401795 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:52.401795 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce is not attached to volume 70083a30-22c4-403f-a4d5-80bf90732330 Jul 26 15:13:52.401795 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:52.401795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cbd3065a-aac4-4049-b7cf-ca3f0cf6c2cd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Returning 404 to user: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce is not attached to volume 70083a30-22c4-403f-a4d5-80bf90732330 {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:52.401795 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cbd3065a-aac4-4049-b7cf-ca3f0cf6c2cd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments/70083a30-22c4-403f-a4d5-80bf90732330" status: 404 len: 154 microversion: 2.1 time: 0.105075 Jul 26 15:13:52.401795 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3431/6747] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 15:13:52 2022] DELETE /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce/os-volume_attachments/70083a30-22c4-403f-a4d5-80bf90732330 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:55.796216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4072853e-950a-41f3-ade0-bc9dba78687d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:55.796797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4072853e-950a-41f3-ade0-bc9dba78687d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:55.804906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4072853e-950a-41f3-ade0-bc9dba78687d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:55.805364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4072853e-950a-41f3-ade0-bc9dba78687d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:55.806325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4072853e-950a-41f3-ade0-bc9dba78687d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:55.806774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4072853e-950a-41f3-ade0-bc9dba78687d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:55.841445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4072853e-950a-41f3-ade0-bc9dba78687d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:13:55.928102 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4072853e-950a-41f3-ade0-bc9dba78687d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 204 len: 0 microversion: 2.1 time: 0.135910 Jul 26 15:13:55.928746 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3317/6748] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:13:55 2022] DELETE /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:13:55.938197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-19c84d43-5023-4cbf-a5b5-4a4a9d3d07b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:55.938856 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-19c84d43-5023-4cbf-a5b5-4a4a9d3d07b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:55.946422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19c84d43-5023-4cbf-a5b5-4a4a9d3d07b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:55.946636 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19c84d43-5023-4cbf-a5b5-4a4a9d3d07b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:55.947305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19c84d43-5023-4cbf-a5b5-4a4a9d3d07b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:55.947935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19c84d43-5023-4cbf-a5b5-4a4a9d3d07b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:56.124907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-19c84d43-5023-4cbf-a5b5-4a4a9d3d07b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:56.134971 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-19c84d43-5023-4cbf-a5b5-4a4a9d3d07b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1560 microversion: 2.1 time: 0.200924 Jul 26 15:13:56.135583 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3432/6749] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:55 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:57.159441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-df6e8a04-58b2-4c29-804c-a2d1f388f651 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:57.160213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-df6e8a04-58b2-4c29-804c-a2d1f388f651 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:57.167393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df6e8a04-58b2-4c29-804c-a2d1f388f651 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:57.168137 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df6e8a04-58b2-4c29-804c-a2d1f388f651 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:57.168929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df6e8a04-58b2-4c29-804c-a2d1f388f651 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:57.169367 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-df6e8a04-58b2-4c29-804c-a2d1f388f651 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:57.323705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-df6e8a04-58b2-4c29-804c-a2d1f388f651 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:57.333160 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-df6e8a04-58b2-4c29-804c-a2d1f388f651 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1560 microversion: 2.1 time: 0.178933 Jul 26 15:13:57.333778 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3318/6750] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:57 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:58.149655 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e5bb0f0a-f7b7-4348-85c5-ab1571f5394f req-6ce1df92-ac54-43ef-b349-e32d52e25ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93da2c3-aefe-4cd1-80db-a5996c3166ce", "name": "network-vif-deleted", "tag": "83a67fdb-ca52-4830-8a2a-bf01657386cb"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:58.161540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e5bb0f0a-f7b7-4348-85c5-ab1571f5394f req-6ce1df92-ac54-43ef-b349-e32d52e25ec8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:58.162012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e5bb0f0a-f7b7-4348-85c5-ab1571f5394f req-6ce1df92-ac54-43ef-b349-e32d52e25ec8 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:58.175358 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e5bb0f0a-f7b7-4348-85c5-ab1571f5394f req-6ce1df92-ac54-43ef-b349-e32d52e25ec8 service nova] Creating event network-vif-deleted:83a67fdb-ca52-4830-8a2a-bf01657386cb for instance d93da2c3-aefe-4cd1-80db-a5996c3166ce on n-h2-833090-9 Jul 26 15:13:58.181521 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e5bb0f0a-f7b7-4348-85c5-ab1571f5394f req-6ce1df92-ac54-43ef-b349-e32d52e25ec8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035545 Jul 26 15:13:58.182138 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3433/6751] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:58.354979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:58.355533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:58.363445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:58.363896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:58.364705 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:58.365181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:58.409585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:58.410146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:58.410593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lazy-loading 'fault' on Instance uuid d93da2c3-aefe-4cd1-80db-a5996c3166ce {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:13:58.460181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:13:58.469097 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a7ddef01-af55-4a45-9253-a08d9510feea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 200 len: 1352 microversion: 2.1 time: 0.117384 Jul 26 15:13:58.469692 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3319/6752] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:58 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 1352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:13:59.492138 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f193413-ce8e-4e11-be0b-7ce47d4dc574 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:59.492877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4f193413-ce8e-4e11-be0b-7ce47d4dc574 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d93da2c3-aefe-4cd1-80db-a5996c3166ce] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:13:59.500820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f193413-ce8e-4e11-be0b-7ce47d4dc574 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:59.501297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f193413-ce8e-4e11-be0b-7ce47d4dc574 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:59.502106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f193413-ce8e-4e11-be0b-7ce47d4dc574 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:13:59.502564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4f193413-ce8e-4e11-be0b-7ce47d4dc574 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:13:59.517270 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-4f193413-ce8e-4e11-be0b-7ce47d4dc574 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] HTTP exception thrown: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce could not be found. Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f193413-ce8e-4e11-be0b-7ce47d4dc574 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Request method failure captured: Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce HTTP/1.1 Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4ARi5FHTfNl_G-XX8ZgBMBrOnjYSRuvA0mAkdkubOX2Rcfw3p7n2vKsOrpr-J_-fHyAav32rqeMyZhlCnTuKJ_itJJKM2GqMfd3HVleZ1XLK7cIzDZJ_i2_wah9EJ4mLzaUyGM0ypRmn2tS4c5cO2vF0gRCom4V_DIqmSrCaVP8gXJ8 Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_84f1ab925e244d8fbf573a2dd7f674c8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}] Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: fe343b4415e44afa80535d4e4ab42bae Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce could not be found. Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'd93da2c3-aefe-4cd1-80db-a5996c3166ce'} Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce could not be found. Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce could not be found. Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:13:59.518959 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:59.523590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:13:59.523590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:13:59.523590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:13:59.523590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:13:59.523590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:13:59.523590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce could not be found. Jul 26 15:13:59.523590 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:13:59.523590 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4f193413-ce8e-4e11-be0b-7ce47d4dc574 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Returning 404 to user: Instance d93da2c3-aefe-4cd1-80db-a5996c3166ce could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:13:59.523590 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4f193413-ce8e-4e11-be0b-7ce47d4dc574 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce" status: 404 len: 111 microversion: 2.1 time: 0.033484 Jul 26 15:13:59.523590 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3434/6753] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:13:59 2022] GET /compute/v2.1/servers/d93da2c3-aefe-4cd1-80db-a5996c3166ce => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:59.529380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e076bc6b-3b06-4914-aaa0-cce06bfce7ea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '.version_select at 0x7f8786c9a280>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:13:59.552094 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e076bc6b-3b06-4914-aaa0-cce06bfce7ea tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1862791346" status: 202 len: 0 microversion: 2.1 time: 0.026407 Jul 26 15:13:59.552684 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3320/6754] 10.222.0.70 () {58 vars in 1278 bytes} [Tue Jul 26 15:13:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1862791346 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:13:59.572346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8c383d33-d19c-4e5e-9413-b7cd9f871234 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Action: 'create', calling method: .version_select at 0x7f8786b11040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-779552292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIsTglSu/oSS79ag8qmRLpSlRi6Xp/G2Djhypv8thV5SZn6rJ2VOkbwiHTzUtpKi4qGIa0Q2FKzqiyqLlI+HdkQWM/qsJa6lQG01ChEyZkOnKnFyJVDF5JIShTYGawucA=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:59.589280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8c383d33-d19c-4e5e-9413-b7cd9f871234 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:13:59.595536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8c383d33-d19c-4e5e-9413-b7cd9f871234 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for user fe343b4415e44afa80535d4e4ab42bae and project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:13:59.624203 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8c383d33-d19c-4e5e-9413-b7cd9f871234 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.055208 Jul 26 15:13:59.624816 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3435/6755] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:13:59 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:13:59.678719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1223751639", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-779552292", "networks": [{"uuid": "03b7d6b5-0f53-4111-876f-139fe93c9d24"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:13:59.738963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] validate_networks() for [('03b7d6b5-0f53-4111-876f-139fe93c9d24', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:14:00.138607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:14:00.139434 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:14:00.139922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:14:00.140366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:14:00.140786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:14:00.150932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:00.151385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:00.152296 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:00.152741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:00.171316 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:14:00.176687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Getting quotas for user fe343b4415e44afa80535d4e4ab42bae and project 84f1ab925e244d8fbf573a2dd7f674c8. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:14:00.190110 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:14:00.192441 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:14:00.241028 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-acae1cf7-46bc-4d95-bc4d-2cfab88ebb32 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567478 Jul 26 15:14:00.241698 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3321/6756] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:13:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:14:00.254157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f25343e0-1b70-406e-be7f-da5d5487ee95 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:00.255125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f25343e0-1b70-406e-be7f-da5d5487ee95 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:00.321802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f25343e0-1b70-406e-be7f-da5d5487ee95 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:00.329867 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f25343e0-1b70-406e-be7f-da5d5487ee95 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1262 microversion: 2.1 time: 0.081140 Jul 26 15:14:00.330459 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3436/6757] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:00 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:01.352408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1cca834a-d99f-4728-96c6-53022f2b20fb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:01.353310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1cca834a-d99f-4728-96c6-53022f2b20fb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:01.361639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cca834a-d99f-4728-96c6-53022f2b20fb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:01.362534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cca834a-d99f-4728-96c6-53022f2b20fb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:01.363592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cca834a-d99f-4728-96c6-53022f2b20fb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:01.364069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1cca834a-d99f-4728-96c6-53022f2b20fb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:01.438621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1cca834a-d99f-4728-96c6-53022f2b20fb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:01.446373 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1cca834a-d99f-4728-96c6-53022f2b20fb tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1320 microversion: 2.1 time: 0.098260 Jul 26 15:14:01.447273 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3322/6758] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:01 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1320 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:02.470148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-59c30e14-5797-41ea-9626-6d57ebfba7a0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:02.470815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-59c30e14-5797-41ea-9626-6d57ebfba7a0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:02.478352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59c30e14-5797-41ea-9626-6d57ebfba7a0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:02.478837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59c30e14-5797-41ea-9626-6d57ebfba7a0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:02.479699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59c30e14-5797-41ea-9626-6d57ebfba7a0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:02.480215 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-59c30e14-5797-41ea-9626-6d57ebfba7a0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:02.680968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-59c30e14-5797-41ea-9626-6d57ebfba7a0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:02.696714 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-59c30e14-5797-41ea-9626-6d57ebfba7a0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1362 microversion: 2.1 time: 0.231595 Jul 26 15:14:02.697669 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3437/6759] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:02 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:02.917745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-5e6902e3-b8d7-4a6e-9124-bfdf5b8daa61 req-d69aeb1c-96cb-40a2-86fe-2dc27fd33a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ddcfdd-472e-4706-a8b3-d36effaa4048", "tag": "b7ce6125-7e0f-437d-b6e7-0a19caa5c01e"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:14:02.928330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5e6902e3-b8d7-4a6e-9124-bfdf5b8daa61 req-d69aeb1c-96cb-40a2-86fe-2dc27fd33a4b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:02.928847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-5e6902e3-b8d7-4a6e-9124-bfdf5b8daa61 req-d69aeb1c-96cb-40a2-86fe-2dc27fd33a4b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:02.942753 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-5e6902e3-b8d7-4a6e-9124-bfdf5b8daa61 req-d69aeb1c-96cb-40a2-86fe-2dc27fd33a4b service nova] Creating event network-changed:b7ce6125-7e0f-437d-b6e7-0a19caa5c01e for instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 on n-h1-833090-9 Jul 26 15:14:02.948878 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-5e6902e3-b8d7-4a6e-9124-bfdf5b8daa61 req-d69aeb1c-96cb-40a2-86fe-2dc27fd33a4b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154164 Jul 26 15:14:02.949516 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3323/6760] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:14:03.720168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-13d39978-1b05-429d-a432-01f72f7780b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:03.720862 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-13d39978-1b05-429d-a432-01f72f7780b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:03.728105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13d39978-1b05-429d-a432-01f72f7780b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:03.728575 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13d39978-1b05-429d-a432-01f72f7780b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:03.729369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13d39978-1b05-429d-a432-01f72f7780b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:03.729854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13d39978-1b05-429d-a432-01f72f7780b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:03.886002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-13d39978-1b05-429d-a432-01f72f7780b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:03.893781 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-13d39978-1b05-429d-a432-01f72f7780b2 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1362 microversion: 2.1 time: 0.178397 Jul 26 15:14:03.894367 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3438/6761] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:03 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:04.918250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eff30dc2-8f91-4e76-9fe5-e8698faafd0d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:04.918968 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eff30dc2-8f91-4e76-9fe5-e8698faafd0d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:04.926864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eff30dc2-8f91-4e76-9fe5-e8698faafd0d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:04.927317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eff30dc2-8f91-4e76-9fe5-e8698faafd0d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:04.928138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eff30dc2-8f91-4e76-9fe5-e8698faafd0d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:04.928609 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eff30dc2-8f91-4e76-9fe5-e8698faafd0d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:05.073613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-eff30dc2-8f91-4e76-9fe5-e8698faafd0d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:05.083460 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eff30dc2-8f91-4e76-9fe5-e8698faafd0d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1362 microversion: 2.1 time: 0.169577 Jul 26 15:14:05.083990 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3324/6762] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:04 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:06.105218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d9e04c51-c372-4c46-b606-e8247cbfee7d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:06.105773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d9e04c51-c372-4c46-b606-e8247cbfee7d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:06.114129 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9e04c51-c372-4c46-b606-e8247cbfee7d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:06.114608 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9e04c51-c372-4c46-b606-e8247cbfee7d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:06.115430 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9e04c51-c372-4c46-b606-e8247cbfee7d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:06.115893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d9e04c51-c372-4c46-b606-e8247cbfee7d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:06.261255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d9e04c51-c372-4c46-b606-e8247cbfee7d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:06.269959 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d9e04c51-c372-4c46-b606-e8247cbfee7d tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1362 microversion: 2.1 time: 0.168746 Jul 26 15:14:06.270566 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3439/6763] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:06 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:06.557084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-683bc60f-fd71-416f-a176-4d90e1005069 req-97c24554-f0a2-4f21-90df-a74b3f9af6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ddcfdd-472e-4706-a8b3-d36effaa4048", "name": "network-vif-plugged", "status": "completed", "tag": "b7ce6125-7e0f-437d-b6e7-0a19caa5c01e"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:14:06.569780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-683bc60f-fd71-416f-a176-4d90e1005069 req-97c24554-f0a2-4f21-90df-a74b3f9af6d0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:06.570298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-683bc60f-fd71-416f-a176-4d90e1005069 req-97c24554-f0a2-4f21-90df-a74b3f9af6d0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:06.583613 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-683bc60f-fd71-416f-a176-4d90e1005069 req-97c24554-f0a2-4f21-90df-a74b3f9af6d0 service nova] Creating event network-vif-plugged:b7ce6125-7e0f-437d-b6e7-0a19caa5c01e for instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 on n-h1-833090-9 Jul 26 15:14:06.590196 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-683bc60f-fd71-416f-a176-4d90e1005069 req-97c24554-f0a2-4f21-90df-a74b3f9af6d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037168 Jul 26 15:14:06.591023 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3325/6764] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:14:07.291969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e9680aba-f5d7-4c42-8456-8c992addfd82 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:07.292863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e9680aba-f5d7-4c42-8456-8c992addfd82 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:07.301034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9680aba-f5d7-4c42-8456-8c992addfd82 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:07.301506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9680aba-f5d7-4c42-8456-8c992addfd82 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:07.302300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9680aba-f5d7-4c42-8456-8c992addfd82 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:07.302754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e9680aba-f5d7-4c42-8456-8c992addfd82 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:07.446853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e9680aba-f5d7-4c42-8456-8c992addfd82 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:07.456561 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e9680aba-f5d7-4c42-8456-8c992addfd82 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1362 microversion: 2.1 time: 0.168826 Jul 26 15:14:07.457289 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3440/6765] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:07 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:08.481164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3dd04cc0-c7c2-4935-94d2-9c50267b1639 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:08.482231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3dd04cc0-c7c2-4935-94d2-9c50267b1639 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:08.489931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3dd04cc0-c7c2-4935-94d2-9c50267b1639 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:08.490497 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3dd04cc0-c7c2-4935-94d2-9c50267b1639 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:08.491280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3dd04cc0-c7c2-4935-94d2-9c50267b1639 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:08.491728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3dd04cc0-c7c2-4935-94d2-9c50267b1639 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:08.638154 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3dd04cc0-c7c2-4935-94d2-9c50267b1639 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:08.648422 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3dd04cc0-c7c2-4935-94d2-9c50267b1639 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1555 microversion: 2.1 time: 0.173076 Jul 26 15:14:08.648970 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3326/6766] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:08 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:08.674455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-de3d1e5c-b254-4cfb-bc39-e3b536efc5d3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:08.675538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-de3d1e5c-b254-4cfb-bc39-e3b536efc5d3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:08.683029 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de3d1e5c-b254-4cfb-bc39-e3b536efc5d3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:08.683508 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de3d1e5c-b254-4cfb-bc39-e3b536efc5d3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:08.684364 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de3d1e5c-b254-4cfb-bc39-e3b536efc5d3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:08.684832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-de3d1e5c-b254-4cfb-bc39-e3b536efc5d3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:08.820444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-de3d1e5c-b254-4cfb-bc39-e3b536efc5d3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:08.829657 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-de3d1e5c-b254-4cfb-bc39-e3b536efc5d3 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1555 microversion: 2.1 time: 0.163015 Jul 26 15:14:08.830260 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3441/6767] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:08 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:14:10.357423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-65933e7e-4c22-4b4b-a2e0-9a54089fe286 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64df8b72-2080-4b64-9fdd-6f54e8928215"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:14:10.360524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-65933e7e-4c22-4b4b-a2e0-9a54089fe286 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:10.363314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:10.364014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:10.370510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65933e7e-4c22-4b4b-a2e0-9a54089fe286 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:10.370973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65933e7e-4c22-4b4b-a2e0-9a54089fe286 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:10.371759 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65933e7e-4c22-4b4b-a2e0-9a54089fe286 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:10.372238 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-65933e7e-4c22-4b4b-a2e0-9a54089fe286 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:10.637728 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-65933e7e-4c22-4b4b-a2e0-9a54089fe286 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "POST /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284163 Jul 26 15:14:10.638428 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3327/6768] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 15:14:10 2022] POST /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:14:21.361650 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2c26af7b-8ccc-47ce-b255-5d67a6a0e64a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:21.362348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2c26af7b-8ccc-47ce-b255-5d67a6a0e64a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:21.364283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:21.365095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:21.365946 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=64 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:21.373112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c26af7b-8ccc-47ce-b255-5d67a6a0e64a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:21.373612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c26af7b-8ccc-47ce-b255-5d67a6a0e64a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:21.374338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c26af7b-8ccc-47ce-b255-5d67a6a0e64a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:21.374797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2c26af7b-8ccc-47ce-b255-5d67a6a0e64a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:21.461696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-2c26af7b-8ccc-47ce-b255-5d67a6a0e64a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lazy-loading 'services' on Instance uuid d9ddcfdd-472e-4706-a8b3-d36effaa4048 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:14:21.536594 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2c26af7b-8ccc-47ce-b255-5d67a6a0e64a tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments/64df8b72-2080-4b64-9fdd-6f54e8928215" status: 202 len: 0 microversion: 2.1 time: 0.179496 Jul 26 15:14:21.537205 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3442/6769] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 15:14:21 2022] DELETE /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments/64df8b72-2080-4b64-9fdd-6f54e8928215 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:14:21.546914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-91536a77-c9a2-4e54-a247-bb5771c366e5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:21.549954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-91536a77-c9a2-4e54-a247-bb5771c366e5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:21.552698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:21.554018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:14:21.560452 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91536a77-c9a2-4e54-a247-bb5771c366e5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:21.561018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91536a77-c9a2-4e54-a247-bb5771c366e5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:21.561916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91536a77-c9a2-4e54-a247-bb5771c366e5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:21.562358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-91536a77-c9a2-4e54-a247-bb5771c366e5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:21.603157 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-91536a77-c9a2-4e54-a247-bb5771c366e5 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061064 Jul 26 15:14:21.603750 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3328/6770] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:14:21 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:14:22.616207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ed1db146-2dc0-468c-aeea-6cbb797726ab tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:22.618658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ed1db146-2dc0-468c-aeea-6cbb797726ab tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:22.626871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed1db146-2dc0-468c-aeea-6cbb797726ab tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:22.627497 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed1db146-2dc0-468c-aeea-6cbb797726ab tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:22.628347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed1db146-2dc0-468c-aeea-6cbb797726ab tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:22.628813 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ed1db146-2dc0-468c-aeea-6cbb797726ab tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:22.663714 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ed1db146-2dc0-468c-aeea-6cbb797726ab tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051848 Jul 26 15:14:22.664549 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3443/6771] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:14:22 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:14:23.679011 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef9cb91a-0f9e-4883-ad30-34412bde1c8b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:23.681425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ef9cb91a-0f9e-4883-ad30-34412bde1c8b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:23.690085 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef9cb91a-0f9e-4883-ad30-34412bde1c8b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:23.690320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef9cb91a-0f9e-4883-ad30-34412bde1c8b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:23.691121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef9cb91a-0f9e-4883-ad30-34412bde1c8b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:23.691570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef9cb91a-0f9e-4883-ad30-34412bde1c8b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:24.013912 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ef9cb91a-0f9e-4883-ad30-34412bde1c8b tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.341395 Jul 26 15:14:24.014421 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3329/6772] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:14:23 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments => generated 197 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:14:25.027626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-365a15a3-bccb-4874-a45a-9f0f5d9b9004 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:25.029768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-365a15a3-bccb-4874-a45a-9f0f5d9b9004 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:25.037382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-365a15a3-bccb-4874-a45a-9f0f5d9b9004 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:25.037861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-365a15a3-bccb-4874-a45a-9f0f5d9b9004 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:25.038678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-365a15a3-bccb-4874-a45a-9f0f5d9b9004 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:25.039143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-365a15a3-bccb-4874-a45a-9f0f5d9b9004 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:25.078595 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-365a15a3-bccb-4874-a45a-9f0f5d9b9004 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055911 Jul 26 15:14:25.079247 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3444/6773] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:14:25 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:14:26.090987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b35e8196-bcda-412a-8bd0-0131fa8ff4dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:26.093182 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b35e8196-bcda-412a-8bd0-0131fa8ff4dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:26.101712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b35e8196-bcda-412a-8bd0-0131fa8ff4dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:26.102168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b35e8196-bcda-412a-8bd0-0131fa8ff4dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:26.102952 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b35e8196-bcda-412a-8bd0-0131fa8ff4dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:26.103398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b35e8196-bcda-412a-8bd0-0131fa8ff4dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:26.136032 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b35e8196-bcda-412a-8bd0-0131fa8ff4dd tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048950 Jul 26 15:14:26.136847 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3330/6774] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:14:26 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:14:27.149689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58d2773f-4b19-4070-bd09-d19059e40086 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:27.151926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-58d2773f-4b19-4070-bd09-d19059e40086 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:27.159368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58d2773f-4b19-4070-bd09-d19059e40086 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:27.159844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58d2773f-4b19-4070-bd09-d19059e40086 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:27.160678 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58d2773f-4b19-4070-bd09-d19059e40086 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:27.161142 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58d2773f-4b19-4070-bd09-d19059e40086 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:27.194321 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-58d2773f-4b19-4070-bd09-d19059e40086 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049388 Jul 26 15:14:27.195116 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3445/6775] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:14:27 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:14:27.205420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d5631d36-be8d-4774-9f96-fabd21375ed0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:27.206242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d5631d36-be8d-4774-9f96-fabd21375ed0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:27.213812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5631d36-be8d-4774-9f96-fabd21375ed0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:27.214271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5631d36-be8d-4774-9f96-fabd21375ed0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:27.215062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5631d36-be8d-4774-9f96-fabd21375ed0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:27.215511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d5631d36-be8d-4774-9f96-fabd21375ed0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:27.302586 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-d5631d36-be8d-4774-9f96-fabd21375ed0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] HTTP exception thrown: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 is not attached to volume 64df8b72-2080-4b64-9fdd-6f54e8928215 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d5631d36-be8d-4774-9f96-fabd21375ed0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Request method failure captured: Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments/64df8b72-2080-4b64-9fdd-6f54e8928215 HTTP/1.1 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4ARi5FHTfNl_G-XX8ZgBMBrOnjYSRuvA0mAkdkubOX2Rcfw3p7n2vKsOrpr-J_-fHyAav32rqeMyZhlCnTuKJ_itJJKM2GqMfd3HVleZ1XLK7cIzDZJ_i2_wah9EJ4mLzaUyGM0ypRmn2tS4c5cO2vF0gRCom4V_DIqmSrCaVP8gXJ8 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_84f1ab925e244d8fbf573a2dd7f674c8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}] Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: fe343b4415e44afa80535d4e4ab42bae Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 is not attached to volume 64df8b72-2080-4b64-9fdd-6f54e8928215 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': 'd9ddcfdd-472e-4706-a8b3-d36effaa4048', 'id': '64df8b72-2080-4b64-9fdd-6f54e8928215'} Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 64df8b72-2080-4b64-9fdd-6f54e8928215. Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 is not attached to volume 64df8b72-2080-4b64-9fdd-6f54e8928215 Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:14:27.304856 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:14:27.312574 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:14:27.312574 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:14:27.312574 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 is not attached to volume 64df8b72-2080-4b64-9fdd-6f54e8928215 Jul 26 15:14:27.312574 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:14:27.312574 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d5631d36-be8d-4774-9f96-fabd21375ed0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Returning 404 to user: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 is not attached to volume 64df8b72-2080-4b64-9fdd-6f54e8928215 {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:14:27.312574 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d5631d36-be8d-4774-9f96-fabd21375ed0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments/64df8b72-2080-4b64-9fdd-6f54e8928215" status: 404 len: 154 microversion: 2.1 time: 0.104697 Jul 26 15:14:27.312574 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3331/6776] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 15:14:27 2022] DELETE /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048/os-volume_attachments/64df8b72-2080-4b64-9fdd-6f54e8928215 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:14:30.733412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c59b6207-500f-447b-8908-a5d47a9f4fc9 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:30.734275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c59b6207-500f-447b-8908-a5d47a9f4fc9 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:30.743032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c59b6207-500f-447b-8908-a5d47a9f4fc9 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:30.743501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c59b6207-500f-447b-8908-a5d47a9f4fc9 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:30.744329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c59b6207-500f-447b-8908-a5d47a9f4fc9 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:30.744798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c59b6207-500f-447b-8908-a5d47a9f4fc9 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:30.777467 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c59b6207-500f-447b-8908-a5d47a9f4fc9 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:14:30.869588 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c59b6207-500f-447b-8908-a5d47a9f4fc9 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 204 len: 0 microversion: 2.1 time: 0.142014 Jul 26 15:14:30.870661 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3446/6777] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:14:30 2022] DELETE /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:14:30.882973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0759b882-b7fc-4e13-9948-15c802bb42e0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:30.884363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0759b882-b7fc-4e13-9948-15c802bb42e0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:30.896667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0759b882-b7fc-4e13-9948-15c802bb42e0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:30.897311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0759b882-b7fc-4e13-9948-15c802bb42e0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:30.898628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0759b882-b7fc-4e13-9948-15c802bb42e0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:30.899338 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0759b882-b7fc-4e13-9948-15c802bb42e0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:31.045863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0759b882-b7fc-4e13-9948-15c802bb42e0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:31.059644 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0759b882-b7fc-4e13-9948-15c802bb42e0 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1561 microversion: 2.1 time: 0.184109 Jul 26 15:14:31.060282 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3332/6778] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:30 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:32.084574 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4e953590-4308-4494-b18c-e2b98dbbe125 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:32.085176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4e953590-4308-4494-b18c-e2b98dbbe125 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:32.092407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e953590-4308-4494-b18c-e2b98dbbe125 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:32.092870 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e953590-4308-4494-b18c-e2b98dbbe125 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:32.093763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e953590-4308-4494-b18c-e2b98dbbe125 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:32.094123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4e953590-4308-4494-b18c-e2b98dbbe125 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:32.237656 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4e953590-4308-4494-b18c-e2b98dbbe125 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:32.247281 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4e953590-4308-4494-b18c-e2b98dbbe125 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1561 microversion: 2.1 time: 0.167447 Jul 26 15:14:32.248237 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3447/6779] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:32 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:33.055494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ac33282d-ba55-4870-92d1-0a256ecc9e48 req-26fd150f-d940-4b34-bdbb-8385c3115daa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ddcfdd-472e-4706-a8b3-d36effaa4048", "name": "network-vif-deleted", "tag": "b7ce6125-7e0f-437d-b6e7-0a19caa5c01e"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:14:33.075239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ac33282d-ba55-4870-92d1-0a256ecc9e48 req-26fd150f-d940-4b34-bdbb-8385c3115daa service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:33.076392 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ac33282d-ba55-4870-92d1-0a256ecc9e48 req-26fd150f-d940-4b34-bdbb-8385c3115daa service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:33.099150 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ac33282d-ba55-4870-92d1-0a256ecc9e48 req-26fd150f-d940-4b34-bdbb-8385c3115daa service nova] Creating event network-vif-deleted:b7ce6125-7e0f-437d-b6e7-0a19caa5c01e for instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 on n-h1-833090-9 Jul 26 15:14:33.107628 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ac33282d-ba55-4870-92d1-0a256ecc9e48 req-26fd150f-d940-4b34-bdbb-8385c3115daa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058345 Jul 26 15:14:33.108872 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3333/6780] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:14:33.270912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:33.271491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:33.278687 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:33.279170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:33.280291 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:33.280763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:33.321272 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:33.322062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:33.322235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lazy-loading 'fault' on Instance uuid d9ddcfdd-472e-4706-a8b3-d36effaa4048 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:14:33.367391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe343b4415e44afa80535d4e4ab42bae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f1ab925e244d8fbf573a2dd7f674c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:14:33.375440 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca80c8c1-18a3-409d-b829-3affb15c6229 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 200 len: 1352 microversion: 2.1 time: 0.109861 Jul 26 15:14:33.376883 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3448/6781] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:33 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:14:34.401257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-adf50448-5ee9-4658-b102-280d9038029f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:34.401974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-adf50448-5ee9-4658-b102-280d9038029f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] [instance: d9ddcfdd-472e-4706-a8b3-d36effaa4048] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:14:34.409811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-adf50448-5ee9-4658-b102-280d9038029f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:34.410268 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-adf50448-5ee9-4658-b102-280d9038029f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:34.411070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-adf50448-5ee9-4658-b102-280d9038029f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:14:34.411521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-adf50448-5ee9-4658-b102-280d9038029f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:14:34.436799 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-adf50448-5ee9-4658-b102-280d9038029f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] HTTP exception thrown: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 could not be found. Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-adf50448-5ee9-4658-b102-280d9038029f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Request method failure captured: Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 HTTP/1.1 Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4ARi5FHTfNl_G-XX8ZgBMBrOnjYSRuvA0mAkdkubOX2Rcfw3p7n2vKsOrpr-J_-fHyAav32rqeMyZhlCnTuKJ_itJJKM2GqMfd3HVleZ1XLK7cIzDZJ_i2_wah9EJ4mLzaUyGM0ypRmn2tS4c5cO2vF0gRCom4V_DIqmSrCaVP8gXJ8 Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/84f1ab925e244d8fbf573a2dd7f674c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_84f1ab925e244d8fbf573a2dd7f674c8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/84f1ab925e244d8fbf573a2dd7f674c8"}]}] Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 84f1ab925e244d8fbf573a2dd7f674c8 Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2041186171 Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: fe343b4415e44afa80535d4e4ab42bae Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestEncryptedCinderVolumes-2041186171-project Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 could not be found. Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'd9ddcfdd-472e-4706-a8b3-d36effaa4048'} Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 could not be found. Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 could not be found. Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:14:34.440641 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:14:34.445534 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:14:34.445534 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:14:34.445534 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:14:34.445534 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:14:34.445534 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:14:34.445534 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 could not be found. Jul 26 15:14:34.445534 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:14:34.445534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-adf50448-5ee9-4658-b102-280d9038029f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Returning 404 to user: Instance d9ddcfdd-472e-4706-a8b3-d36effaa4048 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:14:34.445534 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-adf50448-5ee9-4658-b102-280d9038029f tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048" status: 404 len: 111 microversion: 2.1 time: 0.046884 Jul 26 15:14:34.447576 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3334/6782] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:14:34 2022] GET /compute/v2.1/servers/d9ddcfdd-472e-4706-a8b3-d36effaa4048 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:14:34.457265 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d0c67cd8-4ff7-4b75-af80-dda8ff6c0e07 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] Calling method '.version_select at 0x7f8786a050d0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:14:34.482265 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d0c67cd8-4ff7-4b75-af80-dda8ff6c0e07 tempest-TestEncryptedCinderVolumes-2041186171 tempest-TestEncryptedCinderVolumes-2041186171-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-779552292" status: 202 len: 0 microversion: 2.1 time: 0.032834 Jul 26 15:14:34.482856 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3449/6783] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Jul 26 15:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-779552292 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:15:03.850464 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-38e1153f-7e0d-4774-9345-ee02bc9d8463 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'create', calling method: .version_select at 0x7f8786ef63a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1536894462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErhhlUHyHrb/uCUvG4XGqifzD4ABWXtnuvUMG4DmEJtHJkcmtunyKpJuTMyItgsusDRHU0G1/A2HK+wtTfqd375evrFToLl5l+VWyDovSFx/Ry5iwOMYoom8riPly23vg=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:03.856048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=14 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:03.856707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=34 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:03.872852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-38e1153f-7e0d-4774-9345-ee02bc9d8463 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Getting quotas for project 201aad04f85c4d2d9720c54c8cab855f. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:15:03.879117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-38e1153f-7e0d-4774-9345-ee02bc9d8463 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Getting quotas for user 966e46004bc84db09a828c0ab09377dd and project 201aad04f85c4d2d9720c54c8cab855f. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:15:03.905227 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-38e1153f-7e0d-4774-9345-ee02bc9d8463 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059031 Jul 26 15:15:03.905919 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3335/6784] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:15:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:15:03.961788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-402635130", "imageRef": "b022c2ec-ac6e-4394-b8aa-73e4b26b88cd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1536894462", "networks": [{"uuid": "50f92da8-b3c8-4dc2-9ab3-74c3c413568f"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:03.972117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:03.972822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:04.029940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] validate_networks() for [('50f92da8-b3c8-4dc2-9ab3-74c3c413568f', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:15:04.445852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:15:04.446297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:15:04.446867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:15:04.447200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:15:04.447628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:15:04.457013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:04.457477 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:04.458762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:04.459219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:04.477619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Getting quotas for project 201aad04f85c4d2d9720c54c8cab855f. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:15:04.483058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Getting quotas for user 966e46004bc84db09a828c0ab09377dd and project 201aad04f85c4d2d9720c54c8cab855f. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:15:04.496451 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:15:04.498637 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b022c2ec-ac6e-4394-b8aa-73e4b26b88cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:15:04.546596 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-271e1e68-5de6-45d0-90ed-7d143b74cbfe tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588803 Jul 26 15:15:04.547175 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3450/6785] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:15:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:15:04.558550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9c32677a-7da8-4da5-8a15-0cc9ffe77f77 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:04.559188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9c32677a-7da8-4da5-8a15-0cc9ffe77f77 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:04.617895 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9c32677a-7da8-4da5-8a15-0cc9ffe77f77 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:04.628453 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9c32677a-7da8-4da5-8a15-0cc9ffe77f77 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1258 microversion: 2.1 time: 0.073910 Jul 26 15:15:04.629228 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3336/6786] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:04 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:15:05.651108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-00e74046-41d4-48df-b230-8f4a7132c4ec tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:05.652542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-00e74046-41d4-48df-b230-8f4a7132c4ec tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:05.660730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e74046-41d4-48df-b230-8f4a7132c4ec tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:05.661341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e74046-41d4-48df-b230-8f4a7132c4ec tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:05.662116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e74046-41d4-48df-b230-8f4a7132c4ec tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:05.662583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-00e74046-41d4-48df-b230-8f4a7132c4ec tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:05.762794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-00e74046-41d4-48df-b230-8f4a7132c4ec tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:05.776497 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-00e74046-41d4-48df-b230-8f4a7132c4ec tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1328 microversion: 2.1 time: 0.130046 Jul 26 15:15:05.777516 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3451/6787] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:05 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:06.803379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c0a2eb3c-dfac-4e92-8009-c38caebeef6d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:06.804717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c0a2eb3c-dfac-4e92-8009-c38caebeef6d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:06.818094 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0a2eb3c-dfac-4e92-8009-c38caebeef6d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:06.819724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0a2eb3c-dfac-4e92-8009-c38caebeef6d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:06.822342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0a2eb3c-dfac-4e92-8009-c38caebeef6d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:06.823605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c0a2eb3c-dfac-4e92-8009-c38caebeef6d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:07.039879 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c0a2eb3c-dfac-4e92-8009-c38caebeef6d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:07.051052 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c0a2eb3c-dfac-4e92-8009-c38caebeef6d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.251458 Jul 26 15:15:07.051871 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3337/6788] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:06 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:08.074200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-712766b2-101a-4ba9-b6bc-baf0d0188051 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:08.075242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-712766b2-101a-4ba9-b6bc-baf0d0188051 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:08.084540 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-712766b2-101a-4ba9-b6bc-baf0d0188051 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:08.085010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-712766b2-101a-4ba9-b6bc-baf0d0188051 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:08.085810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-712766b2-101a-4ba9-b6bc-baf0d0188051 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:08.086266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-712766b2-101a-4ba9-b6bc-baf0d0188051 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:08.248032 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-712766b2-101a-4ba9-b6bc-baf0d0188051 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:08.256947 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-712766b2-101a-4ba9-b6bc-baf0d0188051 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.186573 Jul 26 15:15:08.257694 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3452/6789] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:08 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:09.279690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-77dd20d2-614d-4467-ba90-87e285e0fdf3 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:09.280548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-77dd20d2-614d-4467-ba90-87e285e0fdf3 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:09.290678 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77dd20d2-614d-4467-ba90-87e285e0fdf3 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:09.291138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77dd20d2-614d-4467-ba90-87e285e0fdf3 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:09.291992 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77dd20d2-614d-4467-ba90-87e285e0fdf3 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:09.292703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-77dd20d2-614d-4467-ba90-87e285e0fdf3 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:09.497331 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-77dd20d2-614d-4467-ba90-87e285e0fdf3 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:09.506738 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-77dd20d2-614d-4467-ba90-87e285e0fdf3 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.231044 Jul 26 15:15:09.507336 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3338/6790] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:09 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:15:10.529500 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a6ca4368-ff84-4fb8-9c1f-227dc8698caa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:10.530708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a6ca4368-ff84-4fb8-9c1f-227dc8698caa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:10.544289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ca4368-ff84-4fb8-9c1f-227dc8698caa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:10.544777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ca4368-ff84-4fb8-9c1f-227dc8698caa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:10.545605 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ca4368-ff84-4fb8-9c1f-227dc8698caa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:10.546074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a6ca4368-ff84-4fb8-9c1f-227dc8698caa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:10.729189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a6ca4368-ff84-4fb8-9c1f-227dc8698caa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:10.740271 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a6ca4368-ff84-4fb8-9c1f-227dc8698caa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.215116 Jul 26 15:15:10.741231 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3453/6791] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:10 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:11.769059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-576e4a01-cc7f-425f-8459-35a338783d99 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:11.770090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-576e4a01-cc7f-425f-8459-35a338783d99 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:11.779658 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-576e4a01-cc7f-425f-8459-35a338783d99 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:11.780399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-576e4a01-cc7f-425f-8459-35a338783d99 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:11.782256 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-576e4a01-cc7f-425f-8459-35a338783d99 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:11.782963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-576e4a01-cc7f-425f-8459-35a338783d99 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:11.959421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-576e4a01-cc7f-425f-8459-35a338783d99 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:11.969629 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-576e4a01-cc7f-425f-8459-35a338783d99 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.207800 Jul 26 15:15:11.970608 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3339/6792] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:11 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:15:12.996298 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0114c37-aa65-43b4-bd84-7ce781046c39 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:12.997340 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a0114c37-aa65-43b4-bd84-7ce781046c39 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:13.009563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0114c37-aa65-43b4-bd84-7ce781046c39 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:13.010041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0114c37-aa65-43b4-bd84-7ce781046c39 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:13.010861 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0114c37-aa65-43b4-bd84-7ce781046c39 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:13.011326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0114c37-aa65-43b4-bd84-7ce781046c39 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:13.194768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0114c37-aa65-43b4-bd84-7ce781046c39 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:13.238904 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a0114c37-aa65-43b4-bd84-7ce781046c39 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.246345 Jul 26 15:15:13.240228 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3454/6793] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:12 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:14.271518 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cd4e8f73-b0ac-4bf2-a379-4a08013a4726 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:14.272126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cd4e8f73-b0ac-4bf2-a379-4a08013a4726 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:14.280181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd4e8f73-b0ac-4bf2-a379-4a08013a4726 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:14.281376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd4e8f73-b0ac-4bf2-a379-4a08013a4726 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:14.282169 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd4e8f73-b0ac-4bf2-a379-4a08013a4726 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:14.282591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cd4e8f73-b0ac-4bf2-a379-4a08013a4726 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:14.437023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cd4e8f73-b0ac-4bf2-a379-4a08013a4726 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:14.447917 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cd4e8f73-b0ac-4bf2-a379-4a08013a4726 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.180363 Jul 26 15:15:14.449100 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3340/6794] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:14 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:15.480513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-955f4751-87df-48f7-ba66-b4d7a8c1456a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:15.481412 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-955f4751-87df-48f7-ba66-b4d7a8c1456a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:15.487886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:15.488963 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:15.496709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-955f4751-87df-48f7-ba66-b4d7a8c1456a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:15.496709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-955f4751-87df-48f7-ba66-b4d7a8c1456a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:15.497507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-955f4751-87df-48f7-ba66-b4d7a8c1456a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:15.498081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-955f4751-87df-48f7-ba66-b4d7a8c1456a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:15.644664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-06182eb8-e707-4184-9352-89ad72d79f87 req-e5de75ac-2a18-4727-a40e-147aa393c65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd79ad55-4dad-4e1a-a13a-20ea0a81eda9", "tag": "80ae3a97-0a5a-4576-a490-a37a71999510"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:15.653764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:15.657571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-06182eb8-e707-4184-9352-89ad72d79f87 req-e5de75ac-2a18-4727-a40e-147aa393c65f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:15.658031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-06182eb8-e707-4184-9352-89ad72d79f87 req-e5de75ac-2a18-4727-a40e-147aa393c65f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:15.678080 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-06182eb8-e707-4184-9352-89ad72d79f87 req-e5de75ac-2a18-4727-a40e-147aa393c65f service nova] Creating event network-changed:80ae3a97-0a5a-4576-a490-a37a71999510 for instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 on n-h2-833090-9 Jul 26 15:15:15.685982 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-06182eb8-e707-4184-9352-89ad72d79f87 req-e5de75ac-2a18-4727-a40e-147aa393c65f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045640 Jul 26 15:15:15.686857 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3341/6795] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:15:15.769367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-955f4751-87df-48f7-ba66-b4d7a8c1456a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:15.785515 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-955f4751-87df-48f7-ba66-b4d7a8c1456a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.310304 Jul 26 15:15:15.787464 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3455/6796] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:15 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:16.810312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3f99e8d8-a1f0-4d54-abd8-c5c2c29ec685 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:16.810939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3f99e8d8-a1f0-4d54-abd8-c5c2c29ec685 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:16.818717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f99e8d8-a1f0-4d54-abd8-c5c2c29ec685 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:16.819174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f99e8d8-a1f0-4d54-abd8-c5c2c29ec685 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:16.820042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f99e8d8-a1f0-4d54-abd8-c5c2c29ec685 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:16.820445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f99e8d8-a1f0-4d54-abd8-c5c2c29ec685 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:16.968940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3f99e8d8-a1f0-4d54-abd8-c5c2c29ec685 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:16.978016 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3f99e8d8-a1f0-4d54-abd8-c5c2c29ec685 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.172993 Jul 26 15:15:16.978616 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3342/6797] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:16 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:18.001084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-384c8aab-4f64-4b95-b4f8-632acd2ee75e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:18.001756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-384c8aab-4f64-4b95-b4f8-632acd2ee75e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:18.008788 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-384c8aab-4f64-4b95-b4f8-632acd2ee75e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:18.009258 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-384c8aab-4f64-4b95-b4f8-632acd2ee75e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:18.010052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-384c8aab-4f64-4b95-b4f8-632acd2ee75e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:18.010507 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-384c8aab-4f64-4b95-b4f8-632acd2ee75e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:18.145124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-384c8aab-4f64-4b95-b4f8-632acd2ee75e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:18.154955 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-384c8aab-4f64-4b95-b4f8-632acd2ee75e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.158268 Jul 26 15:15:18.156434 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3456/6798] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:17 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:19.181173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce4b5cd3-f368-47be-8ce6-26a6761e46ee tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:19.181901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce4b5cd3-f368-47be-8ce6-26a6761e46ee tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:19.189923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce4b5cd3-f368-47be-8ce6-26a6761e46ee tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:19.190384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce4b5cd3-f368-47be-8ce6-26a6761e46ee tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:19.191177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce4b5cd3-f368-47be-8ce6-26a6761e46ee tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:19.193398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce4b5cd3-f368-47be-8ce6-26a6761e46ee tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:19.353932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ce4b5cd3-f368-47be-8ce6-26a6761e46ee tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:19.364442 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce4b5cd3-f368-47be-8ce6-26a6761e46ee tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.187233 Jul 26 15:15:19.365323 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3343/6799] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:19 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:20.386723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b634045c-cd18-460a-b591-642ada3ecf8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:20.387327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b634045c-cd18-460a-b591-642ada3ecf8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:20.395064 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b634045c-cd18-460a-b591-642ada3ecf8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:20.395530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b634045c-cd18-460a-b591-642ada3ecf8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:20.396407 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b634045c-cd18-460a-b591-642ada3ecf8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:20.396868 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b634045c-cd18-460a-b591-642ada3ecf8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:20.537328 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b634045c-cd18-460a-b591-642ada3ecf8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:20.545238 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b634045c-cd18-460a-b591-642ada3ecf8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.162439 Jul 26 15:15:20.546127 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3457/6800] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:20 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:21.263381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-62c4793d-f2fa-4749-af5a-6338717ecbc0 req-6db3bb72-0635-4ef1-8624-da7341195cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd79ad55-4dad-4e1a-a13a-20ea0a81eda9", "name": "network-vif-plugged", "status": "completed", "tag": "80ae3a97-0a5a-4576-a490-a37a71999510"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:21.274929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-62c4793d-f2fa-4749-af5a-6338717ecbc0 req-6db3bb72-0635-4ef1-8624-da7341195cf2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:21.275366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-62c4793d-f2fa-4749-af5a-6338717ecbc0 req-6db3bb72-0635-4ef1-8624-da7341195cf2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:21.289410 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-62c4793d-f2fa-4749-af5a-6338717ecbc0 req-6db3bb72-0635-4ef1-8624-da7341195cf2 service nova] Creating event network-vif-plugged:80ae3a97-0a5a-4576-a490-a37a71999510 for instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 on n-h2-833090-9 Jul 26 15:15:21.294789 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-62c4793d-f2fa-4749-af5a-6338717ecbc0 req-6db3bb72-0635-4ef1-8624-da7341195cf2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035122 Jul 26 15:15:21.295513 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3344/6801] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:15:21.567280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-13b85fa5-513b-4803-9219-fa913ab1c392 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:21.568125 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-13b85fa5-513b-4803-9219-fa913ab1c392 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:21.574072 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13b85fa5-513b-4803-9219-fa913ab1c392 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:21.574541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13b85fa5-513b-4803-9219-fa913ab1c392 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:21.575350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13b85fa5-513b-4803-9219-fa913ab1c392 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:21.575834 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-13b85fa5-513b-4803-9219-fa913ab1c392 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:22.014404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-13b85fa5-513b-4803-9219-fa913ab1c392 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:22.023466 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-13b85fa5-513b-4803-9219-fa913ab1c392 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1358 microversion: 2.1 time: 0.461883 Jul 26 15:15:22.024083 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3458/6802] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:21 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1358 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:23.046715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-76fa3e6e-d417-41b3-8cdc-53500dea3029 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:23.047416 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-76fa3e6e-d417-41b3-8cdc-53500dea3029 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:23.053785 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76fa3e6e-d417-41b3-8cdc-53500dea3029 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.054245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76fa3e6e-d417-41b3-8cdc-53500dea3029 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.055024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76fa3e6e-d417-41b3-8cdc-53500dea3029 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.055471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-76fa3e6e-d417-41b3-8cdc-53500dea3029 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.194413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-76fa3e6e-d417-41b3-8cdc-53500dea3029 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:23.202759 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-76fa3e6e-d417-41b3-8cdc-53500dea3029 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1548 microversion: 2.1 time: 0.160899 Jul 26 15:15:23.203545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3345/6803] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:23 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:23.227398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-02b47694-178f-4563-9682-0bda3bba3143 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:23.228176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-02b47694-178f-4563-9682-0bda3bba3143 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:23.236109 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02b47694-178f-4563-9682-0bda3bba3143 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.236587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02b47694-178f-4563-9682-0bda3bba3143 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.237402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02b47694-178f-4563-9682-0bda3bba3143 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.237873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-02b47694-178f-4563-9682-0bda3bba3143 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.385596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-02b47694-178f-4563-9682-0bda3bba3143 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:23.393608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-02b47694-178f-4563-9682-0bda3bba3143 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1548 microversion: 2.1 time: 0.170168 Jul 26 15:15:23.394173 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3459/6804] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:23 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:15:23.413455 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a27da817-588c-4eae-a9e0-116cc76ffa17 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:23.418771 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a27da817-588c-4eae-a9e0-116cc76ffa17 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:23.419536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a27da817-588c-4eae-a9e0-116cc76ffa17 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Searching by: {'deleted': False, 'project_id': '201aad04f85c4d2d9720c54c8cab855f'} {{(pid=119478) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 15:15:23.426283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a27da817-588c-4eae-a9e0-116cc76ffa17 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.426733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a27da817-588c-4eae-a9e0-116cc76ffa17 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.427530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a27da817-588c-4eae-a9e0-116cc76ffa17 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.427976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a27da817-588c-4eae-a9e0-116cc76ffa17 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.454491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.multi_cell_list [None req-a27da817-588c-4eae-a9e0-116cc76ffa17 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119478) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 15:15:23.481909 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a27da817-588c-4eae-a9e0-116cc76ffa17 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.072295 Jul 26 15:15:23.482483 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3346/6805] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 15:15:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:15:23.494814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-25a8fc35-4685-4d42-87dc-67b884290fe2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:23.495454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-25a8fc35-4685-4d42-87dc-67b884290fe2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:23.502314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25a8fc35-4685-4d42-87dc-67b884290fe2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.502784 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25a8fc35-4685-4d42-87dc-67b884290fe2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.503591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25a8fc35-4685-4d42-87dc-67b884290fe2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:23.504087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-25a8fc35-4685-4d42-87dc-67b884290fe2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:23.653719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-25a8fc35-4685-4d42-87dc-67b884290fe2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:23.662338 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-25a8fc35-4685-4d42-87dc-67b884290fe2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1548 microversion: 2.1 time: 0.171444 Jul 26 15:15:23.662925 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3460/6806] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:23 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:25.270278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86a33097-f6d9-4f5b-b8a7-b1043cdab1e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65232fb9-6904-4ed3-a15e-105e94835a86"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:25.272909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-86a33097-f6d9-4f5b-b8a7-b1043cdab1e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:25.280307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86a33097-f6d9-4f5b-b8a7-b1043cdab1e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:25.280754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86a33097-f6d9-4f5b-b8a7-b1043cdab1e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:25.281550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86a33097-f6d9-4f5b-b8a7-b1043cdab1e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:25.282005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-86a33097-f6d9-4f5b-b8a7-b1043cdab1e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:25.572903 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-86a33097-f6d9-4f5b-b8a7-b1043cdab1e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306757 Jul 26 15:15:25.573542 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3347/6807] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 15:15:25 2022] POST /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:15:39.884059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-327b1159-ce59-410b-ad1d-5a39b1706a10 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:39.884883 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-327b1159-ce59-410b-ad1d-5a39b1706a10 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:39.886995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:39.887670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=62 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:39.894455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-327b1159-ce59-410b-ad1d-5a39b1706a10 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:39.894935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-327b1159-ce59-410b-ad1d-5a39b1706a10 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:39.895748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-327b1159-ce59-410b-ad1d-5a39b1706a10 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:39.896248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-327b1159-ce59-410b-ad1d-5a39b1706a10 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:40.078535 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-327b1159-ce59-410b-ad1d-5a39b1706a10 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:40.089090 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-327b1159-ce59-410b-ad1d-5a39b1706a10 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1594 microversion: 2.1 time: 0.208610 Jul 26 15:15:40.089782 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3461/6808] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:39 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1594 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:15:42.148699 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:42.150567 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:42.151920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:15:42.159051 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e11c1692-5c15-41f6-80cb-fd5cec42665e req-6bbe4865-c211-4f88-a7fb-ee54aa9b3ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd79ad55-4dad-4e1a-a13a-20ea0a81eda9", "tag": "80ae3a97-0a5a-4576-a490-a37a71999510"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:42.175487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e11c1692-5c15-41f6-80cb-fd5cec42665e req-6bbe4865-c211-4f88-a7fb-ee54aa9b3ad5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:42.176603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e11c1692-5c15-41f6-80cb-fd5cec42665e req-6bbe4865-c211-4f88-a7fb-ee54aa9b3ad5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:42.192968 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e11c1692-5c15-41f6-80cb-fd5cec42665e req-6bbe4865-c211-4f88-a7fb-ee54aa9b3ad5 service nova] Creating event network-changed:80ae3a97-0a5a-4576-a490-a37a71999510 for instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 on n-h2-833090-9 Jul 26 15:15:42.199099 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e11c1692-5c15-41f6-80cb-fd5cec42665e req-6bbe4865-c211-4f88-a7fb-ee54aa9b3ad5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052796 Jul 26 15:15:42.200073 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3348/6809] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:15:43.619789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b157a977-abb7-4e38-b622-e71bf35c6fa8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1448274267"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:43.621126 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b157a977-abb7-4e38-b622-e71bf35c6fa8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:43.628827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b157a977-abb7-4e38-b622-e71bf35c6fa8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:43.629299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b157a977-abb7-4e38-b622-e71bf35c6fa8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:43.630107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b157a977-abb7-4e38-b622-e71bf35c6fa8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:43.630565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b157a977-abb7-4e38-b622-e71bf35c6fa8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:43.789288 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.network.security_group_api [None req-b157a977-abb7-4e38-b622-e71bf35c6fa8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Adding security group d39b781e-0228-4865-88b4-3b8c22f909c0 to port 80ae3a97-0a5a-4576-a490-a37a71999510 Jul 26 15:15:44.228463 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b157a977-abb7-4e38-b622-e71bf35c6fa8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/action" status: 202 len: 0 microversion: 2.1 time: 0.612930 Jul 26 15:15:44.230051 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3462/6810] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:15:43 2022] POST /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:15:44.253214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-877e379d-0182-42fb-8b4b-2e26f83f0085 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:15:44.254138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-877e379d-0182-42fb-8b4b-2e26f83f0085 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:15:44.265667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-877e379d-0182-42fb-8b4b-2e26f83f0085 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:44.265792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-877e379d-0182-42fb-8b4b-2e26f83f0085 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:44.266607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-877e379d-0182-42fb-8b4b-2e26f83f0085 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:44.267260 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-877e379d-0182-42fb-8b4b-2e26f83f0085 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:44.291405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1055f532-1f73-4822-92b1-75b72f8b8ac8 req-bf7183c6-a3e2-41f6-bc9f-55636a4ffcc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd79ad55-4dad-4e1a-a13a-20ea0a81eda9", "tag": "80ae3a97-0a5a-4576-a490-a37a71999510"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:15:44.324213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1055f532-1f73-4822-92b1-75b72f8b8ac8 req-bf7183c6-a3e2-41f6-bc9f-55636a4ffcc6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:15:44.325170 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1055f532-1f73-4822-92b1-75b72f8b8ac8 req-bf7183c6-a3e2-41f6-bc9f-55636a4ffcc6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:15:44.358097 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1055f532-1f73-4822-92b1-75b72f8b8ac8 req-bf7183c6-a3e2-41f6-bc9f-55636a4ffcc6 service nova] Creating event network-changed:80ae3a97-0a5a-4576-a490-a37a71999510 for instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 on n-h2-833090-9 Jul 26 15:15:44.368790 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1055f532-1f73-4822-92b1-75b72f8b8ac8 req-bf7183c6-a3e2-41f6-bc9f-55636a4ffcc6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081093 Jul 26 15:15:44.370166 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3463/6811] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:15:44.691585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-877e379d-0182-42fb-8b4b-2e26f83f0085 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:15:44.705266 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-877e379d-0182-42fb-8b4b-2e26f83f0085 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1760 microversion: 2.1 time: 0.465853 Jul 26 15:15:44.707316 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3349/6812] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:15:44 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1760 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:16:18.730392 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:16:18.731070 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:16:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:17:25.670529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:25.671345 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=12 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:25.676079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3b2bdc5d-3948-4d14-bdbe-4857eb018c8e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:17:25.678538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3b2bdc5d-3948-4d14-bdbe-4857eb018c8e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:25.687199 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b2bdc5d-3948-4d14-bdbe-4857eb018c8e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:25.687698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b2bdc5d-3948-4d14-bdbe-4857eb018c8e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:25.688547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b2bdc5d-3948-4d14-bdbe-4857eb018c8e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:25.689016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3b2bdc5d-3948-4d14-bdbe-4857eb018c8e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:25.770814 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3b2bdc5d-3948-4d14-bdbe-4857eb018c8e tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/action" status: 202 len: 0 microversion: 2.1 time: 0.103601 Jul 26 15:17:25.771674 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3464/6813] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:17:25 2022] POST /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:17:25.783805 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c0418b5-e41d-4f1e-84cf-a946d1ce711a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:25.785603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0c0418b5-e41d-4f1e-84cf-a946d1ce711a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:25.789015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:25.794506 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=8 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:17:25.805353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0418b5-e41d-4f1e-84cf-a946d1ce711a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:25.805353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0418b5-e41d-4f1e-84cf-a946d1ce711a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:25.806585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0418b5-e41d-4f1e-84cf-a946d1ce711a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:25.806800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c0418b5-e41d-4f1e-84cf-a946d1ce711a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:26.230047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0c0418b5-e41d-4f1e-84cf-a946d1ce711a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:26.239314 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c0418b5-e41d-4f1e-84cf-a946d1ce711a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1762 microversion: 2.1 time: 0.463111 Jul 26 15:17:26.240104 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3350/6814] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:25 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1762 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:27.264520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fbc96c65-427f-4999-960e-437e0b49713b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:17:27.265353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fbc96c65-427f-4999-960e-437e0b49713b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:17:27.272012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc96c65-427f-4999-960e-437e0b49713b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:27.272463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc96c65-427f-4999-960e-437e0b49713b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:27.273256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc96c65-427f-4999-960e-437e0b49713b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:17:27.273720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc96c65-427f-4999-960e-437e0b49713b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:17:27.524836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fbc96c65-427f-4999-960e-437e0b49713b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:17:27.544226 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fbc96c65-427f-4999-960e-437e0b49713b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1760 microversion: 2.1 time: 0.285145 Jul 26 15:17:27.545096 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3465/6815] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:17:27 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1760 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:17:58.342565 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:17:58.343351 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:17:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:17:58.457353 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:17:58.457950 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:17:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:18:11.532681 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:18:11.533327 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:18:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:18:42.177888 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [54fe80fa-5d54-4bb9-a76b-59290c50e610] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 15:18:42.178673 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7f3ab2a-6e11-4e90-a515-8ef793525f8a] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 15:18:42.179412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:18:42.180181 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:18:42.184474 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-49ac4f61-1ecb-467d-ac7e-9927849aec13 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1448274267"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:18:42.185014 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-49ac4f61-1ecb-467d-ac7e-9927849aec13 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:42.192496 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49ac4f61-1ecb-467d-ac7e-9927849aec13 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:42.192946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49ac4f61-1ecb-467d-ac7e-9927849aec13 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:42.193715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49ac4f61-1ecb-467d-ac7e-9927849aec13 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:42.194155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-49ac4f61-1ecb-467d-ac7e-9927849aec13 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:42.328207 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.network.security_group_api [None req-49ac4f61-1ecb-467d-ac7e-9927849aec13 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Removing security group d39b781e-0228-4865-88b4-3b8c22f909c0 from port 80ae3a97-0a5a-4576-a490-a37a71999510 Jul 26 15:18:42.972780 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-49ac4f61-1ecb-467d-ac7e-9927849aec13 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/action" status: 202 len: 0 microversion: 2.1 time: 0.795925 Jul 26 15:18:42.977031 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3351/6816] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:18:42 2022] POST /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:18:42.994703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:18:42.995509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:18:43.088596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-cd67d0fc-3b77-44d5-8146-b99401f90ebd req-4523c9d5-580c-4c31-92ba-c1198377e47c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd79ad55-4dad-4e1a-a13a-20ea0a81eda9", "tag": "80ae3a97-0a5a-4576-a490-a37a71999510"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:18:43.101315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-cd67d0fc-3b77-44d5-8146-b99401f90ebd req-4523c9d5-580c-4c31-92ba-c1198377e47c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:43.102073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-cd67d0fc-3b77-44d5-8146-b99401f90ebd req-4523c9d5-580c-4c31-92ba-c1198377e47c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:43.117635 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-cd67d0fc-3b77-44d5-8146-b99401f90ebd req-4523c9d5-580c-4c31-92ba-c1198377e47c service nova] Creating event network-changed:80ae3a97-0a5a-4576-a490-a37a71999510 for instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 on n-h2-833090-9 Jul 26 15:18:43.124916 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-cd67d0fc-3b77-44d5-8146-b99401f90ebd req-4523c9d5-580c-4c31-92ba-c1198377e47c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143488 Jul 26 15:18:43.130553 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3466/6817] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:18:44.172824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-d765086f-c609-4f13-8e31-9d7798dfc366 req-884543a4-66cd-4a17-b54d-b1a1169f1875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd79ad55-4dad-4e1a-a13a-20ea0a81eda9", "tag": "80ae3a97-0a5a-4576-a490-a37a71999510"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:18:44.187580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d765086f-c609-4f13-8e31-9d7798dfc366 req-884543a4-66cd-4a17-b54d-b1a1169f1875 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:44.187847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-d765086f-c609-4f13-8e31-9d7798dfc366 req-884543a4-66cd-4a17-b54d-b1a1169f1875 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:44.209943 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-d765086f-c609-4f13-8e31-9d7798dfc366 req-884543a4-66cd-4a17-b54d-b1a1169f1875 service nova] Creating event network-changed:80ae3a97-0a5a-4576-a490-a37a71999510 for instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 on n-h2-833090-9 Jul 26 15:18:44.221542 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] [54fe80fa-5d54-4bb9-a76b-59290c50e610] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 52042. Jul 26 15:18:44.223238 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7f3ab2a-6e11-4e90-a515-8ef793525f8a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 52044. Jul 26 15:18:44.224749 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e5df25d7-dc02-4c07-96fc-eb75ef5e8c70 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:44.225354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e5df25d7-dc02-4c07-96fc-eb75ef5e8c70 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:44.227199 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-d765086f-c609-4f13-8e31-9d7798dfc366 req-884543a4-66cd-4a17-b54d-b1a1169f1875 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058449 Jul 26 15:18:44.228373 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3352/6818] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:18:44.233789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5df25d7-dc02-4c07-96fc-eb75ef5e8c70 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:44.234274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5df25d7-dc02-4c07-96fc-eb75ef5e8c70 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:44.244366 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5df25d7-dc02-4c07-96fc-eb75ef5e8c70 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:44.244948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e5df25d7-dc02-4c07-96fc-eb75ef5e8c70 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:44.334455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-e5df25d7-dc02-4c07-96fc-eb75ef5e8c70 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lazy-loading 'services' on Instance uuid cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:18:44.431221 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e5df25d7-dc02-4c07-96fc-eb75ef5e8c70 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments/65232fb9-6904-4ed3-a15e-105e94835a86" status: 202 len: 0 microversion: 2.1 time: 0.213181 Jul 26 15:18:44.432587 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3467/6819] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 15:18:44 2022] DELETE /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments/65232fb9-6904-4ed3-a15e-105e94835a86 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:18:44.443598 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-92bfe9c2-3494-4775-b934-93852155b2e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:44.445986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-92bfe9c2-3494-4775-b934-93852155b2e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:44.453170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92bfe9c2-3494-4775-b934-93852155b2e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:44.453889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92bfe9c2-3494-4775-b934-93852155b2e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:44.454980 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92bfe9c2-3494-4775-b934-93852155b2e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:44.456579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-92bfe9c2-3494-4775-b934-93852155b2e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:44.519158 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-92bfe9c2-3494-4775-b934-93852155b2e1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081725 Jul 26 15:18:44.526275 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3353/6820] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:18:44 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:18:45.534368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-759f6a80-9afe-4b36-9440-cf7eabd68146 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:45.536840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-759f6a80-9afe-4b36-9440-cf7eabd68146 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:45.543964 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-759f6a80-9afe-4b36-9440-cf7eabd68146 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:45.544591 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-759f6a80-9afe-4b36-9440-cf7eabd68146 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:45.545667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-759f6a80-9afe-4b36-9440-cf7eabd68146 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:45.546368 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-759f6a80-9afe-4b36-9440-cf7eabd68146 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:45.578635 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-759f6a80-9afe-4b36-9440-cf7eabd68146 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049969 Jul 26 15:18:45.579311 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3468/6821] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:18:45 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:18:46.591596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5394a1ba-7799-477c-b826-c5243abf9e22 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:46.594023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5394a1ba-7799-477c-b826-c5243abf9e22 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:46.602168 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5394a1ba-7799-477c-b826-c5243abf9e22 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:46.602631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5394a1ba-7799-477c-b826-c5243abf9e22 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:46.603423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5394a1ba-7799-477c-b826-c5243abf9e22 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:46.603876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5394a1ba-7799-477c-b826-c5243abf9e22 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:46.637943 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5394a1ba-7799-477c-b826-c5243abf9e22 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050840 Jul 26 15:18:46.638545 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3354/6822] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:18:46 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:18:47.650711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1b646f05-edf9-4a5c-be9f-ca31cd183dc9 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:47.652929 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1b646f05-edf9-4a5c-be9f-ca31cd183dc9 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:47.660568 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b646f05-edf9-4a5c-be9f-ca31cd183dc9 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:47.661043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b646f05-edf9-4a5c-be9f-ca31cd183dc9 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:47.661853 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b646f05-edf9-4a5c-be9f-ca31cd183dc9 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:47.662313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1b646f05-edf9-4a5c-be9f-ca31cd183dc9 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:47.693628 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1b646f05-edf9-4a5c-be9f-ca31cd183dc9 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046734 Jul 26 15:18:47.694053 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3469/6823] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:18:47 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:18:48.707005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0a05cde6-10f0-4e61-aed4-77d5999ccc59 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:48.709209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0a05cde6-10f0-4e61-aed4-77d5999ccc59 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:48.716160 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a05cde6-10f0-4e61-aed4-77d5999ccc59 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:48.716613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a05cde6-10f0-4e61-aed4-77d5999ccc59 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:48.717389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a05cde6-10f0-4e61-aed4-77d5999ccc59 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:48.717828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a05cde6-10f0-4e61-aed4-77d5999ccc59 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:48.748842 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0a05cde6-10f0-4e61-aed4-77d5999ccc59 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046876 Jul 26 15:18:48.749410 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3355/6824] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:18:48 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:18:49.762296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-90d7c35c-39d6-4b14-938e-8efca51f00fa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:49.764447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-90d7c35c-39d6-4b14-938e-8efca51f00fa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:49.771611 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90d7c35c-39d6-4b14-938e-8efca51f00fa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:49.772121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90d7c35c-39d6-4b14-938e-8efca51f00fa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:49.772918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90d7c35c-39d6-4b14-938e-8efca51f00fa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:49.773381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-90d7c35c-39d6-4b14-938e-8efca51f00fa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:49.808684 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-90d7c35c-39d6-4b14-938e-8efca51f00fa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050393 Jul 26 15:18:49.809315 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3470/6825] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:18:49 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:18:49.823212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c621be9-60a1-417f-887f-18c5add73b07 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:49.823933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0c621be9-60a1-417f-887f-18c5add73b07 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:49.831837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c621be9-60a1-417f-887f-18c5add73b07 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:49.832317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c621be9-60a1-417f-887f-18c5add73b07 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:49.833103 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c621be9-60a1-417f-887f-18c5add73b07 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:49.833554 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0c621be9-60a1-417f-887f-18c5add73b07 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:49.911769 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-0c621be9-60a1-417f-887f-18c5add73b07 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] HTTP exception thrown: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 is not attached to volume 65232fb9-6904-4ed3-a15e-105e94835a86 Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c621be9-60a1-417f-887f-18c5add73b07 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Request method failure captured: Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: request: DELETE /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments/65232fb9-6904-4ed3-a15e-105e94835a86 HTTP/1.1 Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4ATnFUeHPvSgnUdLGKcU2Plo-IshqDwpYxU3NMkgC91OsgsLN3xMDBogSvI74KHKtrdm1uGEynaHJTI1FtO_tVJxAAZKphCbe6egnTIK3_iZ2mUaaQGQfrqpiSYdcA6KOFdH9C80ZlE7Dc6WnSPlaQJnvKbtNAAGo7uP5-B1qYNNh1w Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 201aad04f85c4d2d9720c54c8cab855f Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/201aad04f85c4d2d9720c54c8cab855f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/201aad04f85c4d2d9720c54c8cab855f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_201aad04f85c4d2d9720c54c8cab855f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/201aad04f85c4d2d9720c54c8cab855f"}]}] Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 201aad04f85c4d2d9720c54c8cab855f Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestMinimumBasicScenario-120396144-project Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 966e46004bc84db09a828c0ab09377dd Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestMinimumBasicScenario-120396144-project Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 is not attached to volume 65232fb9-6904-4ed3-a15e-105e94835a86 Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'server_id': 'cd79ad55-4dad-4e1a-a13a-20ea0a81eda9', 'id': '65232fb9-6904-4ed3-a15e-105e94835a86'} Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 65232fb9-6904-4ed3-a15e-105e94835a86. Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 is not attached to volume 65232fb9-6904-4ed3-a15e-105e94835a86 Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:18:49.912795 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:18:49.917140 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:18:49.917140 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:18:49.917140 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 is not attached to volume 65232fb9-6904-4ed3-a15e-105e94835a86 Jul 26 15:18:49.917140 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:18:49.917140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0c621be9-60a1-417f-887f-18c5add73b07 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Returning 404 to user: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 is not attached to volume 65232fb9-6904-4ed3-a15e-105e94835a86 {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:18:49.917140 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0c621be9-60a1-417f-887f-18c5add73b07 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments/65232fb9-6904-4ed3-a15e-105e94835a86" status: 404 len: 154 microversion: 2.1 time: 0.096081 Jul 26 15:18:49.917140 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3356/6826] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 15:18:49 2022] DELETE /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9/os-volume_attachments/65232fb9-6904-4ed3-a15e-105e94835a86 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:18:53.168945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cd071943-2606-46d5-bc40-5a24cb2b9571 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:53.169464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cd071943-2606-46d5-bc40-5a24cb2b9571 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:53.177829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd071943-2606-46d5-bc40-5a24cb2b9571 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:53.178304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd071943-2606-46d5-bc40-5a24cb2b9571 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:53.179108 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd071943-2606-46d5-bc40-5a24cb2b9571 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:53.179569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cd071943-2606-46d5-bc40-5a24cb2b9571 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:53.207906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cd071943-2606-46d5-bc40-5a24cb2b9571 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:18:53.297573 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cd071943-2606-46d5-bc40-5a24cb2b9571 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 204 len: 0 microversion: 2.1 time: 0.131776 Jul 26 15:18:53.299823 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3471/6827] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:18:53 2022] DELETE /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:18:53.308975 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dec29484-5a70-4572-b272-db2f334ec00f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:53.309733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dec29484-5a70-4572-b272-db2f334ec00f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:53.318405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dec29484-5a70-4572-b272-db2f334ec00f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:53.318955 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dec29484-5a70-4572-b272-db2f334ec00f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:53.319644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dec29484-5a70-4572-b272-db2f334ec00f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:53.320112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dec29484-5a70-4572-b272-db2f334ec00f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:53.501429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dec29484-5a70-4572-b272-db2f334ec00f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:18:53.510463 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dec29484-5a70-4572-b272-db2f334ec00f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1554 microversion: 2.1 time: 0.206088 Jul 26 15:18:53.511046 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3357/6828] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:18:53 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:18:54.533991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-165f876f-3b71-4f95-a3b9-932daaed4c5b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:54.534847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-165f876f-3b71-4f95-a3b9-932daaed4c5b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:54.541205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-165f876f-3b71-4f95-a3b9-932daaed4c5b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:54.541670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-165f876f-3b71-4f95-a3b9-932daaed4c5b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:54.542501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-165f876f-3b71-4f95-a3b9-932daaed4c5b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:54.543228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-165f876f-3b71-4f95-a3b9-932daaed4c5b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:54.691232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-165f876f-3b71-4f95-a3b9-932daaed4c5b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:18:54.698926 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-165f876f-3b71-4f95-a3b9-932daaed4c5b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1554 microversion: 2.1 time: 0.170346 Jul 26 15:18:54.699651 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3472/6829] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:18:54 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:18:55.575588 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7fe1b816-9671-4200-9022-8d04f2fa2d1b req-107e9a54-79fa-472c-b14b-26af002b376f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd79ad55-4dad-4e1a-a13a-20ea0a81eda9", "name": "network-vif-deleted", "tag": "80ae3a97-0a5a-4576-a490-a37a71999510"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:18:55.590695 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7fe1b816-9671-4200-9022-8d04f2fa2d1b req-107e9a54-79fa-472c-b14b-26af002b376f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:55.591233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7fe1b816-9671-4200-9022-8d04f2fa2d1b req-107e9a54-79fa-472c-b14b-26af002b376f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:55.604495 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7fe1b816-9671-4200-9022-8d04f2fa2d1b req-107e9a54-79fa-472c-b14b-26af002b376f service nova] Creating event network-vif-deleted:80ae3a97-0a5a-4576-a490-a37a71999510 for instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 on n-h2-833090-9 Jul 26 15:18:55.611117 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7fe1b816-9671-4200-9022-8d04f2fa2d1b req-107e9a54-79fa-472c-b14b-26af002b376f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042317 Jul 26 15:18:55.611703 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3358/6830] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:18:55.721202 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:55.721943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:55.729132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:55.729601 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:55.730951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:55.730951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:55.764594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:55.764977 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:55.765449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lazy-loading 'fault' on Instance uuid cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:18:55.812721 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:18:55.821014 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-42d4c63f-3976-4089-bb2e-fb9e62299693 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 200 len: 1348 microversion: 2.1 time: 0.103932 Jul 26 15:18:55.821597 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3473/6831] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:18:55 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:18:56.843586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-35828e69-7d2c-4306-88bb-daea533d276b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:56.844234 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-35828e69-7d2c-4306-88bb-daea533d276b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: cd79ad55-4dad-4e1a-a13a-20ea0a81eda9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:18:56.851542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35828e69-7d2c-4306-88bb-daea533d276b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:56.852013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35828e69-7d2c-4306-88bb-daea533d276b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:56.852798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35828e69-7d2c-4306-88bb-daea533d276b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:18:56.853241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35828e69-7d2c-4306-88bb-daea533d276b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:18:56.868197 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-35828e69-7d2c-4306-88bb-daea533d276b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] HTTP exception thrown: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 could not be found. Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-35828e69-7d2c-4306-88bb-daea533d276b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Request method failure captured: Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 HTTP/1.1 Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4ATnFUeHPvSgnUdLGKcU2Plo-IshqDwpYxU3NMkgC91OsgsLN3xMDBogSvI74KHKtrdm1uGEynaHJTI1FtO_tVJxAAZKphCbe6egnTIK3_iZ2mUaaQGQfrqpiSYdcA6KOFdH9C80ZlE7Dc6WnSPlaQJnvKbtNAAGo7uP5-B1qYNNh1w Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 201aad04f85c4d2d9720c54c8cab855f Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/201aad04f85c4d2d9720c54c8cab855f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/201aad04f85c4d2d9720c54c8cab855f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_201aad04f85c4d2d9720c54c8cab855f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/201aad04f85c4d2d9720c54c8cab855f"}]}] Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 201aad04f85c4d2d9720c54c8cab855f Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestMinimumBasicScenario-120396144-project Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 966e46004bc84db09a828c0ab09377dd Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestMinimumBasicScenario-120396144-project Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 could not be found. Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'cd79ad55-4dad-4e1a-a13a-20ea0a81eda9'} Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 could not be found. Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 could not be found. Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:18:56.869893 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:18:56.874443 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:18:56.874443 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:18:56.874443 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:18:56.874443 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:18:56.874443 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:18:56.874443 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 could not be found. Jul 26 15:18:56.874443 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:18:56.874443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-35828e69-7d2c-4306-88bb-daea533d276b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Returning 404 to user: Instance cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:18:56.874443 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-35828e69-7d2c-4306-88bb-daea533d276b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9" status: 404 len: 111 microversion: 2.1 time: 0.032330 Jul 26 15:18:56.874443 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3359/6832] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:18:56 2022] GET /compute/v2.1/servers/cd79ad55-4dad-4e1a-a13a-20ea0a81eda9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:18:56.882176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-61b24219-c5d8-4852-8062-643f791ee4e2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '.version_select at 0x7f8799443550>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:18:56.886792 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [None req-61b24219-c5d8-4852-8062-643f791ee4e2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [164a6d72-fc25-48d3-9ea9-de7d68fca0a8] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 15:18:57.896937 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [None req-61b24219-c5d8-4852-8062-643f791ee4e2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [164a6d72-fc25-48d3-9ea9-de7d68fca0a8] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 52098. Jul 26 15:18:57.919506 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-61b24219-c5d8-4852-8062-643f791ee4e2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1536894462" status: 202 len: 0 microversion: 2.1 time: 1.042635 Jul 26 15:18:57.920140 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3474/6833] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 15:18:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1536894462 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:19:07.160522 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-df8cf72b-0f8b-44f7-9746-ac5080619e4b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'create', calling method: .version_select at 0x7f8786e0a280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1383012312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqTZnIBo4PS1UqWjHtyKyh80LnvAm0L9+Z+VlYQSp/6XH66d7D9QOht+NipznODdEmR9MfT3vGrjLTVbvp3cte183+d4WcQd6iUDJx8U/wDc9AiJBm17woBUDhBPtQ96A=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:07.167212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=18 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:07.171217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=40 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:07.184841 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-df8cf72b-0f8b-44f7-9746-ac5080619e4b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Getting quotas for project 201aad04f85c4d2d9720c54c8cab855f. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:19:07.192304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-df8cf72b-0f8b-44f7-9746-ac5080619e4b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Getting quotas for user 966e46004bc84db09a828c0ab09377dd and project 201aad04f85c4d2d9720c54c8cab855f. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:19:07.222134 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-df8cf72b-0f8b-44f7-9746-ac5080619e4b tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.066207 Jul 26 15:19:07.222754 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3360/6834] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:19:07 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:19:07.275665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:07.279840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2108034695", "imageRef": "9fd776be-6e90-4c4c-b9c3-dbbef71c9d3d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1383012312", "networks": [{"uuid": "50f92da8-b3c8-4dc2-9ab3-74c3c413568f"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:07.336716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] validate_networks() for [('50f92da8-b3c8-4dc2-9ab3-74c3c413568f', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:19:07.805197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:19:07.805647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:19:07.806181 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:19:07.806658 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:19:07.807113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:19:07.817954 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:07.818429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:07.819285 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:07.819748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:07.840394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Getting quotas for project 201aad04f85c4d2d9720c54c8cab855f. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:19:07.847496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Getting quotas for user 966e46004bc84db09a828c0ab09377dd and project 201aad04f85c4d2d9720c54c8cab855f. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:19:07.864714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:19:07.867105 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9fd776be-6e90-4c4c-b9c3-dbbef71c9d3d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:19:07.920683 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-06992728-1f00-4517-bf74-7b2b417945c4 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646731 Jul 26 15:19:07.921336 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3475/6835] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:19:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:19:07.933237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b981c769-fd46-4fbe-b798-e607514f7b05 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:07.933858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b981c769-fd46-4fbe-b798-e607514f7b05 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:07.998328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b981c769-fd46-4fbe-b798-e607514f7b05 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:08.008173 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b981c769-fd46-4fbe-b798-e607514f7b05 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1259 microversion: 2.1 time: 0.078570 Jul 26 15:19:08.008899 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3361/6836] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:07 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1259 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:09.031826 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-16838c41-119e-4a4c-b11c-ffa1c5a2ab9a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:09.032596 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-16838c41-119e-4a4c-b11c-ffa1c5a2ab9a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:09.041104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16838c41-119e-4a4c-b11c-ffa1c5a2ab9a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:09.041589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16838c41-119e-4a4c-b11c-ffa1c5a2ab9a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:09.042628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16838c41-119e-4a4c-b11c-ffa1c5a2ab9a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:09.043370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16838c41-119e-4a4c-b11c-ffa1c5a2ab9a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:09.122570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-16838c41-119e-4a4c-b11c-ffa1c5a2ab9a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:09.132753 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-16838c41-119e-4a4c-b11c-ffa1c5a2ab9a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1319 microversion: 2.1 time: 0.105769 Jul 26 15:19:09.133947 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3476/6837] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:09 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:10.165247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-83005d75-87c8-4283-8e71-03407e8c1e16 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:10.165800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-83005d75-87c8-4283-8e71-03407e8c1e16 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:10.177605 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83005d75-87c8-4283-8e71-03407e8c1e16 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:10.179077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83005d75-87c8-4283-8e71-03407e8c1e16 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:10.183592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83005d75-87c8-4283-8e71-03407e8c1e16 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:10.184328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-83005d75-87c8-4283-8e71-03407e8c1e16 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:10.372816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-83005d75-87c8-4283-8e71-03407e8c1e16 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:10.386199 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-83005d75-87c8-4283-8e71-03407e8c1e16 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.224834 Jul 26 15:19:10.386832 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3362/6838] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:10 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:19:11.410173 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3999eb90-fa22-4686-a991-5eff37926664 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:11.410851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3999eb90-fa22-4686-a991-5eff37926664 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:11.425296 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3999eb90-fa22-4686-a991-5eff37926664 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:11.426081 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3999eb90-fa22-4686-a991-5eff37926664 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:11.426924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3999eb90-fa22-4686-a991-5eff37926664 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:11.427736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3999eb90-fa22-4686-a991-5eff37926664 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:11.613321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3999eb90-fa22-4686-a991-5eff37926664 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:11.625437 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3999eb90-fa22-4686-a991-5eff37926664 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.220093 Jul 26 15:19:11.627437 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3477/6839] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:11 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:19:12.658295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a9148ff5-0af0-44b3-b39f-29cb4b7b9be6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:12.660594 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a9148ff5-0af0-44b3-b39f-29cb4b7b9be6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:12.673940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9148ff5-0af0-44b3-b39f-29cb4b7b9be6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:12.675034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9148ff5-0af0-44b3-b39f-29cb4b7b9be6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:12.675883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9148ff5-0af0-44b3-b39f-29cb4b7b9be6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:12.676491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a9148ff5-0af0-44b3-b39f-29cb4b7b9be6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:12.878487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a9148ff5-0af0-44b3-b39f-29cb4b7b9be6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:12.891302 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a9148ff5-0af0-44b3-b39f-29cb4b7b9be6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.240729 Jul 26 15:19:12.892103 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3363/6840] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:12 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:13.925799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fe01a25a-9514-4060-8165-e8c7464c6b12 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:13.927154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fe01a25a-9514-4060-8165-e8c7464c6b12 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:13.938193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:13.941534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe01a25a-9514-4060-8165-e8c7464c6b12 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:13.942286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe01a25a-9514-4060-8165-e8c7464c6b12 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:13.944136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe01a25a-9514-4060-8165-e8c7464c6b12 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:13.945044 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fe01a25a-9514-4060-8165-e8c7464c6b12 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:14.127771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fe01a25a-9514-4060-8165-e8c7464c6b12 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:14.138343 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fe01a25a-9514-4060-8165-e8c7464c6b12 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.219048 Jul 26 15:19:14.138937 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3478/6841] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:13 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:15.160689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bba07f56-99b8-4849-98b9-334d5b6f8c5a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:15.161491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bba07f56-99b8-4849-98b9-334d5b6f8c5a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:15.169405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bba07f56-99b8-4849-98b9-334d5b6f8c5a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:15.169926 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bba07f56-99b8-4849-98b9-334d5b6f8c5a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:15.170735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bba07f56-99b8-4849-98b9-334d5b6f8c5a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:15.171189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bba07f56-99b8-4849-98b9-334d5b6f8c5a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:15.367881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bba07f56-99b8-4849-98b9-334d5b6f8c5a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:15.380336 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bba07f56-99b8-4849-98b9-334d5b6f8c5a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.225134 Jul 26 15:19:15.381062 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3364/6842] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:15 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:19:16.404879 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-699d40d1-0377-45a6-9a4d-66430e178b63 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:16.405828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-699d40d1-0377-45a6-9a4d-66430e178b63 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:16.421386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-699d40d1-0377-45a6-9a4d-66430e178b63 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:16.422247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-699d40d1-0377-45a6-9a4d-66430e178b63 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:16.424306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-699d40d1-0377-45a6-9a4d-66430e178b63 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:16.425218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-699d40d1-0377-45a6-9a4d-66430e178b63 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:16.654237 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-699d40d1-0377-45a6-9a4d-66430e178b63 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:16.662864 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-699d40d1-0377-45a6-9a4d-66430e178b63 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.262637 Jul 26 15:19:16.663737 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3479/6843] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:16 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:19:17.688748 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-94868097-3293-4c42-b196-691ae6a17268 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:17.689596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-94868097-3293-4c42-b196-691ae6a17268 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:17.696028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94868097-3293-4c42-b196-691ae6a17268 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:17.696545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94868097-3293-4c42-b196-691ae6a17268 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:17.697354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94868097-3293-4c42-b196-691ae6a17268 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:17.697806 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-94868097-3293-4c42-b196-691ae6a17268 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:17.876335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-94868097-3293-4c42-b196-691ae6a17268 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:17.886787 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-94868097-3293-4c42-b196-691ae6a17268 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.203311 Jul 26 15:19:17.900613 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3365/6844] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:17 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:18.591147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-805b1e74-8bf8-4954-9db0-eed5a10458ad req-42a5c0de-5562-4527-b1e1-6876db68aefc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d", "tag": "325e7445-8b2e-4f1f-9cb3-54a585089f00"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:18.600923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:18.602074 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:18.635729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-805b1e74-8bf8-4954-9db0-eed5a10458ad req-42a5c0de-5562-4527-b1e1-6876db68aefc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:18.636238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-805b1e74-8bf8-4954-9db0-eed5a10458ad req-42a5c0de-5562-4527-b1e1-6876db68aefc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:18.654673 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-805b1e74-8bf8-4954-9db0-eed5a10458ad req-42a5c0de-5562-4527-b1e1-6876db68aefc service nova] Creating event network-changed:325e7445-8b2e-4f1f-9cb3-54a585089f00 for instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d on n-h2-833090-9 Jul 26 15:19:18.666608 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-805b1e74-8bf8-4954-9db0-eed5a10458ad req-42a5c0de-5562-4527-b1e1-6876db68aefc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079221 Jul 26 15:19:18.666608 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3480/6845] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:19:18.916501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-50dbb663-3faa-47c3-bbd4-05a9b15a8867 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:18.917659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-50dbb663-3faa-47c3-bbd4-05a9b15a8867 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:18.924058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:18.939481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-50dbb663-3faa-47c3-bbd4-05a9b15a8867 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:18.939933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-50dbb663-3faa-47c3-bbd4-05a9b15a8867 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:18.940743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-50dbb663-3faa-47c3-bbd4-05a9b15a8867 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:18.941190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-50dbb663-3faa-47c3-bbd4-05a9b15a8867 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:19.152917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-50dbb663-3faa-47c3-bbd4-05a9b15a8867 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:19.163742 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-50dbb663-3faa-47c3-bbd4-05a9b15a8867 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.258562 Jul 26 15:19:19.164502 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3366/6846] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:18 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:20.188135 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1d9e9f3d-c0bd-4d19-9789-2b4aa22930d0 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:20.189144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1d9e9f3d-c0bd-4d19-9789-2b4aa22930d0 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:20.195794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d9e9f3d-c0bd-4d19-9789-2b4aa22930d0 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:20.196299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d9e9f3d-c0bd-4d19-9789-2b4aa22930d0 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:20.197124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d9e9f3d-c0bd-4d19-9789-2b4aa22930d0 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:20.197567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1d9e9f3d-c0bd-4d19-9789-2b4aa22930d0 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:20.428164 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1d9e9f3d-c0bd-4d19-9789-2b4aa22930d0 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:20.442387 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1d9e9f3d-c0bd-4d19-9789-2b4aa22930d0 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.259327 Jul 26 15:19:20.452685 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3481/6847] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:20 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:21.464795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4daaf772-eb92-4ebc-ad33-87554a340d72 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:21.465430 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4daaf772-eb92-4ebc-ad33-87554a340d72 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:21.474060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4daaf772-eb92-4ebc-ad33-87554a340d72 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:21.474524 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4daaf772-eb92-4ebc-ad33-87554a340d72 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:21.475321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4daaf772-eb92-4ebc-ad33-87554a340d72 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:21.475770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4daaf772-eb92-4ebc-ad33-87554a340d72 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:21.627184 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4daaf772-eb92-4ebc-ad33-87554a340d72 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:21.635500 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4daaf772-eb92-4ebc-ad33-87554a340d72 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.174616 Jul 26 15:19:21.636111 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3367/6848] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:21 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:22.656715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ccc4d43c-b198-426c-aa05-0a02a5fb8bde tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:22.657676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ccc4d43c-b198-426c-aa05-0a02a5fb8bde tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:22.664753 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccc4d43c-b198-426c-aa05-0a02a5fb8bde tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:22.665229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccc4d43c-b198-426c-aa05-0a02a5fb8bde tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:22.666037 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccc4d43c-b198-426c-aa05-0a02a5fb8bde tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:22.666498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ccc4d43c-b198-426c-aa05-0a02a5fb8bde tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:22.820414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ccc4d43c-b198-426c-aa05-0a02a5fb8bde tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:22.828563 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ccc4d43c-b198-426c-aa05-0a02a5fb8bde tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.175627 Jul 26 15:19:22.829777 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3482/6849] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:22 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:23.851832 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eb36503a-f799-4afb-8957-baf33219a0a5 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:23.852505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-eb36503a-f799-4afb-8957-baf33219a0a5 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:23.860538 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb36503a-f799-4afb-8957-baf33219a0a5 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:23.861167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb36503a-f799-4afb-8957-baf33219a0a5 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:23.862437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb36503a-f799-4afb-8957-baf33219a0a5 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:23.862583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-eb36503a-f799-4afb-8957-baf33219a0a5 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:24.012932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-eb36503a-f799-4afb-8957-baf33219a0a5 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:24.022010 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eb36503a-f799-4afb-8957-baf33219a0a5 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.174155 Jul 26 15:19:24.022614 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3368/6850] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:23 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:24.619819 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e57c75ea-2cff-43a1-a3a0-601c0035be5e req-9dd05669-239f-40ae-b001-847d326696e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d", "name": "network-vif-plugged", "status": "completed", "tag": "325e7445-8b2e-4f1f-9cb3-54a585089f00"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:24.632027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e57c75ea-2cff-43a1-a3a0-601c0035be5e req-9dd05669-239f-40ae-b001-847d326696e4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:24.632587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e57c75ea-2cff-43a1-a3a0-601c0035be5e req-9dd05669-239f-40ae-b001-847d326696e4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:24.646520 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e57c75ea-2cff-43a1-a3a0-601c0035be5e req-9dd05669-239f-40ae-b001-847d326696e4 service nova] Creating event network-vif-plugged:325e7445-8b2e-4f1f-9cb3-54a585089f00 for instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d on n-h2-833090-9 Jul 26 15:19:24.651748 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e57c75ea-2cff-43a1-a3a0-601c0035be5e req-9dd05669-239f-40ae-b001-847d326696e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097815 Jul 26 15:19:24.652407 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3483/6851] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:19:25.043843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-01b41171-c242-451d-9ca5-503bf9b16626 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:25.044550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-01b41171-c242-451d-9ca5-503bf9b16626 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:25.052789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b41171-c242-451d-9ca5-503bf9b16626 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:25.053250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b41171-c242-451d-9ca5-503bf9b16626 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:25.054032 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b41171-c242-451d-9ca5-503bf9b16626 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:25.054477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01b41171-c242-451d-9ca5-503bf9b16626 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:25.199012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-01b41171-c242-451d-9ca5-503bf9b16626 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:25.208626 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-01b41171-c242-451d-9ca5-503bf9b16626 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1359 microversion: 2.1 time: 0.168977 Jul 26 15:19:25.209241 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3369/6852] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:25 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:26.239873 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ea2649fe-1bef-4c7d-a381-228f36462740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:26.241037 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ea2649fe-1bef-4c7d-a381-228f36462740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:26.249771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea2649fe-1bef-4c7d-a381-228f36462740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:26.250439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea2649fe-1bef-4c7d-a381-228f36462740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:26.252094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea2649fe-1bef-4c7d-a381-228f36462740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:26.252646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ea2649fe-1bef-4c7d-a381-228f36462740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:26.420950 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ea2649fe-1bef-4c7d-a381-228f36462740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:26.429128 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ea2649fe-1bef-4c7d-a381-228f36462740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1550 microversion: 2.1 time: 0.197153 Jul 26 15:19:26.430078 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3484/6853] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:26 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1550 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:26.451485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1e1fe65f-d60c-4334-9f87-aa2106c3536d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:26.452245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1e1fe65f-d60c-4334-9f87-aa2106c3536d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:26.460529 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e1fe65f-d60c-4334-9f87-aa2106c3536d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:26.460994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e1fe65f-d60c-4334-9f87-aa2106c3536d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:26.461818 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e1fe65f-d60c-4334-9f87-aa2106c3536d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:26.462291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e1fe65f-d60c-4334-9f87-aa2106c3536d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:26.612278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1e1fe65f-d60c-4334-9f87-aa2106c3536d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:26.626916 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1e1fe65f-d60c-4334-9f87-aa2106c3536d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1550 microversion: 2.1 time: 0.179467 Jul 26 15:19:26.627500 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3370/6854] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:26 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1550 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:26.648033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6caceb83-0f56-43c1-bd61-202ecbcaa033 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:26.652795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6caceb83-0f56-43c1-bd61-202ecbcaa033 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:26.653628 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6caceb83-0f56-43c1-bd61-202ecbcaa033 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Searching by: {'deleted': False, 'project_id': '201aad04f85c4d2d9720c54c8cab855f'} {{(pid=119479) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 15:19:26.660249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6caceb83-0f56-43c1-bd61-202ecbcaa033 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:26.660725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6caceb83-0f56-43c1-bd61-202ecbcaa033 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:26.661554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6caceb83-0f56-43c1-bd61-202ecbcaa033 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:26.662020 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6caceb83-0f56-43c1-bd61-202ecbcaa033 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:26.690729 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.multi_cell_list [None req-6caceb83-0f56-43c1-bd61-202ecbcaa033 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119479) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 15:19:26.723869 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6caceb83-0f56-43c1-bd61-202ecbcaa033 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.080041 Jul 26 15:19:26.724916 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3485/6855] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Jul 26 15:19:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:19:26.738419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ca747d31-b02d-4725-85f6-08bbea04f3ab tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:26.739048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ca747d31-b02d-4725-85f6-08bbea04f3ab tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:26.746308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca747d31-b02d-4725-85f6-08bbea04f3ab tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:26.747037 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca747d31-b02d-4725-85f6-08bbea04f3ab tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:26.747834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca747d31-b02d-4725-85f6-08bbea04f3ab tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:26.748309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ca747d31-b02d-4725-85f6-08bbea04f3ab tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:26.890222 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ca747d31-b02d-4725-85f6-08bbea04f3ab tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:26.899057 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ca747d31-b02d-4725-85f6-08bbea04f3ab tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1550 microversion: 2.1 time: 0.166317 Jul 26 15:19:26.899716 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3371/6856] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:26 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:28.477423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-aa478d3e-c3be-4379-97c6-d09e43bce238 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "322d84b0-040a-44bb-bfe8-bb8762ca635c"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:28.479925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-aa478d3e-c3be-4379-97c6-d09e43bce238 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:28.489501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa478d3e-c3be-4379-97c6-d09e43bce238 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:28.489970 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa478d3e-c3be-4379-97c6-d09e43bce238 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:28.490769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa478d3e-c3be-4379-97c6-d09e43bce238 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:28.491226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-aa478d3e-c3be-4379-97c6-d09e43bce238 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:28.759600 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-aa478d3e-c3be-4379-97c6-d09e43bce238 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285913 Jul 26 15:19:28.760236 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3486/6857] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Jul 26 15:19:28 2022] POST /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:19:38.740621 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:19:38.741293 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:19:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:19:39.653931 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-04e85fdd-e21f-45ef-9a76-e455a5713740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:39.654684 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-04e85fdd-e21f-45ef-9a76-e455a5713740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:39.657887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:39.658563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=60 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:39.665644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04e85fdd-e21f-45ef-9a76-e455a5713740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:39.666171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04e85fdd-e21f-45ef-9a76-e455a5713740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:39.666967 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04e85fdd-e21f-45ef-9a76-e455a5713740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:39.667418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-04e85fdd-e21f-45ef-9a76-e455a5713740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:39.815330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-04e85fdd-e21f-45ef-9a76-e455a5713740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:39.824076 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-04e85fdd-e21f-45ef-9a76-e455a5713740 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1596 microversion: 2.1 time: 0.173762 Jul 26 15:19:39.827193 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3372/6858] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:39 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1596 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:19:41.607225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:41.608233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=17 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:41.609145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:19:41.616746 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f2816494-62a6-40a5-a87a-6bc90f33526b req-5b126317-02fd-4f0a-ac4c-efd30a56a6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d", "tag": "325e7445-8b2e-4f1f-9cb3-54a585089f00"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:41.632736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f2816494-62a6-40a5-a87a-6bc90f33526b req-5b126317-02fd-4f0a-ac4c-efd30a56a6ee service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:41.633525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f2816494-62a6-40a5-a87a-6bc90f33526b req-5b126317-02fd-4f0a-ac4c-efd30a56a6ee service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:41.648475 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f2816494-62a6-40a5-a87a-6bc90f33526b req-5b126317-02fd-4f0a-ac4c-efd30a56a6ee service nova] Creating event network-changed:325e7445-8b2e-4f1f-9cb3-54a585089f00 for instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d on n-h2-833090-9 Jul 26 15:19:41.654379 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f2816494-62a6-40a5-a87a-6bc90f33526b req-5b126317-02fd-4f0a-ac4c-efd30a56a6ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048007 Jul 26 15:19:41.654379 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3487/6859] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:19:42.999795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0a539119-8283-48b3-8404-94bc24ac365a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2063820177"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:43.000863 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0a539119-8283-48b3-8404-94bc24ac365a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:43.008998 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a539119-8283-48b3-8404-94bc24ac365a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:43.009458 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a539119-8283-48b3-8404-94bc24ac365a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:43.010251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a539119-8283-48b3-8404-94bc24ac365a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:43.010694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0a539119-8283-48b3-8404-94bc24ac365a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:43.158412 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.network.security_group_api [None req-0a539119-8283-48b3-8404-94bc24ac365a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Adding security group 5577ed1a-7e86-49a5-92fa-69c4cc8c002a to port 325e7445-8b2e-4f1f-9cb3-54a585089f00 Jul 26 15:19:43.544777 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0a539119-8283-48b3-8404-94bc24ac365a tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/action" status: 202 len: 0 microversion: 2.1 time: 0.549402 Jul 26 15:19:43.545428 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3373/6860] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:19:42 2022] POST /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:19:43.558331 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d24c22ae-b286-42f8-a916-4ad2e27ba406 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:19:43.561702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d24c22ae-b286-42f8-a916-4ad2e27ba406 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:19:43.571719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d24c22ae-b286-42f8-a916-4ad2e27ba406 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:43.572492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d24c22ae-b286-42f8-a916-4ad2e27ba406 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:43.574112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d24c22ae-b286-42f8-a916-4ad2e27ba406 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:43.575085 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d24c22ae-b286-42f8-a916-4ad2e27ba406 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:43.707432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3c18b3e2-6289-47c6-90d3-7341d18d7c1e req-7214dc1e-0a39-4ec1-aa4a-225d1cecb6be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d", "tag": "325e7445-8b2e-4f1f-9cb3-54a585089f00"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:19:43.721443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3c18b3e2-6289-47c6-90d3-7341d18d7c1e req-7214dc1e-0a39-4ec1-aa4a-225d1cecb6be service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:19:43.722153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3c18b3e2-6289-47c6-90d3-7341d18d7c1e req-7214dc1e-0a39-4ec1-aa4a-225d1cecb6be service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:19:43.737321 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3c18b3e2-6289-47c6-90d3-7341d18d7c1e req-7214dc1e-0a39-4ec1-aa4a-225d1cecb6be service nova] Creating event network-changed:325e7445-8b2e-4f1f-9cb3-54a585089f00 for instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d on n-h2-833090-9 Jul 26 15:19:43.744745 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3c18b3e2-6289-47c6-90d3-7341d18d7c1e req-7214dc1e-0a39-4ec1-aa4a-225d1cecb6be service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052932 Jul 26 15:19:43.746630 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3374/6861] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:19:43.896671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d24c22ae-b286-42f8-a916-4ad2e27ba406 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:19:43.910820 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d24c22ae-b286-42f8-a916-4ad2e27ba406 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1760 microversion: 2.1 time: 0.360015 Jul 26 15:19:43.912069 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3488/6862] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:19:43 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1760 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:06.619976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:06.620747 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=12 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:06.677701 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-73a7747d-1e5e-4feb-ac69-772820236129 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:20:06.680543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-73a7747d-1e5e-4feb-ac69-772820236129 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:06.690361 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73a7747d-1e5e-4feb-ac69-772820236129 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:06.690820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73a7747d-1e5e-4feb-ac69-772820236129 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:06.691599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73a7747d-1e5e-4feb-ac69-772820236129 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:06.692060 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-73a7747d-1e5e-4feb-ac69-772820236129 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:06.772438 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-73a7747d-1e5e-4feb-ac69-772820236129 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/action" status: 202 len: 0 microversion: 2.1 time: 0.154407 Jul 26 15:20:06.776468 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3375/6863] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:20:06 2022] POST /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:20:06.782167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-952908f1-20aa-4aee-afea-807a82867acb tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:06.782762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-952908f1-20aa-4aee-afea-807a82867acb tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:06.789864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:06.790737 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:06.792454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-952908f1-20aa-4aee-afea-807a82867acb tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:06.793052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-952908f1-20aa-4aee-afea-807a82867acb tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:06.794371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-952908f1-20aa-4aee-afea-807a82867acb tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:06.794851 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-952908f1-20aa-4aee-afea-807a82867acb tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:07.073196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-952908f1-20aa-4aee-afea-807a82867acb tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:07.082341 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-952908f1-20aa-4aee-afea-807a82867acb tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1752 microversion: 2.1 time: 0.304400 Jul 26 15:20:07.082936 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3489/6864] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:06 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1752 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:08.106058 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7623570f-c0a1-400f-9e4c-b70f29aaa08d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:08.106840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7623570f-c0a1-400f-9e4c-b70f29aaa08d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:08.113880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7623570f-c0a1-400f-9e4c-b70f29aaa08d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:08.114333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7623570f-c0a1-400f-9e4c-b70f29aaa08d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:08.115106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7623570f-c0a1-400f-9e4c-b70f29aaa08d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:08.115542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7623570f-c0a1-400f-9e4c-b70f29aaa08d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:08.265973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7623570f-c0a1-400f-9e4c-b70f29aaa08d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:08.274423 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7623570f-c0a1-400f-9e4c-b70f29aaa08d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.173574 Jul 26 15:20:08.275008 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3376/6865] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:08 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:20:09.296538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-33b50683-7177-405a-8fbf-cdfbba8f4420 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:09.297203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-33b50683-7177-405a-8fbf-cdfbba8f4420 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:09.305098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b50683-7177-405a-8fbf-cdfbba8f4420 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:09.305569 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b50683-7177-405a-8fbf-cdfbba8f4420 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:09.306370 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b50683-7177-405a-8fbf-cdfbba8f4420 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:09.306830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b50683-7177-405a-8fbf-cdfbba8f4420 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:09.462840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-33b50683-7177-405a-8fbf-cdfbba8f4420 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:09.471129 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-33b50683-7177-405a-8fbf-cdfbba8f4420 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.178847 Jul 26 15:20:09.471709 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3490/6866] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:09 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:10.493289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f8d2c77d-f95b-4745-a354-900b130d1e44 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:10.493948 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f8d2c77d-f95b-4745-a354-900b130d1e44 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:10.502188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8d2c77d-f95b-4745-a354-900b130d1e44 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:10.502644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8d2c77d-f95b-4745-a354-900b130d1e44 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:10.503420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8d2c77d-f95b-4745-a354-900b130d1e44 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:10.503859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f8d2c77d-f95b-4745-a354-900b130d1e44 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:10.661269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f8d2c77d-f95b-4745-a354-900b130d1e44 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:10.669741 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f8d2c77d-f95b-4745-a354-900b130d1e44 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.180868 Jul 26 15:20:10.670315 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3377/6867] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:10 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:11.691765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8da73382-d415-4800-a281-df050a789c2f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:11.692339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8da73382-d415-4800-a281-df050a789c2f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:11.699382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8da73382-d415-4800-a281-df050a789c2f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:11.699860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8da73382-d415-4800-a281-df050a789c2f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:11.700670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8da73382-d415-4800-a281-df050a789c2f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:11.701128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8da73382-d415-4800-a281-df050a789c2f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:11.852805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8da73382-d415-4800-a281-df050a789c2f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:11.860918 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8da73382-d415-4800-a281-df050a789c2f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.174014 Jul 26 15:20:11.861514 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3491/6868] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:11 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:12.881994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-feb88923-7bd8-4bd2-b224-dc3b696d4d58 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:12.882624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-feb88923-7bd8-4bd2-b224-dc3b696d4d58 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:12.889621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feb88923-7bd8-4bd2-b224-dc3b696d4d58 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:12.890084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feb88923-7bd8-4bd2-b224-dc3b696d4d58 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:12.890866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feb88923-7bd8-4bd2-b224-dc3b696d4d58 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:12.891369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-feb88923-7bd8-4bd2-b224-dc3b696d4d58 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:13.044119 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-feb88923-7bd8-4bd2-b224-dc3b696d4d58 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:13.053298 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-feb88923-7bd8-4bd2-b224-dc3b696d4d58 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.175204 Jul 26 15:20:13.053879 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3378/6869] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:12 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:14.074997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c7ad9a9e-6b78-476c-9ffb-b3e18004a452 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:14.075833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c7ad9a9e-6b78-476c-9ffb-b3e18004a452 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:14.083692 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7ad9a9e-6b78-476c-9ffb-b3e18004a452 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:14.084206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7ad9a9e-6b78-476c-9ffb-b3e18004a452 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:14.084991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7ad9a9e-6b78-476c-9ffb-b3e18004a452 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:14.085453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c7ad9a9e-6b78-476c-9ffb-b3e18004a452 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:14.234223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c7ad9a9e-6b78-476c-9ffb-b3e18004a452 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:14.243634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c7ad9a9e-6b78-476c-9ffb-b3e18004a452 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.172780 Jul 26 15:20:14.244238 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3492/6870] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:14 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:15.265626 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6356b64-70ca-4d0c-94ab-52957d0d3878 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:15.266372 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6356b64-70ca-4d0c-94ab-52957d0d3878 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:15.272834 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6356b64-70ca-4d0c-94ab-52957d0d3878 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:15.273292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6356b64-70ca-4d0c-94ab-52957d0d3878 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:15.274068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6356b64-70ca-4d0c-94ab-52957d0d3878 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:15.274542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6356b64-70ca-4d0c-94ab-52957d0d3878 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:15.424923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c6356b64-70ca-4d0c-94ab-52957d0d3878 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:15.433195 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6356b64-70ca-4d0c-94ab-52957d0d3878 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.171467 Jul 26 15:20:15.433842 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3379/6871] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:15 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:16.455369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-72e837bf-885b-4dce-af81-8c19f29dc9a1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:16.456033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-72e837bf-885b-4dce-af81-8c19f29dc9a1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:16.462984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-72e837bf-885b-4dce-af81-8c19f29dc9a1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:16.463462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-72e837bf-885b-4dce-af81-8c19f29dc9a1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:16.464277 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-72e837bf-885b-4dce-af81-8c19f29dc9a1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:16.464747 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-72e837bf-885b-4dce-af81-8c19f29dc9a1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:16.613674 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-72e837bf-885b-4dce-af81-8c19f29dc9a1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:16.623057 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-72e837bf-885b-4dce-af81-8c19f29dc9a1 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.171709 Jul 26 15:20:16.623642 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3493/6872] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:16 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:17.645913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-97098c65-b15f-4115-a425-9202b8a0ee09 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:17.646536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-97098c65-b15f-4115-a425-9202b8a0ee09 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:17.653667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97098c65-b15f-4115-a425-9202b8a0ee09 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:17.654122 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97098c65-b15f-4115-a425-9202b8a0ee09 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:17.654900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97098c65-b15f-4115-a425-9202b8a0ee09 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:17.655341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97098c65-b15f-4115-a425-9202b8a0ee09 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:17.807744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-97098c65-b15f-4115-a425-9202b8a0ee09 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:17.816920 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-97098c65-b15f-4115-a425-9202b8a0ee09 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.175868 Jul 26 15:20:17.817527 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3380/6873] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:17 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:18.838333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5c33031a-b2e5-449a-8b0a-93e56b6c103d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:18.838991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5c33031a-b2e5-449a-8b0a-93e56b6c103d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:18.847034 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c33031a-b2e5-449a-8b0a-93e56b6c103d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:18.847511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c33031a-b2e5-449a-8b0a-93e56b6c103d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:18.848397 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c33031a-b2e5-449a-8b0a-93e56b6c103d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:18.848859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c33031a-b2e5-449a-8b0a-93e56b6c103d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:19.013284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5c33031a-b2e5-449a-8b0a-93e56b6c103d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:19.022972 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5c33031a-b2e5-449a-8b0a-93e56b6c103d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.188695 Jul 26 15:20:19.023569 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3494/6874] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:18 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:20.044993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-34587a40-1249-4df0-b21f-e7e977ed43c6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:20.045607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-34587a40-1249-4df0-b21f-e7e977ed43c6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:20.056512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34587a40-1249-4df0-b21f-e7e977ed43c6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:20.057062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34587a40-1249-4df0-b21f-e7e977ed43c6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:20.058042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34587a40-1249-4df0-b21f-e7e977ed43c6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:20.058718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34587a40-1249-4df0-b21f-e7e977ed43c6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:20.248744 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-34587a40-1249-4df0-b21f-e7e977ed43c6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:20.258486 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-34587a40-1249-4df0-b21f-e7e977ed43c6 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.217763 Jul 26 15:20:20.259233 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3381/6875] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:20 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:21.282778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ba7ffe35-9bf2-4bb6-9812-fe3fbd7ac36d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:21.283416 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ba7ffe35-9bf2-4bb6-9812-fe3fbd7ac36d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:21.290589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba7ffe35-9bf2-4bb6-9812-fe3fbd7ac36d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:21.291062 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba7ffe35-9bf2-4bb6-9812-fe3fbd7ac36d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:21.291854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba7ffe35-9bf2-4bb6-9812-fe3fbd7ac36d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:21.292343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ba7ffe35-9bf2-4bb6-9812-fe3fbd7ac36d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:21.449318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ba7ffe35-9bf2-4bb6-9812-fe3fbd7ac36d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:21.458103 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ba7ffe35-9bf2-4bb6-9812-fe3fbd7ac36d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.179499 Jul 26 15:20:21.458684 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3495/6876] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:21 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:22.480864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fe9c1fb5-fe1b-4311-9bac-c9584988bbfa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:22.481491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fe9c1fb5-fe1b-4311-9bac-c9584988bbfa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:22.488619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe9c1fb5-fe1b-4311-9bac-c9584988bbfa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:22.489079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe9c1fb5-fe1b-4311-9bac-c9584988bbfa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:22.489866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe9c1fb5-fe1b-4311-9bac-c9584988bbfa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:22.490448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fe9c1fb5-fe1b-4311-9bac-c9584988bbfa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:22.642502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fe9c1fb5-fe1b-4311-9bac-c9584988bbfa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:22.651699 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fe9c1fb5-fe1b-4311-9bac-c9584988bbfa tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1757 microversion: 2.1 time: 0.174965 Jul 26 15:20:22.652442 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3382/6877] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:22 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:23.681178 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d1137ff4-d858-4d47-8e2c-31c8cc584c8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:23.682414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d1137ff4-d858-4d47-8e2c-31c8cc584c8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:23.695530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1137ff4-d858-4d47-8e2c-31c8cc584c8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:23.696363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1137ff4-d858-4d47-8e2c-31c8cc584c8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:23.697787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1137ff4-d858-4d47-8e2c-31c8cc584c8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:23.698619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d1137ff4-d858-4d47-8e2c-31c8cc584c8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:23.870534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d1137ff4-d858-4d47-8e2c-31c8cc584c8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:20:23.880871 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d1137ff4-d858-4d47-8e2c-31c8cc584c8d tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1760 microversion: 2.1 time: 0.206374 Jul 26 15:20:23.881467 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3496/6878] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:20:23 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1760 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:20:56.846029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7854ce2d-e2c4-493f-852a-3774b39fa220 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2063820177"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:20:56.846719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7854ce2d-e2c4-493f-852a-3774b39fa220 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:56.849941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=16 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:56.850613 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:56.857502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7854ce2d-e2c4-493f-852a-3774b39fa220 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:56.857973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7854ce2d-e2c4-493f-852a-3774b39fa220 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:56.858957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7854ce2d-e2c4-493f-852a-3774b39fa220 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:56.859454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7854ce2d-e2c4-493f-852a-3774b39fa220 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:57.004299 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.network.security_group_api [None req-7854ce2d-e2c4-493f-852a-3774b39fa220 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Removing security group 5577ed1a-7e86-49a5-92fa-69c4cc8c002a from port 325e7445-8b2e-4f1f-9cb3-54a585089f00 Jul 26 15:20:57.366942 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7854ce2d-e2c4-493f-852a-3774b39fa220 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "POST /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/action" status: 202 len: 0 microversion: 2.1 time: 0.527233 Jul 26 15:20:57.369401 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3383/6879] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:20:56 2022] POST /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:20:57.382139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4bc0b31e-ba3b-4cf8-8b50-6a510caec400 req-e0f29afd-60a4-422b-b509-871b8b1e8587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d", "tag": "325e7445-8b2e-4f1f-9cb3-54a585089f00"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:20:57.398960 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=16 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:57.400203 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=48 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:20:57.402498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4bc0b31e-ba3b-4cf8-8b50-6a510caec400 req-e0f29afd-60a4-422b-b509-871b8b1e8587 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:57.402959 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4bc0b31e-ba3b-4cf8-8b50-6a510caec400 req-e0f29afd-60a4-422b-b509-871b8b1e8587 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:57.442430 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4bc0b31e-ba3b-4cf8-8b50-6a510caec400 req-e0f29afd-60a4-422b-b509-871b8b1e8587 service nova] Creating event network-changed:325e7445-8b2e-4f1f-9cb3-54a585089f00 for instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d on n-h2-833090-9 Jul 26 15:20:57.447922 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4bc0b31e-ba3b-4cf8-8b50-6a510caec400 req-e0f29afd-60a4-422b-b509-871b8b1e8587 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072916 Jul 26 15:20:57.448955 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3497/6880] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:20:58.898850 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e7683960-982c-48e7-921f-ed74ecdc6889 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:58.899415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e7683960-982c-48e7-921f-ed74ecdc6889 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:58.906364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7683960-982c-48e7-921f-ed74ecdc6889 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:58.906836 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7683960-982c-48e7-921f-ed74ecdc6889 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:58.907632 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7683960-982c-48e7-921f-ed74ecdc6889 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:58.908116 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e7683960-982c-48e7-921f-ed74ecdc6889 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:58.971668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-3c115243-75f8-4c7b-a159-1304b32558f2 req-17846395-5f8c-4655-8d1b-85c844a17faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d", "tag": "325e7445-8b2e-4f1f-9cb3-54a585089f00"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:20:58.987349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3c115243-75f8-4c7b-a159-1304b32558f2 req-17846395-5f8c-4655-8d1b-85c844a17faf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:58.988216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3c115243-75f8-4c7b-a159-1304b32558f2 req-17846395-5f8c-4655-8d1b-85c844a17faf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:59.003184 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-3c115243-75f8-4c7b-a159-1304b32558f2 req-17846395-5f8c-4655-8d1b-85c844a17faf service nova] Creating event network-changed:325e7445-8b2e-4f1f-9cb3-54a585089f00 for instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d on n-h2-833090-9 Jul 26 15:20:59.008934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-e7683960-982c-48e7-921f-ed74ecdc6889 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lazy-loading 'services' on Instance uuid c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:20:59.009203 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-3c115243-75f8-4c7b-a159-1304b32558f2 req-17846395-5f8c-4655-8d1b-85c844a17faf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115022 Jul 26 15:20:59.009659 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3498/6881] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:20:59.094764 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e7683960-982c-48e7-921f-ed74ecdc6889 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments/322d84b0-040a-44bb-bfe8-bb8762ca635c" status: 202 len: 0 microversion: 2.1 time: 0.207585 Jul 26 15:20:59.095791 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3384/6882] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 15:20:58 2022] DELETE /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments/322d84b0-040a-44bb-bfe8-bb8762ca635c => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:20:59.106802 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e00874fe-d20a-4cde-b658-92ff18b6fd56 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:20:59.110391 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e00874fe-d20a-4cde-b658-92ff18b6fd56 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:20:59.119720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e00874fe-d20a-4cde-b658-92ff18b6fd56 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:59.120597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e00874fe-d20a-4cde-b658-92ff18b6fd56 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:59.121643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e00874fe-d20a-4cde-b658-92ff18b6fd56 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:20:59.122301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e00874fe-d20a-4cde-b658-92ff18b6fd56 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:20:59.167146 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e00874fe-d20a-4cde-b658-92ff18b6fd56 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066175 Jul 26 15:20:59.172601 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3499/6883] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:20:59 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:21:00.182265 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-717ba3c4-1949-41e9-8a74-efcf55b349d8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:00.186252 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-717ba3c4-1949-41e9-8a74-efcf55b349d8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:00.194356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-717ba3c4-1949-41e9-8a74-efcf55b349d8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:00.194959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-717ba3c4-1949-41e9-8a74-efcf55b349d8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:00.195756 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-717ba3c4-1949-41e9-8a74-efcf55b349d8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:00.196327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-717ba3c4-1949-41e9-8a74-efcf55b349d8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:00.228831 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-717ba3c4-1949-41e9-8a74-efcf55b349d8 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051886 Jul 26 15:21:00.229614 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3385/6884] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:21:00 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:21:01.241907 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5aee9040-9deb-42c8-bca6-d5ad411b73f2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:01.244316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5aee9040-9deb-42c8-bca6-d5ad411b73f2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:01.251710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5aee9040-9deb-42c8-bca6-d5ad411b73f2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:01.252860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5aee9040-9deb-42c8-bca6-d5ad411b73f2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:01.253766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5aee9040-9deb-42c8-bca6-d5ad411b73f2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:01.254238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5aee9040-9deb-42c8-bca6-d5ad411b73f2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:01.289280 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5aee9040-9deb-42c8-bca6-d5ad411b73f2 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052379 Jul 26 15:21:01.289891 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3500/6885] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:21:01 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:21:02.303101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b28cabaf-4551-4a75-86b1-9dacc8429a24 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:02.305417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b28cabaf-4551-4a75-86b1-9dacc8429a24 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:02.312656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b28cabaf-4551-4a75-86b1-9dacc8429a24 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:02.313113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b28cabaf-4551-4a75-86b1-9dacc8429a24 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:02.314232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b28cabaf-4551-4a75-86b1-9dacc8429a24 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:02.315159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b28cabaf-4551-4a75-86b1-9dacc8429a24 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:02.345215 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b28cabaf-4551-4a75-86b1-9dacc8429a24 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046842 Jul 26 15:21:02.346316 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3386/6886] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:21:02 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:21:03.358763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0f2d9693-09ff-47e0-a3f6-bf519ca2b009 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:03.360986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0f2d9693-09ff-47e0-a3f6-bf519ca2b009 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:03.369304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f2d9693-09ff-47e0-a3f6-bf519ca2b009 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:03.370008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f2d9693-09ff-47e0-a3f6-bf519ca2b009 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:03.370546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f2d9693-09ff-47e0-a3f6-bf519ca2b009 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:03.371007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0f2d9693-09ff-47e0-a3f6-bf519ca2b009 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:03.401990 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0f2d9693-09ff-47e0-a3f6-bf519ca2b009 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047215 Jul 26 15:21:03.402771 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3501/6887] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:21:03 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:21:04.415024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-63da0586-dcbe-4d75-8bb2-6c1b01cfe324 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:04.417291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-63da0586-dcbe-4d75-8bb2-6c1b01cfe324 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:04.425941 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-63da0586-dcbe-4d75-8bb2-6c1b01cfe324 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:04.426395 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-63da0586-dcbe-4d75-8bb2-6c1b01cfe324 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:04.427216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-63da0586-dcbe-4d75-8bb2-6c1b01cfe324 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:04.427659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-63da0586-dcbe-4d75-8bb2-6c1b01cfe324 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:04.459533 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-63da0586-dcbe-4d75-8bb2-6c1b01cfe324 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048563 Jul 26 15:21:04.460127 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3387/6888] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Jul 26 15:21:04 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:21:04.471534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ad5efb5-88ee-4738-a8e0-50810d3c9159 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:04.472115 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7ad5efb5-88ee-4738-a8e0-50810d3c9159 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:04.478877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ad5efb5-88ee-4738-a8e0-50810d3c9159 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:04.479350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ad5efb5-88ee-4738-a8e0-50810d3c9159 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:04.480168 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ad5efb5-88ee-4738-a8e0-50810d3c9159 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:04.480631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7ad5efb5-88ee-4738-a8e0-50810d3c9159 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:04.561146 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-7ad5efb5-88ee-4738-a8e0-50810d3c9159 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] HTTP exception thrown: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d is not attached to volume 322d84b0-040a-44bb-bfe8-bb8762ca635c Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ad5efb5-88ee-4738-a8e0-50810d3c9159 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Request method failure captured: Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: request: DELETE /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments/322d84b0-040a-44bb-bfe8-bb8762ca635c HTTP/1.1 Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4ATnFUeHPvSgnUdLGKcU2Plo-IshqDwpYxU3NMkgC91OsgsLN3xMDBogSvI74KHKtrdm1uGEynaHJTI1FtO_tVJxAAZKphCbe6egnTIK3_iZ2mUaaQGQfrqpiSYdcA6KOFdH9C80ZlE7Dc6WnSPlaQJnvKbtNAAGo7uP5-B1qYNNh1w Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 201aad04f85c4d2d9720c54c8cab855f Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/201aad04f85c4d2d9720c54c8cab855f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/201aad04f85c4d2d9720c54c8cab855f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_201aad04f85c4d2d9720c54c8cab855f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/201aad04f85c4d2d9720c54c8cab855f"}]}] Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 201aad04f85c4d2d9720c54c8cab855f Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestMinimumBasicScenario-120396144-project Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 966e46004bc84db09a828c0ab09377dd Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestMinimumBasicScenario-120396144-project Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d is not attached to volume 322d84b0-040a-44bb-bfe8-bb8762ca635c Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'server_id': 'c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d', 'id': '322d84b0-040a-44bb-bfe8-bb8762ca635c'} Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 322d84b0-040a-44bb-bfe8-bb8762ca635c. Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d is not attached to volume 322d84b0-040a-44bb-bfe8-bb8762ca635c Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:04.562804 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:04.567404 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:21:04.567404 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:21:04.567404 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d is not attached to volume 322d84b0-040a-44bb-bfe8-bb8762ca635c Jul 26 15:21:04.567404 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:21:04.567404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7ad5efb5-88ee-4738-a8e0-50810d3c9159 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Returning 404 to user: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d is not attached to volume 322d84b0-040a-44bb-bfe8-bb8762ca635c {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:21:04.567404 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7ad5efb5-88ee-4738-a8e0-50810d3c9159 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments/322d84b0-040a-44bb-bfe8-bb8762ca635c" status: 404 len: 154 microversion: 2.1 time: 0.097295 Jul 26 15:21:04.568535 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3502/6889] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Jul 26 15:21:04 2022] DELETE /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d/os-volume_attachments/322d84b0-040a-44bb-bfe8-bb8762ca635c => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:21:07.820786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fd759b81-365c-42ba-9b3f-cf4e2ef0c799 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:07.821295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fd759b81-365c-42ba-9b3f-cf4e2ef0c799 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:07.828670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd759b81-365c-42ba-9b3f-cf4e2ef0c799 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:07.829121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd759b81-365c-42ba-9b3f-cf4e2ef0c799 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:07.829892 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd759b81-365c-42ba-9b3f-cf4e2ef0c799 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:07.831031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fd759b81-365c-42ba-9b3f-cf4e2ef0c799 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:07.856889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fd759b81-365c-42ba-9b3f-cf4e2ef0c799 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:21:07.954646 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fd759b81-365c-42ba-9b3f-cf4e2ef0c799 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 204 len: 0 microversion: 2.1 time: 0.137466 Jul 26 15:21:07.959180 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3388/6890] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:21:07 2022] DELETE /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:21:07.965287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2de36a4-4b4f-4de8-9104-e0406bddf958 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:07.967067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e2de36a4-4b4f-4de8-9104-e0406bddf958 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:07.977768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2de36a4-4b4f-4de8-9104-e0406bddf958 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:07.978469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2de36a4-4b4f-4de8-9104-e0406bddf958 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:07.979122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2de36a4-4b4f-4de8-9104-e0406bddf958 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:07.979122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2de36a4-4b4f-4de8-9104-e0406bddf958 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:08.130953 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e2de36a4-4b4f-4de8-9104-e0406bddf958 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:08.139389 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e2de36a4-4b4f-4de8-9104-e0406bddf958 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1556 microversion: 2.1 time: 0.178488 Jul 26 15:21:08.139998 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3503/6891] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:07 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:09.164820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-30b6f6f2-5c7d-4b2a-8a0e-6eba66d06816 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:09.165502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-30b6f6f2-5c7d-4b2a-8a0e-6eba66d06816 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:09.172703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30b6f6f2-5c7d-4b2a-8a0e-6eba66d06816 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:09.173157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30b6f6f2-5c7d-4b2a-8a0e-6eba66d06816 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:09.173979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30b6f6f2-5c7d-4b2a-8a0e-6eba66d06816 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:09.174420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-30b6f6f2-5c7d-4b2a-8a0e-6eba66d06816 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:09.316353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-30b6f6f2-5c7d-4b2a-8a0e-6eba66d06816 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:09.324711 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-30b6f6f2-5c7d-4b2a-8a0e-6eba66d06816 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1556 microversion: 2.1 time: 0.166105 Jul 26 15:21:09.325305 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3389/6892] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:09 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:10.225975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-f08a296d-b444-4975-a473-55a759a30be0 req-80859a7b-b2cc-4b44-ac00-2010f0fe4591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d", "name": "network-vif-deleted", "tag": "325e7445-8b2e-4f1f-9cb3-54a585089f00"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:21:10.236820 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f08a296d-b444-4975-a473-55a759a30be0 req-80859a7b-b2cc-4b44-ac00-2010f0fe4591 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:10.237505 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-f08a296d-b444-4975-a473-55a759a30be0 req-80859a7b-b2cc-4b44-ac00-2010f0fe4591 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:10.249614 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-f08a296d-b444-4975-a473-55a759a30be0 req-80859a7b-b2cc-4b44-ac00-2010f0fe4591 service nova] Creating event network-vif-deleted:325e7445-8b2e-4f1f-9cb3-54a585089f00 for instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d on n-h2-833090-9 Jul 26 15:21:10.255072 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-f08a296d-b444-4975-a473-55a759a30be0 req-80859a7b-b2cc-4b44-ac00-2010f0fe4591 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033936 Jul 26 15:21:10.255700 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3504/6893] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:21:10.347335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:10.348417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:10.355248 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:10.355793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:10.356623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:10.357067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:10.391566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:10.391921 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:10.392915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lazy-loading 'fault' on Instance uuid c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:21:10.438735 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966e46004bc84db09a828c0ab09377dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aad04f85c4d2d9720c54c8cab855f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:10.446839 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e4fe7a3b-6b9c-4973-82af-aa5368e2440c tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 200 len: 1349 microversion: 2.1 time: 0.104784 Jul 26 15:21:10.448498 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3390/6894] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:10 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:11.471766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-17f26f07-4ddb-4a68-8c41-7f3016192557 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:11.472706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-17f26f07-4ddb-4a68-8c41-7f3016192557 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] [instance: c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:11.479141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17f26f07-4ddb-4a68-8c41-7f3016192557 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:11.479613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17f26f07-4ddb-4a68-8c41-7f3016192557 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:11.480438 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17f26f07-4ddb-4a68-8c41-7f3016192557 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:11.480897 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-17f26f07-4ddb-4a68-8c41-7f3016192557 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:11.495388 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-17f26f07-4ddb-4a68-8c41-7f3016192557 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] HTTP exception thrown: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d could not be found. Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-17f26f07-4ddb-4a68-8c41-7f3016192557 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Request method failure captured: Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d HTTP/1.1 Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4ATnFUeHPvSgnUdLGKcU2Plo-IshqDwpYxU3NMkgC91OsgsLN3xMDBogSvI74KHKtrdm1uGEynaHJTI1FtO_tVJxAAZKphCbe6egnTIK3_iZ2mUaaQGQfrqpiSYdcA6KOFdH9C80ZlE7Dc6WnSPlaQJnvKbtNAAGo7uP5-B1qYNNh1w Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 201aad04f85c4d2d9720c54c8cab855f Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/201aad04f85c4d2d9720c54c8cab855f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/201aad04f85c4d2d9720c54c8cab855f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_201aad04f85c4d2d9720c54c8cab855f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/201aad04f85c4d2d9720c54c8cab855f"}]}] Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 201aad04f85c4d2d9720c54c8cab855f Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestMinimumBasicScenario-120396144 Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestMinimumBasicScenario-120396144-project Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: 966e46004bc84db09a828c0ab09377dd Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestMinimumBasicScenario-120396144-project Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d could not be found. Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': 'c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d'} Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d could not be found. Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d could not be found. Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:21:11.497111 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:21:11.501515 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:21:11.501515 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:21:11.501515 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:21:11.501515 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:21:11.501515 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:21:11.501515 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d could not be found. Jul 26 15:21:11.501515 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:21:11.501515 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-17f26f07-4ddb-4a68-8c41-7f3016192557 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Returning 404 to user: Instance c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:21:11.501515 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-17f26f07-4ddb-4a68-8c41-7f3016192557 tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d" status: 404 len: 111 microversion: 2.1 time: 0.032691 Jul 26 15:21:11.501515 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3505/6895] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:11 2022] GET /compute/v2.1/servers/c8fd0a2c-bc6f-444b-afe2-50cdf9f0c19d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:21:11.507578 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bc529499-9fec-4140-9dbf-c341283d206f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] Calling method '.version_select at 0x7f87879bfa60>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:11.528093 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bc529499-9fec-4140-9dbf-c341283d206f tempest-TestMinimumBasicScenario-120396144 tempest-TestMinimumBasicScenario-120396144-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1383012312" status: 202 len: 0 microversion: 2.1 time: 0.024330 Jul 26 15:21:11.528667 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3391/6896] 10.222.0.70 () {58 vars in 1272 bytes} [Tue Jul 26 15:21:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1383012312 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:21:21.287302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-33509807-690b-4b6a-acd5-69b7f9cf1079 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'create', calling method: .version_select at 0x7f8786bd3790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1725692775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6KqrIV1qKhny4y/WQbdb+zOlgGPpy1Hka7SigMvqt5LFfgl0qleIHRvOyMQ8+EBFTMct4qbhLZ0c7LWRikOHsRVsvSk9oC6vun/xd2j7bH2pSKRQ/Z1VaruCMGgkblwQ=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:21:21.305021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-33509807-690b-4b6a-acd5-69b7f9cf1079 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:21:21.310305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-33509807-690b-4b6a-acd5-69b7f9cf1079 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for user a87ec95562914f5bbe90e0d65873143e and project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:21:21.342004 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-33509807-690b-4b6a-acd5-69b7f9cf1079 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.232572 Jul 26 15:21:21.342631 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3506/6897] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:21:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:21:27.210837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:27.211871 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:27.219173 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1926569424", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "efe6c12c-f19f-4fa7-98b4-6b461635063e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1725692775", "security_groups": [{"name": "tempest-secgroup-smoke-82856109"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:21:27.373754 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] validate_networks() for [('efe6c12c-f19f-4fa7-98b4-6b461635063e', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:21:27.942984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:21:27.943413 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:21:27.943896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:21:27.944343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:21:27.944755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:21:27.959905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:27.960486 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:27.961417 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:27.961966 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:27.982542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:21:27.989025 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for user a87ec95562914f5bbe90e0d65873143e and project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:21:28.002485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:21:28.004822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:21:28.058732 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-953c71a8-a284-45e3-9b0d-f0a2391a377e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.851275 Jul 26 15:21:28.065848 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3392/6898] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:21:27 2022] POST /compute/v2.1/servers => generated 404 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:21:28.069242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=38 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:28.075333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3ac02131-29c3-44ea-95ad-2b558a816417 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:28.076007 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3ac02131-29c3-44ea-95ad-2b558a816417 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:28.077880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:28.135715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3ac02131-29c3-44ea-95ad-2b558a816417 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:28.143036 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3ac02131-29c3-44ea-95ad-2b558a816417 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1267 microversion: 2.1 time: 0.075102 Jul 26 15:21:28.143670 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3507/6899] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:28 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1267 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:29.165829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5a7dea21-b1a7-4d89-999e-c9d3b552f149 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:29.167583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5a7dea21-b1a7-4d89-999e-c9d3b552f149 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:29.235346 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5a7dea21-b1a7-4d89-999e-c9d3b552f149 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:29.246581 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5a7dea21-b1a7-4d89-999e-c9d3b552f149 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1267 microversion: 2.1 time: 0.085586 Jul 26 15:21:29.247161 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3393/6900] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:29 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:30.268274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-caf2f11b-cbde-4d11-ae44-f4855c46af75 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:30.268823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-caf2f11b-cbde-4d11-ae44-f4855c46af75 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:30.330666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-caf2f11b-cbde-4d11-ae44-f4855c46af75 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:30.336535 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-caf2f11b-cbde-4d11-ae44-f4855c46af75 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1267 microversion: 2.1 time: 0.073285 Jul 26 15:21:30.337121 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3508/6901] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:30 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1267 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:31.358001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5aafd94c-ab28-45d0-b979-192ed70c0351 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:31.358545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5aafd94c-ab28-45d0-b979-192ed70c0351 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:31.415448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5aafd94c-ab28-45d0-b979-192ed70c0351 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:31.422817 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5aafd94c-ab28-45d0-b979-192ed70c0351 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1267 microversion: 2.1 time: 0.068809 Jul 26 15:21:31.424071 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3394/6902] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:31 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:32.445148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b52a8fc6-8ec8-430a-81a6-16d49e1b3951 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:32.445777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b52a8fc6-8ec8-430a-81a6-16d49e1b3951 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:32.452972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b52a8fc6-8ec8-430a-81a6-16d49e1b3951 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:32.453447 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b52a8fc6-8ec8-430a-81a6-16d49e1b3951 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:32.454234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b52a8fc6-8ec8-430a-81a6-16d49e1b3951 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:32.455492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b52a8fc6-8ec8-430a-81a6-16d49e1b3951 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:32.521651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b52a8fc6-8ec8-430a-81a6-16d49e1b3951 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:32.529284 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b52a8fc6-8ec8-430a-81a6-16d49e1b3951 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1271 microversion: 2.1 time: 0.088259 Jul 26 15:21:32.529856 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3509/6903] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:32 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:21:33.551172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9529173c-afa8-4c41-8f04-9cc756e6e389 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:33.551796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9529173c-afa8-4c41-8f04-9cc756e6e389 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:33.559508 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9529173c-afa8-4c41-8f04-9cc756e6e389 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:33.559996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9529173c-afa8-4c41-8f04-9cc756e6e389 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:33.560813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9529173c-afa8-4c41-8f04-9cc756e6e389 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:33.561236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9529173c-afa8-4c41-8f04-9cc756e6e389 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:33.630492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9529173c-afa8-4c41-8f04-9cc756e6e389 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:33.638256 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9529173c-afa8-4c41-8f04-9cc756e6e389 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1325 microversion: 2.1 time: 0.091922 Jul 26 15:21:33.638863 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3395/6904] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:33 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1325 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:34.660842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9f081115-b55c-4070-8315-3e6e936f3e77 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:34.662220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9f081115-b55c-4070-8315-3e6e936f3e77 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:34.670855 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f081115-b55c-4070-8315-3e6e936f3e77 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:34.671485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f081115-b55c-4070-8315-3e6e936f3e77 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:34.672899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f081115-b55c-4070-8315-3e6e936f3e77 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:34.673888 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9f081115-b55c-4070-8315-3e6e936f3e77 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:34.744052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f5b60917-b767-48d1-ae9d-d4bee2f28315 req-a53685fc-54b2-472b-a84e-ad3a662c43a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22cadca2-1448-41f7-863d-3d048db7d646", "tag": "139b455a-abe4-4cc0-9ede-222dd5c0e2da"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:21:34.756385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f5b60917-b767-48d1-ae9d-d4bee2f28315 req-a53685fc-54b2-472b-a84e-ad3a662c43a9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:34.757078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f5b60917-b767-48d1-ae9d-d4bee2f28315 req-a53685fc-54b2-472b-a84e-ad3a662c43a9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:34.773439 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f5b60917-b767-48d1-ae9d-d4bee2f28315 req-a53685fc-54b2-472b-a84e-ad3a662c43a9 service nova] Creating event network-changed:139b455a-abe4-4cc0-9ede-222dd5c0e2da for instance 22cadca2-1448-41f7-863d-3d048db7d646 on n-h1-833090-9 Jul 26 15:21:34.779665 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f5b60917-b767-48d1-ae9d-d4bee2f28315 req-a53685fc-54b2-472b-a84e-ad3a662c43a9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039377 Jul 26 15:21:34.780505 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3396/6905] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:21:34.860352 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9f081115-b55c-4070-8315-3e6e936f3e77 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:34.869535 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9f081115-b55c-4070-8315-3e6e936f3e77 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1391 microversion: 2.1 time: 0.212947 Jul 26 15:21:34.870213 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3510/6906] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:34 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:35.895382 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1e686010-b78b-484d-b9f0-2a81ee5db347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:35.896001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1e686010-b78b-484d-b9f0-2a81ee5db347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:35.902353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e686010-b78b-484d-b9f0-2a81ee5db347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:35.902811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e686010-b78b-484d-b9f0-2a81ee5db347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:35.903597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e686010-b78b-484d-b9f0-2a81ee5db347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:35.904080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1e686010-b78b-484d-b9f0-2a81ee5db347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:36.046255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1e686010-b78b-484d-b9f0-2a81ee5db347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:36.054654 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1e686010-b78b-484d-b9f0-2a81ee5db347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1391 microversion: 2.1 time: 0.165351 Jul 26 15:21:36.055219 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3397/6907] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:35 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:37.076449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-23c11259-af82-4e2a-8006-b84fcb43c663 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:37.076991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-23c11259-af82-4e2a-8006-b84fcb43c663 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:37.084982 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23c11259-af82-4e2a-8006-b84fcb43c663 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:37.085455 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23c11259-af82-4e2a-8006-b84fcb43c663 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:37.086242 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23c11259-af82-4e2a-8006-b84fcb43c663 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:37.086700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-23c11259-af82-4e2a-8006-b84fcb43c663 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:37.218651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-23c11259-af82-4e2a-8006-b84fcb43c663 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:37.227050 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-23c11259-af82-4e2a-8006-b84fcb43c663 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1391 microversion: 2.1 time: 0.154644 Jul 26 15:21:37.227634 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3511/6908] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:37 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:38.248851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-43a465e3-f8b9-4d1c-adec-5448d50c613d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:38.249482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-43a465e3-f8b9-4d1c-adec-5448d50c613d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:38.253078 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:38.258755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a465e3-f8b9-4d1c-adec-5448d50c613d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:38.259218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a465e3-f8b9-4d1c-adec-5448d50c613d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:38.260036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a465e3-f8b9-4d1c-adec-5448d50c613d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:38.260488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a465e3-f8b9-4d1c-adec-5448d50c613d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:38.674671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43a465e3-f8b9-4d1c-adec-5448d50c613d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:38.682409 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-43a465e3-f8b9-4d1c-adec-5448d50c613d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1391 microversion: 2.1 time: 0.437469 Jul 26 15:21:38.682972 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3398/6909] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:38 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1391 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:39.703274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-532c10c0-2aad-4b31-a30d-fd46aea1203a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:39.703903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-532c10c0-2aad-4b31-a30d-fd46aea1203a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:39.710470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-532c10c0-2aad-4b31-a30d-fd46aea1203a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:39.711232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-532c10c0-2aad-4b31-a30d-fd46aea1203a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:39.712042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-532c10c0-2aad-4b31-a30d-fd46aea1203a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:39.712503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-532c10c0-2aad-4b31-a30d-fd46aea1203a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:39.849402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-532c10c0-2aad-4b31-a30d-fd46aea1203a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:39.857164 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-532c10c0-2aad-4b31-a30d-fd46aea1203a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1391 microversion: 2.1 time: 0.157826 Jul 26 15:21:39.858141 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3512/6910] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:39 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:40.878839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-de841774-3016-4de8-bf27-0dae94d042f4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:40.880531 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-de841774-3016-4de8-bf27-0dae94d042f4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:40.889079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de841774-3016-4de8-bf27-0dae94d042f4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:40.889079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de841774-3016-4de8-bf27-0dae94d042f4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:40.894098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-7319c5cc-9abf-4e1d-9363-e71c2c933cd1 req-27ff816a-a3f2-4699-a691-76f6c4054db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22cadca2-1448-41f7-863d-3d048db7d646", "name": "network-vif-plugged", "status": "completed", "tag": "139b455a-abe4-4cc0-9ede-222dd5c0e2da"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:21:40.899712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=8 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:40.900840 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de841774-3016-4de8-bf27-0dae94d042f4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:40.901374 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-de841774-3016-4de8-bf27-0dae94d042f4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:40.915594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7319c5cc-9abf-4e1d-9363-e71c2c933cd1 req-27ff816a-a3f2-4699-a691-76f6c4054db4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:40.916133 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-7319c5cc-9abf-4e1d-9363-e71c2c933cd1 req-27ff816a-a3f2-4699-a691-76f6c4054db4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:40.929190 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-7319c5cc-9abf-4e1d-9363-e71c2c933cd1 req-27ff816a-a3f2-4699-a691-76f6c4054db4 service nova] Creating event network-vif-plugged:139b455a-abe4-4cc0-9ede-222dd5c0e2da for instance 22cadca2-1448-41f7-863d-3d048db7d646 on n-h1-833090-9 Jul 26 15:21:40.935321 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-7319c5cc-9abf-4e1d-9363-e71c2c933cd1 req-27ff816a-a3f2-4699-a691-76f6c4054db4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044791 Jul 26 15:21:40.936036 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3513/6911] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:21:41.056375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-de841774-3016-4de8-bf27-0dae94d042f4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:41.064228 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-de841774-3016-4de8-bf27-0dae94d042f4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1391 microversion: 2.1 time: 0.189401 Jul 26 15:21:41.065104 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3399/6912] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:40 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:42.086714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b63b7901-cbc4-4b70-8217-0ba8b58ca7f1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:42.087576 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b63b7901-cbc4-4b70-8217-0ba8b58ca7f1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:42.095488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b63b7901-cbc4-4b70-8217-0ba8b58ca7f1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:42.096010 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b63b7901-cbc4-4b70-8217-0ba8b58ca7f1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:42.096821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b63b7901-cbc4-4b70-8217-0ba8b58ca7f1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:42.097283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b63b7901-cbc4-4b70-8217-0ba8b58ca7f1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:42.243342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b63b7901-cbc4-4b70-8217-0ba8b58ca7f1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:42.250975 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b63b7901-cbc4-4b70-8217-0ba8b58ca7f1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1391 microversion: 2.1 time: 0.168914 Jul 26 15:21:42.251540 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3514/6913] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:42 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:43.271783 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b1e048db-a29a-4bff-bfe8-54baaed44b3b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:43.272582 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b1e048db-a29a-4bff-bfe8-54baaed44b3b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:43.274437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:21:43.280633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1e048db-a29a-4bff-bfe8-54baaed44b3b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:43.281080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1e048db-a29a-4bff-bfe8-54baaed44b3b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:43.281884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1e048db-a29a-4bff-bfe8-54baaed44b3b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:43.282318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b1e048db-a29a-4bff-bfe8-54baaed44b3b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:43.422356 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b1e048db-a29a-4bff-bfe8-54baaed44b3b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:43.430736 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b1e048db-a29a-4bff-bfe8-54baaed44b3b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1562 microversion: 2.1 time: 0.162838 Jul 26 15:21:43.431320 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3400/6914] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:43 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:43.451239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6fa29636-db72-479b-972a-ece7113d31dc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:43.451872 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6fa29636-db72-479b-972a-ece7113d31dc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:43.458869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fa29636-db72-479b-972a-ece7113d31dc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:43.459360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fa29636-db72-479b-972a-ece7113d31dc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:43.460372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fa29636-db72-479b-972a-ece7113d31dc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:43.460877 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6fa29636-db72-479b-972a-ece7113d31dc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:43.600773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6fa29636-db72-479b-972a-ece7113d31dc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:43.608986 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6fa29636-db72-479b-972a-ece7113d31dc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1562 microversion: 2.1 time: 0.161695 Jul 26 15:21:43.609593 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3515/6915] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:43 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:21:45.262555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-0ff02806-1ece-4ede-9708-f2acc2ccbb16 req-a8265f99-6e93-4018-8aca-bc52cbd7d332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22cadca2-1448-41f7-863d-3d048db7d646", "tag": "139b455a-abe4-4cc0-9ede-222dd5c0e2da"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:21:45.269922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-249937cb-e56b-4734-96a0-e06ed1883e84 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:21:45.270553 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-249937cb-e56b-4734-96a0-e06ed1883e84 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:21:45.280564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0ff02806-1ece-4ede-9708-f2acc2ccbb16 req-a8265f99-6e93-4018-8aca-bc52cbd7d332 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:45.281026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-0ff02806-1ece-4ede-9708-f2acc2ccbb16 req-a8265f99-6e93-4018-8aca-bc52cbd7d332 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:45.287619 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-249937cb-e56b-4734-96a0-e06ed1883e84 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:45.288459 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-249937cb-e56b-4734-96a0-e06ed1883e84 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:45.289481 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-249937cb-e56b-4734-96a0-e06ed1883e84 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:21:45.290141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-249937cb-e56b-4734-96a0-e06ed1883e84 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:21:45.297227 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-0ff02806-1ece-4ede-9708-f2acc2ccbb16 req-a8265f99-6e93-4018-8aca-bc52cbd7d332 service nova] Creating event network-changed:139b455a-abe4-4cc0-9ede-222dd5c0e2da for instance 22cadca2-1448-41f7-863d-3d048db7d646 on n-h1-833090-9 Jul 26 15:21:45.307400 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-0ff02806-1ece-4ede-9708-f2acc2ccbb16 req-a8265f99-6e93-4018-8aca-bc52cbd7d332 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044889 Jul 26 15:21:45.324981 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3516/6916] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:21:45.453029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-249937cb-e56b-4734-96a0-e06ed1883e84 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:21:45.461162 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-249937cb-e56b-4734-96a0-e06ed1883e84 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1562 microversion: 2.1 time: 0.206232 Jul 26 15:21:45.461751 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3401/6917] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:21:45 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1562 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:08.714848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=23 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:08.715706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=40 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:08.719978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6ea0bfcc-d347-47fa-b45a-7d4bc74d82f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:08.722305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6ea0bfcc-d347-47fa-b45a-7d4bc74d82f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:08.730295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6ea0bfcc-d347-47fa-b45a-7d4bc74d82f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:08.730771 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6ea0bfcc-d347-47fa-b45a-7d4bc74d82f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:08.731587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6ea0bfcc-d347-47fa-b45a-7d4bc74d82f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:08.732086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6ea0bfcc-d347-47fa-b45a-7d4bc74d82f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:08.787188 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6ea0bfcc-d347-47fa-b45a-7d4bc74d82f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646/action" status: 200 len: 24573 microversion: 2.1 time: 0.074054 Jul 26 15:22:08.787887 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3517/6918] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:22:08 2022] POST /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:22:19.822851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-51b518a0-2e0f-472a-b771-9bb053779b5d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:19.823421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-51b518a0-2e0f-472a-b771-9bb053779b5d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:19.825477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:19.826289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=40 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:19.833178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51b518a0-2e0f-472a-b771-9bb053779b5d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:19.833733 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51b518a0-2e0f-472a-b771-9bb053779b5d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:19.834532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51b518a0-2e0f-472a-b771-9bb053779b5d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:19.834983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-51b518a0-2e0f-472a-b771-9bb053779b5d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:19.908582 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-51b518a0-2e0f-472a-b771-9bb053779b5d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646/action" status: 202 len: 0 microversion: 2.1 time: 0.090173 Jul 26 15:22:19.912504 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3402/6919] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:22:19 2022] POST /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:22:19.918084 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5847440f-2d98-4f77-a5eb-37bf82325851 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:19.919829 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5847440f-2d98-4f77-a5eb-37bf82325851 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:19.923689 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:19.924495 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:19.929442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5847440f-2d98-4f77-a5eb-37bf82325851 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:19.929930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5847440f-2d98-4f77-a5eb-37bf82325851 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:19.930776 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5847440f-2d98-4f77-a5eb-37bf82325851 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:19.931246 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5847440f-2d98-4f77-a5eb-37bf82325851 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:20.077554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5847440f-2d98-4f77-a5eb-37bf82325851 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:20.086864 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5847440f-2d98-4f77-a5eb-37bf82325851 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1686 microversion: 2.1 time: 0.172806 Jul 26 15:22:20.087968 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3518/6920] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:19 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:21.116089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c6c407a7-214a-41ee-9367-cedf0dfa60d3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:21.116719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c6c407a7-214a-41ee-9367-cedf0dfa60d3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:21.123791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6c407a7-214a-41ee-9367-cedf0dfa60d3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:21.124269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6c407a7-214a-41ee-9367-cedf0dfa60d3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:21.125049 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6c407a7-214a-41ee-9367-cedf0dfa60d3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:21.125488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c6c407a7-214a-41ee-9367-cedf0dfa60d3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:21.264456 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c6c407a7-214a-41ee-9367-cedf0dfa60d3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:21.272625 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c6c407a7-214a-41ee-9367-cedf0dfa60d3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1666 microversion: 2.1 time: 0.162096 Jul 26 15:22:21.273224 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3403/6921] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:21 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:22.370586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-07426124-31bd-4444-9338-2c11028df6ff tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:22.374111 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-07426124-31bd-4444-9338-2c11028df6ff tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:22.382042 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07426124-31bd-4444-9338-2c11028df6ff tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:22.382525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07426124-31bd-4444-9338-2c11028df6ff tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:22.383360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07426124-31bd-4444-9338-2c11028df6ff tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:22.383825 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-07426124-31bd-4444-9338-2c11028df6ff tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:22.436372 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-07426124-31bd-4444-9338-2c11028df6ff tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646/action" status: 200 len: 32636 microversion: 2.1 time: 0.069646 Jul 26 15:22:22.437060 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3519/6922] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:22:22 2022] POST /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646/action => generated 32636 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:22:22.449045 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e9d10d5d-8f29-4262-b301-aa5a9e3bc250 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:22.450164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e9d10d5d-8f29-4262-b301-aa5a9e3bc250 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:22.457225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9d10d5d-8f29-4262-b301-aa5a9e3bc250 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:22.457670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9d10d5d-8f29-4262-b301-aa5a9e3bc250 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:22.458442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9d10d5d-8f29-4262-b301-aa5a9e3bc250 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:22.458880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e9d10d5d-8f29-4262-b301-aa5a9e3bc250 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:22.531440 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e9d10d5d-8f29-4262-b301-aa5a9e3bc250 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646/action" status: 202 len: 0 microversion: 2.1 time: 0.086248 Jul 26 15:22:22.532186 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3404/6923] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:22:22 2022] POST /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:22:22.541206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c545aa0c-27c3-4de8-9a6f-dbabae35fcdd tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:22.541939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c545aa0c-27c3-4de8-9a6f-dbabae35fcdd tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:22.550709 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c545aa0c-27c3-4de8-9a6f-dbabae35fcdd tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:22.551223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c545aa0c-27c3-4de8-9a6f-dbabae35fcdd tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:22.552097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c545aa0c-27c3-4de8-9a6f-dbabae35fcdd tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:22.552719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c545aa0c-27c3-4de8-9a6f-dbabae35fcdd tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:22.697651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c545aa0c-27c3-4de8-9a6f-dbabae35fcdd tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:22.707997 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c545aa0c-27c3-4de8-9a6f-dbabae35fcdd tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1673 microversion: 2.1 time: 0.171092 Jul 26 15:22:22.708585 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3520/6924] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:22 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:23.729809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ad1d6ef5-aacc-4d08-8e92-6a0c9808c304 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:23.730422 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ad1d6ef5-aacc-4d08-8e92-6a0c9808c304 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:23.738271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad1d6ef5-aacc-4d08-8e92-6a0c9808c304 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:23.738728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad1d6ef5-aacc-4d08-8e92-6a0c9808c304 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:23.739505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad1d6ef5-aacc-4d08-8e92-6a0c9808c304 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:23.739974 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ad1d6ef5-aacc-4d08-8e92-6a0c9808c304 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:23.879601 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ad1d6ef5-aacc-4d08-8e92-6a0c9808c304 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:23.888469 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ad1d6ef5-aacc-4d08-8e92-6a0c9808c304 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1681 microversion: 2.1 time: 0.163182 Jul 26 15:22:23.889055 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3405/6925] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:23 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:23.985225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9c3d2870-cf06-465f-a125-b3561e21c453 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:23.987375 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9c3d2870-cf06-465f-a125-b3561e21c453 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:23.995551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c3d2870-cf06-465f-a125-b3561e21c453 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:23.996058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c3d2870-cf06-465f-a125-b3561e21c453 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:23.997047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c3d2870-cf06-465f-a125-b3561e21c453 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:23.997523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c3d2870-cf06-465f-a125-b3561e21c453 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:24.050523 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9c3d2870-cf06-465f-a125-b3561e21c453 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646/action" status: 200 len: 38405 microversion: 2.1 time: 0.069667 Jul 26 15:22:24.051205 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3521/6926] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:22:23 2022] POST /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646/action => generated 38405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:22:25.395995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5600c76e-8bc2-466b-bab3-6bde336fa6c6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:25.396514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5600c76e-8bc2-466b-bab3-6bde336fa6c6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:25.400058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9a64f939-5145-4c4b-a48f-4a78abbfc130 req-644798f0-7a2c-42d8-85f5-17a492c60c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22cadca2-1448-41f7-863d-3d048db7d646", "tag": "139b455a-abe4-4cc0-9ede-222dd5c0e2da"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:25.404565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5600c76e-8bc2-466b-bab3-6bde336fa6c6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:25.405325 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5600c76e-8bc2-466b-bab3-6bde336fa6c6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:25.406380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5600c76e-8bc2-466b-bab3-6bde336fa6c6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:25.407335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5600c76e-8bc2-466b-bab3-6bde336fa6c6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:25.416520 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9a64f939-5145-4c4b-a48f-4a78abbfc130 req-644798f0-7a2c-42d8-85f5-17a492c60c6f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:25.417012 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9a64f939-5145-4c4b-a48f-4a78abbfc130 req-644798f0-7a2c-42d8-85f5-17a492c60c6f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:25.431240 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9a64f939-5145-4c4b-a48f-4a78abbfc130 req-644798f0-7a2c-42d8-85f5-17a492c60c6f service nova] Creating event network-changed:139b455a-abe4-4cc0-9ede-222dd5c0e2da for instance 22cadca2-1448-41f7-863d-3d048db7d646 on n-h1-833090-9 Jul 26 15:22:25.437687 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9a64f939-5145-4c4b-a48f-4a78abbfc130 req-644798f0-7a2c-42d8-85f5-17a492c60c6f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042515 Jul 26 15:22:25.438487 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3522/6927] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:22:25.439342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5600c76e-8bc2-466b-bab3-6bde336fa6c6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:22:25.527436 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5600c76e-8bc2-466b-bab3-6bde336fa6c6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "DELETE /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 204 len: 0 microversion: 2.1 time: 0.134685 Jul 26 15:22:25.532054 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3406/6928] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:22:25 2022] DELETE /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:22:25.540995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dac8793d-3b60-426e-ad87-84894af15645 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:25.542194 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dac8793d-3b60-426e-ad87-84894af15645 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:25.552987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dac8793d-3b60-426e-ad87-84894af15645 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:25.553741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dac8793d-3b60-426e-ad87-84894af15645 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:25.555663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dac8793d-3b60-426e-ad87-84894af15645 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:25.556307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dac8793d-3b60-426e-ad87-84894af15645 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:25.709001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dac8793d-3b60-426e-ad87-84894af15645 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:25.717895 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dac8793d-3b60-426e-ad87-84894af15645 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1687 microversion: 2.1 time: 0.182809 Jul 26 15:22:25.718489 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3523/6929] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:25 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:26.740945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d1a4b06d-593d-4670-859c-dda3b2b9da99 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:26.741651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d1a4b06d-593d-4670-859c-dda3b2b9da99 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:26.750685 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1a4b06d-593d-4670-859c-dda3b2b9da99 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:26.751146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1a4b06d-593d-4670-859c-dda3b2b9da99 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:26.751971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1a4b06d-593d-4670-859c-dda3b2b9da99 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:26.752424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d1a4b06d-593d-4670-859c-dda3b2b9da99 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:26.972852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d1a4b06d-593d-4670-859c-dda3b2b9da99 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:26.988713 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d1a4b06d-593d-4670-859c-dda3b2b9da99 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1687 microversion: 2.1 time: 0.252036 Jul 26 15:22:26.989298 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3407/6930] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:26 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1687 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:27.607006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4cdb3d89-13cc-4ebb-8eae-2da434a9273d req-ce352758-3150-40c1-97ca-9c9b8bf99ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22cadca2-1448-41f7-863d-3d048db7d646", "name": "network-vif-deleted", "tag": "139b455a-abe4-4cc0-9ede-222dd5c0e2da"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:27.623453 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4cdb3d89-13cc-4ebb-8eae-2da434a9273d req-ce352758-3150-40c1-97ca-9c9b8bf99ff6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:27.624015 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4cdb3d89-13cc-4ebb-8eae-2da434a9273d req-ce352758-3150-40c1-97ca-9c9b8bf99ff6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:27.636502 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4cdb3d89-13cc-4ebb-8eae-2da434a9273d req-ce352758-3150-40c1-97ca-9c9b8bf99ff6 service nova] Creating event network-vif-deleted:139b455a-abe4-4cc0-9ede-222dd5c0e2da for instance 22cadca2-1448-41f7-863d-3d048db7d646 on n-h1-833090-9 Jul 26 15:22:27.642494 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4cdb3d89-13cc-4ebb-8eae-2da434a9273d req-ce352758-3150-40c1-97ca-9c9b8bf99ff6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043311 Jul 26 15:22:27.643115 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3524/6931] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:22:28.012451 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:28.013147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:28.020764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:28.021226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:28.022107 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:28.022558 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:28.060972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:28.061432 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:28.061900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lazy-loading 'fault' on Instance uuid 22cadca2-1448-41f7-863d-3d048db7d646 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:22:28.107315 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:28.115342 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-cb882ff3-0fda-4a84-a9e0-85ac06e7e13d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 200 len: 1357 microversion: 2.1 time: 0.107325 Jul 26 15:22:28.115845 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3408/6932] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:28 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:22:29.139189 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21b3d3ec-4e5c-4096-b968-ba8753d6c65d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:29.139899 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-21b3d3ec-4e5c-4096-b968-ba8753d6c65d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 22cadca2-1448-41f7-863d-3d048db7d646] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:29.146232 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21b3d3ec-4e5c-4096-b968-ba8753d6c65d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:29.146700 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21b3d3ec-4e5c-4096-b968-ba8753d6c65d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:29.147480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21b3d3ec-4e5c-4096-b968-ba8753d6c65d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:29.147940 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21b3d3ec-4e5c-4096-b968-ba8753d6c65d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:29.162450 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-21b3d3ec-4e5c-4096-b968-ba8753d6c65d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] HTTP exception thrown: Instance 22cadca2-1448-41f7-863d-3d048db7d646 could not be found. Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21b3d3ec-4e5c-4096-b968-ba8753d6c65d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Request method failure captured: Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 HTTP/1.1 Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AZwWobvxI63mdOVS-oWvEqLyF8cT1eZMQKX5cQkkeaNcCru1ZM9pI6ztC8RXCAaiaIbH4ay2LSrHA40XxMXDFrluWb5iJMSBnoxzurC2hSsA4Lunw2O7_LR-GTzEM4dBacf2I7X2XB3X16LazlGxUWMWZHGjqsLgePN7fPx0QydZEw Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: e055abfc258c4b2f9dec5a105fa0ec41 Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e055abfc258c4b2f9dec5a105fa0ec41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e055abfc258c4b2f9dec5a105fa0ec41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e055abfc258c4b2f9dec5a105fa0ec41", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e055abfc258c4b2f9dec5a105fa0ec41"}]}] Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: e055abfc258c4b2f9dec5a105fa0ec41 Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestNetworkAdvancedServerOps-765091019-project Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: a87ec95562914f5bbe90e0d65873143e Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestNetworkAdvancedServerOps-765091019-project Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 22cadca2-1448-41f7-863d-3d048db7d646 could not be found. Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '22cadca2-1448-41f7-863d-3d048db7d646'} Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22cadca2-1448-41f7-863d-3d048db7d646 could not be found. Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22cadca2-1448-41f7-863d-3d048db7d646 could not be found. Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:22:29.164589 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:22:29.169335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:22:29.169335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:22:29.169335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:22:29.169335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:22:29.169335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:22:29.169335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22cadca2-1448-41f7-863d-3d048db7d646 could not be found. Jul 26 15:22:29.169335 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:22:29.169335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21b3d3ec-4e5c-4096-b968-ba8753d6c65d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Returning 404 to user: Instance 22cadca2-1448-41f7-863d-3d048db7d646 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:22:29.169335 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-21b3d3ec-4e5c-4096-b968-ba8753d6c65d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646" status: 404 len: 111 microversion: 2.1 time: 0.032872 Jul 26 15:22:29.169335 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3525/6933] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:29 2022] GET /compute/v2.1/servers/22cadca2-1448-41f7-863d-3d048db7d646 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:22:32.554633 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e9224932-1d15-4528-8efc-b99e1dd40f24 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '.version_select at 0x7f8787c179d0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:32.585580 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e9224932-1d15-4528-8efc-b99e1dd40f24 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1725692775" status: 202 len: 0 microversion: 2.1 time: 0.034772 Jul 26 15:22:32.586319 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3409/6934] 10.222.0.70 () {58 vars in 1284 bytes} [Tue Jul 26 15:22:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1725692775 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:22:32.617393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca8dbed5-45b1-4e66-95bc-d9edffc8b462 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'create', calling method: .version_select at 0x7f8786b8f5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1995380389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMj99DAs5NO2oa45Mj/vumsHkOSWTwF4P4pBn3lZ2g6PxVV0bKlaccPCjsxUNa4xZLovpypmmzM84PKE4G8XxEPDk2n+7BvW8gY6VVRclhBgQVzzFJPuM9khO7dKiGm0gQ=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:32.640382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ca8dbed5-45b1-4e66-95bc-d9edffc8b462 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:22:32.647789 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-ca8dbed5-45b1-4e66-95bc-d9edffc8b462 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for user a87ec95562914f5bbe90e0d65873143e and project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:22:32.675812 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca8dbed5-45b1-4e66-95bc-d9edffc8b462 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062321 Jul 26 15:22:32.676456 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3526/6935] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:22:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:22:38.492636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-627923388", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "17079b9f-e854-41a0-a72f-33c13523f94d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1995380389", "security_groups": [{"name": "tempest-secgroup-smoke-1999992471"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:38.504445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:38.628944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] validate_networks() for [('17079b9f-e854-41a0-a72f-33c13523f94d', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:22:39.164607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:22:39.165670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:22:39.166377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:22:39.166862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:22:39.167350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:22:39.177971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:39.178523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:39.180047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:39.180572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:39.201287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:22:39.207714 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for user a87ec95562914f5bbe90e0d65873143e and project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:22:39.222602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:22:39.225176 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:22:39.280294 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-53e03712-003f-4e2a-943e-0e91c2251347 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.791584 Jul 26 15:22:39.281682 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3410/6936] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:22:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:22:39.292301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36d102a3-d9e2-4456-b3bc-322a4e8d9971 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:39.293562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-36d102a3-d9e2-4456-b3bc-322a4e8d9971 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:39.297210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=32 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:39.455905 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-36d102a3-d9e2-4456-b3bc-322a4e8d9971 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:39.463101 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-36d102a3-d9e2-4456-b3bc-322a4e8d9971 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1266 microversion: 2.1 time: 0.174693 Jul 26 15:22:39.463820 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3527/6937] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:39 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:40.487243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-95ec14f3-d082-499d-9f0e-1e18d9d1b299 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:40.488530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-95ec14f3-d082-499d-9f0e-1e18d9d1b299 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:40.499124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95ec14f3-d082-499d-9f0e-1e18d9d1b299 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:40.499878 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95ec14f3-d082-499d-9f0e-1e18d9d1b299 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:40.500853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95ec14f3-d082-499d-9f0e-1e18d9d1b299 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:40.502057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-95ec14f3-d082-499d-9f0e-1e18d9d1b299 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:40.599943 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-95ec14f3-d082-499d-9f0e-1e18d9d1b299 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:40.617216 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-95ec14f3-d082-499d-9f0e-1e18d9d1b299 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1326 microversion: 2.1 time: 0.136603 Jul 26 15:22:40.617942 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3411/6938] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:40 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:41.651423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2cd808ee-89bb-4068-9fad-dfedd0586d7a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:41.652691 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2cd808ee-89bb-4068-9fad-dfedd0586d7a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:41.661171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cd808ee-89bb-4068-9fad-dfedd0586d7a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:41.661651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cd808ee-89bb-4068-9fad-dfedd0586d7a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:41.662456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cd808ee-89bb-4068-9fad-dfedd0586d7a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:41.662921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cd808ee-89bb-4068-9fad-dfedd0586d7a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:42.163585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2cd808ee-89bb-4068-9fad-dfedd0586d7a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:42.166982 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2cd808ee-89bb-4068-9fad-dfedd0586d7a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1392 microversion: 2.1 time: 0.519650 Jul 26 15:22:42.167557 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3528/6939] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:41 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1392 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:42.499591 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-af831326-b91e-4586-a37e-802df8a88f07 req-7b4b822e-8644-452f-8c81-214db1ed138e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36adb24e-1b5e-485b-89ce-7dcf71961514", "tag": "f978b6b8-3f7d-48d9-ab81-ee638f7a97dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:42.548907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-af831326-b91e-4586-a37e-802df8a88f07 req-7b4b822e-8644-452f-8c81-214db1ed138e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:42.549807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-af831326-b91e-4586-a37e-802df8a88f07 req-7b4b822e-8644-452f-8c81-214db1ed138e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:42.563649 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-af831326-b91e-4586-a37e-802df8a88f07 req-7b4b822e-8644-452f-8c81-214db1ed138e service nova] Creating event network-changed:f978b6b8-3f7d-48d9-ab81-ee638f7a97dd for instance 36adb24e-1b5e-485b-89ce-7dcf71961514 on n-h2-833090-9 Jul 26 15:22:42.574943 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-af831326-b91e-4586-a37e-802df8a88f07 req-7b4b822e-8644-452f-8c81-214db1ed138e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081952 Jul 26 15:22:42.576480 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3412/6940] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:22:43.190402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1cd9ea8d-ad08-469f-b95f-790179f8103c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:43.191123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1cd9ea8d-ad08-469f-b95f-790179f8103c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:43.199441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1cd9ea8d-ad08-469f-b95f-790179f8103c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:43.208112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1cd9ea8d-ad08-469f-b95f-790179f8103c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:43.208112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1cd9ea8d-ad08-469f-b95f-790179f8103c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:43.208112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1cd9ea8d-ad08-469f-b95f-790179f8103c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:43.348715 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1cd9ea8d-ad08-469f-b95f-790179f8103c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:43.357509 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1cd9ea8d-ad08-469f-b95f-790179f8103c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1392 microversion: 2.1 time: 0.171746 Jul 26 15:22:43.358114 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3529/6941] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:43 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:44.380062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a61c95d-b871-485a-b64f-9761fb99c096 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:44.380772 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4a61c95d-b871-485a-b64f-9761fb99c096 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:44.387817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a61c95d-b871-485a-b64f-9761fb99c096 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:44.388311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a61c95d-b871-485a-b64f-9761fb99c096 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:44.389453 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a61c95d-b871-485a-b64f-9761fb99c096 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:44.389581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a61c95d-b871-485a-b64f-9761fb99c096 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:44.535828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4a61c95d-b871-485a-b64f-9761fb99c096 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:44.544818 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4a61c95d-b871-485a-b64f-9761fb99c096 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1392 microversion: 2.1 time: 0.169629 Jul 26 15:22:44.545406 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3413/6942] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:44 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:45.569317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-448546d9-8b39-4fbb-845b-b2790ebe9725 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:45.569988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-448546d9-8b39-4fbb-845b-b2790ebe9725 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:45.580312 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-448546d9-8b39-4fbb-845b-b2790ebe9725 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:45.580794 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-448546d9-8b39-4fbb-845b-b2790ebe9725 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:45.581624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-448546d9-8b39-4fbb-845b-b2790ebe9725 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:45.582095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-448546d9-8b39-4fbb-845b-b2790ebe9725 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:45.741143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-448546d9-8b39-4fbb-845b-b2790ebe9725 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:45.750435 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-448546d9-8b39-4fbb-845b-b2790ebe9725 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1392 microversion: 2.1 time: 0.187699 Jul 26 15:22:45.751280 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3530/6943] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:45 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:46.772197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d41b01e3-5b88-4f4d-bcdb-6b7445566c9b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:46.772847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d41b01e3-5b88-4f4d-bcdb-6b7445566c9b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:46.781519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d41b01e3-5b88-4f4d-bcdb-6b7445566c9b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:46.781979 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d41b01e3-5b88-4f4d-bcdb-6b7445566c9b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:46.782760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d41b01e3-5b88-4f4d-bcdb-6b7445566c9b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:46.783210 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d41b01e3-5b88-4f4d-bcdb-6b7445566c9b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:46.931406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d41b01e3-5b88-4f4d-bcdb-6b7445566c9b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:46.943176 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d41b01e3-5b88-4f4d-bcdb-6b7445566c9b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1392 microversion: 2.1 time: 0.174886 Jul 26 15:22:46.943782 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3414/6944] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:46 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:47.400896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a4bb6326-821f-4d4a-8d26-b78609a7367b req-041758a9-6ba8-4294-9d20-3f188243ef6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36adb24e-1b5e-485b-89ce-7dcf71961514", "name": "network-vif-plugged", "status": "completed", "tag": "f978b6b8-3f7d-48d9-ab81-ee638f7a97dd"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:47.412450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a4bb6326-821f-4d4a-8d26-b78609a7367b req-041758a9-6ba8-4294-9d20-3f188243ef6d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:47.412931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a4bb6326-821f-4d4a-8d26-b78609a7367b req-041758a9-6ba8-4294-9d20-3f188243ef6d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:47.426399 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a4bb6326-821f-4d4a-8d26-b78609a7367b req-041758a9-6ba8-4294-9d20-3f188243ef6d service nova] Creating event network-vif-plugged:f978b6b8-3f7d-48d9-ab81-ee638f7a97dd for instance 36adb24e-1b5e-485b-89ce-7dcf71961514 on n-h2-833090-9 Jul 26 15:22:47.431725 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a4bb6326-821f-4d4a-8d26-b78609a7367b req-041758a9-6ba8-4294-9d20-3f188243ef6d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034662 Jul 26 15:22:47.432461 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3531/6945] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:22:47.963766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a58a245f-b911-4543-925f-91bbabe2364e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:47.964491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a58a245f-b911-4543-925f-91bbabe2364e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:47.971859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a58a245f-b911-4543-925f-91bbabe2364e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:47.972409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a58a245f-b911-4543-925f-91bbabe2364e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:47.973156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a58a245f-b911-4543-925f-91bbabe2364e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:47.973599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a58a245f-b911-4543-925f-91bbabe2364e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:48.123424 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a58a245f-b911-4543-925f-91bbabe2364e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:48.131473 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a58a245f-b911-4543-925f-91bbabe2364e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1392 microversion: 2.1 time: 0.171756 Jul 26 15:22:48.132116 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3415/6946] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:47 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:49.153758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-83f4a043-3328-4acb-ad60-b9b9324627f7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:49.154486 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-83f4a043-3328-4acb-ad60-b9b9324627f7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:49.160875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83f4a043-3328-4acb-ad60-b9b9324627f7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:49.161349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83f4a043-3328-4acb-ad60-b9b9324627f7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:49.162137 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83f4a043-3328-4acb-ad60-b9b9324627f7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:49.162600 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-83f4a043-3328-4acb-ad60-b9b9324627f7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:49.307094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-83f4a043-3328-4acb-ad60-b9b9324627f7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:49.315977 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-83f4a043-3328-4acb-ad60-b9b9324627f7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1562 microversion: 2.1 time: 0.167679 Jul 26 15:22:49.316777 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3532/6947] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:49 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:49.337189 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4a5911fa-0e70-4a3f-90b4-f41634598ddc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:49.337811 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4a5911fa-0e70-4a3f-90b4-f41634598ddc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:49.341352 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:49.342040 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:49.348151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a5911fa-0e70-4a3f-90b4-f41634598ddc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:49.348614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a5911fa-0e70-4a3f-90b4-f41634598ddc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:49.349406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a5911fa-0e70-4a3f-90b4-f41634598ddc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:49.349856 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4a5911fa-0e70-4a3f-90b4-f41634598ddc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:49.494495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4a5911fa-0e70-4a3f-90b4-f41634598ddc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:49.502927 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4a5911fa-0e70-4a3f-90b4-f41634598ddc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1562 microversion: 2.1 time: 0.169619 Jul 26 15:22:49.503512 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3416/6948] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:49 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:22:51.179122 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f962adf0-a851-42aa-b5ec-1e1c7f0b05b3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:22:51.180071 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f962adf0-a851-42aa-b5ec-1e1c7f0b05b3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:22:51.181388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-835c3ff5-e384-411a-be8f-8a5d5d1dbe65 req-0ffb2502-2dd2-40dc-a82e-013d35f71b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36adb24e-1b5e-485b-89ce-7dcf71961514", "tag": "f978b6b8-3f7d-48d9-ab81-ee638f7a97dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:22:51.184256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:51.186593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:51.188485 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:22:51.192057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f962adf0-a851-42aa-b5ec-1e1c7f0b05b3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:51.192536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f962adf0-a851-42aa-b5ec-1e1c7f0b05b3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:51.193373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f962adf0-a851-42aa-b5ec-1e1c7f0b05b3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:51.193918 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f962adf0-a851-42aa-b5ec-1e1c7f0b05b3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:51.195807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-835c3ff5-e384-411a-be8f-8a5d5d1dbe65 req-0ffb2502-2dd2-40dc-a82e-013d35f71b1a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:22:51.196425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-835c3ff5-e384-411a-be8f-8a5d5d1dbe65 req-0ffb2502-2dd2-40dc-a82e-013d35f71b1a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:22:51.213161 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-835c3ff5-e384-411a-be8f-8a5d5d1dbe65 req-0ffb2502-2dd2-40dc-a82e-013d35f71b1a service nova] Creating event network-changed:f978b6b8-3f7d-48d9-ab81-ee638f7a97dd for instance 36adb24e-1b5e-485b-89ce-7dcf71961514 on n-h2-833090-9 Jul 26 15:22:51.219673 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-835c3ff5-e384-411a-be8f-8a5d5d1dbe65 req-0ffb2502-2dd2-40dc-a82e-013d35f71b1a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042358 Jul 26 15:22:51.220945 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3417/6949] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:22:51.388378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f962adf0-a851-42aa-b5ec-1e1c7f0b05b3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:22:51.399491 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f962adf0-a851-42aa-b5ec-1e1c7f0b05b3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1562 microversion: 2.1 time: 0.223677 Jul 26 15:22:51.412082 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3533/6950] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:22:51 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:14.656831 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=36 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:14.662013 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b49e3ed8-07b2-4c45-bd02-6ba37930b6f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:23:14.664343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b49e3ed8-07b2-4c45-bd02-6ba37930b6f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:14.672498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b49e3ed8-07b2-4c45-bd02-6ba37930b6f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:14.672964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b49e3ed8-07b2-4c45-bd02-6ba37930b6f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:14.673761 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b49e3ed8-07b2-4c45-bd02-6ba37930b6f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:14.674216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b49e3ed8-07b2-4c45-bd02-6ba37930b6f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:14.734238 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b49e3ed8-07b2-4c45-bd02-6ba37930b6f9 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514/action" status: 200 len: 24568 microversion: 2.1 time: 0.079308 Jul 26 15:23:14.734875 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3418/6951] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:23:14 2022] POST /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514/action => generated 24568 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:23:25.779911 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-37919dd9-3951-4bca-945d-f52c7184ea82 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:23:25.782124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-37919dd9-3951-4bca-945d-f52c7184ea82 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:25.784290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:25.784957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=32 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:25.790991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37919dd9-3951-4bca-945d-f52c7184ea82 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:25.791462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37919dd9-3951-4bca-945d-f52c7184ea82 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:25.792867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37919dd9-3951-4bca-945d-f52c7184ea82 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:25.793324 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37919dd9-3951-4bca-945d-f52c7184ea82 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:25.875404 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-37919dd9-3951-4bca-945d-f52c7184ea82 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514/action" status: 202 len: 0 microversion: 2.1 time: 0.099581 Jul 26 15:23:25.876452 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3534/6952] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:23:25 2022] POST /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:23:25.885894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-67753eac-8438-48da-ab71-df1d1150097f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:25.886989 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-67753eac-8438-48da-ab71-df1d1150097f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:25.890258 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:25.891007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=4 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:23:25.898689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67753eac-8438-48da-ab71-df1d1150097f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:25.899185 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67753eac-8438-48da-ab71-df1d1150097f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:25.899999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67753eac-8438-48da-ab71-df1d1150097f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:25.900923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67753eac-8438-48da-ab71-df1d1150097f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:26.133881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-67753eac-8438-48da-ab71-df1d1150097f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:26.142250 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-67753eac-8438-48da-ab71-df1d1150097f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1672 microversion: 2.1 time: 0.261220 Jul 26 15:23:26.142835 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3419/6953] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:25 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1672 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:27.168939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae596fbe-3c77-49f8-b376-ee250b60cc2c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:27.169665 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ae596fbe-3c77-49f8-b376-ee250b60cc2c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:27.176476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae596fbe-3c77-49f8-b376-ee250b60cc2c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:27.176951 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae596fbe-3c77-49f8-b376-ee250b60cc2c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:27.177751 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae596fbe-3c77-49f8-b376-ee250b60cc2c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:27.178444 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae596fbe-3c77-49f8-b376-ee250b60cc2c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:27.326171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ae596fbe-3c77-49f8-b376-ee250b60cc2c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:27.333968 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ae596fbe-3c77-49f8-b376-ee250b60cc2c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.171397 Jul 26 15:23:27.334542 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3535/6954] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:27 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:28.355881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-20e2a48e-ed71-4556-ac75-540c4f2ad307 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:28.356551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-20e2a48e-ed71-4556-ac75-540c4f2ad307 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:28.364412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20e2a48e-ed71-4556-ac75-540c4f2ad307 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:28.364875 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20e2a48e-ed71-4556-ac75-540c4f2ad307 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:28.365663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20e2a48e-ed71-4556-ac75-540c4f2ad307 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:28.366239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-20e2a48e-ed71-4556-ac75-540c4f2ad307 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:28.506320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-20e2a48e-ed71-4556-ac75-540c4f2ad307 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:28.514507 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-20e2a48e-ed71-4556-ac75-540c4f2ad307 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.162856 Jul 26 15:23:28.515081 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3420/6955] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:28 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:29.537585 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f0bd09f6-8753-43fb-afb9-8b1b7d8ca664 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:29.538253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f0bd09f6-8753-43fb-afb9-8b1b7d8ca664 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:29.545772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0bd09f6-8753-43fb-afb9-8b1b7d8ca664 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:29.546257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0bd09f6-8753-43fb-afb9-8b1b7d8ca664 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:29.547055 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0bd09f6-8753-43fb-afb9-8b1b7d8ca664 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:29.547521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f0bd09f6-8753-43fb-afb9-8b1b7d8ca664 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:29.686522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f0bd09f6-8753-43fb-afb9-8b1b7d8ca664 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:29.694260 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f0bd09f6-8753-43fb-afb9-8b1b7d8ca664 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.160803 Jul 26 15:23:29.694837 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3536/6956] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:29 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:30.717027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a15dd2cf-d372-4f6e-bd96-708828515c29 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:30.717581 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a15dd2cf-d372-4f6e-bd96-708828515c29 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:30.724624 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a15dd2cf-d372-4f6e-bd96-708828515c29 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:30.725087 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a15dd2cf-d372-4f6e-bd96-708828515c29 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:30.725911 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a15dd2cf-d372-4f6e-bd96-708828515c29 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:30.726462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a15dd2cf-d372-4f6e-bd96-708828515c29 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:30.859502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a15dd2cf-d372-4f6e-bd96-708828515c29 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:30.867110 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a15dd2cf-d372-4f6e-bd96-708828515c29 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.154656 Jul 26 15:23:30.867685 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3421/6957] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:30 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:31.889921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-36e7a776-17c5-4841-a07c-076fc2a7d357 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:31.890556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-36e7a776-17c5-4841-a07c-076fc2a7d357 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:31.897511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e7a776-17c5-4841-a07c-076fc2a7d357 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:31.897987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e7a776-17c5-4841-a07c-076fc2a7d357 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:31.898836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e7a776-17c5-4841-a07c-076fc2a7d357 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:31.899230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-36e7a776-17c5-4841-a07c-076fc2a7d357 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:32.047531 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-36e7a776-17c5-4841-a07c-076fc2a7d357 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:32.055310 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-36e7a776-17c5-4841-a07c-076fc2a7d357 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.170988 Jul 26 15:23:32.055874 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3537/6958] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:31 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:33.077889 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0e03a794-364f-4b70-990d-87d0ef033240 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:33.078437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0e03a794-364f-4b70-990d-87d0ef033240 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:33.085371 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e03a794-364f-4b70-990d-87d0ef033240 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:33.085825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e03a794-364f-4b70-990d-87d0ef033240 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:33.086602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e03a794-364f-4b70-990d-87d0ef033240 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:33.087046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0e03a794-364f-4b70-990d-87d0ef033240 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:33.228621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0e03a794-364f-4b70-990d-87d0ef033240 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:33.237436 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0e03a794-364f-4b70-990d-87d0ef033240 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.164481 Jul 26 15:23:33.238017 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3422/6959] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:33 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:34.258827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-66a43ba5-23d1-4fcb-97bc-d8be3a55633b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:34.259464 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-66a43ba5-23d1-4fcb-97bc-d8be3a55633b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:34.266706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66a43ba5-23d1-4fcb-97bc-d8be3a55633b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:34.267177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66a43ba5-23d1-4fcb-97bc-d8be3a55633b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:34.267984 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66a43ba5-23d1-4fcb-97bc-d8be3a55633b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:34.268449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-66a43ba5-23d1-4fcb-97bc-d8be3a55633b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:34.415028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-66a43ba5-23d1-4fcb-97bc-d8be3a55633b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:34.424228 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-66a43ba5-23d1-4fcb-97bc-d8be3a55633b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.169227 Jul 26 15:23:34.424808 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3538/6960] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:34 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:35.445916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-39d889d4-fa2d-46bf-9d6b-3995ded9b7b1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:35.446527 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-39d889d4-fa2d-46bf-9d6b-3995ded9b7b1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:35.454717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39d889d4-fa2d-46bf-9d6b-3995ded9b7b1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:35.455167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39d889d4-fa2d-46bf-9d6b-3995ded9b7b1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:35.455961 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39d889d4-fa2d-46bf-9d6b-3995ded9b7b1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:35.456411 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-39d889d4-fa2d-46bf-9d6b-3995ded9b7b1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:35.600231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-39d889d4-fa2d-46bf-9d6b-3995ded9b7b1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:35.609060 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-39d889d4-fa2d-46bf-9d6b-3995ded9b7b1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.167054 Jul 26 15:23:35.609638 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3423/6961] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:35 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:36.631833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f6ab7793-ff0b-41a3-b6a4-b7ef5c06fe2d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:36.632684 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f6ab7793-ff0b-41a3-b6a4-b7ef5c06fe2d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:36.641659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ab7793-ff0b-41a3-b6a4-b7ef5c06fe2d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:36.642144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ab7793-ff0b-41a3-b6a4-b7ef5c06fe2d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:36.642961 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ab7793-ff0b-41a3-b6a4-b7ef5c06fe2d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:36.643434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f6ab7793-ff0b-41a3-b6a4-b7ef5c06fe2d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:36.783823 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f6ab7793-ff0b-41a3-b6a4-b7ef5c06fe2d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:36.793096 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f6ab7793-ff0b-41a3-b6a4-b7ef5c06fe2d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.164936 Jul 26 15:23:36.793685 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3539/6962] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:36 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:37.816188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12aafb1a-223d-450f-8e53-713ed1e9bab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:37.816801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-12aafb1a-223d-450f-8e53-713ed1e9bab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:37.824711 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12aafb1a-223d-450f-8e53-713ed1e9bab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:37.825164 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12aafb1a-223d-450f-8e53-713ed1e9bab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:37.825949 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12aafb1a-223d-450f-8e53-713ed1e9bab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:37.826391 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12aafb1a-223d-450f-8e53-713ed1e9bab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:37.964737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-12aafb1a-223d-450f-8e53-713ed1e9bab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:37.972504 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-12aafb1a-223d-450f-8e53-713ed1e9bab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.161408 Jul 26 15:23:37.973095 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3424/6963] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:37 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:38.995235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7b7d7da0-12cb-432a-8159-3cba7d2f3162 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:38.995931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7b7d7da0-12cb-432a-8159-3cba7d2f3162 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:39.002860 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b7d7da0-12cb-432a-8159-3cba7d2f3162 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:39.003325 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b7d7da0-12cb-432a-8159-3cba7d2f3162 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:39.004149 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b7d7da0-12cb-432a-8159-3cba7d2f3162 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:39.004610 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7b7d7da0-12cb-432a-8159-3cba7d2f3162 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:39.148000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7b7d7da0-12cb-432a-8159-3cba7d2f3162 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:39.158149 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7b7d7da0-12cb-432a-8159-3cba7d2f3162 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.167298 Jul 26 15:23:39.158946 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3540/6964] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:38 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:40.180876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3e6f2bfb-100c-497a-8d52-38796227168a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:40.181501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3e6f2bfb-100c-497a-8d52-38796227168a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:40.189953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e6f2bfb-100c-497a-8d52-38796227168a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:40.190419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e6f2bfb-100c-497a-8d52-38796227168a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:40.191212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e6f2bfb-100c-497a-8d52-38796227168a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:40.191661 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3e6f2bfb-100c-497a-8d52-38796227168a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:40.336600 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3e6f2bfb-100c-497a-8d52-38796227168a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:40.345088 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3e6f2bfb-100c-497a-8d52-38796227168a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.168543 Jul 26 15:23:40.345661 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3425/6965] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:40 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:23:41.366713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4d43d51e-d65f-4e45-962f-2ccdb73b83ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:41.367510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-4d43d51e-d65f-4e45-962f-2ccdb73b83ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:41.375218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d43d51e-d65f-4e45-962f-2ccdb73b83ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:41.375693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d43d51e-d65f-4e45-962f-2ccdb73b83ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:41.376524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d43d51e-d65f-4e45-962f-2ccdb73b83ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:41.376987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-4d43d51e-d65f-4e45-962f-2ccdb73b83ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:41.516233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-4d43d51e-d65f-4e45-962f-2ccdb73b83ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:41.524001 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4d43d51e-d65f-4e45-962f-2ccdb73b83ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1677 microversion: 2.1 time: 0.161277 Jul 26 15:23:41.524569 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3541/6966] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:41 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:23:42.547278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-efee6afa-ada2-45d7-b42c-d522ef445e68 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:23:42.547903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-efee6afa-ada2-45d7-b42c-d522ef445e68 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:23:42.555179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-efee6afa-ada2-45d7-b42c-d522ef445e68 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:42.555631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-efee6afa-ada2-45d7-b42c-d522ef445e68 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:42.556454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-efee6afa-ada2-45d7-b42c-d522ef445e68 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:23:42.557004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-efee6afa-ada2-45d7-b42c-d522ef445e68 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:23:42.696467 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-efee6afa-ada2-45d7-b42c-d522ef445e68 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:23:42.704768 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-efee6afa-ada2-45d7-b42c-d522ef445e68 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1680 microversion: 2.1 time: 0.161899 Jul 26 15:23:42.705344 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3426/6967] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:23:42 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:08.912094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1dcc23b3-9b75-4c05-839b-5b33b60ff38a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:24:08.914442 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1dcc23b3-9b75-4c05-839b-5b33b60ff38a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:08.918310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=16 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:08.919018 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:08.925344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dcc23b3-9b75-4c05-839b-5b33b60ff38a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:08.925827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dcc23b3-9b75-4c05-839b-5b33b60ff38a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:08.926647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dcc23b3-9b75-4c05-839b-5b33b60ff38a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:08.927112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dcc23b3-9b75-4c05-839b-5b33b60ff38a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:08.985493 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1dcc23b3-9b75-4c05-839b-5b33b60ff38a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514/action" status: 200 len: 68759 microversion: 2.1 time: 0.078839 Jul 26 15:24:08.986539 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3542/6968] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:24:08 2022] POST /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514/action => generated 68759 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:24:16.375421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1f8701ae-f634-4a10-99f9-914ce7cbea70 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:16.376124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f8701ae-f634-4a10-99f9-914ce7cbea70 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:16.378120 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d1b812cb-8cd7-461f-8252-c0dfb42ffbb9 req-592cfa18-bb4f-4b2b-aa55-1da852aebbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36adb24e-1b5e-485b-89ce-7dcf71961514", "tag": "f978b6b8-3f7d-48d9-ab81-ee638f7a97dd"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:24:16.378575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=16 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:16.379267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=48 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:16.387301 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f8701ae-f634-4a10-99f9-914ce7cbea70 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:16.387810 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f8701ae-f634-4a10-99f9-914ce7cbea70 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:16.390274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f8701ae-f634-4a10-99f9-914ce7cbea70 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:16.390274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1f8701ae-f634-4a10-99f9-914ce7cbea70 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:16.391399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d1b812cb-8cd7-461f-8252-c0dfb42ffbb9 req-592cfa18-bb4f-4b2b-aa55-1da852aebbb1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:16.392098 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d1b812cb-8cd7-461f-8252-c0dfb42ffbb9 req-592cfa18-bb4f-4b2b-aa55-1da852aebbb1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:16.405035 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d1b812cb-8cd7-461f-8252-c0dfb42ffbb9 req-592cfa18-bb4f-4b2b-aa55-1da852aebbb1 service nova] Creating event network-changed:f978b6b8-3f7d-48d9-ab81-ee638f7a97dd for instance 36adb24e-1b5e-485b-89ce-7dcf71961514 on n-h2-833090-9 Jul 26 15:24:16.415525 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d1b812cb-8cd7-461f-8252-c0dfb42ffbb9 req-592cfa18-bb4f-4b2b-aa55-1da852aebbb1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041280 Jul 26 15:24:16.417512 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3543/6969] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:24:16.424786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1f8701ae-f634-4a10-99f9-914ce7cbea70 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:24:16.523811 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1f8701ae-f634-4a10-99f9-914ce7cbea70 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "DELETE /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 204 len: 0 microversion: 2.1 time: 0.152540 Jul 26 15:24:16.524633 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3427/6970] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:24:16 2022] DELETE /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:24:16.535852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eece2f1d-5e4c-463e-8e51-2694b7b98a6d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:16.536738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eece2f1d-5e4c-463e-8e51-2694b7b98a6d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:16.549978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eece2f1d-5e4c-463e-8e51-2694b7b98a6d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:16.550458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eece2f1d-5e4c-463e-8e51-2694b7b98a6d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:16.551280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eece2f1d-5e4c-463e-8e51-2694b7b98a6d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:16.551927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eece2f1d-5e4c-463e-8e51-2694b7b98a6d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:16.735545 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eece2f1d-5e4c-463e-8e51-2694b7b98a6d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:16.744503 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eece2f1d-5e4c-463e-8e51-2694b7b98a6d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1686 microversion: 2.1 time: 0.213386 Jul 26 15:24:16.745204 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3544/6971] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:16 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1686 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:17.771545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-956bcb6c-991c-49d2-8827-710e351f9812 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:17.772429 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-956bcb6c-991c-49d2-8827-710e351f9812 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:17.781074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-956bcb6c-991c-49d2-8827-710e351f9812 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:17.781537 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-956bcb6c-991c-49d2-8827-710e351f9812 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:17.782336 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-956bcb6c-991c-49d2-8827-710e351f9812 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:17.782788 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-956bcb6c-991c-49d2-8827-710e351f9812 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:17.972059 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-956bcb6c-991c-49d2-8827-710e351f9812 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:17.981997 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-956bcb6c-991c-49d2-8827-710e351f9812 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1686 microversion: 2.1 time: 0.214813 Jul 26 15:24:17.982595 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3428/6972] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:17 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1686 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:19.016225 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-35e2d727-99f2-46c7-af3b-69d69a126438 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:19.016807 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-35e2d727-99f2-46c7-af3b-69d69a126438 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:19.023913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35e2d727-99f2-46c7-af3b-69d69a126438 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:19.024420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35e2d727-99f2-46c7-af3b-69d69a126438 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:19.026693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35e2d727-99f2-46c7-af3b-69d69a126438 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:19.026693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-35e2d727-99f2-46c7-af3b-69d69a126438 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:19.146758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-35e2d727-99f2-46c7-af3b-69d69a126438 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:19.156214 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-35e2d727-99f2-46c7-af3b-69d69a126438 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 200 len: 1500 microversion: 2.1 time: 0.143966 Jul 26 15:24:19.156821 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3545/6973] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:19 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 1500 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:19.266880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f836e2ec-9dd1-4366-b0c7-bb78273bd75f req-c15f0108-13e4-4820-b492-7d8f6f9330ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36adb24e-1b5e-485b-89ce-7dcf71961514", "name": "network-vif-deleted", "tag": "f978b6b8-3f7d-48d9-ab81-ee638f7a97dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:24:19.277412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f836e2ec-9dd1-4366-b0c7-bb78273bd75f req-c15f0108-13e4-4820-b492-7d8f6f9330ef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:19.277862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f836e2ec-9dd1-4366-b0c7-bb78273bd75f req-c15f0108-13e4-4820-b492-7d8f6f9330ef service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:19.293097 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f836e2ec-9dd1-4366-b0c7-bb78273bd75f req-c15f0108-13e4-4820-b492-7d8f6f9330ef service nova] Creating event network-vif-deleted:f978b6b8-3f7d-48d9-ab81-ee638f7a97dd for instance 36adb24e-1b5e-485b-89ce-7dcf71961514 on n-h2-833090-9 Jul 26 15:24:19.299439 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f836e2ec-9dd1-4366-b0c7-bb78273bd75f req-c15f0108-13e4-4820-b492-7d8f6f9330ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126142 Jul 26 15:24:19.300431 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3429/6974] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:24:20.178969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-722cac88-f847-412f-9c21-84d1651b2ebb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:20.179602 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-722cac88-f847-412f-9c21-84d1651b2ebb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 36adb24e-1b5e-485b-89ce-7dcf71961514] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:20.187287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-722cac88-f847-412f-9c21-84d1651b2ebb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:20.187764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-722cac88-f847-412f-9c21-84d1651b2ebb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:20.188604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-722cac88-f847-412f-9c21-84d1651b2ebb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:20.189070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-722cac88-f847-412f-9c21-84d1651b2ebb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:20.204334 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-722cac88-f847-412f-9c21-84d1651b2ebb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] HTTP exception thrown: Instance 36adb24e-1b5e-485b-89ce-7dcf71961514 could not be found. Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-722cac88-f847-412f-9c21-84d1651b2ebb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Request method failure captured: Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 HTTP/1.1 Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AZwWobvxI63mdOVS-oWvEqLyF8cT1eZMQKX5cQkkeaNcCru1ZM9pI6ztC8RXCAaiaIbH4ay2LSrHA40XxMXDFrluWb5iJMSBnoxzurC2hSsA4Lunw2O7_LR-GTzEM4dBacf2I7X2XB3X16LazlGxUWMWZHGjqsLgePN7fPx0QydZEw Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: e055abfc258c4b2f9dec5a105fa0ec41 Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e055abfc258c4b2f9dec5a105fa0ec41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e055abfc258c4b2f9dec5a105fa0ec41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e055abfc258c4b2f9dec5a105fa0ec41", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e055abfc258c4b2f9dec5a105fa0ec41"}]}] Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: e055abfc258c4b2f9dec5a105fa0ec41 Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestNetworkAdvancedServerOps-765091019-project Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: a87ec95562914f5bbe90e0d65873143e Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestNetworkAdvancedServerOps-765091019-project Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 36adb24e-1b5e-485b-89ce-7dcf71961514 could not be found. Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '36adb24e-1b5e-485b-89ce-7dcf71961514'} Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36adb24e-1b5e-485b-89ce-7dcf71961514 could not be found. Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36adb24e-1b5e-485b-89ce-7dcf71961514 could not be found. Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:24:20.206021 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:24:20.211073 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:24:20.211073 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:24:20.211073 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:24:20.211073 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:24:20.211073 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:24:20.211073 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36adb24e-1b5e-485b-89ce-7dcf71961514 could not be found. Jul 26 15:24:20.211073 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:24:20.211073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-722cac88-f847-412f-9c21-84d1651b2ebb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Returning 404 to user: Instance 36adb24e-1b5e-485b-89ce-7dcf71961514 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:24:20.211073 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-722cac88-f847-412f-9c21-84d1651b2ebb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514" status: 404 len: 111 microversion: 2.1 time: 0.032597 Jul 26 15:24:20.211073 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3546/6975] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:20 2022] GET /compute/v2.1/servers/36adb24e-1b5e-485b-89ce-7dcf71961514 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:24:23.407984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5571e7bc-3a1b-44be-89b3-197052471c61 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '.version_select at 0x7f8799268c10>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:23.437623 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5571e7bc-3a1b-44be-89b3-197052471c61 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1995380389" status: 202 len: 0 microversion: 2.1 time: 0.038052 Jul 26 15:24:23.438287 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3430/6976] 10.222.0.70 () {58 vars in 1284 bytes} [Tue Jul 26 15:24:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1995380389 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:24:23.468975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-63940d5f-0311-45bd-8cc3-7fd50ed5f948 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'create', calling method: .version_select at 0x7f87993af790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-874229381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4wIjHxMtBuwtWiW+Swo7SJKHdl5Pn3ZXoDLlLr3WTxnUmQBxhASG9G9skRsRXLk/wctoLA2KYgmcDlSjVDdc+5VQ17Axoze3dYHWSWiikv+MzmVuAqg+FEbfNpaZeCtw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:24:23.487842 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-63940d5f-0311-45bd-8cc3-7fd50ed5f948 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:24:23.496484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-63940d5f-0311-45bd-8cc3-7fd50ed5f948 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for user a87ec95562914f5bbe90e0d65873143e and project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:24:23.525449 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-63940d5f-0311-45bd-8cc3-7fd50ed5f948 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.062532 Jul 26 15:24:23.526249 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3547/6977] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:24:23 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:24:29.500156 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:29.504501 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1399638692", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "0895f9cb-e3c7-43e2-887b-cb6cd9db7c60"}], "key_name": "tempest-TestNetworkAdvancedServerOps-874229381", "security_groups": [{"name": "tempest-secgroup-smoke-1482251340"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:24:29.644207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] validate_networks() for [('0895f9cb-e3c7-43e2-887b-cb6cd9db7c60', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:24:30.098400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:24:30.098855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:24:30.099376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:24:30.099800 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:24:30.100241 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:24:30.109843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:30.110204 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:30.111024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:30.111475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:30.129557 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:24:30.136713 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for user a87ec95562914f5bbe90e0d65873143e and project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:24:30.151135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:24:30.153686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:24:30.204703 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f11f3f86-6d32-42d0-965f-faae86b2c306 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706379 Jul 26 15:24:30.205668 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3431/6978] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:24:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:24:30.221538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5f90e7cc-d37e-43f5-a8ba-d86673b8353e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:30.222428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5f90e7cc-d37e-43f5-a8ba-d86673b8353e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:30.225641 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=20 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:30.286676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5f90e7cc-d37e-43f5-a8ba-d86673b8353e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:30.295246 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5f90e7cc-d37e-43f5-a8ba-d86673b8353e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1266 microversion: 2.1 time: 0.078106 Jul 26 15:24:30.307980 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3548/6979] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:30 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:24:31.320102 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-53220979-13c3-43e2-af58-01e34dc1da52 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:31.320729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-53220979-13c3-43e2-af58-01e34dc1da52 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:31.327881 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53220979-13c3-43e2-af58-01e34dc1da52 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:31.328385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53220979-13c3-43e2-af58-01e34dc1da52 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:31.329167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53220979-13c3-43e2-af58-01e34dc1da52 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:31.329610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-53220979-13c3-43e2-af58-01e34dc1da52 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:31.430904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-53220979-13c3-43e2-af58-01e34dc1da52 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:31.439657 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-53220979-13c3-43e2-af58-01e34dc1da52 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1336 microversion: 2.1 time: 0.124438 Jul 26 15:24:31.440290 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3432/6980] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:31 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:32.461925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-19370547-428f-4e21-ba5c-23125fe66188 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:32.462816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-19370547-428f-4e21-ba5c-23125fe66188 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:32.471635 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19370547-428f-4e21-ba5c-23125fe66188 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:32.472176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19370547-428f-4e21-ba5c-23125fe66188 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:32.474526 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19370547-428f-4e21-ba5c-23125fe66188 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:32.475006 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-19370547-428f-4e21-ba5c-23125fe66188 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:32.694480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-19370547-428f-4e21-ba5c-23125fe66188 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:32.704337 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-19370547-428f-4e21-ba5c-23125fe66188 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1392 microversion: 2.1 time: 0.246620 Jul 26 15:24:32.705346 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3549/6981] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:32 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:33.059172 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a28f606c-5921-410b-85b7-f2e2df230d3e req-6e294ea0-7db5-4465-ba08-7bce0a0f0e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc0db99-cb9f-4d99-b95c-6c416135afbf", "tag": "c6e2bc9f-4f79-488e-b643-c718476df0dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:24:33.086262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a28f606c-5921-410b-85b7-f2e2df230d3e req-6e294ea0-7db5-4465-ba08-7bce0a0f0e92 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:33.086963 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a28f606c-5921-410b-85b7-f2e2df230d3e req-6e294ea0-7db5-4465-ba08-7bce0a0f0e92 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:33.101473 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a28f606c-5921-410b-85b7-f2e2df230d3e req-6e294ea0-7db5-4465-ba08-7bce0a0f0e92 service nova] Creating event network-changed:c6e2bc9f-4f79-488e-b643-c718476df0dd for instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf on n-h1-833090-9 Jul 26 15:24:33.108854 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a28f606c-5921-410b-85b7-f2e2df230d3e req-6e294ea0-7db5-4465-ba08-7bce0a0f0e92 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061323 Jul 26 15:24:33.109503 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3433/6982] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:24:33.726798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1e37d3ca-0e53-4713-891b-972a9ac1feed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:33.727446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1e37d3ca-0e53-4713-891b-972a9ac1feed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:33.734676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e37d3ca-0e53-4713-891b-972a9ac1feed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:33.735160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e37d3ca-0e53-4713-891b-972a9ac1feed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:33.735987 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e37d3ca-0e53-4713-891b-972a9ac1feed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:33.736461 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1e37d3ca-0e53-4713-891b-972a9ac1feed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:33.878119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1e37d3ca-0e53-4713-891b-972a9ac1feed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:33.888470 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1e37d3ca-0e53-4713-891b-972a9ac1feed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1392 microversion: 2.1 time: 0.165419 Jul 26 15:24:33.889070 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3550/6983] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:33 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:34.912864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1b10e653-2d0c-4949-af4d-2d4a50c2fa6c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:34.912864 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1b10e653-2d0c-4949-af4d-2d4a50c2fa6c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:34.920475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b10e653-2d0c-4949-af4d-2d4a50c2fa6c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:34.921201 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b10e653-2d0c-4949-af4d-2d4a50c2fa6c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:34.921993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b10e653-2d0c-4949-af4d-2d4a50c2fa6c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:34.922436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1b10e653-2d0c-4949-af4d-2d4a50c2fa6c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:35.067922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1b10e653-2d0c-4949-af4d-2d4a50c2fa6c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:35.078450 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1b10e653-2d0c-4949-af4d-2d4a50c2fa6c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1392 microversion: 2.1 time: 0.171988 Jul 26 15:24:35.079039 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3434/6984] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:34 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:36.100250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-db8de0a8-6f03-43f7-b933-e75658fa1cf0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:36.100845 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-db8de0a8-6f03-43f7-b933-e75658fa1cf0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:36.108304 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db8de0a8-6f03-43f7-b933-e75658fa1cf0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:36.108783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db8de0a8-6f03-43f7-b933-e75658fa1cf0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:36.109577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db8de0a8-6f03-43f7-b933-e75658fa1cf0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:36.110039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-db8de0a8-6f03-43f7-b933-e75658fa1cf0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:36.245212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-db8de0a8-6f03-43f7-b933-e75658fa1cf0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:36.257285 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-db8de0a8-6f03-43f7-b933-e75658fa1cf0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1392 microversion: 2.1 time: 0.161029 Jul 26 15:24:36.257868 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3551/6985] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:36 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:37.279750 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-46b16e7f-ba48-434c-b616-b5d65aed320f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:37.280425 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-46b16e7f-ba48-434c-b616-b5d65aed320f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:37.287586 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46b16e7f-ba48-434c-b616-b5d65aed320f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:37.288069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46b16e7f-ba48-434c-b616-b5d65aed320f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:37.288849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46b16e7f-ba48-434c-b616-b5d65aed320f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:37.289291 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-46b16e7f-ba48-434c-b616-b5d65aed320f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:37.437141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-46b16e7f-ba48-434c-b616-b5d65aed320f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:37.445666 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-46b16e7f-ba48-434c-b616-b5d65aed320f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1392 microversion: 2.1 time: 0.170662 Jul 26 15:24:37.446268 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3435/6986] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:37 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:37.633384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-544743e9-481d-46cd-891d-bf299471c8e8 req-98865bd7-fa7d-42cc-8f11-4dc1f0cf5097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc0db99-cb9f-4d99-b95c-6c416135afbf", "name": "network-vif-plugged", "status": "completed", "tag": "c6e2bc9f-4f79-488e-b643-c718476df0dd"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:24:37.644092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-544743e9-481d-46cd-891d-bf299471c8e8 req-98865bd7-fa7d-42cc-8f11-4dc1f0cf5097 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:37.644571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-544743e9-481d-46cd-891d-bf299471c8e8 req-98865bd7-fa7d-42cc-8f11-4dc1f0cf5097 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:37.656866 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-544743e9-481d-46cd-891d-bf299471c8e8 req-98865bd7-fa7d-42cc-8f11-4dc1f0cf5097 service nova] Creating event network-vif-plugged:c6e2bc9f-4f79-488e-b643-c718476df0dd for instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf on n-h1-833090-9 Jul 26 15:24:37.661935 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-544743e9-481d-46cd-891d-bf299471c8e8 req-98865bd7-fa7d-42cc-8f11-4dc1f0cf5097 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092342 Jul 26 15:24:37.662555 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3552/6987] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:24:38.355618 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:24:38.355888 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:24:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:24:38.468074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d863f429-2a67-47eb-96a6-e197fc712358 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:38.468710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d863f429-2a67-47eb-96a6-e197fc712358 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:38.475880 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d863f429-2a67-47eb-96a6-e197fc712358 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:38.476569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d863f429-2a67-47eb-96a6-e197fc712358 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:38.477362 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d863f429-2a67-47eb-96a6-e197fc712358 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:38.478502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d863f429-2a67-47eb-96a6-e197fc712358 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:38.621614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d863f429-2a67-47eb-96a6-e197fc712358 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:38.629366 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d863f429-2a67-47eb-96a6-e197fc712358 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1392 microversion: 2.1 time: 0.165411 Jul 26 15:24:38.629959 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3436/6988] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:38 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:24:39.652908 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-466e66c4-7304-471b-b86d-29df61a970ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:39.653630 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-466e66c4-7304-471b-b86d-29df61a970ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:39.655530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:39.661698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-466e66c4-7304-471b-b86d-29df61a970ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:39.662167 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-466e66c4-7304-471b-b86d-29df61a970ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:39.662967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-466e66c4-7304-471b-b86d-29df61a970ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:39.663474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-466e66c4-7304-471b-b86d-29df61a970ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:39.800244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-466e66c4-7304-471b-b86d-29df61a970ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:39.808468 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-466e66c4-7304-471b-b86d-29df61a970ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1563 microversion: 2.1 time: 0.161277 Jul 26 15:24:39.809040 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3553/6989] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:39 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:24:39.829933 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f0ff0ab7-1751-4b3d-ac51-5840f8240e59 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:39.830541 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f0ff0ab7-1751-4b3d-ac51-5840f8240e59 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:39.838075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0ff0ab7-1751-4b3d-ac51-5840f8240e59 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:39.838530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0ff0ab7-1751-4b3d-ac51-5840f8240e59 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:39.839318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0ff0ab7-1751-4b3d-ac51-5840f8240e59 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:39.839765 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0ff0ab7-1751-4b3d-ac51-5840f8240e59 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:39.975530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f0ff0ab7-1751-4b3d-ac51-5840f8240e59 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:39.983098 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f0ff0ab7-1751-4b3d-ac51-5840f8240e59 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1563 microversion: 2.1 time: 0.157074 Jul 26 15:24:39.983664 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3437/6990] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:39 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:24:41.953281 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8e0fbbb5-0296-41f4-8f1b-42d4980c2066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:24:41.954008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8e0fbbb5-0296-41f4-8f1b-42d4980c2066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:24:41.955686 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3c9018f3-8a1d-4850-8c74-bbd122eb4a77 req-782efb70-01ac-427b-93e7-a9c98ba1e91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc0db99-cb9f-4d99-b95c-6c416135afbf", "tag": "c6e2bc9f-4f79-488e-b643-c718476df0dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:24:41.956244 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:41.964733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e0fbbb5-0296-41f4-8f1b-42d4980c2066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:41.965398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e0fbbb5-0296-41f4-8f1b-42d4980c2066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:41.965545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:41.966515 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:24:41.966858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e0fbbb5-0296-41f4-8f1b-42d4980c2066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:41.967310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e0fbbb5-0296-41f4-8f1b-42d4980c2066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:41.969993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3c9018f3-8a1d-4850-8c74-bbd122eb4a77 req-782efb70-01ac-427b-93e7-a9c98ba1e91c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:24:41.970461 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3c9018f3-8a1d-4850-8c74-bbd122eb4a77 req-782efb70-01ac-427b-93e7-a9c98ba1e91c service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:24:41.985575 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3c9018f3-8a1d-4850-8c74-bbd122eb4a77 req-782efb70-01ac-427b-93e7-a9c98ba1e91c service nova] Creating event network-changed:c6e2bc9f-4f79-488e-b643-c718476df0dd for instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf on n-h1-833090-9 Jul 26 15:24:41.992194 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3c9018f3-8a1d-4850-8c74-bbd122eb4a77 req-782efb70-01ac-427b-93e7-a9c98ba1e91c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039645 Jul 26 15:24:41.994984 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3438/6991] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:24:42.222171 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8e0fbbb5-0296-41f4-8f1b-42d4980c2066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:24:42.231086 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8e0fbbb5-0296-41f4-8f1b-42d4980c2066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1563 microversion: 2.1 time: 0.281618 Jul 26 15:24:42.231718 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3554/6992] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:24:41 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1563 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:05.487409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4d0bf02e-29b6-44ed-a162-818023788470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:25:05.489716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4d0bf02e-29b6-44ed-a162-818023788470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:05.492215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:05.493468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=36 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:05.500177 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d0bf02e-29b6-44ed-a162-818023788470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:05.500637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d0bf02e-29b6-44ed-a162-818023788470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:05.501426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d0bf02e-29b6-44ed-a162-818023788470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:05.501870 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4d0bf02e-29b6-44ed-a162-818023788470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:05.559263 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4d0bf02e-29b6-44ed-a162-818023788470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf/action" status: 200 len: 24563 microversion: 2.1 time: 0.076416 Jul 26 15:25:05.559932 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3439/6993] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:25:05 2022] POST /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf/action => generated 24563 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:25:11.950848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:25:11.953530 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:11.955828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:11.956673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=32 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:11.963350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:11.963815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:11.964642 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:11.965097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:12.069727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:12.076755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Old instance type m1.heat2, new instance type m1.heat {{(pid=119479) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 26 15:25:12.083836 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:25:12.084380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:25:12.084874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:25:12.085300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:25:12.085730 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:25:12.156730 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-37eae12d-36b6-4ada-a416-3b34f4998470 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf/action" status: 202 len: 0 microversion: 2.1 time: 0.210181 Jul 26 15:25:12.157418 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3555/6994] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:25:11 2022] POST /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:25:12.167199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3f8e670e-a15b-4b05-8380-08be2cbc421e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:12.167802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3f8e670e-a15b-4b05-8380-08be2cbc421e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:12.175723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f8e670e-a15b-4b05-8380-08be2cbc421e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:12.176334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f8e670e-a15b-4b05-8380-08be2cbc421e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:12.177073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f8e670e-a15b-4b05-8380-08be2cbc421e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:12.177519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3f8e670e-a15b-4b05-8380-08be2cbc421e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:12.329015 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3f8e670e-a15b-4b05-8380-08be2cbc421e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:12.337854 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3f8e670e-a15b-4b05-8380-08be2cbc421e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1690 microversion: 2.1 time: 0.175432 Jul 26 15:25:12.338538 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3440/6995] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:12 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:25:13.360509 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0a6c5723-750b-47b0-9e7b-b56c3a9444be tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:13.361204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0a6c5723-750b-47b0-9e7b-b56c3a9444be tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:13.369383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a6c5723-750b-47b0-9e7b-b56c3a9444be tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:13.369858 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a6c5723-750b-47b0-9e7b-b56c3a9444be tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:13.370659 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a6c5723-750b-47b0-9e7b-b56c3a9444be tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:13.371118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0a6c5723-750b-47b0-9e7b-b56c3a9444be tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:13.530703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0a6c5723-750b-47b0-9e7b-b56c3a9444be tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:13.538467 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0a6c5723-750b-47b0-9e7b-b56c3a9444be tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1690 microversion: 2.1 time: 0.183062 Jul 26 15:25:13.539060 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3556/6996] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:13 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:14.561310 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2f7eea1a-5b2e-40c3-999a-b47f3e1c8d12 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:14.561929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2f7eea1a-5b2e-40c3-999a-b47f3e1c8d12 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:14.568653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f7eea1a-5b2e-40c3-999a-b47f3e1c8d12 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:14.569113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f7eea1a-5b2e-40c3-999a-b47f3e1c8d12 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:14.569890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f7eea1a-5b2e-40c3-999a-b47f3e1c8d12 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:14.570337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f7eea1a-5b2e-40c3-999a-b47f3e1c8d12 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:14.711227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2f7eea1a-5b2e-40c3-999a-b47f3e1c8d12 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:14.718888 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2f7eea1a-5b2e-40c3-999a-b47f3e1c8d12 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1695 microversion: 2.1 time: 0.161567 Jul 26 15:25:14.719457 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3441/6997] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:14 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:15.744422 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eed35da2-8055-4db2-ab71-0723cfae68d4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:15.745003 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eed35da2-8055-4db2-ab71-0723cfae68d4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:15.752197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed35da2-8055-4db2-ab71-0723cfae68d4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:15.752661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed35da2-8055-4db2-ab71-0723cfae68d4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:15.753460 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed35da2-8055-4db2-ab71-0723cfae68d4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:15.753921 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eed35da2-8055-4db2-ab71-0723cfae68d4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:15.887815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eed35da2-8055-4db2-ab71-0723cfae68d4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:15.895652 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eed35da2-8055-4db2-ab71-0723cfae68d4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1695 microversion: 2.1 time: 0.155955 Jul 26 15:25:15.896271 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3557/6998] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:15 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:16.917781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f6cb6741-37c9-4b95-8a2f-03649f2b3a21 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:16.918406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f6cb6741-37c9-4b95-8a2f-03649f2b3a21 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:16.925843 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6cb6741-37c9-4b95-8a2f-03649f2b3a21 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:16.926300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6cb6741-37c9-4b95-8a2f-03649f2b3a21 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:16.927084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6cb6741-37c9-4b95-8a2f-03649f2b3a21 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:16.927563 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6cb6741-37c9-4b95-8a2f-03649f2b3a21 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:17.063131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f6cb6741-37c9-4b95-8a2f-03649f2b3a21 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:17.071812 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f6cb6741-37c9-4b95-8a2f-03649f2b3a21 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1695 microversion: 2.1 time: 0.158705 Jul 26 15:25:17.072541 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3442/6999] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:16 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:18.093577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-879539ef-5c4b-4858-9add-3fef991623ea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:18.094216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-879539ef-5c4b-4858-9add-3fef991623ea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:18.101256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-879539ef-5c4b-4858-9add-3fef991623ea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:18.101732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-879539ef-5c4b-4858-9add-3fef991623ea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:18.103155 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-879539ef-5c4b-4858-9add-3fef991623ea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:18.103624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-879539ef-5c4b-4858-9add-3fef991623ea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:18.245522 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-879539ef-5c4b-4858-9add-3fef991623ea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:18.253741 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-879539ef-5c4b-4858-9add-3fef991623ea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1695 microversion: 2.1 time: 0.164272 Jul 26 15:25:18.254320 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3558/7000] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:18 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:19.276067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8a32146e-7b58-4985-bea8-a2f28189f5a1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:19.276687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8a32146e-7b58-4985-bea8-a2f28189f5a1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:19.283922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a32146e-7b58-4985-bea8-a2f28189f5a1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:19.284415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a32146e-7b58-4985-bea8-a2f28189f5a1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:19.285190 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a32146e-7b58-4985-bea8-a2f28189f5a1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:19.285628 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a32146e-7b58-4985-bea8-a2f28189f5a1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:19.426200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8a32146e-7b58-4985-bea8-a2f28189f5a1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:19.434959 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8a32146e-7b58-4985-bea8-a2f28189f5a1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1695 microversion: 2.1 time: 0.162971 Jul 26 15:25:19.435551 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3443/7001] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:19 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:25:20.456533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fb8fdfba-903c-4069-bef9-611d3bf180c3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:20.457172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fb8fdfba-903c-4069-bef9-611d3bf180c3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:20.464434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb8fdfba-903c-4069-bef9-611d3bf180c3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:20.464909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb8fdfba-903c-4069-bef9-611d3bf180c3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:20.465703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb8fdfba-903c-4069-bef9-611d3bf180c3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:20.466161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb8fdfba-903c-4069-bef9-611d3bf180c3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:20.623884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fb8fdfba-903c-4069-bef9-611d3bf180c3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:20.631906 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fb8fdfba-903c-4069-bef9-611d3bf180c3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1695 microversion: 2.1 time: 0.179375 Jul 26 15:25:20.632698 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3559/7002] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:20 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:21.655282 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2bf2b7a9-1c80-4cd9-9b89-84472869510d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:21.655923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2bf2b7a9-1c80-4cd9-9b89-84472869510d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:21.662839 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2bf2b7a9-1c80-4cd9-9b89-84472869510d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:21.663287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2bf2b7a9-1c80-4cd9-9b89-84472869510d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:21.664090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2bf2b7a9-1c80-4cd9-9b89-84472869510d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:21.664536 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2bf2b7a9-1c80-4cd9-9b89-84472869510d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:21.801375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2bf2b7a9-1c80-4cd9-9b89-84472869510d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:21.809517 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2bf2b7a9-1c80-4cd9-9b89-84472869510d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1695 microversion: 2.1 time: 0.158164 Jul 26 15:25:21.810093 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3444/7003] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:21 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:22.830714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d77a26b5-d4d5-4889-a2e4-0e586c9a76c8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:22.831343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d77a26b5-d4d5-4889-a2e4-0e586c9a76c8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:22.839132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d77a26b5-d4d5-4889-a2e4-0e586c9a76c8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:22.839660 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d77a26b5-d4d5-4889-a2e4-0e586c9a76c8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:22.840476 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d77a26b5-d4d5-4889-a2e4-0e586c9a76c8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:22.840931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d77a26b5-d4d5-4889-a2e4-0e586c9a76c8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:22.984681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d77a26b5-d4d5-4889-a2e4-0e586c9a76c8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:22.993966 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d77a26b5-d4d5-4889-a2e4-0e586c9a76c8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1695 microversion: 2.1 time: 0.165593 Jul 26 15:25:22.995677 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3560/7004] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:22 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:24.017072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-12d34d91-2f81-47ed-adb3-8b544479bbe2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:24.017690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-12d34d91-2f81-47ed-adb3-8b544479bbe2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:24.025617 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12d34d91-2f81-47ed-adb3-8b544479bbe2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:24.026072 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12d34d91-2f81-47ed-adb3-8b544479bbe2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:24.026859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12d34d91-2f81-47ed-adb3-8b544479bbe2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:24.027300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-12d34d91-2f81-47ed-adb3-8b544479bbe2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:24.164666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-12d34d91-2f81-47ed-adb3-8b544479bbe2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:24.173194 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-12d34d91-2f81-47ed-adb3-8b544479bbe2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1695 microversion: 2.1 time: 0.160088 Jul 26 15:25:24.173770 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3445/7005] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:24 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:25.194848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-eb08e34d-397d-412d-bd2f-4f668be6763c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:25.195723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-eb08e34d-397d-412d-bd2f-4f668be6763c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:25.203019 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb08e34d-397d-412d-bd2f-4f668be6763c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:25.203491 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb08e34d-397d-412d-bd2f-4f668be6763c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:25.204332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb08e34d-397d-412d-bd2f-4f668be6763c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:25.204797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-eb08e34d-397d-412d-bd2f-4f668be6763c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:25.358043 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-eb08e34d-397d-412d-bd2f-4f668be6763c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:25.366593 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-eb08e34d-397d-412d-bd2f-4f668be6763c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1695 microversion: 2.1 time: 0.175675 Jul 26 15:25:25.367351 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3561/7006] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:25 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:26.390869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bca757ae-9197-42be-90f4-58c4606131c1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:26.392565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bca757ae-9197-42be-90f4-58c4606131c1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:26.402114 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bca757ae-9197-42be-90f4-58c4606131c1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:26.402573 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bca757ae-9197-42be-90f4-58c4606131c1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:26.403364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bca757ae-9197-42be-90f4-58c4606131c1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:26.403808 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bca757ae-9197-42be-90f4-58c4606131c1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:26.627397 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-bca757ae-9197-42be-90f4-58c4606131c1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:26.636313 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bca757ae-9197-42be-90f4-58c4606131c1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1694 microversion: 2.1 time: 0.250683 Jul 26 15:25:26.637116 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3446/7007] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:26 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1694 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:26.921480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-081c6407-878d-4248-89a0-df32f44b88cd req-e8f7a3b5-67bf-45c8-80e8-68e110532b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc0db99-cb9f-4d99-b95c-6c416135afbf", "name": "network-vif-unplugged", "status": "completed", "tag": "c6e2bc9f-4f79-488e-b643-c718476df0dd"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:25:26.932894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-081c6407-878d-4248-89a0-df32f44b88cd req-e8f7a3b5-67bf-45c8-80e8-68e110532b60 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:26.933107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-081c6407-878d-4248-89a0-df32f44b88cd req-e8f7a3b5-67bf-45c8-80e8-68e110532b60 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:26.945441 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-081c6407-878d-4248-89a0-df32f44b88cd req-e8f7a3b5-67bf-45c8-80e8-68e110532b60 service nova] Creating event network-vif-unplugged:c6e2bc9f-4f79-488e-b643-c718476df0dd for instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf on n-h2-833090-9 Jul 26 15:25:26.954213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [req-081c6407-878d-4248-89a0-df32f44b88cd req-e8f7a3b5-67bf-45c8-80e8-68e110532b60 service nova] Instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119479) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:25:26.967184 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-081c6407-878d-4248-89a0-df32f44b88cd req-e8f7a3b5-67bf-45c8-80e8-68e110532b60 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049676 Jul 26 15:25:26.967840 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3562/7008] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:25:27.660835 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a548aee3-b4ab-4ade-b675-dbc469fcbf35 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:27.661466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a548aee3-b4ab-4ade-b675-dbc469fcbf35 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:27.670951 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a548aee3-b4ab-4ade-b675-dbc469fcbf35 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:27.671672 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a548aee3-b4ab-4ade-b675-dbc469fcbf35 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:27.672492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a548aee3-b4ab-4ade-b675-dbc469fcbf35 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:27.672945 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a548aee3-b4ab-4ade-b675-dbc469fcbf35 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:27.897307 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a548aee3-b4ab-4ade-b675-dbc469fcbf35 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:27.905687 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a548aee3-b4ab-4ade-b675-dbc469fcbf35 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1694 microversion: 2.1 time: 0.250641 Jul 26 15:25:27.906275 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3447/7009] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:27 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1694 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:28.929958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8e0fe3b3-69b8-42b9-9cbe-6f6c70b423b5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:28.930673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8e0fe3b3-69b8-42b9-9cbe-6f6c70b423b5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:28.937957 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e0fe3b3-69b8-42b9-9cbe-6f6c70b423b5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:28.938965 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e0fe3b3-69b8-42b9-9cbe-6f6c70b423b5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:28.939824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e0fe3b3-69b8-42b9-9cbe-6f6c70b423b5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:28.940354 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8e0fe3b3-69b8-42b9-9cbe-6f6c70b423b5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:28.985390 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-07f63be3-6838-4706-97a5-140e13394e77 req-266d3e24-fd90-4bda-90f5-88a04ae29c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc0db99-cb9f-4d99-b95c-6c416135afbf", "tag": "c6e2bc9f-4f79-488e-b643-c718476df0dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:25:28.997239 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-07f63be3-6838-4706-97a5-140e13394e77 req-266d3e24-fd90-4bda-90f5-88a04ae29c1e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:28.997825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-07f63be3-6838-4706-97a5-140e13394e77 req-266d3e24-fd90-4bda-90f5-88a04ae29c1e service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:29.011138 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-07f63be3-6838-4706-97a5-140e13394e77 req-266d3e24-fd90-4bda-90f5-88a04ae29c1e service nova] Creating event network-changed:c6e2bc9f-4f79-488e-b643-c718476df0dd for instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf on n-h2-833090-9 Jul 26 15:25:29.017129 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [req-07f63be3-6838-4706-97a5-140e13394e77 req-266d3e24-fd90-4bda-90f5-88a04ae29c1e service nova] Instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-833090-9', 'n-h2-833090-9'} {{(pid=119478) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 26 15:25:29.029594 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-07f63be3-6838-4706-97a5-140e13394e77 req-266d3e24-fd90-4bda-90f5-88a04ae29c1e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047921 Jul 26 15:25:29.030406 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3448/7010] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:25:29.139865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8e0fe3b3-69b8-42b9-9cbe-6f6c70b423b5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:29.149088 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8e0fe3b3-69b8-42b9-9cbe-6f6c70b423b5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1692 microversion: 2.1 time: 0.224125 Jul 26 15:25:29.150120 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3563/7011] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:28 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1692 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:30.172494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b8c1597c-b9d4-4859-a847-240cbca3997a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:30.173261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b8c1597c-b9d4-4859-a847-240cbca3997a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:30.181299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8c1597c-b9d4-4859-a847-240cbca3997a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:30.181899 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8c1597c-b9d4-4859-a847-240cbca3997a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:30.182842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8c1597c-b9d4-4859-a847-240cbca3997a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:30.183446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8c1597c-b9d4-4859-a847-240cbca3997a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:30.341468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b8c1597c-b9d4-4859-a847-240cbca3997a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:30.350456 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b8c1597c-b9d4-4859-a847-240cbca3997a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1689 microversion: 2.1 time: 0.182771 Jul 26 15:25:30.351419 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3449/7012] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:30 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:30.374376 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bde7257a-b3dd-4cfd-bfa6-17dc308c9838 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:25:30.374967 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bde7257a-b3dd-4cfd-bfa6-17dc308c9838 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:30.385988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bde7257a-b3dd-4cfd-bfa6-17dc308c9838 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:30.385988 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bde7257a-b3dd-4cfd-bfa6-17dc308c9838 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:30.386503 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bde7257a-b3dd-4cfd-bfa6-17dc308c9838 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:30.386682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bde7257a-b3dd-4cfd-bfa6-17dc308c9838 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:30.454452 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bde7257a-b3dd-4cfd-bfa6-17dc308c9838 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf/action" status: 204 len: 0 microversion: 2.1 time: 0.084182 Jul 26 15:25:30.455031 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3564/7013] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:25:30 2022] POST /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:25:30.467155 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b5b687e4-10c4-4b2e-855c-0cc5cbd3eace tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:30.467764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b5b687e4-10c4-4b2e-855c-0cc5cbd3eace tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:30.474802 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5b687e4-10c4-4b2e-855c-0cc5cbd3eace tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:30.476475 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5b687e4-10c4-4b2e-855c-0cc5cbd3eace tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:30.477200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5b687e4-10c4-4b2e-855c-0cc5cbd3eace tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:30.478630 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5b687e4-10c4-4b2e-855c-0cc5cbd3eace tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:31.045999 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b5b687e4-10c4-4b2e-855c-0cc5cbd3eace tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:31.059316 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b5b687e4-10c4-4b2e-855c-0cc5cbd3eace tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1689 microversion: 2.1 time: 0.598072 Jul 26 15:25:31.060007 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3450/7014] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:30 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1689 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:31.091511 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-605358cd-5321-4a6c-a198-719f0b057402 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:31.092338 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-605358cd-5321-4a6c-a198-719f0b057402 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:31.099417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-605358cd-5321-4a6c-a198-719f0b057402 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:31.100207 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-605358cd-5321-4a6c-a198-719f0b057402 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:31.101223 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-605358cd-5321-4a6c-a198-719f0b057402 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:31.101915 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-605358cd-5321-4a6c-a198-719f0b057402 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:31.330344 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-605358cd-5321-4a6c-a198-719f0b057402 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:31.340308 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-605358cd-5321-4a6c-a198-719f0b057402 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1689 microversion: 2.1 time: 0.254297 Jul 26 15:25:31.340910 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3565/7015] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:31 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1689 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:32.249105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c5aa263f-27a0-4a3e-a6a5-bc0d2d1f6c48 req-54a0ceaa-7b64-48dd-858d-ac44720a0abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc0db99-cb9f-4d99-b95c-6c416135afbf", "name": "network-vif-plugged", "status": "completed", "tag": "c6e2bc9f-4f79-488e-b643-c718476df0dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:25:32.262053 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c5aa263f-27a0-4a3e-a6a5-bc0d2d1f6c48 req-54a0ceaa-7b64-48dd-858d-ac44720a0abd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:32.262790 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c5aa263f-27a0-4a3e-a6a5-bc0d2d1f6c48 req-54a0ceaa-7b64-48dd-858d-ac44720a0abd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:32.279172 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c5aa263f-27a0-4a3e-a6a5-bc0d2d1f6c48 req-54a0ceaa-7b64-48dd-858d-ac44720a0abd service nova] Creating event network-vif-plugged:c6e2bc9f-4f79-488e-b643-c718476df0dd for instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf on n-h2-833090-9 Jul 26 15:25:32.284736 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c5aa263f-27a0-4a3e-a6a5-bc0d2d1f6c48 req-54a0ceaa-7b64-48dd-858d-ac44720a0abd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039251 Jul 26 15:25:32.285343 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3451/7016] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:25:32.362711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dffdf489-b460-41e2-8732-de44987681cf tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:25:32.363343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dffdf489-b460-41e2-8732-de44987681cf tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:32.371049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dffdf489-b460-41e2-8732-de44987681cf tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:32.371519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dffdf489-b460-41e2-8732-de44987681cf tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:32.372466 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dffdf489-b460-41e2-8732-de44987681cf tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:32.372923 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dffdf489-b460-41e2-8732-de44987681cf tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:32.521763 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dffdf489-b460-41e2-8732-de44987681cf tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:25:32.530427 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dffdf489-b460-41e2-8732-de44987681cf tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1681 microversion: 2.1 time: 0.171621 Jul 26 15:25:32.531031 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3566/7017] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:25:32 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:25:54.720283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=26 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:54.720954 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=70 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:25:54.725161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6dcfbe68-c8e9-4642-865b-7dbbe675a9ad tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:25:54.727718 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6dcfbe68-c8e9-4642-865b-7dbbe675a9ad tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:25:54.735247 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dcfbe68-c8e9-4642-865b-7dbbe675a9ad tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:54.735716 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dcfbe68-c8e9-4642-865b-7dbbe675a9ad tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:54.736533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dcfbe68-c8e9-4642-865b-7dbbe675a9ad tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:25:54.736983 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6dcfbe68-c8e9-4642-865b-7dbbe675a9ad tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:25:54.794225 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6dcfbe68-c8e9-4642-865b-7dbbe675a9ad tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf/action" status: 200 len: 24579 microversion: 2.1 time: 0.075541 Jul 26 15:25:54.795155 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3452/7018] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:25:54 2022] POST /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf/action => generated 24579 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:26:01.914213 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-e6a1ac78-3d5f-4a49-954f-597642c3bbf5 req-0341973b-2896-4c7c-b4e0-4446cfd61ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc0db99-cb9f-4d99-b95c-6c416135afbf", "tag": "c6e2bc9f-4f79-488e-b643-c718476df0dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:26:01.919680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5911e22b-8fd5-4b35-9eaa-b7354cb92496 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:01.920306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5911e22b-8fd5-4b35-9eaa-b7354cb92496 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:01.924261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=28 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:01.925116 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:01.931439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5911e22b-8fd5-4b35-9eaa-b7354cb92496 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:01.931937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e6a1ac78-3d5f-4a49-954f-597642c3bbf5 req-0341973b-2896-4c7c-b4e0-4446cfd61ef2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:01.932103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5911e22b-8fd5-4b35-9eaa-b7354cb92496 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:01.932421 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-e6a1ac78-3d5f-4a49-954f-597642c3bbf5 req-0341973b-2896-4c7c-b4e0-4446cfd61ef2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:01.933000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5911e22b-8fd5-4b35-9eaa-b7354cb92496 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:01.933651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5911e22b-8fd5-4b35-9eaa-b7354cb92496 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:01.944557 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-e6a1ac78-3d5f-4a49-954f-597642c3bbf5 req-0341973b-2896-4c7c-b4e0-4446cfd61ef2 service nova] Creating event network-changed:c6e2bc9f-4f79-488e-b643-c718476df0dd for instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf on n-h2-833090-9 Jul 26 15:26:01.951340 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-e6a1ac78-3d5f-4a49-954f-597642c3bbf5 req-0341973b-2896-4c7c-b4e0-4446cfd61ef2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040299 Jul 26 15:26:01.953147 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3453/7019] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:26:01.964159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5911e22b-8fd5-4b35-9eaa-b7354cb92496 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:26:02.072277 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5911e22b-8fd5-4b35-9eaa-b7354cb92496 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 204 len: 0 microversion: 2.1 time: 0.162579 Jul 26 15:26:02.073577 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3567/7020] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:26:01 2022] DELETE /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:26:02.083076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-97704cee-6e25-4fe6-b3a3-6094544bab53 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:02.083780 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-97704cee-6e25-4fe6-b3a3-6094544bab53 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:02.092117 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97704cee-6e25-4fe6-b3a3-6094544bab53 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:02.092523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97704cee-6e25-4fe6-b3a3-6094544bab53 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:02.093623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97704cee-6e25-4fe6-b3a3-6094544bab53 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:02.094231 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-97704cee-6e25-4fe6-b3a3-6094544bab53 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:02.269683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-97704cee-6e25-4fe6-b3a3-6094544bab53 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:02.279497 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-97704cee-6e25-4fe6-b3a3-6094544bab53 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1687 microversion: 2.1 time: 0.201050 Jul 26 15:26:02.280058 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3454/7021] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:02 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1687 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:03.304151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fb804c8e-1f54-4af9-a2b7-9a470c012eac tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:03.306361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fb804c8e-1f54-4af9-a2b7-9a470c012eac tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:03.316547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb804c8e-1f54-4af9-a2b7-9a470c012eac tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:03.317541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb804c8e-1f54-4af9-a2b7-9a470c012eac tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:03.318989 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb804c8e-1f54-4af9-a2b7-9a470c012eac tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:03.319448 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fb804c8e-1f54-4af9-a2b7-9a470c012eac tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:03.521290 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fb804c8e-1f54-4af9-a2b7-9a470c012eac tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:03.530581 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fb804c8e-1f54-4af9-a2b7-9a470c012eac tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 200 len: 1687 microversion: 2.1 time: 0.230776 Jul 26 15:26:03.531179 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3568/7022] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:03 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 1687 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:04.177064 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-26ed3a69-9ccc-46ff-9ad7-49103e83a0ab req-6dc96c2a-309d-4f55-83bf-f2f33d8d73cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc0db99-cb9f-4d99-b95c-6c416135afbf", "name": "network-vif-deleted", "tag": "c6e2bc9f-4f79-488e-b643-c718476df0dd"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:26:04.191729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-26ed3a69-9ccc-46ff-9ad7-49103e83a0ab req-6dc96c2a-309d-4f55-83bf-f2f33d8d73cf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:04.192216 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-26ed3a69-9ccc-46ff-9ad7-49103e83a0ab req-6dc96c2a-309d-4f55-83bf-f2f33d8d73cf service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:04.206063 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-26ed3a69-9ccc-46ff-9ad7-49103e83a0ab req-6dc96c2a-309d-4f55-83bf-f2f33d8d73cf service nova] Creating event network-vif-deleted:c6e2bc9f-4f79-488e-b643-c718476df0dd for instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf on n-h2-833090-9 Jul 26 15:26:04.212121 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-26ed3a69-9ccc-46ff-9ad7-49103e83a0ab req-6dc96c2a-309d-4f55-83bf-f2f33d8d73cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037904 Jul 26 15:26:04.213198 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3455/7023] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:26:04.552703 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca943445-7c7a-4993-8be9-63b19f7d1042 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:04.553570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ca943445-7c7a-4993-8be9-63b19f7d1042 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 8dc0db99-cb9f-4d99-b95c-6c416135afbf] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:04.561727 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca943445-7c7a-4993-8be9-63b19f7d1042 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:04.562329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca943445-7c7a-4993-8be9-63b19f7d1042 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:04.563252 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca943445-7c7a-4993-8be9-63b19f7d1042 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:04.563882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ca943445-7c7a-4993-8be9-63b19f7d1042 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:04.580259 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-ca943445-7c7a-4993-8be9-63b19f7d1042 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] HTTP exception thrown: Instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf could not be found. Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca943445-7c7a-4993-8be9-63b19f7d1042 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Request method failure captured: Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf HTTP/1.1 Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AZwWobvxI63mdOVS-oWvEqLyF8cT1eZMQKX5cQkkeaNcCru1ZM9pI6ztC8RXCAaiaIbH4ay2LSrHA40XxMXDFrluWb5iJMSBnoxzurC2hSsA4Lunw2O7_LR-GTzEM4dBacf2I7X2XB3X16LazlGxUWMWZHGjqsLgePN7fPx0QydZEw Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: e055abfc258c4b2f9dec5a105fa0ec41 Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e055abfc258c4b2f9dec5a105fa0ec41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e055abfc258c4b2f9dec5a105fa0ec41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e055abfc258c4b2f9dec5a105fa0ec41", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e055abfc258c4b2f9dec5a105fa0ec41"}]}] Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: e055abfc258c4b2f9dec5a105fa0ec41 Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestNetworkAdvancedServerOps-765091019-project Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: a87ec95562914f5bbe90e0d65873143e Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestNetworkAdvancedServerOps-765091019-project Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf could not be found. Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '8dc0db99-cb9f-4d99-b95c-6c416135afbf'} Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf could not be found. Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf could not be found. Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:26:04.581791 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:26:04.589357 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:26:04.589357 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:26:04.589357 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:26:04.589357 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:26:04.589357 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:26:04.589357 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf could not be found. Jul 26 15:26:04.589357 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:26:04.589357 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ca943445-7c7a-4993-8be9-63b19f7d1042 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Returning 404 to user: Instance 8dc0db99-cb9f-4d99-b95c-6c416135afbf could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:26:04.589357 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ca943445-7c7a-4993-8be9-63b19f7d1042 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf" status: 404 len: 111 microversion: 2.1 time: 0.034874 Jul 26 15:26:04.589357 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3569/7024] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:04 2022] GET /compute/v2.1/servers/8dc0db99-cb9f-4d99-b95c-6c416135afbf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:26:08.076357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-790317ca-8e26-4288-a73f-bc480fa05c1c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '.version_select at 0x7f879936fc10>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:08.100007 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-790317ca-8e26-4288-a73f-bc480fa05c1c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-874229381" status: 202 len: 0 microversion: 2.1 time: 0.027683 Jul 26 15:26:08.100622 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3456/7025] 10.222.0.70 () {58 vars in 1281 bytes} [Tue Jul 26 15:26:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-874229381 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:26:08.126936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-429af2e5-43fb-4a52-89ee-532def867937 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'create', calling method: .version_select at 0x7f8799278550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1766014837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZhwx4hVFSF5JfARtTphuYOCsWIzGmwh7HJsgKARpKRiNXkDeu3t2MwgCyNjUlO9Cg32gB88D0cvDC104qahfc7i69R+2wMuuhrxEF5BDzV/vqoo/prKhjBfupuiNMHCw=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:26:08.143814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-429af2e5-43fb-4a52-89ee-532def867937 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:26:08.150910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-429af2e5-43fb-4a52-89ee-532def867937 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for user a87ec95562914f5bbe90e0d65873143e and project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:26:08.175333 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-429af2e5-43fb-4a52-89ee-532def867937 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052433 Jul 26 15:26:08.175941 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3570/7026] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:26:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:26:14.264589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=14 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:14.269519 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-930908415", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "3e859a80-c8f4-4f14-b8cd-9e86674fbc6e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1766014837", "security_groups": [{"name": "tempest-secgroup-smoke-1735845710"}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:26:14.404499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] validate_networks() for [('3e859a80-c8f4-4f14-b8cd-9e86674fbc6e', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:26:14.855353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:26:14.855784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:26:14.857795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:26:14.860274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:26:14.860274 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:26:14.873946 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:14.874950 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:14.876406 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:14.878853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:14.903500 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:26:14.910019 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for user a87ec95562914f5bbe90e0d65873143e and project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:26:14.933893 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:26:14.936502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:26:14.999546 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8c095ef1-98df-4562-b911-7b03b409304a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.736656 Jul 26 15:26:15.000261 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3457/7027] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:26:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:26:15.011408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:15.016286 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-298fa713-18a4-47e1-bc68-64250e7bcf98 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:15.017217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-298fa713-18a4-47e1-bc68-64250e7bcf98 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:15.103103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-298fa713-18a4-47e1-bc68-64250e7bcf98 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:15.110942 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-298fa713-18a4-47e1-bc68-64250e7bcf98 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1266 microversion: 2.1 time: 0.101416 Jul 26 15:26:15.112763 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3571/7028] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:15 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:16.136000 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d41888f8-b644-4e1f-b4c6-33bff110cd85 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:16.137376 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d41888f8-b644-4e1f-b4c6-33bff110cd85 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:16.155534 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d41888f8-b644-4e1f-b4c6-33bff110cd85 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:16.156604 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d41888f8-b644-4e1f-b4c6-33bff110cd85 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:16.157649 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d41888f8-b644-4e1f-b4c6-33bff110cd85 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:16.158166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d41888f8-b644-4e1f-b4c6-33bff110cd85 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:16.249610 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d41888f8-b644-4e1f-b4c6-33bff110cd85 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:16.261767 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d41888f8-b644-4e1f-b4c6-33bff110cd85 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1326 microversion: 2.1 time: 0.132282 Jul 26 15:26:16.264034 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3458/7029] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:16 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1326 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:17.285854 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-92112105-2682-485b-ba02-7283bbea8ab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:17.286672 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-92112105-2682-485b-ba02-7283bbea8ab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:17.302405 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92112105-2682-485b-ba02-7283bbea8ab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:17.303183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92112105-2682-485b-ba02-7283bbea8ab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:17.304429 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92112105-2682-485b-ba02-7283bbea8ab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:17.305966 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-92112105-2682-485b-ba02-7283bbea8ab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:17.863698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-92112105-2682-485b-ba02-7283bbea8ab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:17.872173 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-92112105-2682-485b-ba02-7283bbea8ab4 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1392 microversion: 2.1 time: 0.590265 Jul 26 15:26:17.872982 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3572/7030] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:17 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1392 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:18.160682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-86416e35-ba5c-4aa0-b1d3-5e58bb06c78b req-b5b2e65b-1db3-497f-95df-25c5042a6a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab7f201-19d7-4fba-84d6-f7661e3896eb", "tag": "623cde8d-6635-4d4c-ad4b-917b081f0612"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:26:18.175373 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-86416e35-ba5c-4aa0-b1d3-5e58bb06c78b req-b5b2e65b-1db3-497f-95df-25c5042a6a44 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:18.176179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-86416e35-ba5c-4aa0-b1d3-5e58bb06c78b req-b5b2e65b-1db3-497f-95df-25c5042a6a44 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:18.204850 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-86416e35-ba5c-4aa0-b1d3-5e58bb06c78b req-b5b2e65b-1db3-497f-95df-25c5042a6a44 service nova] Creating event network-changed:623cde8d-6635-4d4c-ad4b-917b081f0612 for instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb on n-h1-833090-9 Jul 26 15:26:18.211467 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-86416e35-ba5c-4aa0-b1d3-5e58bb06c78b req-b5b2e65b-1db3-497f-95df-25c5042a6a44 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054251 Jul 26 15:26:18.212764 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3459/7031] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:26:18.894454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d773c7f8-b406-49aa-847a-1ae7e842586f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:18.895117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d773c7f8-b406-49aa-847a-1ae7e842586f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:18.902410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d773c7f8-b406-49aa-847a-1ae7e842586f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:18.902884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d773c7f8-b406-49aa-847a-1ae7e842586f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:18.903679 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d773c7f8-b406-49aa-847a-1ae7e842586f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:18.904172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d773c7f8-b406-49aa-847a-1ae7e842586f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:19.042884 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d773c7f8-b406-49aa-847a-1ae7e842586f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:19.051504 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d773c7f8-b406-49aa-847a-1ae7e842586f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1392 microversion: 2.1 time: 0.161108 Jul 26 15:26:19.052110 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3573/7032] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:18 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:20.076507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d82e0d91-54ab-49f3-b946-95d5a3d6d270 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:20.077227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d82e0d91-54ab-49f3-b946-95d5a3d6d270 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:20.083579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d82e0d91-54ab-49f3-b946-95d5a3d6d270 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:20.084073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d82e0d91-54ab-49f3-b946-95d5a3d6d270 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:20.084858 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d82e0d91-54ab-49f3-b946-95d5a3d6d270 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:20.085305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-d82e0d91-54ab-49f3-b946-95d5a3d6d270 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:20.228521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d82e0d91-54ab-49f3-b946-95d5a3d6d270 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:20.236259 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d82e0d91-54ab-49f3-b946-95d5a3d6d270 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1392 microversion: 2.1 time: 0.166487 Jul 26 15:26:20.236858 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3460/7033] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:20 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:21.306036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-dd1900d2-ee48-43cd-9ab1-5cc3a11eb3ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:21.306837 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-dd1900d2-ee48-43cd-9ab1-5cc3a11eb3ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:21.313192 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd1900d2-ee48-43cd-9ab1-5cc3a11eb3ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:21.313664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd1900d2-ee48-43cd-9ab1-5cc3a11eb3ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:21.314463 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd1900d2-ee48-43cd-9ab1-5cc3a11eb3ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:21.314926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-dd1900d2-ee48-43cd-9ab1-5cc3a11eb3ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:21.459932 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-dd1900d2-ee48-43cd-9ab1-5cc3a11eb3ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:21.468456 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-dd1900d2-ee48-43cd-9ab1-5cc3a11eb3ed tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1392 microversion: 2.1 time: 0.215625 Jul 26 15:26:21.469044 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3574/7034] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:21 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1392 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:22.489671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f2c36739-86ae-44a3-aaa4-609639d8d80c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:22.490435 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f2c36739-86ae-44a3-aaa4-609639d8d80c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:22.498366 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2c36739-86ae-44a3-aaa4-609639d8d80c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:22.498842 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2c36739-86ae-44a3-aaa4-609639d8d80c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:22.499636 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2c36739-86ae-44a3-aaa4-609639d8d80c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:22.500115 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f2c36739-86ae-44a3-aaa4-609639d8d80c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:22.645125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f2c36739-86ae-44a3-aaa4-609639d8d80c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:22.653622 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f2c36739-86ae-44a3-aaa4-609639d8d80c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1392 microversion: 2.1 time: 0.167923 Jul 26 15:26:22.654206 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3461/7035] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:22 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:23.676172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b405e18d-f841-4d20-ac2f-994cb546639a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:23.676827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b405e18d-f841-4d20-ac2f-994cb546639a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:23.684073 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b405e18d-f841-4d20-ac2f-994cb546639a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:23.684548 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b405e18d-f841-4d20-ac2f-994cb546639a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:23.685333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b405e18d-f841-4d20-ac2f-994cb546639a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:23.685791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b405e18d-f841-4d20-ac2f-994cb546639a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:23.822546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b405e18d-f841-4d20-ac2f-994cb546639a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:23.830108 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b405e18d-f841-4d20-ac2f-994cb546639a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1392 microversion: 2.1 time: 0.158303 Jul 26 15:26:23.830681 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3575/7036] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:23 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:24.099646 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3aa97551-b6cb-4ad9-8282-61fe5621ab55 req-a633fdd7-f456-4153-b3a0-21a51b5338f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab7f201-19d7-4fba-84d6-f7661e3896eb", "name": "network-vif-plugged", "status": "completed", "tag": "623cde8d-6635-4d4c-ad4b-917b081f0612"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:26:24.111127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3aa97551-b6cb-4ad9-8282-61fe5621ab55 req-a633fdd7-f456-4153-b3a0-21a51b5338f0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:24.111498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3aa97551-b6cb-4ad9-8282-61fe5621ab55 req-a633fdd7-f456-4153-b3a0-21a51b5338f0 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:24.124710 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3aa97551-b6cb-4ad9-8282-61fe5621ab55 req-a633fdd7-f456-4153-b3a0-21a51b5338f0 service nova] Creating event network-vif-plugged:623cde8d-6635-4d4c-ad4b-917b081f0612 for instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb on n-h1-833090-9 Jul 26 15:26:24.131038 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3aa97551-b6cb-4ad9-8282-61fe5621ab55 req-a633fdd7-f456-4153-b3a0-21a51b5338f0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034784 Jul 26 15:26:24.131658 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3462/7037] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:26:24.851408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e1e5d939-0dc2-4f47-920d-b091505d69cb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:24.852885 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e1e5d939-0dc2-4f47-920d-b091505d69cb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:24.859935 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1e5d939-0dc2-4f47-920d-b091505d69cb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:24.860437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1e5d939-0dc2-4f47-920d-b091505d69cb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:24.861230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1e5d939-0dc2-4f47-920d-b091505d69cb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:24.861683 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e1e5d939-0dc2-4f47-920d-b091505d69cb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:25.010668 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e1e5d939-0dc2-4f47-920d-b091505d69cb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:25.018833 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e1e5d939-0dc2-4f47-920d-b091505d69cb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1392 microversion: 2.1 time: 0.171158 Jul 26 15:26:25.019128 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3576/7038] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:24 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:26.041076 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5be7f2fa-63ad-466b-b0e8-a1bad6edfdd7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:26.041694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5be7f2fa-63ad-466b-b0e8-a1bad6edfdd7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:26.043888 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:26.044532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:26.045972 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:26.052849 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5be7f2fa-63ad-466b-b0e8-a1bad6edfdd7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:26.053311 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5be7f2fa-63ad-466b-b0e8-a1bad6edfdd7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:26.054128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5be7f2fa-63ad-466b-b0e8-a1bad6edfdd7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:26.054611 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5be7f2fa-63ad-466b-b0e8-a1bad6edfdd7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:26.195113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5be7f2fa-63ad-466b-b0e8-a1bad6edfdd7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:26.203917 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5be7f2fa-63ad-466b-b0e8-a1bad6edfdd7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1565 microversion: 2.1 time: 0.167184 Jul 26 15:26:26.204777 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3463/7039] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:26 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:26.221824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:26.226586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1f08276f-9d0f-4a44-8abb-f193d558af1e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:26.227367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1f08276f-9d0f-4a44-8abb-f193d558af1e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:26.233913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f08276f-9d0f-4a44-8abb-f193d558af1e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:26.234394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f08276f-9d0f-4a44-8abb-f193d558af1e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:26.235193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f08276f-9d0f-4a44-8abb-f193d558af1e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:26.235661 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1f08276f-9d0f-4a44-8abb-f193d558af1e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:26.374726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1f08276f-9d0f-4a44-8abb-f193d558af1e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:26.384370 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1f08276f-9d0f-4a44-8abb-f193d558af1e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1565 microversion: 2.1 time: 0.163283 Jul 26 15:26:26.385018 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3577/7040] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:26 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:28.114074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ff555ceb-f1e0-455d-9264-1ea4fac0637f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:26:28.115412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ff555ceb-f1e0-455d-9264-1ea4fac0637f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:28.116393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-fd088a4c-f76b-4179-8b02-cb1127a1875a req-8ed9f6a9-e950-4799-b9f6-0b433559fedd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab7f201-19d7-4fba-84d6-f7661e3896eb", "tag": "623cde8d-6635-4d4c-ad4b-917b081f0612"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:26:28.123898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff555ceb-f1e0-455d-9264-1ea4fac0637f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:28.126041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff555ceb-f1e0-455d-9264-1ea4fac0637f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:28.126041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff555ceb-f1e0-455d-9264-1ea4fac0637f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:28.126041 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ff555ceb-f1e0-455d-9264-1ea4fac0637f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:28.129643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fd088a4c-f76b-4179-8b02-cb1127a1875a req-8ed9f6a9-e950-4799-b9f6-0b433559fedd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:28.130200 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-fd088a4c-f76b-4179-8b02-cb1127a1875a req-8ed9f6a9-e950-4799-b9f6-0b433559fedd service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:28.142496 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-fd088a4c-f76b-4179-8b02-cb1127a1875a req-8ed9f6a9-e950-4799-b9f6-0b433559fedd service nova] Creating event network-changed:623cde8d-6635-4d4c-ad4b-917b081f0612 for instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb on n-h1-833090-9 Jul 26 15:26:28.148042 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-fd088a4c-f76b-4179-8b02-cb1127a1875a req-8ed9f6a9-e950-4799-b9f6-0b433559fedd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035855 Jul 26 15:26:28.148909 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3578/7041] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:26:28.357644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ff555ceb-f1e0-455d-9264-1ea4fac0637f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:26:28.366668 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ff555ceb-f1e0-455d-9264-1ea4fac0637f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1565 microversion: 2.1 time: 0.257070 Jul 26 15:26:28.368040 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3464/7042] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:26:28 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1565 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:26:49.665224 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:49.666022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=38 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:26:49.670544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-33b5e524-7d89-47e4-91fb-340e8d01e19a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:26:49.673256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-33b5e524-7d89-47e4-91fb-340e8d01e19a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:26:49.681999 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b5e524-7d89-47e4-91fb-340e8d01e19a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:49.682395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b5e524-7d89-47e4-91fb-340e8d01e19a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:49.683204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b5e524-7d89-47e4-91fb-340e8d01e19a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:26:49.683662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-33b5e524-7d89-47e4-91fb-340e8d01e19a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:26:49.742514 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-33b5e524-7d89-47e4-91fb-340e8d01e19a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb/action" status: 200 len: 24561 microversion: 2.1 time: 0.079656 Jul 26 15:26:49.742898 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3579/7043] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:26:49 2022] POST /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb/action => generated 24561 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:27:00.745919 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-85301d18-ca38-446a-a24d-ca096c0126fc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:00.748339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:00.748994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=36 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:00.755163 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85301d18-ca38-446a-a24d-ca096c0126fc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:00.755618 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-85301d18-ca38-446a-a24d-ca096c0126fc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:00.778667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-85301d18-ca38-446a-a24d-ca096c0126fc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Going to try to stop instance {{(pid=119478) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 15:27:00.822174 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-85301d18-ca38-446a-a24d-ca096c0126fc tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb/action" status: 202 len: 0 microversion: 2.1 time: 0.079885 Jul 26 15:27:00.822785 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3465/7044] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:27:00 2022] POST /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:27:00.832411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c3c9bca6-51e4-4a2c-8906-ef119474efd3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:00.833165 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c3c9bca6-51e4-4a2c-8906-ef119474efd3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:00.836091 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:00.837537 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:00.846841 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3c9bca6-51e4-4a2c-8906-ef119474efd3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:00.847317 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3c9bca6-51e4-4a2c-8906-ef119474efd3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:00.848152 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3c9bca6-51e4-4a2c-8906-ef119474efd3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:00.848618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c3c9bca6-51e4-4a2c-8906-ef119474efd3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:01.000305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c3c9bca6-51e4-4a2c-8906-ef119474efd3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:01.009457 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c3c9bca6-51e4-4a2c-8906-ef119474efd3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.181363 Jul 26 15:27:01.010041 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3580/7045] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:00 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:02.032590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b8731484-292f-4467-9de7-985724e91066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:02.033436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b8731484-292f-4467-9de7-985724e91066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:02.041907 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8731484-292f-4467-9de7-985724e91066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:02.042364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8731484-292f-4467-9de7-985724e91066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:02.043131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8731484-292f-4467-9de7-985724e91066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:02.043570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b8731484-292f-4467-9de7-985724e91066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:02.186837 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b8731484-292f-4467-9de7-985724e91066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:02.194366 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b8731484-292f-4467-9de7-985724e91066 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.166106 Jul 26 15:27:02.194939 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3466/7046] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:02 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:03.216036 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8f4e036b-595d-4ae4-86b2-213c47827ad8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:03.216676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8f4e036b-595d-4ae4-86b2-213c47827ad8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:03.224327 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f4e036b-595d-4ae4-86b2-213c47827ad8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:03.224810 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f4e036b-595d-4ae4-86b2-213c47827ad8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:03.225613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f4e036b-595d-4ae4-86b2-213c47827ad8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:03.226067 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f4e036b-595d-4ae4-86b2-213c47827ad8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:03.367551 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8f4e036b-595d-4ae4-86b2-213c47827ad8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:03.378258 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8f4e036b-595d-4ae4-86b2-213c47827ad8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.166465 Jul 26 15:27:03.378891 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3581/7047] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:03 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:04.400585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c91e3e2f-5471-4da8-8abb-e635aeae5ab6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:04.401225 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c91e3e2f-5471-4da8-8abb-e635aeae5ab6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:04.408511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c91e3e2f-5471-4da8-8abb-e635aeae5ab6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:04.408973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c91e3e2f-5471-4da8-8abb-e635aeae5ab6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:04.409762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c91e3e2f-5471-4da8-8abb-e635aeae5ab6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:04.410211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c91e3e2f-5471-4da8-8abb-e635aeae5ab6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:04.849925 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c91e3e2f-5471-4da8-8abb-e635aeae5ab6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:04.858331 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c91e3e2f-5471-4da8-8abb-e635aeae5ab6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.462031 Jul 26 15:27:04.858904 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3467/7048] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:04 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:05.879315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c6da0cf1-222f-4511-a8d4-57e022302aa0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:05.879943 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c6da0cf1-222f-4511-a8d4-57e022302aa0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:05.888030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6da0cf1-222f-4511-a8d4-57e022302aa0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:05.888510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6da0cf1-222f-4511-a8d4-57e022302aa0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:05.889300 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6da0cf1-222f-4511-a8d4-57e022302aa0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:05.889756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c6da0cf1-222f-4511-a8d4-57e022302aa0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:06.032604 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c6da0cf1-222f-4511-a8d4-57e022302aa0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:06.040438 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c6da0cf1-222f-4511-a8d4-57e022302aa0 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.165122 Jul 26 15:27:06.041026 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3582/7049] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:05 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:07.062407 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9e9aa107-7c82-4eaa-8aae-d88d5be1cdae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:07.063028 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9e9aa107-7c82-4eaa-8aae-d88d5be1cdae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:07.070302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e9aa107-7c82-4eaa-8aae-d88d5be1cdae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:07.070760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e9aa107-7c82-4eaa-8aae-d88d5be1cdae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:07.071562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e9aa107-7c82-4eaa-8aae-d88d5be1cdae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:07.072034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e9aa107-7c82-4eaa-8aae-d88d5be1cdae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:07.213257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9e9aa107-7c82-4eaa-8aae-d88d5be1cdae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:07.221232 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9e9aa107-7c82-4eaa-8aae-d88d5be1cdae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.162895 Jul 26 15:27:07.221819 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3468/7050] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:07 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:08.243835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-369769e0-315e-4788-85a8-c3dea7225ea7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:08.244554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-369769e0-315e-4788-85a8-c3dea7225ea7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:08.251903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-369769e0-315e-4788-85a8-c3dea7225ea7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:08.252517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-369769e0-315e-4788-85a8-c3dea7225ea7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:08.253221 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-369769e0-315e-4788-85a8-c3dea7225ea7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:08.253682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-369769e0-315e-4788-85a8-c3dea7225ea7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:08.388179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-369769e0-315e-4788-85a8-c3dea7225ea7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:08.396421 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-369769e0-315e-4788-85a8-c3dea7225ea7 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.156501 Jul 26 15:27:08.397004 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3583/7051] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:08 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:09.418188 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-27ead892-9b9d-4c75-8216-ad153f0a7c7b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:09.418812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-27ead892-9b9d-4c75-8216-ad153f0a7c7b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:09.426423 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27ead892-9b9d-4c75-8216-ad153f0a7c7b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:09.426887 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27ead892-9b9d-4c75-8216-ad153f0a7c7b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:09.427676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27ead892-9b9d-4c75-8216-ad153f0a7c7b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:09.428167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27ead892-9b9d-4c75-8216-ad153f0a7c7b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:09.566973 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-27ead892-9b9d-4c75-8216-ad153f0a7c7b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:09.574523 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-27ead892-9b9d-4c75-8216-ad153f0a7c7b tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.160418 Jul 26 15:27:09.575085 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3469/7052] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:09 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:10.597008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9ce3dc9b-a9b7-41c4-a819-3de4047cb685 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:10.597565 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9ce3dc9b-a9b7-41c4-a819-3de4047cb685 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:10.604414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ce3dc9b-a9b7-41c4-a819-3de4047cb685 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:10.604892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ce3dc9b-a9b7-41c4-a819-3de4047cb685 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:10.606902 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ce3dc9b-a9b7-41c4-a819-3de4047cb685 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:10.607367 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ce3dc9b-a9b7-41c4-a819-3de4047cb685 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:10.743612 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ce3dc9b-a9b7-41c4-a819-3de4047cb685 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:10.751708 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9ce3dc9b-a9b7-41c4-a819-3de4047cb685 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.159112 Jul 26 15:27:10.752328 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3584/7053] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:10 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:11.774671 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-31c145ce-fe8a-488f-a0d4-a4199b6faa31 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:11.775217 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-31c145ce-fe8a-488f-a0d4-a4199b6faa31 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:11.782344 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31c145ce-fe8a-488f-a0d4-a4199b6faa31 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:11.782797 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31c145ce-fe8a-488f-a0d4-a4199b6faa31 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:11.783565 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31c145ce-fe8a-488f-a0d4-a4199b6faa31 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:11.784023 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-31c145ce-fe8a-488f-a0d4-a4199b6faa31 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:11.916174 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-31c145ce-fe8a-488f-a0d4-a4199b6faa31 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:11.925518 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-31c145ce-fe8a-488f-a0d4-a4199b6faa31 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.154796 Jul 26 15:27:11.926092 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3470/7054] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:11 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:12.946948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-fbc882da-4b8c-4fa5-9d76-9d8bd6331eab tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:12.947606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-fbc882da-4b8c-4fa5-9d76-9d8bd6331eab tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:12.954869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc882da-4b8c-4fa5-9d76-9d8bd6331eab tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:12.955343 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc882da-4b8c-4fa5-9d76-9d8bd6331eab tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:12.956161 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc882da-4b8c-4fa5-9d76-9d8bd6331eab tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:12.956623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-fbc882da-4b8c-4fa5-9d76-9d8bd6331eab tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:13.099816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-fbc882da-4b8c-4fa5-9d76-9d8bd6331eab tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:13.108120 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-fbc882da-4b8c-4fa5-9d76-9d8bd6331eab tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.165279 Jul 26 15:27:13.108693 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3585/7055] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:12 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:14.129603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b5c1b64b-df29-4346-a568-2ed3d8f2227d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:14.130226 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b5c1b64b-df29-4346-a568-2ed3d8f2227d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:14.137442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5c1b64b-df29-4346-a568-2ed3d8f2227d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:14.137904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5c1b64b-df29-4346-a568-2ed3d8f2227d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:14.138680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5c1b64b-df29-4346-a568-2ed3d8f2227d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:14.139124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5c1b64b-df29-4346-a568-2ed3d8f2227d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:14.272270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b5c1b64b-df29-4346-a568-2ed3d8f2227d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:14.280431 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b5c1b64b-df29-4346-a568-2ed3d8f2227d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.154712 Jul 26 15:27:14.280994 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3471/7056] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:14 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:15.302580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0ae3e7dd-4dcb-44cf-8afb-271c772c83ae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:15.303210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0ae3e7dd-4dcb-44cf-8afb-271c772c83ae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:15.310280 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae3e7dd-4dcb-44cf-8afb-271c772c83ae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:15.310748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae3e7dd-4dcb-44cf-8afb-271c772c83ae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:15.311542 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae3e7dd-4dcb-44cf-8afb-271c772c83ae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:15.312030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0ae3e7dd-4dcb-44cf-8afb-271c772c83ae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:15.452421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0ae3e7dd-4dcb-44cf-8afb-271c772c83ae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:15.460225 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0ae3e7dd-4dcb-44cf-8afb-271c772c83ae tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1693 microversion: 2.1 time: 0.161564 Jul 26 15:27:15.460804 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3586/7057] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:15 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:16.482662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a54849c7-741a-48ce-942d-999a7cfbc506 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:16.483281 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a54849c7-741a-48ce-942d-999a7cfbc506 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:16.490230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a54849c7-741a-48ce-942d-999a7cfbc506 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:16.490682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a54849c7-741a-48ce-942d-999a7cfbc506 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:16.491445 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a54849c7-741a-48ce-942d-999a7cfbc506 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:16.491882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a54849c7-741a-48ce-942d-999a7cfbc506 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:16.629070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a54849c7-741a-48ce-942d-999a7cfbc506 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:16.637146 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a54849c7-741a-48ce-942d-999a7cfbc506 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1670 microversion: 2.1 time: 0.159183 Jul 26 15:27:16.637723 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3472/7058] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:16 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:17.737371 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-39ac6fee-a6ed-44d7-865b-f3a72559950c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:17.739580 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-39ac6fee-a6ed-44d7-865b-f3a72559950c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:17.747302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39ac6fee-a6ed-44d7-865b-f3a72559950c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:17.747773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39ac6fee-a6ed-44d7-865b-f3a72559950c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:17.748670 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39ac6fee-a6ed-44d7-865b-f3a72559950c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:17.749130 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-39ac6fee-a6ed-44d7-865b-f3a72559950c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:17.804385 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-39ac6fee-a6ed-44d7-865b-f3a72559950c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb/action" status: 200 len: 38352 microversion: 2.1 time: 0.070777 Jul 26 15:27:17.805042 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3587/7059] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:27:17 2022] POST /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb/action => generated 38352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:27:17.817587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4ca2e76a-337d-4530-ac33-d239ce16a038 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:17.825280 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ca2e76a-337d-4530-ac33-d239ce16a038 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:17.825731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4ca2e76a-337d-4530-ac33-d239ce16a038 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:17.847381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4ca2e76a-337d-4530-ac33-d239ce16a038 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Going to try to start instance {{(pid=119478) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 15:27:17.891603 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4ca2e76a-337d-4530-ac33-d239ce16a038 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb/action" status: 202 len: 0 microversion: 2.1 time: 0.077826 Jul 26 15:27:17.892252 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3473/7060] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:27:17 2022] POST /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:27:17.901075 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3403262a-6089-4501-8656-eec80aec6519 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:17.902652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3403262a-6089-4501-8656-eec80aec6519 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:17.911218 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3403262a-6089-4501-8656-eec80aec6519 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:17.911736 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3403262a-6089-4501-8656-eec80aec6519 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:17.912606 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3403262a-6089-4501-8656-eec80aec6519 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:17.913087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3403262a-6089-4501-8656-eec80aec6519 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:18.150274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3403262a-6089-4501-8656-eec80aec6519 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:18.158519 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3403262a-6089-4501-8656-eec80aec6519 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1679 microversion: 2.1 time: 0.261676 Jul 26 15:27:18.159103 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3588/7061] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:17 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1679 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:19.182664 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6d5f0d81-b86f-4e64-a27a-7060b8699768 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:19.183712 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6d5f0d81-b86f-4e64-a27a-7060b8699768 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:19.190233 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d5f0d81-b86f-4e64-a27a-7060b8699768 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:19.190693 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d5f0d81-b86f-4e64-a27a-7060b8699768 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:19.191471 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d5f0d81-b86f-4e64-a27a-7060b8699768 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:19.191917 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6d5f0d81-b86f-4e64-a27a-7060b8699768 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:19.326821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6d5f0d81-b86f-4e64-a27a-7060b8699768 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:19.334769 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6d5f0d81-b86f-4e64-a27a-7060b8699768 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1683 microversion: 2.1 time: 0.157204 Jul 26 15:27:19.335542 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3474/7062] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:19 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:43.532372 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3f88803d-40cc-4949-8060-a83cc17c40f3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:43.534618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3f88803d-40cc-4949-8060-a83cc17c40f3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:43.537381 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=18 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:43.538213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=52 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:43.543880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f88803d-40cc-4949-8060-a83cc17c40f3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:43.544377 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f88803d-40cc-4949-8060-a83cc17c40f3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:43.545183 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f88803d-40cc-4949-8060-a83cc17c40f3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:43.545638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3f88803d-40cc-4949-8060-a83cc17c40f3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:43.603448 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3f88803d-40cc-4949-8060-a83cc17c40f3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb/action" status: 200 len: 62909 microversion: 2.1 time: 0.075402 Jul 26 15:27:43.604229 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3589/7063] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:27:43 2022] POST /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb/action => generated 62909 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:27:50.709679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-16f5911c-39da-48d7-b6ca-f3d7fbdd8934 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:50.710207 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-16f5911c-39da-48d7-b6ca-f3d7fbdd8934 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:50.712047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-97eb9e5a-6f99-4d0c-9e74-5283cc7d0235 req-3f0d1caa-01ed-405a-8098-0af03a725586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab7f201-19d7-4fba-84d6-f7661e3896eb", "tag": "623cde8d-6635-4d4c-ad4b-917b081f0612"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:50.712660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=20 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:50.713546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:27:50.721179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16f5911c-39da-48d7-b6ca-f3d7fbdd8934 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:50.721634 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16f5911c-39da-48d7-b6ca-f3d7fbdd8934 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:50.722462 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16f5911c-39da-48d7-b6ca-f3d7fbdd8934 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:50.722855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-16f5911c-39da-48d7-b6ca-f3d7fbdd8934 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:50.725235 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-97eb9e5a-6f99-4d0c-9e74-5283cc7d0235 req-3f0d1caa-01ed-405a-8098-0af03a725586 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:50.726102 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-97eb9e5a-6f99-4d0c-9e74-5283cc7d0235 req-3f0d1caa-01ed-405a-8098-0af03a725586 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:50.739317 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-97eb9e5a-6f99-4d0c-9e74-5283cc7d0235 req-3f0d1caa-01ed-405a-8098-0af03a725586 service nova] Creating event network-changed:623cde8d-6635-4d4c-ad4b-917b081f0612 for instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb on n-h1-833090-9 Jul 26 15:27:50.745566 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-97eb9e5a-6f99-4d0c-9e74-5283cc7d0235 req-3f0d1caa-01ed-405a-8098-0af03a725586 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037169 Jul 26 15:27:50.747009 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3590/7064] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:27:50.753913 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-16f5911c-39da-48d7-b6ca-f3d7fbdd8934 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:27:50.847851 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-16f5911c-39da-48d7-b6ca-f3d7fbdd8934 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 204 len: 0 microversion: 2.1 time: 0.142122 Jul 26 15:27:50.848780 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3475/7065] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:27:50 2022] DELETE /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:27:50.858588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a8bb8ac-d548-4628-b143-9919b3466203 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:50.859336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a8bb8ac-d548-4628-b143-9919b3466203 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:50.866651 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a8bb8ac-d548-4628-b143-9919b3466203 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:50.867123 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a8bb8ac-d548-4628-b143-9919b3466203 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:50.867917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a8bb8ac-d548-4628-b143-9919b3466203 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:50.868398 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a8bb8ac-d548-4628-b143-9919b3466203 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:51.085417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a8bb8ac-d548-4628-b143-9919b3466203 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:51.094211 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a8bb8ac-d548-4628-b143-9919b3466203 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1689 microversion: 2.1 time: 0.240652 Jul 26 15:27:51.094828 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3591/7066] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:50 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1689 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:52.117484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5c3746ba-5128-4872-aa84-d4797b1dc3f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:52.118385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5c3746ba-5128-4872-aa84-d4797b1dc3f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:52.126816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c3746ba-5128-4872-aa84-d4797b1dc3f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:52.127084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c3746ba-5128-4872-aa84-d4797b1dc3f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:52.128454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c3746ba-5128-4872-aa84-d4797b1dc3f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:52.128454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5c3746ba-5128-4872-aa84-d4797b1dc3f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:52.329666 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5c3746ba-5128-4872-aa84-d4797b1dc3f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:27:52.337415 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5c3746ba-5128-4872-aa84-d4797b1dc3f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 200 len: 1689 microversion: 2.1 time: 0.224177 Jul 26 15:27:52.338003 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3476/7067] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:52 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 1689 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:27:52.953002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-ad1e7961-ff37-4a42-a297-975ba511fbf8 req-6a8fa96f-e56b-4a76-b3e4-cfb6f9a4b332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab7f201-19d7-4fba-84d6-f7661e3896eb", "name": "network-vif-deleted", "tag": "623cde8d-6635-4d4c-ad4b-917b081f0612"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:52.963795 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ad1e7961-ff37-4a42-a297-975ba511fbf8 req-6a8fa96f-e56b-4a76-b3e4-cfb6f9a4b332 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:52.965104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-ad1e7961-ff37-4a42-a297-975ba511fbf8 req-6a8fa96f-e56b-4a76-b3e4-cfb6f9a4b332 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:52.975851 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-ad1e7961-ff37-4a42-a297-975ba511fbf8 req-6a8fa96f-e56b-4a76-b3e4-cfb6f9a4b332 service nova] Creating event network-vif-deleted:623cde8d-6635-4d4c-ad4b-917b081f0612 for instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb on n-h1-833090-9 Jul 26 15:27:52.981685 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-ad1e7961-ff37-4a42-a297-975ba511fbf8 req-6a8fa96f-e56b-4a76-b3e4-cfb6f9a4b332 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090391 Jul 26 15:27:52.982293 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3592/7068] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:53.360271 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da89d988-795e-4131-a52b-86557c57141f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:53.360867 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-da89d988-795e-4131-a52b-86557c57141f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 9ab7f201-19d7-4fba-84d6-f7661e3896eb] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:27:53.368368 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da89d988-795e-4131-a52b-86557c57141f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:53.368824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da89d988-795e-4131-a52b-86557c57141f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:53.369603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da89d988-795e-4131-a52b-86557c57141f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:27:53.370046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da89d988-795e-4131-a52b-86557c57141f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:27:53.384435 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-da89d988-795e-4131-a52b-86557c57141f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] HTTP exception thrown: Instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb could not be found. Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da89d988-795e-4131-a52b-86557c57141f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Request method failure captured: Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb HTTP/1.1 Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AZwWobvxI63mdOVS-oWvEqLyF8cT1eZMQKX5cQkkeaNcCru1ZM9pI6ztC8RXCAaiaIbH4ay2LSrHA40XxMXDFrluWb5iJMSBnoxzurC2hSsA4Lunw2O7_LR-GTzEM4dBacf2I7X2XB3X16LazlGxUWMWZHGjqsLgePN7fPx0QydZEw Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: e055abfc258c4b2f9dec5a105fa0ec41 Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e055abfc258c4b2f9dec5a105fa0ec41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e055abfc258c4b2f9dec5a105fa0ec41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e055abfc258c4b2f9dec5a105fa0ec41", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e055abfc258c4b2f9dec5a105fa0ec41"}]}] Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: e055abfc258c4b2f9dec5a105fa0ec41 Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestNetworkAdvancedServerOps-765091019-project Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: a87ec95562914f5bbe90e0d65873143e Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestNetworkAdvancedServerOps-765091019-project Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb could not be found. Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '9ab7f201-19d7-4fba-84d6-f7661e3896eb'} Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb could not be found. Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb could not be found. Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:27:53.386101 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:27:53.391890 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:27:53.391890 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:27:53.391890 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:27:53.391890 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:27:53.391890 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:27:53.391890 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb could not be found. Jul 26 15:27:53.391890 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:27:53.391890 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da89d988-795e-4131-a52b-86557c57141f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Returning 404 to user: Instance 9ab7f201-19d7-4fba-84d6-f7661e3896eb could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:27:53.391890 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-da89d988-795e-4131-a52b-86557c57141f tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb" status: 404 len: 111 microversion: 2.1 time: 0.032572 Jul 26 15:27:53.391890 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3477/7069] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:27:53 2022] GET /compute/v2.1/servers/9ab7f201-19d7-4fba-84d6-f7661e3896eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:27:56.748738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-4504ea45-f688-4532-af75-65fa486fe7ef tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '.version_select at 0x7f87992bf1f0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:27:56.772078 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-4504ea45-f688-4532-af75-65fa486fe7ef tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1766014837" status: 202 len: 0 microversion: 2.1 time: 0.030384 Jul 26 15:27:56.772606 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3593/7070] 10.222.0.70 () {58 vars in 1284 bytes} [Tue Jul 26 15:27:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1766014837 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:27:56.804487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-86a89395-4e72-49f8-b1d1-9aa46f951408 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'create', calling method: .version_select at 0x7f879936a0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1630109707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGE/wyoWZ3Z2Pl/5SimlPfmI+6e4xC0NF7efbLuNyyK5LuGuL8CzcVA7VvbzgVD5wF6TuHsLiFRK2SORp8rpkEkoia4U9gZczJ68sfrfrRSsc7XG2/xsbkBc28aRne9vLA=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:27:56.824024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-86a89395-4e72-49f8-b1d1-9aa46f951408 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:27:56.830465 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-86a89395-4e72-49f8-b1d1-9aa46f951408 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for user a87ec95562914f5bbe90e0d65873143e and project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:27:56.859605 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-86a89395-4e72-49f8-b1d1-9aa46f951408 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058969 Jul 26 15:27:56.860253 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3478/7071] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:27:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:27:58.363899 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:27:58.364512 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:27:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:28:02.214797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1579087664", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "networks": [{"uuid": "b7d9bb4a-d9f1-4acc-9438-2426a480b983"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1630109707", "security_groups": [{"name": "tempest-secgroup-smoke-1653426126"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:02.669363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] validate_networks() for [('b7d9bb4a-d9f1-4acc-9438-2426a480b983', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:28:02.970556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=14 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:03.108293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:28:03.108734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:28:03.109226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:28:03.109653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:28:03.110086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:28:03.119144 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:03.119613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:03.120469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:03.120927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:03.139874 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:28:03.145634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Getting quotas for user a87ec95562914f5bbe90e0d65873143e and project e055abfc258c4b2f9dec5a105fa0ec41. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:28:03.158755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:28:03.161184 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:28:03.212002 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-12cf8ae4-7dbe-42ba-b54e-7dd636a666ee tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.002949 Jul 26 15:28:03.213178 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3594/7072] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:28:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:28:03.225477 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aef5f0dc-7baf-4ddc-ae0c-23cb8ad243a2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:03.226319 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aef5f0dc-7baf-4ddc-ae0c-23cb8ad243a2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:03.286412 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aef5f0dc-7baf-4ddc-ae0c-23cb8ad243a2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:03.296261 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aef5f0dc-7baf-4ddc-ae0c-23cb8ad243a2 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1267 microversion: 2.1 time: 0.075574 Jul 26 15:28:03.297485 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3479/7073] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:03 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:04.321926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-067e1d35-e517-4233-9315-f11f5db4f1a5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:04.322480 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-067e1d35-e517-4233-9315-f11f5db4f1a5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:04.332386 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-067e1d35-e517-4233-9315-f11f5db4f1a5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:04.332882 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-067e1d35-e517-4233-9315-f11f5db4f1a5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:04.333755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-067e1d35-e517-4233-9315-f11f5db4f1a5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:04.335118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-067e1d35-e517-4233-9315-f11f5db4f1a5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:04.464942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-067e1d35-e517-4233-9315-f11f5db4f1a5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:04.474303 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-067e1d35-e517-4233-9315-f11f5db4f1a5 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1327 microversion: 2.1 time: 0.158053 Jul 26 15:28:04.479615 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3595/7074] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:04 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:05.501405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-47f61496-e8d8-4fdf-8405-2b6e80cc9f1a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:05.501939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-47f61496-e8d8-4fdf-8405-2b6e80cc9f1a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:05.504089 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:05.513409 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47f61496-e8d8-4fdf-8405-2b6e80cc9f1a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:05.513914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47f61496-e8d8-4fdf-8405-2b6e80cc9f1a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:05.514726 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47f61496-e8d8-4fdf-8405-2b6e80cc9f1a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:05.521121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-47f61496-e8d8-4fdf-8405-2b6e80cc9f1a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:05.759514 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-47f61496-e8d8-4fdf-8405-2b6e80cc9f1a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:05.770219 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-47f61496-e8d8-4fdf-8405-2b6e80cc9f1a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1393 microversion: 2.1 time: 0.277001 Jul 26 15:28:05.785831 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3480/7075] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:05 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1393 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:06.296598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9690a695-da38-4470-8b9c-cb30119d68dc req-a0b56678-44f4-4050-a645-707e19ac48b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d68154-4590-45d5-a368-caceb8ff6701", "tag": "0468df89-afa2-4772-8bc8-05dea222c0da"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:06.314711 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9690a695-da38-4470-8b9c-cb30119d68dc req-a0b56678-44f4-4050-a645-707e19ac48b2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:06.315313 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9690a695-da38-4470-8b9c-cb30119d68dc req-a0b56678-44f4-4050-a645-707e19ac48b2 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:06.332719 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9690a695-da38-4470-8b9c-cb30119d68dc req-a0b56678-44f4-4050-a645-707e19ac48b2 service nova] Creating event network-changed:0468df89-afa2-4772-8bc8-05dea222c0da for instance 06d68154-4590-45d5-a368-caceb8ff6701 on n-h2-833090-9 Jul 26 15:28:06.338399 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9690a695-da38-4470-8b9c-cb30119d68dc req-a0b56678-44f4-4050-a645-707e19ac48b2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047340 Jul 26 15:28:06.339190 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3596/7076] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:06.793128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9925fe86-7b1c-4b3e-be47-02042cc21fd1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:06.794433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9925fe86-7b1c-4b3e-be47-02042cc21fd1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:06.801479 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9925fe86-7b1c-4b3e-be47-02042cc21fd1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:06.801938 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9925fe86-7b1c-4b3e-be47-02042cc21fd1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:06.802715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9925fe86-7b1c-4b3e-be47-02042cc21fd1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:06.803159 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9925fe86-7b1c-4b3e-be47-02042cc21fd1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:06.939457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9925fe86-7b1c-4b3e-be47-02042cc21fd1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:06.947375 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9925fe86-7b1c-4b3e-be47-02042cc21fd1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1393 microversion: 2.1 time: 0.158273 Jul 26 15:28:06.948059 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3481/7077] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:06 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:07.976735 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d7a923a1-0454-48be-a3f8-53dd0f8a796e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:07.977457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d7a923a1-0454-48be-a3f8-53dd0f8a796e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:07.984609 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7a923a1-0454-48be-a3f8-53dd0f8a796e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:07.985253 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7a923a1-0454-48be-a3f8-53dd0f8a796e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:07.986045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7a923a1-0454-48be-a3f8-53dd0f8a796e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:07.986506 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7a923a1-0454-48be-a3f8-53dd0f8a796e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:08.142936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d7a923a1-0454-48be-a3f8-53dd0f8a796e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:08.151190 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d7a923a1-0454-48be-a3f8-53dd0f8a796e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1393 microversion: 2.1 time: 0.179696 Jul 26 15:28:08.151842 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3597/7078] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:07 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:09.178022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c14adc0f-9f9d-45cb-ad9a-2afc9cb98025 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:09.178629 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c14adc0f-9f9d-45cb-ad9a-2afc9cb98025 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:09.187343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c14adc0f-9f9d-45cb-ad9a-2afc9cb98025 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:09.187816 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c14adc0f-9f9d-45cb-ad9a-2afc9cb98025 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:09.189312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c14adc0f-9f9d-45cb-ad9a-2afc9cb98025 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:09.189767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c14adc0f-9f9d-45cb-ad9a-2afc9cb98025 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:09.336812 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c14adc0f-9f9d-45cb-ad9a-2afc9cb98025 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:09.345029 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c14adc0f-9f9d-45cb-ad9a-2afc9cb98025 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1393 microversion: 2.1 time: 0.170966 Jul 26 15:28:09.345621 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3482/7079] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:09 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:10.367699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-781313ed-2c32-4c30-aa62-d862a67d2aeb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:10.368361 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-781313ed-2c32-4c30-aa62-d862a67d2aeb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:10.375934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-781313ed-2c32-4c30-aa62-d862a67d2aeb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:10.376445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-781313ed-2c32-4c30-aa62-d862a67d2aeb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:10.377247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-781313ed-2c32-4c30-aa62-d862a67d2aeb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:10.377714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-781313ed-2c32-4c30-aa62-d862a67d2aeb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:10.512457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-781313ed-2c32-4c30-aa62-d862a67d2aeb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:10.520982 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-781313ed-2c32-4c30-aa62-d862a67d2aeb tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1393 microversion: 2.1 time: 0.157284 Jul 26 15:28:10.521556 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3598/7080] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:10 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:11.040004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-fa1fc333-f4cb-42c2-86b2-e07e8a1377dc req-9cc188e8-0be1-413d-a139-a079e1842e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d68154-4590-45d5-a368-caceb8ff6701", "name": "network-vif-plugged", "status": "completed", "tag": "0468df89-afa2-4772-8bc8-05dea222c0da"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:11.052502 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fa1fc333-f4cb-42c2-86b2-e07e8a1377dc req-9cc188e8-0be1-413d-a139-a079e1842e0a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:11.052958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fa1fc333-f4cb-42c2-86b2-e07e8a1377dc req-9cc188e8-0be1-413d-a139-a079e1842e0a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:11.067150 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-fa1fc333-f4cb-42c2-86b2-e07e8a1377dc req-9cc188e8-0be1-413d-a139-a079e1842e0a service nova] Creating event network-vif-plugged:0468df89-afa2-4772-8bc8-05dea222c0da for instance 06d68154-4590-45d5-a368-caceb8ff6701 on n-h2-833090-9 Jul 26 15:28:11.072722 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-fa1fc333-f4cb-42c2-86b2-e07e8a1377dc req-9cc188e8-0be1-413d-a139-a079e1842e0a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036766 Jul 26 15:28:11.073335 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3483/7081] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:11.542028 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c001ea16-a522-4410-bd34-b8302e5f630e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:11.542696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c001ea16-a522-4410-bd34-b8302e5f630e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:11.550714 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c001ea16-a522-4410-bd34-b8302e5f630e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:11.551179 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c001ea16-a522-4410-bd34-b8302e5f630e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:11.551997 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c001ea16-a522-4410-bd34-b8302e5f630e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:11.552459 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c001ea16-a522-4410-bd34-b8302e5f630e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:11.697305 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c001ea16-a522-4410-bd34-b8302e5f630e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:11.706555 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c001ea16-a522-4410-bd34-b8302e5f630e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1393 microversion: 2.1 time: 0.168421 Jul 26 15:28:11.707153 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3599/7082] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:11 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:12.728704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ebcdfb55-ce4a-4a81-bd7d-0e1eee84d04d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:12.729326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ebcdfb55-ce4a-4a81-bd7d-0e1eee84d04d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:12.737134 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebcdfb55-ce4a-4a81-bd7d-0e1eee84d04d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:12.737583 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebcdfb55-ce4a-4a81-bd7d-0e1eee84d04d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:12.738345 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebcdfb55-ce4a-4a81-bd7d-0e1eee84d04d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:12.738784 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ebcdfb55-ce4a-4a81-bd7d-0e1eee84d04d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:12.875227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ebcdfb55-ce4a-4a81-bd7d-0e1eee84d04d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:12.882896 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ebcdfb55-ce4a-4a81-bd7d-0e1eee84d04d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1566 microversion: 2.1 time: 0.158624 Jul 26 15:28:12.883467 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3484/7083] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:12 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:12.904958 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-111a03a0-6110-4d9d-9d10-f6a078c407f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:12.905597 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-111a03a0-6110-4d9d-9d10-f6a078c407f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:12.913603 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-111a03a0-6110-4d9d-9d10-f6a078c407f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:12.914077 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-111a03a0-6110-4d9d-9d10-f6a078c407f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:12.914876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-111a03a0-6110-4d9d-9d10-f6a078c407f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:12.915339 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-111a03a0-6110-4d9d-9d10-f6a078c407f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:13.050106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-111a03a0-6110-4d9d-9d10-f6a078c407f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:13.057745 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-111a03a0-6110-4d9d-9d10-f6a078c407f6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1566 microversion: 2.1 time: 0.156705 Jul 26 15:28:13.058315 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3600/7084] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:12 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:14.677740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ea453b79-ef5b-4616-b90c-353d87e31a38 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:14.678399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ea453b79-ef5b-4616-b90c-353d87e31a38 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:14.679844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-9f442a02-308a-47b6-a8ec-f78884d775ef req-0f827e6d-63a2-49fa-99cc-d80663312e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d68154-4590-45d5-a368-caceb8ff6701", "tag": "0468df89-afa2-4772-8bc8-05dea222c0da"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:14.680796 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:14.686187 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:14.686944 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea453b79-ef5b-4616-b90c-353d87e31a38 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:14.687146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:14.688694 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea453b79-ef5b-4616-b90c-353d87e31a38 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:14.690041 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:14.690167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea453b79-ef5b-4616-b90c-353d87e31a38 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:14.690570 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ea453b79-ef5b-4616-b90c-353d87e31a38 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:14.698057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9f442a02-308a-47b6-a8ec-f78884d775ef req-0f827e6d-63a2-49fa-99cc-d80663312e33 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:14.698623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-9f442a02-308a-47b6-a8ec-f78884d775ef req-0f827e6d-63a2-49fa-99cc-d80663312e33 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:14.711159 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-9f442a02-308a-47b6-a8ec-f78884d775ef req-0f827e6d-63a2-49fa-99cc-d80663312e33 service nova] Creating event network-changed:0468df89-afa2-4772-8bc8-05dea222c0da for instance 06d68154-4590-45d5-a368-caceb8ff6701 on n-h2-833090-9 Jul 26 15:28:14.717316 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-9f442a02-308a-47b6-a8ec-f78884d775ef req-0f827e6d-63a2-49fa-99cc-d80663312e33 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041824 Jul 26 15:28:14.718635 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3601/7085] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:14.927478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ea453b79-ef5b-4616-b90c-353d87e31a38 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:14.939230 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ea453b79-ef5b-4616-b90c-353d87e31a38 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1566 microversion: 2.1 time: 0.266349 Jul 26 15:28:14.948217 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3485/7086] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:14 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1566 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:38.195787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=36 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:38.200209 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-85179f10-3f50-41f1-b0f7-d52a1b562fa1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:38.202634 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-85179f10-3f50-41f1-b0f7-d52a1b562fa1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:38.210720 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85179f10-3f50-41f1-b0f7-d52a1b562fa1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:38.211197 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85179f10-3f50-41f1-b0f7-d52a1b562fa1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:38.212022 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85179f10-3f50-41f1-b0f7-d52a1b562fa1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:38.212482 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-85179f10-3f50-41f1-b0f7-d52a1b562fa1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:38.271040 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-85179f10-3f50-41f1-b0f7-d52a1b562fa1 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701/action" status: 200 len: 24564 microversion: 2.1 time: 0.076908 Jul 26 15:28:38.271723 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3602/7087] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:28:38 2022] POST /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701/action => generated 24564 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:28:49.420026 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ba74a425-ec43-4019-b0b1-36dabfbeeade tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:49.420688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ba74a425-ec43-4019-b0b1-36dabfbeeade tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:49.423488 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:49.425494 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=32 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:49.432607 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba74a425-ec43-4019-b0b1-36dabfbeeade tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:49.433067 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba74a425-ec43-4019-b0b1-36dabfbeeade tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:49.433846 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba74a425-ec43-4019-b0b1-36dabfbeeade tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:49.434287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ba74a425-ec43-4019-b0b1-36dabfbeeade tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:49.460499 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-ba74a425-ec43-4019-b0b1-36dabfbeeade tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lazy-loading 'flavor' on Instance uuid 06d68154-4590-45d5-a368-caceb8ff6701 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:28:49.533676 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ba74a425-ec43-4019-b0b1-36dabfbeeade tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701/action" status: 202 len: 0 microversion: 2.1 time: 0.117223 Jul 26 15:28:49.535153 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3486/7088] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:28:49 2022] POST /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:28:49.546952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a0a29601-5ae1-481d-b784-83ef0249095a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:49.548406 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a0a29601-5ae1-481d-b784-83ef0249095a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:49.553198 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:49.554233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:28:49.558812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0a29601-5ae1-481d-b784-83ef0249095a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:49.559470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0a29601-5ae1-481d-b784-83ef0249095a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:49.564195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0a29601-5ae1-481d-b784-83ef0249095a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:49.564195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a0a29601-5ae1-481d-b784-83ef0249095a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:49.755002 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a0a29601-5ae1-481d-b784-83ef0249095a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:49.764015 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a0a29601-5ae1-481d-b784-83ef0249095a tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1693 microversion: 2.1 time: 0.223516 Jul 26 15:28:49.764626 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3603/7089] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:49 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1693 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:50.795337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a43bd7ad-ec4f-4729-b687-dc66a3a9493c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:50.795994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a43bd7ad-ec4f-4729-b687-dc66a3a9493c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:50.804615 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a43bd7ad-ec4f-4729-b687-dc66a3a9493c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:50.805071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a43bd7ad-ec4f-4729-b687-dc66a3a9493c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:50.805845 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a43bd7ad-ec4f-4729-b687-dc66a3a9493c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:50.806287 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a43bd7ad-ec4f-4729-b687-dc66a3a9493c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:50.970738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a43bd7ad-ec4f-4729-b687-dc66a3a9493c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:50.984522 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a43bd7ad-ec4f-4729-b687-dc66a3a9493c tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1676 microversion: 2.1 time: 0.193393 Jul 26 15:28:50.985180 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3487/7090] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:50 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:52.095013 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2803681a-966b-4766-9545-e44ecfc9d997 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:52.098145 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2803681a-966b-4766-9545-e44ecfc9d997 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:52.105808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2803681a-966b-4766-9545-e44ecfc9d997 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:52.106282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2803681a-966b-4766-9545-e44ecfc9d997 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:52.107070 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2803681a-966b-4766-9545-e44ecfc9d997 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:52.107534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2803681a-966b-4766-9545-e44ecfc9d997 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:52.159983 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2803681a-966b-4766-9545-e44ecfc9d997 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701/action" status: 200 len: 38299 microversion: 2.1 time: 0.068179 Jul 26 15:28:52.160881 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3604/7091] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:28:52 2022] POST /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701/action => generated 38299 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:28:52.172861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-40fac42e-76f2-48c6-a897-0b757361147e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:52.173437 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-40fac42e-76f2-48c6-a897-0b757361147e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:52.181388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40fac42e-76f2-48c6-a897-0b757361147e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:52.181942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40fac42e-76f2-48c6-a897-0b757361147e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:52.182676 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40fac42e-76f2-48c6-a897-0b757361147e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:52.183153 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-40fac42e-76f2-48c6-a897-0b757361147e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:52.251238 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-40fac42e-76f2-48c6-a897-0b757361147e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701/action" status: 202 len: 0 microversion: 2.1 time: 0.082106 Jul 26 15:28:52.252076 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3488/7092] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:28:52 2022] POST /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:28:52.261824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d34f2fc0-188b-430d-873e-8321aaa53aa3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:52.262562 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d34f2fc0-188b-430d-873e-8321aaa53aa3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:52.270243 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d34f2fc0-188b-430d-873e-8321aaa53aa3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:52.270725 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d34f2fc0-188b-430d-873e-8321aaa53aa3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:52.271547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d34f2fc0-188b-430d-873e-8321aaa53aa3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:52.272045 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d34f2fc0-188b-430d-873e-8321aaa53aa3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:52.506998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d34f2fc0-188b-430d-873e-8321aaa53aa3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:52.514645 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d34f2fc0-188b-430d-873e-8321aaa53aa3 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1682 microversion: 2.1 time: 0.257213 Jul 26 15:28:52.515264 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3605/7093] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:52 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:53.542070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-664ca159-b6a1-4079-b7ed-99cb9a899bea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:53.543161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-664ca159-b6a1-4079-b7ed-99cb9a899bea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:53.554218 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-664ca159-b6a1-4079-b7ed-99cb9a899bea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:53.554854 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-664ca159-b6a1-4079-b7ed-99cb9a899bea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:53.556223 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-664ca159-b6a1-4079-b7ed-99cb9a899bea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:53.557033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-664ca159-b6a1-4079-b7ed-99cb9a899bea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:53.732643 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-664ca159-b6a1-4079-b7ed-99cb9a899bea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:53.742689 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-664ca159-b6a1-4079-b7ed-99cb9a899bea tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1682 microversion: 2.1 time: 0.209279 Jul 26 15:28:53.744148 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3489/7094] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:53 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:54.769157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e33e7fc5-0801-49f7-9e60-8ac40bb44661 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:54.769732 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e33e7fc5-0801-49f7-9e60-8ac40bb44661 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:54.776757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e33e7fc5-0801-49f7-9e60-8ac40bb44661 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:54.777233 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e33e7fc5-0801-49f7-9e60-8ac40bb44661 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:54.778025 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e33e7fc5-0801-49f7-9e60-8ac40bb44661 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:54.778488 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e33e7fc5-0801-49f7-9e60-8ac40bb44661 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:54.912356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e33e7fc5-0801-49f7-9e60-8ac40bb44661 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:54.920168 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e33e7fc5-0801-49f7-9e60-8ac40bb44661 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1685 microversion: 2.1 time: 0.155444 Jul 26 15:28:54.921176 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3606/7095] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:54 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:55.016737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b40a7c89-a84a-4804-8464-ddc5adc99d3e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:55.019572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b40a7c89-a84a-4804-8464-ddc5adc99d3e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:55.026509 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b40a7c89-a84a-4804-8464-ddc5adc99d3e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:55.027009 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b40a7c89-a84a-4804-8464-ddc5adc99d3e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:55.027793 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b40a7c89-a84a-4804-8464-ddc5adc99d3e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:55.028285 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b40a7c89-a84a-4804-8464-ddc5adc99d3e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:55.069585 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b40a7c89-a84a-4804-8464-ddc5adc99d3e tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "POST /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701/action" status: 200 len: 38299 microversion: 2.1 time: 0.057220 Jul 26 15:28:55.070261 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3490/7096] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:28:55 2022] POST /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701/action => generated 38299 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:28:56.081898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-93ca278b-c8af-4edb-9fc1-c4a285a350c9 req-f95b0f00-5ae4-49a0-9548-8e9bdfdb6244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d68154-4590-45d5-a368-caceb8ff6701", "tag": "0468df89-afa2-4772-8bc8-05dea222c0da"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:56.091054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5608467c-e241-4e67-8280-d693cd0fa0e8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:56.091588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5608467c-e241-4e67-8280-d693cd0fa0e8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:56.100274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5608467c-e241-4e67-8280-d693cd0fa0e8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:56.100958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-93ca278b-c8af-4edb-9fc1-c4a285a350c9 req-f95b0f00-5ae4-49a0-9548-8e9bdfdb6244 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:56.101087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5608467c-e241-4e67-8280-d693cd0fa0e8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:56.101403 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-93ca278b-c8af-4edb-9fc1-c4a285a350c9 req-f95b0f00-5ae4-49a0-9548-8e9bdfdb6244 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:56.101931 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5608467c-e241-4e67-8280-d693cd0fa0e8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:56.102471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5608467c-e241-4e67-8280-d693cd0fa0e8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:56.114148 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-93ca278b-c8af-4edb-9fc1-c4a285a350c9 req-f95b0f00-5ae4-49a0-9548-8e9bdfdb6244 service nova] Creating event network-changed:0468df89-afa2-4772-8bc8-05dea222c0da for instance 06d68154-4590-45d5-a368-caceb8ff6701 on n-h2-833090-9 Jul 26 15:28:56.119782 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-93ca278b-c8af-4edb-9fc1-c4a285a350c9 req-f95b0f00-5ae4-49a0-9548-8e9bdfdb6244 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042210 Jul 26 15:28:56.120589 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3491/7097] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:28:56.131723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5608467c-e241-4e67-8280-d693cd0fa0e8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:28:56.225682 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5608467c-e241-4e67-8280-d693cd0fa0e8 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "DELETE /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 204 len: 0 microversion: 2.1 time: 0.150710 Jul 26 15:28:56.226293 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3607/7098] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:28:56 2022] DELETE /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:28:56.243770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-13da9d04-9737-4c7f-b550-1c40f864ed4d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:56.245082 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-13da9d04-9737-4c7f-b550-1c40f864ed4d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:56.252118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13da9d04-9737-4c7f-b550-1c40f864ed4d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:56.252773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13da9d04-9737-4c7f-b550-1c40f864ed4d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:56.253957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13da9d04-9737-4c7f-b550-1c40f864ed4d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:56.254521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-13da9d04-9737-4c7f-b550-1c40f864ed4d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:56.419292 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-13da9d04-9737-4c7f-b550-1c40f864ed4d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:56.428579 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-13da9d04-9737-4c7f-b550-1c40f864ed4d tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1691 microversion: 2.1 time: 0.191517 Jul 26 15:28:56.436401 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3492/7099] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:56 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:57.452554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-554f7d1e-193e-43ff-9e5e-c43e051c9b54 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:57.453308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-554f7d1e-193e-43ff-9e5e-c43e051c9b54 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:57.461816 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-554f7d1e-193e-43ff-9e5e-c43e051c9b54 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:57.462292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-554f7d1e-193e-43ff-9e5e-c43e051c9b54 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:57.463101 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-554f7d1e-193e-43ff-9e5e-c43e051c9b54 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:57.463561 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-554f7d1e-193e-43ff-9e5e-c43e051c9b54 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:57.671772 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-554f7d1e-193e-43ff-9e5e-c43e051c9b54 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:57.681716 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-554f7d1e-193e-43ff-9e5e-c43e051c9b54 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1691 microversion: 2.1 time: 0.233513 Jul 26 15:28:57.682321 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3608/7100] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:57 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1691 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:58.417083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c0fe2753-e8a6-4ed3-880d-e830ea51d9a2 req-dc3f611a-7ec6-448c-97bf-551359ab2096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d68154-4590-45d5-a368-caceb8ff6701", "name": "network-vif-deleted", "tag": "0468df89-afa2-4772-8bc8-05dea222c0da"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:28:58.430123 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c0fe2753-e8a6-4ed3-880d-e830ea51d9a2 req-dc3f611a-7ec6-448c-97bf-551359ab2096 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:58.430576 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c0fe2753-e8a6-4ed3-880d-e830ea51d9a2 req-dc3f611a-7ec6-448c-97bf-551359ab2096 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:58.444327 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c0fe2753-e8a6-4ed3-880d-e830ea51d9a2 req-dc3f611a-7ec6-448c-97bf-551359ab2096 service nova] Creating event network-vif-deleted:0468df89-afa2-4772-8bc8-05dea222c0da for instance 06d68154-4590-45d5-a368-caceb8ff6701 on n-h2-833090-9 Jul 26 15:28:58.449823 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c0fe2753-e8a6-4ed3-880d-e830ea51d9a2 req-dc3f611a-7ec6-448c-97bf-551359ab2096 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036477 Jul 26 15:28:58.450534 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3493/7101] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:28:58.705092 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:58.706307 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:58.714382 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:58.714857 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:58.715713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:58.716204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:58.756848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:58.757322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:58.757805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lazy-loading 'fault' on Instance uuid 06d68154-4590-45d5-a368-caceb8ff6701 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:28:58.812516 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87ec95562914f5bbe90e0d65873143e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e055abfc258c4b2f9dec5a105fa0ec41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:28:58.823462 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7c63fc0f-c48c-4e76-ae20-7c481b825ea6 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 200 len: 1357 microversion: 2.1 time: 0.122292 Jul 26 15:28:58.824183 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3609/7102] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:58 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 1357 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:28:59.848276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44b19c74-d0aa-47b6-ac1b-a14835bfa6af tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:28:59.848923 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-44b19c74-d0aa-47b6-ac1b-a14835bfa6af tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] [instance: 06d68154-4590-45d5-a368-caceb8ff6701] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:28:59.855140 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44b19c74-d0aa-47b6-ac1b-a14835bfa6af tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:59.855593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44b19c74-d0aa-47b6-ac1b-a14835bfa6af tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:59.856385 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44b19c74-d0aa-47b6-ac1b-a14835bfa6af tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:28:59.856830 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-44b19c74-d0aa-47b6-ac1b-a14835bfa6af tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:28:59.870764 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-44b19c74-d0aa-47b6-ac1b-a14835bfa6af tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] HTTP exception thrown: Instance 06d68154-4590-45d5-a368-caceb8ff6701 could not be found. Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44b19c74-d0aa-47b6-ac1b-a14835bfa6af tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Request method failure captured: Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 HTTP/1.1 Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AZwWobvxI63mdOVS-oWvEqLyF8cT1eZMQKX5cQkkeaNcCru1ZM9pI6ztC8RXCAaiaIbH4ay2LSrHA40XxMXDFrluWb5iJMSBnoxzurC2hSsA4Lunw2O7_LR-GTzEM4dBacf2I7X2XB3X16LazlGxUWMWZHGjqsLgePN7fPx0QydZEw Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: e055abfc258c4b2f9dec5a105fa0ec41 Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e055abfc258c4b2f9dec5a105fa0ec41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e055abfc258c4b2f9dec5a105fa0ec41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e055abfc258c4b2f9dec5a105fa0ec41", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e055abfc258c4b2f9dec5a105fa0ec41"}]}] Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: e055abfc258c4b2f9dec5a105fa0ec41 Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-765091019 Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestNetworkAdvancedServerOps-765091019-project Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: a87ec95562914f5bbe90e0d65873143e Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestNetworkAdvancedServerOps-765091019-project Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 06d68154-4590-45d5-a368-caceb8ff6701 could not be found. Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '06d68154-4590-45d5-a368-caceb8ff6701'} Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d68154-4590-45d5-a368-caceb8ff6701 could not be found. Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d68154-4590-45d5-a368-caceb8ff6701 could not be found. Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:28:59.872427 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:28:59.878036 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:28:59.878036 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:28:59.878036 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:28:59.878036 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:28:59.878036 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:28:59.878036 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d68154-4590-45d5-a368-caceb8ff6701 could not be found. Jul 26 15:28:59.878036 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:28:59.878036 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-44b19c74-d0aa-47b6-ac1b-a14835bfa6af tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Returning 404 to user: Instance 06d68154-4590-45d5-a368-caceb8ff6701 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:28:59.878036 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-44b19c74-d0aa-47b6-ac1b-a14835bfa6af tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701" status: 404 len: 111 microversion: 2.1 time: 0.031536 Jul 26 15:28:59.878036 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3494/7103] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:28:59 2022] GET /compute/v2.1/servers/06d68154-4590-45d5-a368-caceb8ff6701 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:29:03.578236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-745052eb-b0fa-42cc-b4a4-a83ea57fbd12 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] Calling method '.version_select at 0x7f879942ba60>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:03.605085 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-745052eb-b0fa-42cc-b4a4-a83ea57fbd12 tempest-TestNetworkAdvancedServerOps-765091019 tempest-TestNetworkAdvancedServerOps-765091019-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1630109707" status: 202 len: 0 microversion: 2.1 time: 0.030638 Jul 26 15:29:03.605814 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3610/7104] 10.222.0.70 () {58 vars in 1284 bytes} [Tue Jul 26 15:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1630109707 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:29:14.740900 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=18 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:14.741638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:14.929731 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1fb74282-9aa0-4fc6-9056-a7a0d55c065e tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Action: 'create', calling method: .version_select at 0x7f87945d9ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1544210520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVBwrH2+pLj7mYeemplWoSAs8ea6/UxjtArnYTUP4mQIbvkXjky9CliYSp0OQD/nj9HLZMeFcb1/jIxrOOLF/QUH/ww4BxrtMIQ+emZDnBVvOtEk86cX8YldwUM5RJeNg=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:29:14.946912 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-1fb74282-9aa0-4fc6-9056-a7a0d55c065e tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Getting quotas for project 179a71165aad4b879c2fb1e742d8c483. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:29:14.956795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-1fb74282-9aa0-4fc6-9056-a7a0d55c065e tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Getting quotas for user bbe352dfd6dd4e98baf11a9821d4d030 and project 179a71165aad4b879c2fb1e742d8c483. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:29:14.987793 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1fb74282-9aa0-4fc6-9056-a7a0d55c065e tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.253144 Jul 26 15:29:14.988577 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3495/7105] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:29:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:29:16.114910 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:16.116554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:16.120925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2084239631", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1544210520", "security_groups": [{"name": "tempest-secgroup-smoke-241023239"}], "networks": [{"uuid": "6fd1eb48-dd9d-4f88-93ce-c7913942e5b5"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:29:16.245587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] validate_networks() for [('6fd1eb48-dd9d-4f88-93ce-c7913942e5b5', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:29:16.645310 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:29:16.645757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:29:16.646282 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:29:16.646738 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:29:16.647141 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:29:16.657266 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:16.657892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:16.659294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:16.659755 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:16.678350 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Getting quotas for project 179a71165aad4b879c2fb1e742d8c483. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:29:16.684146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Getting quotas for user bbe352dfd6dd4e98baf11a9821d4d030 and project 179a71165aad4b879c2fb1e742d8c483. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:29:16.699213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:29:16.701708 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:29:16.750118 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8018cd8d-9faa-4fec-bf68-b035a9eacfe8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.638052 Jul 26 15:29:16.750769 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3611/7106] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:29:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:29:16.762027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-55fb0455-22dc-45b9-8918-a53a41670306 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:16.762655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-55fb0455-22dc-45b9-8918-a53a41670306 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:16.824876 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-55fb0455-22dc-45b9-8918-a53a41670306 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:16.833085 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-55fb0455-22dc-45b9-8918-a53a41670306 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1247 microversion: 2.1 time: 0.074980 Jul 26 15:29:16.833666 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3496/7107] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:16 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:17.854781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-81347338-68ec-42a7-8ec7-54f31dceed61 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:17.855378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-81347338-68ec-42a7-8ec7-54f31dceed61 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:17.863876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81347338-68ec-42a7-8ec7-54f31dceed61 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:17.864457 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81347338-68ec-42a7-8ec7-54f31dceed61 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:17.865517 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81347338-68ec-42a7-8ec7-54f31dceed61 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:17.866388 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-81347338-68ec-42a7-8ec7-54f31dceed61 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:17.950815 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-81347338-68ec-42a7-8ec7-54f31dceed61 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:17.959850 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-81347338-68ec-42a7-8ec7-54f31dceed61 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1307 microversion: 2.1 time: 0.109858 Jul 26 15:29:17.961145 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3612/7108] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:17 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:18.982865 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-3fdd9a99-0410-4026-b4b6-67878a02c4f9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:18.984330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-3fdd9a99-0410-4026-b4b6-67878a02c4f9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:18.999249 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fdd9a99-0410-4026-b4b6-67878a02c4f9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:19.000457 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fdd9a99-0410-4026-b4b6-67878a02c4f9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:19.001801 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fdd9a99-0410-4026-b4b6-67878a02c4f9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:19.009303 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-3fdd9a99-0410-4026-b4b6-67878a02c4f9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:19.184144 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-3fdd9a99-0410-4026-b4b6-67878a02c4f9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:19.201491 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-3fdd9a99-0410-4026-b4b6-67878a02c4f9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1372 microversion: 2.1 time: 0.223520 Jul 26 15:29:19.202415 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3497/7109] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:18 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:19.559449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a6182750-b25f-4f0a-8e95-ca2027f25156 req-a66cf5d7-bb04-490c-a507-acd6766e8ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593cd72f-0613-42f2-a957-dee0d1b5c455", "tag": "e3551465-8c5d-4192-9ff9-b06a72213560"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:29:19.573205 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a6182750-b25f-4f0a-8e95-ca2027f25156 req-a66cf5d7-bb04-490c-a507-acd6766e8ef5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:19.573682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a6182750-b25f-4f0a-8e95-ca2027f25156 req-a66cf5d7-bb04-490c-a507-acd6766e8ef5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:19.592964 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a6182750-b25f-4f0a-8e95-ca2027f25156 req-a66cf5d7-bb04-490c-a507-acd6766e8ef5 service nova] Creating event network-changed:e3551465-8c5d-4192-9ff9-b06a72213560 for instance 593cd72f-0613-42f2-a957-dee0d1b5c455 on n-h1-833090-9 Jul 26 15:29:19.599695 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a6182750-b25f-4f0a-8e95-ca2027f25156 req-a66cf5d7-bb04-490c-a507-acd6766e8ef5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045012 Jul 26 15:29:19.600946 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3613/7110] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:29:20.223853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-43a79a1d-313a-4690-9a0d-c62e075e273d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:20.224548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-43a79a1d-313a-4690-9a0d-c62e075e273d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:20.231532 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a79a1d-313a-4690-9a0d-c62e075e273d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:20.232031 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a79a1d-313a-4690-9a0d-c62e075e273d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:20.232817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a79a1d-313a-4690-9a0d-c62e075e273d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:20.233663 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43a79a1d-313a-4690-9a0d-c62e075e273d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:20.365272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43a79a1d-313a-4690-9a0d-c62e075e273d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:20.372841 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-43a79a1d-313a-4690-9a0d-c62e075e273d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1372 microversion: 2.1 time: 0.153963 Jul 26 15:29:20.373414 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3498/7111] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:20 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:21.395973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6c880045-959f-42c5-9c4d-07e1ed881834 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:21.396710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6c880045-959f-42c5-9c4d-07e1ed881834 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:21.403523 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c880045-959f-42c5-9c4d-07e1ed881834 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:21.404287 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c880045-959f-42c5-9c4d-07e1ed881834 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:21.405496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c880045-959f-42c5-9c4d-07e1ed881834 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:21.405624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6c880045-959f-42c5-9c4d-07e1ed881834 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:21.551021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6c880045-959f-42c5-9c4d-07e1ed881834 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:21.558676 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6c880045-959f-42c5-9c4d-07e1ed881834 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1372 microversion: 2.1 time: 0.168679 Jul 26 15:29:21.559258 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3614/7112] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:21 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:22.580545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-01c1febf-277e-4b55-b0c6-144f49977d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:22.581353 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-01c1febf-277e-4b55-b0c6-144f49977d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:22.588348 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01c1febf-277e-4b55-b0c6-144f49977d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:22.588803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01c1febf-277e-4b55-b0c6-144f49977d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:22.589566 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01c1febf-277e-4b55-b0c6-144f49977d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:22.590007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-01c1febf-277e-4b55-b0c6-144f49977d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:22.726272 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-01c1febf-277e-4b55-b0c6-144f49977d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:22.733746 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-01c1febf-277e-4b55-b0c6-144f49977d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1372 microversion: 2.1 time: 0.157664 Jul 26 15:29:22.734317 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3499/7113] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:22 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:23.754969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-691e1ced-683c-40af-ada4-9fe0f24b4a37 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:23.755690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-691e1ced-683c-40af-ada4-9fe0f24b4a37 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:23.762969 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-691e1ced-683c-40af-ada4-9fe0f24b4a37 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:23.763450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-691e1ced-683c-40af-ada4-9fe0f24b4a37 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:23.764279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-691e1ced-683c-40af-ada4-9fe0f24b4a37 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:23.764740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-691e1ced-683c-40af-ada4-9fe0f24b4a37 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:23.896623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-691e1ced-683c-40af-ada4-9fe0f24b4a37 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:23.904133 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-691e1ced-683c-40af-ada4-9fe0f24b4a37 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1372 microversion: 2.1 time: 0.153327 Jul 26 15:29:23.904701 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3615/7114] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:23 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:29:24.927308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0dec173b-7036-4e17-8df0-f02a11714337 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:24.928068 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0dec173b-7036-4e17-8df0-f02a11714337 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:24.935436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dec173b-7036-4e17-8df0-f02a11714337 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:24.935898 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dec173b-7036-4e17-8df0-f02a11714337 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:24.936746 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dec173b-7036-4e17-8df0-f02a11714337 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:24.937199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0dec173b-7036-4e17-8df0-f02a11714337 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:25.009698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-e136134f-f921-4885-8c6d-e3809f9fe745 req-68db61af-dd7e-40e4-a05a-219060435a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593cd72f-0613-42f2-a957-dee0d1b5c455", "name": "network-vif-plugged", "status": "completed", "tag": "e3551465-8c5d-4192-9ff9-b06a72213560"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:29:25.022613 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e136134f-f921-4885-8c6d-e3809f9fe745 req-68db61af-dd7e-40e4-a05a-219060435a53 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:25.023484 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-e136134f-f921-4885-8c6d-e3809f9fe745 req-68db61af-dd7e-40e4-a05a-219060435a53 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:25.040783 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-e136134f-f921-4885-8c6d-e3809f9fe745 req-68db61af-dd7e-40e4-a05a-219060435a53 service nova] Creating event network-vif-plugged:e3551465-8c5d-4192-9ff9-b06a72213560 for instance 593cd72f-0613-42f2-a957-dee0d1b5c455 on n-h1-833090-9 Jul 26 15:29:25.047152 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-e136134f-f921-4885-8c6d-e3809f9fe745 req-68db61af-dd7e-40e4-a05a-219060435a53 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041240 Jul 26 15:29:25.048029 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3616/7115] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:29:25.079035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0dec173b-7036-4e17-8df0-f02a11714337 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:25.087624 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0dec173b-7036-4e17-8df0-f02a11714337 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1372 microversion: 2.1 time: 0.164864 Jul 26 15:29:25.088259 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3500/7116] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:24 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:26.110906 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bd263db2-db2e-4660-9b91-070111ccff7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:26.112844 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bd263db2-db2e-4660-9b91-070111ccff7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:26.119294 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd263db2-db2e-4660-9b91-070111ccff7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:26.119760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd263db2-db2e-4660-9b91-070111ccff7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:26.120582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd263db2-db2e-4660-9b91-070111ccff7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:26.121035 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bd263db2-db2e-4660-9b91-070111ccff7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:26.259180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bd263db2-db2e-4660-9b91-070111ccff7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:26.266713 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bd263db2-db2e-4660-9b91-070111ccff7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1372 microversion: 2.1 time: 0.160895 Jul 26 15:29:26.267283 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3617/7117] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:26 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:27.287706 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1d0310df-5d46-48b6-ab7c-5e158ddadf99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:27.288357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1d0310df-5d46-48b6-ab7c-5e158ddadf99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:27.291024 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:27.297719 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d0310df-5d46-48b6-ab7c-5e158ddadf99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:27.298309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d0310df-5d46-48b6-ab7c-5e158ddadf99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:27.299517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d0310df-5d46-48b6-ab7c-5e158ddadf99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:27.299981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1d0310df-5d46-48b6-ab7c-5e158ddadf99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:27.434463 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1d0310df-5d46-48b6-ab7c-5e158ddadf99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:27.443334 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1d0310df-5d46-48b6-ab7c-5e158ddadf99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1555 microversion: 2.1 time: 0.160524 Jul 26 15:29:27.443923 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3501/7118] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:27 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:27.463919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2a0ea0fb-02f4-44a9-bb1c-d94f5abae221 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:29:27.464586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2a0ea0fb-02f4-44a9-bb1c-d94f5abae221 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:29:27.466939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:27.467676 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:29:27.475097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a0ea0fb-02f4-44a9-bb1c-d94f5abae221 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:27.475566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a0ea0fb-02f4-44a9-bb1c-d94f5abae221 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:27.476393 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a0ea0fb-02f4-44a9-bb1c-d94f5abae221 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:27.476850 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2a0ea0fb-02f4-44a9-bb1c-d94f5abae221 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:27.618723 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2a0ea0fb-02f4-44a9-bb1c-d94f5abae221 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:29:27.626405 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2a0ea0fb-02f4-44a9-bb1c-d94f5abae221 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1555 microversion: 2.1 time: 0.166991 Jul 26 15:29:27.626993 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3618/7119] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:29:27 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:29:29.710126 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-a75fa290-bca0-42d1-92f3-f608c7ceb220 req-04438078-7a49-4166-8f50-784a6c758726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593cd72f-0613-42f2-a957-dee0d1b5c455", "tag": "e3551465-8c5d-4192-9ff9-b06a72213560"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:29:29.719550 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a75fa290-bca0-42d1-92f3-f608c7ceb220 req-04438078-7a49-4166-8f50-784a6c758726 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:29:29.720018 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-a75fa290-bca0-42d1-92f3-f608c7ceb220 req-04438078-7a49-4166-8f50-784a6c758726 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:29:29.732926 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-a75fa290-bca0-42d1-92f3-f608c7ceb220 req-04438078-7a49-4166-8f50-784a6c758726 service nova] Creating event network-changed:e3551465-8c5d-4192-9ff9-b06a72213560 for instance 593cd72f-0613-42f2-a957-dee0d1b5c455 on n-h1-833090-9 Jul 26 15:29:29.738960 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-a75fa290-bca0-42d1-92f3-f608c7ceb220 req-04438078-7a49-4166-8f50-784a6c758726 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088331 Jul 26 15:29:29.739560 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3502/7120] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:31:18.757969 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:31:18.759136 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:31:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:31:25.031586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:25.032492 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=36 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:25.036991 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0df27a91-9864-48b3-bacc-ce3b252a3a64 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:31:25.037549 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0df27a91-9864-48b3-bacc-ce3b252a3a64 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:25.045458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0df27a91-9864-48b3-bacc-ce3b252a3a64 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:25.045930 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0df27a91-9864-48b3-bacc-ce3b252a3a64 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:25.046718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0df27a91-9864-48b3-bacc-ce3b252a3a64 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:25.047185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0df27a91-9864-48b3-bacc-ce3b252a3a64 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:25.071968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-0df27a91-9864-48b3-bacc-ce3b252a3a64 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lazy-loading 'flavor' on Instance uuid 593cd72f-0613-42f2-a957-dee0d1b5c455 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:31:25.256266 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0df27a91-9864-48b3-bacc-ce3b252a3a64 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "POST /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455/action" status: 202 len: 0 microversion: 2.1 time: 0.226216 Jul 26 15:31:25.256868 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3619/7121] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:31:25 2022] POST /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:31:25.264584 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [54fe80fa-5d54-4bb9-a76b-59290c50e610] AMQP server on 10.222.0.70:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 15:31:25.265678 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7f3ab2a-6e11-4e90-a515-8ef793525f8a] AMQP server on 10.222.0.70:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 26 15:31:25.266290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:25.267048 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=32 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:25.272118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-851292dd-74f0-4e00-83a2-42e8b7c7f483 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:25.272838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-851292dd-74f0-4e00-83a2-42e8b7c7f483 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:25.288795 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-851292dd-74f0-4e00-83a2-42e8b7c7f483 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:25.289179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-851292dd-74f0-4e00-83a2-42e8b7c7f483 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:25.290778 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-851292dd-74f0-4e00-83a2-42e8b7c7f483 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:25.291224 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-851292dd-74f0-4e00-83a2-42e8b7c7f483 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:25.432543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-851292dd-74f0-4e00-83a2-42e8b7c7f483 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:25.440257 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-851292dd-74f0-4e00-83a2-42e8b7c7f483 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.178240 Jul 26 15:31:25.440842 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3503/7122] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:25 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:26.465119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-739b0485-52c8-4eb0-839d-01faabb99cec tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:26.465846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-739b0485-52c8-4eb0-839d-01faabb99cec tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:26.473196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-739b0485-52c8-4eb0-839d-01faabb99cec tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:26.473671 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-739b0485-52c8-4eb0-839d-01faabb99cec tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:26.474458 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-739b0485-52c8-4eb0-839d-01faabb99cec tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:26.474917 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-739b0485-52c8-4eb0-839d-01faabb99cec tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:26.614395 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-739b0485-52c8-4eb0-839d-01faabb99cec tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:26.623253 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-739b0485-52c8-4eb0-839d-01faabb99cec tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.164090 Jul 26 15:31:26.623827 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3620/7123] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:26 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:27.644803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7278f5bf-9029-420a-9e60-f4cbc5272ffd tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:27.645420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7278f5bf-9029-420a-9e60-f4cbc5272ffd tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:27.655562 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7278f5bf-9029-420a-9e60-f4cbc5272ffd tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:27.656046 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7278f5bf-9029-420a-9e60-f4cbc5272ffd tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:27.656826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7278f5bf-9029-420a-9e60-f4cbc5272ffd tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:27.657269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7278f5bf-9029-420a-9e60-f4cbc5272ffd tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:27.661954 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] [54fe80fa-5d54-4bb9-a76b-59290c50e610] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 53796. Jul 26 15:31:27.676704 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7f3ab2a-6e11-4e90-a515-8ef793525f8a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 53798. Jul 26 15:31:27.793415 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7278f5bf-9029-420a-9e60-f4cbc5272ffd tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:27.801290 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7278f5bf-9029-420a-9e60-f4cbc5272ffd tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.160130 Jul 26 15:31:27.801776 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3504/7124] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:27 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:28.823346 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9af6d6f5-b296-422f-9838-7a2eb5ef688b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:28.823891 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9af6d6f5-b296-422f-9838-7a2eb5ef688b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:28.830864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9af6d6f5-b296-422f-9838-7a2eb5ef688b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:28.831337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9af6d6f5-b296-422f-9838-7a2eb5ef688b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:28.832154 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9af6d6f5-b296-422f-9838-7a2eb5ef688b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:28.832619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9af6d6f5-b296-422f-9838-7a2eb5ef688b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:28.967544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9af6d6f5-b296-422f-9838-7a2eb5ef688b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:28.975033 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9af6d6f5-b296-422f-9838-7a2eb5ef688b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.155952 Jul 26 15:31:28.975604 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3621/7125] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:28 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:29.997375 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c8fe03e4-581c-40bc-9a4c-307684ca7ea1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:29.998001 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c8fe03e4-581c-40bc-9a4c-307684ca7ea1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:30.005020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8fe03e4-581c-40bc-9a4c-307684ca7ea1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:30.005495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8fe03e4-581c-40bc-9a4c-307684ca7ea1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:30.006267 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8fe03e4-581c-40bc-9a4c-307684ca7ea1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:30.006710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c8fe03e4-581c-40bc-9a4c-307684ca7ea1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:30.143681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c8fe03e4-581c-40bc-9a4c-307684ca7ea1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:30.151447 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c8fe03e4-581c-40bc-9a4c-307684ca7ea1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.158814 Jul 26 15:31:30.152044 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3505/7126] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:29 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:31.172408 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c09c704e-c30d-4b56-ac19-7a8a97180cb1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:31.173113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c09c704e-c30d-4b56-ac19-7a8a97180cb1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:31.180441 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c09c704e-c30d-4b56-ac19-7a8a97180cb1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:31.181584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c09c704e-c30d-4b56-ac19-7a8a97180cb1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:31.182410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c09c704e-c30d-4b56-ac19-7a8a97180cb1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:31.182871 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c09c704e-c30d-4b56-ac19-7a8a97180cb1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:31.318434 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c09c704e-c30d-4b56-ac19-7a8a97180cb1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:31.326401 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c09c704e-c30d-4b56-ac19-7a8a97180cb1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.158008 Jul 26 15:31:31.326976 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3622/7127] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:31 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:32.348703 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b891ba01-bad9-41c9-a125-7fafb4254809 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:32.349328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b891ba01-bad9-41c9-a125-7fafb4254809 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:32.357318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b891ba01-bad9-41c9-a125-7fafb4254809 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:32.357779 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b891ba01-bad9-41c9-a125-7fafb4254809 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:32.358556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b891ba01-bad9-41c9-a125-7fafb4254809 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:32.359005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b891ba01-bad9-41c9-a125-7fafb4254809 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:32.498498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b891ba01-bad9-41c9-a125-7fafb4254809 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:32.506562 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b891ba01-bad9-41c9-a125-7fafb4254809 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.161844 Jul 26 15:31:32.507124 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3506/7128] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:32 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:33.528664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5ee4778b-e705-4a8c-8e1c-231627cc8b8f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:33.529238 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5ee4778b-e705-4a8c-8e1c-231627cc8b8f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:33.536140 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ee4778b-e705-4a8c-8e1c-231627cc8b8f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:33.536619 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ee4778b-e705-4a8c-8e1c-231627cc8b8f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:33.537403 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ee4778b-e705-4a8c-8e1c-231627cc8b8f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:33.537859 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5ee4778b-e705-4a8c-8e1c-231627cc8b8f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:33.671132 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5ee4778b-e705-4a8c-8e1c-231627cc8b8f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:33.678965 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5ee4778b-e705-4a8c-8e1c-231627cc8b8f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.155251 Jul 26 15:31:33.679534 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3623/7129] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:33 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:34.699560 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8a55878b-f245-4ada-a7c1-eb35ce23741d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:34.700167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8a55878b-f245-4ada-a7c1-eb35ce23741d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:34.707379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a55878b-f245-4ada-a7c1-eb35ce23741d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:34.707853 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a55878b-f245-4ada-a7c1-eb35ce23741d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:34.708755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a55878b-f245-4ada-a7c1-eb35ce23741d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:34.709197 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8a55878b-f245-4ada-a7c1-eb35ce23741d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:34.846243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8a55878b-f245-4ada-a7c1-eb35ce23741d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:34.853828 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8a55878b-f245-4ada-a7c1-eb35ce23741d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.158359 Jul 26 15:31:34.854415 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3507/7130] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:34 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:35.874773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-277cecf1-2c09-40e9-9542-d48d341a12e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:35.875418 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-277cecf1-2c09-40e9-9542-d48d341a12e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:35.883027 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-277cecf1-2c09-40e9-9542-d48d341a12e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:35.883504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-277cecf1-2c09-40e9-9542-d48d341a12e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:35.884483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-277cecf1-2c09-40e9-9542-d48d341a12e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:35.884945 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-277cecf1-2c09-40e9-9542-d48d341a12e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:36.015986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-277cecf1-2c09-40e9-9542-d48d341a12e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:36.023607 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-277cecf1-2c09-40e9-9542-d48d341a12e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1701 microversion: 2.1 time: 0.152762 Jul 26 15:31:36.024311 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3624/7131] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:35 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:37.045665 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-78f20ef6-fb2e-4358-bdfe-9921d542855d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:37.046286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-78f20ef6-fb2e-4358-bdfe-9921d542855d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:37.053590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78f20ef6-fb2e-4358-bdfe-9921d542855d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:37.054042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78f20ef6-fb2e-4358-bdfe-9921d542855d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:37.054809 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78f20ef6-fb2e-4358-bdfe-9921d542855d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:37.055250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-78f20ef6-fb2e-4358-bdfe-9921d542855d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:37.187431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-78f20ef6-fb2e-4358-bdfe-9921d542855d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:37.194890 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-78f20ef6-fb2e-4358-bdfe-9921d542855d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1701 microversion: 2.1 time: 0.153157 Jul 26 15:31:37.195456 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3508/7132] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:37 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:38.218095 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-887be061-7596-40c7-88a5-6ab02abda2a8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:38.218827 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-887be061-7596-40c7-88a5-6ab02abda2a8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:38.225798 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-887be061-7596-40c7-88a5-6ab02abda2a8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:38.226341 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-887be061-7596-40c7-88a5-6ab02abda2a8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:38.227195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-887be061-7596-40c7-88a5-6ab02abda2a8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:38.227716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-887be061-7596-40c7-88a5-6ab02abda2a8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:38.376792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-887be061-7596-40c7-88a5-6ab02abda2a8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:38.386004 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-887be061-7596-40c7-88a5-6ab02abda2a8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1696 microversion: 2.1 time: 0.172236 Jul 26 15:31:38.386598 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3625/7133] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:38 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:31:39.413981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-da185239-c305-4dd0-b3e8-6b221ffecabe tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:39.414894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-da185239-c305-4dd0-b3e8-6b221ffecabe tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:39.430612 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da185239-c305-4dd0-b3e8-6b221ffecabe tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:39.431243 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da185239-c305-4dd0-b3e8-6b221ffecabe tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:39.432194 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da185239-c305-4dd0-b3e8-6b221ffecabe tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:39.432602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-da185239-c305-4dd0-b3e8-6b221ffecabe tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:39.598986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-da185239-c305-4dd0-b3e8-6b221ffecabe tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:39.608517 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-da185239-c305-4dd0-b3e8-6b221ffecabe tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1696 microversion: 2.1 time: 0.204850 Jul 26 15:31:39.620646 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3509/7134] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:39 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1696 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:39.736924 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4ba29e72-759c-4c23-a2a6-4e1f446dfe21 req-61406a49-b4e1-42ee-9113-98576f97f975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593cd72f-0613-42f2-a957-dee0d1b5c455", "name": "network-vif-plugged", "status": "completed", "tag": "e3551465-8c5d-4192-9ff9-b06a72213560"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:31:39.747975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4ba29e72-759c-4c23-a2a6-4e1f446dfe21 req-61406a49-b4e1-42ee-9113-98576f97f975 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:39.748440 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4ba29e72-759c-4c23-a2a6-4e1f446dfe21 req-61406a49-b4e1-42ee-9113-98576f97f975 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:39.763480 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4ba29e72-759c-4c23-a2a6-4e1f446dfe21 req-61406a49-b4e1-42ee-9113-98576f97f975 service nova] Creating event network-vif-plugged:e3551465-8c5d-4192-9ff9-b06a72213560 for instance 593cd72f-0613-42f2-a957-dee0d1b5c455 on n-h1-833090-9 Jul 26 15:31:39.768975 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4ba29e72-759c-4c23-a2a6-4e1f446dfe21 req-61406a49-b4e1-42ee-9113-98576f97f975 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120125 Jul 26 15:31:39.774497 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3626/7135] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:31:40.630766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f0cbe662-36c3-43b2-8dbc-d38327195db2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:40.631384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f0cbe662-36c3-43b2-8dbc-d38327195db2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:40.641270 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0cbe662-36c3-43b2-8dbc-d38327195db2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:40.641751 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0cbe662-36c3-43b2-8dbc-d38327195db2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:40.642833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0cbe662-36c3-43b2-8dbc-d38327195db2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:40.643495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f0cbe662-36c3-43b2-8dbc-d38327195db2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:40.797133 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f0cbe662-36c3-43b2-8dbc-d38327195db2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:40.805237 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f0cbe662-36c3-43b2-8dbc-d38327195db2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1696 microversion: 2.1 time: 0.178307 Jul 26 15:31:40.806024 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3510/7136] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:40 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:41.831087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-71056f79-7ffb-4bf9-87cb-4b3dfdd63a4d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:41.832583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-71056f79-7ffb-4bf9-87cb-4b3dfdd63a4d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:41.840702 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71056f79-7ffb-4bf9-87cb-4b3dfdd63a4d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:41.841275 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71056f79-7ffb-4bf9-87cb-4b3dfdd63a4d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:41.842094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71056f79-7ffb-4bf9-87cb-4b3dfdd63a4d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:41.842563 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-71056f79-7ffb-4bf9-87cb-4b3dfdd63a4d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:42.005239 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-71056f79-7ffb-4bf9-87cb-4b3dfdd63a4d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:42.014929 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-71056f79-7ffb-4bf9-87cb-4b3dfdd63a4d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1696 microversion: 2.1 time: 0.190739 Jul 26 15:31:42.015741 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3627/7137] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:41 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1696 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:43.039708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f6b0ceeb-281a-4819-9c70-00af3d5d99eb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:43.040957 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f6b0ceeb-281a-4819-9c70-00af3d5d99eb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:43.048814 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6b0ceeb-281a-4819-9c70-00af3d5d99eb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:43.049339 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6b0ceeb-281a-4819-9c70-00af3d5d99eb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:43.051389 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6b0ceeb-281a-4819-9c70-00af3d5d99eb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:43.052020 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f6b0ceeb-281a-4819-9c70-00af3d5d99eb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:43.220897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f6b0ceeb-281a-4819-9c70-00af3d5d99eb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:43.231200 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f6b0ceeb-281a-4819-9c70-00af3d5d99eb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1696 microversion: 2.1 time: 0.195489 Jul 26 15:31:43.245708 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3511/7138] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:43 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1696 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:44.253713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-89015af3-639a-4a92-8ba0-f7edf23ded5c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:44.255536 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-89015af3-639a-4a92-8ba0-f7edf23ded5c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:44.266334 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89015af3-639a-4a92-8ba0-f7edf23ded5c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:44.266846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89015af3-639a-4a92-8ba0-f7edf23ded5c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:44.267663 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89015af3-639a-4a92-8ba0-f7edf23ded5c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:44.268157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89015af3-639a-4a92-8ba0-f7edf23ded5c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:44.442582 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-89015af3-639a-4a92-8ba0-f7edf23ded5c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:44.451106 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-89015af3-639a-4a92-8ba0-f7edf23ded5c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1696 microversion: 2.1 time: 0.201411 Jul 26 15:31:44.452092 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3628/7139] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:44 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1696 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:45.474152 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1df7cd86-52a3-485a-881f-292d1d55ea21 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:45.475631 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1df7cd86-52a3-485a-881f-292d1d55ea21 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:45.484542 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1df7cd86-52a3-485a-881f-292d1d55ea21 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:45.485530 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1df7cd86-52a3-485a-881f-292d1d55ea21 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:45.486821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1df7cd86-52a3-485a-881f-292d1d55ea21 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:45.487507 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1df7cd86-52a3-485a-881f-292d1d55ea21 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:45.643786 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1df7cd86-52a3-485a-881f-292d1d55ea21 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:45.653804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1df7cd86-52a3-485a-881f-292d1d55ea21 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1696 microversion: 2.1 time: 0.184054 Jul 26 15:31:45.670638 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3512/7140] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:45 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:46.679308 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-51306b68-cc77-4b43-a7f8-6eba4691ff24 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:46.680792 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-51306b68-cc77-4b43-a7f8-6eba4691ff24 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:46.689134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51306b68-cc77-4b43-a7f8-6eba4691ff24 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:46.689933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51306b68-cc77-4b43-a7f8-6eba4691ff24 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:46.691117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51306b68-cc77-4b43-a7f8-6eba4691ff24 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:46.691801 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-51306b68-cc77-4b43-a7f8-6eba4691ff24 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:46.852059 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-51306b68-cc77-4b43-a7f8-6eba4691ff24 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:46.862824 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-51306b68-cc77-4b43-a7f8-6eba4691ff24 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1696 microversion: 2.1 time: 0.189260 Jul 26 15:31:46.863532 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3629/7141] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:46 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:47.887335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ed1d920e-246b-4349-8698-453b81bad322 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:47.888004 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ed1d920e-246b-4349-8698-453b81bad322 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:47.895062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed1d920e-246b-4349-8698-453b81bad322 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:47.895517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed1d920e-246b-4349-8698-453b81bad322 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:47.896322 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed1d920e-246b-4349-8698-453b81bad322 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:47.896770 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ed1d920e-246b-4349-8698-453b81bad322 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:48.036269 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ed1d920e-246b-4349-8698-453b81bad322 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:48.044598 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ed1d920e-246b-4349-8698-453b81bad322 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1678 microversion: 2.1 time: 0.161794 Jul 26 15:31:48.045180 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3513/7142] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:47 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:49.066848 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2d6c0ab4-6d1d-47f5-95e1-c9befaf1d396 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:49.067487 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2d6c0ab4-6d1d-47f5-95e1-c9befaf1d396 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:49.074901 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d6c0ab4-6d1d-47f5-95e1-c9befaf1d396 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:49.075373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d6c0ab4-6d1d-47f5-95e1-c9befaf1d396 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:49.076190 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d6c0ab4-6d1d-47f5-95e1-c9befaf1d396 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:49.076652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2d6c0ab4-6d1d-47f5-95e1-c9befaf1d396 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:49.211764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2d6c0ab4-6d1d-47f5-95e1-c9befaf1d396 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:49.220176 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2d6c0ab4-6d1d-47f5-95e1-c9befaf1d396 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1678 microversion: 2.1 time: 0.157243 Jul 26 15:31:49.220747 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3630/7143] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:49 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:49.590295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-865e47b8-9b2e-4d4f-bc64-ec4fc3e26dab req-0f856367-23de-45e5-98a1-c11361ea0c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593cd72f-0613-42f2-a957-dee0d1b5c455", "name": "network-vif-unplugged", "status": "completed", "tag": "e3551465-8c5d-4192-9ff9-b06a72213560"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:31:49.601639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-865e47b8-9b2e-4d4f-bc64-ec4fc3e26dab req-0f856367-23de-45e5-98a1-c11361ea0c4a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:49.602170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-865e47b8-9b2e-4d4f-bc64-ec4fc3e26dab req-0f856367-23de-45e5-98a1-c11361ea0c4a service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:49.614932 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-865e47b8-9b2e-4d4f-bc64-ec4fc3e26dab req-0f856367-23de-45e5-98a1-c11361ea0c4a service nova] Creating event network-vif-unplugged:e3551465-8c5d-4192-9ff9-b06a72213560 for instance 593cd72f-0613-42f2-a957-dee0d1b5c455 on n-h1-833090-9 Jul 26 15:31:49.621090 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-865e47b8-9b2e-4d4f-bc64-ec4fc3e26dab req-0f856367-23de-45e5-98a1-c11361ea0c4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035921 Jul 26 15:31:49.621704 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3514/7144] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:31:50.242852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-21157de8-5432-4a8a-bd0f-2996d5df4f7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:50.244083 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-21157de8-5432-4a8a-bd0f-2996d5df4f7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:50.251066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21157de8-5432-4a8a-bd0f-2996d5df4f7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:50.251624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21157de8-5432-4a8a-bd0f-2996d5df4f7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:50.252740 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21157de8-5432-4a8a-bd0f-2996d5df4f7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:50.253204 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-21157de8-5432-4a8a-bd0f-2996d5df4f7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:50.393332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-21157de8-5432-4a8a-bd0f-2996d5df4f7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:50.402569 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-21157de8-5432-4a8a-bd0f-2996d5df4f7f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1681 microversion: 2.1 time: 0.164151 Jul 26 15:31:50.403248 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3631/7145] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:50 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:50.427655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-deaa7abd-0120-409a-9951-fe29701827fb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:31:50.428363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-deaa7abd-0120-409a-9951-fe29701827fb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:50.435929 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-deaa7abd-0120-409a-9951-fe29701827fb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:50.436447 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-deaa7abd-0120-409a-9951-fe29701827fb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:50.437230 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-deaa7abd-0120-409a-9951-fe29701827fb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:50.437682 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-deaa7abd-0120-409a-9951-fe29701827fb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:50.578153 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-deaa7abd-0120-409a-9951-fe29701827fb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "POST /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455/action" status: 202 len: 0 microversion: 2.1 time: 0.155259 Jul 26 15:31:50.578954 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3515/7146] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:31:50 2022] POST /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:31:50.588079 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9ac78d9a-e25f-4d4e-b54f-95283164ee71 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:50.588718 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9ac78d9a-e25f-4d4e-b54f-95283164ee71 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:50.594770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ac78d9a-e25f-4d4e-b54f-95283164ee71 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:50.595247 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ac78d9a-e25f-4d4e-b54f-95283164ee71 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:50.596093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ac78d9a-e25f-4d4e-b54f-95283164ee71 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:50.596554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9ac78d9a-e25f-4d4e-b54f-95283164ee71 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:50.735778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9ac78d9a-e25f-4d4e-b54f-95283164ee71 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:50.744099 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9ac78d9a-e25f-4d4e-b54f-95283164ee71 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1629 microversion: 2.1 time: 0.160021 Jul 26 15:31:50.745374 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3632/7147] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:50 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1629 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:31:51.766681 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-593e0866-e3ce-4802-ac73-878a3ad34bb0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:51.767284 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-593e0866-e3ce-4802-ac73-878a3ad34bb0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:51.775125 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-593e0866-e3ce-4802-ac73-878a3ad34bb0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:51.775589 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-593e0866-e3ce-4802-ac73-878a3ad34bb0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:51.776807 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-593e0866-e3ce-4802-ac73-878a3ad34bb0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:51.777320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-593e0866-e3ce-4802-ac73-878a3ad34bb0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:51.978545 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-593e0866-e3ce-4802-ac73-878a3ad34bb0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:51.986858 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-593e0866-e3ce-4802-ac73-878a3ad34bb0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.224069 Jul 26 15:31:51.987637 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3516/7148] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:51 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:52.757449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a19abda5-9a1a-49fb-ab33-99a4bfe89824 req-699dace5-944b-4f63-89dd-2600912d25c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593cd72f-0613-42f2-a957-dee0d1b5c455", "tag": "e3551465-8c5d-4192-9ff9-b06a72213560"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:31:52.770076 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a19abda5-9a1a-49fb-ab33-99a4bfe89824 req-699dace5-944b-4f63-89dd-2600912d25c1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:52.770886 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a19abda5-9a1a-49fb-ab33-99a4bfe89824 req-699dace5-944b-4f63-89dd-2600912d25c1 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:52.786336 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a19abda5-9a1a-49fb-ab33-99a4bfe89824 req-699dace5-944b-4f63-89dd-2600912d25c1 service nova] Creating event network-changed:e3551465-8c5d-4192-9ff9-b06a72213560 for instance 593cd72f-0613-42f2-a957-dee0d1b5c455 on n-h2-833090-9 Jul 26 15:31:52.792792 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a19abda5-9a1a-49fb-ab33-99a4bfe89824 req-699dace5-944b-4f63-89dd-2600912d25c1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042813 Jul 26 15:31:52.793649 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3633/7149] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:31:53.010702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8c41ff9e-2b63-4c3b-91c8-df49055c0d99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:53.011426 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8c41ff9e-2b63-4c3b-91c8-df49055c0d99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:53.018326 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c41ff9e-2b63-4c3b-91c8-df49055c0d99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:53.018774 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c41ff9e-2b63-4c3b-91c8-df49055c0d99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:53.019543 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c41ff9e-2b63-4c3b-91c8-df49055c0d99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:53.020003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8c41ff9e-2b63-4c3b-91c8-df49055c0d99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:53.246113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8c41ff9e-2b63-4c3b-91c8-df49055c0d99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:53.253815 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8c41ff9e-2b63-4c3b-91c8-df49055c0d99 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.249067 Jul 26 15:31:53.254433 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3517/7150] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:53 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:54.276893 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-777e2837-81c0-40ef-8d88-fc76b38d320f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:54.277647 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-777e2837-81c0-40ef-8d88-fc76b38d320f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:54.284228 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-777e2837-81c0-40ef-8d88-fc76b38d320f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:54.284704 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-777e2837-81c0-40ef-8d88-fc76b38d320f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:54.285504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-777e2837-81c0-40ef-8d88-fc76b38d320f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:54.285975 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-777e2837-81c0-40ef-8d88-fc76b38d320f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:54.451261 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-777e2837-81c0-40ef-8d88-fc76b38d320f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:54.454942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:54.466351 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-777e2837-81c0-40ef-8d88-fc76b38d320f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.194724 Jul 26 15:31:54.468254 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3634/7151] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:54 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:55.491304 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4b088912-2428-4276-9d82-70a208e2a825 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:55.500012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4b088912-2428-4276-9d82-70a208e2a825 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:55.500012 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=33 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:55.507894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b088912-2428-4276-9d82-70a208e2a825 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:55.508742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b088912-2428-4276-9d82-70a208e2a825 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:55.510825 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b088912-2428-4276-9d82-70a208e2a825 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:55.511651 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b088912-2428-4276-9d82-70a208e2a825 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:55.539934 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:55.687290 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4b088912-2428-4276-9d82-70a208e2a825 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:55.695131 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4b088912-2428-4276-9d82-70a208e2a825 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.208007 Jul 26 15:31:55.695723 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3518/7152] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:55 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:56.718804 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-3d10370b-ecfd-4171-b078-08ab8a2bd3c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:56.719443 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-3d10370b-ecfd-4171-b078-08ab8a2bd3c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:56.722326 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=33 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:31:56.729297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d10370b-ecfd-4171-b078-08ab8a2bd3c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:56.729773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d10370b-ecfd-4171-b078-08ab8a2bd3c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:56.730567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d10370b-ecfd-4171-b078-08ab8a2bd3c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:56.731026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-3d10370b-ecfd-4171-b078-08ab8a2bd3c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:56.883713 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-3d10370b-ecfd-4171-b078-08ab8a2bd3c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:56.892705 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-3d10370b-ecfd-4171-b078-08ab8a2bd3c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.178157 Jul 26 15:31:56.893499 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3635/7153] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:56 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:31:57.917264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8bbc2f94-3edb-403b-ab87-ef6c7d0bdc75 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:57.919251 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8bbc2f94-3edb-403b-ab87-ef6c7d0bdc75 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:57.928662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bbc2f94-3edb-403b-ab87-ef6c7d0bdc75 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:57.929118 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bbc2f94-3edb-403b-ab87-ef6c7d0bdc75 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:57.929937 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bbc2f94-3edb-403b-ab87-ef6c7d0bdc75 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:57.930379 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8bbc2f94-3edb-403b-ab87-ef6c7d0bdc75 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:58.092482 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8bbc2f94-3edb-403b-ab87-ef6c7d0bdc75 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:58.102426 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8bbc2f94-3edb-403b-ab87-ef6c7d0bdc75 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.191377 Jul 26 15:31:58.103490 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3519/7154] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:57 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:31:59.135148 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-61e6612d-22c9-43c0-9606-274c83b584a1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:31:59.135770 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-61e6612d-22c9-43c0-9606-274c83b584a1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:31:59.142824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61e6612d-22c9-43c0-9606-274c83b584a1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:59.143293 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61e6612d-22c9-43c0-9606-274c83b584a1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:59.144106 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61e6612d-22c9-43c0-9606-274c83b584a1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:31:59.144564 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-61e6612d-22c9-43c0-9606-274c83b584a1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:31:59.319423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-61e6612d-22c9-43c0-9606-274c83b584a1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:31:59.329071 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-61e6612d-22c9-43c0-9606-274c83b584a1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.197782 Jul 26 15:31:59.329682 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3636/7155] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:31:59 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:32:00.367377 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-e6a4bb70-2af7-4cec-9e42-86e87d4cbd93 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:32:00.370775 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-e6a4bb70-2af7-4cec-9e42-86e87d4cbd93 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:32:00.380084 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6a4bb70-2af7-4cec-9e42-86e87d4cbd93 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:00.381052 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6a4bb70-2af7-4cec-9e42-86e87d4cbd93 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:00.382170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6a4bb70-2af7-4cec-9e42-86e87d4cbd93 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:00.382958 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-e6a4bb70-2af7-4cec-9e42-86e87d4cbd93 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:00.541408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-e6a4bb70-2af7-4cec-9e42-86e87d4cbd93 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:32:00.555034 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-e6a4bb70-2af7-4cec-9e42-86e87d4cbd93 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.192590 Jul 26 15:32:00.570699 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3520/7156] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:32:00 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:32:01.585435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-26449e50-21fc-4ef4-92f5-840f55df18f4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:32:01.585435 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-26449e50-21fc-4ef4-92f5-840f55df18f4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:32:01.595112 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26449e50-21fc-4ef4-92f5-840f55df18f4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:01.595805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26449e50-21fc-4ef4-92f5-840f55df18f4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:01.597061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26449e50-21fc-4ef4-92f5-840f55df18f4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:01.597624 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-26449e50-21fc-4ef4-92f5-840f55df18f4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:01.751828 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-26449e50-21fc-4ef4-92f5-840f55df18f4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:32:01.760334 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-26449e50-21fc-4ef4-92f5-840f55df18f4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.185044 Jul 26 15:32:01.760866 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3637/7157] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:32:01 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:32:02.781720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-500122ad-ba39-43b4-a6b3-d89887045d7c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:32:02.782354 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-500122ad-ba39-43b4-a6b3-d89887045d7c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:32:02.789286 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-500122ad-ba39-43b4-a6b3-d89887045d7c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:02.789737 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-500122ad-ba39-43b4-a6b3-d89887045d7c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:02.791157 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-500122ad-ba39-43b4-a6b3-d89887045d7c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:02.791597 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-500122ad-ba39-43b4-a6b3-d89887045d7c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:02.939641 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-500122ad-ba39-43b4-a6b3-d89887045d7c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:32:02.948263 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-500122ad-ba39-43b4-a6b3-d89887045d7c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.170326 Jul 26 15:32:02.948859 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3521/7158] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:32:02 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:32:03.970322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-37f8ca28-9a16-4047-9e4c-8419b3734ed8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:32:03.970952 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-37f8ca28-9a16-4047-9e4c-8419b3734ed8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:32:03.978986 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37f8ca28-9a16-4047-9e4c-8419b3734ed8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:03.979454 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37f8ca28-9a16-4047-9e4c-8419b3734ed8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:03.980278 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37f8ca28-9a16-4047-9e4c-8419b3734ed8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:03.980731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-37f8ca28-9a16-4047-9e4c-8419b3734ed8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:04.173525 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-37f8ca28-9a16-4047-9e4c-8419b3734ed8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:32:04.181650 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-37f8ca28-9a16-4047-9e4c-8419b3734ed8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.215609 Jul 26 15:32:04.182424 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3638/7159] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:32:03 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:32:05.204109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9471464d-cf5a-45be-806f-031be22736ee tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:32:05.204773 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9471464d-cf5a-45be-806f-031be22736ee tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:32:05.211696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9471464d-cf5a-45be-806f-031be22736ee tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:05.212209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9471464d-cf5a-45be-806f-031be22736ee tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:05.213124 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9471464d-cf5a-45be-806f-031be22736ee tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:05.213577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9471464d-cf5a-45be-806f-031be22736ee tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:05.343551 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9471464d-cf5a-45be-806f-031be22736ee tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:32:05.351462 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9471464d-cf5a-45be-806f-031be22736ee tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.151332 Jul 26 15:32:05.352077 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3522/7160] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:32:05 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:32:06.374521 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-84b614d5-d280-44f3-aa4f-055f10fa5462 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:32:06.375206 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-84b614d5-d280-44f3-aa4f-055f10fa5462 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:32:06.382289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84b614d5-d280-44f3-aa4f-055f10fa5462 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:06.382766 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84b614d5-d280-44f3-aa4f-055f10fa5462 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:06.383566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84b614d5-d280-44f3-aa4f-055f10fa5462 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:06.384086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-84b614d5-d280-44f3-aa4f-055f10fa5462 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:06.525369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-84b614d5-d280-44f3-aa4f-055f10fa5462 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:32:06.534670 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-84b614d5-d280-44f3-aa4f-055f10fa5462 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.164014 Jul 26 15:32:06.535268 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3639/7161] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:32:06 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:32:07.557146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-f3852578-c76e-45dc-8fac-3b0f8f4ec865 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:32:07.557670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-f3852578-c76e-45dc-8fac-3b0f8f4ec865 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:32:07.564697 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3852578-c76e-45dc-8fac-3b0f8f4ec865 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:07.565145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3852578-c76e-45dc-8fac-3b0f8f4ec865 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:07.565906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3852578-c76e-45dc-8fac-3b0f8f4ec865 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:07.566350 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-f3852578-c76e-45dc-8fac-3b0f8f4ec865 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:07.698894 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-f3852578-c76e-45dc-8fac-3b0f8f4ec865 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:32:07.706765 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-f3852578-c76e-45dc-8fac-3b0f8f4ec865 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.154103 Jul 26 15:32:07.707352 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3523/7162] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:32:07 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:32:08.115151 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-d42a5c4e-319a-4721-a9d8-0831acef7ca0 req-643d47c8-bfa1-4c7f-bcd4-e5fc966ed288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593cd72f-0613-42f2-a957-dee0d1b5c455", "name": "network-vif-plugged", "status": "completed", "tag": "e3551465-8c5d-4192-9ff9-b06a72213560"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:32:08.126824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d42a5c4e-319a-4721-a9d8-0831acef7ca0 req-643d47c8-bfa1-4c7f-bcd4-e5fc966ed288 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:08.129402 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-d42a5c4e-319a-4721-a9d8-0831acef7ca0 req-643d47c8-bfa1-4c7f-bcd4-e5fc966ed288 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:08.140005 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-d42a5c4e-319a-4721-a9d8-0831acef7ca0 req-643d47c8-bfa1-4c7f-bcd4-e5fc966ed288 service nova] Creating event network-vif-plugged:e3551465-8c5d-4192-9ff9-b06a72213560 for instance 593cd72f-0613-42f2-a957-dee0d1b5c455 on n-h2-833090-9 Jul 26 15:32:08.145375 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-d42a5c4e-319a-4721-a9d8-0831acef7ca0 req-643d47c8-bfa1-4c7f-bcd4-e5fc966ed288 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033947 Jul 26 15:32:08.146018 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3640/7163] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:32:08.729393 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-35043235-e8e4-484c-846e-2da61aeb04cc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:32:08.730232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-35043235-e8e4-484c-846e-2da61aeb04cc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:32:08.737521 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35043235-e8e4-484c-846e-2da61aeb04cc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:08.737965 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35043235-e8e4-484c-846e-2da61aeb04cc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:08.738749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35043235-e8e4-484c-846e-2da61aeb04cc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:08.739200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-35043235-e8e4-484c-846e-2da61aeb04cc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:08.887302 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-35043235-e8e4-484c-846e-2da61aeb04cc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:32:08.894881 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-35043235-e8e4-484c-846e-2da61aeb04cc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.169661 Jul 26 15:32:08.895454 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3524/7164] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:32:08 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:32:09.921425 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6de1cd2c-7cef-43e0-82f8-eb94ac1fd3a9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:32:09.922219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6de1cd2c-7cef-43e0-82f8-eb94ac1fd3a9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:32:09.932421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6de1cd2c-7cef-43e0-82f8-eb94ac1fd3a9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:09.932909 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6de1cd2c-7cef-43e0-82f8-eb94ac1fd3a9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:09.933768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6de1cd2c-7cef-43e0-82f8-eb94ac1fd3a9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:09.934216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6de1cd2c-7cef-43e0-82f8-eb94ac1fd3a9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:10.079024 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6de1cd2c-7cef-43e0-82f8-eb94ac1fd3a9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:32:10.086674 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6de1cd2c-7cef-43e0-82f8-eb94ac1fd3a9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1687 microversion: 2.1 time: 0.173082 Jul 26 15:32:10.087715 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3641/7165] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:32:09 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:32:11.109533 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-928ef073-ae5c-460d-a8cd-856232d68288 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:32:11.110151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-928ef073-ae5c-460d-a8cd-856232d68288 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:32:11.116556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-928ef073-ae5c-460d-a8cd-856232d68288 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:11.117030 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-928ef073-ae5c-460d-a8cd-856232d68288 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:11.117940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-928ef073-ae5c-460d-a8cd-856232d68288 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:32:11.119142 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-928ef073-ae5c-460d-a8cd-856232d68288 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:32:11.261136 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-928ef073-ae5c-460d-a8cd-856232d68288 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:32:11.269366 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-928ef073-ae5c-460d-a8cd-856232d68288 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1674 microversion: 2.1 time: 0.164665 Jul 26 15:32:11.269954 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3525/7166] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:32:11 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:25.086396 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=13 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:25.087799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=38 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:25.088364 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=15 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:25.089192 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=47 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:25.092566 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5661f66c-007a-4ff1-9254-7cc53643328c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:25.093196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5661f66c-007a-4ff1-9254-7cc53643328c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:25.094798 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-dce59f95-7d40-4e73-9381-dde152e0919b req-0c46b5f3-12b5-4ca3-a817-eafe4261825f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593cd72f-0613-42f2-a957-dee0d1b5c455", "tag": "e3551465-8c5d-4192-9ff9-b06a72213560"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:33:25.100894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5661f66c-007a-4ff1-9254-7cc53643328c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:25.101449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5661f66c-007a-4ff1-9254-7cc53643328c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:25.102323 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5661f66c-007a-4ff1-9254-7cc53643328c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:25.102867 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5661f66c-007a-4ff1-9254-7cc53643328c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:25.107358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-dce59f95-7d40-4e73-9381-dde152e0919b req-0c46b5f3-12b5-4ca3-a817-eafe4261825f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:25.107689 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-dce59f95-7d40-4e73-9381-dde152e0919b req-0c46b5f3-12b5-4ca3-a817-eafe4261825f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:25.119347 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-dce59f95-7d40-4e73-9381-dde152e0919b req-0c46b5f3-12b5-4ca3-a817-eafe4261825f service nova] Creating event network-changed:e3551465-8c5d-4192-9ff9-b06a72213560 for instance 593cd72f-0613-42f2-a957-dee0d1b5c455 on n-h2-833090-9 Jul 26 15:33:25.132228 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-dce59f95-7d40-4e73-9381-dde152e0919b req-0c46b5f3-12b5-4ca3-a817-eafe4261825f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045692 Jul 26 15:33:25.133179 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3526/7167] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:33:25.133934 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5661f66c-007a-4ff1-9254-7cc53643328c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:33:25.232389 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5661f66c-007a-4ff1-9254-7cc53643328c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 204 len: 0 microversion: 2.1 time: 0.148005 Jul 26 15:33:25.233307 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3642/7168] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:33:25 2022] DELETE /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:33:25.242334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-dcfa122f-8dd1-45d4-9525-5bb0af56c04c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:25.243056 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-dcfa122f-8dd1-45d4-9525-5bb0af56c04c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:25.250525 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcfa122f-8dd1-45d4-9525-5bb0af56c04c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:25.250981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcfa122f-8dd1-45d4-9525-5bb0af56c04c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:25.251791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcfa122f-8dd1-45d4-9525-5bb0af56c04c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:25.252314 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-dcfa122f-8dd1-45d4-9525-5bb0af56c04c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:25.488469 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-dcfa122f-8dd1-45d4-9525-5bb0af56c04c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:25.496357 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-dcfa122f-8dd1-45d4-9525-5bb0af56c04c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.258191 Jul 26 15:33:25.497032 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3527/7169] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:25 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:26.518534 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c44a1968-0857-48f5-952e-3128e2a3dac9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:26.519176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c44a1968-0857-48f5-952e-3128e2a3dac9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:26.527292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c44a1968-0857-48f5-952e-3128e2a3dac9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:26.527769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c44a1968-0857-48f5-952e-3128e2a3dac9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:26.529423 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c44a1968-0857-48f5-952e-3128e2a3dac9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:26.529938 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c44a1968-0857-48f5-952e-3128e2a3dac9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:26.919824 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c44a1968-0857-48f5-952e-3128e2a3dac9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:26.928202 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c44a1968-0857-48f5-952e-3128e2a3dac9 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 200 len: 1680 microversion: 2.1 time: 0.414172 Jul 26 15:33:26.928797 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3643/7170] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:26 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 1680 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:27.299710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3bedd84e-9d5c-4cf8-a861-facbc888cfc2 req-7b0d8dc0-3958-42fb-994b-7184266b4a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593cd72f-0613-42f2-a957-dee0d1b5c455", "name": "network-vif-deleted", "tag": "e3551465-8c5d-4192-9ff9-b06a72213560"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:33:27.311548 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3bedd84e-9d5c-4cf8-a861-facbc888cfc2 req-7b0d8dc0-3958-42fb-994b-7184266b4a80 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:27.312077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3bedd84e-9d5c-4cf8-a861-facbc888cfc2 req-7b0d8dc0-3958-42fb-994b-7184266b4a80 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:27.326951 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-3bedd84e-9d5c-4cf8-a861-facbc888cfc2 req-7b0d8dc0-3958-42fb-994b-7184266b4a80 service nova] Creating event network-vif-deleted:e3551465-8c5d-4192-9ff9-b06a72213560 for instance 593cd72f-0613-42f2-a957-dee0d1b5c455 on n-h2-833090-9 Jul 26 15:33:27.332023 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3bedd84e-9d5c-4cf8-a861-facbc888cfc2 req-7b0d8dc0-3958-42fb-994b-7184266b4a80 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036994 Jul 26 15:33:27.332623 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3528/7171] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:33:27.949219 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-778308be-49ba-43a9-b381-b0b151c0345d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:27.950212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-778308be-49ba-43a9-b381-b0b151c0345d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 593cd72f-0613-42f2-a957-dee0d1b5c455] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:27.957301 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-778308be-49ba-43a9-b381-b0b151c0345d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:27.957764 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-778308be-49ba-43a9-b381-b0b151c0345d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:27.958541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-778308be-49ba-43a9-b381-b0b151c0345d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:27.958996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-778308be-49ba-43a9-b381-b0b151c0345d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:27.973081 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.wsgi [None req-778308be-49ba-43a9-b381-b0b151c0345d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] HTTP exception thrown: Instance 593cd72f-0613-42f2-a957-dee0d1b5c455 could not be found. Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-778308be-49ba-43a9-b381-b0b151c0345d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Request method failure captured: Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: request: GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 HTTP/1.1 Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: Accept: application/json Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: Accept-Encoding: identity Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: Connection: close Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: Content-Length: 0 Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: Content-Type: application/json Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: Host: 10.222.0.70 Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: Openstack-System-Scope: None Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: User-Agent: python-urllib3/1.26.10 Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Auth-Token: gAAAAABi4AhFHd8b8J5X5HPeC9ze5r4-SyaCZdjlQADfWEL-Zc-vF6PYQxV9i-I5JDXzGz8w-BbXtgXICoNrxQaU3e4dN0IFMRLqZN-HlqtHYujlotvWxrYV93rsG321LgT0ek6oiwTZwuLRvGNoPsyVv1RTQNoo5tEpUkVoV0RShI99510tuec Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Id: None Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Domain-Name: None Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Identity-Status: Confirmed Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Is-Admin-Project: True Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Id: default Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Domain-Name: Default Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Id: 179a71165aad4b879c2fb1e742d8c483 Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Project-Name: tempest-TestShelveInstance-159911206 Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Role: member,reader Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Roles: member,reader Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/179a71165aad4b879c2fb1e742d8c483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/179a71165aad4b879c2fb1e742d8c483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_179a71165aad4b879c2fb1e742d8c483", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/179a71165aad4b879c2fb1e742d8c483"}]}] Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant: tempest-TestShelveInstance-159911206 Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Id: 179a71165aad4b879c2fb1e742d8c483 Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-Tenant-Name: tempest-TestShelveInstance-159911206 Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-User: tempest-TestShelveInstance-159911206-project Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Id: default Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-User-Domain-Name: Default Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-User-Id: bbe352dfd6dd4e98baf11a9821d4d030 Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: X-User-Name: tempest-TestShelveInstance-159911206-project Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: method: > Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: exception: Instance 593cd72f-0613-42f2-a957-dee0d1b5c455 could not be found. Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: action_args: {'id': '593cd72f-0613-42f2-a957-dee0d1b5c455'} Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 593cd72f-0613-42f2-a957-dee0d1b5c455 could not be found. Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 593cd72f-0613-42f2-a957-dee0d1b5c455 could not be found. Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:33:27.974758 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:33:27.979832 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:33:27.979832 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:33:27.979832 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:33:27.979832 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:33:27.979832 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:33:27.979832 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 593cd72f-0613-42f2-a957-dee0d1b5c455 could not be found. Jul 26 15:33:27.979832 n-d-833090-9 devstack@n-api.service[119479]: ERROR nova.api.openstack.wsgi Jul 26 15:33:27.979832 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-778308be-49ba-43a9-b381-b0b151c0345d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Returning 404 to user: Instance 593cd72f-0613-42f2-a957-dee0d1b5c455 could not be found. {{(pid=119479) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:33:27.979832 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-778308be-49ba-43a9-b381-b0b151c0345d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455" status: 404 len: 111 microversion: 2.1 time: 0.030988 Jul 26 15:33:27.979832 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3644/7172] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:27 2022] GET /compute/v2.1/servers/593cd72f-0613-42f2-a957-dee0d1b5c455 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:33:28.152644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-eec1674b-2c4b-4905-9c2b-f805c2271db7 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '.version_select at 0x7f87993adaf0>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:28.175328 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-eec1674b-2c4b-4905-9c2b-f805c2271db7 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1544210520" status: 202 len: 0 microversion: 2.1 time: 0.027011 Jul 26 15:33:28.176022 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3529/7173] 10.222.0.70 () {58 vars in 1254 bytes} [Tue Jul 26 15:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1544210520 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:33:28.205741 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6114e8c7-0e70-4087-aaf6-b38717442edc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Action: 'create', calling method: .version_select at 0x7f8787faa820>, body: {"keypair": {"name": "tempest-TestShelveInstance-443416191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsLE0eV5tGdE0UVo25nOF0WzlxFSsVa3RlcQgNCb1Bn4A+tG3o4EIc+C8a0EnYTUvnpzrtK9YPjEVXi2bAboN48zonjahXggRDxHV5SdkLM3FLVZHmXPJdrCpuy0dOD+w=="}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:33:28.221948 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-6114e8c7-0e70-4087-aaf6-b38717442edc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Getting quotas for project 179a71165aad4b879c2fb1e742d8c483. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:33:28.227124 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-6114e8c7-0e70-4087-aaf6-b38717442edc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Getting quotas for user bbe352dfd6dd4e98baf11a9821d4d030 and project 179a71165aad4b879c2fb1e742d8c483. Resources: {'key_pairs'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:33:28.253342 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6114e8c7-0e70-4087-aaf6-b38717442edc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.051427 Jul 26 15:33:28.253947 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3645/7174] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:33:28 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:33:44.451227 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-93527095", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-443416191", "security_groups": [{"name": "tempest-secgroup-smoke-1538976698"}], "networks": [{"uuid": "6fd1eb48-dd9d-4f88-93ce-c7913942e5b5"}], "block_device_mapping_v2": [{"uuid": "d3571d44-54ae-4cef-b085-b8ae09648b9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:33:44.467215 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=10 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:44.467882 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:44.608221 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.network.neutron [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] validate_networks() for [('6fd1eb48-dd9d-4f88-93ce-c7913942e5b5', None, None, None, None, None)] {{(pid=119478) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:33:45.057308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Flavor limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:33:45.057743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Image limits 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:33:45.058235 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Flavor pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:33:45.058655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Image pref 0:0:0 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:33:45.059844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.virt.hardware [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119478) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:33:45.068885 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:45.069343 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:45.070151 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:45.070603 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:45.093317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Getting quotas for project 179a71165aad4b879c2fb1e742d8c483. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:33:45.100915 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Getting quotas for user bbe352dfd6dd4e98baf11a9821d4d030 and project 179a71165aad4b879c2fb1e742d8c483. Resources: {'ram', 'instances', 'cores'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:33:45.161400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Going to run 1 instances... {{(pid=119478) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:33:45.163662 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3571d44-54ae-4cef-b085-b8ae09648b9a',volume_size=None,volume_type=None)] {{(pid=119478) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:33:45.305355 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aee3b905-4816-4b95-80d0-4f78861c0d16 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.860287 Jul 26 15:33:45.312203 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3530/7175] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:33:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:33:45.317631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1bdfeaf4-4939-4c9a-a789-dcb3bad079d5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:45.318269 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1bdfeaf4-4939-4c9a-a789-dcb3bad079d5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:45.320799 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:45.321556 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=4 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:45.322360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:45.384428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1bdfeaf4-4939-4c9a-a789-dcb3bad079d5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:45.394421 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1bdfeaf4-4939-4c9a-a789-dcb3bad079d5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1086 microversion: 2.1 time: 0.080219 Jul 26 15:33:45.396078 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3646/7176] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:45 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1086 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:46.417264 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-509baa04-cdb5-448b-ba66-0b7c5ecb1f9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:46.418002 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-509baa04-cdb5-448b-ba66-0b7c5ecb1f9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:46.432466 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-509baa04-cdb5-448b-ba66-0b7c5ecb1f9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:46.432924 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-509baa04-cdb5-448b-ba66-0b7c5ecb1f9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:46.434724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-509baa04-cdb5-448b-ba66-0b7c5ecb1f9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:46.434909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-509baa04-cdb5-448b-ba66-0b7c5ecb1f9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:46.500901 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-509baa04-cdb5-448b-ba66-0b7c5ecb1f9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:46.509095 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-509baa04-cdb5-448b-ba66-0b7c5ecb1f9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1202 microversion: 2.1 time: 0.096493 Jul 26 15:33:46.509817 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3531/7177] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:46 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:47.534821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8ed321e9-e50a-4d25-b841-ae41db61ea9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:47.536744 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8ed321e9-e50a-4d25-b841-ae41db61ea9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:47.560136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ed321e9-e50a-4d25-b841-ae41db61ea9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:47.561342 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ed321e9-e50a-4d25-b841-ae41db61ea9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:47.562230 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ed321e9-e50a-4d25-b841-ae41db61ea9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:47.562695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8ed321e9-e50a-4d25-b841-ae41db61ea9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:47.725229 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8ed321e9-e50a-4d25-b841-ae41db61ea9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:47.735708 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8ed321e9-e50a-4d25-b841-ae41db61ea9d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1270 microversion: 2.1 time: 0.208557 Jul 26 15:33:47.748915 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3647/7178] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:47 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:47.877351 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-7b733bed-a0ab-404d-a706-38c20b46df77 req-05369e75-f0fa-4b89-a1c8-fc24b92195c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023c3562-656b-4335-94c0-2add1ce4ee16", "tag": "41e89e07-b1e5-47f3-b840-f13a6990114c"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:33:47.895791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7b733bed-a0ab-404d-a706-38c20b46df77 req-05369e75-f0fa-4b89-a1c8-fc24b92195c4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:47.896569 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-7b733bed-a0ab-404d-a706-38c20b46df77 req-05369e75-f0fa-4b89-a1c8-fc24b92195c4 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:47.913891 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-7b733bed-a0ab-404d-a706-38c20b46df77 req-05369e75-f0fa-4b89-a1c8-fc24b92195c4 service nova] Creating event network-changed:41e89e07-b1e5-47f3-b840-f13a6990114c for instance 023c3562-656b-4335-94c0-2add1ce4ee16 on n-h1-833090-9 Jul 26 15:33:47.920721 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-7b733bed-a0ab-404d-a706-38c20b46df77 req-05369e75-f0fa-4b89-a1c8-fc24b92195c4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139278 Jul 26 15:33:47.922757 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3532/7179] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:33:48.758690 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-e2b8a3b3-9057-42a7-9228-f84843b86144 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:48.760765 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-e2b8a3b3-9057-42a7-9228-f84843b86144 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:48.770615 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2b8a3b3-9057-42a7-9228-f84843b86144 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:48.771097 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2b8a3b3-9057-42a7-9228-f84843b86144 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:48.771912 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2b8a3b3-9057-42a7-9228-f84843b86144 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:48.772411 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-e2b8a3b3-9057-42a7-9228-f84843b86144 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:48.911686 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-e2b8a3b3-9057-42a7-9228-f84843b86144 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:48.920173 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-e2b8a3b3-9057-42a7-9228-f84843b86144 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1270 microversion: 2.1 time: 0.167126 Jul 26 15:33:48.920858 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3648/7180] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:48 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:49.942564 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2a19a288-43f0-4107-9c82-2ae10bbb7445 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:49.943262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2a19a288-43f0-4107-9c82-2ae10bbb7445 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:49.950369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a19a288-43f0-4107-9c82-2ae10bbb7445 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:49.950822 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a19a288-43f0-4107-9c82-2ae10bbb7445 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:49.951587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a19a288-43f0-4107-9c82-2ae10bbb7445 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:49.952054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2a19a288-43f0-4107-9c82-2ae10bbb7445 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:50.092484 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2a19a288-43f0-4107-9c82-2ae10bbb7445 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:50.100063 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2a19a288-43f0-4107-9c82-2ae10bbb7445 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1270 microversion: 2.1 time: 0.162745 Jul 26 15:33:50.100839 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3533/7181] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:49 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:51.122292 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-27905092-1449-4d21-abba-f79779d4d7e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:51.123052 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-27905092-1449-4d21-abba-f79779d4d7e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:51.130410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27905092-1449-4d21-abba-f79779d4d7e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:51.130880 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27905092-1449-4d21-abba-f79779d4d7e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:51.131685 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27905092-1449-4d21-abba-f79779d4d7e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:51.132169 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-27905092-1449-4d21-abba-f79779d4d7e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:51.271316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-27905092-1449-4d21-abba-f79779d4d7e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:51.280490 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-27905092-1449-4d21-abba-f79779d4d7e4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1270 microversion: 2.1 time: 0.162541 Jul 26 15:33:51.281175 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3649/7182] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:51 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:52.303138 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-931f0f28-85f0-40fb-abdc-d14be04e1b89 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:52.303683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-931f0f28-85f0-40fb-abdc-d14be04e1b89 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:52.310886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-931f0f28-85f0-40fb-abdc-d14be04e1b89 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:52.311342 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-931f0f28-85f0-40fb-abdc-d14be04e1b89 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:52.312161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-931f0f28-85f0-40fb-abdc-d14be04e1b89 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:52.312606 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-931f0f28-85f0-40fb-abdc-d14be04e1b89 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:52.445405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-931f0f28-85f0-40fb-abdc-d14be04e1b89 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:52.453957 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-931f0f28-85f0-40fb-abdc-d14be04e1b89 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1258 microversion: 2.1 time: 0.155180 Jul 26 15:33:52.454527 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3534/7183] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:52 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:53.475839 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bc74545a-5592-4de7-acfd-14989d2c27da tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:53.476501 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bc74545a-5592-4de7-acfd-14989d2c27da tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:53.484584 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc74545a-5592-4de7-acfd-14989d2c27da tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:53.485054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc74545a-5592-4de7-acfd-14989d2c27da tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:53.485835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc74545a-5592-4de7-acfd-14989d2c27da tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:53.486295 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bc74545a-5592-4de7-acfd-14989d2c27da tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:53.626627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bc74545a-5592-4de7-acfd-14989d2c27da tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:53.634363 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bc74545a-5592-4de7-acfd-14989d2c27da tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1258 microversion: 2.1 time: 0.162412 Jul 26 15:33:53.634948 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3650/7184] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:53 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:54.654762 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-853f69be-2f89-4688-b9d7-c7cb3fa818c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:54.655399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-853f69be-2f89-4688-b9d7-c7cb3fa818c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:54.663178 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-853f69be-2f89-4688-b9d7-c7cb3fa818c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:54.663639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-853f69be-2f89-4688-b9d7-c7cb3fa818c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:54.664442 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-853f69be-2f89-4688-b9d7-c7cb3fa818c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:54.664883 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-853f69be-2f89-4688-b9d7-c7cb3fa818c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:54.799599 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-853f69be-2f89-4688-b9d7-c7cb3fa818c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:54.807399 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-853f69be-2f89-4688-b9d7-c7cb3fa818c1 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1258 microversion: 2.1 time: 0.156585 Jul 26 15:33:54.808056 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3535/7185] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:54 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:55.828840 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9c554c78-d5a6-4e96-926f-68fea901b68b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:55.829400 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9c554c78-d5a6-4e96-926f-68fea901b68b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:55.832240 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:55.838048 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c554c78-d5a6-4e96-926f-68fea901b68b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:55.838524 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c554c78-d5a6-4e96-926f-68fea901b68b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:55.839309 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c554c78-d5a6-4e96-926f-68fea901b68b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:55.839863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c554c78-d5a6-4e96-926f-68fea901b68b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:55.977760 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9c554c78-d5a6-4e96-926f-68fea901b68b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:55.985530 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9c554c78-d5a6-4e96-926f-68fea901b68b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1258 microversion: 2.1 time: 0.161612 Jul 26 15:33:55.986110 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3651/7186] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:55 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:57.006255 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-9e2b4e10-00cd-425a-9ab9-cd7281d99cff tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:57.006905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-9e2b4e10-00cd-425a-9ab9-cd7281d99cff tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:57.009075 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:57.009884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:33:57.017276 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e2b4e10-00cd-425a-9ab9-cd7281d99cff tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:57.017723 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e2b4e10-00cd-425a-9ab9-cd7281d99cff tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:57.018487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e2b4e10-00cd-425a-9ab9-cd7281d99cff tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:57.018920 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-9e2b4e10-00cd-425a-9ab9-cd7281d99cff tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:57.155410 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-9e2b4e10-00cd-425a-9ab9-cd7281d99cff tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:57.162871 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-9e2b4e10-00cd-425a-9ab9-cd7281d99cff tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1258 microversion: 2.1 time: 0.160572 Jul 26 15:33:57.163456 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3536/7187] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:57 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:58.187743 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-0fa27d60-3882-4dc6-abf1-fc13a217dee0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:58.188428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-0fa27d60-3882-4dc6-abf1-fc13a217dee0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:58.195363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0fa27d60-3882-4dc6-abf1-fc13a217dee0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:58.195831 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0fa27d60-3882-4dc6-abf1-fc13a217dee0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:58.196653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0fa27d60-3882-4dc6-abf1-fc13a217dee0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:58.197172 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-0fa27d60-3882-4dc6-abf1-fc13a217dee0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:58.334234 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-0fa27d60-3882-4dc6-abf1-fc13a217dee0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:58.343209 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-0fa27d60-3882-4dc6-abf1-fc13a217dee0 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1258 microversion: 2.1 time: 0.159397 Jul 26 15:33:58.343816 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3652/7188] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:58 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:33:59.365106 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a74d7acd-dad2-4324-8f5d-92d51a5d9196 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:33:59.365745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a74d7acd-dad2-4324-8f5d-92d51a5d9196 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:33:59.373007 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a74d7acd-dad2-4324-8f5d-92d51a5d9196 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:59.373454 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a74d7acd-dad2-4324-8f5d-92d51a5d9196 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:59.374214 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a74d7acd-dad2-4324-8f5d-92d51a5d9196 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:33:59.374647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a74d7acd-dad2-4324-8f5d-92d51a5d9196 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:33:59.509112 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-a74d7acd-dad2-4324-8f5d-92d51a5d9196 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:33:59.517195 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a74d7acd-dad2-4324-8f5d-92d51a5d9196 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1258 microversion: 2.1 time: 0.156079 Jul 26 15:33:59.517760 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3537/7189] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:33:59 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:34:00.538538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ec99789c-c6ea-451c-8a3c-8a04f170372b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:34:00.539175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ec99789c-c6ea-451c-8a3c-8a04f170372b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:34:00.546998 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec99789c-c6ea-451c-8a3c-8a04f170372b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:00.547471 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec99789c-c6ea-451c-8a3c-8a04f170372b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:00.548299 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec99789c-c6ea-451c-8a3c-8a04f170372b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:00.548762 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ec99789c-c6ea-451c-8a3c-8a04f170372b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:00.687777 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ec99789c-c6ea-451c-8a3c-8a04f170372b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:34:00.695357 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ec99789c-c6ea-451c-8a3c-8a04f170372b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1258 microversion: 2.1 time: 0.160775 Jul 26 15:34:00.695932 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3653/7190] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:34:00 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:34:01.718005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-27afe572-356b-46c1-afc2-61769192d579 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:34:01.719080 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-27afe572-356b-46c1-afc2-61769192d579 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:34:01.727862 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27afe572-356b-46c1-afc2-61769192d579 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:01.728363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27afe572-356b-46c1-afc2-61769192d579 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:01.729147 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27afe572-356b-46c1-afc2-61769192d579 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:01.729596 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-27afe572-356b-46c1-afc2-61769192d579 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:01.865571 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-27afe572-356b-46c1-afc2-61769192d579 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:34:01.874170 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-27afe572-356b-46c1-afc2-61769192d579 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1258 microversion: 2.1 time: 0.161525 Jul 26 15:34:01.874755 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3538/7191] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:34:01 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:34:02.004351 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a65efaab-c824-4713-8a03-dbcf1579c613 req-326283c7-2c4a-4299-9ca7-f2c9ca2a17a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023c3562-656b-4335-94c0-2add1ce4ee16", "name": "network-vif-plugged", "status": "completed", "tag": "41e89e07-b1e5-47f3-b840-f13a6990114c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:34:02.017065 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a65efaab-c824-4713-8a03-dbcf1579c613 req-326283c7-2c4a-4299-9ca7-f2c9ca2a17a9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:02.017623 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a65efaab-c824-4713-8a03-dbcf1579c613 req-326283c7-2c4a-4299-9ca7-f2c9ca2a17a9 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:02.030136 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a65efaab-c824-4713-8a03-dbcf1579c613 req-326283c7-2c4a-4299-9ca7-f2c9ca2a17a9 service nova] Creating event network-vif-plugged:41e89e07-b1e5-47f3-b840-f13a6990114c for instance 023c3562-656b-4335-94c0-2add1ce4ee16 on n-h1-833090-9 Jul 26 15:34:02.035435 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a65efaab-c824-4713-8a03-dbcf1579c613 req-326283c7-2c4a-4299-9ca7-f2c9ca2a17a9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034943 Jul 26 15:34:02.036043 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3654/7192] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:34:02.894817 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fcfb4607-28b5-4249-989d-2de5bcdc099b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:34:02.895438 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fcfb4607-28b5-4249-989d-2de5bcdc099b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:34:02.902987 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcfb4607-28b5-4249-989d-2de5bcdc099b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:02.903590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcfb4607-28b5-4249-989d-2de5bcdc099b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:02.904381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcfb4607-28b5-4249-989d-2de5bcdc099b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:02.904821 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fcfb4607-28b5-4249-989d-2de5bcdc099b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:03.040679 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fcfb4607-28b5-4249-989d-2de5bcdc099b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:34:03.048460 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fcfb4607-28b5-4249-989d-2de5bcdc099b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1258 microversion: 2.1 time: 0.157472 Jul 26 15:34:03.049040 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3539/7193] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:34:02 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:34:04.069978 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-68c9a6d3-2769-44a9-bcb9-2d0b9dbb5ee2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:34:04.070712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-68c9a6d3-2769-44a9-bcb9-2d0b9dbb5ee2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:34:04.078107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68c9a6d3-2769-44a9-bcb9-2d0b9dbb5ee2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:04.078586 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68c9a6d3-2769-44a9-bcb9-2d0b9dbb5ee2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:04.079383 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68c9a6d3-2769-44a9-bcb9-2d0b9dbb5ee2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:04.079852 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-68c9a6d3-2769-44a9-bcb9-2d0b9dbb5ee2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:04.215353 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-68c9a6d3-2769-44a9-bcb9-2d0b9dbb5ee2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:34:04.223241 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-68c9a6d3-2769-44a9-bcb9-2d0b9dbb5ee2 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1442 microversion: 2.1 time: 0.157596 Jul 26 15:34:04.223832 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3655/7194] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:34:04 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:34:04.244670 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b64af4ae-9601-49d7-ae81-ee509412a9c5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:34:04.245347 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b64af4ae-9601-49d7-ae81-ee509412a9c5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:34:04.252436 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b64af4ae-9601-49d7-ae81-ee509412a9c5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:04.252922 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b64af4ae-9601-49d7-ae81-ee509412a9c5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:04.253698 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b64af4ae-9601-49d7-ae81-ee509412a9c5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:04.254141 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b64af4ae-9601-49d7-ae81-ee509412a9c5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:04.694910 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-b64af4ae-9601-49d7-ae81-ee509412a9c5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:34:04.703286 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b64af4ae-9601-49d7-ae81-ee509412a9c5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1442 microversion: 2.1 time: 0.463323 Jul 26 15:34:04.703855 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3540/7195] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:34:04 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1442 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:34:06.313926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-274fd119-8281-47d3-866a-e4c7978e9891 req-ab21b588-c348-4765-82e1-e5ba4590aff6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023c3562-656b-4335-94c0-2add1ce4ee16", "tag": "41e89e07-b1e5-47f3-b840-f13a6990114c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:34:06.324976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-274fd119-8281-47d3-866a-e4c7978e9891 req-ab21b588-c348-4765-82e1-e5ba4590aff6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:34:06.325439 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-274fd119-8281-47d3-866a-e4c7978e9891 req-ab21b588-c348-4765-82e1-e5ba4590aff6 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:34:06.337004 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-274fd119-8281-47d3-866a-e4c7978e9891 req-ab21b588-c348-4765-82e1-e5ba4590aff6 service nova] Creating event network-changed:41e89e07-b1e5-47f3-b840-f13a6990114c for instance 023c3562-656b-4335-94c0-2add1ce4ee16 on n-h1-833090-9 Jul 26 15:34:06.342818 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-274fd119-8281-47d3-866a-e4c7978e9891 req-ab21b588-c348-4765-82e1-e5ba4590aff6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032674 Jul 26 15:34:06.343571 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3656/7196] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:34:38.376400 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:34:38.377185 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:34:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:36:01.445883 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7f3ab2a-6e11-4e90-a515-8ef793525f8a] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 15:36:01.446770 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [54fe80fa-5d54-4bb9-a76b-59290c50e610] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 15:36:01.447587 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:01.448357 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=58 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:01.506162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-bbe8ec6b-a515-4c5d-ad36-34956650a302 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:01.506728 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-bbe8ec6b-a515-4c5d-ad36-34956650a302 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:01.513741 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbe8ec6b-a515-4c5d-ad36-34956650a302 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.514196 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbe8ec6b-a515-4c5d-ad36-34956650a302 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.514993 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbe8ec6b-a515-4c5d-ad36-34956650a302 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.515427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-bbe8ec6b-a515-4c5d-ad36-34956650a302 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.538644 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.objects.instance [None req-bbe8ec6b-a515-4c5d-ad36-34956650a302 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lazy-loading 'flavor' on Instance uuid 023c3562-656b-4335-94c0-2add1ce4ee16 {{(pid=119478) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:36:01.612256 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-bbe8ec6b-a515-4c5d-ad36-34956650a302 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "POST /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16/action" status: 202 len: 0 microversion: 2.1 time: 0.167815 Jul 26 15:36:01.612762 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3541/7197] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:36:01 2022] POST /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:36:01.619728 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fcb0ade0-98d2-4d3c-ae6b-59cf589e6dcc] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 15:36:01.624417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-41ad5376-34c6-453f-8e61-629daf1cb0f3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:01.625147 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-41ad5376-34c6-453f-8e61-629daf1cb0f3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:01.627684 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30cc4c1d-189c-4030-802b-dd5549a8f3b2] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 15:36:01.628271 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=24 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:01.628937 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=52 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:01.636985 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41ad5376-34c6-453f-8e61-629daf1cb0f3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.637513 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41ad5376-34c6-453f-8e61-629daf1cb0f3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.638332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41ad5376-34c6-453f-8e61-629daf1cb0f3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:01.638797 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-41ad5376-34c6-453f-8e61-629daf1cb0f3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:01.780707 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-41ad5376-34c6-453f-8e61-629daf1cb0f3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:01.788344 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-41ad5376-34c6-453f-8e61-629daf1cb0f3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.170559 Jul 26 15:36:01.788932 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3657/7198] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:01 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:02.812635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c4ec26ab-3695-4d41-8f61-e2085cdc600c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:02.813236 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c4ec26ab-3695-4d41-8f61-e2085cdc600c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:02.822381 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c4ec26ab-3695-4d41-8f61-e2085cdc600c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:02.822828 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c4ec26ab-3695-4d41-8f61-e2085cdc600c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:02.824198 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c4ec26ab-3695-4d41-8f61-e2085cdc600c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:02.824688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c4ec26ab-3695-4d41-8f61-e2085cdc600c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:02.829952 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] [54fe80fa-5d54-4bb9-a76b-59290c50e610] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 54334. Jul 26 15:36:02.830729 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7f3ab2a-6e11-4e90-a515-8ef793525f8a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 54332. Jul 26 15:36:02.977637 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-c4ec26ab-3695-4d41-8f61-e2085cdc600c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:02.985514 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c4ec26ab-3695-4d41-8f61-e2085cdc600c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.178752 Jul 26 15:36:02.986083 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3542/7199] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:02 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:04.008217 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f64c0ec0-aa8b-4f56-82b6-ff7f4a5fe790 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:04.008846 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f64c0ec0-aa8b-4f56-82b6-ff7f4a5fe790 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:04.019822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f64c0ec0-aa8b-4f56-82b6-ff7f4a5fe790 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:04.020337 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f64c0ec0-aa8b-4f56-82b6-ff7f4a5fe790 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:04.021134 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f64c0ec0-aa8b-4f56-82b6-ff7f4a5fe790 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:04.021594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f64c0ec0-aa8b-4f56-82b6-ff7f4a5fe790 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:04.029857 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] [fcb0ade0-98d2-4d3c-ae6b-59cf589e6dcc] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 54338. Jul 26 15:36:04.040094 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] [30cc4c1d-189c-4030-802b-dd5549a8f3b2] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 54340. Jul 26 15:36:04.158107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f64c0ec0-aa8b-4f56-82b6-ff7f4a5fe790 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:04.165705 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f64c0ec0-aa8b-4f56-82b6-ff7f4a5fe790 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.161666 Jul 26 15:36:04.166279 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3658/7200] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:04 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:05.188781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-1759e74e-2d8c-4c90-8037-7b2d3eda9a39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:05.189408 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-1759e74e-2d8c-4c90-8037-7b2d3eda9a39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:05.196414 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1759e74e-2d8c-4c90-8037-7b2d3eda9a39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.196866 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1759e74e-2d8c-4c90-8037-7b2d3eda9a39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.197639 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1759e74e-2d8c-4c90-8037-7b2d3eda9a39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:05.198079 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-1759e74e-2d8c-4c90-8037-7b2d3eda9a39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:05.334995 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-1759e74e-2d8c-4c90-8037-7b2d3eda9a39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:05.343508 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-1759e74e-2d8c-4c90-8037-7b2d3eda9a39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.158555 Jul 26 15:36:05.344143 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3543/7201] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:05 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:06.365432 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c98ffed1-0edd-4b96-966f-e7633429981a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:06.366008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c98ffed1-0edd-4b96-966f-e7633429981a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:06.374404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c98ffed1-0edd-4b96-966f-e7633429981a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:06.374875 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c98ffed1-0edd-4b96-966f-e7633429981a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:06.375664 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c98ffed1-0edd-4b96-966f-e7633429981a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:06.376150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c98ffed1-0edd-4b96-966f-e7633429981a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:06.508249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c98ffed1-0edd-4b96-966f-e7633429981a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:06.516221 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c98ffed1-0edd-4b96-966f-e7633429981a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.155029 Jul 26 15:36:06.516790 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3659/7202] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:06 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:07.537034 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-34974b6f-0964-4dab-8520-345acce0cbfa tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:07.537647 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-34974b6f-0964-4dab-8520-345acce0cbfa tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:07.544717 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34974b6f-0964-4dab-8520-345acce0cbfa tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:07.545171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34974b6f-0964-4dab-8520-345acce0cbfa tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:07.545932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34974b6f-0964-4dab-8520-345acce0cbfa tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:07.546369 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-34974b6f-0964-4dab-8520-345acce0cbfa tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:07.682027 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-34974b6f-0964-4dab-8520-345acce0cbfa tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:07.690139 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-34974b6f-0964-4dab-8520-345acce0cbfa tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.157204 Jul 26 15:36:07.690709 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3544/7203] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:07 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:08.712355 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-18364762-4632-4942-971d-931d8b66ca39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:08.712927 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-18364762-4632-4942-971d-931d8b66ca39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:08.720529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-18364762-4632-4942-971d-931d8b66ca39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:08.720995 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-18364762-4632-4942-971d-931d8b66ca39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:08.721778 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-18364762-4632-4942-971d-931d8b66ca39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:08.722231 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-18364762-4632-4942-971d-931d8b66ca39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:08.853046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-18364762-4632-4942-971d-931d8b66ca39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:08.860988 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-18364762-4632-4942-971d-931d8b66ca39 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.152776 Jul 26 15:36:08.861562 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3660/7204] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:08 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:09.882964 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5a279e89-a66b-4499-92ec-5e4f0eda29a3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:09.883616 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5a279e89-a66b-4499-92ec-5e4f0eda29a3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:09.891510 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a279e89-a66b-4499-92ec-5e4f0eda29a3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.892003 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a279e89-a66b-4499-92ec-5e4f0eda29a3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:09.892792 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a279e89-a66b-4499-92ec-5e4f0eda29a3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:09.893237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5a279e89-a66b-4499-92ec-5e4f0eda29a3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:10.025327 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5a279e89-a66b-4499-92ec-5e4f0eda29a3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:10.033625 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5a279e89-a66b-4499-92ec-5e4f0eda29a3 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.154852 Jul 26 15:36:10.034210 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3545/7205] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:09 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:11.054769 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-24b5a283-7844-4764-9827-21152bc735f8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:11.055420 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-24b5a283-7844-4764-9827-21152bc735f8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:11.062529 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24b5a283-7844-4764-9827-21152bc735f8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:11.063005 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24b5a283-7844-4764-9827-21152bc735f8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:11.063791 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24b5a283-7844-4764-9827-21152bc735f8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:11.064284 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-24b5a283-7844-4764-9827-21152bc735f8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:11.201096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-24b5a283-7844-4764-9827-21152bc735f8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:11.208932 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-24b5a283-7844-4764-9827-21152bc735f8 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.158380 Jul 26 15:36:11.209569 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3661/7206] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:11 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:12.235313 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-26929841-37a3-40d6-bb6c-3e11c4983cbf tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:12.235991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-26929841-37a3-40d6-bb6c-3e11c4983cbf tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:12.242986 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26929841-37a3-40d6-bb6c-3e11c4983cbf tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:12.243446 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26929841-37a3-40d6-bb6c-3e11c4983cbf tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:12.244321 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26929841-37a3-40d6-bb6c-3e11c4983cbf tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:12.244767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-26929841-37a3-40d6-bb6c-3e11c4983cbf tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:12.387720 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-26929841-37a3-40d6-bb6c-3e11c4983cbf tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:12.397249 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-26929841-37a3-40d6-bb6c-3e11c4983cbf tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.167047 Jul 26 15:36:12.397837 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3546/7207] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:12 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:13.419914 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-528f3a7d-ecdb-46dd-b03e-8cb1c6154104 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:13.420572 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-528f3a7d-ecdb-46dd-b03e-8cb1c6154104 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:13.427716 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-528f3a7d-ecdb-46dd-b03e-8cb1c6154104 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:13.428216 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-528f3a7d-ecdb-46dd-b03e-8cb1c6154104 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:13.429047 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-528f3a7d-ecdb-46dd-b03e-8cb1c6154104 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:13.429445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-528f3a7d-ecdb-46dd-b03e-8cb1c6154104 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:13.565552 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-528f3a7d-ecdb-46dd-b03e-8cb1c6154104 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:13.573256 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-528f3a7d-ecdb-46dd-b03e-8cb1c6154104 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.157521 Jul 26 15:36:13.574410 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3662/7208] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:13 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:14.594984 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2f16ae92-7319-4c5f-a12c-baf90e235b8d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:14.595520 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2f16ae92-7319-4c5f-a12c-baf90e235b8d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:14.602517 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f16ae92-7319-4c5f-a12c-baf90e235b8d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:14.602976 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f16ae92-7319-4c5f-a12c-baf90e235b8d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:14.603766 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f16ae92-7319-4c5f-a12c-baf90e235b8d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:14.604245 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2f16ae92-7319-4c5f-a12c-baf90e235b8d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:14.749749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2f16ae92-7319-4c5f-a12c-baf90e235b8d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:14.758131 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2f16ae92-7319-4c5f-a12c-baf90e235b8d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.167248 Jul 26 15:36:14.758712 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3547/7209] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:14 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:15.780385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-15044f07-3031-4b15-bedf-53dc911486de tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:15.780933 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-15044f07-3031-4b15-bedf-53dc911486de tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:15.787830 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15044f07-3031-4b15-bedf-53dc911486de tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:15.788332 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15044f07-3031-4b15-bedf-53dc911486de tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:15.789118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15044f07-3031-4b15-bedf-53dc911486de tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:15.789573 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-15044f07-3031-4b15-bedf-53dc911486de tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:15.927587 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-15044f07-3031-4b15-bedf-53dc911486de tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:15.935487 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-15044f07-3031-4b15-bedf-53dc911486de tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1567 microversion: 2.1 time: 0.159720 Jul 26 15:36:15.936081 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3663/7210] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:15 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:15.956330 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a05b16c9-4798-4382-9e3d-9378d4b7363b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:15.956916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-a05b16c9-4798-4382-9e3d-9378d4b7363b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:15.963851 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a05b16c9-4798-4382-9e3d-9378d4b7363b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:15.965069 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a05b16c9-4798-4382-9e3d-9378d4b7363b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:15.966135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a05b16c9-4798-4382-9e3d-9378d4b7363b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:15.966580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-a05b16c9-4798-4382-9e3d-9378d4b7363b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:16.052804 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a05b16c9-4798-4382-9e3d-9378d4b7363b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "POST /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16/action" status: 202 len: 0 microversion: 2.1 time: 0.100388 Jul 26 15:36:16.053498 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3548/7211] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:36:15 2022] POST /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:36:16.063054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cb61bfc8-c55a-4475-a96d-fe21e266fcdc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:16.063698 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cb61bfc8-c55a-4475-a96d-fe21e266fcdc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:16.069783 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb61bfc8-c55a-4475-a96d-fe21e266fcdc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:16.070263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb61bfc8-c55a-4475-a96d-fe21e266fcdc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:16.071056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb61bfc8-c55a-4475-a96d-fe21e266fcdc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:16.071518 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cb61bfc8-c55a-4475-a96d-fe21e266fcdc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:16.253456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-cb61bfc8-c55a-4475-a96d-fe21e266fcdc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:16.261224 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cb61bfc8-c55a-4475-a96d-fe21e266fcdc tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1515 microversion: 2.1 time: 0.202895 Jul 26 15:36:16.261802 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3664/7212] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:16 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:17.284667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-54cabce1-fe15-4532-b7a7-025bc467e04b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:17.285295 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-54cabce1-fe15-4532-b7a7-025bc467e04b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:17.291704 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54cabce1-fe15-4532-b7a7-025bc467e04b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:17.292897 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54cabce1-fe15-4532-b7a7-025bc467e04b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:17.293833 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54cabce1-fe15-4532-b7a7-025bc467e04b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:17.294283 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-54cabce1-fe15-4532-b7a7-025bc467e04b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:17.443428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-54cabce1-fe15-4532-b7a7-025bc467e04b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:17.452190 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-54cabce1-fe15-4532-b7a7-025bc467e04b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1517 microversion: 2.1 time: 0.172667 Jul 26 15:36:17.452765 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3549/7213] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:17 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:18.331927 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:36:18.332399 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:36:18.474726 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9c9dab37-902c-4946-9533-8046267d25c7 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:18.475363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9c9dab37-902c-4946-9533-8046267d25c7 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:18.483222 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c9dab37-902c-4946-9533-8046267d25c7 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:18.483695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c9dab37-902c-4946-9533-8046267d25c7 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:18.484547 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c9dab37-902c-4946-9533-8046267d25c7 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:18.485004 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9c9dab37-902c-4946-9533-8046267d25c7 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:18.487061 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:36:18.488024 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:36:18.600161 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-3185ba5e-f315-4721-bc8a-c3e06ad6cf76 req-bfd3df57-8b2c-4746-b415-32548da6f1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023c3562-656b-4335-94c0-2add1ce4ee16", "name": "network-vif-unplugged", "status": "completed", "tag": "41e89e07-b1e5-47f3-b840-f13a6990114c"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:18.615660 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3185ba5e-f315-4721-bc8a-c3e06ad6cf76 req-bfd3df57-8b2c-4746-b415-32548da6f1ca service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:18.616262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-3185ba5e-f315-4721-bc8a-c3e06ad6cf76 req-bfd3df57-8b2c-4746-b415-32548da6f1ca service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:18.629289 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.compute.server_external_events [req-3185ba5e-f315-4721-bc8a-c3e06ad6cf76 req-bfd3df57-8b2c-4746-b415-32548da6f1ca service nova] Unable to find a host for instance 023c3562-656b-4335-94c0-2add1ce4ee16. Dropping event network-vif-unplugged {{(pid=119478) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 15:36:18.630337 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-3185ba5e-f315-4721-bc8a-c3e06ad6cf76 req-bfd3df57-8b2c-4746-b415-32548da6f1ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036417 Jul 26 15:36:18.631025 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3550/7214] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 15:36:18.640631 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9c9dab37-902c-4946-9533-8046267d25c7 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:18.650226 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9c9dab37-902c-4946-9533-8046267d25c7 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1517 microversion: 2.1 time: 0.179610 Jul 26 15:36:18.651010 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3665/7215] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:18 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:19.673105 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-7674ae38-1f54-4090-9493-463058083b79 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:19.673729 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-7674ae38-1f54-4090-9493-463058083b79 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:19.681071 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7674ae38-1f54-4090-9493-463058083b79 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:19.681523 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7674ae38-1f54-4090-9493-463058083b79 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:19.682298 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7674ae38-1f54-4090-9493-463058083b79 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:19.683299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-7674ae38-1f54-4090-9493-463058083b79 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:19.821120 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-7674ae38-1f54-4090-9493-463058083b79 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:19.829377 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-7674ae38-1f54-4090-9493-463058083b79 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1517 microversion: 2.1 time: 0.160152 Jul 26 15:36:19.829981 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3551/7216] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:19 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:20.852903 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-d7ae9738-5471-4809-a1cf-a610c3e1a66b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:20.853456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-d7ae9738-5471-4809-a1cf-a610c3e1a66b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:20.860817 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7ae9738-5471-4809-a1cf-a610c3e1a66b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:20.861289 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7ae9738-5471-4809-a1cf-a610c3e1a66b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:20.862093 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7ae9738-5471-4809-a1cf-a610c3e1a66b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:20.862557 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-d7ae9738-5471-4809-a1cf-a610c3e1a66b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:21.002385 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-d7ae9738-5471-4809-a1cf-a610c3e1a66b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:21.010152 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-d7ae9738-5471-4809-a1cf-a610c3e1a66b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1517 microversion: 2.1 time: 0.161325 Jul 26 15:36:21.011056 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3666/7217] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:20 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:22.032337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ef0ee118-e83f-452a-bcdc-c0a9be521214 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:22.032906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ef0ee118-e83f-452a-bcdc-c0a9be521214 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:22.039826 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0ee118-e83f-452a-bcdc-c0a9be521214 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:22.040317 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0ee118-e83f-452a-bcdc-c0a9be521214 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:22.041098 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0ee118-e83f-452a-bcdc-c0a9be521214 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:22.041556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ef0ee118-e83f-452a-bcdc-c0a9be521214 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:22.182341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ef0ee118-e83f-452a-bcdc-c0a9be521214 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:22.190989 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ef0ee118-e83f-452a-bcdc-c0a9be521214 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1573 microversion: 2.1 time: 0.162887 Jul 26 15:36:22.191578 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3552/7218] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:22 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:23.212638 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a4d2ebaa-9f86-4411-882b-be24367b9a1d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:23.213283 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a4d2ebaa-9f86-4411-882b-be24367b9a1d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:23.220838 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4d2ebaa-9f86-4411-882b-be24367b9a1d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:23.221321 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4d2ebaa-9f86-4411-882b-be24367b9a1d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:23.222117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4d2ebaa-9f86-4411-882b-be24367b9a1d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:23.222577 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a4d2ebaa-9f86-4411-882b-be24367b9a1d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:23.362428 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a4d2ebaa-9f86-4411-882b-be24367b9a1d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:23.371080 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a4d2ebaa-9f86-4411-882b-be24367b9a1d tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1573 microversion: 2.1 time: 0.162231 Jul 26 15:36:23.371644 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3667/7219] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:23 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:24.392757 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-03668422-5cb9-46ab-8938-83bd9170f180 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:24.393378 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-03668422-5cb9-46ab-8938-83bd9170f180 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:24.400401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03668422-5cb9-46ab-8938-83bd9170f180 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:24.400859 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03668422-5cb9-46ab-8938-83bd9170f180 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:24.402405 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03668422-5cb9-46ab-8938-83bd9170f180 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:24.402848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-03668422-5cb9-46ab-8938-83bd9170f180 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:24.534953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-03668422-5cb9-46ab-8938-83bd9170f180 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:24.543192 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-03668422-5cb9-46ab-8938-83bd9170f180 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1573 microversion: 2.1 time: 0.154247 Jul 26 15:36:24.543765 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3553/7220] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:24 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:25.564302 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6cdb150b-ca29-44c0-a222-e5fe6ec4d965 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:25.564942 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6cdb150b-ca29-44c0-a222-e5fe6ec4d965 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:25.572462 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cdb150b-ca29-44c0-a222-e5fe6ec4d965 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:25.573026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cdb150b-ca29-44c0-a222-e5fe6ec4d965 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:25.574468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cdb150b-ca29-44c0-a222-e5fe6ec4d965 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:25.574926 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6cdb150b-ca29-44c0-a222-e5fe6ec4d965 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:25.717653 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6cdb150b-ca29-44c0-a222-e5fe6ec4d965 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:25.725359 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6cdb150b-ca29-44c0-a222-e5fe6ec4d965 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1573 microversion: 2.1 time: 0.165019 Jul 26 15:36:25.725927 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3668/7221] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:25 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:26.746939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8dcc1cea-5016-46dc-8207-c28711b81f3f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:26.747590 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8dcc1cea-5016-46dc-8207-c28711b81f3f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:26.754638 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8dcc1cea-5016-46dc-8207-c28711b81f3f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:26.755090 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8dcc1cea-5016-46dc-8207-c28711b81f3f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:26.755855 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8dcc1cea-5016-46dc-8207-c28711b81f3f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:26.756320 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8dcc1cea-5016-46dc-8207-c28711b81f3f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:26.890742 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8dcc1cea-5016-46dc-8207-c28711b81f3f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:26.898410 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8dcc1cea-5016-46dc-8207-c28711b81f3f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1573 microversion: 2.1 time: 0.155550 Jul 26 15:36:26.898999 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3554/7222] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:26 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:27.920748 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-16b44157-1e95-46d8-b6dc-b18c8c117119 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:27.921399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-16b44157-1e95-46d8-b6dc-b18c8c117119 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:27.929728 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16b44157-1e95-46d8-b6dc-b18c8c117119 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:27.930210 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16b44157-1e95-46d8-b6dc-b18c8c117119 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:27.931008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16b44157-1e95-46d8-b6dc-b18c8c117119 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:27.931474 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-16b44157-1e95-46d8-b6dc-b18c8c117119 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:28.068693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-16b44157-1e95-46d8-b6dc-b18c8c117119 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:28.076868 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-16b44157-1e95-46d8-b6dc-b18c8c117119 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1573 microversion: 2.1 time: 0.160715 Jul 26 15:36:28.077441 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3669/7223] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:27 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:29.098623 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-82958ee6-3583-48eb-a8c2-9875a8f37b27 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:29.099312 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-82958ee6-3583-48eb-a8c2-9875a8f37b27 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:29.107083 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82958ee6-3583-48eb-a8c2-9875a8f37b27 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:29.107539 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82958ee6-3583-48eb-a8c2-9875a8f37b27 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:29.108341 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82958ee6-3583-48eb-a8c2-9875a8f37b27 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:29.108781 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-82958ee6-3583-48eb-a8c2-9875a8f37b27 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:29.112692 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:29.248820 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-82958ee6-3583-48eb-a8c2-9875a8f37b27 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:29.256379 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-82958ee6-3583-48eb-a8c2-9875a8f37b27 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1573 microversion: 2.1 time: 0.161634 Jul 26 15:36:29.256948 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3555/7224] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:29 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:30.279143 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-1dd29bc6-7716-4166-b654-eb238937fe11 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:30.279805 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-1dd29bc6-7716-4166-b654-eb238937fe11 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:30.286808 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dd29bc6-7716-4166-b654-eb238937fe11 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:30.287279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dd29bc6-7716-4166-b654-eb238937fe11 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:30.288127 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dd29bc6-7716-4166-b654-eb238937fe11 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:30.288583 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-1dd29bc6-7716-4166-b654-eb238937fe11 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:30.425113 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-1dd29bc6-7716-4166-b654-eb238937fe11 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:30.434407 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-1dd29bc6-7716-4166-b654-eb238937fe11 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1573 microversion: 2.1 time: 0.159321 Jul 26 15:36:30.435002 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3670/7225] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:30 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:31.456556 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-6f0deaa4-93b7-4d59-ad70-ee154c1ef689 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:31.457166 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-6f0deaa4-93b7-4d59-ad70-ee154c1ef689 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:31.459909 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=33 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:31.465994 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f0deaa4-93b7-4d59-ad70-ee154c1ef689 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:31.466443 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f0deaa4-93b7-4d59-ad70-ee154c1ef689 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:31.467585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f0deaa4-93b7-4d59-ad70-ee154c1ef689 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:31.467736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-6f0deaa4-93b7-4d59-ad70-ee154c1ef689 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:31.602063 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-6f0deaa4-93b7-4d59-ad70-ee154c1ef689 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:31.610399 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-6f0deaa4-93b7-4d59-ad70-ee154c1ef689 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1573 microversion: 2.1 time: 0.157828 Jul 26 15:36:31.610961 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3556/7226] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:31 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:36:32.558652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-6db30ee8-79b2-4a6a-8044-60d69eae5d64 req-b7069e7c-9efa-405e-884d-d3e1393d76fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023c3562-656b-4335-94c0-2add1ce4ee16", "name": "network-vif-plugged", "status": "completed", "tag": "41e89e07-b1e5-47f3-b840-f13a6990114c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:36:32.565919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=29 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:32.570314 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6db30ee8-79b2-4a6a-8044-60d69eae5d64 req-b7069e7c-9efa-405e-884d-d3e1393d76fc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:32.570781 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-6db30ee8-79b2-4a6a-8044-60d69eae5d64 req-b7069e7c-9efa-405e-884d-d3e1393d76fc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:32.575973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=85 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:36:32.583975 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-6db30ee8-79b2-4a6a-8044-60d69eae5d64 req-b7069e7c-9efa-405e-884d-d3e1393d76fc service nova] Creating event network-vif-plugged:41e89e07-b1e5-47f3-b840-f13a6990114c for instance 023c3562-656b-4335-94c0-2add1ce4ee16 on n-h1-833090-9 Jul 26 15:36:32.589892 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-6db30ee8-79b2-4a6a-8044-60d69eae5d64 req-b7069e7c-9efa-405e-884d-d3e1393d76fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034824 Jul 26 15:36:32.590661 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3671/7227] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:36:32.630653 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0f1cea7e-28ec-4d6e-a20e-b6a31e6f9ab5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:32.631279 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0f1cea7e-28ec-4d6e-a20e-b6a31e6f9ab5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:32.639511 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f1cea7e-28ec-4d6e-a20e-b6a31e6f9ab5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:32.639978 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f1cea7e-28ec-4d6e-a20e-b6a31e6f9ab5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:32.640803 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f1cea7e-28ec-4d6e-a20e-b6a31e6f9ab5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:32.641237 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0f1cea7e-28ec-4d6e-a20e-b6a31e6f9ab5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:32.779656 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0f1cea7e-28ec-4d6e-a20e-b6a31e6f9ab5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:32.787455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0f1cea7e-28ec-4d6e-a20e-b6a31e6f9ab5 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1573 microversion: 2.1 time: 0.160729 Jul 26 15:36:32.788056 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3557/7228] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:32 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:36:33.810546 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c89a98a5-f112-4866-bbcc-fcadad14f95a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:36:33.811263 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c89a98a5-f112-4866-bbcc-fcadad14f95a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:36:33.817652 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c89a98a5-f112-4866-bbcc-fcadad14f95a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:33.818118 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c89a98a5-f112-4866-bbcc-fcadad14f95a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:33.818896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c89a98a5-f112-4866-bbcc-fcadad14f95a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:36:33.819349 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c89a98a5-f112-4866-bbcc-fcadad14f95a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:36:33.962666 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c89a98a5-f112-4866-bbcc-fcadad14f95a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:36:33.970713 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c89a98a5-f112-4866-bbcc-fcadad14f95a tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1560 microversion: 2.1 time: 0.166201 Jul 26 15:36:33.971293 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3672/7229] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:36:33 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:47.803838 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=3 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:47.804745 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=16 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:47.806913 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:47.808039 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=7 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:37:47.809149 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fa2059af-7153-4e1c-a1a3-ac0959b2cb0c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:47.809736 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fa2059af-7153-4e1c-a1a3-ac0959b2cb0c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:47.817113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa2059af-7153-4e1c-a1a3-ac0959b2cb0c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.817861 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa2059af-7153-4e1c-a1a3-ac0959b2cb0c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.819335 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa2059af-7153-4e1c-a1a3-ac0959b2cb0c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.819869 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fa2059af-7153-4e1c-a1a3-ac0959b2cb0c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.846852 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fa2059af-7153-4e1c-a1a3-ac0959b2cb0c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:37:47.868249 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-3d82ee3d-5fae-4bf6-8ba1-01a385507812 req-1f0092d6-3e8b-4298-a2f6-5d67b8f0985f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023c3562-656b-4335-94c0-2add1ce4ee16", "tag": "41e89e07-b1e5-47f3-b840-f13a6990114c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:47.878226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3d82ee3d-5fae-4bf6-8ba1-01a385507812 req-1f0092d6-3e8b-4298-a2f6-5d67b8f0985f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.878779 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-3d82ee3d-5fae-4bf6-8ba1-01a385507812 req-1f0092d6-3e8b-4298-a2f6-5d67b8f0985f service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.893018 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-3d82ee3d-5fae-4bf6-8ba1-01a385507812 req-1f0092d6-3e8b-4298-a2f6-5d67b8f0985f service nova] Creating event network-changed:41e89e07-b1e5-47f3-b840-f13a6990114c for instance 023c3562-656b-4335-94c0-2add1ce4ee16 on n-h1-833090-9 Jul 26 15:37:47.900634 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-3d82ee3d-5fae-4bf6-8ba1-01a385507812 req-1f0092d6-3e8b-4298-a2f6-5d67b8f0985f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096266 Jul 26 15:37:47.901335 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3673/7230] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:47.938718 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fa2059af-7153-4e1c-a1a3-ac0959b2cb0c tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "DELETE /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 204 len: 0 microversion: 2.1 time: 0.135058 Jul 26 15:37:47.938718 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3558/7231] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:37:47 2022] DELETE /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:37:47.948449 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-7d799f12-f64e-4341-b62b-434c361cc032 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:47.949335 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-7d799f12-f64e-4341-b62b-434c361cc032 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:47.955757 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d799f12-f64e-4341-b62b-434c361cc032 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.956255 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d799f12-f64e-4341-b62b-434c361cc032 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:47.957046 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d799f12-f64e-4341-b62b-434c361cc032 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:47.957499 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-7d799f12-f64e-4341-b62b-434c361cc032 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:48.098739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-7d799f12-f64e-4341-b62b-434c361cc032 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:48.107476 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-7d799f12-f64e-4341-b62b-434c361cc032 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.165037 Jul 26 15:37:48.108077 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3674/7232] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:37:47 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:49.131057 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-43ecedd8-52fa-4b49-ad07-958ae361ed29 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:49.131896 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-43ecedd8-52fa-4b49-ad07-958ae361ed29 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:49.140768 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43ecedd8-52fa-4b49-ad07-958ae361ed29 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.141220 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43ecedd8-52fa-4b49-ad07-958ae361ed29 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.141996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43ecedd8-52fa-4b49-ad07-958ae361ed29 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.142431 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-43ecedd8-52fa-4b49-ad07-958ae361ed29 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.281318 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-43ecedd8-52fa-4b49-ad07-958ae361ed29 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:49.289531 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-43ecedd8-52fa-4b49-ad07-958ae361ed29 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1566 microversion: 2.1 time: 0.162968 Jul 26 15:37:49.290112 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3559/7233] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:37:49 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:49.945892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-4b674325-62ab-444c-8eec-b2b3ca8b3016 req-ad0309c4-1d61-4650-bced-be18a7ebe304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023c3562-656b-4335-94c0-2add1ce4ee16", "name": "network-vif-deleted", "tag": "41e89e07-b1e5-47f3-b840-f13a6990114c"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:37:49.956510 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4b674325-62ab-444c-8eec-b2b3ca8b3016 req-ad0309c4-1d61-4650-bced-be18a7ebe304 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:49.956981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-4b674325-62ab-444c-8eec-b2b3ca8b3016 req-ad0309c4-1d61-4650-bced-be18a7ebe304 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:49.969235 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-4b674325-62ab-444c-8eec-b2b3ca8b3016 req-ad0309c4-1d61-4650-bced-be18a7ebe304 service nova] Creating event network-vif-deleted:41e89e07-b1e5-47f3-b840-f13a6990114c for instance 023c3562-656b-4335-94c0-2add1ce4ee16 on n-h1-833090-9 Jul 26 15:37:49.973909 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-4b674325-62ab-444c-8eec-b2b3ca8b3016 req-ad0309c4-1d61-4650-bced-be18a7ebe304 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032376 Jul 26 15:37:49.974537 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3675/7234] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:37:50.311505 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-66a2a8b9-5541-47e3-a3c1-7d221930dddb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:50.313054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-66a2a8b9-5541-47e3-a3c1-7d221930dddb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:50.321309 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66a2a8b9-5541-47e3-a3c1-7d221930dddb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.322042 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66a2a8b9-5541-47e3-a3c1-7d221930dddb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.323029 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66a2a8b9-5541-47e3-a3c1-7d221930dddb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:50.323468 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-66a2a8b9-5541-47e3-a3c1-7d221930dddb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:50.395625 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-66a2a8b9-5541-47e3-a3c1-7d221930dddb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:50.403584 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-66a2a8b9-5541-47e3-a3c1-7d221930dddb tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1217 microversion: 2.1 time: 0.096309 Jul 26 15:37:50.404400 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3560/7235] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:37:50 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:51.426594 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-6d67682c-ab1c-402c-b821-65d43259758f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:51.427315 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-6d67682c-ab1c-402c-b821-65d43259758f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:51.435680 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d67682c-ab1c-402c-b821-65d43259758f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:51.436177 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d67682c-ab1c-402c-b821-65d43259758f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:51.436983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d67682c-ab1c-402c-b821-65d43259758f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:51.437437 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-6d67682c-ab1c-402c-b821-65d43259758f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:51.503316 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-6d67682c-ab1c-402c-b821-65d43259758f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:51.512213 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-6d67682c-ab1c-402c-b821-65d43259758f tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1217 microversion: 2.1 time: 0.090981 Jul 26 15:37:51.512884 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3676/7236] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:37:51 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:52.533687 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-fb8f8af5-9b72-4795-9f96-032504c9cfd6 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:52.534305 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-fb8f8af5-9b72-4795-9f96-032504c9cfd6 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:52.541942 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb8f8af5-9b72-4795-9f96-032504c9cfd6 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:52.542398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb8f8af5-9b72-4795-9f96-032504c9cfd6 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:52.543211 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb8f8af5-9b72-4795-9f96-032504c9cfd6 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:52.543655 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-fb8f8af5-9b72-4795-9f96-032504c9cfd6 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:52.609333 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-fb8f8af5-9b72-4795-9f96-032504c9cfd6 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:52.617946 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-fb8f8af5-9b72-4795-9f96-032504c9cfd6 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1217 microversion: 2.1 time: 0.088312 Jul 26 15:37:52.618531 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3561/7237] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:37:52 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:53.639421 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-79769a92-9957-470e-bed5-456b77fdaf4b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:53.640087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-79769a92-9957-470e-bed5-456b77fdaf4b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:53.648030 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79769a92-9957-470e-bed5-456b77fdaf4b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:53.648514 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79769a92-9957-470e-bed5-456b77fdaf4b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:53.649319 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79769a92-9957-470e-bed5-456b77fdaf4b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:53.649786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-79769a92-9957-470e-bed5-456b77fdaf4b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:53.721066 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-79769a92-9957-470e-bed5-456b77fdaf4b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe352dfd6dd4e98baf11a9821d4d030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179a71165aad4b879c2fb1e742d8c483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:37:53.729223 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-79769a92-9957-470e-bed5-456b77fdaf4b tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 200 len: 1217 microversion: 2.1 time: 0.093832 Jul 26 15:37:53.729814 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3677/7238] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:37:53 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:37:54.750299 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c1698188-f824-4768-a5dc-46345ce09730 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:54.750824 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-c1698188-f824-4768-a5dc-46345ce09730 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] [instance: 023c3562-656b-4335-94c0-2add1ce4ee16] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:37:54.759334 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1698188-f824-4768-a5dc-46345ce09730 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:54.759791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1698188-f824-4768-a5dc-46345ce09730 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:54.760593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1698188-f824-4768-a5dc-46345ce09730 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:37:54.761033 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-c1698188-f824-4768-a5dc-46345ce09730 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:37:54.774702 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-c1698188-f824-4768-a5dc-46345ce09730 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] HTTP exception thrown: Instance 023c3562-656b-4335-94c0-2add1ce4ee16 could not be found. Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c1698188-f824-4768-a5dc-46345ce09730 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Request method failure captured: Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 HTTP/1.1 Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4AhFHd8b8J5X5HPeC9ze5r4-SyaCZdjlQADfWEL-Zc-vF6PYQxV9i-I5JDXzGz8w-BbXtgXICoNrxQaU3e4dN0IFMRLqZN-HlqtHYujlotvWxrYV93rsG321LgT0ek6oiwTZwuLRvGNoPsyVv1RTQNoo5tEpUkVoV0RShI99510tuec Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 179a71165aad4b879c2fb1e742d8c483 Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestShelveInstance-159911206 Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/179a71165aad4b879c2fb1e742d8c483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/179a71165aad4b879c2fb1e742d8c483"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_179a71165aad4b879c2fb1e742d8c483", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/179a71165aad4b879c2fb1e742d8c483"}]}] Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestShelveInstance-159911206 Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 179a71165aad4b879c2fb1e742d8c483 Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestShelveInstance-159911206 Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestShelveInstance-159911206-project Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: bbe352dfd6dd4e98baf11a9821d4d030 Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestShelveInstance-159911206-project Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 023c3562-656b-4335-94c0-2add1ce4ee16 could not be found. Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '023c3562-656b-4335-94c0-2add1ce4ee16'} Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023c3562-656b-4335-94c0-2add1ce4ee16 could not be found. Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023c3562-656b-4335-94c0-2add1ce4ee16 could not be found. Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:37:54.776401 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:37:54.781363 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:37:54.781363 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:37:54.781363 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:37:54.781363 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:37:54.781363 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:37:54.781363 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023c3562-656b-4335-94c0-2add1ce4ee16 could not be found. Jul 26 15:37:54.781363 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:37:54.781363 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-c1698188-f824-4768-a5dc-46345ce09730 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Returning 404 to user: Instance 023c3562-656b-4335-94c0-2add1ce4ee16 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:37:54.781363 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-c1698188-f824-4768-a5dc-46345ce09730 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16" status: 404 len: 111 microversion: 2.1 time: 0.031581 Jul 26 15:37:54.781363 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3562/7239] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:37:54 2022] GET /compute/v2.1/servers/023c3562-656b-4335-94c0-2add1ce4ee16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:37:54.955533 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-af29a980-a5f8-4407-a761-e6dbdb7513d4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] Calling method '.version_select at 0x7f8799350c10>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:37:54.986539 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-af29a980-a5f8-4407-a761-e6dbdb7513d4 tempest-TestShelveInstance-159911206 tempest-TestShelveInstance-159911206-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-443416191" status: 202 len: 0 microversion: 2.1 time: 0.036202 Jul 26 15:37:54.987148 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3678/7240] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Jul 26 15:37:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-443416191 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:37:58.385579 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:37:58.386146 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:37:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:38:12.871724 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:12.872579 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:13.062419 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-a410772b-2077-47e2-9bfc-408bd2547223 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Action: 'create', calling method: .version_select at 0x7f8786d08dc0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1842177823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1vobuwJIZKWpuWQB4ZMByiTUroHGNooDJI5wtYM1FlVqK/STjwqnoejY1MeSZUwm2JANGaa3TXo6AnJjPGql2EfA8EcEqBEhDMuSySM23qy+iETlu/1+i9x1SVHadlOg=="}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:13.080755 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-a410772b-2077-47e2-9bfc-408bd2547223 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Getting quotas for project 2971acaa234b4d6fb16f84de75420339. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:38:13.087490 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.quota [None req-a410772b-2077-47e2-9bfc-408bd2547223 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Getting quotas for user 667e41cb1fa541859bdfb335caf66c40 and project 2971acaa234b4d6fb16f84de75420339. Resources: {'key_pairs'} {{(pid=119478) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:38:13.121174 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-a410772b-2077-47e2-9bfc-408bd2547223 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.254656 Jul 26 15:38:13.121908 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3563/7241] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Jul 26 15:38:12 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:14.240220 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=22 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:14.240990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:14.245973 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1341779167", "imageRef": "5fc64a26-e870-4f37-8cf2-dd18e171162e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1842177823", "security_groups": [{"name": "tempest-secgroup-smoke-1733753524"}], "networks": [{"uuid": "c82e6625-9c61-4e92-a750-b927f0377514"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:14.359550 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] validate_networks() for [('c82e6625-9c61-4e92-a750-b927f0377514', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:38:14.882054 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:38:14.882498 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:38:14.883031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:38:14.883446 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:38:14.883864 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:38:14.893297 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:14.893768 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:14.894593 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:14.895057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:14.915248 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Getting quotas for project 2971acaa234b4d6fb16f84de75420339. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:38:14.920682 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Getting quotas for user 667e41cb1fa541859bdfb335caf66c40 and project 2971acaa234b4d6fb16f84de75420339. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:38:14.933699 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:38:14.936001 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5fc64a26-e870-4f37-8cf2-dd18e171162e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:38:14.986669 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2cf107cc-42c6-49fb-9a42-1f191950b1f7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.748215 Jul 26 15:38:14.987259 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3679/7242] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:38:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:38:14.999077 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-036dc9d7-40ae-4a61-81f0-64c1f0014b63 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:14.999740 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-036dc9d7-40ae-4a61-81f0-64c1f0014b63 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:15.060688 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-036dc9d7-40ae-4a61-81f0-64c1f0014b63 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:15.068376 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-036dc9d7-40ae-4a61-81f0-64c1f0014b63 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1249 microversion: 2.1 time: 0.073376 Jul 26 15:38:15.068956 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3564/7243] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:38:14 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1249 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:16.091414 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c0f382c1-7675-4e67-9db4-df59226f7864 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:16.092096 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c0f382c1-7675-4e67-9db4-df59226f7864 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:16.100567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0f382c1-7675-4e67-9db4-df59226f7864 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:16.101399 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0f382c1-7675-4e67-9db4-df59226f7864 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:16.102465 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0f382c1-7675-4e67-9db4-df59226f7864 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:16.103016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c0f382c1-7675-4e67-9db4-df59226f7864 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:16.196734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-c0f382c1-7675-4e67-9db4-df59226f7864 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:16.209294 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c0f382c1-7675-4e67-9db4-df59226f7864 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1309 microversion: 2.1 time: 0.121564 Jul 26 15:38:16.210561 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3680/7244] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:38:16 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1309 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:17.231261 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-997cbf54-818e-4d7d-8cee-8d41788b0da7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:17.231884 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-997cbf54-818e-4d7d-8cee-8d41788b0da7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:17.240823 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-997cbf54-818e-4d7d-8cee-8d41788b0da7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:17.241278 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-997cbf54-818e-4d7d-8cee-8d41788b0da7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:17.242111 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-997cbf54-818e-4d7d-8cee-8d41788b0da7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:17.242743 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-997cbf54-818e-4d7d-8cee-8d41788b0da7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:17.472254 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-997cbf54-818e-4d7d-8cee-8d41788b0da7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:17.483097 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-997cbf54-818e-4d7d-8cee-8d41788b0da7 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1375 microversion: 2.1 time: 0.255112 Jul 26 15:38:17.484267 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3565/7245] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:38:17 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:17.835186 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-a9907a5e-59df-444b-9e2f-c95407abc448 req-4aa92239-1c3f-4449-93c1-0f0a7cbfe752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f2de6e-db1a-48b7-ac0b-65c2506ad32e", "tag": "a756bf05-dd20-469c-816c-cc618c1053ed"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:17.850968 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a9907a5e-59df-444b-9e2f-c95407abc448 req-4aa92239-1c3f-4449-93c1-0f0a7cbfe752 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:17.852389 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-a9907a5e-59df-444b-9e2f-c95407abc448 req-4aa92239-1c3f-4449-93c1-0f0a7cbfe752 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:17.868941 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-a9907a5e-59df-444b-9e2f-c95407abc448 req-4aa92239-1c3f-4449-93c1-0f0a7cbfe752 service nova] Creating event network-changed:a756bf05-dd20-469c-816c-cc618c1053ed for instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e on n-h1-833090-9 Jul 26 15:38:17.874237 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-a9907a5e-59df-444b-9e2f-c95407abc448 req-4aa92239-1c3f-4449-93c1-0f0a7cbfe752 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044095 Jul 26 15:38:17.875265 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3681/7246] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:38:18.507179 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-5b86551e-4211-4f77-9efc-ca2cde3f9747 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:18.507799 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-5b86551e-4211-4f77-9efc-ca2cde3f9747 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:18.515905 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b86551e-4211-4f77-9efc-ca2cde3f9747 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:18.516491 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b86551e-4211-4f77-9efc-ca2cde3f9747 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:18.517546 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b86551e-4211-4f77-9efc-ca2cde3f9747 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:18.518086 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-5b86551e-4211-4f77-9efc-ca2cde3f9747 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:18.665047 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-5b86551e-4211-4f77-9efc-ca2cde3f9747 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:18.672607 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-5b86551e-4211-4f77-9efc-ca2cde3f9747 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1375 microversion: 2.1 time: 0.169589 Jul 26 15:38:18.677298 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3566/7247] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:38:18 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:19.695598 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-9a82f4f1-01c1-4b50-ab8e-4470d0db72ea tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:19.696348 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-9a82f4f1-01c1-4b50-ab8e-4470d0db72ea tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:19.703554 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a82f4f1-01c1-4b50-ab8e-4470d0db72ea tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:19.704121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a82f4f1-01c1-4b50-ab8e-4470d0db72ea tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:19.704993 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a82f4f1-01c1-4b50-ab8e-4470d0db72ea tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:19.705527 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-9a82f4f1-01c1-4b50-ab8e-4470d0db72ea tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:19.842588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-9a82f4f1-01c1-4b50-ab8e-4470d0db72ea tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:19.850287 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-9a82f4f1-01c1-4b50-ab8e-4470d0db72ea tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1375 microversion: 2.1 time: 0.159835 Jul 26 15:38:19.851037 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3682/7248] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:38:19 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:20.871503 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ce8c4c31-55cc-4676-a4b4-0a7203c9bc79 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:20.873212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ce8c4c31-55cc-4676-a4b4-0a7203c9bc79 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:20.881886 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce8c4c31-55cc-4676-a4b4-0a7203c9bc79 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:20.882349 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce8c4c31-55cc-4676-a4b4-0a7203c9bc79 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:20.883145 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce8c4c31-55cc-4676-a4b4-0a7203c9bc79 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:20.883592 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ce8c4c31-55cc-4676-a4b4-0a7203c9bc79 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:21.017128 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-ce8c4c31-55cc-4676-a4b4-0a7203c9bc79 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:21.026025 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ce8c4c31-55cc-4676-a4b4-0a7203c9bc79 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1375 microversion: 2.1 time: 0.158442 Jul 26 15:38:21.026613 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3567/7249] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:38:20 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:22.048363 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2b40ea37-f8bb-41b0-8e8d-8ea77d3258ba tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:22.049103 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2b40ea37-f8bb-41b0-8e8d-8ea77d3258ba tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:22.057026 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b40ea37-f8bb-41b0-8e8d-8ea77d3258ba tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:22.057504 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b40ea37-f8bb-41b0-8e8d-8ea77d3258ba tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:22.058333 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b40ea37-f8bb-41b0-8e8d-8ea77d3258ba tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:22.058780 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2b40ea37-f8bb-41b0-8e8d-8ea77d3258ba tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:22.193257 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2b40ea37-f8bb-41b0-8e8d-8ea77d3258ba tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:22.201130 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2b40ea37-f8bb-41b0-8e8d-8ea77d3258ba tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1375 microversion: 2.1 time: 0.156779 Jul 26 15:38:22.201698 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3683/7250] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:38:22 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:23.092054 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-9209eeda-76c5-460d-bf36-5acd69943b11 req-1b63b45d-ecbf-4868-856e-9f5e16647d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f2de6e-db1a-48b7-ac0b-65c2506ad32e", "name": "network-vif-plugged", "status": "completed", "tag": "a756bf05-dd20-469c-816c-cc618c1053ed"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:23.102593 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9209eeda-76c5-460d-bf36-5acd69943b11 req-1b63b45d-ecbf-4868-856e-9f5e16647d9d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:23.103035 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-9209eeda-76c5-460d-bf36-5acd69943b11 req-1b63b45d-ecbf-4868-856e-9f5e16647d9d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:23.114852 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-9209eeda-76c5-460d-bf36-5acd69943b11 req-1b63b45d-ecbf-4868-856e-9f5e16647d9d service nova] Creating event network-vif-plugged:a756bf05-dd20-469c-816c-cc618c1053ed for instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e on n-h1-833090-9 Jul 26 15:38:23.119770 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-9209eeda-76c5-460d-bf36-5acd69943b11 req-1b63b45d-ecbf-4868-856e-9f5e16647d9d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098573 Jul 26 15:38:23.120404 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3568/7251] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:38:23.224939 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-ae1c140c-bcba-4987-a1ea-d591feeeec56 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:23.225618 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-ae1c140c-bcba-4987-a1ea-d591feeeec56 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:23.232695 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae1c140c-bcba-4987-a1ea-d591feeeec56 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:23.233176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae1c140c-bcba-4987-a1ea-d591feeeec56 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:23.233983 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae1c140c-bcba-4987-a1ea-d591feeeec56 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:23.234450 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-ae1c140c-bcba-4987-a1ea-d591feeeec56 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:23.374734 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-ae1c140c-bcba-4987-a1ea-d591feeeec56 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:23.383738 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-ae1c140c-bcba-4987-a1ea-d591feeeec56 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1375 microversion: 2.1 time: 0.163541 Jul 26 15:38:23.384391 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3684/7252] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:38:23 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:38:24.407487 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-4b60d188-7c8a-4a3a-af2f-da3d637524f4 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:24.408250 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-4b60d188-7c8a-4a3a-af2f-da3d637524f4 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:24.414738 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b60d188-7c8a-4a3a-af2f-da3d637524f4 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:24.415187 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b60d188-7c8a-4a3a-af2f-da3d637524f4 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:24.415971 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b60d188-7c8a-4a3a-af2f-da3d637524f4 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:24.416418 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-4b60d188-7c8a-4a3a-af2f-da3d637524f4 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:24.555038 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-4b60d188-7c8a-4a3a-af2f-da3d637524f4 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:24.562750 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-4b60d188-7c8a-4a3a-af2f-da3d637524f4 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1558 microversion: 2.1 time: 0.161174 Jul 26 15:38:24.563338 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3569/7253] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:38:24 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:24.583710 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-70dabe9f-57b1-4947-b634-7935faac3751 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:38:24.584380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-70dabe9f-57b1-4947-b634-7935faac3751 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:38:24.591336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70dabe9f-57b1-4947-b634-7935faac3751 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:24.591812 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70dabe9f-57b1-4947-b634-7935faac3751 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:24.592646 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70dabe9f-57b1-4947-b634-7935faac3751 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:24.593107 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-70dabe9f-57b1-4947-b634-7935faac3751 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:24.730643 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-70dabe9f-57b1-4947-b634-7935faac3751 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:38:24.738211 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-70dabe9f-57b1-4947-b634-7935faac3751 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1558 microversion: 2.1 time: 0.158918 Jul 26 15:38:24.738778 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3685/7254] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:38:24 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:38:26.710384 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-f4c89d89-e56b-42f5-bb89-57fc80165490 req-aa36f661-a3a7-4ac2-a2ba-ca211936c7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f2de6e-db1a-48b7-ac0b-65c2506ad32e", "tag": "a756bf05-dd20-469c-816c-cc618c1053ed"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:38:26.715297 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=6 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:38:26.722337 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f4c89d89-e56b-42f5-bb89-57fc80165490 req-aa36f661-a3a7-4ac2-a2ba-ca211936c7d5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:38:26.722789 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-f4c89d89-e56b-42f5-bb89-57fc80165490 req-aa36f661-a3a7-4ac2-a2ba-ca211936c7d5 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:38:26.735058 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-f4c89d89-e56b-42f5-bb89-57fc80165490 req-aa36f661-a3a7-4ac2-a2ba-ca211936c7d5 service nova] Creating event network-changed:a756bf05-dd20-469c-816c-cc618c1053ed for instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e on n-h1-833090-9 Jul 26 15:38:26.740321 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-f4c89d89-e56b-42f5-bb89-57fc80165490 req-aa36f661-a3a7-4ac2-a2ba-ca211936c7d5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034758 Jul 26 15:38:26.740952 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3570/7255] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:19.234787 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30cc4c1d-189c-4030-802b-dd5549a8f3b2] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 15:40:19.235707 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fcb0ade0-98d2-4d3c-ae6b-59cf589e6dcc] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 15:40:19.236104 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:19.236869 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:19.238392 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:19.239146 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=34 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:19.244544 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-cc19654a-0888-4b67-bab7-bc15f6335cf6 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-880277424"}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:19.247021 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-cc19654a-0888-4b67-bab7-bc15f6335cf6 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:19.257256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc19654a-0888-4b67-bab7-bc15f6335cf6 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:19.257731 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc19654a-0888-4b67-bab7-bc15f6335cf6 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:19.258519 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc19654a-0888-4b67-bab7-bc15f6335cf6 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:19.259000 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-cc19654a-0888-4b67-bab7-bc15f6335cf6 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:19.553260 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-cc19654a-0888-4b67-bab7-bc15f6335cf6 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "POST /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e/action" status: 202 len: 0 microversion: 2.1 time: 0.320545 Jul 26 15:40:19.554193 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3686/7256] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:40:19 2022] POST /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 15:40:23.642798 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [54fe80fa-5d54-4bb9-a76b-59290c50e610] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 15:40:23.643621 n-d-833090-9 devstack@n-api.service[119478]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b7f3ab2a-6e11-4e90-a515-8ef793525f8a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 15:40:23.644212 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:23.645005 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=28 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:23.649577 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-4be04829-8165-46df-a1ff-ca7080230078 req-0dc85f8b-0143-4ca9-9acf-fc2c38cd72ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f2de6e-db1a-48b7-ac0b-65c2506ad32e", "name": "network-vif-plugged", "status": "completed", "tag": "a756bf05-dd20-469c-816c-cc618c1053ed"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:23.659683 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4be04829-8165-46df-a1ff-ca7080230078 req-0dc85f8b-0143-4ca9-9acf-fc2c38cd72ac service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:23.660162 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-4be04829-8165-46df-a1ff-ca7080230078 req-0dc85f8b-0143-4ca9-9acf-fc2c38cd72ac service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:23.673002 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-4be04829-8165-46df-a1ff-ca7080230078 req-0dc85f8b-0143-4ca9-9acf-fc2c38cd72ac service nova] Creating event network-vif-plugged:a756bf05-dd20-469c-816c-cc618c1053ed for instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e on n-h1-833090-9 Jul 26 15:40:23.679166 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-4be04829-8165-46df-a1ff-ca7080230078 req-0dc85f8b-0143-4ca9-9acf-fc2c38cd72ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037792 Jul 26 15:40:23.679730 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3571/7257] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:33.096469 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:33.098329 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:33.109150 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-238208212", "imageRef": "02d945a4-52b4-49e7-bcd1-be01197fe7fc", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1842177823", "security_groups": [{"name": "tempest-secgroup-smoke-1733753524"}], "networks": [{"uuid": "c82e6625-9c61-4e92-a750-b927f0377514"}]}} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:33.134654 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] [fcb0ade0-98d2-4d3c-ae6b-59cf589e6dcc] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 54828. Jul 26 15:40:33.136739 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] [30cc4c1d-189c-4030-802b-dd5549a8f3b2] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 54826. Jul 26 15:40:33.230157 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.network.neutron [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] validate_networks() for [('c82e6625-9c61-4e92-a750-b927f0377514', None, None, None, None, None)] {{(pid=119479) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:40:33.606667 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Flavor limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:40:33.607117 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Image limits 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:40:33.607626 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Flavor pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:40:33.608088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Image pref 0:0:0 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:40:33.608532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.virt.hardware [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:40:33.618322 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:33.618796 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:33.619627 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:33.620128 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:33.637579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Getting quotas for project 2971acaa234b4d6fb16f84de75420339. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:40:33.642865 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.quota [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Getting quotas for user 667e41cb1fa541859bdfb335caf66c40 and project 2971acaa234b4d6fb16f84de75420339. Resources: {'ram', 'instances', 'cores'} {{(pid=119479) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:40:33.655336 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Going to run 1 instances... {{(pid=119479) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:40:33.657847 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='02d945a4-52b4-49e7-bcd1-be01197fe7fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119479) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:40:33.706024 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-c9e4f908-23d5-4fc5-a223-01c335ce54d3 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.611742 Jul 26 15:40:33.709619 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3687/7258] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Jul 26 15:40:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:40:33.718039 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:33.730399 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-d991b86f-27fc-4938-8915-5a8603551cfa tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:33.731070 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-d991b86f-27fc-4938-8915-5a8603551cfa tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:33.735081 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] [b7f3ab2a-6e11-4e90-a515-8ef793525f8a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 54842. Jul 26 15:40:33.749145 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] [54fe80fa-5d54-4bb9-a76b-59290c50e610] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 54840. Jul 26 15:40:33.849690 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-d991b86f-27fc-4938-8915-5a8603551cfa tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:33.856574 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-d991b86f-27fc-4938-8915-5a8603551cfa tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1248 microversion: 2.1 time: 0.142360 Jul 26 15:40:33.857085 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3572/7259] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:33 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1248 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:34.879121 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5f34e6df-7141-4344-8586-1de1d8536f96 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:34.880214 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5f34e6df-7141-4344-8586-1de1d8536f96 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:34.889394 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f34e6df-7141-4344-8586-1de1d8536f96 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:34.890274 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f34e6df-7141-4344-8586-1de1d8536f96 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:34.891236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f34e6df-7141-4344-8586-1de1d8536f96 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:34.892033 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5f34e6df-7141-4344-8586-1de1d8536f96 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:35.015378 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5f34e6df-7141-4344-8586-1de1d8536f96 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:35.023907 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5f34e6df-7141-4344-8586-1de1d8536f96 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1306 microversion: 2.1 time: 0.150322 Jul 26 15:40:35.024820 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3688/7260] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:34 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1306 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:35.983492 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-c8bf28c7-7297-4af2-a397-98e9ae58a7f6 req-9d4f87a8-7844-4096-a53d-3deb10738acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f2de6e-db1a-48b7-ac0b-65c2506ad32e", "name": "network-vif-unplugged", "status": "completed", "tag": "a756bf05-dd20-469c-816c-cc618c1053ed"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:35.996981 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c8bf28c7-7297-4af2-a397-98e9ae58a7f6 req-9d4f87a8-7844-4096-a53d-3deb10738acc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:35.997635 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-c8bf28c7-7297-4af2-a397-98e9ae58a7f6 req-9d4f87a8-7844-4096-a53d-3deb10738acc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:36.023389 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-c8bf28c7-7297-4af2-a397-98e9ae58a7f6 req-9d4f87a8-7844-4096-a53d-3deb10738acc service nova] Creating event network-vif-unplugged:a756bf05-dd20-469c-816c-cc618c1053ed for instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e on n-h1-833090-9 Jul 26 15:40:36.029915 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-c8bf28c7-7297-4af2-a397-98e9ae58a7f6 req-9d4f87a8-7844-4096-a53d-3deb10738acc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050355 Jul 26 15:40:36.031432 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3573/7261] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:36.047058 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-89386551-ddce-475d-b2f0-a717c1408a0c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:36.048176 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-89386551-ddce-475d-b2f0-a717c1408a0c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:36.055936 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89386551-ddce-475d-b2f0-a717c1408a0c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:36.056814 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89386551-ddce-475d-b2f0-a717c1408a0c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:36.057786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89386551-ddce-475d-b2f0-a717c1408a0c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:36.058410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-89386551-ddce-475d-b2f0-a717c1408a0c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:36.226347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-89386551-ddce-475d-b2f0-a717c1408a0c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:36.234931 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-89386551-ddce-475d-b2f0-a717c1408a0c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.192604 Jul 26 15:40:36.235685 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3689/7262] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:36 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:37.258206 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-2960e86b-70f4-4240-b751-688e605c3f57 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:37.258914 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-2960e86b-70f4-4240-b751-688e605c3f57 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:37.265749 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2960e86b-70f4-4240-b751-688e605c3f57 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:37.266203 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2960e86b-70f4-4240-b751-688e605c3f57 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:37.266997 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2960e86b-70f4-4240-b751-688e605c3f57 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:37.267433 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-2960e86b-70f4-4240-b751-688e605c3f57 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:37.438848 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-2960e86b-70f4-4240-b751-688e605c3f57 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:37.447132 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-2960e86b-70f4-4240-b751-688e605c3f57 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.193869 Jul 26 15:40:37.447651 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3574/7263] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:37 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:38.469539 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-8f709639-da2f-400a-b28b-6bd134592ef5 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:38.470380 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-8f709639-da2f-400a-b28b-6bd134592ef5 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:38.478538 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f709639-da2f-400a-b28b-6bd134592ef5 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:38.479011 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f709639-da2f-400a-b28b-6bd134592ef5 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:38.479809 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f709639-da2f-400a-b28b-6bd134592ef5 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:38.480318 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-8f709639-da2f-400a-b28b-6bd134592ef5 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:38.634061 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-8f709639-da2f-400a-b28b-6bd134592ef5 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:38.644947 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-8f709639-da2f-400a-b28b-6bd134592ef5 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.176785 Jul 26 15:40:38.645741 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3690/7264] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:38 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:39.668209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-aeff003d-0a10-4e61-b01e-5fe86deaea5c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:39.669055 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-aeff003d-0a10-4e61-b01e-5fe86deaea5c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:39.677328 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeff003d-0a10-4e61-b01e-5fe86deaea5c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:39.677791 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeff003d-0a10-4e61-b01e-5fe86deaea5c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:39.678575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeff003d-0a10-4e61-b01e-5fe86deaea5c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:39.679300 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-aeff003d-0a10-4e61-b01e-5fe86deaea5c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:39.827444 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-aeff003d-0a10-4e61-b01e-5fe86deaea5c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:39.835335 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-aeff003d-0a10-4e61-b01e-5fe86deaea5c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.171406 Jul 26 15:40:39.835914 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3575/7265] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:39 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:40.861773 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-2233dce9-47fa-491f-bbf9-8c6f5b010d01 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:40.863195 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-2233dce9-47fa-491f-bbf9-8c6f5b010d01 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:40.870892 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2233dce9-47fa-491f-bbf9-8c6f5b010d01 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:40.871373 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2233dce9-47fa-491f-bbf9-8c6f5b010d01 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:40.872226 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2233dce9-47fa-491f-bbf9-8c6f5b010d01 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:40.872739 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-2233dce9-47fa-491f-bbf9-8c6f5b010d01 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:41.061409 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-2233dce9-47fa-491f-bbf9-8c6f5b010d01 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:41.075724 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-2233dce9-47fa-491f-bbf9-8c6f5b010d01 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.217824 Jul 26 15:40:41.080018 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3691/7266] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:40 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:42.099022 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-32ff1dd2-ecba-4ba4-9518-0ab45ebdce13 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:42.099659 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-32ff1dd2-ecba-4ba4-9518-0ab45ebdce13 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:42.107257 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32ff1dd2-ecba-4ba4-9518-0ab45ebdce13 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:42.107715 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32ff1dd2-ecba-4ba4-9518-0ab45ebdce13 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:42.108547 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32ff1dd2-ecba-4ba4-9518-0ab45ebdce13 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:42.108996 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-32ff1dd2-ecba-4ba4-9518-0ab45ebdce13 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:42.289787 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-32ff1dd2-ecba-4ba4-9518-0ab45ebdce13 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:42.297436 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-32ff1dd2-ecba-4ba4-9518-0ab45ebdce13 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.202939 Jul 26 15:40:42.298005 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3576/7267] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:42 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:43.319719 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b35d8353-f15e-4628-902e-7bac58dea802 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:43.320485 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b35d8353-f15e-4628-902e-7bac58dea802 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:43.327470 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b35d8353-f15e-4628-902e-7bac58dea802 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:43.327972 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b35d8353-f15e-4628-902e-7bac58dea802 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:43.328787 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b35d8353-f15e-4628-902e-7bac58dea802 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:43.329256 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b35d8353-f15e-4628-902e-7bac58dea802 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:43.594136 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b35d8353-f15e-4628-902e-7bac58dea802 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:43.604885 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b35d8353-f15e-4628-902e-7bac58dea802 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.289053 Jul 26 15:40:43.605490 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3692/7268] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:43 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:43.977420 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-ddb6f23c-8497-4800-8574-e28f435f67f2 req-ad0adc49-ffff-40a8-869f-686a625d5159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ffcf02-af20-4872-b699-35b7a57782a9", "tag": "2598c415-0bcd-4b28-b83c-7d32a63034f2"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:43.985970 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell0:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:43.992109 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ddb6f23c-8497-4800-8574-e28f435f67f2 req-ad0adc49-ffff-40a8-869f-686a625d5159 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:43.992621 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-ddb6f23c-8497-4800-8574-e28f435f67f2 req-ad0adc49-ffff-40a8-869f-686a625d5159 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:44.009290 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-ddb6f23c-8497-4800-8574-e28f435f67f2 req-ad0adc49-ffff-40a8-869f-686a625d5159 service nova] Creating event network-changed:2598c415-0bcd-4b28-b83c-7d32a63034f2 for instance 04ffcf02-af20-4872-b699-35b7a57782a9 on n-h2-833090-9 Jul 26 15:40:44.016571 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-ddb6f23c-8497-4800-8574-e28f435f67f2 req-ad0adc49-ffff-40a8-869f-686a625d5159 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044470 Jul 26 15:40:44.017540 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3577/7269] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:44.629570 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-b63bfa3c-0b00-4a01-9c31-457c89b8e355 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:44.630213 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-b63bfa3c-0b00-4a01-9c31-457c89b8e355 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:44.632212 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=2 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:44.632896 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell0:SELECT=6 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:40:44.640706 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b63bfa3c-0b00-4a01-9c31-457c89b8e355 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:44.641180 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b63bfa3c-0b00-4a01-9c31-457c89b8e355 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:44.641981 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b63bfa3c-0b00-4a01-9c31-457c89b8e355 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:44.642445 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-b63bfa3c-0b00-4a01-9c31-457c89b8e355 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:44.794139 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-b63bfa3c-0b00-4a01-9c31-457c89b8e355 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:44.803349 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-b63bfa3c-0b00-4a01-9c31-457c89b8e355 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.179178 Jul 26 15:40:44.804344 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3693/7270] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:44 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:45.828359 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8802e6a6-e279-4764-97bd-994c08d85830 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:45.829200 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8802e6a6-e279-4764-97bd-994c08d85830 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:45.837100 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8802e6a6-e279-4764-97bd-994c08d85830 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:45.838171 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8802e6a6-e279-4764-97bd-994c08d85830 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:45.839904 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8802e6a6-e279-4764-97bd-994c08d85830 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:45.840614 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8802e6a6-e279-4764-97bd-994c08d85830 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:46.304074 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-8802e6a6-e279-4764-97bd-994c08d85830 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:46.311679 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8802e6a6-e279-4764-97bd-994c08d85830 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.488679 Jul 26 15:40:46.312321 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3578/7271] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:45 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:47.333502 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-a344f07a-03eb-4a55-a544-1993cb32dc75 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:47.334835 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-a344f07a-03eb-4a55-a544-1993cb32dc75 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:47.344057 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a344f07a-03eb-4a55-a544-1993cb32dc75 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:47.344541 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a344f07a-03eb-4a55-a544-1993cb32dc75 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:47.345356 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a344f07a-03eb-4a55-a544-1993cb32dc75 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:47.345821 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-a344f07a-03eb-4a55-a544-1993cb32dc75 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:47.496925 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-a344f07a-03eb-4a55-a544-1993cb32dc75 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:47.505438 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-a344f07a-03eb-4a55-a544-1993cb32dc75 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.176678 Jul 26 15:40:47.506030 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3694/7272] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:47 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:40:48.475707 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-2d2f65b4-2a86-466d-aaa5-32dbbd5122c1 req-35ed0f28-0940-4cac-ad90-3185540f9299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ffcf02-af20-4872-b699-35b7a57782a9", "name": "network-vif-plugged", "status": "completed", "tag": "2598c415-0bcd-4b28-b83c-7d32a63034f2"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:48.486448 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2d2f65b4-2a86-466d-aaa5-32dbbd5122c1 req-35ed0f28-0940-4cac-ad90-3185540f9299 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:48.486932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-2d2f65b4-2a86-466d-aaa5-32dbbd5122c1 req-35ed0f28-0940-4cac-ad90-3185540f9299 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:48.498251 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-2d2f65b4-2a86-466d-aaa5-32dbbd5122c1 req-35ed0f28-0940-4cac-ad90-3185540f9299 service nova] Creating event network-vif-plugged:2598c415-0bcd-4b28-b83c-7d32a63034f2 for instance 04ffcf02-af20-4872-b699-35b7a57782a9 on n-h2-833090-9 Jul 26 15:40:48.503350 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-2d2f65b4-2a86-466d-aaa5-32dbbd5122c1 req-35ed0f28-0940-4cac-ad90-3185540f9299 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032413 Jul 26 15:40:48.504324 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3579/7273] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:40:48.532571 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-5c644e27-5309-4cc7-90dc-7917c4b6df40 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:48.533347 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-5c644e27-5309-4cc7-90dc-7917c4b6df40 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:48.543369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c644e27-5309-4cc7-90dc-7917c4b6df40 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:48.544160 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c644e27-5309-4cc7-90dc-7917c4b6df40 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:48.545119 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c644e27-5309-4cc7-90dc-7917c4b6df40 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:48.546588 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-5c644e27-5309-4cc7-90dc-7917c4b6df40 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:48.742994 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-5c644e27-5309-4cc7-90dc-7917c4b6df40 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:48.743337 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-5c644e27-5309-4cc7-90dc-7917c4b6df40 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.214720 Jul 26 15:40:48.743905 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3695/7274] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:48 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:49.766763 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-0d40b214-fd0a-49b4-a066-4d49e3e1c659 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:49.767512 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-0d40b214-fd0a-49b4-a066-4d49e3e1c659 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:49.774844 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d40b214-fd0a-49b4-a066-4d49e3e1c659 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:49.775294 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d40b214-fd0a-49b4-a066-4d49e3e1c659 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:49.776127 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d40b214-fd0a-49b4-a066-4d49e3e1c659 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:49.776572 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-0d40b214-fd0a-49b4-a066-4d49e3e1c659 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:49.925953 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-0d40b214-fd0a-49b4-a066-4d49e3e1c659 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:49.934063 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-0d40b214-fd0a-49b4-a066-4d49e3e1c659 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1374 microversion: 2.1 time: 0.172455 Jul 26 15:40:49.934646 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3580/7275] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:49 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:50.955456 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-057366f5-84fc-4d7c-b43e-049f7173ca18 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:50.956196 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-057366f5-84fc-4d7c-b43e-049f7173ca18 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:50.963185 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-057366f5-84fc-4d7c-b43e-049f7173ca18 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:50.963673 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-057366f5-84fc-4d7c-b43e-049f7173ca18 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:50.964528 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-057366f5-84fc-4d7c-b43e-049f7173ca18 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:50.964996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-057366f5-84fc-4d7c-b43e-049f7173ca18 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:51.099876 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-057366f5-84fc-4d7c-b43e-049f7173ca18 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:51.107563 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-057366f5-84fc-4d7c-b43e-049f7173ca18 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1557 microversion: 2.1 time: 0.156168 Jul 26 15:40:51.108183 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3696/7276] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:50 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:51.128760 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-24d3e64c-edc2-4ed4-80d2-ea33d1151f35 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:40:51.129380 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-24d3e64c-edc2-4ed4-80d2-ea33d1151f35 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:40:51.136388 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24d3e64c-edc2-4ed4-80d2-ea33d1151f35 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:51.136847 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24d3e64c-edc2-4ed4-80d2-ea33d1151f35 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:51.137696 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24d3e64c-edc2-4ed4-80d2-ea33d1151f35 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:51.138131 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-24d3e64c-edc2-4ed4-80d2-ea33d1151f35 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:51.275513 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-24d3e64c-edc2-4ed4-80d2-ea33d1151f35 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:40:51.283436 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-24d3e64c-edc2-4ed4-80d2-ea33d1151f35 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1557 microversion: 2.1 time: 0.158986 Jul 26 15:40:51.284633 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3581/7277] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:40:51 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:40:52.882532 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1bb82351-a6f8-49df-8600-38ce76ce222c req-da587d56-a837-4a5a-a48a-8c691e2b090b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ffcf02-af20-4872-b699-35b7a57782a9", "tag": "2598c415-0bcd-4b28-b83c-7d32a63034f2"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:40:52.893159 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1bb82351-a6f8-49df-8600-38ce76ce222c req-da587d56-a837-4a5a-a48a-8c691e2b090b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:40:52.893696 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1bb82351-a6f8-49df-8600-38ce76ce222c req-da587d56-a837-4a5a-a48a-8c691e2b090b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:40:52.905215 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1bb82351-a6f8-49df-8600-38ce76ce222c req-da587d56-a837-4a5a-a48a-8c691e2b090b service nova] Creating event network-changed:2598c415-0bcd-4b28-b83c-7d32a63034f2 for instance 04ffcf02-af20-4872-b699-35b7a57782a9 on n-h2-833090-9 Jul 26 15:40:52.910777 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1bb82351-a6f8-49df-8600-38ce76ce222c req-da587d56-a837-4a5a-a48a-8c691e2b090b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032479 Jul 26 15:40:52.911345 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3697/7278] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:41:18.503349 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:41:18.504569 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:41:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:41:18.773010 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:41:18.773216 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:41:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:42:21.682928 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=24 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:21.683640 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=42 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:21.688580 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-b5703f24-cb3e-4ee1-bbac-5a075b0caa43 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1919460712"}} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:21.691764 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-b5703f24-cb3e-4ee1-bbac-5a075b0caa43 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:21.699209 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5703f24-cb3e-4ee1-bbac-5a075b0caa43 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:21.699667 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5703f24-cb3e-4ee1-bbac-5a075b0caa43 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:21.700680 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5703f24-cb3e-4ee1-bbac-5a075b0caa43 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:21.701167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-b5703f24-cb3e-4ee1-bbac-5a075b0caa43 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:21.906286 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-b5703f24-cb3e-4ee1-bbac-5a075b0caa43 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "POST /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9/action" status: 202 len: 0 microversion: 2.1 time: 0.225207 Jul 26 15:42:21.906942 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3582/7279] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Jul 26 15:42:21 2022] POST /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 26 15:42:27.132843 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:27.133894 n-d-833090-9 devstack@n-api.service[119479]: DEBUG dbcounter [-] [119479] Writing DB stats nova_cell1:SELECT=58 {{(pid=119479) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:27.140990 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-1b1b0e77-7c5c-4038-a27b-0b9a0bb6139b req-b3e3ea53-a603-4321-bf9d-ec08272deee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ffcf02-af20-4872-b699-35b7a57782a9", "name": "network-vif-plugged", "status": "completed", "tag": "2598c415-0bcd-4b28-b83c-7d32a63034f2"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:27.156086 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1b1b0e77-7c5c-4038-a27b-0b9a0bb6139b req-b3e3ea53-a603-4321-bf9d-ec08272deee7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:27.157016 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-1b1b0e77-7c5c-4038-a27b-0b9a0bb6139b req-b3e3ea53-a603-4321-bf9d-ec08272deee7 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:27.172103 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-1b1b0e77-7c5c-4038-a27b-0b9a0bb6139b req-b3e3ea53-a603-4321-bf9d-ec08272deee7 service nova] Creating event network-vif-plugged:2598c415-0bcd-4b28-b83c-7d32a63034f2 for instance 04ffcf02-af20-4872-b699-35b7a57782a9 on n-h2-833090-9 Jul 26 15:42:27.179116 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-1b1b0e77-7c5c-4038-a27b-0b9a0bb6139b req-b3e3ea53-a603-4321-bf9d-ec08272deee7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050689 Jul 26 15:42:27.180505 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3698/7280] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:36.876959 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-af80bd49-31ef-4125-a80a-d0f9431df005 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:36.877575 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-af80bd49-31ef-4125-a80a-d0f9431df005 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:36.880813 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_api:SELECT=2 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:36.881498 n-d-833090-9 devstack@n-api.service[119478]: DEBUG dbcounter [-] [119478] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:42:36.883774 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [req-b1e27bf0-151f-4108-a917-205aa9214645 req-b1ab4dea-70d9-4630-b551-8e19e6e9f166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ffcf02-af20-4872-b699-35b7a57782a9", "tag": "2598c415-0bcd-4b28-b83c-7d32a63034f2"}]} {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:36.887242 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af80bd49-31ef-4125-a80a-d0f9431df005 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:36.887702 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af80bd49-31ef-4125-a80a-d0f9431df005 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:36.888555 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af80bd49-31ef-4125-a80a-d0f9431df005 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:36.889167 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-af80bd49-31ef-4125-a80a-d0f9431df005 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:36.896360 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b1e27bf0-151f-4108-a917-205aa9214645 req-b1ab4dea-70d9-4630-b551-8e19e6e9f166 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:36.896996 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [req-b1e27bf0-151f-4108-a917-205aa9214645 req-b1ab4dea-70d9-4630-b551-8e19e6e9f166 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:36.910854 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.compute.server_external_events [req-b1e27bf0-151f-4108-a917-205aa9214645 req-b1ab4dea-70d9-4630-b551-8e19e6e9f166 service nova] Creating event network-changed:2598c415-0bcd-4b28-b83c-7d32a63034f2 for instance 04ffcf02-af20-4872-b699-35b7a57782a9 on n-h2-833090-9 Jul 26 15:42:36.917081 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [req-b1e27bf0-151f-4108-a917-205aa9214645 req-b1ab4dea-70d9-4630-b551-8e19e6e9f166 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041010 Jul 26 15:42:36.918211 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3699/7281] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:36.921398 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-af80bd49-31ef-4125-a80a-d0f9431df005 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Going to try to terminate instance {{(pid=119478) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:42:37.016906 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-af80bd49-31ef-4125-a80a-d0f9431df005 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "DELETE /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 204 len: 0 microversion: 2.1 time: 0.144002 Jul 26 15:42:37.017710 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3583/7282] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:42:36 2022] DELETE /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:42:37.028754 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-80430845-3f6f-4b2e-b9ed-b9b406051e6c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:37.029512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-80430845-3f6f-4b2e-b9ed-b9b406051e6c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:37.037401 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80430845-3f6f-4b2e-b9ed-b9b406051e6c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:37.037863 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80430845-3f6f-4b2e-b9ed-b9b406051e6c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:37.038677 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80430845-3f6f-4b2e-b9ed-b9b406051e6c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:37.039330 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-80430845-3f6f-4b2e-b9ed-b9b406051e6c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:37.212496 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-80430845-3f6f-4b2e-b9ed-b9b406051e6c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:37.220671 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-80430845-3f6f-4b2e-b9ed-b9b406051e6c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1682 microversion: 2.1 time: 0.197232 Jul 26 15:42:37.221266 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3700/7283] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:42:37 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:37.398767 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-877798df-5a10-4b94-a419-023e6b5b85ac req-1294288a-65de-4c66-9557-28acad3d2c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ffcf02-af20-4872-b699-35b7a57782a9", "name": "network-vif-unplugged", "status": "completed", "tag": "2598c415-0bcd-4b28-b83c-7d32a63034f2"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:37.412602 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-877798df-5a10-4b94-a419-023e6b5b85ac req-1294288a-65de-4c66-9557-28acad3d2c1b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:37.413135 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-877798df-5a10-4b94-a419-023e6b5b85ac req-1294288a-65de-4c66-9557-28acad3d2c1b service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:37.426846 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-877798df-5a10-4b94-a419-023e6b5b85ac req-1294288a-65de-4c66-9557-28acad3d2c1b service nova] Creating event network-vif-unplugged:2598c415-0bcd-4b28-b83c-7d32a63034f2 for instance 04ffcf02-af20-4872-b699-35b7a57782a9 on n-h2-833090-9 Jul 26 15:42:37.434773 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-877798df-5a10-4b94-a419-023e6b5b85ac req-1294288a-65de-4c66-9557-28acad3d2c1b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040478 Jul 26 15:42:37.435939 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3584/7284] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:38.243468 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-08a9e326-a7a9-4323-8f3a-06d783e1da5e tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:38.244662 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-08a9e326-a7a9-4323-8f3a-06d783e1da5e tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:38.252404 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08a9e326-a7a9-4323-8f3a-06d783e1da5e tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:38.253483 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08a9e326-a7a9-4323-8f3a-06d783e1da5e tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:38.254384 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08a9e326-a7a9-4323-8f3a-06d783e1da5e tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:38.254919 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-08a9e326-a7a9-4323-8f3a-06d783e1da5e tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:38.421786 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-08a9e326-a7a9-4323-8f3a-06d783e1da5e tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:38.430863 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-08a9e326-a7a9-4323-8f3a-06d783e1da5e tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1682 microversion: 2.1 time: 0.191648 Jul 26 15:42:38.431519 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3701/7285] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:42:38 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:39.259906 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-fe277198-19af-4b99-a855-3df8010d7cd7 req-b9e7b23c-0bbb-4e98-b4a8-2c3c0b5fdfcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ffcf02-af20-4872-b699-35b7a57782a9", "name": "network-vif-deleted", "tag": "2598c415-0bcd-4b28-b83c-7d32a63034f2"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:39.270568 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fe277198-19af-4b99-a855-3df8010d7cd7 req-b9e7b23c-0bbb-4e98-b4a8-2c3c0b5fdfcc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:39.270932 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-fe277198-19af-4b99-a855-3df8010d7cd7 req-b9e7b23c-0bbb-4e98-b4a8-2c3c0b5fdfcc service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:39.282455 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-fe277198-19af-4b99-a855-3df8010d7cd7 req-b9e7b23c-0bbb-4e98-b4a8-2c3c0b5fdfcc service nova] Creating event network-vif-deleted:2598c415-0bcd-4b28-b83c-7d32a63034f2 for instance 04ffcf02-af20-4872-b699-35b7a57782a9 on n-h2-833090-9 Jul 26 15:42:39.287589 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-fe277198-19af-4b99-a855-3df8010d7cd7 req-b9e7b23c-0bbb-4e98-b4a8-2c3c0b5fdfcc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032565 Jul 26 15:42:39.288122 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3585/7286] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:39.455056 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:39.455697 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:39.463833 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:39.464279 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:39.465088 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:39.465553 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:39.500790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:39.501273 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:39.501756 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lazy-loading 'fault' on Instance uuid 04ffcf02-af20-4872-b699-35b7a57782a9 {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:42:39.550175 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:39.558638 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-980148ea-7b88-4f67-a0af-011ee6e933d1 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 200 len: 1338 microversion: 2.1 time: 0.107533 Jul 26 15:42:39.559456 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3702/7287] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:42:39 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 1338 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:40.582170 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee3a78cf-9677-447a-a31e-40e527562cbf tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:40.582903 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-ee3a78cf-9677-447a-a31e-40e527562cbf tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: 04ffcf02-af20-4872-b699-35b7a57782a9] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:40.589262 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee3a78cf-9677-447a-a31e-40e527562cbf tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:40.589710 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee3a78cf-9677-447a-a31e-40e527562cbf tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:40.590478 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee3a78cf-9677-447a-a31e-40e527562cbf tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:40.590916 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-ee3a78cf-9677-447a-a31e-40e527562cbf tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:40.605432 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-ee3a78cf-9677-447a-a31e-40e527562cbf tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] HTTP exception thrown: Instance 04ffcf02-af20-4872-b699-35b7a57782a9 could not be found. Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee3a78cf-9677-447a-a31e-40e527562cbf tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Request method failure captured: Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 HTTP/1.1 Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4ApfVRgAxHc1aM9atLq8lW9YEKKg6SAhkZ-RbDMfMxBpRorycVh1z3fY8ZR8TLQHEJ3dXhVzJ3qVYK4ij4lZ_fWztYhawvUKylZa_HmE8Evh9i_RNqH8A1ks8wUHKLvAm0rgaovnCYgd-py2CbhenKQ7h0FvHqfIHjF-5sLds-jtPAI Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2971acaa234b4d6fb16f84de75420339 Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestSnapshotPattern-804732794 Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2971acaa234b4d6fb16f84de75420339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2971acaa234b4d6fb16f84de75420339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2971acaa234b4d6fb16f84de75420339", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2971acaa234b4d6fb16f84de75420339"}]}] Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestSnapshotPattern-804732794 Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2971acaa234b4d6fb16f84de75420339 Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestSnapshotPattern-804732794 Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestSnapshotPattern-804732794-project Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 667e41cb1fa541859bdfb335caf66c40 Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestSnapshotPattern-804732794-project Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance 04ffcf02-af20-4872-b699-35b7a57782a9 could not be found. Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': '04ffcf02-af20-4872-b699-35b7a57782a9'} Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04ffcf02-af20-4872-b699-35b7a57782a9 could not be found. Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04ffcf02-af20-4872-b699-35b7a57782a9 could not be found. Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:42:40.607062 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:42:40.611991 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:42:40.611991 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:42:40.611991 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:42:40.611991 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:42:40.611991 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:42:40.611991 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04ffcf02-af20-4872-b699-35b7a57782a9 could not be found. Jul 26 15:42:40.611991 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:42:40.611991 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-ee3a78cf-9677-447a-a31e-40e527562cbf tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Returning 404 to user: Instance 04ffcf02-af20-4872-b699-35b7a57782a9 could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:42:40.611991 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-ee3a78cf-9677-447a-a31e-40e527562cbf tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9" status: 404 len: 111 microversion: 2.1 time: 0.032162 Jul 26 15:42:40.611991 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3586/7288] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:42:40 2022] GET /compute/v2.1/servers/04ffcf02-af20-4872-b699-35b7a57782a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:42:41.951822 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-58ee4fd4-7077-4f1d-a76b-b6c7859b3d37 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:41.952369 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-58ee4fd4-7077-4f1d-a76b-b6c7859b3d37 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:41.953829 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-538736e5-ed2f-48a8-b6ce-48c2e634672e req-c06555ee-df23-4856-9f1b-2d86caa0612d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f2de6e-db1a-48b7-ac0b-65c2506ad32e", "tag": "a756bf05-dd20-469c-816c-cc618c1053ed"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:41.961193 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58ee4fd4-7077-4f1d-a76b-b6c7859b3d37 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:41.961681 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58ee4fd4-7077-4f1d-a76b-b6c7859b3d37 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:41.962512 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58ee4fd4-7077-4f1d-a76b-b6c7859b3d37 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:41.962976 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-58ee4fd4-7077-4f1d-a76b-b6c7859b3d37 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:41.966428 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-538736e5-ed2f-48a8-b6ce-48c2e634672e req-c06555ee-df23-4856-9f1b-2d86caa0612d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:41.966939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-538736e5-ed2f-48a8-b6ce-48c2e634672e req-c06555ee-df23-4856-9f1b-2d86caa0612d service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:41.978365 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-538736e5-ed2f-48a8-b6ce-48c2e634672e req-c06555ee-df23-4856-9f1b-2d86caa0612d service nova] Creating event network-changed:a756bf05-dd20-469c-816c-cc618c1053ed for instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e on n-h1-833090-9 Jul 26 15:42:41.983797 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-538736e5-ed2f-48a8-b6ce-48c2e634672e req-c06555ee-df23-4856-9f1b-2d86caa0612d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033760 Jul 26 15:42:41.984692 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3587/7289] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:41.994693 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-58ee4fd4-7077-4f1d-a76b-b6c7859b3d37 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Going to try to terminate instance {{(pid=119479) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:42:42.085085 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-58ee4fd4-7077-4f1d-a76b-b6c7859b3d37 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 204 len: 0 microversion: 2.1 time: 0.137066 Jul 26 15:42:42.086604 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3703/7290] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Jul 26 15:42:41 2022] DELETE /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:42:42.095358 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-67f39f63-72ea-4f1e-b71a-108dbfedbf81 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:42.096232 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-67f39f63-72ea-4f1e-b71a-108dbfedbf81 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:42.103427 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67f39f63-72ea-4f1e-b71a-108dbfedbf81 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:42.104495 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67f39f63-72ea-4f1e-b71a-108dbfedbf81 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:42.105400 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67f39f63-72ea-4f1e-b71a-108dbfedbf81 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:42.105939 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-67f39f63-72ea-4f1e-b71a-108dbfedbf81 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:42.258940 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.policy [None req-67f39f63-72ea-4f1e-b71a-108dbfedbf81 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119478) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:42.268084 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-67f39f63-72ea-4f1e-b71a-108dbfedbf81 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1683 microversion: 2.1 time: 0.176748 Jul 26 15:42:42.269386 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3588/7291] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:42:42 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:42:43.291417 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-f1796e54-bd44-46c7-b97b-83690e1468cc tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:43.292094 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-f1796e54-bd44-46c7-b97b-83690e1468cc tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:43.299049 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1796e54-bd44-46c7-b97b-83690e1468cc tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:43.299589 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1796e54-bd44-46c7-b97b-83690e1468cc tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:43.300790 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1796e54-bd44-46c7-b97b-83690e1468cc tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:43.301410 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-f1796e54-bd44-46c7-b97b-83690e1468cc tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:43.441579 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-f1796e54-bd44-46c7-b97b-83690e1468cc tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:43.449126 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-f1796e54-bd44-46c7-b97b-83690e1468cc tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1683 microversion: 2.1 time: 0.162194 Jul 26 15:42:43.449698 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3704/7292] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:42:43 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:44.425777 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [req-b98eac8f-36d0-4ab2-99ca-ffa7fb440573 req-62d0aa25-4bb1-43a6-949d-d3ff209c2814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f2de6e-db1a-48b7-ac0b-65c2506ad32e", "name": "network-vif-deleted", "tag": "a756bf05-dd20-469c-816c-cc618c1053ed"}]} {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:42:44.436708 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b98eac8f-36d0-4ab2-99ca-ffa7fb440573 req-62d0aa25-4bb1-43a6-949d-d3ff209c2814 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:44.437146 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [req-b98eac8f-36d0-4ab2-99ca-ffa7fb440573 req-62d0aa25-4bb1-43a6-949d-d3ff209c2814 service nova] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:44.452459 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.compute.server_external_events [req-b98eac8f-36d0-4ab2-99ca-ffa7fb440573 req-62d0aa25-4bb1-43a6-949d-d3ff209c2814 service nova] Creating event network-vif-deleted:a756bf05-dd20-469c-816c-cc618c1053ed for instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e on n-h1-833090-9 Jul 26 15:42:44.458723 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [req-b98eac8f-36d0-4ab2-99ca-ffa7fb440573 req-62d0aa25-4bb1-43a6-949d-d3ff209c2814 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098997 Jul 26 15:42:44.459448 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3589/7293] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Jul 26 15:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:42:44.471555 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:44.472306 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.compute.api [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119479) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:44.479250 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:44.479733 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:44.480567 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:44.481031 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:44.513758 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:44.514236 n-d-833090-9 devstack@n-api.service[119479]: DEBUG oslo_concurrency.lockutils [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119479) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:44.514712 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.objects.instance [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lazy-loading 'fault' on Instance uuid b7f2de6e-db1a-48b7-ac0b-65c2506ad32e {{(pid=119479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:42:44.559008 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.policy [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '667e41cb1fa541859bdfb335caf66c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2971acaa234b4d6fb16f84de75420339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119479) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:42:44.568620 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-bf3c9828-746a-410c-8909-73304ca84159 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 200 len: 1339 microversion: 2.1 time: 0.100893 Jul 26 15:42:44.569227 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3705/7294] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:42:44 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:42:45.591113 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8727baf8-5d8d-4eec-81fb-7d1a4b2a7f1c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '>' {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:45.591969 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.compute.api [None req-8727baf8-5d8d-4eec-81fb-7d1a4b2a7f1c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [instance: b7f2de6e-db1a-48b7-ac0b-65c2506ad32e] Fetching instance by UUID {{(pid=119478) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:42:45.599891 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8727baf8-5d8d-4eec-81fb-7d1a4b2a7f1c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:45.600308 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8727baf8-5d8d-4eec-81fb-7d1a4b2a7f1c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:45.601121 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8727baf8-5d8d-4eec-81fb-7d1a4b2a7f1c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:42:45.601585 n-d-833090-9 devstack@n-api.service[119478]: DEBUG oslo_concurrency.lockutils [None req-8727baf8-5d8d-4eec-81fb-7d1a4b2a7f1c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Lock "b932038d-06d1-4ca1-bcc6-753a97a3adde" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:42:45.615505 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.wsgi [None req-8727baf8-5d8d-4eec-81fb-7d1a4b2a7f1c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] HTTP exception thrown: Instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e could not be found. Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8727baf8-5d8d-4eec-81fb-7d1a4b2a7f1c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Request method failure captured: Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: request: GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e HTTP/1.1 Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: Accept: application/json Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: Accept-Encoding: identity Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: Connection: close Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: Content-Length: 0 Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: Content-Type: application/json Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: Host: 10.222.0.70 Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: Openstack-System-Scope: None Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: User-Agent: python-urllib3/1.26.10 Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Auth-Token: gAAAAABi4ApfVRgAxHc1aM9atLq8lW9YEKKg6SAhkZ-RbDMfMxBpRorycVh1z3fY8ZR8TLQHEJ3dXhVzJ3qVYK4ij4lZ_fWztYhawvUKylZa_HmE8Evh9i_RNqH8A1ks8wUHKLvAm0rgaovnCYgd-py2CbhenKQ7h0FvHqfIHjF-5sLds-jtPAI Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Id: None Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Domain-Name: None Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Identity-Status: Confirmed Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Is-Admin-Project: True Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Id: default Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Domain-Name: Default Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Id: 2971acaa234b4d6fb16f84de75420339 Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Project-Name: tempest-TestSnapshotPattern-804732794 Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Role: member,reader Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Roles: member,reader Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2971acaa234b4d6fb16f84de75420339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2971acaa234b4d6fb16f84de75420339"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2971acaa234b4d6fb16f84de75420339", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2971acaa234b4d6fb16f84de75420339"}]}] Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant: tempest-TestSnapshotPattern-804732794 Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Id: 2971acaa234b4d6fb16f84de75420339 Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-Tenant-Name: tempest-TestSnapshotPattern-804732794 Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-User: tempest-TestSnapshotPattern-804732794-project Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Id: default Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-User-Domain-Name: Default Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-User-Id: 667e41cb1fa541859bdfb335caf66c40 Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: X-User-Name: tempest-TestSnapshotPattern-804732794-project Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: method: > Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: exception: Instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e could not be found. Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: action_args: {'id': 'b7f2de6e-db1a-48b7-ac0b-65c2506ad32e'} Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: {{(pid=119478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e could not be found. Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e could not be found. Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:42:45.617199 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:42:45.622073 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:42:45.622073 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:42:45.622073 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:42:45.622073 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:42:45.622073 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:42:45.622073 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e could not be found. Jul 26 15:42:45.622073 n-d-833090-9 devstack@n-api.service[119478]: ERROR nova.api.openstack.wsgi Jul 26 15:42:45.622073 n-d-833090-9 devstack@n-api.service[119478]: DEBUG nova.api.openstack.wsgi [None req-8727baf8-5d8d-4eec-81fb-7d1a4b2a7f1c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Returning 404 to user: Instance b7f2de6e-db1a-48b7-ac0b-65c2506ad32e could not be found. {{(pid=119478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:42:45.622073 n-d-833090-9 devstack@n-api.service[119478]: INFO nova.api.openstack.requestlog [None req-8727baf8-5d8d-4eec-81fb-7d1a4b2a7f1c tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e" status: 404 len: 111 microversion: 2.1 time: 0.032878 Jul 26 15:42:45.631279 n-d-833090-9 devstack@n-api.service[119478]: [pid: 119478|app: 0|req: 3590/7295] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Jul 26 15:42:45 2022] GET /compute/v2.1/servers/b7f2de6e-db1a-48b7-ac0b-65c2506ad32e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:42:45.791087 n-d-833090-9 devstack@n-api.service[119479]: DEBUG nova.api.openstack.wsgi [None req-233ca388-8e96-41e9-9c4e-d7d04133b734 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] Calling method '.version_select at 0x7f8787fe28b0>' {{(pid=119479) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:42:45.796784 n-d-833090-9 devstack@n-api.service[119479]: ERROR oslo.messaging._drivers.impl_rabbit [None req-233ca388-8e96-41e9-9c4e-d7d04133b734 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [164a6d72-fc25-48d3-9ea9-de7d68fca0a8] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 15:42:46.806263 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [None req-233ca388-8e96-41e9-9c4e-d7d04133b734 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] [164a6d72-fc25-48d3-9ea9-de7d68fca0a8] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 55208. Jul 26 15:42:46.826896 n-d-833090-9 devstack@n-api.service[119479]: INFO nova.api.openstack.requestlog [None req-233ca388-8e96-41e9-9c4e-d7d04133b734 tempest-TestSnapshotPattern-804732794 tempest-TestSnapshotPattern-804732794-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1842177823" status: 202 len: 0 microversion: 2.1 time: 1.039544 Jul 26 15:42:46.827489 n-d-833090-9 devstack@n-api.service[119479]: [pid: 119479|app: 0|req: 3706/7296] 10.222.0.70 () {58 vars in 1257 bytes} [Tue Jul 26 15:42:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1842177823 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:42:58.397803 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:42:58.398513 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:42:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:44:38.512641 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:44:38.513267 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:44:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:44:38.782227 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:44:38.782437 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:44:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:46:18.423067 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:46:18.423695 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:47:58.354890 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:47:58.355645 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:47:58.522261 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:47:58.522877 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:47:58.791653 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:47:58.791915 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:48:11.568825 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:48:11.569608 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:48:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:48:37.628642 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:48:37.629242 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:48:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:49:38.435080 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:49:38.435679 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:49:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:51:18.364240 n-d-833090-9 devstack@n-api.service[119479]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:51:18.364987 n-d-833090-9 devstack@n-api.service[119479]: Tue Jul 26 15:51:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:51:18.531914 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:51:18.532655 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:51:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:51:18.801329 n-d-833090-9 devstack@n-api.service[119478]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:51:18.801526 n-d-833090-9 devstack@n-api.service[119478]: Tue Jul 26 15:51:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!